2023-10-09T11:22:25.889 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T11:22:25.890 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423 --name vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/orig.config.yaml 2023-10-09T11:22:25.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:22:26.040 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: vshankar@redhat.com first_in_suite: false job_id: '7418423' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231009.111138 sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-vshankar-testing-20231009.111138 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: c68c3f491122d7c1646aa58425d37dc1a8b276ba targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbPPd4qgmh4rOUyLxbWXr31ScyeBsHgy2YCgau6CW/kJj2R1U/IbwHWREVU0lCO50r3uNbB0SfJdtnBbcB4IKk= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDceSactrI1vpiOAbWL7HOQAHEujhYkixJ9U/iCrhQ6ukDarDM/3FBgtruKQ8aFRD37qGoaH1bAEP5KqM1vZCPY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_11:13:22 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T11:22:26.041 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa; will attempt to use it 2023-10-09T11:22:26.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa/tasks 2023-10-09T11:22:26.042 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T11:22:26.046 INFO:teuthology.task.internal:Checking packages... 2023-10-09T11:22:26.066 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T11:22:26.066 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T11:22:26.067 INFO:teuthology.packaging:ref: None 2023-10-09T11:22:26.067 INFO:teuthology.packaging:tag: None 2023-10-09T11:22:26.067 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:22:26.067 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:22:26.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T11:22:26.300 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T11:22:26.300 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T11:22:26.313 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T11:22:26.313 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T11:22:26.320 INFO:teuthology.task.internal:Saving configuration 2023-10-09T11:22:26.348 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T11:22:26.359 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:22:26.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.244289', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbPPd4qgmh4rOUyLxbWXr31ScyeBsHgy2YCgau6CW/kJj2R1U/IbwHWREVU0lCO50r3uNbB0SfJdtnBbcB4IKk='} 2023-10-09T11:22:26.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.246048', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDceSactrI1vpiOAbWL7HOQAHEujhYkixJ9U/iCrhQ6ukDarDM/3FBgtruKQ8aFRD37qGoaH1bAEP5KqM1vZCPY='} 2023-10-09T11:22:26.414 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T11:22:26.421 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T11:22:26.421 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T11:22:26.421 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T11:22:26.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb95a287b80>, signals=[15]) 2023-10-09T11:22:26.501 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T11:22:26.509 INFO:teuthology.task.internal:Opening connections... 2023-10-09T11:22:26.509 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:22:26.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:26.581 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:22:26.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:22:26.647 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T11:22:26.654 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-10-09T11:22:26.672 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-10-09T11:22:26.672 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-10-09T11:22:26.728 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.4" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:22:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:22:26.730 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:22:26.731 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-10-09T11:22:26.757 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-10-09T11:22:26.774 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-10-09T11:22:26.774 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-09T11:22:26.830 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T11:22:26.830 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T11:22:26.830 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-10-09T11:22:26.830 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.4" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T11:22:26.831 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T11:22:26.832 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T11:22:26.832 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-09T11:22:26.856 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T11:22:26.865 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T11:22:26.884 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T11:22:26.884 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:22:26.886 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-10-09T11:22:26.902 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T11:22:26.908 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T11:22:26.908 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:22:26.944 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-10-09T11:22:26.959 INFO:teuthology.orchestra.run.smithi006.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:22:26.960 INFO:teuthology.orchestra.run.smithi118.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T11:22:26.960 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T11:22:27.008 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T11:22:27.024 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T11:22:27.024 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-09T11:22:27.024 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-09T11:22:27.025 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:22:27.025 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T11:22:27.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:22:27.041 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-10-09T11:22:27.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:22:27.042 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-10-09T11:22:27.097 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:22:27.097 INFO:teuthology.task.kernel:Running kernel on smithi118: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:22:27.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2023-10-09T11:22:27.099 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:22:27.099 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T11:22:27.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-10-09T11:22:28.537 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:28.538 INFO:teuthology.orchestra.run.smithi118.stdout:Unable to read consumer identity 2023-10-09T11:22:28.598 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:28.599 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-09T11:22:30.054 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-09T11:22:30.628 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 30 MB/s | 16 MB 00:00 2023-10-09T11:22:31.009 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-09T11:22:31.581 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-10-09T11:22:34.124 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-09T11:22:34.866 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-09T11:22:34.886 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T11:22:34.886 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T11:22:34.886 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T11:22:35.047 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-09T11:22:35.048 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-10-09T11:22:35.048 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-09T11:22:35.153 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-10-09T11:22:35.519 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:35.519 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-09T11:22:35.532 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T11:22:35.533 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T11:22:35.533 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T11:22:35.681 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-09T11:22:35.682 INFO:teuthology.orchestra.run.smithi118.stdout:Nothing to do. 2023-10-09T11:22:35.682 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-09T11:22:35.825 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:01 ago on Mon 09 Oct 2023 11:22:34 AM UTC. 2023-10-09T11:22:35.862 DEBUG:teuthology.orchestra.run.smithi118:> echo no | sudo yum reinstall kernel || true 2023-10-09T11:22:35.990 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:22:35.990 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:35.990 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-09T11:22:36.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-10-09T11:22:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:36.205 INFO:teuthology.orchestra.run.smithi118.stdout:Unable to read consumer identity 2023-10-09T11:22:36.431 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:36.432 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-09T11:22:36.497 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:22:34 AM UTC. 2023-10-09T11:22:36.629 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:22:36.629 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:36.629 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:36.668 INFO:teuthology.orchestra.run.smithi118.stderr:Error: No packages marked for reinstall. 2023-10-09T11:22:36.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum reinstall -y kernel || true 2023-10-09T11:22:36.732 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 11:22:34 AM UTC. 2023-10-09T11:22:36.873 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:22:36.874 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:36.874 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-09T11:22:36.937 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:22:37.059 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-09T11:22:37.059 INFO:teuthology.orchestra.run.smithi118.stdout:Unable to read consumer identity 2023-10-09T11:22:37.068 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.069 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.069 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.069 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T11:22:37.069 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T11:22:37.070 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-09T11:22:37.070 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T11:22:37.070 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:22:37.200 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.200 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2023-10-09T11:22:37.229 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2023-10-09T11:22:37.229 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2023-10-09T11:22:37.229 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.02 2023-10-09T11:22:37.230 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 99.el8_4.1 2023-10-09T11:22:37.230 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2023-10-09T11:22:37.230 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:22:37.230 INFO:teuthology.orchestra.run.smithi006.stdout:Group : System Environment/Base 2023-10-09T11:22:37.230 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 9264631 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Relocations : (not relocatable) 2023-10-09T11:22:37.231 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : Red Hat, Inc. 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:22:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:22:37.233 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:22:37.233 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:22:37.233 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2023-10-09T11:22:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:22:37.233 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:22:37.234 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:22:37.235 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:22:37.341 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:00:03 ago on Mon 09 Oct 2023 11:22:34 AM UTC. 2023-10-09T11:22:37.563 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T11:22:37.563 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:37.563 INFO:teuthology.orchestra.run.smithi118.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T11:22:37.582 INFO:teuthology.orchestra.run.smithi118.stderr:Error: No packages marked for reinstall. 2023-10-09T11:22:37.630 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:22:37.756 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.756 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.756 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.756 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T11:22:37.756 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T11:22:37.757 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-09T11:22:37.757 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T11:22:37.757 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T11:22:37.881 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.881 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.02 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 99.el8_4.1 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2023-10-09T11:22:37.909 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Group : System Environment/Base 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 9264631 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Relocations : (not relocatable) 2023-10-09T11:22:37.910 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : Red Hat, Inc. 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : Red Hat, Inc. 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:22:37.911 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T11:22:37.912 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T11:22:37.913 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:37.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T11:22:38.473 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-10-09T11:22:38.992 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-10-09T11:22:40.255 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-10-09T11:22:40.256 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-10-09T11:22:40.279 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.73Vx14O0BH 2023-10-09T11:22:40.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.73Vx14O0BH 2023-10-09T11:22:40.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.73Vx14O0BH 2023-10-09T11:22:40.504 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.73Vx14O0BH is 6KB 2023-10-09T11:22:40.552 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.73Vx14O0BH 2023-10-09T11:22:40.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:22:40.636 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:22:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:22:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:22:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:22:40.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:40.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2023-10-09T11:22:40.867 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-10-09T11:22:40.868 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-10-09T11:22:40.882 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.99yQne9u7o 2023-10-09T11:22:40.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.99yQne9u7o 2023-10-09T11:22:40.961 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.99yQne9u7o 2023-10-09T11:22:41.134 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.99yQne9u7o is 6KB 2023-10-09T11:22:41.182 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.99yQne9u7o 2023-10-09T11:22:41.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T11:22:41.265 INFO:teuthology.orchestra.run.smithi118.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T11:22:41.265 INFO:teuthology.orchestra.run.smithi118.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T11:22:41.266 INFO:teuthology.orchestra.run.smithi118.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T11:22:41.266 INFO:teuthology.orchestra.run.smithi118.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T11:22:41.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T11:22:41.438 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-10-09T11:23:10.846 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T11:23:10.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:23:10.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:11.442 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T11:23:11.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:23:11.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:29.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-10-09T11:23:29.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-09T11:23:38.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:23:38.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:38.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:23:38.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:41.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-09T11:23:53.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:23:53.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:23:56.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-09T11:24:11.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:24:11.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:38.313 DEBUG:teuthology.orchestra.remote:timed out 2023-10-09T11:24:44.643 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-09T11:24:45.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:24:45.141 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T11:24:45.141 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-10-09T11:24:45.194 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T11:24:45.195 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:24:45.195 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:24:45.195 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:24:46.196 DEBUG:teuthology.parallel:result is None 2023-10-09T11:24:50.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:24:50.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:24:50.564 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-10-09T11:24:50.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:24:50.866 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T11:24:50.867 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-10-09T11:24:50.882 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T11:24:50.883 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T11:24:50.883 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T11:24:50.883 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T11:24:51.884 DEBUG:teuthology.parallel:result is None 2023-10-09T11:24:51.884 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T11:24:51.893 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T11:24:51.893 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:24:51.895 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T11:24:51.913 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T11:24:51.920 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T11:24:51.932 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T11:24:51.932 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:24:51.953 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T11:24:51.992 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T11:24:52.000 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T11:24:52.000 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:24:52.017 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T11:24:52.098 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:24:52.116 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:24:52.191 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:24:52.210 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T11:24:52.211 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T11:24:52.218 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T11:24:52.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:24:52.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T11:24:52.248 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T11:24:52.257 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T11:24:52.257 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:24:52.290 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T11:24:52.305 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:24:52.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:24:52.457 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:24:52.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:24:52.541 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:24:52.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:24:52.608 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:24:52.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T11:24:52.731 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:24:52.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T11:24:52.814 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:24:52.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T11:24:52.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-10-09T11:24:52.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-10-09T11:24:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:24:52.996 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:24:53.384 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T11:24:53.394 INFO:teuthology.task.internal:Starting timer... 2023-10-09T11:24:53.394 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T11:24:53.411 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T11:24:53.427 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T11:24:53.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-10-09T11:24:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: [ OK ] 2023-10-09T11:24:53.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-10-09T11:24:53.586 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: [ OK ] 2023-10-09T11:24:53.587 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T11:24:53.587 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-10-09T11:24:53.613 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-10-09T11:24:53.614 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-10-09T11:24:53.628 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-10-09T11:24:53.628 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2023-10-09T11:24:53.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:24:53.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:24:53.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:24:53.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:24:53.705 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T11:24:53.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:24:53.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-10-09T11:24:53.772 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T11:24:53.783 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-09T11:24:53.788 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-09T11:24:53.910 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T11:24:53.925 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T11:24:53.961 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T11:33:23.924 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2023-10-09T11:33:23.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:33:23.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:33:23.999 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-10-09T11:33:24.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-09T11:33:24.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:33:24.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T11:33:24.135 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-09T11:33:24.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-09T11:33:24.198 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T11:33:24.209 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T11:33:24.209 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:33:24.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:33:24.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T11:33:24.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:33:24.240 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:33:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:33:24.266 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T11:33:24.281 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T11:33:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-10-09T11:33:24.302 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-10-09T11:33:24.316 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-10-09T11:33:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:33:24.326 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-10-09T11:33:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:33:24.340 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T11:33:24.353 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T11:33:24.400 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:210 Number of sources = 4 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.412 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-09T11:33:24.414 INFO:teuthology.orchestra.run.smithi118.stdout:210 Number of sources = 4 2023-10-09T11:33:24.414 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:33:24.414 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-09T11:33:24.415 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.415 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.415 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.415 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:33:24.416 INFO:teuthology.run_tasks:Running task install... 2023-10-09T11:33:24.424 DEBUG:teuthology.task.install:project ceph 2023-10-09T11:33:24.424 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T11:33:24.424 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T11:33:24.425 INFO:teuthology.task.install:Using flavor: default 2023-10-09T11:33:24.433 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T11:33:24.433 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T11:33:24.434 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:33:24.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:33:24.436 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T11:33:24.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:33:24.580 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:33:24.580 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:33:24.586 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T11:33:24.586 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T11:33:24.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:33:24.694 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:33:24.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:33:24.719 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:33:24.719 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:33:24.746 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T11:33:24.746 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:33:24.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T11:33:24.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T11:33:24.774 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T11:33:24.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:33:24.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T11:33:24.858 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:33:24.916 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T11:33:24.922 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-10-09T11:33:24.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-10-09T11:33:24.980 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-10-09T11:33:24.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-10-09T11:33:25.310 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-09T11:33:25.392 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-09T11:33:25.695 INFO:teuthology.orchestra.run.smithi118.stdout:44 files removed 2023-10-09T11:33:25.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:33:25.788 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-10-09T11:33:25.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T11:33:26.103 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-09T11:33:26.218 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-09T11:33:26.939 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 211 kB/s | 78 kB 00:00 2023-10-09T11:33:26.994 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 272 kB/s | 78 kB 00:00 2023-10-09T11:33:27.282 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-09T11:33:27.286 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-09T11:33:27.554 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2023-10-09T11:33:27.615 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-09T11:33:27.669 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-10-09T11:33:27.725 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-09T11:33:28.454 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-10-09T11:33:29.343 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-09T11:33:32.010 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 2.8 MB/s | 24 kB 00:00 2023-10-09T11:33:32.658 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-09T11:33:32.676 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 38 MB 00:00 2023-10-09T11:33:33.429 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 33 MB 00:00 2023-10-09T11:33:38.820 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 38 MB 00:00 2023-10-09T11:33:38.944 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 33 MB 00:00 2023-10-09T11:33:47.243 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:33:47.243 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:33:47.254 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:33:47.255 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:33:47.256 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:33:47.257 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:33:47.258 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:33:47.261 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:33:47.261 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:33:47.431 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:33:47.431 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T11:33:47.443 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T11:33:47.444 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T11:33:47.445 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T11:33:47.445 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T11:33:47.447 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T11:33:47.450 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T11:33:47.450 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T11:33:47.754 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:33:47.766 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:33:47.767 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:33:47.768 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:33:47.769 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:33:47.770 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:33:47.771 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:33:47.772 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:33:47.773 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:33:47.774 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:33:47.775 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:33:47.776 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:33:47.777 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:33:47.778 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-09T11:33:47.779 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================================================== 2023-10-09T11:33:47.779 INFO:teuthology.orchestra.run.smithi118.stdout:Install 118 Packages 2023-10-09T11:33:47.779 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 2 Packages 2023-10-09T11:33:47.779 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:33:47.779 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 202 M 2023-10-09T11:33:47.780 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-10-09T11:33:47.965 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T11:33:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T11:33:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T11:33:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-10-09T11:33:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T11:33:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T11:33:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T11:33:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T11:33:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T11:33:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T11:33:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T11:33:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-10-09T11:33:47.990 INFO:teuthology.orchestra.run.smithi006.stdout:====================================================================================================================== 2023-10-09T11:33:47.991 INFO:teuthology.orchestra.run.smithi006.stdout:Install 118 Packages 2023-10-09T11:33:47.991 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 2 Packages 2023-10-09T11:33:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:33:47.992 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 202 M 2023-10-09T11:33:47.992 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-10-09T11:33:48.116 INFO:teuthology.orchestra.run.smithi006.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 69 kB/s | 6.4 kB 00:00 2023-10-09T11:33:48.269 INFO:teuthology.orchestra.run.smithi006.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 5.6 MB/s | 876 kB 00:00 2023-10-09T11:33:48.290 INFO:teuthology.orchestra.run.smithi118.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 40 kB/s | 6.4 kB 00:00 2023-10-09T11:33:48.294 INFO:teuthology.orchestra.run.smithi006.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 6.5 MB/s | 162 kB 00:00 2023-10-09T11:33:48.572 INFO:teuthology.orchestra.run.smithi006.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 8.3 MB/s | 2.3 MB 00:00 2023-10-09T11:33:48.757 INFO:teuthology.orchestra.run.smithi006.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 8.5 MB/s | 1.6 MB 00:00 2023-10-09T11:33:49.084 INFO:teuthology.orchestra.run.smithi006.stdout:(6/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 4.9 MB/s | 5.2 MB 00:01 2023-10-09T11:33:49.271 INFO:teuthology.orchestra.run.smithi006.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 7.7 MB/s | 3.9 MB 00:00 2023-10-09T11:33:49.348 INFO:teuthology.orchestra.run.smithi118.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 828 kB/s | 876 kB 00:01 2023-10-09T11:33:49.485 INFO:teuthology.orchestra.run.smithi118.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.2 MB/s | 162 kB 00:00 2023-10-09T11:33:50.771 INFO:teuthology.orchestra.run.smithi118.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.8 MB/s | 2.3 MB 00:01 2023-10-09T11:33:50.871 INFO:teuthology.orchestra.run.smithi006.stdout:(8/120): ceph-common-17.2.6-1320.g08cac018.el8. 8.2 MB/s | 23 MB 00:02 2023-10-09T11:33:50.928 INFO:teuthology.orchestra.run.smithi006.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 432 kB/s | 24 kB 00:00 2023-10-09T11:33:51.326 INFO:teuthology.orchestra.run.smithi006.stdout:(10/120): ceph-radosgw-17.2.6-1320.g08cac018.el 8.2 MB/s | 17 MB 00:02 2023-10-09T11:33:51.330 INFO:teuthology.orchestra.run.smithi118.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-10-09T11:33:51.382 INFO:teuthology.orchestra.run.smithi006.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 4.5 MB/s | 255 kB 00:00 2023-10-09T11:33:51.433 INFO:teuthology.orchestra.run.smithi006.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 486 kB/s | 25 kB 00:00 2023-10-09T11:33:51.579 INFO:teuthology.orchestra.run.smithi006.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.3 MB/s | 797 kB 00:00 2023-10-09T11:33:51.646 INFO:teuthology.orchestra.run.smithi006.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.5 MB/s | 174 kB 00:00 2023-10-09T11:33:51.711 INFO:teuthology.orchestra.run.smithi006.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.0 MB/s | 130 kB 00:00 2023-10-09T11:33:51.847 INFO:teuthology.orchestra.run.smithi006.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 3.6 MB/s | 507 kB 00:00 2023-10-09T11:33:52.050 INFO:teuthology.orchestra.run.smithi006.stdout:(17/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 5.6 MB/s | 17 MB 00:02 2023-10-09T11:33:52.124 INFO:teuthology.orchestra.run.smithi006.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 608 kB/s | 45 kB 00:00 2023-10-09T11:33:52.200 INFO:teuthology.orchestra.run.smithi006.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 1.5 MB/s | 115 kB 00:00 2023-10-09T11:33:52.263 INFO:teuthology.orchestra.run.smithi006.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 2.9 MB/s | 190 kB 00:00 2023-10-09T11:33:52.360 INFO:teuthology.orchestra.run.smithi006.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 3.8 MB/s | 371 kB 00:00 2023-10-09T11:33:52.371 INFO:teuthology.orchestra.run.smithi118.stdout:(6/120): ceph-common-17.2.6-1320.g08cac018.el8. 5.5 MB/s | 23 MB 00:04 2023-10-09T11:33:52.454 INFO:teuthology.orchestra.run.smithi118.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.2 MB/s | 5.2 MB 00:04 2023-10-09T11:33:52.489 INFO:teuthology.orchestra.run.smithi006.stdout:(22/120): librgw2-17.2.6-1320.g08cac018.el8.x86 8.7 MB/s | 5.6 MB 00:00 2023-10-09T11:33:52.490 INFO:teuthology.orchestra.run.smithi006.stdout:(23/120): python3-rbd-17.2.6-1320.g08cac018.el8 2.7 MB/s | 358 kB 00:00 2023-10-09T11:33:52.532 INFO:teuthology.orchestra.run.smithi006.stdout:(24/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.4 MB/s | 107 kB 00:00 2023-10-09T11:33:52.555 INFO:teuthology.orchestra.run.smithi006.stdout:(25/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.4 MB/s | 90 kB 00:00 2023-10-09T11:33:52.637 INFO:teuthology.orchestra.run.smithi006.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.1 MB/s | 173 kB 00:00 2023-10-09T11:33:52.713 INFO:teuthology.orchestra.run.smithi006.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 304 kB/s | 23 kB 00:00 2023-10-09T11:33:52.774 INFO:teuthology.orchestra.run.smithi118.stdout:(8/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 2.7 MB/s | 3.9 MB 00:01 2023-10-09T11:33:52.790 INFO:teuthology.orchestra.run.smithi006.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.5 MB/s | 121 kB 00:00 2023-10-09T11:33:52.845 INFO:teuthology.orchestra.run.smithi118.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 343 kB/s | 24 kB 00:00 2023-10-09T11:33:53.039 INFO:teuthology.orchestra.run.smithi006.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 6.8 MB/s | 3.5 MB 00:00 2023-10-09T11:33:53.290 INFO:teuthology.orchestra.run.smithi006.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 3.4 MB/s | 1.7 MB 00:00 2023-10-09T11:33:53.379 INFO:teuthology.orchestra.run.smithi006.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 2.6 MB/s | 238 kB 00:00 2023-10-09T11:33:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 583 kB/s | 47 kB 00:00 2023-10-09T11:33:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 182 kB/s | 14 kB 00:00 2023-10-09T11:33:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.0 MB/s | 267 kB 00:00 2023-10-09T11:33:53.710 INFO:teuthology.orchestra.run.smithi006.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 988 kB/s | 80 kB 00:00 2023-10-09T11:33:53.791 INFO:teuthology.orchestra.run.smithi006.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 224 kB/s | 18 kB 00:00 2023-10-09T11:33:53.938 INFO:teuthology.orchestra.run.smithi118.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 11 MB/s | 17 MB 00:01 2023-10-09T11:33:53.967 INFO:teuthology.orchestra.run.smithi006.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 8.0 MB/s | 7.4 MB 00:00 2023-10-09T11:33:53.971 INFO:teuthology.orchestra.run.smithi118.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 7.6 MB/s | 255 kB 00:00 2023-10-09T11:33:53.993 INFO:teuthology.orchestra.run.smithi118.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 1.2 MB/s | 25 kB 00:00 2023-10-09T11:33:54.043 INFO:teuthology.orchestra.run.smithi118.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 15 MB/s | 797 kB 00:00 2023-10-09T11:33:54.074 INFO:teuthology.orchestra.run.smithi118.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 5.6 MB/s | 174 kB 00:00 2023-10-09T11:33:54.097 INFO:teuthology.orchestra.run.smithi118.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 5.4 MB/s | 130 kB 00:00 2023-10-09T11:33:54.132 INFO:teuthology.orchestra.run.smithi118.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 14 MB/s | 507 kB 00:00 2023-10-09T11:33:54.364 INFO:teuthology.orchestra.run.smithi006.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 148 kB/s | 59 kB 00:00 2023-10-09T11:33:54.484 INFO:teuthology.orchestra.run.smithi118.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 16 MB/s | 5.6 MB 00:00 2023-10-09T11:33:54.490 INFO:teuthology.orchestra.run.smithi006.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 597 kB/s | 75 kB 00:00 2023-10-09T11:33:54.506 INFO:teuthology.orchestra.run.smithi118.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 2.1 MB/s | 45 kB 00:00 2023-10-09T11:33:54.529 INFO:teuthology.orchestra.run.smithi118.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 4.8 MB/s | 115 kB 00:00 2023-10-09T11:33:54.536 INFO:teuthology.orchestra.run.smithi006.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 411 kB/s | 306 kB 00:00 2023-10-09T11:33:54.552 INFO:teuthology.orchestra.run.smithi118.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 8.3 MB/s | 190 kB 00:00 2023-10-09T11:33:54.585 INFO:teuthology.orchestra.run.smithi118.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 11 MB/s | 371 kB 00:00 2023-10-09T11:33:54.620 INFO:teuthology.orchestra.run.smithi006.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 520 kB/s | 44 kB 00:00 2023-10-09T11:33:54.621 INFO:teuthology.orchestra.run.smithi118.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 9.6 MB/s | 358 kB 00:00 2023-10-09T11:33:54.650 INFO:teuthology.orchestra.run.smithi118.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 3.8 MB/s | 107 kB 00:00 2023-10-09T11:33:54.671 INFO:teuthology.orchestra.run.smithi118.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 90 kB 00:00 2023-10-09T11:33:54.730 INFO:teuthology.orchestra.run.smithi006.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-09T11:33:54.764 INFO:teuthology.orchestra.run.smithi006.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-10-09T11:33:54.812 INFO:teuthology.orchestra.run.smithi006.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 401 kB/s | 33 kB 00:00 2023-10-09T11:33:54.842 INFO:teuthology.orchestra.run.smithi006.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 209 kB/s | 16 kB 00:00 2023-10-09T11:33:54.898 INFO:teuthology.orchestra.run.smithi118.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 15 MB/s | 3.5 MB 00:00 2023-10-09T11:33:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-09T11:33:54.921 INFO:teuthology.orchestra.run.smithi118.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 7.3 MB/s | 173 kB 00:00 2023-10-09T11:33:54.943 INFO:teuthology.orchestra.run.smithi118.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.0 MB/s | 23 kB 00:00 2023-10-09T11:33:54.959 INFO:teuthology.orchestra.run.smithi006.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-10-09T11:33:54.964 INFO:teuthology.orchestra.run.smithi118.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.5 MB/s | 121 kB 00:00 2023-10-09T11:33:55.013 INFO:teuthology.orchestra.run.smithi006.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 881 kB/s | 81 kB 00:00 2023-10-09T11:33:55.036 INFO:teuthology.orchestra.run.smithi006.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 144 kB/s | 11 kB 00:00 2023-10-09T11:33:55.082 INFO:teuthology.orchestra.run.smithi118.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 14 MB/s | 1.7 MB 00:00 2023-10-09T11:33:55.090 INFO:teuthology.orchestra.run.smithi006.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 223 kB/s | 18 kB 00:00 2023-10-09T11:33:55.175 INFO:teuthology.orchestra.run.smithi006.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 575 kB/s | 49 kB 00:00 2023-10-09T11:33:55.237 INFO:teuthology.orchestra.run.smithi006.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-10-09T11:33:55.261 INFO:teuthology.orchestra.run.smithi006.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 685 kB/s | 59 kB 00:00 2023-10-09T11:33:55.316 INFO:teuthology.orchestra.run.smithi006.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 763 kB/s | 60 kB 00:00 2023-10-09T11:33:55.388 INFO:teuthology.orchestra.run.smithi006.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-09T11:33:55.394 INFO:teuthology.orchestra.run.smithi006.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 202 kB/s | 16 kB 00:00 2023-10-09T11:33:55.470 INFO:teuthology.orchestra.run.smithi006.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 412 kB/s | 34 kB 00:00 2023-10-09T11:33:55.478 INFO:teuthology.orchestra.run.smithi006.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-09T11:33:55.547 INFO:teuthology.orchestra.run.smithi118.stdout:(30/120): ceph-mgr-diskprediction-local-17.2.6- 16 MB/s | 7.4 MB 00:00 2023-10-09T11:33:55.555 INFO:teuthology.orchestra.run.smithi006.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 244 kB/s | 19 kB 00:00 2023-10-09T11:33:55.556 INFO:teuthology.orchestra.run.smithi006.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 747 kB/s | 64 kB 00:00 2023-10-09T11:33:55.574 INFO:teuthology.orchestra.run.smithi118.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 8.9 MB/s | 238 kB 00:00 2023-10-09T11:33:55.595 INFO:teuthology.orchestra.run.smithi118.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 2.2 MB/s | 47 kB 00:00 2023-10-09T11:33:55.617 INFO:teuthology.orchestra.run.smithi118.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 676 kB/s | 14 kB 00:00 2023-10-09T11:33:55.633 INFO:teuthology.orchestra.run.smithi006.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 308 kB/s | 24 kB 00:00 2023-10-09T11:33:55.637 INFO:teuthology.orchestra.run.smithi006.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 363 kB/s | 29 kB 00:00 2023-10-09T11:33:55.642 INFO:teuthology.orchestra.run.smithi118.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 10 MB/s | 267 kB 00:00 2023-10-09T11:33:55.668 INFO:teuthology.orchestra.run.smithi118.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 3.1 MB/s | 80 kB 00:00 2023-10-09T11:33:55.689 INFO:teuthology.orchestra.run.smithi118.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 861 kB/s | 18 kB 00:00 2023-10-09T11:33:55.711 INFO:teuthology.orchestra.run.smithi006.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 354 kB/s | 27 kB 00:00 2023-10-09T11:33:55.755 INFO:teuthology.orchestra.run.smithi006.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-09T11:33:55.797 INFO:teuthology.orchestra.run.smithi006.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-09T11:33:55.841 INFO:teuthology.orchestra.run.smithi006.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 715 kB/s | 61 kB 00:00 2023-10-09T11:33:55.877 INFO:teuthology.orchestra.run.smithi006.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-09T11:33:55.927 INFO:teuthology.orchestra.run.smithi006.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 266 kB/s | 23 kB 00:00 2023-10-09T11:33:55.931 INFO:teuthology.orchestra.run.smithi006.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-09T11:33:55.980 INFO:teuthology.orchestra.run.smithi006.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 388 kB/s | 19 kB 00:00 2023-10-09T11:33:56.021 INFO:teuthology.orchestra.run.smithi006.stdout:(71/120): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-09T11:33:56.136 INFO:teuthology.orchestra.run.smithi006.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 273 kB/s | 43 kB 00:00 2023-10-09T11:33:56.179 INFO:teuthology.orchestra.run.smithi118.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 625 kB/s | 306 kB 00:00 2023-10-09T11:33:56.189 INFO:teuthology.orchestra.run.smithi006.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 919 kB/s | 155 kB 00:00 2023-10-09T11:33:56.255 INFO:teuthology.orchestra.run.smithi006.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-09T11:33:56.259 INFO:teuthology.orchestra.run.smithi118.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 733 kB/s | 59 kB 00:00 2023-10-09T11:33:56.343 INFO:teuthology.orchestra.run.smithi118.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2023-10-09T11:33:56.345 INFO:teuthology.orchestra.run.smithi006.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 308 kB/s | 48 kB 00:00 2023-10-09T11:33:56.374 INFO:teuthology.orchestra.run.smithi006.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-09T11:33:56.419 INFO:teuthology.orchestra.run.smithi006.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 578 kB/s | 43 kB 00:00 2023-10-09T11:33:56.457 INFO:teuthology.orchestra.run.smithi006.stdout:(78/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 28 MB/s | 2.3 MB 00:00 2023-10-09T11:33:56.495 INFO:teuthology.orchestra.run.smithi118.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2023-10-09T11:33:56.499 INFO:teuthology.orchestra.run.smithi006.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 224 kB/s | 18 kB 00:00 2023-10-09T11:33:56.568 INFO:teuthology.orchestra.run.smithi118.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 598 kB/s | 44 kB 00:00 2023-10-09T11:33:56.569 INFO:teuthology.orchestra.run.smithi006.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2023-10-09T11:33:56.581 INFO:teuthology.orchestra.run.smithi006.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-10-09T11:33:56.650 INFO:teuthology.orchestra.run.smithi118.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-09T11:33:56.663 INFO:teuthology.orchestra.run.smithi006.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 624 kB/s | 59 kB 00:00 2023-10-09T11:33:56.702 INFO:teuthology.orchestra.run.smithi006.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 1.4 MB/s | 169 kB 00:00 2023-10-09T11:33:56.705 INFO:teuthology.orchestra.run.smithi006.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 914 kB/s | 38 kB 00:00 2023-10-09T11:33:56.723 INFO:teuthology.orchestra.run.smithi118.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 454 kB/s | 33 kB 00:00 2023-10-09T11:33:56.794 INFO:teuthology.orchestra.run.smithi118.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 227 kB/s | 16 kB 00:00 2023-10-09T11:33:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 618 kB/s | 86 kB 00:00 2023-10-09T11:33:56.852 INFO:teuthology.orchestra.run.smithi006.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 392 kB/s | 58 kB 00:00 2023-10-09T11:33:56.875 INFO:teuthology.orchestra.run.smithi118.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.1 MB/s | 173 kB 00:00 2023-10-09T11:33:56.945 INFO:teuthology.orchestra.run.smithi006.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 5.9 MB/s | 559 kB 00:00 2023-10-09T11:33:56.969 INFO:teuthology.orchestra.run.smithi118.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.0 MB/s | 384 kB 00:00 2023-10-09T11:33:57.045 INFO:teuthology.orchestra.run.smithi118.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-09T11:33:57.117 INFO:teuthology.orchestra.run.smithi118.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 155 kB/s | 11 kB 00:00 2023-10-09T11:33:57.193 INFO:teuthology.orchestra.run.smithi118.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 232 kB/s | 18 kB 00:00 2023-10-09T11:33:57.337 INFO:teuthology.orchestra.run.smithi118.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 8.1 MB/s | 1.2 MB 00:00 2023-10-09T11:33:57.350 INFO:teuthology.orchestra.run.smithi006.stdout:(88/120): ceph-test-17.2.6-1320.g08cac018.el8.x 8.0 MB/s | 52 MB 00:06 2023-10-09T11:33:57.352 INFO:teuthology.orchestra.run.smithi006.stdout:(89/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 92 kB/s | 47 kB 00:00 2023-10-09T11:33:57.389 INFO:teuthology.orchestra.run.smithi006.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 1.4 MB/s | 639 kB 00:00 2023-10-09T11:33:57.410 INFO:teuthology.orchestra.run.smithi118.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 667 kB/s | 49 kB 00:00 2023-10-09T11:33:57.473 INFO:teuthology.orchestra.run.smithi006.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-10-09T11:33:57.483 INFO:teuthology.orchestra.run.smithi118.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 804 kB/s | 59 kB 00:00 2023-10-09T11:33:57.501 INFO:teuthology.orchestra.run.smithi006.stdout:(92/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 465 kB/s | 70 kB 00:00 2023-10-09T11:33:57.539 INFO:teuthology.orchestra.run.smithi006.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 682 kB/s | 97 kB 00:00 2023-10-09T11:33:57.557 INFO:teuthology.orchestra.run.smithi118.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 826 kB/s | 60 kB 00:00 2023-10-09T11:33:57.601 INFO:teuthology.orchestra.run.smithi006.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 438 kB/s | 44 kB 00:00 2023-10-09T11:33:57.617 INFO:teuthology.orchestra.run.smithi006.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 345 kB/s | 27 kB 00:00 2023-10-09T11:33:57.634 INFO:teuthology.orchestra.run.smithi006.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 4.9 MB/s | 161 kB 00:00 2023-10-09T11:33:57.639 INFO:teuthology.orchestra.run.smithi118.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-10-09T11:33:57.702 INFO:teuthology.orchestra.run.smithi006.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 3.7 MB/s | 320 kB 00:00 2023-10-09T11:33:57.709 INFO:teuthology.orchestra.run.smithi006.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 5.9 MB/s | 457 kB 00:00 2023-10-09T11:33:57.711 INFO:teuthology.orchestra.run.smithi118.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 218 kB/s | 16 kB 00:00 2023-10-09T11:33:57.783 INFO:teuthology.orchestra.run.smithi118.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 467 kB/s | 34 kB 00:00 2023-10-09T11:33:57.863 INFO:teuthology.orchestra.run.smithi118.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 2.4 MB/s | 196 kB 00:00 2023-10-09T11:33:57.903 INFO:teuthology.orchestra.run.smithi006.stdout:(99/120): python3-scipy-1.0.0-20.module+el8.1.0 34 MB/s | 15 MB 00:00 2023-10-09T11:33:57.904 INFO:teuthology.orchestra.run.smithi006.stdout:(100/120): python3-markupsafe-0.23-19.el8.x86_6 200 kB/s | 39 kB 00:00 2023-10-09T11:33:57.938 INFO:teuthology.orchestra.run.smithi118.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 859 kB/s | 64 kB 00:00 2023-10-09T11:33:57.951 INFO:teuthology.orchestra.run.smithi006.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-09T11:33:57.999 INFO:teuthology.orchestra.run.smithi006.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.7 MB/s | 259 kB 00:00 2023-10-09T11:33:58.010 INFO:teuthology.orchestra.run.smithi118.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 261 kB/s | 19 kB 00:00 2023-10-09T11:33:58.012 INFO:teuthology.orchestra.run.smithi006.stdout:(103/120): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-10-09T11:33:58.079 INFO:teuthology.orchestra.run.smithi006.stdout:(104/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 1.7 MB/s | 225 kB 00:00 2023-10-09T11:33:58.082 INFO:teuthology.orchestra.run.smithi118.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 333 kB/s | 24 kB 00:00 2023-10-09T11:33:58.136 INFO:teuthology.orchestra.run.smithi006.stdout:(105/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 924 kB/s | 126 kB 00:00 2023-10-09T11:33:58.154 INFO:teuthology.orchestra.run.smithi118.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 407 kB/s | 29 kB 00:00 2023-10-09T11:33:58.227 INFO:teuthology.orchestra.run.smithi006.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 5.8 MB/s | 538 kB 00:00 2023-10-09T11:33:58.231 INFO:teuthology.orchestra.run.smithi006.stdout:(107/120): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-09T11:33:58.289 INFO:teuthology.orchestra.run.smithi006.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-10-09T11:33:58.298 INFO:teuthology.orchestra.run.smithi006.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 4.1 MB/s | 302 kB 00:00 2023-10-09T11:33:58.314 INFO:teuthology.orchestra.run.smithi006.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 4.3 MB/s | 110 kB 00:00 2023-10-09T11:33:58.318 INFO:teuthology.orchestra.run.smithi118.stdout:(62/120): ceph-radosgw-17.2.6-1320.g08cac018.el 2.9 MB/s | 17 MB 00:05 2023-10-09T11:33:58.319 INFO:teuthology.orchestra.run.smithi118.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 167 kB/s | 27 kB 00:00 2023-10-09T11:33:58.321 INFO:teuthology.orchestra.run.smithi006.stdout:(111/120): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-10-09T11:33:58.355 INFO:teuthology.orchestra.run.smithi006.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 6.0 MB/s | 353 kB 00:00 2023-10-09T11:33:58.356 INFO:teuthology.orchestra.run.smithi006.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 483 kB/s | 20 kB 00:00 2023-10-09T11:33:58.385 INFO:teuthology.orchestra.run.smithi006.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 11 MB/s | 709 kB 00:00 2023-10-09T11:33:58.400 INFO:teuthology.orchestra.run.smithi118.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.0 MB/s | 251 kB 00:00 2023-10-09T11:33:58.440 INFO:teuthology.orchestra.run.smithi006.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 56 MB/s | 4.7 MB 00:00 2023-10-09T11:33:58.441 INFO:teuthology.orchestra.run.smithi006.stdout:(116/120): python3-pytz-2017.2-9.el8.noarch.rpm 633 kB/s | 54 kB 00:00 2023-10-09T11:33:58.474 INFO:teuthology.orchestra.run.smithi118.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 837 kB/s | 61 kB 00:00 2023-10-09T11:33:58.483 INFO:teuthology.orchestra.run.smithi006.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2023-10-09T11:33:58.503 INFO:teuthology.orchestra.run.smithi006.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 39 MB/s | 4.6 MB 00:00 2023-10-09T11:33:58.548 INFO:teuthology.orchestra.run.smithi118.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-09T11:33:58.621 INFO:teuthology.orchestra.run.smithi118.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 319 kB/s | 23 kB 00:00 2023-10-09T11:33:58.723 INFO:teuthology.orchestra.run.smithi006.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-09T11:33:58.782 INFO:teuthology.orchestra.run.smithi118.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2023-10-09T11:33:58.786 INFO:teuthology.orchestra.run.smithi118.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-09T11:33:58.791 INFO:teuthology.orchestra.run.smithi118.stdout:(70/120): python3-waitress-1.4.3-1.el8.noarch.r 540 kB/s | 255 kB 00:00 2023-10-09T11:33:59.003 INFO:teuthology.orchestra.run.smithi118.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 207 kB/s | 44 kB 00:00 2023-10-09T11:33:59.077 INFO:teuthology.orchestra.run.smithi118.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 364 kB/s | 27 kB 00:00 2023-10-09T11:33:59.079 INFO:teuthology.orchestra.run.smithi006.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 6.0 MB/s | 3.6 MB 00:00 2023-10-09T11:33:59.083 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:33:59.084 INFO:teuthology.orchestra.run.smithi006.stdout:Total 18 MB/s | 202 MB 00:11 2023-10-09T11:33:59.101 INFO:teuthology.orchestra.run.smithi118.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 6.5 MB/s | 161 kB 00:00 2023-10-09T11:33:59.136 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-10-09T11:33:59.226 INFO:teuthology.orchestra.run.smithi118.stdout:(74/120): python3-scipy-1.0.0-20.module+el8.1.0 33 MB/s | 15 MB 00:00 2023-10-09T11:33:59.231 INFO:teuthology.orchestra.run.smithi118.stdout:(75/120): flex-2.6.1-9.el8.x86_64.rpm 2.4 MB/s | 320 kB 00:00 2023-10-09T11:33:59.261 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-10-09T11:33:59.262 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-10-09T11:33:59.378 INFO:teuthology.orchestra.run.smithi118.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2023-10-09T11:33:59.382 INFO:teuthology.orchestra.run.smithi118.stdout:(77/120): python3-werkzeug-0.12.2-4.el8.noarch. 2.9 MB/s | 457 kB 00:00 2023-10-09T11:33:59.507 INFO:teuthology.orchestra.run.smithi118.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 303 kB/s | 39 kB 00:00 2023-10-09T11:33:59.540 INFO:teuthology.orchestra.run.smithi118.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2023-10-09T11:33:59.553 INFO:teuthology.orchestra.run.smithi118.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.4 MB/s | 259 kB 00:00 2023-10-09T11:33:59.577 INFO:teuthology.orchestra.run.smithi118.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 6.1 MB/s | 225 kB 00:00 2023-10-09T11:33:59.580 INFO:teuthology.orchestra.run.smithi118.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.7 MB/s | 126 kB 00:00 2023-10-09T11:33:59.604 INFO:teuthology.orchestra.run.smithi118.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 7.5 MB/s | 187 kB 00:00 2023-10-09T11:33:59.633 INFO:teuthology.orchestra.run.smithi118.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 19 MB/s | 538 kB 00:00 2023-10-09T11:33:59.646 INFO:teuthology.orchestra.run.smithi118.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 54 MB/s | 3.7 MB 00:00 2023-10-09T11:33:59.656 INFO:teuthology.orchestra.run.smithi118.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-09T11:33:59.688 INFO:teuthology.orchestra.run.smithi118.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 3.6 MB/s | 157 kB 00:00 2023-10-09T11:33:59.701 INFO:teuthology.orchestra.run.smithi118.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 2.4 MB/s | 110 kB 00:00 2023-10-09T11:33:59.720 INFO:teuthology.orchestra.run.smithi118.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2023-10-09T11:33:59.733 INFO:teuthology.orchestra.run.smithi118.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 634 kB/s | 20 kB 00:00 2023-10-09T11:33:59.752 INFO:teuthology.orchestra.run.smithi118.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.8 MB/s | 54 kB 00:00 2023-10-09T11:33:59.757 INFO:teuthology.orchestra.run.smithi118.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 19 MB/s | 709 kB 00:00 2023-10-09T11:33:59.842 INFO:teuthology.orchestra.run.smithi118.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 54 MB/s | 4.6 MB 00:00 2023-10-09T11:33:59.855 INFO:teuthology.orchestra.run.smithi118.stdout:(94/120): openblas-threads-0.3.12-1.el8.x86_64. 46 MB/s | 4.7 MB 00:00 2023-10-09T11:33:59.893 INFO:teuthology.orchestra.run.smithi118.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-10-09T11:33:59.901 INFO:teuthology.orchestra.run.smithi118.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 410 kB/s | 19 kB 00:00 2023-10-09T11:33:59.923 INFO:teuthology.orchestra.run.smithi118.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2023-10-09T11:33:59.948 INFO:teuthology.orchestra.run.smithi118.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.5 MB/s | 220 kB 00:00 2023-10-09T11:33:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 2.9 MB/s | 155 kB 00:00 2023-10-09T11:33:59.974 INFO:teuthology.orchestra.run.smithi118.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.8 MB/s | 48 kB 00:00 2023-10-09T11:33:59.985 INFO:teuthology.orchestra.run.smithi118.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.9 MB/s | 229 kB 00:00 2023-10-09T11:33:59.998 INFO:teuthology.orchestra.run.smithi118.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.8 MB/s | 43 kB 00:00 2023-10-09T11:34:00.019 INFO:teuthology.orchestra.run.smithi118.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 879 kB/s | 18 kB 00:00 2023-10-09T11:34:00.031 INFO:teuthology.orchestra.run.smithi118.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 50 MB/s | 2.3 MB 00:00 2023-10-09T11:34:00.040 INFO:teuthology.orchestra.run.smithi118.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 28 MB/s | 605 kB 00:00 2023-10-09T11:34:00.057 INFO:teuthology.orchestra.run.smithi118.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 3.2 MB/s | 83 kB 00:00 2023-10-09T11:34:00.059 INFO:teuthology.orchestra.run.smithi118.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 3.0 MB/s | 59 kB 00:00 2023-10-09T11:34:00.075 INFO:teuthology.orchestra.run.smithi118.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.5 MB/s | 169 kB 00:00 2023-10-09T11:34:00.094 INFO:teuthology.orchestra.run.smithi118.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.5 MB/s | 86 kB 00:00 2023-10-09T11:34:00.109 INFO:teuthology.orchestra.run.smithi118.stdout:(110/120): libcom_err-devel-1.45.6-1.el8.x86_64 777 kB/s | 38 kB 00:00 2023-10-09T11:34:00.114 INFO:teuthology.orchestra.run.smithi118.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.8 MB/s | 58 kB 00:00 2023-10-09T11:34:00.129 INFO:teuthology.orchestra.run.smithi118.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.3 MB/s | 47 kB 00:00 2023-10-09T11:34:00.152 INFO:teuthology.orchestra.run.smithi118.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 27 MB/s | 639 kB 00:00 2023-10-09T11:34:00.156 INFO:teuthology.orchestra.run.smithi118.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 13 MB/s | 559 kB 00:00 2023-10-09T11:34:00.173 INFO:teuthology.orchestra.run.smithi118.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 3.3 MB/s | 70 kB 00:00 2023-10-09T11:34:00.175 INFO:teuthology.orchestra.run.smithi118.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 10 MB/s | 200 kB 00:00 2023-10-09T11:34:00.188 INFO:teuthology.orchestra.run.smithi118.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.4 MB/s | 97 kB 00:00 2023-10-09T11:34:00.465 INFO:teuthology.orchestra.run.smithi118.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 13 MB/s | 3.6 MB 00:00 2023-10-09T11:34:00.973 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-10-09T11:34:00.978 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-10-09T11:34:01.058 INFO:teuthology.orchestra.run.smithi118.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 3.9 MB/s | 3.5 MB 00:00 2023-10-09T11:34:01.611 INFO:teuthology.orchestra.run.smithi118.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 5.9 MB/s | 52 MB 00:08 2023-10-09T11:34:01.615 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-10-09T11:34:01.616 INFO:teuthology.orchestra.run.smithi118.stdout:Total 15 MB/s | 202 MB 00:13 2023-10-09T11:34:01.665 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-10-09T11:34:01.779 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-10-09T11:34:01.779 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-10-09T11:34:03.485 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-10-09T11:34:03.489 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-10-09T11:34:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-10-09T11:34:06.438 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:34:06.629 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:34:06.797 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-09T11:34:07.004 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:34:07.407 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-09T11:34:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:34:08.068 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:34:08.428 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:34:08.581 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:34:08.775 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-10-09T11:34:08.787 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:08.971 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T11:34:09.076 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:34:09.184 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-09T11:34:09.420 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T11:34:09.444 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-09T11:34:09.538 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T11:34:09.728 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T11:34:10.114 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T11:34:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:34:10.337 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:34:10.362 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:10.482 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:10.725 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:34:10.751 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T11:34:10.920 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:34:10.936 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:11.056 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:34:11.121 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:11.261 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:34:11.342 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:34:11.362 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:34:11.468 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:34:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-09T11:34:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-09T11:34:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-09T11:34:12.252 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:34:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-09T11:34:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:34:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-09T11:34:12.905 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T11:34:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:34:13.094 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:13.192 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:34:13.424 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T11:34:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-09T11:34:13.570 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T11:34:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:34:13.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:13.917 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:34:14.070 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:34:14.136 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T11:34:14.289 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-09T11:34:14.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-09T11:34:14.470 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T11:34:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:34:14.603 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T11:34:14.786 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T11:34:15.272 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-09T11:34:15.331 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T11:34:15.477 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T11:34:16.014 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T11:34:16.186 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T11:34:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-09T11:34:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-09T11:34:16.840 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:34:16.901 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T11:34:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:34:17.145 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-09T11:34:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:34:17.498 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:34:17.685 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-09T11:34:17.771 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-09T11:34:17.848 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-09T11:34:18.065 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-09T11:34:18.076 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-09T11:34:18.302 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:34:18.371 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-09T11:34:18.581 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T11:34:18.742 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T11:34:18.904 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T11:34:19.179 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T11:34:20.238 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-09T11:34:20.538 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-09T11:34:20.567 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-09T11:34:20.869 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-09T11:34:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-09T11:34:21.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-09T11:34:21.335 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-09T11:34:21.535 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T11:34:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-09T11:34:22.641 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-09T11:34:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-09T11:34:23.160 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:34:23.389 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:34:23.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:34:23.643 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T11:34:23.842 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:34:23.955 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-09T11:34:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:34:24.173 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T11:34:24.346 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T11:34:24.393 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-09T11:34:24.579 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T11:34:24.602 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-09T11:34:24.765 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T11:34:24.835 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-09T11:34:24.930 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T11:34:25.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-09T11:34:25.125 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-09T11:34:25.243 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:34:25.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-09T11:34:25.308 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-09T11:34:25.445 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-09T11:34:25.495 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-09T11:34:25.595 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-09T11:34:25.701 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-09T11:34:25.755 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-09T11:34:25.934 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-09T11:34:25.942 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-09T11:34:26.096 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-09T11:34:26.149 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-09T11:34:26.364 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-09T11:34:26.417 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-09T11:34:26.555 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-09T11:34:26.675 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-09T11:34:26.733 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-09T11:34:26.942 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-09T11:34:26.971 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-09T11:34:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-09T11:34:27.282 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-09T11:34:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-09T11:34:27.521 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-09T11:34:27.666 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-09T11:34:27.780 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-09T11:34:27.823 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-09T11:34:28.004 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-09T11:34:28.071 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-09T11:34:28.184 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T11:34:28.268 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T11:34:28.399 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-09T11:34:28.442 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-09T11:34:28.586 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:34:28.628 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-09T11:34:28.826 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T11:34:28.912 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:34:28.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T11:34:29.202 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:34:29.214 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T11:34:29.453 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:34:29.501 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T11:34:29.676 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:34:29.699 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T11:34:29.816 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:34:29.850 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T11:34:29.945 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:34:30.023 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T11:34:30.143 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:34:30.259 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T11:34:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:34:30.501 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T11:34:30.536 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:34:30.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T11:34:30.753 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:34:30.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:34:30.988 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T11:34:31.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:34:31.200 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T11:34:31.296 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:34:31.473 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T11:34:31.514 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:34:31.772 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:34:31.967 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T11:34:31.974 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:34:32.165 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:34:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T11:34:32.399 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:34:32.514 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T11:34:32.835 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T11:34:33.014 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T11:34:33.319 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T11:34:33.632 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:34:33.973 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:34:34.185 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:34:34.509 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:34:34.721 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T11:34:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:34:35.050 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T11:34:35.056 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:34:35.293 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:34:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T11:34:35.476 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:34:35.675 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:34:35.678 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T11:34:35.976 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T11:34:36.324 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T11:34:36.666 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T11:34:36.895 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T11:34:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T11:34:40.758 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:40.966 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:41.542 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:41.851 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:34:41.942 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:34:42.065 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:34:43.437 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:43.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:44.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T11:34:44.750 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:34:44.884 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T11:34:45.033 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-10-09T11:35:00.034 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-10-09T11:35:00.035 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-09T11:35:00.035 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:00.395 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:35:01.889 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:35:02.056 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:35:02.285 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:35:02.444 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:35:02.833 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:35:02.970 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:35:02.988 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:35:03.448 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T11:35:03.448 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-10-09T11:35:03.448 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-10-09T11:35:03.448 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-09T11:35:03.448 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-09T11:35:03.449 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:03.847 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:35:05.436 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T11:35:05.789 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:35:05.830 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:35:05.977 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:35:06.025 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T11:35:06.159 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:35:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:35:06.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:35:06.536 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:35:06.640 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T11:35:06.752 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:35:06.772 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:35:06.789 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T11:35:06.997 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:35:07.968 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:35:08.186 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:35:08.287 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:35:08.653 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:35:08.872 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:35:08.910 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:35:09.077 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:35:09.089 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:35:10.295 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:35:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T11:35:10.653 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T11:35:10.684 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:35:10.875 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T11:35:10.913 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:35:10.994 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:35:11.079 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:35:11.136 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:35:11.178 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:35:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T11:35:11.369 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:35:11.579 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:35:11.716 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:35:11.877 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:35:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T11:35:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:35:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T11:35:13.319 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T11:35:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:35:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T11:35:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:35:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T11:35:15.529 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T11:35:15.763 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:35:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T11:35:16.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:35:16.074 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T11:35:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:35:16.632 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T11:35:16.809 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:35:16.838 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:35:17.149 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:35:17.309 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T11:35:18.024 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T11:35:18.360 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-09T11:35:18.556 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-09T11:35:18.704 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-09T11:35:18.830 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:35:18.997 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:35:19.134 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:35:19.308 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:35:19.468 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:35:19.710 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-09T11:35:19.876 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T11:35:19.929 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T11:35:20.092 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T11:35:20.101 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T11:35:20.102 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:35:20.337 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:35:20.337 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:35:21.198 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:35:21.199 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:35:21.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:35:21.201 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:35:21.202 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:35:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-09T11:35:21.204 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-09T11:35:21.205 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-09T11:35:21.206 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-09T11:35:21.207 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:35:21.208 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:35:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T11:35:23.116 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T11:35:23.457 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:23.457 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:45 ago on Mon 09 Oct 2023 11:33:38 AM UTC. 2023-10-09T11:35:23.467 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-09T11:35:23.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-09T11:35:23.940 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-09T11:35:24.303 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:35:24.316 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-09T11:35:24.516 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T11:35:24.725 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T11:35:24.870 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T11:35:25.071 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T11:35:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T11:35:25.544 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:35:25.599 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-09T11:35:25.630 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-10-09T11:35:25.761 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:35:25.771 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:35:25.781 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.782 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.783 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.784 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:35:25.785 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:35:25.786 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:35:25.787 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:35:25.788 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:35:25.789 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:35:25.790 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:35:25.791 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:35:25.792 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:35:25.792 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:25.792 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-09T11:35:25.955 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-09T11:35:25.955 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:35:26.111 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:26.173 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T11:35:26.173 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T11:35:27.172 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T11:35:27.173 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T11:35:27.174 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T11:35:27.175 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T11:35:27.176 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T11:35:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T11:35:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T11:35:27.179 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T11:35:27.180 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T11:35:27.181 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T11:35:27.182 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-09T11:35:27.183 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-09T11:35:27.184 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-09T11:35:27.185 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-09T11:35:27.186 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-09T11:35:27.187 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-09T11:35:27.188 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-09T11:35:27.189 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-09T11:35:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-09T11:35:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-09T11:35:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T11:35:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T11:35:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T11:35:29.626 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T11:35:29.626 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:51 ago on Mon 09 Oct 2023 11:33:38 AM UTC. 2023-10-09T11:35:31.667 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-10-09T11:35:31.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:31.818 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.819 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.820 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T11:35:31.821 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.5-12.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T11:35:31.822 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T11:35:31.823 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T11:35:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T11:35:31.825 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T11:35:31.826 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T11:35:31.827 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T11:35:31.828 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T11:35:31.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T11:35:31.830 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T11:35:31.831 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T11:35:31.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:31.831 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-09T11:35:32.092 DEBUG:teuthology.parallel:result is None 2023-10-09T11:35:32.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:35:32.239 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:35:32.260 INFO:teuthology.orchestra.run.smithi006.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:35:32.260 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:35:32.261 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:35:32.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T11:35:32.401 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T11:35:32.424 INFO:teuthology.orchestra.run.smithi118.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T11:35:32.424 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T11:35:32.424 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T11:35:32.425 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T11:35:32.425 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:32.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:35:32.466 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:32.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T11:35:32.506 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T11:35:32.506 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:32.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:35:32.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:35:32.597 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:32.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T11:35:32.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T11:35:32.687 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T11:35:32.687 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:32.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:35:32.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:35:32.777 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:32.777 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T11:35:32.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T11:35:32.866 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T11:35:32.866 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:32.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:35:32.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:35:32.955 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:32.956 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T11:35:32.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T11:35:33.043 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T11:35:33.107 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T11:35:33.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-10-09T11:35:33.109 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-10-09T11:35:33.133 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T11:35:33.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:35:33.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T11:35:33.199 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T11:35:33.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:35:33.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T11:35:33.272 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T11:35:33.272 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T11:35:33.272 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T11:35:33.272 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:33.272 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:35:33.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:33.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:33.457 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:33.457 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T11:35:33.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:33.581 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T11:35:33.610 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T11:35:33.610 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T11:35:33.611 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418423', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231009.111138', 'sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231009.111138', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_c68c3f491122d7c1646aa58425d37dc1a8b276ba/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'c68c3f491122d7c1646aa58425d37dc1a8b276ba', 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbPPd4qgmh4rOUyLxbWXr31ScyeBsHgy2YCgau6CW/kJj2R1U/IbwHWREVU0lCO50r3uNbB0SfJdtnBbcB4IKk=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDceSactrI1vpiOAbWL7HOQAHEujhYkixJ9U/iCrhQ6ukDarDM/3FBgtruKQ8aFRD37qGoaH1bAEP5KqM1vZCPY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_11:13:22', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T11:35:33.611 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:35:33.613 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T11:35:33.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:35:33.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T11:35:33.722 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:33.722 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:35:33.746 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:35:33.747 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-10-09T11:35:33.801 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 216816 Links: 1 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-09 11:35:26.701242071 +0000 2023-10-09T11:35:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-09 11:32:53.735749251 +0000 2023-10-09T11:35:33.803 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-09 11:32:53.735749251 +0000 2023-10-09T11:35:33.803 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-09T11:35:33.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:35:33.865 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-09T11:35:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-09T11:35:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000243907 s, 2.1 MB/s 2023-10-09T11:35:33.867 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:35:33.923 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 220445 Links: 1 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-09 11:35:26.701242071 +0000 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-09 11:32:54.232744213 +0000 2023-10-09T11:35:33.979 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-09 11:32:54.232744213 +0000 2023-10-09T11:35:33.980 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-09T11:35:33.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-09T11:35:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-09T11:35:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000242502 s, 2.1 MB/s 2023-10-09T11:35:34.045 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:35:34.100 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 220604 Links: 1 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-09 11:35:26.701242071 +0000 2023-10-09T11:35:34.156 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-09 11:32:54.742739045 +0000 2023-10-09T11:35:34.157 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-09 11:32:54.742739045 +0000 2023-10-09T11:35:34.157 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-09T11:35:34.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:35:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-09T11:35:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-09T11:35:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000208796 s, 2.5 MB/s 2023-10-09T11:35:34.220 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:35:34.276 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-10-09T11:35:34.331 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 218106 Links: 1 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-09 11:35:26.701242071 +0000 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-09 11:32:55.285733540 +0000 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-09 11:32:55.285733540 +0000 2023-10-09T11:35:34.332 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-09T11:35:34.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:35:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-09T11:35:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-09T11:35:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00018964 s, 2.7 MB/s 2023-10-09T11:35:34.397 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:35:34.453 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:34.453 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:34.453 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T11:35:34.471 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T11:35:34.472 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-10-09T11:35:34.529 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 215683 Links: 1 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-09 11:35:20.779024451 +0000 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-09 11:32:40.353303301 +0000 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-09 11:32:40.353303301 +0000 2023-10-09T11:35:34.530 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-09T11:35:34.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T11:35:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-09T11:35:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-09T11:35:34.598 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000140455 s, 3.6 MB/s 2023-10-09T11:35:34.599 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T11:35:34.658 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-10-09T11:35:34.715 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T11:35:34.715 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 215774 Links: 1 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-09 11:35:20.779024451 +0000 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-09 11:32:40.843301275 +0000 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-09 11:32:40.843301275 +0000 2023-10-09T11:35:34.716 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-09T11:35:34.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T11:35:34.781 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-09T11:35:34.825 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-09T11:35:34.825 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000132182 s, 3.9 MB/s 2023-10-09T11:35:34.826 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T11:35:34.888 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-10-09T11:35:34.952 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 222426 Links: 1 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-09 11:35:20.780024447 +0000 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-09 11:32:41.353299165 +0000 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-09 11:32:41.353299165 +0000 2023-10-09T11:35:34.953 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-09T11:35:34.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T11:35:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-09T11:35:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-09T11:35:35.022 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000130564 s, 3.9 MB/s 2023-10-09T11:35:35.023 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T11:35:35.084 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-10-09T11:35:35.142 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 222549 Links: 1 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-09 11:35:20.780024447 +0000 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-09 11:32:41.863297056 +0000 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-09 11:32:41.863297056 +0000 2023-10-09T11:35:35.143 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-09T11:35:35.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T11:35:35.211 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-09T11:35:35.211 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-09T11:35:35.212 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000102905 s, 5.0 MB/s 2023-10-09T11:35:35.212 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T11:35:35.270 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:35.271 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:35:35.271 INFO:tasks.ceph:Generating config... 2023-10-09T11:35:35.272 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T11:35:35.274 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T11:35:35.274 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T11:35:35.275 INFO:tasks.ceph:[client] pid file = 2023-10-09T11:35:35.275 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T11:35:35.275 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T11:35:35.275 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-09T11:35:35.276 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T11:35:35.276 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T11:35:35.277 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T11:35:35.278 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-09T11:35:35.279 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-09T11:35:35.279 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T11:35:35.279 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T11:35:35.280 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T11:35:35.280 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T11:35:35.280 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T11:35:35.280 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T11:35:35.280 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-09T11:35:35.281 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T11:35:35.281 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T11:35:35.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T11:35:35.340 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T11:35:35.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T11:35:35.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:35:35.454 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2023-10-09T11:35:35.455 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T11:35:35.456 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:35.456 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:35:35.510 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 7857a25d-47fa-49eb-8e61-2818cdc55761 2023-10-09T11:35:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = octopus 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 7857a25d-47fa-49eb-8e61-2818cdc55761 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-10-09T11:35:35.596404+0000 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-10-09T11:35:35.596404+0000 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 15 (octopus) 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2023-10-09T11:35:35.597 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T11:35:35.598 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T11:35:35.613 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7857a25d-47fa-49eb-8e61-2818cdc55761... 2023-10-09T11:35:35.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:35:35.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.698 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-10-09T11:35:35.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:35:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.702 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 7857a25d-47fa-49eb-8e61-2818cdc55761 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.703 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-10-09T11:35:35.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-10-09T11:35:35.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:35:35.706 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-10-09T11:35:35.707 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: memstore device bytes = 200000000 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:35:35.708 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 1.0 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: osd mon report interval = 5 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = memstore 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.709 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:35:35.710 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-10-09T11:35:35.711 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.712 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull ratio = 0.6 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.7 2023-10-09T11:35:35.713 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.6 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-10-09T11:35:35.714 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-10-09T11:35:35.715 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug objectcacher = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug objecter = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug objectcacher = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug objecter = 20 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-10-09T11:35:35.716 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-10-09T11:35:35.717 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-10-09T11:35:35.719 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-10-09T11:35:35.719 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-10-09T11:35:35.719 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T11:35:35.719 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-10-09T11:35:35.719 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.720 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-10-09T11:35:35.721 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-10-09T11:35:35.721 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.722 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T11:35:35.722 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-10-09T11:35:35.723 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-10-09T11:35:35.724 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.6,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 7857a25d-47fa-49eb-8e61-2818cdc55761 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-10-09T11:35:35.725 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-10-09T11:35:35.726 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-10-09T11:35:35.727 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: memstore device bytes = 200000000 2023-10-09T11:35:35.728 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 1.0 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: osd mon report interval = 5 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = memstore 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-10-09T11:35:35.729 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-10-09T11:35:35.730 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T11:35:35.731 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull ratio = 0.6 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.7 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.6 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-09T11:35:35.732 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-10-09T11:35:35.733 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout: debug objectcacher = 20 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout: debug objecter = 20 2023-10-09T11:35:35.734 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: debug objectcacher = 20 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: debug objecter = 20 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-10-09T11:35:35.735 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-10-09T11:35:35.736 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-10-09T11:35:35.736 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T11:35:35.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T11:35:35.811 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T11:35:35.811 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:35.811 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T11:35:35.826 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:35.826 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T11:35:35.881 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:35:35.881 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:35.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:35:35.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:35:35.956 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:35.956 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:36.011 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:35:36.011 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:36.011 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T11:35:36.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T11:35:36.049 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:36.050 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:36.105 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T11:35:36.105 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T11:35:36.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:35:36.154 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T11:35:36.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:35:36.226 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T11:35:36.229 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T11:35:36.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:35:36.279 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T11:35:36.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T11:35:36.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:35:36.396 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T11:35:36.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T11:35:36.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:35:36.473 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T11:35:36.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T11:35:36.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:35:36.586 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T11:35:36.588 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T11:35:36.612 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T11:35:36.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T11:35:36.651 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T11:35:36.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T11:35:36.743 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T11:35:36.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T11:35:36.794 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T11:35:36.806 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T11:35:36.884 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T11:35:36.896 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T11:35:36.897 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T11:35:36.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T11:35:36.922 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:36.922 INFO:tasks.ceph:role: osd.0 2023-10-09T11:35:36.923 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:35:36.923 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:36.995 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:36.996 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:36.996 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:37.429 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-09T11:35:37.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-09T11:35:37.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T11:35:37.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T11:35:37.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T11:35:37.694 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:37.694 INFO:tasks.ceph:role: osd.1 2023-10-09T11:35:37.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:35:37.694 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:37.768 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:37.768 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:38.190 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-09T11:35:38.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-09T11:35:38.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T11:35:38.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T11:35:38.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T11:35:38.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:38.392 INFO:tasks.ceph:role: osd.2 2023-10-09T11:35:38.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:35:38.393 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:38.466 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:38.467 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:38.467 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:38.467 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:38.917 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-09T11:35:38.919 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-09T11:35:38.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T11:35:39.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T11:35:39.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T11:35:39.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:39.190 INFO:tasks.ceph:role: osd.3 2023-10-09T11:35:39.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:35:39.190 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:35:39.263 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:39.263 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:39.263 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:39.264 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:39.692 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-10-09T11:35:39.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-10-09T11:35:39.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T11:35:39.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T11:35:39.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:39.997+0000 7f5cfb4d7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T11:35:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:39.998+0000 7f5cfb4d7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T11:35:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:39.998+0000 7f5cfb4d7540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-09T11:35:40.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T11:35:40.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.118+0000 7fc441cc9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T11:35:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.118+0000 7fc441cc9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T11:35:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.119+0000 7fc441cc9540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-09T11:35:40.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T11:35:40.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:40.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.274+0000 7fa1929bc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T11:35:40.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.274+0000 7fa1929bc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T11:35:40.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.275+0000 7fa1929bc540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-09T11:35:40.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T11:35:40.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:40.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.429+0000 7fcd38184540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T11:35:40.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.429+0000 7fcd38184540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T11:35:40.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:40.430+0000 7fcd38184540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-09T11:35:40.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T11:35:40.503 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T11:35:40.533 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:40.534 INFO:tasks.ceph:role: osd.4 2023-10-09T11:35:40.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:35:40.534 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T11:35:40.604 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-10-09T11:35:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:40.606 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:40.606 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:40.626 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-10-09T11:35:41.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-10-09T11:35:41.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T11:35:41.205 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T11:35:41.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T11:35:41.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:41.340 INFO:tasks.ceph:role: osd.5 2023-10-09T11:35:41.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:35:41.340 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T11:35:41.404 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:41.404 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:41.404 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:41.405 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:41.406 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:41.427 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-10-09T11:35:41.429 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-10-09T11:35:41.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T11:35:41.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T11:35:41.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T11:35:41.639 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:41.640 INFO:tasks.ceph:role: osd.6 2023-10-09T11:35:41.640 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:35:41.640 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T11:35:41.703 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:41.703 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:41.703 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:41.704 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:41.726 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-10-09T11:35:41.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-10-09T11:35:41.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T11:35:41.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T11:35:41.871 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T11:35:41.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T11:35:41.935 INFO:tasks.ceph:role: osd.7 2023-10-09T11:35:41.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:35:41.935 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T11:35:41.999 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-10-09T11:35:42.000 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T11:35:42.000 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T11:35:42.000 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T11:35:42.000 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T11:35:42.024 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-10-09T11:35:42.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-10-09T11:35:42.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T11:35:42.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T11:35:42.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:42.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.323+0000 7f95f0213540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T11:35:42.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.323+0000 7f95f0213540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T11:35:42.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.323+0000 7f95f0213540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-09T11:35:42.330 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T11:35:42.354 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:42.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.432+0000 7f27ead99540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T11:35:42.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.433+0000 7f27ead99540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T11:35:42.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.433+0000 7f27ead99540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-09T11:35:42.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T11:35:42.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:42.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.582+0000 7f0e6cf3e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T11:35:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.583+0000 7f0e6cf3e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T11:35:42.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.583+0000 7f0e6cf3e540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-09T11:35:42.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T11:35:42.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:42.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.732+0000 7f13a79e0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T11:35:42.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.732+0000 7f13a79e0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T11:35:42.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:42.733+0000 7f13a79e0540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-09T11:35:42.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T11:35:42.803 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T11:35:42.803 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:42.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T11:35:42.832 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:42.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T11:35:42.900 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:42.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T11:35:42.967 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:42.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T11:35:43.034 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:43.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T11:35:43.101 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:43.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T11:35:43.166 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:43.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T11:35:43.232 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T11:35:43.256 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.257 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T11:35:43.321 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.321 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T11:35:43.384 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T11:35:43.448 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T11:35:43.512 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.512 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T11:35:43.576 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T11:35:43.640 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:43.640 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T11:35:43.657 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:43.657 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T11:35:43.713 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.713 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T11:35:43.728 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:43.728 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T11:35:43.783 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T11:35:43.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:35:43.785 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T11:35:43.825 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw== 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ== 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ== 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A== 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ== 2023-10-09T11:35:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA== 2023-10-09T11:35:43.827 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ== 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg== 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ== 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ== 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ== 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-10-09T11:35:43.828 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg== 2023-10-09T11:35:43.829 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2023-10-09T11:35:43.829 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug== 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw== 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ== 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-10-09T11:35:43.845 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ== 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A== 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ== 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA== 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ== 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-10-09T11:35:43.846 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg== 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-10-09T11:35:43.847 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ== 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ== 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ== 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg== 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2023-10-09T11:35:43.848 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug== 2023-10-09T11:35:43.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:35:43.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:35:44.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.409 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:35:44.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T11:35:44.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T11:35:44.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.944 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:44.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T11:35:45.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T11:35:45.248 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T11:35:45.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T11:35:45.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:35:45.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T11:35:45.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T11:35:45.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:35:45.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T11:35:45.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T11:35:45.594 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T11:35:45.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T11:35:45.709 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:45.711 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T11:35:45.763 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T11:35:45.764 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T11:35:45.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T11:35:45.768 INFO:tasks.ceph.mon.a:Started 2023-10-09T11:35:45.768 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T11:35:45.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T11:35:45.806 INFO:tasks.ceph.mon.b:Started 2023-10-09T11:35:45.806 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T11:35:45.806 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T11:35:45.810 INFO:tasks.ceph.mon.c:Started 2023-10-09T11:35:45.810 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T11:35:45.811 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T11:35:45.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T11:35:45.813 INFO:tasks.ceph.mgr.y:Started 2023-10-09T11:35:45.814 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T11:35:45.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T11:35:45.816 INFO:tasks.ceph.mgr.x:Started 2023-10-09T11:35:45.816 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T11:35:45.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T11:35:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.935+0000 7f572d2e1700 1 Processor -- start 2023-10-09T11:35:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.935+0000 7f572d2e1700 1 -- start start 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f572d2e1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 0x7f572806a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f572d2e1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280af720 con 0x7f57280cc700 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f572d2e1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280c7bd0 con 0x7f572806a9b0 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f572d2e1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280af950 con 0x7f5728156a50 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f5726ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 0x7f572806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f57277fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57280cc700 0x7f57280c8c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35094/0 (socket says 172.21.15.6:35094) 2023-10-09T11:35:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f57277fe700 1 -- 172.21.15.6:0/1205678869 learned_addr learned my addr 172.21.15.6:0/1205678869 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:35:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f5726ffd700 1 -- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 msgr2=0x7f572806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-09T11:35:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f5726ffd700 1 -- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 msgr2=0x7f572806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T11:35:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f5726ffd700 1 --2- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 0x7f572806a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T11:35:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:45.936+0000 7f5726ffd700 1 --2- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 0x7f572806a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395798987 0 0) 0x7f57280af720 con 0x7f57280cc700 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5714003570 con 0x7f57280cc700 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586862761 0 0) 0x7f57280c7bd0 con 0x7f572806a9b0 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57280af720 con 0x7f572806a9b0 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729609947 0 0) 0x7f57280af720 con 0x7f572806a9b0 2023-10-09T11:35:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 msgr2=0x7f572806a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 --2- 172.21.15.6:0/1205678869 >> v2:172.21.15.6:3300/0 conn(0x7f5728156a50 0x7f572806a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 >> v1:172.21.15.6:6789/0 conn(0x7f57280cc700 legacy=0x7f57280c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280afc30 con 0x7f572806a9b0 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f57100014c0 con 0x7f572806a9b0 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 >> v1:172.21.15.118:6789/0 conn(0x7f572806a9b0 legacy=0x7f57280cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.122+0000 7f5725ffb700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714003c40 0x7f5714004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 0x7f5714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57140052e0 0x7f571400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280af950 con 0x7f5714004810 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571400c1b0 con 0x7f57140052e0 2023-10-09T11:35:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571400c370 con 0x7f5714003c40 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 0x7f5714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57277fe700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57140052e0 0x7f571400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5726ffd700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714003c40 0x7f5714004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 -- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714003c40 msgr2=0x7f5714004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714003c40 0x7f5714004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 -- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57140052e0 msgr2=0x7f571400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57140052e0 0x7f571400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57277fe700 1 -- 172.21.15.6:0/1205678869 reap_dead start 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 -- 172.21.15.6:0/1205678869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280af720 con 0x7f5714004810 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f57267fc700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 0x7f5714004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5710007fb0 tx=0x7f5710002dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe17d832a68a6e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710016070 con 0x7f5714004810 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000c9e0 con 0x7f5714004810 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.123+0000 7f5725ffb700 1 -- 172.21.15.6:0/1205678869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710007970 con 0x7f5714004810 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 -- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 msgr2=0x7f5714004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 0x7f5714004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5710007fb0 tx=0x7f5710002dc0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 -- 172.21.15.6:0/1205678869 shutdown_connections 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 --2- 172.21.15.6:0/1205678869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5714004810 0x7f5714004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 -- 172.21.15.6:0/1205678869 >> 172.21.15.6:0/1205678869 conn(0x7f572806cca0 msgr2=0x7f572806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 -- 172.21.15.6:0/1205678869 shutdown_connections 2023-10-09T11:35:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.124+0000 7f572d2e1700 1 -- 172.21.15.6:0/1205678869 wait complete. 2023-10-09T11:35:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.126+0000 7f572d2e1700 1 Processor -- start 2023-10-09T11:35:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.126+0000 7f572d2e1700 1 -- start start 2023-10-09T11:35:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 0x7f5728151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5728147510 0x7f572806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 0x7f572806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728151fb0 con 0x7f5728147980 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57281515e0 con 0x7f5728147510 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f572d2e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57281509d0 con 0x7f5714004810 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f5726ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 0x7f5728151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f57277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 0x7f572806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f57267fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5728147510 0x7f572806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f5726ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 0x7f5728151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:45774/0 (socket says 172.21.15.6:45774) 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.127+0000 7f5726ffd700 1 -- 172.21.15.6:0/16476123 learned_addr learned my addr 172.21.15.6:0/16476123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 -- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 msgr2=0x7f5728151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 0x7f5728151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 -- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5728147510 msgr2=0x7f572806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5728147510 0x7f572806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 -- 172.21.15.6:0/16476123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728150cb0 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f57277fe700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 0x7f572806c0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57280656a0 tx=0x7f5720007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720001d20 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720012560 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728150f90 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720012920 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5728158720 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5720012d10 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.128+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f572001dcf0 con 0x7f5728147980 2023-10-09T11:35:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.129+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728151770 con 0x7f5728147980 2023-10-09T11:35:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.133+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f572001d460 con 0x7f5728147980 2023-10-09T11:35:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.209+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f57280aff10 con 0x7f5728147980 2023-10-09T11:35:46.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.212+0000 7f571effd700 1 -- 172.21.15.6:0/16476123 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5720027430 con 0x7f5728147980 2023-10-09T11:35:46.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 msgr2=0x7f572806c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 0x7f572806c0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57280656a0 tx=0x7f5720007de0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 shutdown_connections 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5728147980 0x7f572806c0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5714004810 0x7f5728151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 --2- 172.21.15.6:0/16476123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5728147510 0x7f572806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 >> 172.21.15.6:0/16476123 conn(0x7f572806cca0 msgr2=0x7f5728149500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.213+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 shutdown_connections 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:46.214+0000 7f572d2e1700 1 -- 172.21.15.6:0/16476123 wait complete. 2023-10-09T11:35:46.215 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-10-09T11:35:46.226 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T11:35:46.226 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:46.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T11:35:46.251 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:46.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T11:35:46.318 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:46.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T11:35:46.383 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-09T11:35:46.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T11:35:46.448 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:46.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T11:35:46.472 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:46.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T11:35:46.537 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:46.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T11:35:46.602 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-09T11:35:46.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T11:35:46.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-09T11:35:46.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.819+0000 7fcf56766700 1 Processor -- start 2023-10-09T11:35:46.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.819+0000 7fcf56766700 1 -- start start 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf56766700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 0x7fcf500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf56766700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500d07c0 con 0x7fcf501578d0 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf56766700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500cfbb0 con 0x7fcf5006d120 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf56766700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500cfe90 con 0x7fcf50157ca0 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf54d03700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fcf5006d120 0x7fcf5015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42444/0 (socket says 172.21.15.118:42444) 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf54d03700 1 -- 172.21.15.118:0/2500199611 learned_addr learned my addr 172.21.15.118:0/2500199611 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 0x7fcf500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4effd700 1 -- 172.21.15.118:0/2500199611 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100464452 0 0) 0x7fcf500cfbb0 con 0x7fcf5006d120 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4effd700 1 -- 172.21.15.118:0/2500199611 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf38003570 con 0x7fcf5006d120 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2500199611 >> v1:172.21.15.118:6789/0 conn(0x7fcf5006d120 legacy=0x7fcf5015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2500199611 >> v1:172.21.15.6:6789/0 conn(0x7fcf501578d0 legacy=0x7fcf5015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2500199611 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500d0170 con 0x7fcf50157ca0 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4f7fe700 1 --2- 172.21.15.118:0/2500199611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 0x7fcf500cf4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009910 tx=0x7fcf440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b739f0631cc4eec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4effd700 1 -- 172.21.15.118:0/2500199611 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400b680 con 0x7fcf50157ca0 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4effd700 1 -- 172.21.15.118:0/2500199611 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4400b7e0 con 0x7fcf50157ca0 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.820+0000 7fcf4effd700 1 -- 172.21.15.118:0/2500199611 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400bba0 con 0x7fcf50157ca0 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 -- 172.21.15.118:0/2500199611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 msgr2=0x7fcf500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 --2- 172.21.15.118:0/2500199611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 0x7fcf500cf4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009910 tx=0x7fcf440091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 -- 172.21.15.118:0/2500199611 shutdown_connections 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 --2- 172.21.15.118:0/2500199611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf50157ca0 0x7fcf500cf4f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 -- 172.21.15.118:0/2500199611 >> 172.21.15.118:0/2500199611 conn(0x7fcf5006bb90 msgr2=0x7fcf5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 -- 172.21.15.118:0/2500199611 shutdown_connections 2023-10-09T11:35:46.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.821+0000 7fcf56766700 1 -- 172.21.15.118:0/2500199611 wait complete. 2023-10-09T11:35:46.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.823+0000 7fcf56766700 1 Processor -- start 2023-10-09T11:35:46.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.823+0000 7fcf56766700 1 -- start start 2023-10-09T11:35:46.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf50157ca0 0x7fcf500c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c8bf0 con 0x7fcf50157ca0 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c7ef0 con 0x7fcf501578d0 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf56766700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50155260 con 0x7fcf5006d120 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf4f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50400/0 (socket says 172.21.15.118:50400) 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf4ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:54992/0 (socket says 172.21.15.118:54992) 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2861123582 learned_addr learned my addr 172.21.15.118:0/2861123582 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.824+0000 7fcf54d03700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf50157ca0 0x7fcf500c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 msgr2=0x7fcf50154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2861123582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf50157ca0 msgr2=0x7fcf500c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf50157ca0 0x7fcf500c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 -- 172.21.15.118:0/2861123582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009420 con 0x7fcf501578d0 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4ffff700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf4f7fe700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006fe20 tx=0x7fcf44017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400bb60 con 0x7fcf501578d0 2023-10-09T11:35:46.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44000c90 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500c72e0 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4401a660 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500c78a0 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcf4401ac90 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.825+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcf44011bb0 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.826+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50067ac0 con 0x7fcf501578d0 2023-10-09T11:35:46.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.828+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcf44034060 con 0x7fcf501578d0 2023-10-09T11:35:46.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.909+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7fcf500d0450 con 0x7fcf501578d0 2023-10-09T11:35:46.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.912+0000 7fcf37fff700 1 -- 172.21.15.118:0/2861123582 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf44015020 con 0x7fcf501578d0 2023-10-09T11:35:46.914 INFO:teuthology.orchestra.run.smithi118.stdout:0 2023-10-09T11:35:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 msgr2=0x7fcf500c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006fe20 tx=0x7fcf44017000 comp rx=0 tx=0).stop 2023-10-09T11:35:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 shutdown_connections 2023-10-09T11:35:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf50157ca0 0x7fcf500c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcf5006d120 0x7fcf50154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 --2- 172.21.15.118:0/2861123582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf501578d0 0x7fcf500c6720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 >> 172.21.15.118:0/2861123582 conn(0x7fcf5006bb90 msgr2=0x7fcf50155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 shutdown_connections 2023-10-09T11:35:46.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:46.913+0000 7fcf56766700 1 -- 172.21.15.118:0/2861123582 wait complete. 2023-10-09T11:35:46.926 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-09T11:35:47.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.040+0000 7f5bf2f7d700 1 Processor -- start 2023-10-09T11:35:47.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.040+0000 7f5bf2f7d700 1 -- start start 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf2f7d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5bec0cf240 0x7f5bec0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf2f7d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bec06d650 0x7f5bec06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf2f7d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0b0ca0 con 0x7f5bec15a2a0 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf2f7d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec06ea90 con 0x7f5bec06d650 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf2f7d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0b00d0 con 0x7f5bec0cf240 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5bec0cf240 0x7f5bec0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5bec0cf240 0x7f5bec0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50412/0 (socket says 172.21.15.118:50412) 2023-10-09T11:35:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 -- 172.21.15.118:0/3853823967 learned_addr learned my addr 172.21.15.118:0/3853823967 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bf151a700 1 --2- 172.21.15.118:0/3853823967 >> v2:172.21.15.6:3300/0 conn(0x7f5bec06d650 0x7f5bec06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 -- 172.21.15.118:0/3853823967 >> v2:172.21.15.6:3300/0 conn(0x7f5bec06d650 msgr2=0x7f5bec06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 --2- 172.21.15.118:0/3853823967 >> v2:172.21.15.6:3300/0 conn(0x7f5bec06d650 0x7f5bec06da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 -- 172.21.15.118:0/3853823967 >> v1:172.21.15.6:6789/0 conn(0x7f5bec15a2a0 legacy=0x7f5bec0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 -- 172.21.15.118:0/3853823967 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0b0370 con 0x7f5bec0cf240 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5bebfff700 1 --2- 172.21.15.118:0/3853823967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec0cf240 0x7f5bec0b1130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0713b0 tx=0x7f5bd8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc76f54a9a2218d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5beb7fe700 1 -- 172.21.15.118:0/3853823967 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8009e70 con 0x7f5bec0cf240 2023-10-09T11:35:47.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5beb7fe700 1 -- 172.21.15.118:0/3853823967 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800b860 con 0x7f5bec0cf240 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.041+0000 7f5beb7fe700 1 -- 172.21.15.118:0/3853823967 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800bc00 con 0x7f5bec0cf240 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/3853823967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec0cf240 msgr2=0x7f5bec0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/3853823967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec0cf240 0x7f5bec0b1130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0713b0 tx=0x7f5bd8009250 comp rx=0 tx=0).stop 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/3853823967 shutdown_connections 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/3853823967 >> v2:172.21.15.6:3300/0 conn(0x7f5bec06d650 0x7f5bec06da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/3853823967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec0cf240 0x7f5bec0b1130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/3853823967 >> 172.21.15.118:0/3853823967 conn(0x7f5bec067640 msgr2=0x7f5bec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/3853823967 shutdown_connections 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.042+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/3853823967 wait complete. 2023-10-09T11:35:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.043+0000 7f5bf2f7d700 1 Processor -- start 2023-10-09T11:35:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.043+0000 7f5bf2f7d700 1 -- start start 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bec06d650 0x7f5bec16db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5bec0cf240 0x7f5bec0b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0b46e0 con 0x7f5bec06d650 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec16eaf0 con 0x7f5bec15a2a0 2023-10-09T11:35:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf2f7d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec15ccb0 con 0x7f5bec0cf240 2023-10-09T11:35:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bebfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5bec0cf240 0x7f5bec0b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50426/0 (socket says 172.21.15.118:50426) 2023-10-09T11:35:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 -- 172.21.15.118:0/479175591 learned_addr learned my addr 172.21.15.118:0/479175591 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf0d19700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bec06d650 0x7f5bec16db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 -- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5bec0cf240 msgr2=0x7f5bec0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5bec0cf240 0x7f5bec0b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 -- 172.21.15.118:0/479175591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bec06d650 msgr2=0x7f5bec16db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bec06d650 0x7f5bec16db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.044+0000 7f5bf151a700 1 -- 172.21.15.118:0/479175591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80094f0 con 0x7f5bec15a2a0 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5bf151a700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009e90 tx=0x7f5be400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400cb70 con 0x7f5bec15a2a0 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400f040 con 0x7f5bec15a2a0 2023-10-09T11:35:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4014480 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec155800 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec16e530 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5be4014a70 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.045+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f5be401dd30 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.046+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec15ca80 con 0x7f5bec15a2a0 2023-10-09T11:35:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.048+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5be403c6d0 con 0x7f5bec15a2a0 2023-10-09T11:35:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.130+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f5bec04bb80 con 0x7f5bec15a2a0 2023-10-09T11:35:47.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.134+0000 7f5be8ff9700 1 -- 172.21.15.118:0/479175591 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5be402b070 con 0x7f5bec15a2a0 2023-10-09T11:35:47.136 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:35:47.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 msgr2=0x7f5bec1552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009e90 tx=0x7f5be400b040 comp rx=0 tx=0).stop 2023-10-09T11:35:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 shutdown_connections 2023-10-09T11:35:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bec15a2a0 0x7f5bec1552c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bec06d650 0x7f5bec16db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 --2- 172.21.15.118:0/479175591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5bec0cf240 0x7f5bec0b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 >> 172.21.15.118:0/479175591 conn(0x7f5bec067640 msgr2=0x7f5bec1570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 shutdown_connections 2023-10-09T11:35:47.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.135+0000 7f5bf2f7d700 1 -- 172.21.15.118:0/479175591 wait complete. 2023-10-09T11:35:47.148 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-09T11:35:47.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 Processor -- start 2023-10-09T11:35:47.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 -- start start 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a815dfb0 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80acec0 con 0x7fd5a80ce5c0 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.263+0000 7fd5ae0cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80ad1a0 con 0x7fd5a80ac570 2023-10-09T11:35:47.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a77fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd5a80ce1f0 0x7fd5a815e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42452/0 (socket says 172.21.15.118:42452) 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a77fe700 1 -- 172.21.15.118:0/1501523428 learned_addr learned my addr 172.21.15.118:0/1501523428 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55006/0 (socket says 172.21.15.118:55006) 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a6ffd700 1 --2- 172.21.15.118:0/1501523428 >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50428/0 (socket says 172.21.15.118:50428) 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 -- 172.21.15.118:0/1501523428 >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 msgr2=0x7fd5a80aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 --2- 172.21.15.118:0/1501523428 >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 -- 172.21.15.118:0/1501523428 >> v1:172.21.15.118:6789/0 conn(0x7fd5a80ce1f0 legacy=0x7fd5a815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 -- 172.21.15.118:0/1501523428 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a815dc40 con 0x7fd5a80ac570 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a67fc700 1 -- 172.21.15.118:0/1501523428 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153722806 0 0) 0x7fd5a815dfb0 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a6ffd700 1 --2- 172.21.15.118:0/1501523428 >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a7fff700 1 --2- 172.21.15.118:0/1501523428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009e60 tx=0x7fd5a0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e276e5264dc891e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a67fc700 1 -- 172.21.15.118:0/1501523428 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000e070 con 0x7fd5a80ac570 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a67fc700 1 -- 172.21.15.118:0/1501523428 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a000bb60 con 0x7fd5a80ac570 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.264+0000 7fd5a67fc700 1 -- 172.21.15.118:0/1501523428 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0012430 con 0x7fd5a80ac570 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/1501523428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 msgr2=0x7fd5a806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/1501523428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009e60 tx=0x7fd5a0009780 comp rx=0 tx=0).stop 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/1501523428 shutdown_connections 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/1501523428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ac570 0x7fd5a806e230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/1501523428 >> v2:172.21.15.118:3300/0 conn(0x7fd5a80ce5c0 0x7fd5a80aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/1501523428 >> 172.21.15.118:0/1501523428 conn(0x7fd5a806cca0 msgr2=0x7fd5a806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/1501523428 shutdown_connections 2023-10-09T11:35:47.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.265+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/1501523428 wait complete. 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.266+0000 7fd5ae0cd700 1 Processor -- start 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.266+0000 7fd5ae0cd700 1 -- start start 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 0x7fd5a80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 0x7fd5a81538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80ae840 con 0x7fd5a80ac570 2023-10-09T11:35:47.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80adc30 con 0x7fd5a80ce5c0 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5ae0cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80adf10 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a6ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 0x7fd5a81538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50442/0 (socket says 172.21.15.118:50442) 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a7fff700 1 -- 172.21.15.118:0/40493526 learned_addr learned my addr 172.21.15.118:0/40493526 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a77fe700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 0x7fd5a80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a6ffd700 1 -- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 msgr2=0x7fd5a80aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a6ffd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a6ffd700 1 -- 172.21.15.118:0/40493526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 msgr2=0x7fd5a80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.267+0000 7fd5a6ffd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 0x7fd5a80ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5a6ffd700 1 -- 172.21.15.118:0/40493526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009420 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5a7fff700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5a77fe700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 0x7fd5a80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5a6ffd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 0x7fd5a81538f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd59000ec80 tx=0x7fd5900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000c850 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000c9b0 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a0009a20 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000cd50 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a80ad920 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd590005c80 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.268+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fd590013c20 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.269+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a80ae0d0 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.271+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd590021060 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.328 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:47.327+0000 7f91b3491180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:35:47.330 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:47.330+0000 7ff6d26b3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T11:35:47.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.354+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7fd5a80ae9b0 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.358+0000 7fd59f7fe700 1 -- 172.21.15.118:0/40493526 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd590017070 con 0x7fd5a80ce1f0 2023-10-09T11:35:47.360 INFO:teuthology.orchestra.run.smithi118.stdout:2 2023-10-09T11:35:47.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 msgr2=0x7fd5a81538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 0x7fd5a81538f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd59000ec80 tx=0x7fd5900091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 shutdown_connections 2023-10-09T11:35:47.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5a80ce5c0 0x7fd5a80aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5a80ac570 0x7fd5a80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 --2- 172.21.15.118:0/40493526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5a80ce1f0 0x7fd5a81538f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 >> 172.21.15.118:0/40493526 conn(0x7fd5a806cca0 msgr2=0x7fd5a815ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.359+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 shutdown_connections 2023-10-09T11:35:47.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.360+0000 7fd5ae0cd700 1 -- 172.21.15.118:0/40493526 wait complete. 2023-10-09T11:35:47.373 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-09T11:35:47.468 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:47.466+0000 7f91b3491180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:47.469 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:47.469+0000 7ff6d26b3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:47.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.486+0000 7ffa3f575700 1 Processor -- start 2023-10-09T11:35:47.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.486+0000 7ffa3f575700 1 -- start start 2023-10-09T11:35:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3f575700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 0x7ffa380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3f575700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa3806d120 0x7ffa3806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3f575700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806dac0 con 0x7ffa381578d0 2023-10-09T11:35:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3f575700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380d07c0 con 0x7ffa3806d120 2023-10-09T11:35:47.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3f575700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380cfbb0 con 0x7ffa38157ca0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 0x7ffa380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3d311700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ffa381578d0 0x7ffa3815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42468/0 (socket says 172.21.15.118:42468) 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3d311700 1 -- 172.21.15.118:0/2565609626 learned_addr learned my addr 172.21.15.118:0/2565609626 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3db12700 1 --2- 172.21.15.118:0/2565609626 >> v2:172.21.15.6:3300/0 conn(0x7ffa3806d120 0x7ffa3806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2565609626 >> v2:172.21.15.6:3300/0 conn(0x7ffa3806d120 msgr2=0x7ffa3806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 --2- 172.21.15.118:0/2565609626 >> v2:172.21.15.6:3300/0 conn(0x7ffa3806d120 0x7ffa3806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2565609626 >> v1:172.21.15.118:6789/0 conn(0x7ffa381578d0 legacy=0x7ffa3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa2ffff700 1 -- 172.21.15.118:0/2565609626 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887041892 0 0) 0x7ffa34001110 con 0x7ffa381578d0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2565609626 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380cfe90 con 0x7ffa38157ca0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.487+0000 7ffa3cb10700 1 --2- 172.21.15.118:0/2565609626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 0x7ffa380cf4f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098e0 tx=0x7ffa280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245b7ca8d33ceacc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa2ffff700 1 -- 172.21.15.118:0/2565609626 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800b640 con 0x7ffa38157ca0 2023-10-09T11:35:47.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa2ffff700 1 -- 172.21.15.118:0/2565609626 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800b7a0 con 0x7ffa38157ca0 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa2ffff700 1 -- 172.21.15.118:0/2565609626 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800bb40 con 0x7ffa38157ca0 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 -- 172.21.15.118:0/2565609626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 msgr2=0x7ffa380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2565609626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 0x7ffa380cf4f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098e0 tx=0x7ffa280091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 -- 172.21.15.118:0/2565609626 shutdown_connections 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2565609626 >> v2:172.21.15.6:3300/0 conn(0x7ffa3806d120 0x7ffa3806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2565609626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa38157ca0 0x7ffa380cf4f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 -- 172.21.15.118:0/2565609626 >> 172.21.15.118:0/2565609626 conn(0x7ffa3806bb90 msgr2=0x7ffa3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 -- 172.21.15.118:0/2565609626 shutdown_connections 2023-10-09T11:35:47.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.488+0000 7ffa3f575700 1 -- 172.21.15.118:0/2565609626 wait complete. 2023-10-09T11:35:47.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.489+0000 7ffa3f575700 1 Processor -- start 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.489+0000 7ffa3f575700 1 -- start start 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 0x7ffa3816a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa38157ca0 0x7ffa380aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380b6ad0 con 0x7ffa38157ca0 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ac1d0 con 0x7ffa3806d120 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3f575700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380ac4b0 con 0x7ffa381578d0 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3cb10700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3d311700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 0x7ffa3816a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3cb10700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55046/0 (socket says 172.21.15.118:55046) 2023-10-09T11:35:47.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2272010668 learned_addr learned my addr 172.21.15.118:0/2272010668 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.490+0000 7ffa3db12700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa38157ca0 0x7ffa380aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 msgr2=0x7ffa3816a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 0x7ffa3816a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2272010668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa38157ca0 msgr2=0x7ffa380aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa38157ca0 0x7ffa380aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 -- 172.21.15.118:0/2272010668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009420 con 0x7ffa381578d0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3d311700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 0x7ffa3816a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3cb10700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f80 tx=0x7ffa28017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800bb20 con 0x7ffa381578d0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28000c90 con 0x7ffa381578d0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380ab5c0 con 0x7ffa381578d0 2023-10-09T11:35:47.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28026680 con 0x7ffa381578d0 2023-10-09T11:35:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa380abb80 con 0x7ffa381578d0 2023-10-09T11:35:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ffa28026ab0 con 0x7ffa381578d0 2023-10-09T11:35:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.491+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7ffa280119b0 con 0x7ffa381578d0 2023-10-09T11:35:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.492+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa38067ac0 con 0x7ffa381578d0 2023-10-09T11:35:47.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.494+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ffa2802b020 con 0x7ffa381578d0 2023-10-09T11:35:47.547 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:47.546+0000 7f91b3491180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:35:47.548 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:47.548+0000 7ff6d26b3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T11:35:47.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.577+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7ffa380ac5f0 con 0x7ffa381578d0 2023-10-09T11:35:47.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.581+0000 7ffa2d7fa700 1 -- 172.21.15.118:0/2272010668 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa28015020 con 0x7ffa381578d0 2023-10-09T11:35:47.582 INFO:teuthology.orchestra.run.smithi118.stdout:3 2023-10-09T11:35:47.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 msgr2=0x7ffa38153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f80 tx=0x7ffa28017000 comp rx=0 tx=0).stop 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 shutdown_connections 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa38157ca0 0x7ffa380aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa3806d120 0x7ffa3816a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 --2- 172.21.15.118:0/2272010668 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa381578d0 0x7ffa38153b70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 >> 172.21.15.118:0/2272010668 conn(0x7ffa3806bb90 msgr2=0x7ffa380693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 shutdown_connections 2023-10-09T11:35:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.582+0000 7ffa3f575700 1 -- 172.21.15.118:0/2272010668 wait complete. 2023-10-09T11:35:47.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-09T11:35:47.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.710+0000 7f68f7c38700 1 Processor -- start 2023-10-09T11:35:47.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 -- start start 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68f01583b0 0x7f68f00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00b2890 con 0x7f68f0157fe0 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00b4070 con 0x7f68f01583b0 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.711+0000 7f68f7c38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00b4350 con 0x7f68f00b3bd0 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f51d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68f01583b0 0x7f68f00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f51d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55052/0 (socket says 172.21.15.118:55052) 2023-10-09T11:35:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68f01583b0 0x7f68f00cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50466/0 (socket says 172.21.15.118:50466) 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f51d3700 1 -- 172.21.15.118:0/2830654271 learned_addr learned my addr 172.21.15.118:0/2830654271 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 -- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 msgr2=0x7f68f00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 -- 172.21.15.118:0/2830654271 >> v1:172.21.15.6:6789/0 conn(0x7f68f0157fe0 legacy=0x7f68f00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 -- 172.21.15.118:0/2830654271 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00b4630 con 0x7f68f01583b0 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f51d3700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f61d5700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cf070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009e60 tx=0x7f68e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42145343007ca4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f49d2700 1 -- 172.21.15.118:0/2830654271 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800e070 con 0x7f68f01583b0 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f49d2700 1 -- 172.21.15.118:0/2830654271 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800bb60 con 0x7f68f01583b0 2023-10-09T11:35:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.712+0000 7f68f49d2700 1 -- 172.21.15.118:0/2830654271 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8012430 con 0x7f68f01583b0 2023-10-09T11:35:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 -- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 msgr2=0x7f68f00cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cf070 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009e60 tx=0x7f68e8009780 comp rx=0 tx=0).stop 2023-10-09T11:35:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 -- 172.21.15.118:0/2830654271 shutdown_connections 2023-10-09T11:35:47.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cf070 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 --2- 172.21.15.118:0/2830654271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f00b3bd0 0x7f68f00ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 -- 172.21.15.118:0/2830654271 >> 172.21.15.118:0/2830654271 conn(0x7f68f0067640 msgr2=0x7f68f0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 -- 172.21.15.118:0/2830654271 shutdown_connections 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.713+0000 7f68f7c38700 1 -- 172.21.15.118:0/2830654271 wait complete. 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.714+0000 7f68f7c38700 1 Processor -- start 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.714+0000 7f68f7c38700 1 -- start start 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f00b3bd0 0x7f68f014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00ced90 con 0x7f68f00b3bd0 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f014f860 con 0x7f68f01583b0 2023-10-09T11:35:47.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f7c38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0159860 con 0x7f68f0157fe0 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f51d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50480/0 (socket says 172.21.15.118:50480) 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f51d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55054/0 (socket says 172.21.15.118:55054) 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 -- 172.21.15.118:0/1929640426 learned_addr learned my addr 172.21.15.118:0/1929640426 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f59d4700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f00b3bd0 0x7f68f014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 -- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 msgr2=0x7f68f0159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 -- 172.21.15.118:0/1929640426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f00b3bd0 msgr2=0x7f68f014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f00b3bd0 0x7f68f014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 -- 172.21.15.118:0/1929640426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0094f0 con 0x7f68f01583b0 2023-10-09T11:35:47.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f51d3700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.715+0000 7f68f61d5700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68f006f990 tx=0x7f68e8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8012ea0 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e8027470 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e8009a20 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8027850 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f015a110 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f68e8024070 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.716+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f68e801dde0 con 0x7f68f01583b0 2023-10-09T11:35:47.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.717+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f00cef00 con 0x7f68f01583b0 2023-10-09T11:35:47.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.719+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f68e80466d0 con 0x7f68f01583b0 2023-10-09T11:35:47.740 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:47.740+0000 7ff6d26b3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:47.750 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:47.748+0000 7f91b3491180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:47.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.813+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f68f00cc6b0 con 0x7f68f01583b0 2023-10-09T11:35:47.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68e1ffb700 1 -- 172.21.15.118:0/1929640426 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f68e8035030 con 0x7f68f01583b0 2023-10-09T11:35:47.818 INFO:teuthology.orchestra.run.smithi118.stdout:4 2023-10-09T11:35:47.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 msgr2=0x7f68f00cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68f006f990 tx=0x7f68e8019000 comp rx=0 tx=0).stop 2023-10-09T11:35:47.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 shutdown_connections 2023-10-09T11:35:47.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f01583b0 0x7f68f00cdb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f00b3bd0 0x7f68f014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.817+0000 7f68f7c38700 1 --2- 172.21.15.118:0/1929640426 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f0157fe0 0x7f68f0159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.818+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 >> 172.21.15.118:0/1929640426 conn(0x7f68f0067640 msgr2=0x7f68f01510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.818+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 shutdown_connections 2023-10-09T11:35:47.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.818+0000 7f68f7c38700 1 -- 172.21.15.118:0/1929640426 wait complete. 2023-10-09T11:35:47.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-09T11:35:47.922 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:47.921+0000 7ff6d26b3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:35:47.931 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:47.929+0000 7f91b3491180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T11:35:47.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.945+0000 7f38aaffc700 1 Processor -- start 2023-10-09T11:35:47.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.945+0000 7f38aaffc700 1 -- start start 2023-10-09T11:35:47.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aaffc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 0x7f38a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aaffc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38a40d02b0 0x7f38a406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aaffc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40cf2d0 con 0x7f38a40d0f50 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aaffc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a415a690 con 0x7f38a40d02b0 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aaffc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406dc00 con 0x7f38a40d0b80 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aa7fb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f38a40d0f50 0x7f38a415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42472/0 (socket says 172.21.15.118:42472) 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a9ffa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 0x7f38a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38aa7fb700 1 -- 172.21.15.118:0/2326322792 learned_addr learned my addr 172.21.15.118:0/2326322792 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a97f9700 1 --2- 172.21.15.118:0/2326322792 >> v2:172.21.15.6:3300/0 conn(0x7f38a40d02b0 0x7f38a406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a8ff8700 1 -- 172.21.15.118:0/2326322792 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290141180 0 0) 0x7f38a40cf2d0 con 0x7f38a40d0f50 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a8ff8700 1 -- 172.21.15.118:0/2326322792 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3890003570 con 0x7f38a40d0f50 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a9ffa700 1 -- 172.21.15.118:0/2326322792 >> v2:172.21.15.6:3300/0 conn(0x7f38a40d02b0 msgr2=0x7f38a406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:47.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a9ffa700 1 --2- 172.21.15.118:0/2326322792 >> v2:172.21.15.6:3300/0 conn(0x7f38a40d02b0 0x7f38a406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a9ffa700 1 -- 172.21.15.118:0/2326322792 >> v1:172.21.15.118:6789/0 conn(0x7f38a40d0f50 legacy=0x7f38a415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.946+0000 7f38a9ffa700 1 -- 172.21.15.118:0/2326322792 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40cf570 con 0x7f38a40d0b80 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38a9ffa700 1 --2- 172.21.15.118:0/2326322792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 0x7f38a40cfd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38940098e0 tx=0x7f38940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8762f43ac5cf498 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38a8ff8700 1 -- 172.21.15.118:0/2326322792 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894011630 con 0x7f38a40d0b80 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38a8ff8700 1 -- 172.21.15.118:0/2326322792 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894011790 con 0x7f38a40d0b80 2023-10-09T11:35:47.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38a8ff8700 1 -- 172.21.15.118:0/2326322792 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894011b30 con 0x7f38a40d0b80 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 -- 172.21.15.118:0/2326322792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 msgr2=0x7f38a40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 --2- 172.21.15.118:0/2326322792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 0x7f38a40cfd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38940098e0 tx=0x7f38940091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 -- 172.21.15.118:0/2326322792 shutdown_connections 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 --2- 172.21.15.118:0/2326322792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d0b80 0x7f38a40cfd70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 --2- 172.21.15.118:0/2326322792 >> v2:172.21.15.6:3300/0 conn(0x7f38a40d02b0 0x7f38a406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.947+0000 7f38aaffc700 1 -- 172.21.15.118:0/2326322792 >> 172.21.15.118:0/2326322792 conn(0x7f38a4063230 msgr2=0x7f38a4063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.948+0000 7f38aaffc700 1 -- 172.21.15.118:0/2326322792 shutdown_connections 2023-10-09T11:35:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.948+0000 7f38aaffc700 1 -- 172.21.15.118:0/2326322792 wait complete. 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 Processor -- start 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 -- start start 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38a40d0b80 0x7f38a414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a40d0f50 0x7f38a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40c7030 con 0x7f38a40d0f50 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40c94a0 con 0x7f38a40d0b80 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aaffc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40c9e30 con 0x7f38a40d02b0 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38a9ffa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38a97f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38a40d0b80 0x7f38a414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38a9ffa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55076/0 (socket says 172.21.15.118:55076) 2023-10-09T11:35:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38a9ffa700 1 -- 172.21.15.118:0/778172365 learned_addr learned my addr 172.21.15.118:0/778172365 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.949+0000 7f38aa7fb700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a40d0f50 0x7f38a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 -- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38a40d0b80 msgr2=0x7f38a414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38a40d0b80 0x7f38a414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 -- 172.21.15.118:0/778172365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a40d0f50 msgr2=0x7f38a40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a40d0f50 0x7f38a40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 -- 172.21.15.118:0/778172365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894009420 con 0x7f38a40d02b0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38a9ffa700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38a406dd40 tx=0x7f3894017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894011900 con 0x7f38a40d02b0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894011a60 con 0x7f38a40d02b0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894025640 con 0x7f38a40d02b0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a40c96f0 con 0x7f38a40d02b0 2023-10-09T11:35:47.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.950+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a40ca080 con 0x7f38a40d02b0 2023-10-09T11:35:47.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.951+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3894025cb0 con 0x7f38a40d02b0 2023-10-09T11:35:47.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.951+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40676e0 con 0x7f38a40d02b0 2023-10-09T11:35:47.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.951+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f389402ed30 con 0x7f38a40d02b0 2023-10-09T11:35:47.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:47.953+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3894033060 con 0x7f38a40d02b0 2023-10-09T11:35:48.003 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.002+0000 7ff6d26b3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:35:48.013 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:48.011+0000 7f91b3491180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T11:35:48.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.036+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f38a40cf850 con 0x7f38a40d02b0 2023-10-09T11:35:48.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.040+0000 7f3899ffb700 1 -- 172.21.15.118:0/778172365 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3894015020 con 0x7f38a40d02b0 2023-10-09T11:35:48.042 INFO:teuthology.orchestra.run.smithi118.stdout:5 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 msgr2=0x7f38a40c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38a406dd40 tx=0x7f3894017000 comp rx=0 tx=0).stop 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 shutdown_connections 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a40d0f50 0x7f38a40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f38a40d02b0 0x7f38a40c6af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 --2- 172.21.15.118:0/778172365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38a40d0b80 0x7f38a414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 >> 172.21.15.118:0/778172365 conn(0x7f38a4063230 msgr2=0x7f38a40b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 shutdown_connections 2023-10-09T11:35:48.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.042+0000 7f38aaffc700 1 -- 172.21.15.118:0/778172365 wait complete. 2023-10-09T11:35:48.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-09T11:35:48.143 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.142+0000 7ff6d26b3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:35:48.162 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:48.160+0000 7f91b3491180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T11:35:48.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.174+0000 7fd038635700 1 Processor -- start 2023-10-09T11:35:48.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.174+0000 7fd038635700 1 -- start start 2023-10-09T11:35:48.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd038635700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 0x7fd0300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd038635700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300d07c0 con 0x7fd0301578d0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd038635700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0300cfbb0 con 0x7fd030157ca0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd038635700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300cfe90 con 0x7fd03006d830 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd035bd0700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd030157ca0 0x7fd03006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42488/0 (socket says 172.21.15.118:42488) 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd035bd0700 1 -- 172.21.15.118:0/803020940 learned_addr learned my addr 172.21.15.118:0/803020940 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.175+0000 7fd036bd2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 0x7fd0300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765972639 0 0) 0x7fd0300cfbb0 con 0x7fd030157ca0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd01c003570 con 0x7fd030157ca0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660653834 0 0) 0x7fd0300d07c0 con 0x7fd0301578d0 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd036bd2700 1 -- 172.21.15.118:0/803020940 >> v1:172.21.15.118:6789/0 conn(0x7fd030157ca0 legacy=0x7fd03006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd036bd2700 1 -- 172.21.15.118:0/803020940 >> v1:172.21.15.6:6789/0 conn(0x7fd0301578d0 legacy=0x7fd03015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd036bd2700 1 -- 172.21.15.118:0/803020940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300d0170 con 0x7fd03006d830 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd036bd2700 1 --2- 172.21.15.118:0/803020940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 0x7fd0300cf4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd028009e90 tx=0x7fd028009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba4719823ab442f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800e070 con 0x7fd03006d830 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800bc30 con 0x7fd03006d830 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd0353cf700 1 -- 172.21.15.118:0/803020940 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd028012430 con 0x7fd03006d830 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd038635700 1 -- 172.21.15.118:0/803020940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 msgr2=0x7fd0300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.176+0000 7fd038635700 1 --2- 172.21.15.118:0/803020940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 0x7fd0300cf4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd028009e90 tx=0x7fd028009780 comp rx=0 tx=0).stop 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.177+0000 7fd038635700 1 -- 172.21.15.118:0/803020940 shutdown_connections 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.177+0000 7fd038635700 1 --2- 172.21.15.118:0/803020940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03006d830 0x7fd0300cf4f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.177+0000 7fd038635700 1 -- 172.21.15.118:0/803020940 >> 172.21.15.118:0/803020940 conn(0x7fd03006bb90 msgr2=0x7fd03006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.177+0000 7fd038635700 1 -- 172.21.15.118:0/803020940 shutdown_connections 2023-10-09T11:35:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.177+0000 7fd038635700 1 -- 172.21.15.118:0/803020940 wait complete. 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 Processor -- start 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 -- start start 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03006d830 0x7fd030148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 0x7fd0300ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300ab2d0 con 0x7fd03006d830 2023-10-09T11:35:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030154c80 con 0x7fd030157ca0 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.178+0000 7fd038635700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300aa9a0 con 0x7fd0301578d0 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd035bd0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 0x7fd0300ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50488/0 (socket says 172.21.15.118:50488) 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd035bd0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 0x7fd0300ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:55086/0 (socket says 172.21.15.118:55086) 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 -- 172.21.15.118:0/1260246065 learned_addr learned my addr 172.21.15.118:0/1260246065 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0363d1700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03006d830 0x7fd030148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 -- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 msgr2=0x7fd0300ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 0x7fd0300ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 -- 172.21.15.118:0/1260246065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03006d830 msgr2=0x7fd030148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03006d830 0x7fd030148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 -- 172.21.15.118:0/1260246065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009a20 con 0x7fd030157ca0 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd036bd2700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd03006fe20 tx=0x7fd028019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02801b420 con 0x7fd030157ca0 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02801b5a0 con 0x7fd030157ca0 2023-10-09T11:35:48.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0300aac80 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02801b960 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300acf60 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd02801bd50 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.179+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd02801ca00 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.180+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0300ab440 con 0x7fd030157ca0 2023-10-09T11:35:48.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.182+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd02802a070 con 0x7fd030157ca0 2023-10-09T11:35:48.242 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.242+0000 7ff6d26b3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:48.261 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:48.260+0000 7f91b3491180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T11:35:48.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.264+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fd0300d0450 con 0x7fd030157ca0 2023-10-09T11:35:48.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.270+0000 7fd0267fc700 1 -- 172.21.15.118:0/1260246065 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd02802f440 con 0x7fd030157ca0 2023-10-09T11:35:48.272 INFO:teuthology.orchestra.run.smithi118.stdout:6 2023-10-09T11:35:48.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 msgr2=0x7fd0300ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd03006fe20 tx=0x7fd028019000 comp rx=0 tx=0).stop 2023-10-09T11:35:48.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 shutdown_connections 2023-10-09T11:35:48.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd030157ca0 0x7fd0300ac920 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd03006d830 0x7fd030148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 --2- 172.21.15.118:0/1260246065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0301578d0 0x7fd0300ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 >> 172.21.15.118:0/1260246065 conn(0x7fd03006bb90 msgr2=0x7fd03006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 shutdown_connections 2023-10-09T11:35:48.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.271+0000 7fd038635700 1 -- 172.21.15.118:0/1260246065 wait complete. 2023-10-09T11:35:48.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-09T11:35:48.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.397+0000 7fbb0d488700 1 Processor -- start 2023-10-09T11:35:48.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb0d488700 1 -- start start 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb0d488700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb080b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb0d488700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080b2890 con 0x7fbb080cf240 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb0d488700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080b4070 con 0x7fbb081583b0 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb0d488700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080b4350 con 0x7fbb08157fe0 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb080b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb067fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbb081583b0 0x7fbb080ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:56214/0 (socket says 172.21.15.118:56214) 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.398+0000 7fbb067fc700 1 -- 172.21.15.118:0/2092115933 learned_addr learned my addr 172.21.15.118:0/2092115933 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb06ffd700 1 -- 172.21.15.118:0/2092115933 >> v1:172.21.15.118:6789/0 conn(0x7fbb081583b0 legacy=0x7fbb080ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb06ffd700 1 -- 172.21.15.118:0/2092115933 >> v1:172.21.15.6:6789/0 conn(0x7fbb080cf240 legacy=0x7fbb08158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb05ffb700 1 -- 172.21.15.118:0/2092115933 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514697557 0 0) 0x7fbb080b4070 con 0x7fbb081583b0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb06ffd700 1 -- 172.21.15.118:0/2092115933 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080b4630 con 0x7fbb08157fe0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb06ffd700 1 --2- 172.21.15.118:0/2092115933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb080b34c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009910 tx=0x7fbaf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d6fef21e9ce7a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb05ffb700 1 -- 172.21.15.118:0/2092115933 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800b820 con 0x7fbb08157fe0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb05ffb700 1 -- 172.21.15.118:0/2092115933 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf800b980 con 0x7fbb08157fe0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb05ffb700 1 -- 172.21.15.118:0/2092115933 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800bd20 con 0x7fbb08157fe0 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb0d488700 1 -- 172.21.15.118:0/2092115933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 msgr2=0x7fbb080b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.399+0000 7fbb0d488700 1 --2- 172.21.15.118:0/2092115933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb080b34c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009910 tx=0x7fbaf80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.400+0000 7fbb0d488700 1 -- 172.21.15.118:0/2092115933 shutdown_connections 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.400+0000 7fbb0d488700 1 --2- 172.21.15.118:0/2092115933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb080b34c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.400+0000 7fbb0d488700 1 -- 172.21.15.118:0/2092115933 >> 172.21.15.118:0/2092115933 conn(0x7fbb08067640 msgr2=0x7fbb08067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.400+0000 7fbb0d488700 1 -- 172.21.15.118:0/2092115933 shutdown_connections 2023-10-09T11:35:48.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.400+0000 7fbb0d488700 1 -- 172.21.15.118:0/2092115933 wait complete. 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 Processor -- start 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 -- start start 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb080cf240 0x7fbb0814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb081583b0 0x7fbb0814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08156e60 con 0x7fbb081583b0 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08150f60 con 0x7fbb080cf240 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.401+0000 7fbb0d488700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08150630 con 0x7fbb08157fe0 2023-10-09T11:35:48.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb080cf240 0x7fbb0814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:43922/0 (socket says 172.21.15.118:43922) 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 -- 172.21.15.118:0/193693610 learned_addr learned my addr 172.21.15.118:0/193693610 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb077fe700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb081583b0 0x7fbb0814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 -- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb080cf240 msgr2=0x7fbb0814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb080cf240 0x7fbb0814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 -- 172.21.15.118:0/193693610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb081583b0 msgr2=0x7fbb0814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb081583b0 0x7fbb0814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 -- 172.21.15.118:0/193693610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8009420 con 0x7fbb08157fe0 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb067fc700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c7e0 tx=0x7fbaf0007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0005b30 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0005c90 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08150910 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0007300 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0814ae40 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbaf001c440 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.402+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fbaf0005e00 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.403+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08069e40 con 0x7fbb08157fe0 2023-10-09T11:35:48.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.405+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbaf0017070 con 0x7fbb08157fe0 2023-10-09T11:35:48.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.486+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7fbb081510a0 con 0x7fbb08157fe0 2023-10-09T11:35:48.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.493+0000 7fbafeffd700 1 -- 172.21.15.118:0/193693610 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbaf001c8d0 con 0x7fbb08157fe0 2023-10-09T11:35:48.495 INFO:teuthology.orchestra.run.smithi118.stdout:7 2023-10-09T11:35:48.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 msgr2=0x7fbb08156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c7e0 tx=0x7fbaf0007df0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 shutdown_connections 2023-10-09T11:35:48.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb081583b0 0x7fbb0814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb080cf240 0x7fbb0814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 --2- 172.21.15.118:0/193693610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb08157fe0 0x7fbb08156920 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 >> 172.21.15.118:0/193693610 conn(0x7fbb08067640 msgr2=0x7fbb080cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 shutdown_connections 2023-10-09T11:35:48.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-09T11:35:48.494+0000 7fbb0d488700 1 -- 172.21.15.118:0/193693610 wait complete. 2023-10-09T11:35:48.507 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T11:35:48.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T11:35:48.509 INFO:tasks.ceph.osd.0:Started 2023-10-09T11:35:48.510 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T11:35:48.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T11:35:48.511 INFO:tasks.ceph.osd.1:Started 2023-10-09T11:35:48.512 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T11:35:48.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T11:35:48.514 INFO:tasks.ceph.osd.2:Started 2023-10-09T11:35:48.514 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T11:35:48.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T11:35:48.516 INFO:tasks.ceph.osd.3:Started 2023-10-09T11:35:48.517 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T11:35:48.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T11:35:48.518 INFO:tasks.ceph.osd.4:Started 2023-10-09T11:35:48.519 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T11:35:48.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T11:35:48.521 INFO:tasks.ceph.osd.5:Started 2023-10-09T11:35:48.521 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T11:35:48.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T11:35:48.522 INFO:tasks.ceph.osd.6:Started 2023-10-09T11:35:48.523 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T11:35:48.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T11:35:48.524 INFO:tasks.ceph.osd.7:Started 2023-10-09T11:35:48.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:48.593 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-10-09T11:35:48.592+0000 7f510f2e9540 -1 Falling back to public interface 2023-10-09T11:35:48.594 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-10-09T11:35:48.592+0000 7f2fe2127540 -1 Falling back to public interface 2023-10-09T11:35:48.595 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-10-09T11:35:48.593+0000 7f3680460540 -1 Falling back to public interface 2023-10-09T11:35:48.595 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-10-09T11:35:48.594+0000 7f2fdc550700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6815/0: (98) Address already in use 2023-10-09T11:35:48.597 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-10-09T11:35:48.596+0000 7f828b6de540 -1 Falling back to public interface 2023-10-09T11:35:48.601 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-09T11:35:48.601+0000 7f0eb70ec540 -1 Falling back to public interface 2023-10-09T11:35:48.606 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-10-09T11:35:48.604+0000 7f510f2e9540 -1 osd.4 0 log_to_monitors true 2023-10-09T11:35:48.606 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-10-09T11:35:48.605+0000 7f2fe2127540 -1 osd.5 0 log_to_monitors true 2023-10-09T11:35:48.610 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-10-09T11:35:48.609+0000 7f3680460540 -1 osd.6 0 log_to_monitors true 2023-10-09T11:35:48.615 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-10-09T11:35:48.613+0000 7f828b6de540 -1 osd.7 0 log_to_monitors true 2023-10-09T11:35:48.615 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-09T11:35:48.615+0000 7f0eb70ec540 -1 osd.2 0 log_to_monitors true 2023-10-09T11:35:48.616 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-09T11:35:48.616+0000 7fdfe4652540 -1 Falling back to public interface 2023-10-09T11:35:48.622 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-09T11:35:48.622+0000 7f458453e540 -1 Falling back to public interface 2023-10-09T11:35:48.624 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-09T11:35:48.624+0000 7f0d42c96540 -1 Falling back to public interface 2023-10-09T11:35:48.634 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-09T11:35:48.634+0000 7fdfe4652540 -1 osd.1 0 log_to_monitors true 2023-10-09T11:35:48.642 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-09T11:35:48.642+0000 7f458453e540 -1 osd.3 0 log_to_monitors true 2023-10-09T11:35:48.644 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-09T11:35:48.644+0000 7f0d42c96540 -1 osd.0 0 log_to_monitors true 2023-10-09T11:35:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.691+0000 7f639404b700 1 Processor -- start 2023-10-09T11:35:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.691+0000 7f639404b700 1 -- start start 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f639404b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f638c156d60 0x7f638c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f639404b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f638c06ceb0 0x7f638c157130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f6391de7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f638c156d60 0x7f638c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f639404b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c06ac50 con 0x7f638c157670 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f639404b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c06a400 con 0x7f638c156d60 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f639404b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0c8fd0 con 0x7f638c06ceb0 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f6391de7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f638c156d60 0x7f638c06b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36602/0 (socket says 172.21.15.6:36602) 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.692+0000 7f6391de7700 1 -- 172.21.15.6:0/315745825 learned_addr learned my addr 172.21.15.6:0/315745825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f63915e6700 1 --2- 172.21.15.6:0/315745825 >> v2:172.21.15.118:3300/0 conn(0x7f638c06ceb0 0x7f638c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6391de7700 1 -- 172.21.15.6:0/315745825 >> v2:172.21.15.118:3300/0 conn(0x7f638c06ceb0 msgr2=0x7f638c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6391de7700 1 --2- 172.21.15.6:0/315745825 >> v2:172.21.15.118:3300/0 conn(0x7f638c06ceb0 0x7f638c157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6391de7700 1 -- 172.21.15.6:0/315745825 >> v1:172.21.15.6:6789/0 conn(0x7f638c157670 legacy=0x7f638c0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6391de7700 1 -- 172.21.15.6:0/315745825 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0c8cf0 con 0x7f638c156d60 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6391de7700 1 --2- 172.21.15.6:0/315745825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c156d60 0x7f638c06b0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f638c0c9c00 tx=0x7f6388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900c29075c8511f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6390de5700 1 -- 172.21.15.6:0/315745825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388009e70 con 0x7f638c156d60 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6390de5700 1 -- 172.21.15.6:0/315745825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800b860 con 0x7f638c156d60 2023-10-09T11:35:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.693+0000 7f6390de5700 1 -- 172.21.15.6:0/315745825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800bc00 con 0x7f638c156d60 2023-10-09T11:35:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 -- 172.21.15.6:0/315745825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c156d60 msgr2=0x7f638c06b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 --2- 172.21.15.6:0/315745825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c156d60 0x7f638c06b0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f638c0c9c00 tx=0x7f6388009250 comp rx=0 tx=0).stop 2023-10-09T11:35:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 -- 172.21.15.6:0/315745825 shutdown_connections 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 --2- 172.21.15.6:0/315745825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c156d60 0x7f638c06b0e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 --2- 172.21.15.6:0/315745825 >> v2:172.21.15.118:3300/0 conn(0x7f638c06ceb0 0x7f638c157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 -- 172.21.15.6:0/315745825 >> 172.21.15.6:0/315745825 conn(0x7f638c0c9ca0 msgr2=0x7f638c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 -- 172.21.15.6:0/315745825 shutdown_connections 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.694+0000 7f639404b700 1 -- 172.21.15.6:0/315745825 wait complete. 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.695+0000 7f639404b700 1 Processor -- start 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.695+0000 7f639404b700 1 -- start start 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f638c06ceb0 0x7f638c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f638c156d60 0x7f638c16a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c15a5d0 con 0x7f638c157670 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c158af0 con 0x7f638c06ceb0 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f639404b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0c53e0 con 0x7f638c156d60 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36608/0 (socket says 172.21.15.6:36608) 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 -- 172.21.15.6:0/17163537 learned_addr learned my addr 172.21.15.6:0/17163537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f6391de7700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f638c06ceb0 0x7f638c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63915e6700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f638c156d60 0x7f638c16a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 -- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f638c156d60 msgr2=0x7f638c16a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f638c156d60 0x7f638c16a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 -- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f638c06ceb0 msgr2=0x7f638c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f638c06ceb0 0x7f638c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 -- 172.21.15.6:0/17163537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094f0 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f63925e8700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f638400c840 tx=0x7f6384001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.696+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384012630 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384012790 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0c56c0 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384012b50 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6384003030 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0c5c80 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.697+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f638401a3a0 con 0x7f638c157670 2023-10-09T11:35:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.698+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c0c5ea0 con 0x7f638c157670 2023-10-09T11:35:48.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.700+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f638401b680 con 0x7f638c157670 2023-10-09T11:35:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.769+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f638c0cb170 con 0x7f638c157670 2023-10-09T11:35:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.770+0000 7f6381ffb700 1 -- 172.21.15.6:0/17163537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f638401b820 con 0x7f638c157670 2023-10-09T11:35:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:48.771 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:35:48.488373+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 msgr2=0x7f638c159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f638400c840 tx=0x7f6384001670 comp rx=0 tx=0).stop 2023-10-09T11:35:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 shutdown_connections 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f638c157670 0x7f638c159a10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f638c06ceb0 0x7f638c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 --2- 172.21.15.6:0/17163537 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f638c156d60 0x7f638c16a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.771+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 >> 172.21.15.6:0/17163537 conn(0x7f638c0c9ca0 msgr2=0x7f638c0cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.772+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 shutdown_connections 2023-10-09T11:35:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:48.772+0000 7f639404b700 1 -- 172.21.15.6:0/17163537 wait complete. 2023-10-09T11:35:48.784 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T11:35:48.784 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T11:35:48.813 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.813+0000 7ff6d26b3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:35:48.895 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.894+0000 7ff6d26b3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:35:48.976 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:48.976+0000 7ff6d26b3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:35:49.590 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:49.603 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:49.603+0000 7ff6d26b3180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:35:49.699 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.698+0000 7f920530b700 1 Processor -- start 2023-10-09T11:35:49.699 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.698+0000 7f920530b700 1 -- start start 2023-10-09T11:35:49.701 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f920530b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920015a2f0 0x7f92000cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.701 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f920530b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920006cca0 0x7f920006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f920530b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920006d640 con 0x7f92000cc760 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f920530b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920015a6c0 con 0x7f920015a2f0 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f920530b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92000b1550 con 0x7f920006cca0 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f91feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920015a2f0 0x7f92000cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f91feffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f920015a2f0 0x7f92000cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36622/0 (socket says 172.21.15.6:36622) 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.699+0000 7f91feffd700 1 -- 172.21.15.6:0/3354281596 learned_addr learned my addr 172.21.15.6:0/3354281596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91ff7fe700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920006cca0 0x7f920006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91feffd700 1 -- 172.21.15.6:0/3354281596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920006cca0 msgr2=0x7f920006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91feffd700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920006cca0 0x7f920006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.702 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91feffd700 1 -- 172.21.15.6:0/3354281596 >> v1:172.21.15.118:6789/0 conn(0x7f92000cc760 legacy=0x7f92000c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91feffd700 1 -- 172.21.15.6:0/3354281596 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92000ce6b0 con 0x7f920015a2f0 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91feffd700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920015a2f0 0x7f92000cbf40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3451c040f8fa08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91fdffb700 1 -- 172.21.15.6:0/3354281596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400b860 con 0x7f920015a2f0 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91fdffb700 1 -- 172.21.15.6:0/3354281596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400b9c0 con 0x7f920015a2f0 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.700+0000 7f91fdffb700 1 -- 172.21.15.6:0/3354281596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400bd60 con 0x7f920015a2f0 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 -- 172.21.15.6:0/3354281596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920015a2f0 msgr2=0x7f92000cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920015a2f0 0x7f92000cbf40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4009250 comp rx=0 tx=0).stop 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 -- 172.21.15.6:0/3354281596 shutdown_connections 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920006cca0 0x7f920006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 --2- 172.21.15.6:0/3354281596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920015a2f0 0x7f92000cbf40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.703 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 -- 172.21.15.6:0/3354281596 >> 172.21.15.6:0/3354281596 conn(0x7f9200067640 msgr2=0x7f9200067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.704 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 -- 172.21.15.6:0/3354281596 shutdown_connections 2023-10-09T11:35:49.704 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.701+0000 7f920530b700 1 -- 172.21.15.6:0/3354281596 wait complete. 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.702+0000 7f920530b700 1 Processor -- start 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.702+0000 7f920530b700 1 -- start start 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 0x7f920015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 0x7f920015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920015aed0 con 0x7f920006cca0 2023-10-09T11:35:49.706 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920015ccb0 con 0x7f92000cc760 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920015c400 con 0x7f920015a2f0 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36634/0 (socket says 172.21.15.6:36634) 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 -- 172.21.15.6:0/2732314179 learned_addr learned my addr 172.21.15.6:0/2732314179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91ff7fe700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 0x7f920015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91fe7fc700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 0x7f920015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 -- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 msgr2=0x7f920015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 0x7f920015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 -- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 msgr2=0x7f920015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 0x7f920015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 -- 172.21.15.6:0/2732314179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40094f0 con 0x7f920006cca0 2023-10-09T11:35:49.707 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91ff7fe700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 0x7f920015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91fe7fc700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 0x7f920015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91feffd700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92000648f0 tx=0x7f91f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4024440 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f40245a0 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920015c680 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4024940 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.703+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920015c940 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.704+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f91f401a6a0 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.704+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7f91f4023bb0 con 0x7f920006cca0 2023-10-09T11:35:49.708 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.705+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9200069bd0 con 0x7f920006cca0 2023-10-09T11:35:49.709 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.707+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f91f4015020 con 0x7f920006cca0 2023-10-09T11:35:49.752 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:49.751+0000 7ff6d26b3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:49.777 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.777+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f920004bb80 con 0x7f920006cca0 2023-10-09T11:35:49.778 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.778+0000 7f91e6ffd700 1 -- 172.21.15.6:0/2732314179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f91f4023dc0 con 0x7f920006cca0 2023-10-09T11:35:49.778 INFO:teuthology.misc.health.smithi006.stdout: 2023-10-09T11:35:49.778 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":11,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:35:49.491571+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:49.779 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 msgr2=0x7f920014ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:49.779 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92000648f0 tx=0x7f91f4017000 comp rx=0 tx=0).stop 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 shutdown_connections 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f920015a2f0 0x7f920015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f920006cca0 0x7f920014ee10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 --2- 172.21.15.6:0/2732314179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92000cc760 0x7f920015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 >> 172.21.15.6:0/2732314179 conn(0x7f9200067640 msgr2=0x7f92000ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 shutdown_connections 2023-10-09T11:35:49.780 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:49.779+0000 7f920530b700 1 -- 172.21.15.6:0/2732314179 wait complete. 2023-10-09T11:35:49.790 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T11:35:49.850 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:49.850+0000 7ff6d26b3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:35:50.107 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:50.107+0000 7ff6d26b3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:35:50.155 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:50.153+0000 7f91b3491180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T11:35:50.188 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:50.188+0000 7ff6d26b3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:35:50.232 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:50.229+0000 7f91b3491180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T11:35:50.308 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:50.306+0000 7f91b3491180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T11:35:50.512 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-09T11:35:50.512+0000 7f0eae50f700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T11:35:50.513 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-10-09T11:35:50.510+0000 7f3677883700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T11:35:50.513 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-10-09T11:35:50.510+0000 7f8282b01700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T11:35:50.514 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-10-09T11:35:50.512+0000 7f367167c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.514 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-09T11:35:50.512+0000 7f0d3a0b9700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T11:35:50.515 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-10-09T11:35:50.512+0000 7f827c8fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.515 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-09T11:35:50.512+0000 7f457b961700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T11:35:50.515 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-10-09T11:35:50.513+0000 7f0d33eb2700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.516 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-10-09T11:35:50.513+0000 7f0ea8308700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.517 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-10-09T11:35:50.515+0000 7f457575a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.519 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-10-09T11:35:50.517+0000 7f2fd954a700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T11:35:50.519 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-10-09T11:35:50.518+0000 7f510670c700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T11:35:50.523 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-10-09T11:35:50.519+0000 7f5100505700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.523 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-10-09T11:35:50.519+0000 7f2fd3343700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.531 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-09T11:35:50.531+0000 7fdfdba75700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T11:35:50.535 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-10-09T11:35:50.532+0000 7fdfd586e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T11:35:50.898 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:50.897+0000 7f91b3491180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T11:35:51.036 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:51.034+0000 7f91b3491180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T11:35:51.122 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:51.121+0000 7f91b3491180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T11:35:51.136 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.134+0000 7ff6d26b3180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:35:51.213 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.211+0000 7ff6d26b3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:35:51.290 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.289+0000 7ff6d26b3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:35:51.366 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:51.364+0000 7f91b3491180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T11:35:51.443 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:51.441+0000 7f91b3491180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T11:35:51.487 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.486+0000 7ff6d26b3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:35:51.730 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.728+0000 7ff6d26b3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:35:51.889 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.887+0000 7ff6d26b3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:35:51.968 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:51.967+0000 7ff6d26b3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:35:52.046 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:52.045+0000 7ff6d26b3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:35:52.126 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:52.124+0000 7ff6d26b3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:35:52.274 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.272+0000 7f91b3491180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T11:35:52.347 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.345+0000 7f91b3491180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T11:35:52.420 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.419+0000 7f91b3491180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T11:35:52.555 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.553+0000 7f91b3491180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T11:35:52.651 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.649+0000 7f91b3491180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T11:35:52.801 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.800+0000 7f91b3491180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T11:35:52.876 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.875+0000 7f91b3491180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T11:35:52.952 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:52.950+0000 7f91b3491180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T11:35:53.026 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-10-09T11:35:53.024+0000 7f91b3491180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T11:35:53.153 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:53.152+0000 7ff68bab7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T11:35:53.153 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-10-09T11:35:53.152+0000 7ff68bab7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T11:35:56.597 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:56.719 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.717+0000 7f2cd9c22700 1 Processor -- start 2023-10-09T11:35:56.719 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.717+0000 7f2cd9c22700 1 -- start start 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.718+0000 7f2cd9c22700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.718+0000 7f2cd9c22700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cd4157bb0 0x7f2cd40cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.718+0000 7f2cd9c22700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40cfdd0 con 0x7f2cd406d240 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.718+0000 7f2cd9c22700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40d00b0 con 0x7f2cd4157bb0 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.718+0000 7f2cd9c22700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40d0390 con 0x7f2cd41577e0 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cd4157bb0 0x7f2cd40cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd37fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.721 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd37fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:58630/0 (socket says 172.21.15.6:58630) 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd3fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2cd406d240 0x7f2cd415daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:49748/0 (socket says 172.21.15.6:49748) 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cd4157bb0 0x7f2cd40cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:37702/0 (socket says 172.21.15.6:37702) 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd37fe700 1 -- 172.21.15.6:0/214824878 learned_addr learned my addr 172.21.15.6:0/214824878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 msgr2=0x7f2cd415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/214824878 >> v1:172.21.15.118:6789/0 conn(0x7f2cd406d240 legacy=0x7f2cd415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/214824878 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40d0670 con 0x7f2cd4157bb0 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd37fe700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd2ffd700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd4157bb0 0x7f2cd40cf510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80098e0 tx=0x7f2cc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89aa4793eddbc589 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.722 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd27fc700 1 -- 172.21.15.6:0/214824878 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800b640 con 0x7f2cd4157bb0 2023-10-09T11:35:56.723 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd27fc700 1 -- 172.21.15.6:0/214824878 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800b7a0 con 0x7f2cd4157bb0 2023-10-09T11:35:56.723 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.719+0000 7f2cd27fc700 1 -- 172.21.15.6:0/214824878 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800bb40 con 0x7f2cd4157bb0 2023-10-09T11:35:56.725 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 -- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd4157bb0 msgr2=0x7f2cd40cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.725 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd4157bb0 0x7f2cd40cf510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80098e0 tx=0x7f2cc80091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.725 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 -- 172.21.15.6:0/214824878 shutdown_connections 2023-10-09T11:35:56.725 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd41577e0 0x7f2cd415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/214824878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd4157bb0 0x7f2cd40cf510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 -- 172.21.15.6:0/214824878 >> 172.21.15.6:0/214824878 conn(0x7f2cd406bb90 msgr2=0x7f2cd406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 -- 172.21.15.6:0/214824878 shutdown_connections 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.720+0000 7f2cd9c22700 1 -- 172.21.15.6:0/214824878 wait complete. 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.721+0000 7f2cd9c22700 1 Processor -- start 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.721+0000 7f2cd9c22700 1 -- start start 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd406d240 0x7f2cd415f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd4157bb0 0x7f2cd415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.726 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40c64c0 con 0x7f2cd41577e0 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd416b7d0 con 0x7f2cd406d240 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd9c22700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40c5b20 con 0x7f2cd4157bb0 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53784/0 (socket says 172.21.15.6:53784) 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/2864377089 learned_addr learned my addr 172.21.15.6:0/2864377089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd37fe700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd406d240 0x7f2cd415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd3fff700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd4157bb0 0x7f2cd415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd4157bb0 msgr2=0x7f2cd415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd4157bb0 0x7f2cd415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.722+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd406d240 msgr2=0x7f2cd415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.727 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cd2ffd700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd406d240 0x7f2cd415f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cd2ffd700 1 -- 172.21.15.6:0/2864377089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40094f0 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cd2ffd700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4067780 tx=0x7f2cc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc801bc40 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc801bdc0 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc8009420 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8011670 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.723+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd40c60e0 con 0x7f2cd41577e0 2023-10-09T11:35:56.728 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.724+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4067850 con 0x7f2cd41577e0 2023-10-09T11:35:56.729 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.724+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cc8011a20 con 0x7f2cd41577e0 2023-10-09T11:35:56.729 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.725+0000 7f2cbb7fe700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 0x7f2cc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:56.729 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.725+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2cc8085670 con 0x7f2cd41577e0 2023-10-09T11:35:56.729 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.725+0000 7f2cd37fe700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 0x7f2cc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:56.729 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.725+0000 7f2cd37fe700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 0x7f2cc00693e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006d20 tx=0x7f2cc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:56.731 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.730+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cc8052c30 con 0x7f2cd41577e0 2023-10-09T11:35:56.925 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.924+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cd40cfa50 con 0x7f2cd41577e0 2023-10-09T11:35:56.926 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.924+0000 7f2cbb7fe700 1 -- 172.21.15.6:0/2864377089 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f2cc8056250 con 0x7f2cd41577e0 2023-10-09T11:35:56.926 INFO:teuthology.misc.health.smithi006.stdout: 2023-10-09T11:35:56.926 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":16,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:35:54.531374+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:56.928 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 msgr2=0x7f2cc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.928 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 0x7f2cc00693e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006d20 tx=0x7f2cc4008040 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 msgr2=0x7f2cd40c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4067780 tx=0x7f2cc8017000 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 shutdown_connections 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2cc0066f30 0x7f2cc00693e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2cd4157bb0 0x7f2cd415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cd406d240 0x7f2cd415f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 --2- 172.21.15.6:0/2864377089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cd41577e0 0x7f2cd40c68e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 >> 172.21.15.6:0/2864377089 conn(0x7f2cd406bb90 msgr2=0x7f2cd406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 shutdown_connections 2023-10-09T11:35:56.929 INFO:teuthology.misc.health.smithi006.stderr:2023-10-09T11:35:56.927+0000 7f2cd9c22700 1 -- 172.21.15.6:0/2864377089 wait complete. 2023-10-09T11:35:56.939 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T11:35:56.939 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T11:35:56.940 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:35:56.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:35:56.942 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:35:56.942 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:35:56.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:35:56.944 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:35:56.944 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:35:56.944 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:35:56.946 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:35:56.947 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:35:56.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:35:56.949 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:35:56.949 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T11:35:56.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:35:57.017 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:35:57.018 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:35:57.026 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:35:57.026 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:35:57.026 INFO:tasks.ceph.mds.b.smithi118.stderr:2023-10-09T11:35:57.025+0000 7efebe9c4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T11:35:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.072+0000 7f25e3a62700 1 Processor -- start 2023-10-09T11:35:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.073+0000 7f25e3a62700 1 -- start start 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e3a62700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25dc13ffe0 0x7f25dc0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e3a62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e3a62700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0698b0 con 0x7f25dc13fc10 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e3a62700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0692a0 con 0x7f25dc06ccb0 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e3a62700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc06d180 con 0x7f25dc13ffe0 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53810/0 (socket says 172.21.15.6:53810) 2023-10-09T11:35:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 -- 172.21.15.6:0/3856013066 learned_addr learned my addr 172.21.15.6:0/3856013066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e17fe700 1 --1- 172.21.15.6:0/3856013066 >> v1:172.21.15.6:6789/0 conn(0x7f25dc13fc10 0x7f25dc06c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50292/0 (socket says 172.21.15.6:50292) 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e0ffd700 1 --2- 172.21.15.6:0/3856013066 >> v2:172.21.15.118:3300/0 conn(0x7f25dc13ffe0 0x7f25dc0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 -- 172.21.15.6:0/3856013066 >> v2:172.21.15.118:3300/0 conn(0x7f25dc13ffe0 msgr2=0x7f25dc0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 --2- 172.21.15.6:0/3856013066 >> v2:172.21.15.118:3300/0 conn(0x7f25dc13ffe0 0x7f25dc0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 -- 172.21.15.6:0/3856013066 >> v1:172.21.15.6:6789/0 conn(0x7f25dc13fc10 legacy=0x7f25dc06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 -- 172.21.15.6:0/3856013066 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc069540 con 0x7f25dc06ccb0 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25d3fff700 1 -- 172.21.15.6:0/3856013066 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146832593 0 0) 0x7f25dc0698b0 con 0x7f25dc13fc10 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25e1fff700 1 --2- 172.21.15.6:0/3856013066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0c4290 tx=0x7f25d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb106fe47c061937 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25d3fff700 1 -- 172.21.15.6:0/3856013066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400e070 con 0x7f25dc06ccb0 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25d3fff700 1 -- 172.21.15.6:0/3856013066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d400ba20 con 0x7f25dc06ccb0 2023-10-09T11:35:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.074+0000 7f25d3fff700 1 -- 172.21.15.6:0/3856013066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40092e0 con 0x7f25dc06ccb0 2023-10-09T11:35:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 -- 172.21.15.6:0/3856013066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc06ccb0 msgr2=0x7f25dc0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 --2- 172.21.15.6:0/3856013066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0c4290 tx=0x7f25d4009840 comp rx=0 tx=0).stop 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 -- 172.21.15.6:0/3856013066 shutdown_connections 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 --2- 172.21.15.6:0/3856013066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c7fc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 --2- 172.21.15.6:0/3856013066 >> v2:172.21.15.118:3300/0 conn(0x7f25dc13ffe0 0x7f25dc0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 -- 172.21.15.6:0/3856013066 >> 172.21.15.6:0/3856013066 conn(0x7f25dc0c9ca0 msgr2=0x7f25dc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 -- 172.21.15.6:0/3856013066 shutdown_connections 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.075+0000 7f25e3a62700 1 -- 172.21.15.6:0/3856013066 wait complete. 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.076+0000 7f25e3a62700 1 Processor -- start 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.076+0000 7f25e3a62700 1 -- start start 2023-10-09T11:35:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25dc13ffe0 0x7f25dc0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0af2e0 con 0x7f25dc13fc10 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0ae6d0 con 0x7f25dc06ccb0 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e3a62700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0ae9b0 con 0x7f25dc13ffe0 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53816/0 (socket says 172.21.15.6:53816) 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 -- 172.21.15.6:0/216394703 learned_addr learned my addr 172.21.15.6:0/216394703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e1fff700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25dc13ffe0 0x7f25dc0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e17fe700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 -- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25dc13ffe0 msgr2=0x7f25dc0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25dc13ffe0 0x7f25dc0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 -- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25dc06ccb0 msgr2=0x7f25dc0c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.077+0000 7f25e0ffd700 1 -- 172.21.15.6:0/216394703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009ae0 con 0x7f25dc13fc10 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25e0ffd700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00e900 tx=0x7f25cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc013680 con 0x7f25dc13fc10 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc0137e0 con 0x7f25dc13fc10 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc0aec90 con 0x7f25dc13fc10 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc013ba0 con 0x7f25dc13fc10 2023-10-09T11:35:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.078+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc0c3be0 con 0x7f25dc13fc10 2023-10-09T11:35:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.079+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc0af490 con 0x7f25dc13fc10 2023-10-09T11:35:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.079+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25cc0123d0 con 0x7f25dc13fc10 2023-10-09T11:35:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.079+0000 7f25d17fa700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 0x7f25c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.079+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f25cc083fb0 con 0x7f25dc13fc10 2023-10-09T11:35:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.079+0000 7f25e17fe700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 0x7f25c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.080+0000 7f25e17fe700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 0x7f25c00693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007fd0 tx=0x7f25d8007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.084+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25dc0af490 con 0x7f25dc13fc10 2023-10-09T11:35:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.277+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25dc0af490 con 0x7f25dc13fc10 2023-10-09T11:35:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.277+0000 7f25d17fa700 1 -- 172.21.15.6:0/216394703 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f25dc0af490 con 0x7f25dc13fc10 2023-10-09T11:35:57.279 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:57.279 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:35:54.531374+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:35:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 msgr2=0x7f25c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 0x7f25c00693e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007fd0 tx=0x7f25d8007d50 comp rx=0 tx=0).stop 2023-10-09T11:35:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 msgr2=0x7f25dc1674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00e900 tx=0x7f25cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 shutdown_connections 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0066f30 0x7f25c00693e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25dc13ffe0 0x7f25dc0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25dc06ccb0 0x7f25dc0c36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 --2- 172.21.15.6:0/216394703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25dc13fc10 0x7f25dc1674a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.279+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 >> 172.21.15.6:0/216394703 conn(0x7f25dc0c9ca0 msgr2=0x7f25dc06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.280+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 shutdown_connections 2023-10-09T11:35:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.280+0000 7f25e3a62700 1 -- 172.21.15.6:0/216394703 wait complete. 2023-10-09T11:35:57.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:35:57.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:35:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.413+0000 7f4327218700 1 Processor -- start 2023-10-09T11:35:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.413+0000 7f4327218700 1 -- start start 2023-10-09T11:35:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f4327218700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4320156db0 0x7f432006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f4327218700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f432006e770 0x7f43200cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f4327218700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432006ebd0 con 0x7f43201569e0 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f4327218700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43200b2290 con 0x7f432006e770 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f4327218700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4320157c00 con 0x7f4320156db0 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f43257b5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f432006e770 0x7f43200cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f43257b5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f432006e770 0x7f43200cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53824/0 (socket says 172.21.15.6:53824) 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.414+0000 7f43257b5700 1 -- 172.21.15.6:0/576216055 learned_addr learned my addr 172.21.15.6:0/576216055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f431ffff700 1 --2- 172.21.15.6:0/576216055 >> v2:172.21.15.118:3300/0 conn(0x7f4320156db0 0x7f432006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f43257b5700 1 -- 172.21.15.6:0/576216055 >> v2:172.21.15.118:3300/0 conn(0x7f4320156db0 msgr2=0x7f432006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f43257b5700 1 --2- 172.21.15.6:0/576216055 >> v2:172.21.15.118:3300/0 conn(0x7f4320156db0 0x7f432006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f43257b5700 1 -- 172.21.15.6:0/576216055 >> v1:172.21.15.118:6789/0 conn(0x7f43201569e0 legacy=0x7f43200b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f43257b5700 1 -- 172.21.15.6:0/576216055 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43201572d0 con 0x7f432006e770 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f43257b5700 1 --2- 172.21.15.6:0/576216055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432006e770 0x7f43200cd920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4320069450 tx=0x7f4318009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e50d81d8223038 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f431f7fe700 1 -- 172.21.15.6:0/576216055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800e070 con 0x7f432006e770 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f431f7fe700 1 -- 172.21.15.6:0/576216055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800ba20 con 0x7f432006e770 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.415+0000 7f431f7fe700 1 -- 172.21.15.6:0/576216055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180092e0 con 0x7f432006e770 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 -- 172.21.15.6:0/576216055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432006e770 msgr2=0x7f43200cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 --2- 172.21.15.6:0/576216055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432006e770 0x7f43200cd920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4320069450 tx=0x7f4318009840 comp rx=0 tx=0).stop 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 -- 172.21.15.6:0/576216055 shutdown_connections 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 --2- 172.21.15.6:0/576216055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432006e770 0x7f43200cd920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 --2- 172.21.15.6:0/576216055 >> v2:172.21.15.118:3300/0 conn(0x7f4320156db0 0x7f432006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 -- 172.21.15.6:0/576216055 >> 172.21.15.6:0/576216055 conn(0x7f432006cca0 msgr2=0x7f432006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 -- 172.21.15.6:0/576216055 shutdown_connections 2023-10-09T11:35:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.416+0000 7f4327218700 1 -- 172.21.15.6:0/576216055 wait complete. 2023-10-09T11:35:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.417+0000 7f4327218700 1 Processor -- start 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.417+0000 7f4327218700 1 -- start start 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f432006e770 0x7f43200caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 0x7f43200cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432015a390 con 0x7f43201569e0 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43201592f0 con 0x7f4320156db0 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4327218700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43201595d0 con 0x7f432006e770 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53838/0 (socket says 172.21.15.6:53838) 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 -- 172.21.15.6:0/673776169 learned_addr learned my addr 172.21.15.6:0/673776169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f43257b5700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 0x7f43200cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f4324fb4700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f432006e770 0x7f43200caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 -- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f432006e770 msgr2=0x7f43200caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f432006e770 0x7f43200caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 -- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 msgr2=0x7f43200cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 0x7f43200cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 -- 172.21.15.6:0/673776169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318009ae0 con 0x7f43201569e0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f43257b5700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 0x7f43200cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431ffff700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f431400e900 tx=0x7f43140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.418+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314013680 con 0x7f43201569e0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.419+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43140137e0 con 0x7f43201569e0 2023-10-09T11:35:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.419+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43201598b0 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.419+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314013ba0 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.419+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4320159e70 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.420+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320068900 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.420+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43140123d0 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.421+0000 7f431cff9700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.421+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f43140842a0 con 0x7f43201569e0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.421+0000 7f4324fb4700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.421+0000 7f4324fb4700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4310003a60 tx=0x7f4310007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.425+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4314051860 con 0x7f43201569e0 2023-10-09T11:35:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.619+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43201575b0 con 0x7f43201569e0 2023-10-09T11:35:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.620+0000 7f431cff9700 1 -- 172.21.15.6:0/673776169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4314054e80 con 0x7f43201569e0 2023-10-09T11:35:57.621 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:35:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 msgr2=0x7f430c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4310003a60 tx=0x7f4310007ec0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 msgr2=0x7f432016a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f431400e900 tx=0x7f43140091a0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 shutdown_connections 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320156db0 0x7f43200cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f432006e770 0x7f43200caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 --2- 172.21.15.6:0/673776169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43201569e0 0x7f432016a360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 >> 172.21.15.6:0/673776169 conn(0x7f432006cca0 msgr2=0x7f4320153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 shutdown_connections 2023-10-09T11:35:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.622+0000 7f4327218700 1 -- 172.21.15.6:0/673776169 wait complete. 2023-10-09T11:35:57.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:35:57.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.752+0000 7fef397f0700 1 Processor -- start 2023-10-09T11:35:57.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.752+0000 7fef397f0700 1 -- start start 2023-10-09T11:35:57.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef397f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fef341578d0 0x7fef340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef397f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef3406d120 0x7fef3406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef397f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340d07c0 con 0x7fef34157ca0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef397f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3406da50 con 0x7fef3406d120 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef397f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef340cfbb0 con 0x7fef341578d0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef337fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef3406d120 0x7fef3406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef327fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef34157ca0 0x7fef3415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50296/0 (socket says 172.21.15.6:50296) 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.753+0000 7fef327fc700 1 -- 172.21.15.6:0/1637885854 learned_addr learned my addr 172.21.15.6:0/1637885854 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef32ffd700 1 --2- 172.21.15.6:0/1637885854 >> v2:172.21.15.118:3300/0 conn(0x7fef341578d0 0x7fef340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef31ffb700 1 -- 172.21.15.6:0/1637885854 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217329632 0 0) 0x7fef340d07c0 con 0x7fef34157ca0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef31ffb700 1 -- 172.21.15.6:0/1637885854 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef20003570 con 0x7fef34157ca0 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef337fe700 1 -- 172.21.15.6:0/1637885854 >> v2:172.21.15.118:3300/0 conn(0x7fef341578d0 msgr2=0x7fef340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:35:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef337fe700 1 --2- 172.21.15.6:0/1637885854 >> v2:172.21.15.118:3300/0 conn(0x7fef341578d0 0x7fef340cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef337fe700 1 -- 172.21.15.6:0/1637885854 >> v1:172.21.15.6:6789/0 conn(0x7fef34157ca0 legacy=0x7fef3415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef337fe700 1 -- 172.21.15.6:0/1637885854 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340cfe90 con 0x7fef3406d120 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef337fe700 1 --2- 172.21.15.6:0/1637885854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3406d120 0x7fef3406d510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef340646b0 tx=0x7fef24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a592d499ff40003 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef31ffb700 1 -- 172.21.15.6:0/1637885854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400e070 con 0x7fef3406d120 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef31ffb700 1 -- 172.21.15.6:0/1637885854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400bb60 con 0x7fef3406d120 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.754+0000 7fef31ffb700 1 -- 172.21.15.6:0/1637885854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24012430 con 0x7fef3406d120 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 -- 172.21.15.6:0/1637885854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3406d120 msgr2=0x7fef3406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 --2- 172.21.15.6:0/1637885854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3406d120 0x7fef3406d510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef340646b0 tx=0x7fef24009780 comp rx=0 tx=0).stop 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 -- 172.21.15.6:0/1637885854 shutdown_connections 2023-10-09T11:35:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 --2- 172.21.15.6:0/1637885854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3406d120 0x7fef3406d510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 --2- 172.21.15.6:0/1637885854 >> v2:172.21.15.118:3300/0 conn(0x7fef341578d0 0x7fef340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 -- 172.21.15.6:0/1637885854 >> 172.21.15.6:0/1637885854 conn(0x7fef3406bb90 msgr2=0x7fef3406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 -- 172.21.15.6:0/1637885854 shutdown_connections 2023-10-09T11:35:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.755+0000 7fef397f0700 1 -- 172.21.15.6:0/1637885854 wait complete. 2023-10-09T11:35:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.756+0000 7fef397f0700 1 Processor -- start 2023-10-09T11:35:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.756+0000 7fef397f0700 1 -- start start 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef3406d120 0x7fef34142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef341578d0 0x7fef340c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c77e0 con 0x7fef34157ca0 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef34155bd0 con 0x7fef3406d120 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c6bd0 con 0x7fef341578d0 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53858/0 (socket says 172.21.15.6:53858) 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 -- 172.21.15.6:0/372180851 learned_addr learned my addr 172.21.15.6:0/372180851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef327fc700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef341578d0 0x7fef340c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 -- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef341578d0 msgr2=0x7fef340c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef32ffd700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef3406d120 0x7fef34142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef341578d0 0x7fef340c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 -- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef3406d120 msgr2=0x7fef34142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef3406d120 0x7fef34142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 -- 172.21.15.6:0/372180851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009a20 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef337fe700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef3406fe20 tx=0x7fef24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24012e00 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2401e630 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef340c6eb0 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2401e9f0 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.757+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef340c7470 con 0x7fef34157ca0 2023-10-09T11:35:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.758+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340c7990 con 0x7fef34157ca0 2023-10-09T11:35:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.759+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef24024070 con 0x7fef34157ca0 2023-10-09T11:35:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.759+0000 7fef2affd700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:35:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.759+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fef24086a70 con 0x7fef34157ca0 2023-10-09T11:35:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.759+0000 7fef32ffd700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:35:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.760+0000 7fef32ffd700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef2c006fd0 tx=0x7fef2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:35:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:57.763+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef340c7990 con 0x7fef34157ca0 2023-10-09T11:35:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.005+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef340c7990 con 0x7fef34157ca0 2023-10-09T11:35:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.006+0000 7fef2affd700 1 -- 172.21.15.6:0/372180851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fef2402c500 con 0x7fef34157ca0 2023-10-09T11:35:58.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:35:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-09T11:35:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 msgr2=0x7fef140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef2c006fd0 tx=0x7fef2c008040 comp rx=0 tx=0).stop 2023-10-09T11:35:58.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 msgr2=0x7fef341437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef3406fe20 tx=0x7fef24019000 comp rx=0 tx=0).stop 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 shutdown_connections 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34157ca0 0x7fef341437a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef3406d120 0x7fef34142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 --2- 172.21.15.6:0/372180851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef341578d0 0x7fef340c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:35:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 >> 172.21.15.6:0/372180851 conn(0x7fef3406bb90 msgr2=0x7fef341566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:35:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 shutdown_connections 2023-10-09T11:35:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:35:58.008+0000 7fef397f0700 1 -- 172.21.15.6:0/372180851 wait complete. 2023-10-09T11:35:58.012 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-10-09T11:36:00.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.154+0000 7f2e4a161700 1 Processor -- start 2023-10-09T11:36:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.154+0000 7f2e4a161700 1 -- start start 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e4a161700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e4406d830 0x7f2e440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e4a161700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440d07c0 con 0x7f2e441578d0 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e4a161700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440cfbb0 con 0x7f2e44157ca0 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e4a161700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e440cfe90 con 0x7f2e4406d830 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e43fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e4406d830 0x7f2e440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e437fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2e441578d0 0x7f2e4415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50302/0 (socket says 172.21.15.6:50302) 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e437fe700 1 -- 172.21.15.6:0/2425527961 learned_addr learned my addr 172.21.15.6:0/2425527961 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e43fff700 1 -- 172.21.15.6:0/2425527961 >> v1:172.21.15.118:6789/0 conn(0x7f2e44157ca0 legacy=0x7f2e4406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e43fff700 1 -- 172.21.15.6:0/2425527961 >> v1:172.21.15.6:6789/0 conn(0x7f2e441578d0 legacy=0x7f2e4415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e43fff700 1 -- 172.21.15.6:0/2425527961 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440d0170 con 0x7f2e4406d830 2023-10-09T11:36:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e43fff700 1 --2- 172.21.15.6:0/2425527961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e440cf4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009e60 tx=0x7f2e3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f35a69679c18cab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e427fc700 1 -- 172.21.15.6:0/2425527961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00e070 con 0x7f2e4406d830 2023-10-09T11:36:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e427fc700 1 -- 172.21.15.6:0/2425527961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00bc30 con 0x7f2e4406d830 2023-10-09T11:36:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.155+0000 7f2e427fc700 1 -- 172.21.15.6:0/2425527961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c012430 con 0x7f2e4406d830 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 -- 172.21.15.6:0/2425527961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 msgr2=0x7f2e440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2425527961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e440cf4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009e60 tx=0x7f2e3c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 -- 172.21.15.6:0/2425527961 shutdown_connections 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2425527961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e440cf4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 -- 172.21.15.6:0/2425527961 >> 172.21.15.6:0/2425527961 conn(0x7f2e4406bb90 msgr2=0x7f2e4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 -- 172.21.15.6:0/2425527961 shutdown_connections 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.156+0000 7f2e4a161700 1 -- 172.21.15.6:0/2425527961 wait complete. 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.157+0000 7f2e4a161700 1 Processor -- start 2023-10-09T11:36:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.157+0000 7f2e4a161700 1 -- start start 2023-10-09T11:36:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e441578d0 0x7f2e44156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e44157ca0 0x7f2e441566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e44153fa0 con 0x7f2e4406d830 2023-10-09T11:36:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4416b480 con 0x7f2e44157ca0 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e4a161700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440b5500 con 0x7f2e441578d0 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53870/0 (socket says 172.21.15.6:53870) 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 -- 172.21.15.6:0/2427487940 learned_addr learned my addr 172.21.15.6:0/2427487940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e43fff700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e44157ca0 0x7f2e441566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e42ffd700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e441578d0 0x7f2e44156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 -- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e441578d0 msgr2=0x7f2e44156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e441578d0 0x7f2e44156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 -- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e44157ca0 msgr2=0x7f2e441566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e44157ca0 0x7f2e441566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.158+0000 7f2e437fe700 1 -- 172.21.15.6:0/2427487940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c009a20 con 0x7f2e4406d830 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e437fe700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c7c0 tx=0x7f2e34007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34005b30 con 0x7f2e4406d830 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34005c90 con 0x7f2e4406d830 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4416b270 con 0x7f2e4406d830 2023-10-09T11:36:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34004a80 con 0x7f2e4406d830 2023-10-09T11:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.159+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4416af90 con 0x7f2e4406d830 2023-10-09T11:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.160+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e44067ac0 con 0x7f2e4406d830 2023-10-09T11:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.160+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e340070d0 con 0x7f2e4406d830 2023-10-09T11:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.161+0000 7f2e2b7fe700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.161+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2e340834d0 con 0x7f2e4406d830 2023-10-09T11:36:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.161+0000 7f2e42ffd700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.161+0000 7f2e42ffd700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 0x7f2e300693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2e440d0a50 tx=0x7f2e38007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.165+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e3404b5a0 con 0x7f2e4406d830 2023-10-09T11:36:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.401+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e440d0450 con 0x7f2e4406d830 2023-10-09T11:36:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.401+0000 7f2e2b7fe700 1 -- 172.21.15.6:0/2427487940 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f2e34050a90 con 0x7f2e4406d830 2023-10-09T11:36:00.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:00.403 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 msgr2=0x7f2e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 0x7f2e300693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2e440d0a50 tx=0x7f2e38007ec0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 msgr2=0x7f2e44153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c7c0 tx=0x7f2e34007f70 comp rx=0 tx=0).stop 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 shutdown_connections 2023-10-09T11:36:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e30066f30 0x7f2e300693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e44157ca0 0x7f2e441566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4406d830 0x7f2e44153410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 --2- 172.21.15.6:0/2427487940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e441578d0 0x7f2e44156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 >> 172.21.15.6:0/2427487940 conn(0x7f2e4406bb90 msgr2=0x7f2e44069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 shutdown_connections 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.403+0000 7f2e4a161700 1 -- 172.21.15.6:0/2427487940 wait complete. 2023-10-09T11:36:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-10-09T11:36:00.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.534+0000 7f8b185b5700 1 Processor -- start 2023-10-09T11:36:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.534+0000 7f8b185b5700 1 -- start start 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b185b5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b101578d0 0x7f8b100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b185b5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b10157ca0 0x7f8b1015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b185b5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100d07c0 con 0x7f8b1006d120 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b185b5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100cfbb0 con 0x7f8b10157ca0 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b185b5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100cfe90 con 0x7f8b101578d0 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b10157ca0 0x7f8b1015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b16b52700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b1006d120 0x7f8b1006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50314/0 (socket says 172.21.15.6:50314) 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b16b52700 1 -- 172.21.15.6:0/3132184299 learned_addr learned my addr 172.21.15.6:0/3132184299 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b16351700 1 --2- 172.21.15.6:0/3132184299 >> v2:172.21.15.118:3300/0 conn(0x7f8b101578d0 0x7f8b100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 -- 172.21.15.6:0/3132184299 >> v2:172.21.15.118:3300/0 conn(0x7f8b101578d0 msgr2=0x7f8b100cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 --2- 172.21.15.6:0/3132184299 >> v2:172.21.15.118:3300/0 conn(0x7f8b101578d0 0x7f8b100cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 -- 172.21.15.6:0/3132184299 >> v1:172.21.15.6:6789/0 conn(0x7f8b1006d120 legacy=0x7f8b1006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b1534f700 1 -- 172.21.15.6:0/3132184299 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308281404 0 0) 0x7f8b100d07c0 con 0x7f8b1006d120 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 -- 172.21.15.6:0/3132184299 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100d0170 con 0x7f8b10157ca0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.535+0000 7f8b15b50700 1 --2- 172.21.15.6:0/3132184299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b1015af00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b100646b0 tx=0x7f8b000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dfaec30119a4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b1534f700 1 -- 172.21.15.6:0/3132184299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000b6b0 con 0x7f8b10157ca0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b1534f700 1 -- 172.21.15.6:0/3132184299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000b810 con 0x7f8b10157ca0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b1534f700 1 -- 172.21.15.6:0/3132184299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000bbb0 con 0x7f8b10157ca0 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 -- 172.21.15.6:0/3132184299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 msgr2=0x7f8b1015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 --2- 172.21.15.6:0/3132184299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b1015af00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b100646b0 tx=0x7f8b000091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 -- 172.21.15.6:0/3132184299 shutdown_connections 2023-10-09T11:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 --2- 172.21.15.6:0/3132184299 >> v2:172.21.15.118:3300/0 conn(0x7f8b101578d0 0x7f8b100cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 --2- 172.21.15.6:0/3132184299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b1015af00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 -- 172.21.15.6:0/3132184299 >> 172.21.15.6:0/3132184299 conn(0x7f8b1006bb90 msgr2=0x7f8b1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 -- 172.21.15.6:0/3132184299 shutdown_connections 2023-10-09T11:36:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.536+0000 7f8b185b5700 1 -- 172.21.15.6:0/3132184299 wait complete. 2023-10-09T11:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.537+0000 7f8b185b5700 1 Processor -- start 2023-10-09T11:36:00.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.537+0000 7f8b185b5700 1 -- start start 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b1006d120 0x7f8b100c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 0x7f8b100c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c7560 con 0x7f8b10157ca0 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c6060 con 0x7f8b101578d0 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b185b5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b101438f0 con 0x7f8b1006d120 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b16b52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b16b52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53894/0 (socket says 172.21.15.6:53894) 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b16b52700 1 -- 172.21.15.6:0/1903717112 learned_addr learned my addr 172.21.15.6:0/1903717112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b15b50700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 0x7f8b100c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.538+0000 7f8b16351700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b1006d120 0x7f8b100c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 -- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b1006d120 msgr2=0x7f8b100c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b1006d120 0x7f8b100c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 -- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 msgr2=0x7f8b100c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 0x7f8b100c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 -- 172.21.15.6:0/1903717112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009420 con 0x7f8b10157ca0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b15b50700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 0x7f8b100c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b16b52700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800ccc0 tx=0x7f8b08001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800ab30 con 0x7f8b10157ca0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800ac90 con 0x7f8b10157ca0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100c6950 con 0x7f8b10157ca0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08007340 con 0x7f8b10157ca0 2023-10-09T11:36:00.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.539+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100c6f10 con 0x7f8b10157ca0 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.540+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100c7710 con 0x7f8b10157ca0 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.540+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b080076f0 con 0x7f8b10157ca0 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.541+0000 7f8b067fc700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 0x7f8af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.541+0000 7f8b16351700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 0x7f8af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.541+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8b080846d0 con 0x7f8b10157ca0 2023-10-09T11:36:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.541+0000 7f8b16351700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 0x7f8af40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006fd0 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.545+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b100c7710 con 0x7f8b10157ca0 2023-10-09T11:36:00.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.739+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b100c7710 con 0x7f8b10157ca0 2023-10-09T11:36:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.740+0000 7f8b067fc700 1 -- 172.21.15.6:0/1903717112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f8b100c7710 con 0x7f8b10157ca0 2023-10-09T11:36:00.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:00.741 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:35:54.531374+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.741+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 msgr2=0x7f8af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.741+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 0x7f8af40693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006fd0 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 msgr2=0x7f8b101433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800ccc0 tx=0x7f8b08001a80 comp rx=0 tx=0).stop 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 shutdown_connections 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8af4066f30 0x7f8af40693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b10157ca0 0x7f8b101433b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b1006d120 0x7f8b100c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 --2- 172.21.15.6:0/1903717112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b101578d0 0x7f8b100c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 >> 172.21.15.6:0/1903717112 conn(0x7f8b1006bb90 msgr2=0x7f8b1006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 shutdown_connections 2023-10-09T11:36:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.742+0000 7f8b185b5700 1 -- 172.21.15.6:0/1903717112 wait complete. 2023-10-09T11:36:00.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:36:00.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.877+0000 7f17f4f8c700 1 Processor -- start 2023-10-09T11:36:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.877+0000 7f17f4f8c700 1 -- start start 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17f4f8c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 0x7f17f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17f4f8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17f0157ca0 0x7f17f015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17f4f8c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00d07c0 con 0x7f17f006d120 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17f4f8c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00cfbb0 con 0x7f17f0157ca0 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17f4f8c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00cfe90 con 0x7f17f01578d0 2023-10-09T11:36:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17f0157ca0 0x7f17f015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17f0157ca0 0x7f17f015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53904/0 (socket says 172.21.15.6:53904) 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 -- 172.21.15.6:0/1063227967 learned_addr learned my addr 172.21.15.6:0/1063227967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17ee59c700 1 --2- 172.21.15.6:0/1063227967 >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 0x7f17f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 -- 172.21.15.6:0/1063227967 >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 msgr2=0x7f17f00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 --2- 172.21.15.6:0/1063227967 >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 0x7f17f00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 -- 172.21.15.6:0/1063227967 >> v1:172.21.15.118:6789/0 conn(0x7f17f006d120 legacy=0x7f17f006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 -- 172.21.15.6:0/1063227967 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00d0170 con 0x7f17f0157ca0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17ee59c700 1 --2- 172.21.15.6:0/1063227967 >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 0x7f17f00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.878+0000 7f17edd9b700 1 --2- 172.21.15.6:0/1063227967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f0157ca0 0x7f17f015af00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17f00646b0 tx=0x7f17d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35841f8c148e641 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17ed59a700 1 -- 172.21.15.6:0/1063227967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800b860 con 0x7f17f0157ca0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17ed59a700 1 -- 172.21.15.6:0/1063227967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800b9c0 con 0x7f17f0157ca0 2023-10-09T11:36:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17ed59a700 1 -- 172.21.15.6:0/1063227967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800bd60 con 0x7f17f0157ca0 2023-10-09T11:36:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1063227967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f0157ca0 msgr2=0x7f17f015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1063227967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f0157ca0 0x7f17f015af00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17f00646b0 tx=0x7f17d8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1063227967 shutdown_connections 2023-10-09T11:36:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1063227967 >> v2:172.21.15.118:3300/0 conn(0x7f17f01578d0 0x7f17f00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1063227967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f0157ca0 0x7f17f015af00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1063227967 >> 172.21.15.6:0/1063227967 conn(0x7f17f006bb90 msgr2=0x7f17f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1063227967 shutdown_connections 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.879+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1063227967 wait complete. 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.880+0000 7f17f4f8c700 1 Processor -- start 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.880+0000 7f17f4f8c700 1 -- start start 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17f01578d0 0x7f17f015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0157ca0 0x7f17f015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f016a490 con 0x7f17f006d120 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00b5c20 con 0x7f17f0157ca0 2023-10-09T11:36:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17f4f8c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00b5f00 con 0x7f17f01578d0 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53918/0 (socket says 172.21.15.6:53918) 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 -- 172.21.15.6:0/1704626446 learned_addr learned my addr 172.21.15.6:0/1704626446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17eed9d700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0157ca0 0x7f17f015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17edd9b700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17f01578d0 0x7f17f015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 -- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17f01578d0 msgr2=0x7f17f015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17f01578d0 0x7f17f015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 -- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0157ca0 msgr2=0x7f17f015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0157ca0 0x7f17f015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.881+0000 7f17ee59c700 1 -- 172.21.15.6:0/1704626446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80094f0 con 0x7f17f006d120 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17ee59c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f17e000d1d0 tx=0x7f17e0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000dd10 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e000f040 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f00b61e0 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0015670 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.882+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f0147bb0 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.883+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0067ac0 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.883+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17e0015a60 con 0x7f17f006d120 2023-10-09T11:36:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.884+0000 7f17e67fc700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 0x7f17d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.884+0000 7f17edd9b700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 0x7f17d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.884+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f17e00845a0 con 0x7f17f006d120 2023-10-09T11:36:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.884+0000 7f17edd9b700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 0x7f17d00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f17f00646b0 tx=0x7f17d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:00.888+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17e004e5a0 con 0x7f17f006d120 2023-10-09T11:36:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.080+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17f00d0450 con 0x7f17f006d120 2023-10-09T11:36:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.080+0000 7f17e67fc700 1 -- 172.21.15.6:0/1704626446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17e001a020 con 0x7f17f006d120 2023-10-09T11:36:01.082 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 msgr2=0x7f17d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 0x7f17d00693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f17f00646b0 tx=0x7f17d8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 msgr2=0x7f17f0147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f17e000d1d0 tx=0x7f17e0009a90 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 shutdown_connections 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f17d0066f30 0x7f17d00693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0157ca0 0x7f17f015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17f006d120 0x7f17f0147670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 --2- 172.21.15.6:0/1704626446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17f01578d0 0x7f17f015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 >> 172.21.15.6:0/1704626446 conn(0x7f17f006bb90 msgr2=0x7f17f01556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 shutdown_connections 2023-10-09T11:36:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.082+0000 7f17f4f8c700 1 -- 172.21.15.6:0/1704626446 wait complete. 2023-10-09T11:36:01.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:36:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.212+0000 7f56968e5700 1 Processor -- start 2023-10-09T11:36:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.212+0000 7f56968e5700 1 -- start start 2023-10-09T11:36:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f56968e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 0x7f56900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f56968e5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f569006d120 0x7f569006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f56968e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569006dac0 con 0x7f5690157ca0 2023-10-09T11:36:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f56968e5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900d07c0 con 0x7f569006d120 2023-10-09T11:36:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f56968e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900cfbb0 con 0x7f56901578d0 2023-10-09T11:36:01.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f568f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5690157ca0 0x7f569015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50324/0 (socket says 172.21.15.6:50324) 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f568f7fe700 1 -- 172.21.15.6:0/4051705497 learned_addr learned my addr 172.21.15.6:0/4051705497 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f568ffff700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 0x7f56900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.213+0000 7f5694e82700 1 --2- 172.21.15.6:0/4051705497 >> v2:172.21.15.118:3300/0 conn(0x7f569006d120 0x7f569006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105419748 0 0) 0x7f5678001110 con 0x7f5690157ca0 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f567c003570 con 0x7f5690157ca0 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735725095 0 0) 0x7f567c003570 con 0x7f5690157ca0 2023-10-09T11:36:01.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f5694e82700 1 -- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 msgr2=0x7f56900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f5694e82700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 0x7f56900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f5694e82700 1 -- 172.21.15.6:0/4051705497 >> v1:172.21.15.6:6789/0 conn(0x7f5690157ca0 legacy=0x7f569015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f5694e82700 1 -- 172.21.15.6:0/4051705497 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900cfe90 con 0x7f569006d120 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568ffff700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 0x7f56900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f5694e82700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569006d120 0x7f569006d580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5688009e60 tx=0x7f5688009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278646dca313fd14 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800e070 con 0x7f569006d120 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800b7a0 con 0x7f569006d120 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.214+0000 7f568effd700 1 -- 172.21.15.6:0/4051705497 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678001600 con 0x7f569006d120 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 -- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569006d120 msgr2=0x7f569006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569006d120 0x7f569006d580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5688009e60 tx=0x7f5688009780 comp rx=0 tx=0).stop 2023-10-09T11:36:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 -- 172.21.15.6:0/4051705497 shutdown_connections 2023-10-09T11:36:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f569006d120 0x7f569006d580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 --2- 172.21.15.6:0/4051705497 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56901578d0 0x7f56900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 -- 172.21.15.6:0/4051705497 >> 172.21.15.6:0/4051705497 conn(0x7f569006bb90 msgr2=0x7f569006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 -- 172.21.15.6:0/4051705497 shutdown_connections 2023-10-09T11:36:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.215+0000 7f56968e5700 1 -- 172.21.15.6:0/4051705497 wait complete. 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.216+0000 7f56968e5700 1 Processor -- start 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.216+0000 7f56968e5700 1 -- start start 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569006d120 0x7f56901558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56901578d0 0x7f569015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900cd1e0 con 0x7f5690157ca0 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569015eba0 con 0x7f56901578d0 2023-10-09T11:36:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f56968e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569016acc0 con 0x7f569006d120 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53922/0 (socket says 172.21.15.6:53922) 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 -- 172.21.15.6:0/3028783197 learned_addr learned my addr 172.21.15.6:0/3028783197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f568f7fe700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56901578d0 0x7f569015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f568ffff700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569006d120 0x7f56901558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 -- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569006d120 msgr2=0x7f56901558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569006d120 0x7f56901558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 -- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56901578d0 msgr2=0x7f569015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56901578d0 0x7f569015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 -- 172.21.15.6:0/3028783197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009420 con 0x7f5690157ca0 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.217+0000 7f5694e82700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f569006fe20 tx=0x7f5688018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688012af0 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688012c50 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688009a20 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880276c0 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569016a950 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.218+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569016a4a0 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.219+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5688024070 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.219+0000 7f5687fff700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 0x7f56700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.219+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f56880867d0 con 0x7f5690157ca0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.219+0000 7f568ffff700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 0x7f56700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.220+0000 7f568ffff700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 0x7f56700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5680009f40 tx=0x7f56800091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.224+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5688053d90 con 0x7f5690157ca0 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.418+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f569016ae00 con 0x7f5690157ca0 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.419+0000 7f5687fff700 1 -- 172.21.15.6:0/3028783197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f568802c090 con 0x7f5690157ca0 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:01.421 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:36:01.422 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:36:01.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:01.422 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 msgr2=0x7f56700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 0x7f56700693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5680009f40 tx=0x7f56800091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 msgr2=0x7f569015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f569006fe20 tx=0x7f5688018000 comp rx=0 tx=0).stop 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 shutdown_connections 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5670066f30 0x7f56700693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5690157ca0 0x7f569015df80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f569006d120 0x7f56901558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 --2- 172.21.15.6:0/3028783197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56901578d0 0x7f569015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 >> 172.21.15.6:0/3028783197 conn(0x7f569006bb90 msgr2=0x7f56901580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 shutdown_connections 2023-10-09T11:36:01.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.421+0000 7f56968e5700 1 -- 172.21.15.6:0/3028783197 wait complete. 2023-10-09T11:36:01.435 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:36:01.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:36:01.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.556+0000 7f3c8fe0b700 1 Processor -- start 2023-10-09T11:36:01.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.556+0000 7f3c8fe0b700 1 -- start start 2023-10-09T11:36:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8fe0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 0x7f3c880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8fe0b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880d07c0 con 0x7f3c88157ca0 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8fe0b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880cfbb0 con 0x7f3c8806d120 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8fe0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c880cfe90 con 0x7f3c881578d0 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8d3a6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c88157ca0 0x7f3c8815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50336/0 (socket says 172.21.15.6:50336) 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8d3a6700 1 -- 172.21.15.6:0/854717485 learned_addr learned my addr 172.21.15.6:0/854717485 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.557+0000 7f3c8dba7700 1 --2- 172.21.15.6:0/854717485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 0x7f3c880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244053924 0 0) 0x7f3c880d07c0 con 0x7f3c88157ca0 2023-10-09T11:36:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c70003570 con 0x7f3c88157ca0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925547055 0 0) 0x7f3c880cfbb0 con 0x7f3c8806d120 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c880d07c0 con 0x7f3c8806d120 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8dba7700 1 -- 172.21.15.6:0/854717485 >> v1:172.21.15.118:6789/0 conn(0x7f3c8806d120 legacy=0x7f3c8815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8dba7700 1 -- 172.21.15.6:0/854717485 >> v1:172.21.15.6:6789/0 conn(0x7f3c88157ca0 legacy=0x7f3c8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8dba7700 1 -- 172.21.15.6:0/854717485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c880d0170 con 0x7f3c881578d0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8dba7700 1 --2- 172.21.15.6:0/854717485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 0x7f3c880cf4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009910 tx=0x7f3c780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9fe2a183308425 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011630 con 0x7f3c881578d0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78011790 con 0x7f3c881578d0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.558+0000 7f3c8cba5700 1 -- 172.21.15.6:0/854717485 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011b10 con 0x7f3c881578d0 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/854717485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 msgr2=0x7f3c880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/854717485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 0x7f3c880cf4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009910 tx=0x7f3c780091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/854717485 shutdown_connections 2023-10-09T11:36:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/854717485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c881578d0 0x7f3c880cf4f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/854717485 >> 172.21.15.6:0/854717485 conn(0x7f3c8806bb90 msgr2=0x7f3c8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/854717485 shutdown_connections 2023-10-09T11:36:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.559+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/854717485 wait complete. 2023-10-09T11:36:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.560+0000 7f3c8fe0b700 1 Processor -- start 2023-10-09T11:36:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.560+0000 7f3c8fe0b700 1 -- start start 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c881578d0 0x7f3c8816b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c88157ca0 0x7f3c881497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8816c8f0 con 0x7f3c8806d120 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8816ba40 con 0x7f3c881578d0 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8816bce0 con 0x7f3c88157ca0 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53938/0 (socket says 172.21.15.6:53938) 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 -- 172.21.15.6:0/3500901416 learned_addr learned my addr 172.21.15.6:0/3500901416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8d3a6700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c881578d0 0x7f3c8816b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8e3a8700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c88157ca0 0x7f3c881497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 -- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c88157ca0 msgr2=0x7f3c881497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c88157ca0 0x7f3c881497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 -- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c881578d0 msgr2=0x7f3c8816b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c881578d0 0x7f3c8816b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 -- 172.21.15.6:0/3500901416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009420 con 0x7f3c8806d120 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8dba7700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009860 tx=0x7f3c78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78000c90 con 0x7f3c8806d120 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78011900 con 0x7f3c8806d120 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78025630 con 0x7f3c8806d120 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.561+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8816bfc0 con 0x7f3c8806d120 2023-10-09T11:36:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.562+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8816c580 con 0x7f3c8806d120 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.563+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88067ac0 con 0x7f3c8806d120 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.563+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c78023070 con 0x7f3c8806d120 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.563+0000 7f3c85ffb700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.564+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c780854a0 con 0x7f3c8806d120 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.564+0000 7f3c8d3a6700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.564+0000 7f3c8d3a6700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 0x7f3c740693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b3070 tx=0x7f3c7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:01.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.568+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c78052a60 con 0x7f3c8806d120 2023-10-09T11:36:01.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:01.760+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3c880d0450 con 0x7f3c8806d120 2023-10-09T11:36:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.054+0000 7f3c85ffb700 1 -- 172.21.15.6:0/3500901416 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3c78056080 con 0x7f3c8806d120 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 msgr2=0x7f3c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 0x7f3c740693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b3070 tx=0x7f3c7c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 msgr2=0x7f3c8816af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009860 tx=0x7f3c78017000 comp rx=0 tx=0).stop 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 shutdown_connections 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c74066f30 0x7f3c740693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c88157ca0 0x7f3c881497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c8806d120 0x7f3c8816af00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 --2- 172.21.15.6:0/3500901416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c881578d0 0x7f3c8816b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.058+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 >> 172.21.15.6:0/3500901416 conn(0x7f3c8806bb90 msgr2=0x7f3c88068d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.059+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 shutdown_connections 2023-10-09T11:36:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.059+0000 7f3c8fe0b700 1 -- 172.21.15.6:0/3500901416 wait complete. 2023-10-09T11:36:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:36:02.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:36:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 Processor -- start 2023-10-09T11:36:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 -- start start 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75a4154790 0x7f75a406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 0x7f75a406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40ab990 con 0x7f75a4069120 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a415ede0 con 0x7f75a4154790 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.198+0000 7f75aadbe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40abe20 con 0x7f75a415e600 2023-10-09T11:36:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75a4069120 0x7f75a415def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50342/0 (socket says 172.21.15.6:50342) 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a3fff700 1 -- 172.21.15.6:0/1037391545 learned_addr learned my addr 172.21.15.6:0/1037391545 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/1037391545 >> v2:172.21.15.118:3300/0 conn(0x7f75a4154790 0x7f75a406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a935b700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 0x7f75a406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35290491 0 0) 0x7f75a40ab990 con 0x7f75a4069120 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7594003570 con 0x7f75a4069120 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 -- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 msgr2=0x7f75a406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 0x7f75a406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444026840 0 0) 0x7f7594003570 con 0x7f75a4069120 2023-10-09T11:36:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 -- 172.21.15.6:0/1037391545 >> v1:172.21.15.6:6789/0 conn(0x7f75a4069120 legacy=0x7f75a415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 -- 172.21.15.6:0/1037391545 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4069590 con 0x7f75a4154790 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a935b700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 0x7f75a406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a406ae00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75980098e0 tx=0x7f75980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe7ca3b957d3174c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590001470 con 0x7f75a4154790 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598011420 con 0x7f75a4154790 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.199+0000 7f75a37fe700 1 -- 172.21.15.6:0/1037391545 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980117c0 con 0x7f75a4154790 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 -- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 msgr2=0x7f75a406ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a406ae00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75980098e0 tx=0x7f75980091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 -- 172.21.15.6:0/1037391545 shutdown_connections 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a415e600 0x7f75a406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 --2- 172.21.15.6:0/1037391545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a406ae00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 -- 172.21.15.6:0/1037391545 >> 172.21.15.6:0/1037391545 conn(0x7f75a406e650 msgr2=0x7f75a40cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 -- 172.21.15.6:0/1037391545 shutdown_connections 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.200+0000 7f75aadbe700 1 -- 172.21.15.6:0/1037391545 wait complete. 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.201+0000 7f75aadbe700 1 Processor -- start 2023-10-09T11:36:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.201+0000 7f75aadbe700 1 -- start start 2023-10-09T11:36:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a4069120 0x7f75a40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a40af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a415cfc0 con 0x7f75a415e600 2023-10-09T11:36:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a415c3b0 con 0x7f75a4154790 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75aadbe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a415c690 con 0x7f75a4069120 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53954/0 (socket says 172.21.15.6:53954) 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 -- 172.21.15.6:0/2342727851 learned_addr learned my addr 172.21.15.6:0/2342727851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a3fff700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a40af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a4069120 0x7f75a40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 -- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a4069120 msgr2=0x7f75a40aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a4069120 0x7f75a40aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 -- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 msgr2=0x7f75a40af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a40af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.202+0000 7f75a935b700 1 -- 172.21.15.6:0/2342727851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c009a20 con 0x7f75a415e600 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75a935b700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f759c009f60 tx=0x7f759c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00cb70 con 0x7f75a415e600 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00f040 con 0x7f75a415e600 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7598009420 con 0x7f75a415e600 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c014480 con 0x7f75a415e600 2023-10-09T11:36:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.203+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a415cc50 con 0x7f75a415e600 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.204+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a416bc40 con 0x7f75a415e600 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.204+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f759c003020 con 0x7f75a415e600 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.205+0000 7f75a0ff9700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.205+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.205+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f759c084b20 con 0x7f75a415e600 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.205+0000 7f75a8b5a700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75980030c0 tx=0x7f7598016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.209+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f759c051f70 con 0x7f75a415e600 2023-10-09T11:36:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:02.403+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f75a415d8c0 con 0x7f75a415e600 2023-10-09T11:36:03.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.061+0000 7f75a0ff9700 1 -- 172.21.15.6:0/2342727851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f759c055590 con 0x7f75a415e600 2023-10-09T11:36:03.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.069+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 msgr2=0x7f75880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.069+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75980030c0 tx=0x7f7598016000 comp rx=0 tx=0).stop 2023-10-09T11:36:03.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.069+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 msgr2=0x7f75a415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.069+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f759c009f60 tx=0x7f759c00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:03.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.069+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 shutdown_connections 2023-10-09T11:36:03.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.070+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.070+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75a415e600 0x7f75a415b730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.070+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75a4069120 0x7f75a40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.070+0000 7f75aadbe700 1 --2- 172.21.15.6:0/2342727851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75a4154790 0x7f75a40af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.070+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 >> 172.21.15.6:0/2342727851 conn(0x7f75a406e650 msgr2=0x7f75a40b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.073+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 shutdown_connections 2023-10-09T11:36:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.073+0000 7f75aadbe700 1 -- 172.21.15.6:0/2342727851 wait complete. 2023-10-09T11:36:03.076 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:36:03.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:36:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.216+0000 7fb1b8d66700 1 Processor -- start 2023-10-09T11:36:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.216+0000 7fb1b8d66700 1 -- start start 2023-10-09T11:36:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b8d66700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b8d66700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40d07c0 con 0x7fb1b4157ca0 2023-10-09T11:36:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b8d66700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40cfbb0 con 0x7fb1b406d120 2023-10-09T11:36:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b8d66700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40cfe90 con 0x7fb1b41578d0 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1b4157ca0 0x7fb1b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50354/0 (socket says 172.21.15.6:50354) 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b1d9b700 1 -- 172.21.15.6:0/3465973075 learned_addr learned my addr 172.21.15.6:0/3465973075 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b259c700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.217+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877875096 0 0) 0x7fb1b40d07c0 con 0x7fb1b4157ca0 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003570 con 0x7fb1b4157ca0 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454735473 0 0) 0x7fb1b40cfbb0 con 0x7fb1b406d120 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b40d07c0 con 0x7fb1b406d120 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170968559 0 0) 0x7fb1a0003570 con 0x7fb1b4157ca0 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 msgr2=0x7fb1b40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1b40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 >> v1:172.21.15.118:6789/0 conn(0x7fb1b406d120 legacy=0x7fb1b415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40d0170 con 0x7fb1b4157ca0 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fb19c001470 con 0x7fb1b4157ca0 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 >> v1:172.21.15.6:6789/0 conn(0x7fb1b4157ca0 legacy=0x7fb1b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1a0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004180 0x7fb1a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0004d50 0x7fb1a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40cfe90 con 0x7fb1a0004d50 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000bba0 con 0x7fb1a0004180 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a000bd60 con 0x7fb1b41578d0 2023-10-09T11:36:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0004d50 0x7fb1a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b259c700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1a0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b1d9b700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004180 0x7fb1a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 -- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 msgr2=0x7fb1a0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b41578d0 0x7fb1a0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 -- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004180 msgr2=0x7fb1a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004180 0x7fb1a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 -- 172.21.15.6:0/3465973075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0003570 con 0x7fb1a0004d50 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.218+0000 7fb1b2d9d700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0004d50 0x7fb1a00051c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac001a10 tx=0x7fb1ac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a4ce820d51f778 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00c5d0 con 0x7fb1a0004d50 2023-10-09T11:36:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00c730 con 0x7fb1a0004d50 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b159a700 1 -- 172.21.15.6:0/3465973075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00cad0 con 0x7fb1a0004d50 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 -- 172.21.15.6:0/3465973075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0004d50 msgr2=0x7fb1a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/3465973075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0004d50 0x7fb1a00051c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac001a10 tx=0x7fb1ac007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b2d9d700 1 -- 172.21.15.6:0/3465973075 reap_dead start 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 -- 172.21.15.6:0/3465973075 shutdown_connections 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 -- 172.21.15.6:0/3465973075 >> 172.21.15.6:0/3465973075 conn(0x7fb1b406bb90 msgr2=0x7fb1b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 -- 172.21.15.6:0/3465973075 shutdown_connections 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.219+0000 7fb1b8d66700 1 -- 172.21.15.6:0/3465973075 wait complete. 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.220+0000 7fb1b8d66700 1 Processor -- start 2023-10-09T11:36:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.220+0000 7fb1b8d66700 1 -- start start 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004d50 0x7fb1b414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b415ed20 0x7fb1b415f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b415f700 con 0x7fb1b40b5e50 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4159050 con 0x7fb1a0004d50 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b8d66700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4159330 con 0x7fb1b415ed20 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53976/0 (socket says 172.21.15.6:53976) 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 -- 172.21.15.6:0/2942919066 learned_addr learned my addr 172.21.15.6:0/2942919066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b259c700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004d50 0x7fb1b414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b2d9d700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b415ed20 0x7fb1b415f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 -- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b415ed20 msgr2=0x7fb1b415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b415ed20 0x7fb1b415f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 -- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004d50 msgr2=0x7fb1b414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004d50 0x7fb1b414a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.221+0000 7fb1b1d9b700 1 -- 172.21.15.6:0/2942919066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4159610 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1b1d9b700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007fd0 tx=0x7fb1b415b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c018030 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c011590 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b41598f0 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011950 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.222+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b415a0f0 con 0x7fb1b40b5e50 2023-10-09T11:36:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.223+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b4159e10 con 0x7fb1b40b5e50 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.223+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb19c01b070 con 0x7fb1b40b5e50 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.224+0000 7fb1aa7fc700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.224+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb19c019070 con 0x7fb1b40b5e50 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.224+0000 7fb1b259c700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.224+0000 7fb1b259c700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 0x7fb1940693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40094d0 tx=0x7fb1a400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.228+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b4159e10 con 0x7fb1b40b5e50 2023-10-09T11:36:03.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:03.466+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb1b414e9e0 con 0x7fb1b40b5e50 2023-10-09T11:36:03.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:03.615 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.063+0000 7fb1aa7fc700 1 -- 172.21.15.6:0/2942919066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb19c054f60 con 0x7fb1b40b5e50 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 msgr2=0x7fb1940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 0x7fb1940693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40094d0 tx=0x7fb1a400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 msgr2=0x7fb1b41586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007fd0 tx=0x7fb1b415b610 comp rx=0 tx=0).stop 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 shutdown_connections 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb194066f30 0x7fb1940693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1b415ed20 0x7fb1b415f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1a0004d50 0x7fb1b414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 --2- 172.21.15.6:0/2942919066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b40b5e50 0x7fb1b41586e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.069+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 >> 172.21.15.6:0/2942919066 conn(0x7fb1b406bb90 msgr2=0x7fb1b414c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.071+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 shutdown_connections 2023-10-09T11:36:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.072+0000 7fb1b8d66700 1 -- 172.21.15.6:0/2942919066 wait complete. 2023-10-09T11:36:04.076 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T11:36:04.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.212+0000 7f7d9c9b8700 1 Processor -- start 2023-10-09T11:36:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.212+0000 7f7d9c9b8700 1 -- start start 2023-10-09T11:36:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9c9b8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d98159bc0 0x7f7d980b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9c9b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159f90 0x7f7d9806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9c9b8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d98067640 con 0x7f7d98068370 2023-10-09T11:36:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9c9b8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980b1e50 con 0x7f7d98159bc0 2023-10-09T11:36:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9c9b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98067890 con 0x7f7d98159f90 2023-10-09T11:36:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d96d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d98159bc0 0x7f7d980b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9759e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d98068370 0x7f7d980ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51524/0 (socket says 172.21.15.6:51524) 2023-10-09T11:36:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9759e700 1 -- 172.21.15.6:0/1234076628 learned_addr learned my addr 172.21.15.6:0/1234076628 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d9659c700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159f90 0x7f7d9806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d96d9d700 1 -- 172.21.15.6:0/1234076628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159f90 msgr2=0x7f7d9806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d96d9d700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159f90 0x7f7d9806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d96d9d700 1 -- 172.21.15.6:0/1234076628 >> v1:172.21.15.6:6789/0 conn(0x7f7d98068370 legacy=0x7f7d980ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.213+0000 7f7d95d9b700 1 -- 172.21.15.6:0/1234076628 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280113500 0 0) 0x7f7d98067640 con 0x7f7d98068370 2023-10-09T11:36:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d96d9d700 1 -- 172.21.15.6:0/1234076628 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98067b70 con 0x7f7d98159bc0 2023-10-09T11:36:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d96d9d700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159bc0 0x7f7d980b17c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d900098e0 tx=0x7f7d900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c905097f2f541a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d95d9b700 1 -- 172.21.15.6:0/1234076628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90009e80 con 0x7f7d98159bc0 2023-10-09T11:36:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d95d9b700 1 -- 172.21.15.6:0/1234076628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9000b860 con 0x7f7d98159bc0 2023-10-09T11:36:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d95d9b700 1 -- 172.21.15.6:0/1234076628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000bbe0 con 0x7f7d98159bc0 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/1234076628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159bc0 msgr2=0x7f7d980b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159bc0 0x7f7d980b17c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d900098e0 tx=0x7f7d900091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/1234076628 shutdown_connections 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159bc0 0x7f7d980b17c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/1234076628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159f90 0x7f7d9806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/1234076628 >> 172.21.15.6:0/1234076628 conn(0x7f7d9806c620 msgr2=0x7f7d9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/1234076628 shutdown_connections 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.214+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/1234076628 wait complete. 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 Processor -- start 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 -- start start 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d98068370 0x7f7d98146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159bc0 0x7f7d98158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d981583c0 con 0x7f7d98159f90 2023-10-09T11:36:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9816dab0 con 0x7f7d98068370 2023-10-09T11:36:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9c9b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9816e070 con 0x7f7d98159bc0 2023-10-09T11:36:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.216+0000 7f7d9759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49946/0 (socket says 172.21.15.6:49946) 2023-10-09T11:36:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 -- 172.21.15.6:0/671845133 learned_addr learned my addr 172.21.15.6:0/671845133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d96d9d700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d98068370 0x7f7d98146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9659c700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159bc0 0x7f7d98158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 -- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159bc0 msgr2=0x7f7d98158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159bc0 0x7f7d98158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 -- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d98068370 msgr2=0x7f7d98146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d98068370 0x7f7d98146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 -- 172.21.15.6:0/671845133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009420 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9759e700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800cc20 tx=0x7f7d880019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800a870 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800a9d0 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d98159290 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800ad90 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.217+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d981588f0 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.218+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d98069920 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.218+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d88007300 con 0x7f7d98159f90 2023-10-09T11:36:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.219+0000 7f7d8effd700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.219+0000 7f7d96d9d700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.219+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d88084800 con 0x7f7d98159f90 2023-10-09T11:36:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.219+0000 7f7d96d9d700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 0x7f7d780693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d900091e0 tx=0x7f7d90017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.223+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d88051af0 con 0x7f7d98159f90 2023-10-09T11:36:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.416+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d9816e1b0 con 0x7f7d98159f90 2023-10-09T11:36:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.417+0000 7f7d8effd700 1 -- 172.21.15.6:0/671845133 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f7d88055110 con 0x7f7d98159f90 2023-10-09T11:36:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:04.419 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:03.468208+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 msgr2=0x7f7d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 0x7f7d780693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d900091e0 tx=0x7f7d90017000 comp rx=0 tx=0).stop 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 msgr2=0x7f7d980af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800cc20 tx=0x7f7d880019b0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 shutdown_connections 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d78066f30 0x7f7d780693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d98159f90 0x7f7d980af580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d98068370 0x7f7d98146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 --2- 172.21.15.6:0/671845133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d98159bc0 0x7f7d98158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 >> 172.21.15.6:0/671845133 conn(0x7f7d9806c620 msgr2=0x7f7d9815bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 shutdown_connections 2023-10-09T11:36:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.419+0000 7f7d9c9b8700 1 -- 172.21.15.6:0/671845133 wait complete. 2023-10-09T11:36:04.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.549+0000 7f926877b700 1 Processor -- start 2023-10-09T11:36:04.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.549+0000 7f926877b700 1 -- start start 2023-10-09T11:36:04.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.550+0000 7f926877b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f92600b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.550+0000 7f926877b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600b0ca0 con 0x7f926006dd60 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.550+0000 7f926877b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600b00d0 con 0x7f92600ceb30 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.550+0000 7f926877b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926006ea90 con 0x7f926015a2a0 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9266d18700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f926006dd60 0x7f92600b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51540/0 (socket says 172.21.15.6:51540) 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9266d18700 1 -- 172.21.15.6:0/2050591019 learned_addr learned my addr 172.21.15.6:0/2050591019 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9266517700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f92600b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721892011 0 0) 0x7f92600b0ca0 con 0x7f926006dd60 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924c003570 con 0x7f926006dd60 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852604468 0 0) 0x7f924c003570 con 0x7f926006dd60 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 msgr2=0x7f92600b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:04.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f92600b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 >> v1:172.21.15.118:6789/0 conn(0x7f92600ceb30 legacy=0x7f926006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600b0370 con 0x7f926006dd60 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f92580017f0 con 0x7f926006dd60 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 >> v1:172.21.15.6:6789/0 conn(0x7f926006dd60 legacy=0x7f92600b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f924c003a90 0x7f924c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924c004810 0x7f924c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f924c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926006ea90 con 0x7f924c003a90 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c00bb60 con 0x7f924c004810 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c00bd20 con 0x7f926015a2a0 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9266517700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f924c003a90 0x7f924c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9265d16700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924c004810 0x7f924c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.551+0000 7f9266d18700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f924c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 -- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 msgr2=0x7f924c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f926015a2a0 0x7f924c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 -- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924c004810 msgr2=0x7f924c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924c004810 0x7f924c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 -- 172.21.15.6:0/2050591019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c003570 con 0x7f924c003a90 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266517700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f924c003a90 0x7f924c003ea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f925c009c00 tx=0x7f925c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836fb4ec2819085 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00e710 con 0x7f924c003a90 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00e870 con 0x7f924c003a90 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9265515700 1 -- 172.21.15.6:0/2050591019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00ec30 con 0x7f924c003a90 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f926877b700 1 -- 172.21.15.6:0/2050591019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f924c003a90 msgr2=0x7f924c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f926877b700 1 --2- 172.21.15.6:0/2050591019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f924c003a90 0x7f924c003ea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f925c009c00 tx=0x7f925c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.552+0000 7f9266d18700 1 -- 172.21.15.6:0/2050591019 reap_dead start 2023-10-09T11:36:04.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.553+0000 7f926877b700 1 -- 172.21.15.6:0/2050591019 shutdown_connections 2023-10-09T11:36:04.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.553+0000 7f926877b700 1 -- 172.21.15.6:0/2050591019 >> 172.21.15.6:0/2050591019 conn(0x7f9260067640 msgr2=0x7f9260067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.553+0000 7f926877b700 1 -- 172.21.15.6:0/2050591019 shutdown_connections 2023-10-09T11:36:04.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.553+0000 7f926877b700 1 -- 172.21.15.6:0/2050591019 wait complete. 2023-10-09T11:36:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 Processor -- start 2023-10-09T11:36:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 -- start start 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f924c003a90 0x7f926015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926016ada0 0x7f926016b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926015c650 con 0x7f926015bb80 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926016b730 con 0x7f926016ada0 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f926877b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600c9ae0 con 0x7f924c003a90 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f9265d16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f9265d16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49966/0 (socket says 172.21.15.6:49966) 2023-10-09T11:36:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.554+0000 7f9265d16700 1 -- 172.21.15.6:0/574788334 learned_addr learned my addr 172.21.15.6:0/574788334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9266d18700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926016ada0 0x7f926016b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9266517700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f924c003a90 0x7f926015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 -- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f924c003a90 msgr2=0x7f926015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f924c003a90 0x7f926015b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 -- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926016ada0 msgr2=0x7f926016b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926016ada0 0x7f926016b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 -- 172.21.15.6:0/574788334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926015c370 con 0x7f926015bb80 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f9265d16700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9250002950 tx=0x7f9250007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003390 con 0x7f926015bb80 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250006820 con 0x7f926015bb80 2023-10-09T11:36:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600c9d80 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250006c00 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.555+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92600ca340 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.556+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9260069e40 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.556+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9250007230 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.557+0000 7f92567fc700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 0x7f92440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.557+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9250084430 con 0x7f926015bb80 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.557+0000 7f9266517700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 0x7f92440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.557+0000 7f9266517700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 0x7f92440693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f925c0091e0 tx=0x7f925c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.561+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92500516a0 con 0x7f926015bb80 2023-10-09T11:36:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.756+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926004bb80 con 0x7f926015bb80 2023-10-09T11:36:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.757+0000 7f92567fc700 1 -- 172.21.15.6:0/574788334 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f9250054cc0 con 0x7f926015bb80 2023-10-09T11:36:04.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:04.758 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:03.468208+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 msgr2=0x7f92440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 0x7f92440693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f925c0091e0 tx=0x7f925c01a000 comp rx=0 tx=0).stop 2023-10-09T11:36:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 msgr2=0x7f926016a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9250002950 tx=0x7f9250007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 shutdown_connections 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9244066f30 0x7f92440693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926016ada0 0x7f926016b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f924c003a90 0x7f926015b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 --2- 172.21.15.6:0/574788334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f926015bb80 0x7f926016a860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 >> 172.21.15.6:0/574788334 conn(0x7f9260067640 msgr2=0x7f92600cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 shutdown_connections 2023-10-09T11:36:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.759+0000 7f926877b700 1 -- 172.21.15.6:0/574788334 wait complete. 2023-10-09T11:36:04.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:36:04.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.892+0000 7fb30b0ac700 1 Processor -- start 2023-10-09T11:36:04.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.892+0000 7fb30b0ac700 1 -- start start 2023-10-09T11:36:04.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30b0ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3040d0f50 0x7fb30406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30b0ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb30406d530 0x7fb30415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30b0ac700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30406d990 con 0x7fb3040d0b80 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30b0ac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30415a690 con 0x7fb3040d0f50 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30b0ac700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3040cf2d0 con 0x7fb30406d530 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3040d0f50 0x7fb30406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3040d0f50 0x7fb30406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49982/0 (socket says 172.21.15.6:49982) 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 -- 172.21.15.6:0/1706819326 learned_addr learned my addr 172.21.15.6:0/1706819326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb30a8ab700 1 --2- 172.21.15.6:0/1706819326 >> v2:172.21.15.118:3300/0 conn(0x7fb30406d530 0x7fb30415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 -- 172.21.15.6:0/1706819326 >> v2:172.21.15.118:3300/0 conn(0x7fb30406d530 msgr2=0x7fb30415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:04.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 --2- 172.21.15.6:0/1706819326 >> v2:172.21.15.118:3300/0 conn(0x7fb30406d530 0x7fb30415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 -- 172.21.15.6:0/1706819326 >> v1:172.21.15.118:6789/0 conn(0x7fb3040d0b80 legacy=0x7fb3040cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 -- 172.21.15.6:0/1706819326 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3040d0480 con 0x7fb3040d0f50 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.893+0000 7fb3098a9700 1 --2- 172.21.15.6:0/1706819326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0f50 0x7fb30406cff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ce9b0 tx=0x7fb2f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d972a80d8726ebf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb3090a8700 1 -- 172.21.15.6:0/1706819326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800b860 con 0x7fb3040d0f50 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb3090a8700 1 -- 172.21.15.6:0/1706819326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800b9c0 con 0x7fb3040d0f50 2023-10-09T11:36:04.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb3090a8700 1 -- 172.21.15.6:0/1706819326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800bd60 con 0x7fb3040d0f50 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1706819326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0f50 msgr2=0x7fb30406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1706819326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0f50 0x7fb30406cff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ce9b0 tx=0x7fb2f8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1706819326 shutdown_connections 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1706819326 >> v2:172.21.15.118:3300/0 conn(0x7fb30406d530 0x7fb30415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1706819326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0f50 0x7fb30406cff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1706819326 >> 172.21.15.6:0/1706819326 conn(0x7fb304063230 msgr2=0x7fb304063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1706819326 shutdown_connections 2023-10-09T11:36:04.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.894+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1706819326 wait complete. 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.895+0000 7fb30b0ac700 1 Processor -- start 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.895+0000 7fb30b0ac700 1 -- start start 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 0x7fb304149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 0x7fb304068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040b0a20 con 0x7fb3040d0b80 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040af980 con 0x7fb30406d530 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30b0ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040afc60 con 0x7fb3040d0f50 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49996/0 (socket says 172.21.15.6:49996) 2023-10-09T11:36:04.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 -- 172.21.15.6:0/1993015719 learned_addr learned my addr 172.21.15.6:0/1993015719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30a0aa700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 0x7fb304149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30a8ab700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 0x7fb304068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 -- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 msgr2=0x7fb304068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 0x7fb304068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 -- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 msgr2=0x7fb304149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 0x7fb304149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb3098a9700 1 -- 172.21.15.6:0/1993015719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80094f0 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30a0aa700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 0x7fb304149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.896+0000 7fb30a8ab700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 0x7fb304068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb3098a9700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb30406fcc0 tx=0x7fb2f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8011e60 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f801a630 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f801a9f0 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3040aff40 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.897+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3040b0500 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.898+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3040676e0 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.898+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f802d440 con 0x7fb3040d0b80 2023-10-09T11:36:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.898+0000 7fb3027fc700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 0x7fb2f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:04.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.899+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2f8086010 con 0x7fb3040d0b80 2023-10-09T11:36:04.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.899+0000 7fb30a0aa700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 0x7fb2f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:04.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.899+0000 7fb30a0aa700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 0x7fb2f00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007fd0 tx=0x7fb2f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:04.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:04.903+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f8053280 con 0x7fb3040d0b80 2023-10-09T11:36:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:05.145+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb30406dc00 con 0x7fb3040d0b80 2023-10-09T11:36:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.085+0000 7fb3027fc700 1 -- 172.21.15.6:0/1993015719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb2f80568a0 con 0x7fb3040d0b80 2023-10-09T11:36:06.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 msgr2=0x7fb2f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 0x7fb2f00693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007fd0 tx=0x7fb2f4009040 comp rx=0 tx=0).stop 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 msgr2=0x7fb3040aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb30406fcc0 tx=0x7fb2f8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 shutdown_connections 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2f0066f30 0x7fb2f00693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb3040d0f50 0x7fb304068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb30406d530 0x7fb304149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 --2- 172.21.15.6:0/1993015719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3040d0b80 0x7fb3040aeee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.087+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 >> 172.21.15.6:0/1993015719 conn(0x7fb304063230 msgr2=0x7fb3040b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.088+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 shutdown_connections 2023-10-09T11:36:06.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.088+0000 7fb30b0ac700 1 -- 172.21.15.6:0/1993015719 wait complete. 2023-10-09T11:36:06.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:36:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.260+0000 7f2f6719d700 1 Processor -- start 2023-10-09T11:36:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.260+0000 7f2f6719d700 1 -- start start 2023-10-09T11:36:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6719d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6719d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6719d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f600cb1b0 con 0x7f2f60157c80 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6719d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6015c5f0 con 0x7f2f6006c2a0 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6719d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600ca5a0 con 0x7f2f601578b0 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6699c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:51488/0 (socket says 172.21.15.6:51488) 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6599a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2f60157c80 0x7f2f6006bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37908/0 (socket says 172.21.15.6:37908) 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 -- 172.21.15.6:0/3524975520 learned_addr learned my addr 172.21.15.6:0/3524975520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6699c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:49586/0 (socket says 172.21.15.6:49586) 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 -- 172.21.15.6:0/3524975520 >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 msgr2=0x7f2f60069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 --2- 172.21.15.6:0/3524975520 >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 -- 172.21.15.6:0/3524975520 >> v1:172.21.15.118:6789/0 conn(0x7f2f60157c80 legacy=0x7f2f6006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6619b700 1 -- 172.21.15.6:0/3524975520 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600ca880 con 0x7f2f601578b0 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.261+0000 7f2f6699c700 1 --2- 172.21.15.6:0/3524975520 >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6619b700 1 --2- 172.21.15.6:0/3524975520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009f20 tx=0x7f2f50009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85d4fb9aac91b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f65199700 1 -- 172.21.15.6:0/3524975520 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000e070 con 0x7f2f601578b0 2023-10-09T11:36:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f65199700 1 -- 172.21.15.6:0/3524975520 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000b9d0 con 0x7f2f601578b0 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f65199700 1 -- 172.21.15.6:0/3524975520 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500092e0 con 0x7f2f601578b0 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 -- 172.21.15.6:0/3524975520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 msgr2=0x7f2f6015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 --2- 172.21.15.6:0/3524975520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009f20 tx=0x7f2f50009840 comp rx=0 tx=0).stop 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 -- 172.21.15.6:0/3524975520 shutdown_connections 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 --2- 172.21.15.6:0/3524975520 >> v2:172.21.15.118:3300/0 conn(0x7f2f6006c2a0 0x7f2f60069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 --2- 172.21.15.6:0/3524975520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f6015c0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 -- 172.21.15.6:0/3524975520 >> 172.21.15.6:0/3524975520 conn(0x7f2f6006cca0 msgr2=0x7f2f6006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 -- 172.21.15.6:0/3524975520 shutdown_connections 2023-10-09T11:36:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.262+0000 7f2f6719d700 1 -- 172.21.15.6:0/3524975520 wait complete. 2023-10-09T11:36:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.263+0000 7f2f6719d700 1 Processor -- start 2023-10-09T11:36:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.263+0000 7f2f6719d700 1 -- start start 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f60151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f60157c80 0x7f2f60069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60153a20 con 0x7f2f6006c2a0 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60169b50 con 0x7f2f60157c80 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6719d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60156210 con 0x7f2f601578b0 2023-10-09T11:36:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6619b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6619b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50006/0 (socket says 172.21.15.6:50006) 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6619b700 1 -- 172.21.15.6:0/14074597 learned_addr learned my addr 172.21.15.6:0/14074597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6699c700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f60157c80 0x7f2f60069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.264+0000 7f2f6599a700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f60151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 -- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 msgr2=0x7f2f60151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f60151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 -- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f60157c80 msgr2=0x7f2f60069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f60157c80 0x7f2f60069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:06.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 -- 172.21.15.6:0/14074597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009420 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6619b700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f50003440 tx=0x7f2f50018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500089d0 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50008b30 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f50009ae0 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50026460 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.265+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f601536b0 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.266+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f60153840 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.266+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f50003040 con 0x7f2f6006c2a0 2023-10-09T11:36:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.267+0000 7f2f5e7fc700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.267+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f50085bf0 con 0x7f2f6006c2a0 2023-10-09T11:36:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.267+0000 7f2f6599a700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.267+0000 7f2f6599a700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 0x7f2f4c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f600b3940 tx=0x7f2f54007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.271+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f50052f20 con 0x7f2f6006c2a0 2023-10-09T11:36:06.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:06.508+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2f60156730 con 0x7f2f6006c2a0 2023-10-09T11:36:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.089+0000 7f2f5e7fc700 1 -- 172.21.15.6:0/14074597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f60156730 con 0x7f2f6006c2a0 2023-10-09T11:36:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.091+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 msgr2=0x7f2f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.091+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 0x7f2f4c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f600b3940 tx=0x7f2f54007eb0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.091+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 msgr2=0x7f2f60169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.091+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f50003440 tx=0x7f2f50018000 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 shutdown_connections 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f4c066f30 0x7f2f4c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f60157c80 0x7f2f60069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f6006c2a0 0x7f2f60169610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 --2- 172.21.15.6:0/14074597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f601578b0 0x7f2f60151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 >> 172.21.15.6:0/14074597 conn(0x7f2f6006cca0 msgr2=0x7f2f6015a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 shutdown_connections 2023-10-09T11:36:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.092+0000 7f2f6719d700 1 -- 172.21.15.6:0/14074597 wait complete. 2023-10-09T11:36:07.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.234+0000 7f41c0cad700 1 Processor -- start 2023-10-09T11:36:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.234+0000 7f41c0cad700 1 -- start start 2023-10-09T11:36:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41c0cad700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41bc1578d0 0x7f41bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41c0cad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41c0cad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc0d07c0 con 0x7f41bc157ca0 2023-10-09T11:36:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41c0cad700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc06daa0 con 0x7f41bc1578d0 2023-10-09T11:36:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41c0cad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0cfbb0 con 0x7f41bc06d120 2023-10-09T11:36:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41ba59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41bc1578d0 0x7f41bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41ba59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41bc1578d0 0x7f41bc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50012/0 (socket says 172.21.15.6:50012) 2023-10-09T11:36:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.235+0000 7f41ba59c700 1 -- 172.21.15.6:0/957381990 learned_addr learned my addr 172.21.15.6:0/957381990 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41bad9d700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41ba59c700 1 -- 172.21.15.6:0/957381990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 msgr2=0x7f41bc06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41ba59c700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41ba59c700 1 -- 172.21.15.6:0/957381990 >> v1:172.21.15.118:6789/0 conn(0x7f41bc157ca0 legacy=0x7f41bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41ba59c700 1 -- 172.21.15.6:0/957381990 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0cfe90 con 0x7f41bc1578d0 2023-10-09T11:36:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41bad9d700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41ba59c700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0cf4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009f20 tx=0x7f41ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ddfdb9bf02425f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41b959a700 1 -- 172.21.15.6:0/957381990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00e070 con 0x7f41bc1578d0 2023-10-09T11:36:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41b959a700 1 -- 172.21.15.6:0/957381990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac00ba80 con 0x7f41bc1578d0 2023-10-09T11:36:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41b959a700 1 -- 172.21.15.6:0/957381990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0092e0 con 0x7f41bc1578d0 2023-10-09T11:36:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41c0cad700 1 -- 172.21.15.6:0/957381990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 msgr2=0x7f41bc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.236+0000 7f41c0cad700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0cf4f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009f20 tx=0x7f41ac009840 comp rx=0 tx=0).stop 2023-10-09T11:36:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 -- 172.21.15.6:0/957381990 shutdown_connections 2023-10-09T11:36:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 --2- 172.21.15.6:0/957381990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0cf4f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 -- 172.21.15.6:0/957381990 >> 172.21.15.6:0/957381990 conn(0x7f41bc06bb90 msgr2=0x7f41bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 -- 172.21.15.6:0/957381990 shutdown_connections 2023-10-09T11:36:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.237+0000 7f41c0cad700 1 -- 172.21.15.6:0/957381990 wait complete. 2023-10-09T11:36:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 Processor -- start 2023-10-09T11:36:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 -- start start 2023-10-09T11:36:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 0x7f41bc0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc16e9c0 con 0x7f41bc1578d0 2023-10-09T11:36:07.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc16ddb0 con 0x7f41bc157ca0 2023-10-09T11:36:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.238+0000 7f41c0cad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc16e090 con 0x7f41bc06d120 2023-10-09T11:36:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41bad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 0x7f41bc0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41bad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 0x7f41bc0b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:49612/0 (socket says 172.21.15.6:49612) 2023-10-09T11:36:07.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41bad9d700 1 -- 172.21.15.6:0/3235101303 learned_addr learned my addr 172.21.15.6:0/3235101303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41ba59c700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 -- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 msgr2=0x7f41bc068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc068fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 -- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 msgr2=0x7f41bc0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 0x7f41bc0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 -- 172.21.15.6:0/3235101303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009ae0 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b9d9b700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0b5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41a4001eb0 tx=0x7f41a4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400ce10 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4011590 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc16e370 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4011950 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.239+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc0694e0 con 0x7f41bc1578d0 2023-10-09T11:36:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.240+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc067ac0 con 0x7f41bc1578d0 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.240+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41a4011d00 con 0x7f41bc1578d0 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.241+0000 7f41b27fc700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 0x7f419c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.241+0000 7f41ba59c700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 0x7f419c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.241+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41a40837a0 con 0x7f41bc1578d0 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.241+0000 7f41ba59c700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 0x7f419c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009880 tx=0x7f41ac018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.245+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41a4050a10 con 0x7f41bc1578d0 2023-10-09T11:36:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.483+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41bc157100 con 0x7f41bc1578d0 2023-10-09T11:36:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.483+0000 7f41b27fc700 1 -- 172.21.15.6:0/3235101303 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f41a4017020 con 0x7f41bc1578d0 2023-10-09T11:36:07.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:07.485 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 msgr2=0x7f419c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 0x7f419c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009880 tx=0x7f41ac018000 comp rx=0 tx=0).stop 2023-10-09T11:36:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 msgr2=0x7f41bc0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0b5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41a4001eb0 tx=0x7f41a4007ec0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 shutdown_connections 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f419c066f30 0x7f419c0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41bc157ca0 0x7f41bc0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41bc06d120 0x7f41bc068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 --2- 172.21.15.6:0/3235101303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41bc1578d0 0x7f41bc0b5cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 >> 172.21.15.6:0/3235101303 conn(0x7f41bc06bb90 msgr2=0x7f41bc1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 shutdown_connections 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.485+0000 7f41c0cad700 1 -- 172.21.15.6:0/3235101303 wait complete. 2023-10-09T11:36:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:07.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:07.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.616+0000 7fd18f0d7700 1 Processor -- start 2023-10-09T11:36:07.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.616+0000 7fd18f0d7700 1 -- start start 2023-10-09T11:36:07.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18f0d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18f0d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1880cf060 0x7fd18806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18f0d7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd188067640 con 0x7fd188159f90 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18f0d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880b1e50 con 0x7fd1880cf060 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18f0d7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd188067890 con 0x7fd188159bc0 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1880cf060 0x7fd18806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1880cf060 0x7fd18806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50038/0 (socket says 172.21.15.6:50038) 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 -- 172.21.15.6:0/1852814908 learned_addr learned my addr 172.21.15.6:0/1852814908 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e0d5700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 -- 172.21.15.6:0/1852814908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 msgr2=0x7fd1880b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 -- 172.21.15.6:0/1852814908 >> v1:172.21.15.118:6789/0 conn(0x7fd188159f90 legacy=0x7fd1880ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 -- 172.21.15.6:0/1852814908 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188067b70 con 0x7fd1880cf060 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18e8d6700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880cf060 0x7fd18806b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd180009f20 tx=0x7fd180009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3218bac7a2bacada server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18d0d3700 1 -- 172.21.15.6:0/1852814908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18000e070 con 0x7fd1880cf060 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18d0d3700 1 -- 172.21.15.6:0/1852814908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18000ba80 con 0x7fd1880cf060 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.617+0000 7fd18d0d3700 1 -- 172.21.15.6:0/1852814908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800092e0 con 0x7fd1880cf060 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 -- 172.21.15.6:0/1852814908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880cf060 msgr2=0x7fd18806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880cf060 0x7fd18806b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd180009f20 tx=0x7fd180009840 comp rx=0 tx=0).stop 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 -- 172.21.15.6:0/1852814908 shutdown_connections 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880cf060 0x7fd18806b0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/1852814908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 -- 172.21.15.6:0/1852814908 >> 172.21.15.6:0/1852814908 conn(0x7fd18806c620 msgr2=0x7fd18806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 -- 172.21.15.6:0/1852814908 shutdown_connections 2023-10-09T11:36:07.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.618+0000 7fd18f0d7700 1 -- 172.21.15.6:0/1852814908 wait complete. 2023-10-09T11:36:07.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.619+0000 7fd18f0d7700 1 Processor -- start 2023-10-09T11:36:07.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.619+0000 7fd18f0d7700 1 -- start start 2023-10-09T11:36:07.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1880cf060 0x7fd1880af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880ce360 con 0x7fd188159f90 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b0660 con 0x7fd1880cf060 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18f0d7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880afa50 con 0x7fd188159bc0 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e0d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1880cf060 0x7fd1880af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50054/0 (socket says 172.21.15.6:50054) 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 -- 172.21.15.6:0/2085308905 learned_addr learned my addr 172.21.15.6:0/2085308905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18d8d4700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 -- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 msgr2=0x7fd1880cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 -- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1880cf060 msgr2=0x7fd1880af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1880cf060 0x7fd1880af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 -- 172.21.15.6:0/2085308905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180009ae0 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.620+0000 7fd18e8d6700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd188063870 tx=0x7fd180018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.621+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800032f0 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.621+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180008d20 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.621+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1880afd30 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.621+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18001c640 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.621+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1880b02f0 con 0x7fd188159f90 2023-10-09T11:36:07.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.622+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1880b07f0 con 0x7fd188159f90 2023-10-09T11:36:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.622+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd180003040 con 0x7fd188159f90 2023-10-09T11:36:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.622+0000 7fd1867fc700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.622+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd180085d10 con 0x7fd188159f90 2023-10-09T11:36:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.622+0000 7fd18e0d5700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.623+0000 7fd18e0d5700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 0x7fd1740693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd178006fd0 tx=0x7fd178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.627+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd180052f80 con 0x7fd188159f90 2023-10-09T11:36:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.820+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd188063f00 con 0x7fd188159f90 2023-10-09T11:36:07.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.821+0000 7fd1867fc700 1 -- 172.21.15.6:0/2085308905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd1800565a0 con 0x7fd188159f90 2023-10-09T11:36:07.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:07.824 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 msgr2=0x7fd1740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 0x7fd1740693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd178006fd0 tx=0x7fd178008040 comp rx=0 tx=0).stop 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 msgr2=0x7fd188143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd188063870 tx=0x7fd180018000 comp rx=0 tx=0).stop 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 shutdown_connections 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd188159f90 0x7fd188143940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1880cf060 0x7fd1880af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 --2- 172.21.15.6:0/2085308905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd188159bc0 0x7fd1880cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 >> 172.21.15.6:0/2085308905 conn(0x7fd18806c620 msgr2=0x7fd188158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 shutdown_connections 2023-10-09T11:36:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.823+0000 7fd18f0d7700 1 -- 172.21.15.6:0/2085308905 wait complete. 2023-10-09T11:36:07.836 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:36:07.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.954+0000 7f29bf78a700 1 Processor -- start 2023-10-09T11:36:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.954+0000 7f29bf78a700 1 -- start start 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bf78a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 0x7f29b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bf78a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bf78a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b80d07c0 con 0x7f29b806d120 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bf78a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b80cfbb0 con 0x7f29b81578d0 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bf78a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80cfe90 con 0x7f29b8157ca0 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bd526700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 0x7f29b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bd526700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 0x7f29b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:49628/0 (socket says 172.21.15.6:49628) 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:51518/0 (socket says 172.21.15.6:51518) 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bd526700 1 -- 172.21.15.6:0/4134573752 learned_addr learned my addr 172.21.15.6:0/4134573752 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bdd27700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f29b806d120 0x7f29b815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37938/0 (socket says 172.21.15.6:37938) 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 -- 172.21.15.6:0/4134573752 >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 msgr2=0x7f29b80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 --2- 172.21.15.6:0/4134573752 >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 0x7f29b80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29b7fff700 1 -- 172.21.15.6:0/4134573752 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463067056 0 0) 0x7f29b80d07c0 con 0x7f29b806d120 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 -- 172.21.15.6:0/4134573752 >> v1:172.21.15.118:6789/0 conn(0x7f29b806d120 legacy=0x7f29b815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 -- 172.21.15.6:0/4134573752 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80d0170 con 0x7f29b8157ca0 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29bcd25700 1 --2- 172.21.15.6:0/4134573752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098e0 tx=0x7f29ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94961c45c413fac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.955+0000 7f29b7fff700 1 -- 172.21.15.6:0/4134573752 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00b640 con 0x7f29b8157ca0 2023-10-09T11:36:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29b7fff700 1 -- 172.21.15.6:0/4134573752 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00b7a0 con 0x7f29b8157ca0 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29b7fff700 1 -- 172.21.15.6:0/4134573752 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bb40 con 0x7f29b8157ca0 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 -- 172.21.15.6:0/4134573752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 msgr2=0x7f29b815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 --2- 172.21.15.6:0/4134573752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098e0 tx=0x7f29ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 -- 172.21.15.6:0/4134573752 shutdown_connections 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 --2- 172.21.15.6:0/4134573752 >> v2:172.21.15.118:3300/0 conn(0x7f29b81578d0 0x7f29b80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 --2- 172.21.15.6:0/4134573752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b815af00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 -- 172.21.15.6:0/4134573752 >> 172.21.15.6:0/4134573752 conn(0x7f29b806bb90 msgr2=0x7f29b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 -- 172.21.15.6:0/4134573752 shutdown_connections 2023-10-09T11:36:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.956+0000 7f29bf78a700 1 -- 172.21.15.6:0/4134573752 wait complete. 2023-10-09T11:36:07.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.957+0000 7f29bf78a700 1 Processor -- start 2023-10-09T11:36:07.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.957+0000 7f29bf78a700 1 -- start start 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b81578d0 0x7f29b81465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80b5980 con 0x7f29b806d120 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80b4aa0 con 0x7f29b81578d0 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bf78a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80b4d70 con 0x7f29b8157ca0 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50070/0 (socket says 172.21.15.6:50070) 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 -- 172.21.15.6:0/1519191915 learned_addr learned my addr 172.21.15.6:0/1519191915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bcd25700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b81578d0 0x7f29b81465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bdd27700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 -- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 msgr2=0x7f29b80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 -- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b81578d0 msgr2=0x7f29b81465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b81578d0 0x7f29b81465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.958+0000 7f29bd526700 1 -- 172.21.15.6:0/1519191915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009420 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29bd526700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ea50 tx=0x7f29b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000c850 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b000c9b0 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000cd30 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b80b5050 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.959+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b80b5610 con 0x7f29b806d120 2023-10-09T11:36:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.960+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b80b5c60 con 0x7f29b806d120 2023-10-09T11:36:07.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.960+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29b0013680 con 0x7f29b806d120 2023-10-09T11:36:07.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.960+0000 7f29b57fa700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:07.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.961+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29b00847f0 con 0x7f29b806d120 2023-10-09T11:36:07.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.961+0000 7f29bcd25700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:07.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.961+0000 7f29bcd25700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 0x7f29a40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0093f0 tx=0x7f29ac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:07.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:07.965+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29b0051a60 con 0x7f29b806d120 2023-10-09T11:36:08.042 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-09T11:36:08.040+0000 7f04a4ff0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.156+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29b80b5ac0 con 0x7f29a4066f30 2023-10-09T11:36:08.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.163+0000 7f29b57fa700 1 -- 172.21.15.6:0/1519191915 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257303 (secure 0 0 0) 0x7f29ac00b910 con 0x7f29a4066f30 2023-10-09T11:36:08.169 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.166+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 msgr2=0x7f29a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.166+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 0x7f29a40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0093f0 tx=0x7f29ac017000 comp rx=0 tx=0).stop 2023-10-09T11:36:08.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.166+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 msgr2=0x7f29b815c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.166+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ea50 tx=0x7f29b0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 shutdown_connections 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29a4066f30 0x7f29a40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29b8157ca0 0x7f29b80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b806d120 0x7f29b815c910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 --2- 172.21.15.6:0/1519191915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b81578d0 0x7f29b81465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 >> 172.21.15.6:0/1519191915 conn(0x7f29b806bb90 msgr2=0x7f29b80688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 shutdown_connections 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.167+0000 7f29bf78a700 1 -- 172.21.15.6:0/1519191915 wait complete. 2023-10-09T11:36:08.172 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:08.180 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T11:36:08.148039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1551,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560948,"statfs":{"total":1600000000,"available":1598410835,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001074"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067592+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070708+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070047+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064769+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067818+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066393+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067730+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069945+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072104+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068003+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.073743+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062261+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:37.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069561+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069557+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071589+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066001+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065329+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064911+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071719+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074646+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:03.074646+0000","last_peered":"2023-10-09T11:36:03.074646+0000","last_clean":"2023-10-09T11:36:03.074646+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:03.074646+0000","last_undegraded":"2023-10-09T11:36:03.074646+0000","last_fullsized":"2023-10-09T11:36:03.074646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066130+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071936+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:03.071936+0000","last_peered":"2023-10-09T11:36:03.071936+0000","last_clean":"2023-10-09T11:36:03.071936+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:03.071936+0000","last_undegraded":"2023-10-09T11:36:03.071936+0000","last_fullsized":"2023-10-09T11:36:03.071936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069653+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076134+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:03.076134+0000","last_peered":"2023-10-09T11:36:03.076134+0000","last_clean":"2023-10-09T11:36:03.076134+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:03.076134+0000","last_undegraded":"2023-10-09T11:36:03.076134+0000","last_fullsized":"2023-10-09T11:36:03.076134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062780+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072573+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:03.072573+0000","last_peered":"2023-10-09T11:36:03.072573+0000","last_clean":"2023-10-09T11:36:03.072573+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:03.072573+0000","last_undegraded":"2023-10-09T11:36:03.072573+0000","last_fullsized":"2023-10-09T11:36:03.072573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062038+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072466+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:03.072466+0000","last_peered":"2023-10-09T11:36:03.072466+0000","last_clean":"2023-10-09T11:36:03.072466+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:03.072466+0000","last_undegraded":"2023-10-09T11:36:03.072466+0000","last_fullsized":"2023-10-09T11:36:03.072466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063539+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074738+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:03.074738+0000","last_peered":"2023-10-09T11:36:03.074738+0000","last_clean":"2023-10-09T11:36:03.074738+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:03.074738+0000","last_undegraded":"2023-10-09T11:36:03.074738+0000","last_fullsized":"2023-10-09T11:36:03.074738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065759+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076801+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:03.076801+0000","last_peered":"2023-10-09T11:36:03.076801+0000","last_clean":"2023-10-09T11:36:03.076801+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:03.076801+0000","last_undegraded":"2023-10-09T11:36:03.076801+0000","last_fullsized":"2023-10-09T11:36:03.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065051+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068534+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:03.068534+0000","last_peered":"2023-10-09T11:36:03.068534+0000","last_clean":"2023-10-09T11:36:03.068534+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:03.068534+0000","last_undegraded":"2023-10-09T11:36:03.068534+0000","last_fullsized":"2023-10-09T11:36:03.068534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069966+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.077021+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:03.077021+0000","last_peered":"2023-10-09T11:36:03.077021+0000","last_clean":"2023-10-09T11:36:03.077021+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:03.077021+0000","last_undegraded":"2023-10-09T11:36:03.077021+0000","last_fullsized":"2023-10-09T11:36:03.077021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063640+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075059+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:03.075059+0000","last_peered":"2023-10-09T11:36:03.075059+0000","last_clean":"2023-10-09T11:36:03.075059+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:03.075059+0000","last_undegraded":"2023-10-09T11:36:03.075059+0000","last_fullsized":"2023-10-09T11:36:03.075059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066485+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071834+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:03.071834+0000","last_peered":"2023-10-09T11:36:03.071834+0000","last_clean":"2023-10-09T11:36:03.071834+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:03.071834+0000","last_undegraded":"2023-10-09T11:36:03.071834+0000","last_fullsized":"2023-10-09T11:36:03.071834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062185+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:12.099345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073913+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:03.073913+0000","last_peered":"2023-10-09T11:36:03.073913+0000","last_clean":"2023-10-09T11:36:03.073913+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:03.073913+0000","last_undegraded":"2023-10-09T11:36:03.073913+0000","last_fullsized":"2023-10-09T11:36:03.073913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068099+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069288+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:03.069288+0000","last_peered":"2023-10-09T11:36:03.069288+0000","last_clean":"2023-10-09T11:36:03.069288+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:03.069288+0000","last_undegraded":"2023-10-09T11:36:03.069288+0000","last_fullsized":"2023-10-09T11:36:03.069288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066050+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070071+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:03.070071+0000","last_peered":"2023-10-09T11:36:03.070071+0000","last_clean":"2023-10-09T11:36:03.070071+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:03.070071+0000","last_undegraded":"2023-10-09T11:36:03.070071+0000","last_fullsized":"2023-10-09T11:36:03.070071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067378+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074702+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:03.074702+0000","last_peered":"2023-10-09T11:36:03.074702+0000","last_clean":"2023-10-09T11:36:03.074702+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:03.074702+0000","last_undegraded":"2023-10-09T11:36:03.074702+0000","last_fullsized":"2023-10-09T11:36:03.074702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069625+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073149+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:03.073149+0000","last_peered":"2023-10-09T11:36:03.073149+0000","last_clean":"2023-10-09T11:36:03.073149+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:03.073149+0000","last_undegraded":"2023-10-09T11:36:03.073149+0000","last_fullsized":"2023-10-09T11:36:03.073149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066642+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.064500+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:03.064500+0000","last_peered":"2023-10-09T11:36:03.064500+0000","last_clean":"2023-10-09T11:36:03.064500+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:03.064500+0000","last_undegraded":"2023-10-09T11:36:03.064500+0000","last_fullsized":"2023-10-09T11:36:03.064500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065936+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074056+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:03.074056+0000","last_peered":"2023-10-09T11:36:03.074056+0000","last_clean":"2023-10-09T11:36:03.074056+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:03.074056+0000","last_undegraded":"2023-10-09T11:36:03.074056+0000","last_fullsized":"2023-10-09T11:36:03.074056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063904+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070650+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:03.070650+0000","last_peered":"2023-10-09T11:36:03.070650+0000","last_clean":"2023-10-09T11:36:03.070650+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:03.070650+0000","last_undegraded":"2023-10-09T11:36:03.070650+0000","last_fullsized":"2023-10-09T11:36:03.070650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062686+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065297+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068267+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:03.068267+0000","last_peered":"2023-10-09T11:36:03.068267+0000","last_clean":"2023-10-09T11:36:03.068267+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:03.068267+0000","last_undegraded":"2023-10-09T11:36:03.068267+0000","last_fullsized":"2023-10-09T11:36:03.068267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064562+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.063629+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:03.063629+0000","last_peered":"2023-10-09T11:36:03.063629+0000","last_clean":"2023-10-09T11:36:03.063629+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:03.063629+0000","last_undegraded":"2023-10-09T11:36:03.063629+0000","last_fullsized":"2023-10-09T11:36:03.063629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-09T11:36:02.056823+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:02.056823+0000","last_peered":"2023-10-09T11:36:02.056823+0000","last_clean":"2023-10-09T11:36:02.056823+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:02.056823+0000","last_undegraded":"2023-10-09T11:36:02.056823+0000","last_fullsized":"2023-10-09T11:36:02.056823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067509+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072868+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:03.072868+0000","last_peered":"2023-10-09T11:36:03.072868+0000","last_clean":"2023-10-09T11:36:03.072868+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:03.072868+0000","last_undegraded":"2023-10-09T11:36:03.072868+0000","last_fullsized":"2023-10-09T11:36:03.072868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073553+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:03.073553+0000","last_peered":"2023-10-09T11:36:03.073553+0000","last_clean":"2023-10-09T11:36:03.073553+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:03.073553+0000","last_undegraded":"2023-10-09T11:36:03.073553+0000","last_fullsized":"2023-10-09T11:36:03.073553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066226+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075260+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:03.075260+0000","last_peered":"2023-10-09T11:36:03.075260+0000","last_clean":"2023-10-09T11:36:03.075260+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:03.075260+0000","last_undegraded":"2023-10-09T11:36:03.075260+0000","last_fullsized":"2023-10-09T11:36:03.075260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064996+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074849+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:03.074849+0000","last_peered":"2023-10-09T11:36:03.074849+0000","last_clean":"2023-10-09T11:36:03.074849+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:03.074849+0000","last_undegraded":"2023-10-09T11:36:03.074849+0000","last_fullsized":"2023-10-09T11:36:03.074849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067886+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070871+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:03.070871+0000","last_peered":"2023-10-09T11:36:03.070871+0000","last_clean":"2023-10-09T11:36:03.070871+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:03.070871+0000","last_undegraded":"2023-10-09T11:36:03.070871+0000","last_fullsized":"2023-10-09T11:36:03.070871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063131+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068307+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:03.068307+0000","last_peered":"2023-10-09T11:36:03.068307+0000","last_clean":"2023-10-09T11:36:03.068307+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:03.068307+0000","last_undegraded":"2023-10-09T11:36:03.068307+0000","last_fullsized":"2023-10-09T11:36:03.068307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064284+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073134+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:03.073134+0000","last_peered":"2023-10-09T11:36:03.073134+0000","last_clean":"2023-10-09T11:36:03.073134+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:03.073134+0000","last_undegraded":"2023-10-09T11:36:03.073134+0000","last_fullsized":"2023-10-09T11:36:03.073134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068964+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:03.068964+0000","last_peered":"2023-10-09T11:36:03.068964+0000","last_clean":"2023-10-09T11:36:03.068964+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:03.068964+0000","last_undegraded":"2023-10-09T11:36:03.068964+0000","last_fullsized":"2023-10-09T11:36:03.068964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066222+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069521+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:03.069521+0000","last_peered":"2023-10-09T11:36:03.069521+0000","last_clean":"2023-10-09T11:36:03.069521+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:03.069521+0000","last_undegraded":"2023-10-09T11:36:03.069521+0000","last_fullsized":"2023-10-09T11:36:03.069521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065085+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069505+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:03.069505+0000","last_peered":"2023-10-09T11:36:03.069505+0000","last_clean":"2023-10-09T11:36:03.069505+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:03.069505+0000","last_undegraded":"2023-10-09T11:36:03.069505+0000","last_fullsized":"2023-10-09T11:36:03.069505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063282+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.066236+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:03.066236+0000","last_peered":"2023-10-09T11:36:03.066236+0000","last_clean":"2023-10-09T11:36:03.066236+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:03.066236+0000","last_undegraded":"2023-10-09T11:36:03.066236+0000","last_fullsized":"2023-10-09T11:36:03.066236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067516+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065132+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062475+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068868+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068816+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070319+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072967+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065496+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064301+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069199+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064930+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066933+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066155+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:08.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.338+0000 7f981a5b6700 1 Processor -- start 2023-10-09T11:36:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.338+0000 7f981a5b6700 1 -- start start 2023-10-09T11:36:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f981a5b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98141578d0 0x7f98140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f981a5b6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 0x7f981406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f981a5b6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140d07c0 con 0x7f9814157ca0 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f981a5b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981406da50 con 0x7f98141578d0 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f981a5b6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140cfbb0 con 0x7f981406d120 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98141578d0 0x7f98140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f98137fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9814157ca0 0x7f981415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51556/0 (socket says 172.21.15.6:51556) 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f98137fe700 1 -- 172.21.15.6:0/4233197836 learned_addr learned my addr 172.21.15.6:0/4233197836 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9818b53700 1 --2- 172.21.15.6:0/4233197836 >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 0x7f981406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 -- 172.21.15.6:0/4233197836 >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 msgr2=0x7f981406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 --2- 172.21.15.6:0/4233197836 >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 0x7f981406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 -- 172.21.15.6:0/4233197836 >> v1:172.21.15.6:6789/0 conn(0x7f9814157ca0 legacy=0x7f981415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 -- 172.21.15.6:0/4233197836 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140cfe90 con 0x7f98141578d0 2023-10-09T11:36:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9812ffd700 1 -- 172.21.15.6:0/4233197836 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531663828 0 0) 0x7f98140d07c0 con 0x7f9814157ca0 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9818b53700 1 --2- 172.21.15.6:0/4233197836 >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 0x7f981406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9813fff700 1 --2- 172.21.15.6:0/4233197836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9814068300 tx=0x7f98040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd22e8ec894b290f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9812ffd700 1 -- 172.21.15.6:0/4233197836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400b6b0 con 0x7f98141578d0 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9812ffd700 1 -- 172.21.15.6:0/4233197836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400b810 con 0x7f98141578d0 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.339+0000 7f9812ffd700 1 -- 172.21.15.6:0/4233197836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400bbb0 con 0x7f98141578d0 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 -- 172.21.15.6:0/4233197836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 msgr2=0x7f98140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 --2- 172.21.15.6:0/4233197836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9814068300 tx=0x7f98040091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 -- 172.21.15.6:0/4233197836 shutdown_connections 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 --2- 172.21.15.6:0/4233197836 >> v2:172.21.15.118:3300/0 conn(0x7f981406d120 0x7f981406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 --2- 172.21.15.6:0/4233197836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140cf4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 -- 172.21.15.6:0/4233197836 >> 172.21.15.6:0/4233197836 conn(0x7f981406bb90 msgr2=0x7f981406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 -- 172.21.15.6:0/4233197836 shutdown_connections 2023-10-09T11:36:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.340+0000 7f981a5b6700 1 -- 172.21.15.6:0/4233197836 wait complete. 2023-10-09T11:36:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.341+0000 7f981a5b6700 1 Processor -- start 2023-10-09T11:36:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.341+0000 7f981a5b6700 1 -- start start 2023-10-09T11:36:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f981406d120 0x7f98140c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9814157ca0 0x7f98140b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140cd330 con 0x7f98141578d0 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140cc720 con 0x7f9814157ca0 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f981a5b6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140cca00 con 0x7f981406d120 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50088/0 (socket says 172.21.15.6:50088) 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 -- 172.21.15.6:0/3118184042 learned_addr learned my addr 172.21.15.6:0/3118184042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f9813fff700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f981406d120 0x7f98140c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f9818b53700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9814157ca0 0x7f98140b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 -- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f981406d120 msgr2=0x7f98140c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f981406d120 0x7f98140c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 -- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9814157ca0 msgr2=0x7f98140b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9814157ca0 0x7f98140b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.342+0000 7f98137fe700 1 -- 172.21.15.6:0/3118184042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804009420 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f98137fe700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f980800c5e0 tx=0x7f9808000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808005b30 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808005c90 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98140ccce0 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808007300 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.343+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140c98e0 con 0x7f98141578d0 2023-10-09T11:36:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.344+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98140b2f30 con 0x7f98141578d0 2023-10-09T11:36:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.344+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f980801b3b0 con 0x7f98141578d0 2023-10-09T11:36:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.344+0000 7f97fbfff700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.345+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f98080839b0 con 0x7f98141578d0 2023-10-09T11:36:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.345+0000 7f9813fff700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.345+0000 7f9813fff700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 0x7f98000693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98040093f0 tx=0x7f9804017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.349+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9808050b80 con 0x7f98141578d0 2023-10-09T11:36:08.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.538+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98140cd470 con 0x7f9800066f30 2023-10-09T11:36:08.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.546+0000 7f97fbfff700 1 -- 172.21.15.6:0/3118184042 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257303 (secure 0 0 0) 0x7f98140cd470 con 0x7f9800066f30 2023-10-09T11:36:08.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 msgr2=0x7f98000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 0x7f98000693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98040093f0 tx=0x7f9804017000 comp rx=0 tx=0).stop 2023-10-09T11:36:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 msgr2=0x7f98140b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f980800c5e0 tx=0x7f9808000fe0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 shutdown_connections 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9814157ca0 0x7f98140b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f981406d120 0x7f98140c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 --2- 172.21.15.6:0/3118184042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98141578d0 0x7f98140b5b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 >> 172.21.15.6:0/3118184042 conn(0x7f981406bb90 msgr2=0x7f981415b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 shutdown_connections 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.549+0000 7f981a5b6700 1 -- 172.21.15.6:0/3118184042 wait complete. 2023-10-09T11:36:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:08.562 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T11:36:08.148039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1551,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560948,"statfs":{"total":1600000000,"available":1598410835,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001074"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067592+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070708+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070047+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064769+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067818+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066393+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067730+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069945+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072104+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068003+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.073743+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062261+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:37.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069561+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069557+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071589+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066001+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065329+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064911+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071719+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074646+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:03.074646+0000","last_peered":"2023-10-09T11:36:03.074646+0000","last_clean":"2023-10-09T11:36:03.074646+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:03.074646+0000","last_undegraded":"2023-10-09T11:36:03.074646+0000","last_fullsized":"2023-10-09T11:36:03.074646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066130+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071936+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:03.071936+0000","last_peered":"2023-10-09T11:36:03.071936+0000","last_clean":"2023-10-09T11:36:03.071936+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:03.071936+0000","last_undegraded":"2023-10-09T11:36:03.071936+0000","last_fullsized":"2023-10-09T11:36:03.071936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069653+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076134+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:03.076134+0000","last_peered":"2023-10-09T11:36:03.076134+0000","last_clean":"2023-10-09T11:36:03.076134+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:03.076134+0000","last_undegraded":"2023-10-09T11:36:03.076134+0000","last_fullsized":"2023-10-09T11:36:03.076134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062780+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072573+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:03.072573+0000","last_peered":"2023-10-09T11:36:03.072573+0000","last_clean":"2023-10-09T11:36:03.072573+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:03.072573+0000","last_undegraded":"2023-10-09T11:36:03.072573+0000","last_fullsized":"2023-10-09T11:36:03.072573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062038+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072466+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:03.072466+0000","last_peered":"2023-10-09T11:36:03.072466+0000","last_clean":"2023-10-09T11:36:03.072466+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:03.072466+0000","last_undegraded":"2023-10-09T11:36:03.072466+0000","last_fullsized":"2023-10-09T11:36:03.072466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063539+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074738+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:03.074738+0000","last_peered":"2023-10-09T11:36:03.074738+0000","last_clean":"2023-10-09T11:36:03.074738+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:03.074738+0000","last_undegraded":"2023-10-09T11:36:03.074738+0000","last_fullsized":"2023-10-09T11:36:03.074738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065759+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076801+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:03.076801+0000","last_peered":"2023-10-09T11:36:03.076801+0000","last_clean":"2023-10-09T11:36:03.076801+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:03.076801+0000","last_undegraded":"2023-10-09T11:36:03.076801+0000","last_fullsized":"2023-10-09T11:36:03.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065051+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068534+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:03.068534+0000","last_peered":"2023-10-09T11:36:03.068534+0000","last_clean":"2023-10-09T11:36:03.068534+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:03.068534+0000","last_undegraded":"2023-10-09T11:36:03.068534+0000","last_fullsized":"2023-10-09T11:36:03.068534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069966+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.077021+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:03.077021+0000","last_peered":"2023-10-09T11:36:03.077021+0000","last_clean":"2023-10-09T11:36:03.077021+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:03.077021+0000","last_undegraded":"2023-10-09T11:36:03.077021+0000","last_fullsized":"2023-10-09T11:36:03.077021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063640+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075059+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:03.075059+0000","last_peered":"2023-10-09T11:36:03.075059+0000","last_clean":"2023-10-09T11:36:03.075059+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:03.075059+0000","last_undegraded":"2023-10-09T11:36:03.075059+0000","last_fullsized":"2023-10-09T11:36:03.075059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066485+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071834+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:03.071834+0000","last_peered":"2023-10-09T11:36:03.071834+0000","last_clean":"2023-10-09T11:36:03.071834+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:03.071834+0000","last_undegraded":"2023-10-09T11:36:03.071834+0000","last_fullsized":"2023-10-09T11:36:03.071834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062185+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:12.099345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073913+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:03.073913+0000","last_peered":"2023-10-09T11:36:03.073913+0000","last_clean":"2023-10-09T11:36:03.073913+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:03.073913+0000","last_undegraded":"2023-10-09T11:36:03.073913+0000","last_fullsized":"2023-10-09T11:36:03.073913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068099+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069288+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:03.069288+0000","last_peered":"2023-10-09T11:36:03.069288+0000","last_clean":"2023-10-09T11:36:03.069288+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:03.069288+0000","last_undegraded":"2023-10-09T11:36:03.069288+0000","last_fullsized":"2023-10-09T11:36:03.069288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066050+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070071+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:03.070071+0000","last_peered":"2023-10-09T11:36:03.070071+0000","last_clean":"2023-10-09T11:36:03.070071+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:03.070071+0000","last_undegraded":"2023-10-09T11:36:03.070071+0000","last_fullsized":"2023-10-09T11:36:03.070071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067378+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074702+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:03.074702+0000","last_peered":"2023-10-09T11:36:03.074702+0000","last_clean":"2023-10-09T11:36:03.074702+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:03.074702+0000","last_undegraded":"2023-10-09T11:36:03.074702+0000","last_fullsized":"2023-10-09T11:36:03.074702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069625+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073149+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:03.073149+0000","last_peered":"2023-10-09T11:36:03.073149+0000","last_clean":"2023-10-09T11:36:03.073149+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:03.073149+0000","last_undegraded":"2023-10-09T11:36:03.073149+0000","last_fullsized":"2023-10-09T11:36:03.073149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066642+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.064500+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:03.064500+0000","last_peered":"2023-10-09T11:36:03.064500+0000","last_clean":"2023-10-09T11:36:03.064500+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:03.064500+0000","last_undegraded":"2023-10-09T11:36:03.064500+0000","last_fullsized":"2023-10-09T11:36:03.064500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065936+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074056+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:03.074056+0000","last_peered":"2023-10-09T11:36:03.074056+0000","last_clean":"2023-10-09T11:36:03.074056+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:03.074056+0000","last_undegraded":"2023-10-09T11:36:03.074056+0000","last_fullsized":"2023-10-09T11:36:03.074056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063904+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070650+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:03.070650+0000","last_peered":"2023-10-09T11:36:03.070650+0000","last_clean":"2023-10-09T11:36:03.070650+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:03.070650+0000","last_undegraded":"2023-10-09T11:36:03.070650+0000","last_fullsized":"2023-10-09T11:36:03.070650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062686+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065297+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068267+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:03.068267+0000","last_peered":"2023-10-09T11:36:03.068267+0000","last_clean":"2023-10-09T11:36:03.068267+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:03.068267+0000","last_undegraded":"2023-10-09T11:36:03.068267+0000","last_fullsized":"2023-10-09T11:36:03.068267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064562+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.063629+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:03.063629+0000","last_peered":"2023-10-09T11:36:03.063629+0000","last_clean":"2023-10-09T11:36:03.063629+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:03.063629+0000","last_undegraded":"2023-10-09T11:36:03.063629+0000","last_fullsized":"2023-10-09T11:36:03.063629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-09T11:36:02.056823+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:02.056823+0000","last_peered":"2023-10-09T11:36:02.056823+0000","last_clean":"2023-10-09T11:36:02.056823+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:02.056823+0000","last_undegraded":"2023-10-09T11:36:02.056823+0000","last_fullsized":"2023-10-09T11:36:02.056823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067509+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072868+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:03.072868+0000","last_peered":"2023-10-09T11:36:03.072868+0000","last_clean":"2023-10-09T11:36:03.072868+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:03.072868+0000","last_undegraded":"2023-10-09T11:36:03.072868+0000","last_fullsized":"2023-10-09T11:36:03.072868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073553+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:03.073553+0000","last_peered":"2023-10-09T11:36:03.073553+0000","last_clean":"2023-10-09T11:36:03.073553+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:03.073553+0000","last_undegraded":"2023-10-09T11:36:03.073553+0000","last_fullsized":"2023-10-09T11:36:03.073553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066226+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075260+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:03.075260+0000","last_peered":"2023-10-09T11:36:03.075260+0000","last_clean":"2023-10-09T11:36:03.075260+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:03.075260+0000","last_undegraded":"2023-10-09T11:36:03.075260+0000","last_fullsized":"2023-10-09T11:36:03.075260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064996+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074849+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:03.074849+0000","last_peered":"2023-10-09T11:36:03.074849+0000","last_clean":"2023-10-09T11:36:03.074849+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:03.074849+0000","last_undegraded":"2023-10-09T11:36:03.074849+0000","last_fullsized":"2023-10-09T11:36:03.074849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067886+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070871+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:03.070871+0000","last_peered":"2023-10-09T11:36:03.070871+0000","last_clean":"2023-10-09T11:36:03.070871+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:03.070871+0000","last_undegraded":"2023-10-09T11:36:03.070871+0000","last_fullsized":"2023-10-09T11:36:03.070871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063131+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068307+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:03.068307+0000","last_peered":"2023-10-09T11:36:03.068307+0000","last_clean":"2023-10-09T11:36:03.068307+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:03.068307+0000","last_undegraded":"2023-10-09T11:36:03.068307+0000","last_fullsized":"2023-10-09T11:36:03.068307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064284+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073134+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:03.073134+0000","last_peered":"2023-10-09T11:36:03.073134+0000","last_clean":"2023-10-09T11:36:03.073134+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:03.073134+0000","last_undegraded":"2023-10-09T11:36:03.073134+0000","last_fullsized":"2023-10-09T11:36:03.073134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068964+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:03.068964+0000","last_peered":"2023-10-09T11:36:03.068964+0000","last_clean":"2023-10-09T11:36:03.068964+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:03.068964+0000","last_undegraded":"2023-10-09T11:36:03.068964+0000","last_fullsized":"2023-10-09T11:36:03.068964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066222+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069521+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:03.069521+0000","last_peered":"2023-10-09T11:36:03.069521+0000","last_clean":"2023-10-09T11:36:03.069521+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:03.069521+0000","last_undegraded":"2023-10-09T11:36:03.069521+0000","last_fullsized":"2023-10-09T11:36:03.069521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065085+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069505+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:03.069505+0000","last_peered":"2023-10-09T11:36:03.069505+0000","last_clean":"2023-10-09T11:36:03.069505+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:03.069505+0000","last_undegraded":"2023-10-09T11:36:03.069505+0000","last_fullsized":"2023-10-09T11:36:03.069505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063282+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.066236+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:03.066236+0000","last_peered":"2023-10-09T11:36:03.066236+0000","last_clean":"2023-10-09T11:36:03.066236+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:03.066236+0000","last_undegraded":"2023-10-09T11:36:03.066236+0000","last_fullsized":"2023-10-09T11:36:03.066236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067516+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065132+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062475+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068868+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068816+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070319+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072967+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065496+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064301+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069199+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064930+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066933+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066155+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:08.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:08.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.720+0000 7f4bb9336700 1 Processor -- start 2023-10-09T11:36:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.720+0000 7f4bb9336700 1 -- start start 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb9336700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb9336700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb40d07c0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb9336700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb40cfbb0 con 0x7f4bb406d120 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb9336700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40cfe90 con 0x7f4bb41578d0 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4bb4157ca0 0x7f4bb415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51570/0 (socket says 172.21.15.6:51570) 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb27fc700 1 -- 172.21.15.6:0/1969012062 learned_addr learned my addr 172.21.15.6:0/1969012062 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb2ffd700 1 --2- 172.21.15.6:0/1969012062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb1ffb700 1 -- 172.21.15.6:0/1969012062 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243671089 0 0) 0x7f4bb40d07c0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb2ffd700 1 -- 172.21.15.6:0/1969012062 >> v1:172.21.15.118:6789/0 conn(0x7f4bb406d120 legacy=0x7f4bb415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb2ffd700 1 -- 172.21.15.6:0/1969012062 >> v1:172.21.15.6:6789/0 conn(0x7f4bb4157ca0 legacy=0x7f4bb415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb2ffd700 1 -- 172.21.15.6:0/1969012062 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40d0170 con 0x7f4bb41578d0 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.721+0000 7f4bb2ffd700 1 --2- 172.21.15.6:0/1969012062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb40cf4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e10 tx=0x7f4ba4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73bc5a6dd6ba2cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb1ffb700 1 -- 172.21.15.6:0/1969012062 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x7f4bb41578d0 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb1ffb700 1 -- 172.21.15.6:0/1969012062 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400bbb0 con 0x7f4bb41578d0 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb1ffb700 1 -- 172.21.15.6:0/1969012062 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4012430 con 0x7f4bb41578d0 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 -- 172.21.15.6:0/1969012062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 msgr2=0x7f4bb40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 --2- 172.21.15.6:0/1969012062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb40cf4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e10 tx=0x7f4ba4009780 comp rx=0 tx=0).stop 2023-10-09T11:36:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 -- 172.21.15.6:0/1969012062 shutdown_connections 2023-10-09T11:36:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 --2- 172.21.15.6:0/1969012062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb40cf4f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 -- 172.21.15.6:0/1969012062 >> 172.21.15.6:0/1969012062 conn(0x7f4bb406bb90 msgr2=0x7f4bb406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 -- 172.21.15.6:0/1969012062 shutdown_connections 2023-10-09T11:36:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.722+0000 7f4bb9336700 1 -- 172.21.15.6:0/1969012062 wait complete. 2023-10-09T11:36:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.723+0000 7f4bb9336700 1 Processor -- start 2023-10-09T11:36:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.723+0000 7f4bb9336700 1 -- start start 2023-10-09T11:36:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb406d120 0x7f4bb40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb4068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb406a350 con 0x7f4bb4157ca0 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40cb080 con 0x7f4bb406d120 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb9336700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40c5bc0 con 0x7f4bb41578d0 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50092/0 (socket says 172.21.15.6:50092) 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb37fe700 1 -- 172.21.15.6:0/385123086 learned_addr learned my addr 172.21.15.6:0/385123086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb2ffd700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb406d120 0x7f4bb40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.724+0000 7f4bb27fc700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb4068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 -- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 msgr2=0x7f4bb4068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb4068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 -- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb406d120 msgr2=0x7f4bb40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb406d120 0x7f4bb40cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 -- 172.21.15.6:0/385123086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009a20 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb37fe700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c810 tx=0x7f4bac007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac011590 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac011710 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb40c6180 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac011ad0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.725+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb40c6740 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.726+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb4067ac0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.726+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bac01b3b0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.727+0000 7f4baaffd700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 0x7f4b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.727+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bac083a80 con 0x7f4bb4157ca0 2023-10-09T11:36:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.727+0000 7f4bb2ffd700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 0x7f4b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.727+0000 7f4bb2ffd700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 0x7f4b940693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40097c0 tx=0x7f4ba4018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.731+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bac050cf0 con 0x7f4bb4157ca0 2023-10-09T11:36:08.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.918+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bb40d0450 con 0x7f4b94066f30 2023-10-09T11:36:08.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.926+0000 7f4baaffd700 1 -- 172.21.15.6:0/385123086 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257303 (secure 0 0 0) 0x7f4bb40d0450 con 0x7f4b94066f30 2023-10-09T11:36:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 msgr2=0x7f4b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 0x7f4b940693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40097c0 tx=0x7f4ba4018000 comp rx=0 tx=0).stop 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 msgr2=0x7f4bb40c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c810 tx=0x7f4bac007e60 comp rx=0 tx=0).stop 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 shutdown_connections 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b94066f30 0x7f4b940693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4157ca0 0x7f4bb40c8b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb406d120 0x7f4bb40cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 --2- 172.21.15.6:0/385123086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bb41578d0 0x7f4bb4068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 >> 172.21.15.6:0/385123086 conn(0x7f4bb406bb90 msgr2=0x7f4bb41559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 shutdown_connections 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:08.929+0000 7f4bb9336700 1 -- 172.21.15.6:0/385123086 wait complete. 2023-10-09T11:36:08.933 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:08.942 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T11:36:08.148039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1551,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560948,"statfs":{"total":1600000000,"available":1598410835,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001074"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067592+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070708+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070047+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064769+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067818+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066393+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067730+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069945+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072104+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068003+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.073743+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062261+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:37.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069561+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069557+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071589+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066001+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065329+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064911+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071719+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074646+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:03.074646+0000","last_peered":"2023-10-09T11:36:03.074646+0000","last_clean":"2023-10-09T11:36:03.074646+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:03.074646+0000","last_undegraded":"2023-10-09T11:36:03.074646+0000","last_fullsized":"2023-10-09T11:36:03.074646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066130+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071936+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:03.071936+0000","last_peered":"2023-10-09T11:36:03.071936+0000","last_clean":"2023-10-09T11:36:03.071936+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:03.071936+0000","last_undegraded":"2023-10-09T11:36:03.071936+0000","last_fullsized":"2023-10-09T11:36:03.071936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069653+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076134+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:03.076134+0000","last_peered":"2023-10-09T11:36:03.076134+0000","last_clean":"2023-10-09T11:36:03.076134+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:03.076134+0000","last_undegraded":"2023-10-09T11:36:03.076134+0000","last_fullsized":"2023-10-09T11:36:03.076134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062780+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072573+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:03.072573+0000","last_peered":"2023-10-09T11:36:03.072573+0000","last_clean":"2023-10-09T11:36:03.072573+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:03.072573+0000","last_undegraded":"2023-10-09T11:36:03.072573+0000","last_fullsized":"2023-10-09T11:36:03.072573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062038+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072466+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:03.072466+0000","last_peered":"2023-10-09T11:36:03.072466+0000","last_clean":"2023-10-09T11:36:03.072466+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:03.072466+0000","last_undegraded":"2023-10-09T11:36:03.072466+0000","last_fullsized":"2023-10-09T11:36:03.072466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063539+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074738+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:03.074738+0000","last_peered":"2023-10-09T11:36:03.074738+0000","last_clean":"2023-10-09T11:36:03.074738+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:03.074738+0000","last_undegraded":"2023-10-09T11:36:03.074738+0000","last_fullsized":"2023-10-09T11:36:03.074738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065759+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076801+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:03.076801+0000","last_peered":"2023-10-09T11:36:03.076801+0000","last_clean":"2023-10-09T11:36:03.076801+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:03.076801+0000","last_undegraded":"2023-10-09T11:36:03.076801+0000","last_fullsized":"2023-10-09T11:36:03.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065051+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068534+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:03.068534+0000","last_peered":"2023-10-09T11:36:03.068534+0000","last_clean":"2023-10-09T11:36:03.068534+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:03.068534+0000","last_undegraded":"2023-10-09T11:36:03.068534+0000","last_fullsized":"2023-10-09T11:36:03.068534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069966+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.077021+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:03.077021+0000","last_peered":"2023-10-09T11:36:03.077021+0000","last_clean":"2023-10-09T11:36:03.077021+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:03.077021+0000","last_undegraded":"2023-10-09T11:36:03.077021+0000","last_fullsized":"2023-10-09T11:36:03.077021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063640+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075059+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:03.075059+0000","last_peered":"2023-10-09T11:36:03.075059+0000","last_clean":"2023-10-09T11:36:03.075059+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:03.075059+0000","last_undegraded":"2023-10-09T11:36:03.075059+0000","last_fullsized":"2023-10-09T11:36:03.075059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066485+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071834+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:03.071834+0000","last_peered":"2023-10-09T11:36:03.071834+0000","last_clean":"2023-10-09T11:36:03.071834+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:03.071834+0000","last_undegraded":"2023-10-09T11:36:03.071834+0000","last_fullsized":"2023-10-09T11:36:03.071834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062185+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:12.099345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073913+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:03.073913+0000","last_peered":"2023-10-09T11:36:03.073913+0000","last_clean":"2023-10-09T11:36:03.073913+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:03.073913+0000","last_undegraded":"2023-10-09T11:36:03.073913+0000","last_fullsized":"2023-10-09T11:36:03.073913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068099+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069288+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:03.069288+0000","last_peered":"2023-10-09T11:36:03.069288+0000","last_clean":"2023-10-09T11:36:03.069288+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:03.069288+0000","last_undegraded":"2023-10-09T11:36:03.069288+0000","last_fullsized":"2023-10-09T11:36:03.069288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066050+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070071+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:03.070071+0000","last_peered":"2023-10-09T11:36:03.070071+0000","last_clean":"2023-10-09T11:36:03.070071+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:03.070071+0000","last_undegraded":"2023-10-09T11:36:03.070071+0000","last_fullsized":"2023-10-09T11:36:03.070071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067378+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074702+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:03.074702+0000","last_peered":"2023-10-09T11:36:03.074702+0000","last_clean":"2023-10-09T11:36:03.074702+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:03.074702+0000","last_undegraded":"2023-10-09T11:36:03.074702+0000","last_fullsized":"2023-10-09T11:36:03.074702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069625+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073149+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:03.073149+0000","last_peered":"2023-10-09T11:36:03.073149+0000","last_clean":"2023-10-09T11:36:03.073149+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:03.073149+0000","last_undegraded":"2023-10-09T11:36:03.073149+0000","last_fullsized":"2023-10-09T11:36:03.073149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066642+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.064500+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:03.064500+0000","last_peered":"2023-10-09T11:36:03.064500+0000","last_clean":"2023-10-09T11:36:03.064500+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:03.064500+0000","last_undegraded":"2023-10-09T11:36:03.064500+0000","last_fullsized":"2023-10-09T11:36:03.064500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065936+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074056+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:03.074056+0000","last_peered":"2023-10-09T11:36:03.074056+0000","last_clean":"2023-10-09T11:36:03.074056+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:03.074056+0000","last_undegraded":"2023-10-09T11:36:03.074056+0000","last_fullsized":"2023-10-09T11:36:03.074056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063904+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070650+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:03.070650+0000","last_peered":"2023-10-09T11:36:03.070650+0000","last_clean":"2023-10-09T11:36:03.070650+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:03.070650+0000","last_undegraded":"2023-10-09T11:36:03.070650+0000","last_fullsized":"2023-10-09T11:36:03.070650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062686+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065297+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068267+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:03.068267+0000","last_peered":"2023-10-09T11:36:03.068267+0000","last_clean":"2023-10-09T11:36:03.068267+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:03.068267+0000","last_undegraded":"2023-10-09T11:36:03.068267+0000","last_fullsized":"2023-10-09T11:36:03.068267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064562+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.063629+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:03.063629+0000","last_peered":"2023-10-09T11:36:03.063629+0000","last_clean":"2023-10-09T11:36:03.063629+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:03.063629+0000","last_undegraded":"2023-10-09T11:36:03.063629+0000","last_fullsized":"2023-10-09T11:36:03.063629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-09T11:36:02.056823+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:02.056823+0000","last_peered":"2023-10-09T11:36:02.056823+0000","last_clean":"2023-10-09T11:36:02.056823+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:02.056823+0000","last_undegraded":"2023-10-09T11:36:02.056823+0000","last_fullsized":"2023-10-09T11:36:02.056823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067509+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072868+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:03.072868+0000","last_peered":"2023-10-09T11:36:03.072868+0000","last_clean":"2023-10-09T11:36:03.072868+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:03.072868+0000","last_undegraded":"2023-10-09T11:36:03.072868+0000","last_fullsized":"2023-10-09T11:36:03.072868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073553+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:03.073553+0000","last_peered":"2023-10-09T11:36:03.073553+0000","last_clean":"2023-10-09T11:36:03.073553+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:03.073553+0000","last_undegraded":"2023-10-09T11:36:03.073553+0000","last_fullsized":"2023-10-09T11:36:03.073553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066226+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075260+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:03.075260+0000","last_peered":"2023-10-09T11:36:03.075260+0000","last_clean":"2023-10-09T11:36:03.075260+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:03.075260+0000","last_undegraded":"2023-10-09T11:36:03.075260+0000","last_fullsized":"2023-10-09T11:36:03.075260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064996+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074849+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:03.074849+0000","last_peered":"2023-10-09T11:36:03.074849+0000","last_clean":"2023-10-09T11:36:03.074849+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:03.074849+0000","last_undegraded":"2023-10-09T11:36:03.074849+0000","last_fullsized":"2023-10-09T11:36:03.074849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067886+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070871+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:03.070871+0000","last_peered":"2023-10-09T11:36:03.070871+0000","last_clean":"2023-10-09T11:36:03.070871+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:03.070871+0000","last_undegraded":"2023-10-09T11:36:03.070871+0000","last_fullsized":"2023-10-09T11:36:03.070871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063131+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068307+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:03.068307+0000","last_peered":"2023-10-09T11:36:03.068307+0000","last_clean":"2023-10-09T11:36:03.068307+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:03.068307+0000","last_undegraded":"2023-10-09T11:36:03.068307+0000","last_fullsized":"2023-10-09T11:36:03.068307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064284+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073134+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:03.073134+0000","last_peered":"2023-10-09T11:36:03.073134+0000","last_clean":"2023-10-09T11:36:03.073134+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:03.073134+0000","last_undegraded":"2023-10-09T11:36:03.073134+0000","last_fullsized":"2023-10-09T11:36:03.073134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068964+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:03.068964+0000","last_peered":"2023-10-09T11:36:03.068964+0000","last_clean":"2023-10-09T11:36:03.068964+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:03.068964+0000","last_undegraded":"2023-10-09T11:36:03.068964+0000","last_fullsized":"2023-10-09T11:36:03.068964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066222+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069521+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:03.069521+0000","last_peered":"2023-10-09T11:36:03.069521+0000","last_clean":"2023-10-09T11:36:03.069521+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:03.069521+0000","last_undegraded":"2023-10-09T11:36:03.069521+0000","last_fullsized":"2023-10-09T11:36:03.069521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065085+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069505+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:03.069505+0000","last_peered":"2023-10-09T11:36:03.069505+0000","last_clean":"2023-10-09T11:36:03.069505+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:03.069505+0000","last_undegraded":"2023-10-09T11:36:03.069505+0000","last_fullsized":"2023-10-09T11:36:03.069505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063282+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.066236+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:03.066236+0000","last_peered":"2023-10-09T11:36:03.066236+0000","last_clean":"2023-10-09T11:36:03.066236+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:03.066236+0000","last_undegraded":"2023-10-09T11:36:03.066236+0000","last_fullsized":"2023-10-09T11:36:03.066236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067516+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065132+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062475+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068868+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068816+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070319+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072967+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065496+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064301+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069199+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064930+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066933+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066155+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:08.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067592+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.070708+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.070047+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064769+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067818+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066393+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067730+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069945+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-09T11:36:08.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.072104+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.068003+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.073743+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062261+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:15:37.210244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069561+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-09T11:36:08.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069557+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.071589+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066001+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065329+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064911+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-09T11:36:08.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.071719+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066130+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069653+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062780+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062038+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.063539+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065759+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065051+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069966+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-09T11:36:08.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.063640+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066485+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062185+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:07:12.099345+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.068099+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066050+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067378+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069625+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066642+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065936+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.063904+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062686+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065297+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-09T11:36:08.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064562+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067509+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066226+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064996+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067886+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.063131+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064284+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064289+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066222+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-09T11:36:08.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065085+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.063282+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.071289+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.067516+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065132+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:36:08.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.062475+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.068868+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.068816+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.070319+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-09T11:36:08.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.072967+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.065496+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064301+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.069199+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.064930+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:36:08.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-09T11:36:08.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066933+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:36:08.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-09T11:36:08.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:36:03.055104+0000', 'last_change': '2023-10-09T11:36:03.066155+0000', 'last_active': '2023-10-09T11:36:03.055104+0000', 'last_peered': '2023-10-09T11:36:03.055104+0000', 'last_clean': '2023-10-09T11:36:03.055104+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:36:03.055104+0000', 'last_undegraded': '2023-10-09T11:36:03.055104+0000', 'last_fullsized': '2023-10-09T11:36:03.055104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'last_clean_scrub_stamp': '2023-10-09T11:36:03.055104+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:36:08.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:36:09.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 Processor -- start 2023-10-09T11:36:09.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 -- start start 2023-10-09T11:36:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c1577e0 0x7f2e5c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2e5c157bb0 0x7f2e5c0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0cfdd0 con 0x7f2e5c06d240 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0d00b0 con 0x7f2e5c1577e0 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.099+0000 7f2e612e8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0d0390 con 0x7f2e5c157bb0 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c1577e0 0x7f2e5c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c1577e0 0x7f2e5c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50098/0 (socket says 172.21.15.6:50098) 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 -- 172.21.15.6:0/985188952 learned_addr learned my addr 172.21.15.6:0/985188952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5a7fc700 1 --2- 172.21.15.6:0/985188952 >> v2:172.21.15.118:3300/0 conn(0x7f2e5c157bb0 0x7f2e5c0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 -- 172.21.15.6:0/985188952 >> v2:172.21.15.118:3300/0 conn(0x7f2e5c157bb0 msgr2=0x7f2e5c0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 --2- 172.21.15.6:0/985188952 >> v2:172.21.15.118:3300/0 conn(0x7f2e5c157bb0 0x7f2e5c0cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 -- 172.21.15.6:0/985188952 >> v1:172.21.15.118:6789/0 conn(0x7f2e5c06d240 legacy=0x7f2e5c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 -- 172.21.15.6:0/985188952 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c0d0670 con 0x7f2e5c1577e0 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e5affd700 1 --2- 172.21.15.6:0/985188952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c15b070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b6e70 tx=0x7f2e4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f525d26337a0269 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e59ffb700 1 -- 172.21.15.6:0/985188952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e070 con 0x7f2e5c1577e0 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e59ffb700 1 -- 172.21.15.6:0/985188952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00ba20 con 0x7f2e5c1577e0 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.100+0000 7f2e59ffb700 1 -- 172.21.15.6:0/985188952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0092e0 con 0x7f2e5c1577e0 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 -- 172.21.15.6:0/985188952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c1577e0 msgr2=0x7f2e5c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 --2- 172.21.15.6:0/985188952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c15b070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b6e70 tx=0x7f2e4c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 -- 172.21.15.6:0/985188952 shutdown_connections 2023-10-09T11:36:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 --2- 172.21.15.6:0/985188952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c15b070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 --2- 172.21.15.6:0/985188952 >> v2:172.21.15.118:3300/0 conn(0x7f2e5c157bb0 0x7f2e5c0cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 -- 172.21.15.6:0/985188952 >> 172.21.15.6:0/985188952 conn(0x7f2e5c06bb90 msgr2=0x7f2e5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 -- 172.21.15.6:0/985188952 shutdown_connections 2023-10-09T11:36:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.101+0000 7f2e612e8700 1 -- 172.21.15.6:0/985188952 wait complete. 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.102+0000 7f2e612e8700 1 Processor -- start 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.102+0000 7f2e612e8700 1 -- start start 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e5c06d240 0x7f2e5c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c15f600 con 0x7f2e5c157bb0 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c15e620 con 0x7f2e5c1577e0 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e612e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c15da10 con 0x7f2e5c06d240 2023-10-09T11:36:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50104/0 (socket says 172.21.15.6:50104) 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 -- 172.21.15.6:0/4172332892 learned_addr learned my addr 172.21.15.6:0/4172332892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5a7fc700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5affd700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e5c06d240 0x7f2e5c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 -- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e5c06d240 msgr2=0x7f2e5c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e5c06d240 0x7f2e5c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 -- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e5c1577e0 msgr2=0x7f2e5c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 -- 172.21.15.6:0/4172332892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009ae0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.103+0000 7f2e5b7fe700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c560 tx=0x7f2e54007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54011590 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e540116f0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c15dcf0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54011ab0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c15e2b0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.104+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c067850 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.105+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e5401b3b0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.105+0000 7f2e52ffd700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 0x7f2e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.106+0000 7f2e5affd700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 0x7f2e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.106+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e540838f0 con 0x7f2e5c157bb0 2023-10-09T11:36:09.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.106+0000 7f2e5affd700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 0x7f2e3c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009880 tx=0x7f2e4c018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.110+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e54050b60 con 0x7f2e5c157bb0 2023-10-09T11:36:09.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.385+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2e5c0cfa50 con 0x7f2e5c157bb0 2023-10-09T11:36:09.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.385+0000 7f2e52ffd700 1 -- 172.21.15.6:0/4172332892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1027 (secure 0 0 0) 0x7f2e54017020 con 0x7f2e5c157bb0 2023-10-09T11:36:09.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:09.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851351,"num_in_osds":8,"osd_in_since":1696851348,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1589165,"bytes_avail":1598410835,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4266}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-09T11:35:46.108374+0000","services":{}},"progress_events":{}} 2023-10-09T11:36:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 msgr2=0x7f2e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 0x7f2e3c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009880 tx=0x7f2e4c018000 comp rx=0 tx=0).stop 2023-10-09T11:36:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 msgr2=0x7f2e5c0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c560 tx=0x7f2e54007ef0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 shutdown_connections 2023-10-09T11:36:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e3c066f30 0x7f2e3c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c157bb0 0x7f2e5c0c76f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e5c06d240 0x7f2e5c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 --2- 172.21.15.6:0/4172332892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e5c1577e0 0x7f2e5c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.387+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 >> 172.21.15.6:0/4172332892 conn(0x7f2e5c06bb90 msgr2=0x7f2e5c156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.388+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 shutdown_connections 2023-10-09T11:36:09.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.388+0000 7f2e612e8700 1 -- 172.21.15.6:0/4172332892 wait complete. 2023-10-09T11:36:09.401 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:36:09.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.518+0000 7f64c0867700 1 Processor -- start 2023-10-09T11:36:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.518+0000 7f64c0867700 1 -- start start 2023-10-09T11:36:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64c0867700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64bc159b40 0x7f64bc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64c0867700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64c0867700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0cee10 con 0x7f64bc0ccb40 2023-10-09T11:36:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64c0867700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0cd040 con 0x7f64bc159b40 2023-10-09T11:36:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64c0867700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc0cd320 con 0x7f64bc159f10 2023-10-09T11:36:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64bc159b40 0x7f64bc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64bc159b40 0x7f64bc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50106/0 (socket says 172.21.15.6:50106) 2023-10-09T11:36:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 -- 172.21.15.6:0/2614063449 learned_addr learned my addr 172.21.15.6:0/2614063449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64ba59c700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 -- 172.21.15.6:0/2614063449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 msgr2=0x7f64bc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 -- 172.21.15.6:0/2614063449 >> v1:172.21.15.118:6789/0 conn(0x7f64bc0ccb40 legacy=0x7f64bc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.519+0000 7f64bad9d700 1 -- 172.21.15.6:0/2614063449 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0ce7c0 con 0x7f64bc159b40 2023-10-09T11:36:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64bad9d700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc159b40 0x7f64bc0cc600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0099b0 tx=0x7f64ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456f6f91984f0261 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64b9d9b700 1 -- 172.21.15.6:0/2614063449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00b860 con 0x7f64bc159b40 2023-10-09T11:36:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64b9d9b700 1 -- 172.21.15.6:0/2614063449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00b9c0 con 0x7f64bc159b40 2023-10-09T11:36:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64b9d9b700 1 -- 172.21.15.6:0/2614063449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00bd60 con 0x7f64bc159b40 2023-10-09T11:36:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 -- 172.21.15.6:0/2614063449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc159b40 msgr2=0x7f64bc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc159b40 0x7f64bc0cc600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0099b0 tx=0x7f64ac009250 comp rx=0 tx=0).stop 2023-10-09T11:36:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 -- 172.21.15.6:0/2614063449 shutdown_connections 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc159b40 0x7f64bc0cc600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 --2- 172.21.15.6:0/2614063449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 -- 172.21.15.6:0/2614063449 >> 172.21.15.6:0/2614063449 conn(0x7f64bc0cd660 msgr2=0x7f64bc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 -- 172.21.15.6:0/2614063449 shutdown_connections 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.520+0000 7f64c0867700 1 -- 172.21.15.6:0/2614063449 wait complete. 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.521+0000 7f64c0867700 1 Processor -- start 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 -- start start 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64bc159b40 0x7f64bc157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc158c90 con 0x7f64bc0ccb40 2023-10-09T11:36:09.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1583f0 con 0x7f64bc159b40 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64c0867700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1586d0 con 0x7f64bc159f10 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64bad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64bad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50110/0 (socket says 172.21.15.6:50110) 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64bad9d700 1 -- 172.21.15.6:0/710103170 learned_addr learned my addr 172.21.15.6:0/710103170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64ba59c700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64bc159b40 0x7f64bc157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.522+0000 7f64bb59e700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 -- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 msgr2=0x7f64bc0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 -- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64bc159b40 msgr2=0x7f64bc157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64bc159b40 0x7f64bc157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 -- 172.21.15.6:0/710103170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0094f0 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64bad9d700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f64bc06fe10 tx=0x7f64ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac011e40 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac024440 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac024800 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc1589b0 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.523+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc158100 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.524+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc0cb910 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.524+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64ac01a420 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.525+0000 7f64b2ffd700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 0x7f649c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.525+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64ac086410 con 0x7f64bc0ccb40 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.525+0000 7f64ba59c700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 0x7f649c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.525+0000 7f64ba59c700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 0x7f649c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0c6030 tx=0x7f64a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.529+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64ac053680 con 0x7f64bc0ccb40 2023-10-09T11:36:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.718+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64bc0ceaa0 con 0x7f649c066f30 2023-10-09T11:36:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.725+0000 7f64b2ffd700 1 -- 172.21.15.6:0/710103170 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257303 (secure 0 0 0) 0x7f64bc0ceaa0 con 0x7f649c066f30 2023-10-09T11:36:09.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 msgr2=0x7f649c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 0x7f649c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0c6030 tx=0x7f64a4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 msgr2=0x7f64bc0ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f64bc06fe10 tx=0x7f64ac017000 comp rx=0 tx=0).stop 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 shutdown_connections 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f649c066f30 0x7f649c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64bc159f10 0x7f64bc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64bc0ccb40 0x7f64bc0ca420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 --2- 172.21.15.6:0/710103170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64bc159b40 0x7f64bc157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 >> 172.21.15.6:0/710103170 conn(0x7f64bc0cd660 msgr2=0x7f64bc0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 shutdown_connections 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:09.728+0000 7f64c0867700 1 -- 172.21.15.6:0/710103170 wait complete. 2023-10-09T11:36:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:09.742 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T11:36:08.148039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1551,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560948,"statfs":{"total":1600000000,"available":1598410835,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001074"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067592+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070708+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070047+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064769+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067818+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066393+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067730+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069945+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072104+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068003+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.073743+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062261+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:37.210244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069561+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069557+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071589+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066001+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065329+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064911+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071719+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074646+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:03.074646+0000","last_peered":"2023-10-09T11:36:03.074646+0000","last_clean":"2023-10-09T11:36:03.074646+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:03.074646+0000","last_undegraded":"2023-10-09T11:36:03.074646+0000","last_fullsized":"2023-10-09T11:36:03.074646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066130+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071936+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:03.071936+0000","last_peered":"2023-10-09T11:36:03.071936+0000","last_clean":"2023-10-09T11:36:03.071936+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:03.071936+0000","last_undegraded":"2023-10-09T11:36:03.071936+0000","last_fullsized":"2023-10-09T11:36:03.071936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069653+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076134+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:03.076134+0000","last_peered":"2023-10-09T11:36:03.076134+0000","last_clean":"2023-10-09T11:36:03.076134+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:03.076134+0000","last_undegraded":"2023-10-09T11:36:03.076134+0000","last_fullsized":"2023-10-09T11:36:03.076134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062780+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072573+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:03.072573+0000","last_peered":"2023-10-09T11:36:03.072573+0000","last_clean":"2023-10-09T11:36:03.072573+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:03.072573+0000","last_undegraded":"2023-10-09T11:36:03.072573+0000","last_fullsized":"2023-10-09T11:36:03.072573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062038+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072466+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:03.072466+0000","last_peered":"2023-10-09T11:36:03.072466+0000","last_clean":"2023-10-09T11:36:03.072466+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:03.072466+0000","last_undegraded":"2023-10-09T11:36:03.072466+0000","last_fullsized":"2023-10-09T11:36:03.072466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063539+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074738+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:03.074738+0000","last_peered":"2023-10-09T11:36:03.074738+0000","last_clean":"2023-10-09T11:36:03.074738+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:03.074738+0000","last_undegraded":"2023-10-09T11:36:03.074738+0000","last_fullsized":"2023-10-09T11:36:03.074738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065759+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.076801+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:03.076801+0000","last_peered":"2023-10-09T11:36:03.076801+0000","last_clean":"2023-10-09T11:36:03.076801+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:03.076801+0000","last_undegraded":"2023-10-09T11:36:03.076801+0000","last_fullsized":"2023-10-09T11:36:03.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065051+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068534+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:03.068534+0000","last_peered":"2023-10-09T11:36:03.068534+0000","last_clean":"2023-10-09T11:36:03.068534+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:03.068534+0000","last_undegraded":"2023-10-09T11:36:03.068534+0000","last_fullsized":"2023-10-09T11:36:03.068534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069966+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.077021+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:03.077021+0000","last_peered":"2023-10-09T11:36:03.077021+0000","last_clean":"2023-10-09T11:36:03.077021+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:03.077021+0000","last_undegraded":"2023-10-09T11:36:03.077021+0000","last_fullsized":"2023-10-09T11:36:03.077021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063640+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075059+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:03.075059+0000","last_peered":"2023-10-09T11:36:03.075059+0000","last_clean":"2023-10-09T11:36:03.075059+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:03.075059+0000","last_undegraded":"2023-10-09T11:36:03.075059+0000","last_fullsized":"2023-10-09T11:36:03.075059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066485+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:04.737257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.071834+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:03.071834+0000","last_peered":"2023-10-09T11:36:03.071834+0000","last_clean":"2023-10-09T11:36:03.071834+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:03.071834+0000","last_undegraded":"2023-10-09T11:36:03.071834+0000","last_fullsized":"2023-10-09T11:36:03.071834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062185+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:12.099345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073913+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:03.073913+0000","last_peered":"2023-10-09T11:36:03.073913+0000","last_clean":"2023-10-09T11:36:03.073913+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:03.073913+0000","last_undegraded":"2023-10-09T11:36:03.073913+0000","last_fullsized":"2023-10-09T11:36:03.073913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068099+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069288+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:03.069288+0000","last_peered":"2023-10-09T11:36:03.069288+0000","last_clean":"2023-10-09T11:36:03.069288+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:03.069288+0000","last_undegraded":"2023-10-09T11:36:03.069288+0000","last_fullsized":"2023-10-09T11:36:03.069288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066050+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070071+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:03.070071+0000","last_peered":"2023-10-09T11:36:03.070071+0000","last_clean":"2023-10-09T11:36:03.070071+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:03.070071+0000","last_undegraded":"2023-10-09T11:36:03.070071+0000","last_fullsized":"2023-10-09T11:36:03.070071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067378+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074702+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:03.074702+0000","last_peered":"2023-10-09T11:36:03.074702+0000","last_clean":"2023-10-09T11:36:03.074702+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:03.074702+0000","last_undegraded":"2023-10-09T11:36:03.074702+0000","last_fullsized":"2023-10-09T11:36:03.074702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069625+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073149+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:03.073149+0000","last_peered":"2023-10-09T11:36:03.073149+0000","last_clean":"2023-10-09T11:36:03.073149+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:03.073149+0000","last_undegraded":"2023-10-09T11:36:03.073149+0000","last_fullsized":"2023-10-09T11:36:03.073149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066642+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.064500+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:03.064500+0000","last_peered":"2023-10-09T11:36:03.064500+0000","last_clean":"2023-10-09T11:36:03.064500+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:03.064500+0000","last_undegraded":"2023-10-09T11:36:03.064500+0000","last_fullsized":"2023-10-09T11:36:03.064500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065936+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074056+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:03.074056+0000","last_peered":"2023-10-09T11:36:03.074056+0000","last_clean":"2023-10-09T11:36:03.074056+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:03.074056+0000","last_undegraded":"2023-10-09T11:36:03.074056+0000","last_fullsized":"2023-10-09T11:36:03.074056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063904+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070650+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:03.070650+0000","last_peered":"2023-10-09T11:36:03.070650+0000","last_clean":"2023-10-09T11:36:03.070650+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:03.070650+0000","last_undegraded":"2023-10-09T11:36:03.070650+0000","last_fullsized":"2023-10-09T11:36:03.070650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062686+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:41.342629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065297+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068267+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:03.068267+0000","last_peered":"2023-10-09T11:36:03.068267+0000","last_clean":"2023-10-09T11:36:03.068267+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:03.068267+0000","last_undegraded":"2023-10-09T11:36:03.068267+0000","last_fullsized":"2023-10-09T11:36:03.068267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064562+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.063629+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:03.063629+0000","last_peered":"2023-10-09T11:36:03.063629+0000","last_clean":"2023-10-09T11:36:03.063629+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:03.063629+0000","last_undegraded":"2023-10-09T11:36:03.063629+0000","last_fullsized":"2023-10-09T11:36:03.063629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-09T11:36:02.056823+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:02.056823+0000","last_peered":"2023-10-09T11:36:02.056823+0000","last_clean":"2023-10-09T11:36:02.056823+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:02.056823+0000","last_undegraded":"2023-10-09T11:36:02.056823+0000","last_fullsized":"2023-10-09T11:36:02.056823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067509+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.072868+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:03.072868+0000","last_peered":"2023-10-09T11:36:03.072868+0000","last_clean":"2023-10-09T11:36:03.072868+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:03.072868+0000","last_undegraded":"2023-10-09T11:36:03.072868+0000","last_fullsized":"2023-10-09T11:36:03.072868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073553+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:03.073553+0000","last_peered":"2023-10-09T11:36:03.073553+0000","last_clean":"2023-10-09T11:36:03.073553+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:03.073553+0000","last_undegraded":"2023-10-09T11:36:03.073553+0000","last_fullsized":"2023-10-09T11:36:03.073553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066226+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.075260+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:03.075260+0000","last_peered":"2023-10-09T11:36:03.075260+0000","last_clean":"2023-10-09T11:36:03.075260+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:03.075260+0000","last_undegraded":"2023-10-09T11:36:03.075260+0000","last_fullsized":"2023-10-09T11:36:03.075260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064996+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.074849+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:03.074849+0000","last_peered":"2023-10-09T11:36:03.074849+0000","last_clean":"2023-10-09T11:36:03.074849+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:03.074849+0000","last_undegraded":"2023-10-09T11:36:03.074849+0000","last_fullsized":"2023-10-09T11:36:03.074849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067886+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.070871+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:03.070871+0000","last_peered":"2023-10-09T11:36:03.070871+0000","last_clean":"2023-10-09T11:36:03.070871+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:03.070871+0000","last_undegraded":"2023-10-09T11:36:03.070871+0000","last_fullsized":"2023-10-09T11:36:03.070871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063131+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:08.431200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068307+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:03.068307+0000","last_peered":"2023-10-09T11:36:03.068307+0000","last_clean":"2023-10-09T11:36:03.068307+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:03.068307+0000","last_undegraded":"2023-10-09T11:36:03.068307+0000","last_fullsized":"2023-10-09T11:36:03.068307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064284+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.073134+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:03.073134+0000","last_peered":"2023-10-09T11:36:03.073134+0000","last_clean":"2023-10-09T11:36:03.073134+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:03.073134+0000","last_undegraded":"2023-10-09T11:36:03.073134+0000","last_fullsized":"2023-10-09T11:36:03.073134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.068964+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:03.068964+0000","last_peered":"2023-10-09T11:36:03.068964+0000","last_clean":"2023-10-09T11:36:03.068964+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:03.068964+0000","last_undegraded":"2023-10-09T11:36:03.068964+0000","last_fullsized":"2023-10-09T11:36:03.068964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066222+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069521+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:03.069521+0000","last_peered":"2023-10-09T11:36:03.069521+0000","last_clean":"2023-10-09T11:36:03.069521+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:03.069521+0000","last_undegraded":"2023-10-09T11:36:03.069521+0000","last_fullsized":"2023-10-09T11:36:03.069521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065085+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.069505+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:03.069505+0000","last_peered":"2023-10-09T11:36:03.069505+0000","last_clean":"2023-10-09T11:36:03.069505+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:03.069505+0000","last_undegraded":"2023-10-09T11:36:03.069505+0000","last_fullsized":"2023-10-09T11:36:03.069505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.063282+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-09T11:36:03.066236+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:03.066236+0000","last_peered":"2023-10-09T11:36:03.066236+0000","last_clean":"2023-10-09T11:36:03.066236+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:03.066236+0000","last_undegraded":"2023-10-09T11:36:03.066236+0000","last_fullsized":"2023-10-09T11:36:03.066236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.071289+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.067516+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:17.377017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065132+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.062475+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068868+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.068816+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.070319+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.072967+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.065496+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064301+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.069199+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.064930+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066933+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:03.055104+0000","last_change":"2023-10-09T11:36:03.066155+0000","last_active":"2023-10-09T11:36:03.055104+0000","last_peered":"2023-10-09T11:36:03.055104+0000","last_clean":"2023-10-09T11:36:03.055104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:03.055104+0000","last_undegraded":"2023-10-09T11:36:03.055104+0000","last_fullsized":"2023-10-09T11:36:03.055104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:12.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.879+0000 7f920a86d700 1 Processor -- start 2023-10-09T11:36:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.879+0000 7f920a86d700 1 -- start start 2023-10-09T11:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f920a86d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92041578d0 0x7f92040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f920a86d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f920415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f920a86d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92040d07c0 con 0x7f920406d120 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f920a86d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92040cfbb0 con 0x7f92041578d0 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f920a86d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92040cfe90 con 0x7f9204157ca0 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92041578d0 0x7f92040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92041578d0 0x7f92040cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50112/0 (socket says 172.21.15.6:50112) 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 -- 172.21.15.6:0/2558451706 learned_addr learned my addr 172.21.15.6:0/2558451706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f92037fe700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f920415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 -- 172.21.15.6:0/2558451706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 msgr2=0x7f920415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f920415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 -- 172.21.15.6:0/2558451706 >> v1:172.21.15.118:6789/0 conn(0x7f920406d120 legacy=0x7f920415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.880+0000 7f9203fff700 1 -- 172.21.15.6:0/2558451706 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040d0170 con 0x7f92041578d0 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f9203fff700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f92040cf4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343ffb78d82e54df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f9202ffd700 1 -- 172.21.15.6:0/2558451706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400b860 con 0x7f92041578d0 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f9202ffd700 1 -- 172.21.15.6:0/2558451706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400b9c0 con 0x7f92041578d0 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f9202ffd700 1 -- 172.21.15.6:0/2558451706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400bd60 con 0x7f92041578d0 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 -- 172.21.15.6:0/2558451706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 msgr2=0x7f92040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f92040cf4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 -- 172.21.15.6:0/2558451706 shutdown_connections 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f92040cf4f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 --2- 172.21.15.6:0/2558451706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f920415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 -- 172.21.15.6:0/2558451706 >> 172.21.15.6:0/2558451706 conn(0x7f920406bb90 msgr2=0x7f920406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:12.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 -- 172.21.15.6:0/2558451706 shutdown_connections 2023-10-09T11:36:12.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.881+0000 7f920a86d700 1 -- 172.21.15.6:0/2558451706 wait complete. 2023-10-09T11:36:12.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.882+0000 7f920a86d700 1 Processor -- start 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 -- start start 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f920406d120 0x7f92040b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f92041534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92040ab9c0 con 0x7f92041578d0 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92040aa890 con 0x7f920406d120 2023-10-09T11:36:12.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f920a86d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92040aae10 con 0x7f9204157ca0 2023-10-09T11:36:12.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f92037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f92037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50126/0 (socket says 172.21.15.6:50126) 2023-10-09T11:36:12.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f92037fe700 1 -- 172.21.15.6:0/2311785916 learned_addr learned my addr 172.21.15.6:0/2311785916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:12.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f9203fff700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f920406d120 0x7f92040b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.883+0000 7f9208e0a700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f92041534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 -- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 msgr2=0x7f92041534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f92041534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 -- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f920406d120 msgr2=0x7f92040b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f920406d120 0x7f92040b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:12.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 -- 172.21.15.6:0/2311785916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40094f0 con 0x7f92041578d0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f92037fe700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91f800d860 tx=0x7f91f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80125f0 con 0x7f92041578d0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8012770 con 0x7f92041578d0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92040b5b00 con 0x7f92041578d0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8012b30 con 0x7f92041578d0 2023-10-09T11:36:12.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.884+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92040ab6e0 con 0x7f92041578d0 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.885+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9204067ac0 con 0x7f92041578d0 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.885+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91f8013480 con 0x7f92041578d0 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.886+0000 7f91ebfff700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 0x7f91f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.886+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91f8084890 con 0x7f92041578d0 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.886+0000 7f9203fff700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 0x7f91f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:12.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.886+0000 7f9203fff700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 0x7f91f00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:12.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:12.890+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91f8051b00 con 0x7f92041578d0 2023-10-09T11:36:13.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.077+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92040d0450 con 0x7f91f0066f30 2023-10-09T11:36:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.085+0000 7f91ebfff700 1 -- 172.21.15.6:0/2311785916 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260147 (secure 0 0 0) 0x7f92040d0450 con 0x7f91f0066f30 2023-10-09T11:36:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 msgr2=0x7f91f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 0x7f91f00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91f40099b0 tx=0x7f91f4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 msgr2=0x7f920415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91f800d860 tx=0x7f91f8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 shutdown_connections 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f91f0066f30 0x7f91f00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9204157ca0 0x7f92041534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f920406d120 0x7f92040b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 --2- 172.21.15.6:0/2311785916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92041578d0 0x7f920415ba60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 >> 172.21.15.6:0/2311785916 conn(0x7f920406bb90 msgr2=0x7f9204155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 shutdown_connections 2023-10-09T11:36:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.088+0000 7f920a86d700 1 -- 172.21.15.6:0/2311785916 wait complete. 2023-10-09T11:36:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:13.102 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-09T11:36:12.149033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.087049"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079635+0000","last_change":"2023-10-09T11:36:04.078956+0000","last_active":"2023-10-09T11:36:04.079635+0000","last_peered":"2023-10-09T11:36:04.079635+0000","last_clean":"2023-10-09T11:36:04.079635+0000","last_became_active":"2023-10-09T11:36:04.078726+0000","last_became_peered":"2023-10-09T11:36:04.078726+0000","last_unstale":"2023-10-09T11:36:04.079635+0000","last_undegraded":"2023-10-09T11:36:04.079635+0000","last_fullsized":"2023-10-09T11:36:04.079635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:23.806661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077801+0000","last_change":"2023-10-09T11:36:04.077746+0000","last_active":"2023-10-09T11:36:04.077801+0000","last_peered":"2023-10-09T11:36:04.077801+0000","last_clean":"2023-10-09T11:36:04.077801+0000","last_became_active":"2023-10-09T11:36:04.077586+0000","last_became_peered":"2023-10-09T11:36:04.077586+0000","last_unstale":"2023-10-09T11:36:04.077801+0000","last_undegraded":"2023-10-09T11:36:04.077801+0000","last_fullsized":"2023-10-09T11:36:04.077801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067923+0000","last_change":"2023-10-09T11:36:04.067868+0000","last_active":"2023-10-09T11:36:04.067923+0000","last_peered":"2023-10-09T11:36:04.067923+0000","last_clean":"2023-10-09T11:36:04.067923+0000","last_became_active":"2023-10-09T11:36:04.067359+0000","last_became_peered":"2023-10-09T11:36:04.067359+0000","last_unstale":"2023-10-09T11:36:04.067923+0000","last_undegraded":"2023-10-09T11:36:04.067923+0000","last_fullsized":"2023-10-09T11:36:04.067923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081543+0000","last_change":"2023-10-09T11:36:04.081241+0000","last_active":"2023-10-09T11:36:04.081543+0000","last_peered":"2023-10-09T11:36:04.081543+0000","last_clean":"2023-10-09T11:36:04.081543+0000","last_became_active":"2023-10-09T11:36:04.080417+0000","last_became_peered":"2023-10-09T11:36:04.080417+0000","last_unstale":"2023-10-09T11:36:04.081543+0000","last_undegraded":"2023-10-09T11:36:04.081543+0000","last_fullsized":"2023-10-09T11:36:04.081543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079612+0000","last_change":"2023-10-09T11:36:04.078524+0000","last_active":"2023-10-09T11:36:04.079612+0000","last_peered":"2023-10-09T11:36:04.079612+0000","last_clean":"2023-10-09T11:36:04.079612+0000","last_became_active":"2023-10-09T11:36:04.078262+0000","last_became_peered":"2023-10-09T11:36:04.078262+0000","last_unstale":"2023-10-09T11:36:04.079612+0000","last_undegraded":"2023-10-09T11:36:04.079612+0000","last_fullsized":"2023-10-09T11:36:04.079612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069441+0000","last_change":"2023-10-09T11:36:04.068963+0000","last_active":"2023-10-09T11:36:04.069441+0000","last_peered":"2023-10-09T11:36:04.069441+0000","last_clean":"2023-10-09T11:36:04.069441+0000","last_became_active":"2023-10-09T11:36:04.068322+0000","last_became_peered":"2023-10-09T11:36:04.068322+0000","last_unstale":"2023-10-09T11:36:04.069441+0000","last_undegraded":"2023-10-09T11:36:04.069441+0000","last_fullsized":"2023-10-09T11:36:04.069441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079107+0000","last_change":"2023-10-09T11:36:04.078377+0000","last_active":"2023-10-09T11:36:04.079107+0000","last_peered":"2023-10-09T11:36:04.079107+0000","last_clean":"2023-10-09T11:36:04.079107+0000","last_became_active":"2023-10-09T11:36:04.077783+0000","last_became_peered":"2023-10-09T11:36:04.077783+0000","last_unstale":"2023-10-09T11:36:04.079107+0000","last_undegraded":"2023-10-09T11:36:04.079107+0000","last_fullsized":"2023-10-09T11:36:04.079107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086953+0000","last_change":"2023-10-09T11:36:04.085234+0000","last_active":"2023-10-09T11:36:04.086953+0000","last_peered":"2023-10-09T11:36:04.086953+0000","last_clean":"2023-10-09T11:36:04.086953+0000","last_became_active":"2023-10-09T11:36:04.081369+0000","last_became_peered":"2023-10-09T11:36:04.081369+0000","last_unstale":"2023-10-09T11:36:04.086953+0000","last_undegraded":"2023-10-09T11:36:04.086953+0000","last_fullsized":"2023-10-09T11:36:04.086953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073597+0000","last_change":"2023-10-09T11:36:04.073032+0000","last_active":"2023-10-09T11:36:04.073597+0000","last_peered":"2023-10-09T11:36:04.073597+0000","last_clean":"2023-10-09T11:36:04.073597+0000","last_became_active":"2023-10-09T11:36:04.072482+0000","last_became_peered":"2023-10-09T11:36:04.072482+0000","last_unstale":"2023-10-09T11:36:04.073597+0000","last_undegraded":"2023-10-09T11:36:04.073597+0000","last_fullsized":"2023-10-09T11:36:04.073597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:57.265856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077089+0000","last_change":"2023-10-09T11:36:04.076990+0000","last_active":"2023-10-09T11:36:04.077089+0000","last_peered":"2023-10-09T11:36:04.077089+0000","last_clean":"2023-10-09T11:36:04.077089+0000","last_became_active":"2023-10-09T11:36:04.076769+0000","last_became_peered":"2023-10-09T11:36:04.076769+0000","last_unstale":"2023-10-09T11:36:04.077089+0000","last_undegraded":"2023-10-09T11:36:04.077089+0000","last_fullsized":"2023-10-09T11:36:04.077089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070537+0000","last_change":"2023-10-09T11:36:04.070385+0000","last_active":"2023-10-09T11:36:04.070537+0000","last_peered":"2023-10-09T11:36:04.070537+0000","last_clean":"2023-10-09T11:36:04.070537+0000","last_became_active":"2023-10-09T11:36:04.070159+0000","last_became_peered":"2023-10-09T11:36:04.070159+0000","last_unstale":"2023-10-09T11:36:04.070537+0000","last_undegraded":"2023-10-09T11:36:04.070537+0000","last_fullsized":"2023-10-09T11:36:04.070537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070944+0000","last_change":"2023-10-09T11:36:04.070645+0000","last_active":"2023-10-09T11:36:04.070944+0000","last_peered":"2023-10-09T11:36:04.070944+0000","last_clean":"2023-10-09T11:36:04.070944+0000","last_became_active":"2023-10-09T11:36:04.070421+0000","last_became_peered":"2023-10-09T11:36:04.070421+0000","last_unstale":"2023-10-09T11:36:04.070944+0000","last_undegraded":"2023-10-09T11:36:04.070944+0000","last_fullsized":"2023-10-09T11:36:04.070944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081588+0000","last_change":"2023-10-09T11:36:04.081114+0000","last_active":"2023-10-09T11:36:04.081588+0000","last_peered":"2023-10-09T11:36:04.081588+0000","last_clean":"2023-10-09T11:36:04.081588+0000","last_became_active":"2023-10-09T11:36:04.080371+0000","last_became_peered":"2023-10-09T11:36:04.080371+0000","last_unstale":"2023-10-09T11:36:04.081588+0000","last_undegraded":"2023-10-09T11:36:04.081588+0000","last_fullsized":"2023-10-09T11:36:04.081588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072507+0000","last_change":"2023-10-09T11:36:04.072443+0000","last_active":"2023-10-09T11:36:04.072507+0000","last_peered":"2023-10-09T11:36:04.072507+0000","last_clean":"2023-10-09T11:36:04.072507+0000","last_became_active":"2023-10-09T11:36:04.072205+0000","last_became_peered":"2023-10-09T11:36:04.072205+0000","last_unstale":"2023-10-09T11:36:04.072507+0000","last_undegraded":"2023-10-09T11:36:04.072507+0000","last_fullsized":"2023-10-09T11:36:04.072507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073391+0000","last_change":"2023-10-09T11:36:04.073323+0000","last_active":"2023-10-09T11:36:04.073391+0000","last_peered":"2023-10-09T11:36:04.073391+0000","last_clean":"2023-10-09T11:36:04.073391+0000","last_became_active":"2023-10-09T11:36:04.073096+0000","last_became_peered":"2023-10-09T11:36:04.073096+0000","last_unstale":"2023-10-09T11:36:04.073391+0000","last_undegraded":"2023-10-09T11:36:04.073391+0000","last_fullsized":"2023-10-09T11:36:04.073391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069410+0000","last_change":"2023-10-09T11:36:04.068825+0000","last_active":"2023-10-09T11:36:04.069410+0000","last_peered":"2023-10-09T11:36:04.069410+0000","last_clean":"2023-10-09T11:36:04.069410+0000","last_became_active":"2023-10-09T11:36:04.067993+0000","last_became_peered":"2023-10-09T11:36:04.067993+0000","last_unstale":"2023-10-09T11:36:04.069410+0000","last_undegraded":"2023-10-09T11:36:04.069410+0000","last_fullsized":"2023-10-09T11:36:04.069410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076162+0000","last_change":"2023-10-09T11:36:04.075555+0000","last_active":"2023-10-09T11:36:04.076162+0000","last_peered":"2023-10-09T11:36:04.076162+0000","last_clean":"2023-10-09T11:36:04.076162+0000","last_became_active":"2023-10-09T11:36:04.074783+0000","last_became_peered":"2023-10-09T11:36:04.074783+0000","last_unstale":"2023-10-09T11:36:04.076162+0000","last_undegraded":"2023-10-09T11:36:04.076162+0000","last_fullsized":"2023-10-09T11:36:04.076162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074638+0000","last_change":"2023-10-09T11:36:04.073743+0000","last_active":"2023-10-09T11:36:04.074638+0000","last_peered":"2023-10-09T11:36:04.074638+0000","last_clean":"2023-10-09T11:36:04.074638+0000","last_became_active":"2023-10-09T11:36:04.073540+0000","last_became_peered":"2023-10-09T11:36:04.073540+0000","last_unstale":"2023-10-09T11:36:04.074638+0000","last_undegraded":"2023-10-09T11:36:04.074638+0000","last_fullsized":"2023-10-09T11:36:04.074638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078952+0000","last_change":"2023-10-09T11:36:04.077634+0000","last_active":"2023-10-09T11:36:04.078952+0000","last_peered":"2023-10-09T11:36:04.078952+0000","last_clean":"2023-10-09T11:36:04.078952+0000","last_became_active":"2023-10-09T11:36:04.077447+0000","last_became_peered":"2023-10-09T11:36:04.077447+0000","last_unstale":"2023-10-09T11:36:04.078952+0000","last_undegraded":"2023-10-09T11:36:04.078952+0000","last_fullsized":"2023-10-09T11:36:04.078952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:23.233430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083898+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:04.083898+0000","last_peered":"2023-10-09T11:36:04.083898+0000","last_clean":"2023-10-09T11:36:04.083898+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:04.083898+0000","last_undegraded":"2023-10-09T11:36:04.083898+0000","last_fullsized":"2023-10-09T11:36:04.083898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081372+0000","last_change":"2023-10-09T11:36:04.080046+0000","last_active":"2023-10-09T11:36:04.081372+0000","last_peered":"2023-10-09T11:36:04.081372+0000","last_clean":"2023-10-09T11:36:04.081372+0000","last_became_active":"2023-10-09T11:36:04.079611+0000","last_became_peered":"2023-10-09T11:36:04.079611+0000","last_unstale":"2023-10-09T11:36:04.081372+0000","last_undegraded":"2023-10-09T11:36:04.081372+0000","last_fullsized":"2023-10-09T11:36:04.081372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085869+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:04.085869+0000","last_peered":"2023-10-09T11:36:04.085869+0000","last_clean":"2023-10-09T11:36:04.085869+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:04.085869+0000","last_undegraded":"2023-10-09T11:36:04.085869+0000","last_fullsized":"2023-10-09T11:36:04.085869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068031+0000","last_change":"2023-10-09T11:36:04.067981+0000","last_active":"2023-10-09T11:36:04.068031+0000","last_peered":"2023-10-09T11:36:04.068031+0000","last_clean":"2023-10-09T11:36:04.068031+0000","last_became_active":"2023-10-09T11:36:04.067598+0000","last_became_peered":"2023-10-09T11:36:04.067598+0000","last_unstale":"2023-10-09T11:36:04.068031+0000","last_undegraded":"2023-10-09T11:36:04.068031+0000","last_fullsized":"2023-10-09T11:36:04.068031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079025+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:04.079025+0000","last_peered":"2023-10-09T11:36:04.079025+0000","last_clean":"2023-10-09T11:36:04.079025+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:04.079025+0000","last_undegraded":"2023-10-09T11:36:04.079025+0000","last_fullsized":"2023-10-09T11:36:04.079025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070274+0000","last_change":"2023-10-09T11:36:04.070208+0000","last_active":"2023-10-09T11:36:04.070274+0000","last_peered":"2023-10-09T11:36:04.070274+0000","last_clean":"2023-10-09T11:36:04.070274+0000","last_became_active":"2023-10-09T11:36:04.069970+0000","last_became_peered":"2023-10-09T11:36:04.069970+0000","last_unstale":"2023-10-09T11:36:04.070274+0000","last_undegraded":"2023-10-09T11:36:04.070274+0000","last_fullsized":"2023-10-09T11:36:04.070274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082152+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:04.082152+0000","last_peered":"2023-10-09T11:36:04.082152+0000","last_clean":"2023-10-09T11:36:04.082152+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:04.082152+0000","last_undegraded":"2023-10-09T11:36:04.082152+0000","last_fullsized":"2023-10-09T11:36:04.082152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067470+0000","last_change":"2023-10-09T11:36:04.067052+0000","last_active":"2023-10-09T11:36:04.067470+0000","last_peered":"2023-10-09T11:36:04.067470+0000","last_clean":"2023-10-09T11:36:04.067470+0000","last_became_active":"2023-10-09T11:36:04.066804+0000","last_became_peered":"2023-10-09T11:36:04.066804+0000","last_unstale":"2023-10-09T11:36:04.067470+0000","last_undegraded":"2023-10-09T11:36:04.067470+0000","last_fullsized":"2023-10-09T11:36:04.067470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080288+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:04.080288+0000","last_peered":"2023-10-09T11:36:04.080288+0000","last_clean":"2023-10-09T11:36:04.080288+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:04.080288+0000","last_undegraded":"2023-10-09T11:36:04.080288+0000","last_fullsized":"2023-10-09T11:36:04.080288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072277+0000","last_change":"2023-10-09T11:36:04.071963+0000","last_active":"2023-10-09T11:36:04.072277+0000","last_peered":"2023-10-09T11:36:04.072277+0000","last_clean":"2023-10-09T11:36:04.072277+0000","last_became_active":"2023-10-09T11:36:04.071760+0000","last_became_peered":"2023-10-09T11:36:04.071760+0000","last_unstale":"2023-10-09T11:36:04.072277+0000","last_undegraded":"2023-10-09T11:36:04.072277+0000","last_fullsized":"2023-10-09T11:36:04.072277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076254+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:04.076254+0000","last_peered":"2023-10-09T11:36:04.076254+0000","last_clean":"2023-10-09T11:36:04.076254+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:04.076254+0000","last_undegraded":"2023-10-09T11:36:04.076254+0000","last_fullsized":"2023-10-09T11:36:04.076254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066583+0000","last_change":"2023-10-09T11:36:04.066355+0000","last_active":"2023-10-09T11:36:04.066583+0000","last_peered":"2023-10-09T11:36:04.066583+0000","last_clean":"2023-10-09T11:36:04.066583+0000","last_became_active":"2023-10-09T11:36:04.066128+0000","last_became_peered":"2023-10-09T11:36:04.066128+0000","last_unstale":"2023-10-09T11:36:04.066583+0000","last_undegraded":"2023-10-09T11:36:04.066583+0000","last_fullsized":"2023-10-09T11:36:04.066583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076230+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:04.076230+0000","last_peered":"2023-10-09T11:36:04.076230+0000","last_clean":"2023-10-09T11:36:04.076230+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:04.076230+0000","last_undegraded":"2023-10-09T11:36:04.076230+0000","last_fullsized":"2023-10-09T11:36:04.076230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079241+0000","last_change":"2023-10-09T11:36:04.079049+0000","last_active":"2023-10-09T11:36:04.079241+0000","last_peered":"2023-10-09T11:36:04.079241+0000","last_clean":"2023-10-09T11:36:04.079241+0000","last_became_active":"2023-10-09T11:36:04.078834+0000","last_became_peered":"2023-10-09T11:36:04.078834+0000","last_unstale":"2023-10-09T11:36:04.079241+0000","last_undegraded":"2023-10-09T11:36:04.079241+0000","last_fullsized":"2023-10-09T11:36:04.079241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066626+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:04.066626+0000","last_peered":"2023-10-09T11:36:04.066626+0000","last_clean":"2023-10-09T11:36:04.066626+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:04.066626+0000","last_undegraded":"2023-10-09T11:36:04.066626+0000","last_fullsized":"2023-10-09T11:36:04.066626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086442+0000","last_change":"2023-10-09T11:36:04.086385+0000","last_active":"2023-10-09T11:36:04.086442+0000","last_peered":"2023-10-09T11:36:04.086442+0000","last_clean":"2023-10-09T11:36:04.086442+0000","last_became_active":"2023-10-09T11:36:04.086167+0000","last_became_peered":"2023-10-09T11:36:04.086167+0000","last_unstale":"2023-10-09T11:36:04.086442+0000","last_undegraded":"2023-10-09T11:36:04.086442+0000","last_fullsized":"2023-10-09T11:36:04.086442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068009+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:04.068009+0000","last_peered":"2023-10-09T11:36:04.068009+0000","last_clean":"2023-10-09T11:36:04.068009+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:04.068009+0000","last_undegraded":"2023-10-09T11:36:04.068009+0000","last_fullsized":"2023-10-09T11:36:04.068009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076195+0000","last_change":"2023-10-09T11:36:04.075850+0000","last_active":"2023-10-09T11:36:04.076195+0000","last_peered":"2023-10-09T11:36:04.076195+0000","last_clean":"2023-10-09T11:36:04.076195+0000","last_became_active":"2023-10-09T11:36:04.075362+0000","last_became_peered":"2023-10-09T11:36:04.075362+0000","last_unstale":"2023-10-09T11:36:04.076195+0000","last_undegraded":"2023-10-09T11:36:04.076195+0000","last_fullsized":"2023-10-09T11:36:04.076195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066187+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:04.066187+0000","last_peered":"2023-10-09T11:36:04.066187+0000","last_clean":"2023-10-09T11:36:04.066187+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:04.066187+0000","last_undegraded":"2023-10-09T11:36:04.066187+0000","last_fullsized":"2023-10-09T11:36:04.066187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067792+0000","last_change":"2023-10-09T11:36:04.067726+0000","last_active":"2023-10-09T11:36:04.067792+0000","last_peered":"2023-10-09T11:36:04.067792+0000","last_clean":"2023-10-09T11:36:04.067792+0000","last_became_active":"2023-10-09T11:36:04.067478+0000","last_became_peered":"2023-10-09T11:36:04.067478+0000","last_unstale":"2023-10-09T11:36:04.067792+0000","last_undegraded":"2023-10-09T11:36:04.067792+0000","last_fullsized":"2023-10-09T11:36:04.067792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077393+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:04.077393+0000","last_peered":"2023-10-09T11:36:04.077393+0000","last_clean":"2023-10-09T11:36:04.077393+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:04.077393+0000","last_undegraded":"2023-10-09T11:36:04.077393+0000","last_fullsized":"2023-10-09T11:36:04.077393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072210+0000","last_change":"2023-10-09T11:36:04.071867+0000","last_active":"2023-10-09T11:36:04.072210+0000","last_peered":"2023-10-09T11:36:04.072210+0000","last_clean":"2023-10-09T11:36:04.072210+0000","last_became_active":"2023-10-09T11:36:04.071610+0000","last_became_peered":"2023-10-09T11:36:04.071610+0000","last_unstale":"2023-10-09T11:36:04.072210+0000","last_undegraded":"2023-10-09T11:36:04.072210+0000","last_fullsized":"2023-10-09T11:36:04.072210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087147+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:04.087147+0000","last_peered":"2023-10-09T11:36:04.087147+0000","last_clean":"2023-10-09T11:36:04.087147+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:04.087147+0000","last_undegraded":"2023-10-09T11:36:04.087147+0000","last_fullsized":"2023-10-09T11:36:04.087147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085788+0000","last_change":"2023-10-09T11:36:04.085709+0000","last_active":"2023-10-09T11:36:04.085788+0000","last_peered":"2023-10-09T11:36:04.085788+0000","last_clean":"2023-10-09T11:36:04.085788+0000","last_became_active":"2023-10-09T11:36:04.085450+0000","last_became_peered":"2023-10-09T11:36:04.085450+0000","last_unstale":"2023-10-09T11:36:04.085788+0000","last_undegraded":"2023-10-09T11:36:04.085788+0000","last_fullsized":"2023-10-09T11:36:04.085788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:35.059638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082197+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:04.082197+0000","last_peered":"2023-10-09T11:36:04.082197+0000","last_clean":"2023-10-09T11:36:04.082197+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:04.082197+0000","last_undegraded":"2023-10-09T11:36:04.082197+0000","last_fullsized":"2023-10-09T11:36:04.082197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085055+0000","last_change":"2023-10-09T11:36:04.085019+0000","last_active":"2023-10-09T11:36:04.085055+0000","last_peered":"2023-10-09T11:36:04.085055+0000","last_clean":"2023-10-09T11:36:04.085055+0000","last_became_active":"2023-10-09T11:36:04.084628+0000","last_became_peered":"2023-10-09T11:36:04.084628+0000","last_unstale":"2023-10-09T11:36:04.085055+0000","last_undegraded":"2023-10-09T11:36:04.085055+0000","last_fullsized":"2023-10-09T11:36:04.085055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066123+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:04.066123+0000","last_peered":"2023-10-09T11:36:04.066123+0000","last_clean":"2023-10-09T11:36:04.066123+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:04.066123+0000","last_undegraded":"2023-10-09T11:36:04.066123+0000","last_fullsized":"2023-10-09T11:36:04.066123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072927+0000","last_change":"2023-10-09T11:36:04.072862+0000","last_active":"2023-10-09T11:36:04.072927+0000","last_peered":"2023-10-09T11:36:04.072927+0000","last_clean":"2023-10-09T11:36:04.072927+0000","last_became_active":"2023-10-09T11:36:04.072643+0000","last_became_peered":"2023-10-09T11:36:04.072643+0000","last_unstale":"2023-10-09T11:36:04.072927+0000","last_undegraded":"2023-10-09T11:36:04.072927+0000","last_fullsized":"2023-10-09T11:36:04.072927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068216+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:04.068216+0000","last_peered":"2023-10-09T11:36:04.068216+0000","last_clean":"2023-10-09T11:36:04.068216+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:04.068216+0000","last_undegraded":"2023-10-09T11:36:04.068216+0000","last_fullsized":"2023-10-09T11:36:04.068216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073388+0000","last_change":"2023-10-09T11:36:04.072942+0000","last_active":"2023-10-09T11:36:04.073388+0000","last_peered":"2023-10-09T11:36:04.073388+0000","last_clean":"2023-10-09T11:36:04.073388+0000","last_became_active":"2023-10-09T11:36:04.072713+0000","last_became_peered":"2023-10-09T11:36:04.072713+0000","last_unstale":"2023-10-09T11:36:04.073388+0000","last_undegraded":"2023-10-09T11:36:04.073388+0000","last_fullsized":"2023-10-09T11:36:04.073388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078402+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:04.078402+0000","last_peered":"2023-10-09T11:36:04.078402+0000","last_clean":"2023-10-09T11:36:04.078402+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:04.078402+0000","last_undegraded":"2023-10-09T11:36:04.078402+0000","last_fullsized":"2023-10-09T11:36:04.078402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078935+0000","last_change":"2023-10-09T11:36:04.077455+0000","last_active":"2023-10-09T11:36:04.078935+0000","last_peered":"2023-10-09T11:36:04.078935+0000","last_clean":"2023-10-09T11:36:04.078935+0000","last_became_active":"2023-10-09T11:36:04.075697+0000","last_became_peered":"2023-10-09T11:36:04.075697+0000","last_unstale":"2023-10-09T11:36:04.078935+0000","last_undegraded":"2023-10-09T11:36:04.078935+0000","last_fullsized":"2023-10-09T11:36:04.078935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082726+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:04.082726+0000","last_peered":"2023-10-09T11:36:04.082726+0000","last_clean":"2023-10-09T11:36:04.082726+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:04.082726+0000","last_undegraded":"2023-10-09T11:36:04.082726+0000","last_fullsized":"2023-10-09T11:36:04.082726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073739+0000","last_change":"2023-10-09T11:36:04.073672+0000","last_active":"2023-10-09T11:36:04.073739+0000","last_peered":"2023-10-09T11:36:04.073739+0000","last_clean":"2023-10-09T11:36:04.073739+0000","last_became_active":"2023-10-09T11:36:04.073078+0000","last_became_peered":"2023-10-09T11:36:04.073078+0000","last_unstale":"2023-10-09T11:36:04.073739+0000","last_undegraded":"2023-10-09T11:36:04.073739+0000","last_fullsized":"2023-10-09T11:36:04.073739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068917+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:04.068917+0000","last_peered":"2023-10-09T11:36:04.068917+0000","last_clean":"2023-10-09T11:36:04.068917+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:04.068917+0000","last_undegraded":"2023-10-09T11:36:04.068917+0000","last_fullsized":"2023-10-09T11:36:04.068917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081559+0000","last_change":"2023-10-09T11:36:04.081376+0000","last_active":"2023-10-09T11:36:04.081559+0000","last_peered":"2023-10-09T11:36:04.081559+0000","last_clean":"2023-10-09T11:36:04.081559+0000","last_became_active":"2023-10-09T11:36:04.080714+0000","last_became_peered":"2023-10-09T11:36:04.080714+0000","last_unstale":"2023-10-09T11:36:04.081559+0000","last_undegraded":"2023-10-09T11:36:04.081559+0000","last_fullsized":"2023-10-09T11:36:04.081559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066307+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:04.066307+0000","last_peered":"2023-10-09T11:36:04.066307+0000","last_clean":"2023-10-09T11:36:04.066307+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:04.066307+0000","last_undegraded":"2023-10-09T11:36:04.066307+0000","last_fullsized":"2023-10-09T11:36:04.066307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069101+0000","last_change":"2023-10-09T11:36:04.068591+0000","last_active":"2023-10-09T11:36:04.069101+0000","last_peered":"2023-10-09T11:36:04.069101+0000","last_clean":"2023-10-09T11:36:04.069101+0000","last_became_active":"2023-10-09T11:36:04.068323+0000","last_became_peered":"2023-10-09T11:36:04.068323+0000","last_unstale":"2023-10-09T11:36:04.069101+0000","last_undegraded":"2023-10-09T11:36:04.069101+0000","last_fullsized":"2023-10-09T11:36:04.069101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077971+0000","last_change":"2023-10-09T11:36:04.077889+0000","last_active":"2023-10-09T11:36:04.077971+0000","last_peered":"2023-10-09T11:36:04.077971+0000","last_clean":"2023-10-09T11:36:04.077971+0000","last_became_active":"2023-10-09T11:36:04.077682+0000","last_became_peered":"2023-10-09T11:36:04.077682+0000","last_unstale":"2023-10-09T11:36:04.077971+0000","last_undegraded":"2023-10-09T11:36:04.077971+0000","last_fullsized":"2023-10-09T11:36:04.077971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066047+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:04.066047+0000","last_peered":"2023-10-09T11:36:04.066047+0000","last_clean":"2023-10-09T11:36:04.066047+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:04.066047+0000","last_undegraded":"2023-10-09T11:36:04.066047+0000","last_fullsized":"2023-10-09T11:36:04.066047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081391+0000","last_change":"2023-10-09T11:36:04.080698+0000","last_active":"2023-10-09T11:36:04.081391+0000","last_peered":"2023-10-09T11:36:04.081391+0000","last_clean":"2023-10-09T11:36:04.081391+0000","last_became_active":"2023-10-09T11:36:04.080102+0000","last_became_peered":"2023-10-09T11:36:04.080102+0000","last_unstale":"2023-10-09T11:36:04.081391+0000","last_undegraded":"2023-10-09T11:36:04.081391+0000","last_fullsized":"2023-10-09T11:36:04.081391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066308+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:04.066308+0000","last_peered":"2023-10-09T11:36:04.066308+0000","last_clean":"2023-10-09T11:36:04.066308+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:04.066308+0000","last_undegraded":"2023-10-09T11:36:04.066308+0000","last_fullsized":"2023-10-09T11:36:04.066308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067759+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:04.067759+0000","last_peered":"2023-10-09T11:36:04.067759+0000","last_clean":"2023-10-09T11:36:04.067759+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:04.067759+0000","last_undegraded":"2023-10-09T11:36:04.067759+0000","last_fullsized":"2023-10-09T11:36:04.067759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067809+0000","last_change":"2023-10-09T11:36:04.067741+0000","last_active":"2023-10-09T11:36:04.067809+0000","last_peered":"2023-10-09T11:36:04.067809+0000","last_clean":"2023-10-09T11:36:04.067809+0000","last_became_active":"2023-10-09T11:36:04.067100+0000","last_became_peered":"2023-10-09T11:36:04.067100+0000","last_unstale":"2023-10-09T11:36:04.067809+0000","last_undegraded":"2023-10-09T11:36:04.067809+0000","last_fullsized":"2023-10-09T11:36:04.067809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067883+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:04.067883+0000","last_peered":"2023-10-09T11:36:04.067883+0000","last_clean":"2023-10-09T11:36:04.067883+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:04.067883+0000","last_undegraded":"2023-10-09T11:36:04.067883+0000","last_fullsized":"2023-10-09T11:36:04.067883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075638+0000","last_change":"2023-10-09T11:36:04.075567+0000","last_active":"2023-10-09T11:36:04.075638+0000","last_peered":"2023-10-09T11:36:04.075638+0000","last_clean":"2023-10-09T11:36:04.075638+0000","last_became_active":"2023-10-09T11:36:04.075313+0000","last_became_peered":"2023-10-09T11:36:04.075313+0000","last_unstale":"2023-10-09T11:36:04.075638+0000","last_undegraded":"2023-10-09T11:36:04.075638+0000","last_fullsized":"2023-10-09T11:36:04.075638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:36:05.064162+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:05.064162+0000","last_peered":"2023-10-09T11:36:05.064162+0000","last_clean":"2023-10-09T11:36:05.064162+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:05.064162+0000","last_undegraded":"2023-10-09T11:36:05.064162+0000","last_fullsized":"2023-10-09T11:36:05.064162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081604+0000","last_change":"2023-10-09T11:36:04.081186+0000","last_active":"2023-10-09T11:36:04.081604+0000","last_peered":"2023-10-09T11:36:04.081604+0000","last_clean":"2023-10-09T11:36:04.081604+0000","last_became_active":"2023-10-09T11:36:04.080933+0000","last_became_peered":"2023-10-09T11:36:04.080933+0000","last_unstale":"2023-10-09T11:36:04.081604+0000","last_undegraded":"2023-10-09T11:36:04.081604+0000","last_fullsized":"2023-10-09T11:36:04.081604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079780+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:04.079780+0000","last_peered":"2023-10-09T11:36:04.079780+0000","last_clean":"2023-10-09T11:36:04.079780+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:04.079780+0000","last_undegraded":"2023-10-09T11:36:04.079780+0000","last_fullsized":"2023-10-09T11:36:04.079780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072912+0000","last_change":"2023-10-09T11:36:04.072805+0000","last_active":"2023-10-09T11:36:04.072912+0000","last_peered":"2023-10-09T11:36:04.072912+0000","last_clean":"2023-10-09T11:36:04.072912+0000","last_became_active":"2023-10-09T11:36:04.072588+0000","last_became_peered":"2023-10-09T11:36:04.072588+0000","last_unstale":"2023-10-09T11:36:04.072912+0000","last_undegraded":"2023-10-09T11:36:04.072912+0000","last_fullsized":"2023-10-09T11:36:04.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071718+0000","last_change":"2023-10-09T11:36:04.071396+0000","last_active":"2023-10-09T11:36:04.071718+0000","last_peered":"2023-10-09T11:36:04.071718+0000","last_clean":"2023-10-09T11:36:04.071718+0000","last_became_active":"2023-10-09T11:36:04.071015+0000","last_became_peered":"2023-10-09T11:36:04.071015+0000","last_unstale":"2023-10-09T11:36:04.071718+0000","last_undegraded":"2023-10-09T11:36:04.071718+0000","last_fullsized":"2023-10-09T11:36:04.071718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069006+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:04.069006+0000","last_peered":"2023-10-09T11:36:04.069006+0000","last_clean":"2023-10-09T11:36:04.069006+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:04.069006+0000","last_undegraded":"2023-10-09T11:36:04.069006+0000","last_fullsized":"2023-10-09T11:36:04.069006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081346+0000","last_change":"2023-10-09T11:36:04.079699+0000","last_active":"2023-10-09T11:36:04.081346+0000","last_peered":"2023-10-09T11:36:04.081346+0000","last_clean":"2023-10-09T11:36:04.081346+0000","last_became_active":"2023-10-09T11:36:04.079452+0000","last_became_peered":"2023-10-09T11:36:04.079452+0000","last_unstale":"2023-10-09T11:36:04.081346+0000","last_undegraded":"2023-10-09T11:36:04.081346+0000","last_fullsized":"2023-10-09T11:36:04.081346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068665+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:04.068665+0000","last_peered":"2023-10-09T11:36:04.068665+0000","last_clean":"2023-10-09T11:36:04.068665+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:04.068665+0000","last_undegraded":"2023-10-09T11:36:04.068665+0000","last_fullsized":"2023-10-09T11:36:04.068665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087047+0000","last_change":"2023-10-09T11:36:04.086892+0000","last_active":"2023-10-09T11:36:04.087047+0000","last_peered":"2023-10-09T11:36:04.087047+0000","last_clean":"2023-10-09T11:36:04.087047+0000","last_became_active":"2023-10-09T11:36:04.086144+0000","last_became_peered":"2023-10-09T11:36:04.086144+0000","last_unstale":"2023-10-09T11:36:04.087047+0000","last_undegraded":"2023-10-09T11:36:04.087047+0000","last_fullsized":"2023-10-09T11:36:04.087047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080644+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:04.080644+0000","last_peered":"2023-10-09T11:36:04.080644+0000","last_clean":"2023-10-09T11:36:04.080644+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:04.080644+0000","last_undegraded":"2023-10-09T11:36:04.080644+0000","last_fullsized":"2023-10-09T11:36:04.080644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075657+0000","last_change":"2023-10-09T11:36:04.074171+0000","last_active":"2023-10-09T11:36:04.075657+0000","last_peered":"2023-10-09T11:36:04.075657+0000","last_clean":"2023-10-09T11:36:04.075657+0000","last_became_active":"2023-10-09T11:36:04.073930+0000","last_became_peered":"2023-10-09T11:36:04.073930+0000","last_unstale":"2023-10-09T11:36:04.075657+0000","last_undegraded":"2023-10-09T11:36:04.075657+0000","last_fullsized":"2023-10-09T11:36:04.075657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.065534+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:04.065534+0000","last_peered":"2023-10-09T11:36:04.065534+0000","last_clean":"2023-10-09T11:36:04.065534+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:04.065534+0000","last_undegraded":"2023-10-09T11:36:04.065534+0000","last_fullsized":"2023-10-09T11:36:04.065534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074310+0000","last_change":"2023-10-09T11:36:04.074247+0000","last_active":"2023-10-09T11:36:04.074310+0000","last_peered":"2023-10-09T11:36:04.074310+0000","last_clean":"2023-10-09T11:36:04.074310+0000","last_became_active":"2023-10-09T11:36:04.074025+0000","last_became_peered":"2023-10-09T11:36:04.074025+0000","last_unstale":"2023-10-09T11:36:04.074310+0000","last_undegraded":"2023-10-09T11:36:04.074310+0000","last_fullsized":"2023-10-09T11:36:04.074310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074519+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:04.074519+0000","last_peered":"2023-10-09T11:36:04.074519+0000","last_clean":"2023-10-09T11:36:04.074519+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:04.074519+0000","last_undegraded":"2023-10-09T11:36:04.074519+0000","last_fullsized":"2023-10-09T11:36:04.074519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080255+0000","last_change":"2023-10-09T11:36:04.079551+0000","last_active":"2023-10-09T11:36:04.080255+0000","last_peered":"2023-10-09T11:36:04.080255+0000","last_clean":"2023-10-09T11:36:04.080255+0000","last_became_active":"2023-10-09T11:36:04.079307+0000","last_became_peered":"2023-10-09T11:36:04.079307+0000","last_unstale":"2023-10-09T11:36:04.080255+0000","last_undegraded":"2023-10-09T11:36:04.080255+0000","last_fullsized":"2023-10-09T11:36:04.080255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083869+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:04.083869+0000","last_peered":"2023-10-09T11:36:04.083869+0000","last_clean":"2023-10-09T11:36:04.083869+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:04.083869+0000","last_undegraded":"2023-10-09T11:36:04.083869+0000","last_fullsized":"2023-10-09T11:36:04.083869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073623+0000","last_change":"2023-10-09T11:36:04.073410+0000","last_active":"2023-10-09T11:36:04.073623+0000","last_peered":"2023-10-09T11:36:04.073623+0000","last_clean":"2023-10-09T11:36:04.073623+0000","last_became_active":"2023-10-09T11:36:04.072808+0000","last_became_peered":"2023-10-09T11:36:04.072808+0000","last_unstale":"2023-10-09T11:36:04.073623+0000","last_undegraded":"2023-10-09T11:36:04.073623+0000","last_fullsized":"2023-10-09T11:36:04.073623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:22.124509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072611+0000","last_change":"2023-10-09T11:36:04.072547+0000","last_active":"2023-10-09T11:36:04.072611+0000","last_peered":"2023-10-09T11:36:04.072611+0000","last_clean":"2023-10-09T11:36:04.072611+0000","last_became_active":"2023-10-09T11:36:04.070914+0000","last_became_peered":"2023-10-09T11:36:04.070914+0000","last_unstale":"2023-10-09T11:36:04.072611+0000","last_undegraded":"2023-10-09T11:36:04.072611+0000","last_fullsized":"2023-10-09T11:36:04.072611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071473+0000","last_change":"2023-10-09T11:36:04.070407+0000","last_active":"2023-10-09T11:36:04.071473+0000","last_peered":"2023-10-09T11:36:04.071473+0000","last_clean":"2023-10-09T11:36:04.071473+0000","last_became_active":"2023-10-09T11:36:04.070183+0000","last_became_peered":"2023-10-09T11:36:04.070183+0000","last_unstale":"2023-10-09T11:36:04.071473+0000","last_undegraded":"2023-10-09T11:36:04.071473+0000","last_fullsized":"2023-10-09T11:36:04.071473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080238+0000","last_change":"2023-10-09T11:36:04.079371+0000","last_active":"2023-10-09T11:36:04.080238+0000","last_peered":"2023-10-09T11:36:04.080238+0000","last_clean":"2023-10-09T11:36:04.080238+0000","last_became_active":"2023-10-09T11:36:04.079152+0000","last_became_peered":"2023-10-09T11:36:04.079152+0000","last_unstale":"2023-10-09T11:36:04.080238+0000","last_undegraded":"2023-10-09T11:36:04.080238+0000","last_fullsized":"2023-10-09T11:36:04.080238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081639+0000","last_change":"2023-10-09T11:36:04.081536+0000","last_active":"2023-10-09T11:36:04.081639+0000","last_peered":"2023-10-09T11:36:04.081639+0000","last_clean":"2023-10-09T11:36:04.081639+0000","last_became_active":"2023-10-09T11:36:04.081054+0000","last_became_peered":"2023-10-09T11:36:04.081054+0000","last_unstale":"2023-10-09T11:36:04.081639+0000","last_undegraded":"2023-10-09T11:36:04.081639+0000","last_fullsized":"2023-10-09T11:36:04.081639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087035+0000","last_change":"2023-10-09T11:36:04.086736+0000","last_active":"2023-10-09T11:36:04.087035+0000","last_peered":"2023-10-09T11:36:04.087035+0000","last_clean":"2023-10-09T11:36:04.087035+0000","last_became_active":"2023-10-09T11:36:04.085787+0000","last_became_peered":"2023-10-09T11:36:04.085787+0000","last_unstale":"2023-10-09T11:36:04.087035+0000","last_undegraded":"2023-10-09T11:36:04.087035+0000","last_fullsized":"2023-10-09T11:36:04.087035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085923+0000","last_change":"2023-10-09T11:36:04.085863+0000","last_active":"2023-10-09T11:36:04.085923+0000","last_peered":"2023-10-09T11:36:04.085923+0000","last_clean":"2023-10-09T11:36:04.085923+0000","last_became_active":"2023-10-09T11:36:04.085616+0000","last_became_peered":"2023-10-09T11:36:04.085616+0000","last_unstale":"2023-10-09T11:36:04.085923+0000","last_undegraded":"2023-10-09T11:36:04.085923+0000","last_fullsized":"2023-10-09T11:36:04.085923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077303+0000","last_change":"2023-10-09T11:36:04.077191+0000","last_active":"2023-10-09T11:36:04.077303+0000","last_peered":"2023-10-09T11:36:04.077303+0000","last_clean":"2023-10-09T11:36:04.077303+0000","last_became_active":"2023-10-09T11:36:04.074565+0000","last_became_peered":"2023-10-09T11:36:04.074565+0000","last_unstale":"2023-10-09T11:36:04.077303+0000","last_undegraded":"2023-10-09T11:36:04.077303+0000","last_fullsized":"2023-10-09T11:36:04.077303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086970+0000","last_change":"2023-10-09T11:36:04.085672+0000","last_active":"2023-10-09T11:36:04.086970+0000","last_peered":"2023-10-09T11:36:04.086970+0000","last_clean":"2023-10-09T11:36:04.086970+0000","last_became_active":"2023-10-09T11:36:04.085373+0000","last_became_peered":"2023-10-09T11:36:04.085373+0000","last_unstale":"2023-10-09T11:36:04.086970+0000","last_undegraded":"2023-10-09T11:36:04.086970+0000","last_fullsized":"2023-10-09T11:36:04.086970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081601+0000","last_change":"2023-10-09T11:36:04.081476+0000","last_active":"2023-10-09T11:36:04.081601+0000","last_peered":"2023-10-09T11:36:04.081601+0000","last_clean":"2023-10-09T11:36:04.081601+0000","last_became_active":"2023-10-09T11:36:04.081002+0000","last_became_peered":"2023-10-09T11:36:04.081002+0000","last_unstale":"2023-10-09T11:36:04.081601+0000","last_undegraded":"2023-10-09T11:36:04.081601+0000","last_fullsized":"2023-10-09T11:36:04.081601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087021+0000","last_change":"2023-10-09T11:36:04.086449+0000","last_active":"2023-10-09T11:36:04.087021+0000","last_peered":"2023-10-09T11:36:04.087021+0000","last_clean":"2023-10-09T11:36:04.087021+0000","last_became_active":"2023-10-09T11:36:04.085477+0000","last_became_peered":"2023-10-09T11:36:04.085477+0000","last_unstale":"2023-10-09T11:36:04.087021+0000","last_undegraded":"2023-10-09T11:36:04.087021+0000","last_fullsized":"2023-10-09T11:36:04.087021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076180+0000","last_change":"2023-10-09T11:36:04.075706+0000","last_active":"2023-10-09T11:36:04.076180+0000","last_peered":"2023-10-09T11:36:04.076180+0000","last_clean":"2023-10-09T11:36:04.076180+0000","last_became_active":"2023-10-09T11:36:04.075096+0000","last_became_peered":"2023-10-09T11:36:04.075096+0000","last_unstale":"2023-10-09T11:36:04.076180+0000","last_undegraded":"2023-10-09T11:36:04.076180+0000","last_fullsized":"2023-10-09T11:36:04.076180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.084996+0000","last_change":"2023-10-09T11:36:04.084941+0000","last_active":"2023-10-09T11:36:04.084996+0000","last_peered":"2023-10-09T11:36:04.084996+0000","last_clean":"2023-10-09T11:36:04.084996+0000","last_became_active":"2023-10-09T11:36:04.084453+0000","last_became_peered":"2023-10-09T11:36:04.084453+0000","last_unstale":"2023-10-09T11:36:04.084996+0000","last_undegraded":"2023-10-09T11:36:04.084996+0000","last_fullsized":"2023-10-09T11:36:04.084996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073999+0000","last_change":"2023-10-09T11:36:04.073572+0000","last_active":"2023-10-09T11:36:04.073999+0000","last_peered":"2023-10-09T11:36:04.073999+0000","last_clean":"2023-10-09T11:36:04.073999+0000","last_became_active":"2023-10-09T11:36:04.073337+0000","last_became_peered":"2023-10-09T11:36:04.073337+0000","last_unstale":"2023-10-09T11:36:04.073999+0000","last_undegraded":"2023-10-09T11:36:04.073999+0000","last_fullsized":"2023-10-09T11:36:04.073999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:13.108 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:36:13.108 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T11:36:13.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T11:36:13.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T11:36:13.109 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T11:36:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 Processor -- start 2023-10-09T11:36:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 -- start start 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39881578d0 0x7f39880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398806d120 0x7f398806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39880d07c0 con 0x7f3988157ca0 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398806da50 con 0x7f398806d120 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f398d946700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880cfbb0 con 0x7f39881578d0 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.260+0000 7f39877fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398806d120 0x7f398806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398806d120 0x7f398806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36102/0 (socket says 172.21.15.6:36102) 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 -- 172.21.15.6:0/1214231465 learned_addr learned my addr 172.21.15.6:0/1214231465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f3986ffd700 1 --2- 172.21.15.6:0/1214231465 >> v2:172.21.15.118:3300/0 conn(0x7f39881578d0 0x7f39880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 -- 172.21.15.6:0/1214231465 >> v2:172.21.15.118:3300/0 conn(0x7f39881578d0 msgr2=0x7f39880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 --2- 172.21.15.6:0/1214231465 >> v2:172.21.15.118:3300/0 conn(0x7f39881578d0 0x7f39880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 -- 172.21.15.6:0/1214231465 >> v1:172.21.15.118:6789/0 conn(0x7f3988157ca0 legacy=0x7f398815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 -- 172.21.15.6:0/1214231465 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880cfe90 con 0x7f398806d120 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f39877fe700 1 --2- 172.21.15.6:0/1214231465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f398806d510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39880646b0 tx=0x7f3980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed84f72bb2f41f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f3985ffb700 1 -- 172.21.15.6:0/1214231465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000b820 con 0x7f398806d120 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f3985ffb700 1 -- 172.21.15.6:0/1214231465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000b980 con 0x7f398806d120 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.261+0000 7f3985ffb700 1 -- 172.21.15.6:0/1214231465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000bd20 con 0x7f398806d120 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 -- 172.21.15.6:0/1214231465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 msgr2=0x7f398806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 --2- 172.21.15.6:0/1214231465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f398806d510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39880646b0 tx=0x7f3980009250 comp rx=0 tx=0).stop 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 -- 172.21.15.6:0/1214231465 shutdown_connections 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 --2- 172.21.15.6:0/1214231465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f398806d510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 --2- 172.21.15.6:0/1214231465 >> v2:172.21.15.118:3300/0 conn(0x7f39881578d0 0x7f39880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 -- 172.21.15.6:0/1214231465 >> 172.21.15.6:0/1214231465 conn(0x7f398806bb90 msgr2=0x7f398806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 -- 172.21.15.6:0/1214231465 shutdown_connections 2023-10-09T11:36:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.262+0000 7f398d946700 1 -- 172.21.15.6:0/1214231465 wait complete. 2023-10-09T11:36:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.263+0000 7f398d946700 1 Processor -- start 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.263+0000 7f398d946700 1 -- start start 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39881578d0 0x7f398816dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3988157ca0 0x7f3988068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398816ebd0 con 0x7f398806d120 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398816e330 con 0x7f39881578d0 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398816e610 con 0x7f3988157ca0 2023-10-09T11:36:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36106/0 (socket says 172.21.15.6:36106) 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 -- 172.21.15.6:0/1663481613 learned_addr learned my addr 172.21.15.6:0/1663481613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f39867fc700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39881578d0 0x7f398816dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f39877fe700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3988157ca0 0x7f3988068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 -- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3988157ca0 msgr2=0x7f3988068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3988157ca0 0x7f3988068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 -- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39881578d0 msgr2=0x7f398816dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39881578d0 0x7f398816dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 -- 172.21.15.6:0/1663481613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800094f0 con 0x7f398806d120 2023-10-09T11:36:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f3986ffd700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f397800e190 tx=0x7f3978009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800ecd0 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800ee30 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398816e8f0 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.264+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978014670 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.265+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3988069010 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.265+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3988158730 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.266+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3978014a20 con 0x7f398806d120 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.266+0000 7f397effd700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.266+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3978084bf0 con 0x7f398806d120 2023-10-09T11:36:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.266+0000 7f39867fc700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.267+0000 7f39867fc700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398806a670 tx=0x7f3970009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.270+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3978051e60 con 0x7f398806d120 2023-10-09T11:36:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.517+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f39881588e0 con 0x7f398806d120 2023-10-09T11:36:13.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.520+0000 7f397effd700 1 -- 172.21.15.6:0/1663481613 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163692 (secure 0 0 0) 0x7f3978009a60 con 0x7f398806d120 2023-10-09T11:36:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 msgr2=0x7f39680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398806a670 tx=0x7f3970009060 comp rx=0 tx=0).stop 2023-10-09T11:36:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 msgr2=0x7f39880ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f397800e190 tx=0x7f3978009920 comp rx=0 tx=0).stop 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 shutdown_connections 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3988157ca0 0x7f3988068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398806d120 0x7f39880ab350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 --2- 172.21.15.6:0/1663481613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39881578d0 0x7f398816dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 >> 172.21.15.6:0/1663481613 conn(0x7f398806bb90 msgr2=0x7f3988069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 shutdown_connections 2023-10-09T11:36:13.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.522+0000 7f398d946700 1 -- 172.21.15.6:0/1663481613 wait complete. 2023-10-09T11:36:13.535 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":86144},{"type":"v1","addr":"172.21.15.6:6833","nonce":86144}]},"active_addr":"172.21.15.6:6833/86144","active_change":"2023-10-09T11:35:52.139121+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3110671575}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2871195989}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":1896312010}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3316130649}]}]} 2023-10-09T11:36:13.540 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T11:36:13.541 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T11:36:13.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.659+0000 7f6656c4d700 1 Processor -- start 2023-10-09T11:36:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.659+0000 7f6656c4d700 1 -- start start 2023-10-09T11:36:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f6656c4d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6650157fe0 0x7f66500b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f6656c4d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66501583b0 0x7f66500b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f6656c4d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66500b2890 con 0x7f66500ceb30 2023-10-09T11:36:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f6656c4d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66500b4070 con 0x7f6650157fe0 2023-10-09T11:36:13.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f6656c4d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66500b4350 con 0x7f66501583b0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f66549e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6650157fe0 0x7f66500b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f66549e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6650157fe0 0x7f66500b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36108/0 (socket says 172.21.15.6:36108) 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.660+0000 7f66549e9700 1 -- 172.21.15.6:0/1637143396 learned_addr learned my addr 172.21.15.6:0/1637143396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f664ffff700 1 --2- 172.21.15.6:0/1637143396 >> v2:172.21.15.118:3300/0 conn(0x7f66501583b0 0x7f66500b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f66549e9700 1 -- 172.21.15.6:0/1637143396 >> v2:172.21.15.118:3300/0 conn(0x7f66501583b0 msgr2=0x7f66500b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f66549e9700 1 --2- 172.21.15.6:0/1637143396 >> v2:172.21.15.118:3300/0 conn(0x7f66501583b0 0x7f66500b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f66549e9700 1 -- 172.21.15.6:0/1637143396 >> v1:172.21.15.118:6789/0 conn(0x7f66500ceb30 legacy=0x7f66500cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f66549e9700 1 -- 172.21.15.6:0/1637143396 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500b4630 con 0x7f6650157fe0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f66549e9700 1 --2- 172.21.15.6:0/1637143396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6650157fe0 0x7f66500b34c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f665004c150 tx=0x7f6640009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4ecc7bc16b5101 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f664f7fe700 1 -- 172.21.15.6:0/1637143396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000b820 con 0x7f6650157fe0 2023-10-09T11:36:13.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f664f7fe700 1 -- 172.21.15.6:0/1637143396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000b980 con 0x7f6650157fe0 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f664f7fe700 1 -- 172.21.15.6:0/1637143396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000bd20 con 0x7f6650157fe0 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 -- 172.21.15.6:0/1637143396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6650157fe0 msgr2=0x7f66500b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 --2- 172.21.15.6:0/1637143396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6650157fe0 0x7f66500b34c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f665004c150 tx=0x7f6640009250 comp rx=0 tx=0).stop 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 -- 172.21.15.6:0/1637143396 shutdown_connections 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 --2- 172.21.15.6:0/1637143396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6650157fe0 0x7f66500b34c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 --2- 172.21.15.6:0/1637143396 >> v2:172.21.15.118:3300/0 conn(0x7f66501583b0 0x7f66500b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.661+0000 7f6656c4d700 1 -- 172.21.15.6:0/1637143396 >> 172.21.15.6:0/1637143396 conn(0x7f6650067640 msgr2=0x7f6650067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.662+0000 7f6656c4d700 1 -- 172.21.15.6:0/1637143396 shutdown_connections 2023-10-09T11:36:13.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.662+0000 7f6656c4d700 1 -- 172.21.15.6:0/1637143396 wait complete. 2023-10-09T11:36:13.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.663+0000 7f6656c4d700 1 Processor -- start 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.663+0000 7f6656c4d700 1 -- start start 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 0x7f6650152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66501583b0 0x7f665015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650169780 con 0x7f66500ceb30 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500c48a0 con 0x7f66501583b0 2023-10-09T11:36:13.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f6656c4d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500c3d20 con 0x7f6650157fe0 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36114/0 (socket says 172.21.15.6:36114) 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 -- 172.21.15.6:0/3165514074 learned_addr learned my addr 172.21.15.6:0/3165514074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66551ea700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66501583b0 0x7f665015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f664ffff700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 0x7f6650152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 -- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 msgr2=0x7f6650152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 0x7f6650152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 -- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66501583b0 msgr2=0x7f665015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.664+0000 7f66549e9700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66501583b0 0x7f665015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f66549e9700 1 -- 172.21.15.6:0/3165514074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66400094f0 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f664ffff700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 0x7f6650152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f66549e9700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6640009290 tx=0x7f6640016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664001b470 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664001b5d0 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66500c4000 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664001b990 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.665+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500c45c0 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.666+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6650069e40 con 0x7f66500ceb30 2023-10-09T11:36:13.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.666+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f664001bd40 con 0x7f66500ceb30 2023-10-09T11:36:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.667+0000 7f664cff9700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:13.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.667+0000 7f664ffff700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:13.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.667+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6640086210 con 0x7f66500ceb30 2023-10-09T11:36:13.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.667+0000 7f664ffff700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 0x7f663c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6644006fd0 tx=0x7f6644008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:13.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.671+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6640053480 con 0x7f66500ceb30 2023-10-09T11:36:13.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.863+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66500cc6b0 con 0x7f66500ceb30 2023-10-09T11:36:13.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.863+0000 7f664cff9700 1 -- 172.21.15.6:0/3165514074 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6640056aa0 con 0x7f66500ceb30 2023-10-09T11:36:13.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:13.866 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 msgr2=0x7f663c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 0x7f663c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6644006fd0 tx=0x7f6644008040 comp rx=0 tx=0).stop 2023-10-09T11:36:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 msgr2=0x7f6650169240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6640009290 tx=0x7f6640016000 comp rx=0 tx=0).stop 2023-10-09T11:36:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 shutdown_connections 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f663c066f30 0x7f663c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66501583b0 0x7f665015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66500ceb30 0x7f6650169240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 --2- 172.21.15.6:0/3165514074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6650157fe0 0x7f6650152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 >> 172.21.15.6:0/3165514074 conn(0x7f6650067640 msgr2=0x7f6650155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 shutdown_connections 2023-10-09T11:36:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.866+0000 7f6656c4d700 1 -- 172.21.15.6:0/3165514074 wait complete. 2023-10-09T11:36:13.879 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T11:36:13.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.997+0000 7f0496510700 1 Processor -- start 2023-10-09T11:36:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.997+0000 7f0496510700 1 -- start start 2023-10-09T11:36:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0496510700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0496510700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04900c3030 0x7f04900c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0496510700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049006aae0 con 0x7f04900aeea0 2023-10-09T11:36:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0496510700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900c8780 con 0x7f04900c3030 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0496510700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0490069ed0 con 0x7f04900af270 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f0494aad700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04900c3030 0x7f04900c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f048ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04900aeea0 0x7f04900c2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44178/0 (socket says 172.21.15.6:44178) 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.998+0000 7f048ffff700 1 -- 172.21.15.6:0/3760436178 learned_addr learned my addr 172.21.15.6:0/3760436178 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048f7fe700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0494aad700 1 -- 172.21.15.6:0/3760436178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 msgr2=0x7f04900c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0494aad700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0494aad700 1 -- 172.21.15.6:0/3760436178 >> v1:172.21.15.6:6789/0 conn(0x7f04900aeea0 legacy=0x7f04900c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0494aad700 1 -- 172.21.15.6:0/3760436178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049006a1b0 con 0x7f04900c3030 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048f7fe700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048effd700 1 -- 172.21.15.6:0/3760436178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028740325 0 0) 0x7f049006aae0 con 0x7f04900aeea0 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0494aad700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900c8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0488009e60 tx=0x7f0488009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185bd35c07b3873b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048effd700 1 -- 172.21.15.6:0/3760436178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800e070 con 0x7f04900c3030 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048effd700 1 -- 172.21.15.6:0/3760436178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048800bcc0 con 0x7f04900c3030 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f048effd700 1 -- 172.21.15.6:0/3760436178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488012680 con 0x7f04900c3030 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0496510700 1 -- 172.21.15.6:0/3760436178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 msgr2=0x7f04900c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:13.999+0000 7f0496510700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900c8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0488009e60 tx=0x7f0488009780 comp rx=0 tx=0).stop 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 -- 172.21.15.6:0/3760436178 shutdown_connections 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900c8240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 --2- 172.21.15.6:0/3760436178 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 -- 172.21.15.6:0/3760436178 >> 172.21.15.6:0/3760436178 conn(0x7f049006c660 msgr2=0x7f04900cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 -- 172.21.15.6:0/3760436178 shutdown_connections 2023-10-09T11:36:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.000+0000 7f0496510700 1 -- 172.21.15.6:0/3760436178 wait complete. 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.001+0000 7f0496510700 1 Processor -- start 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.001+0000 7f0496510700 1 -- start start 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04900aeea0 0x7f04901437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c5c80 con 0x7f04900c3030 2023-10-09T11:36:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c5f60 con 0x7f04900aeea0 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c6240 con 0x7f04900af270 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36132/0 (socket says 172.21.15.6:36132) 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 -- 172.21.15.6:0/1154206935 learned_addr learned my addr 172.21.15.6:0/1154206935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f048ffff700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04900aeea0 0x7f04901437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f048f7fe700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 -- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 msgr2=0x7f04900c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 -- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04900aeea0 msgr2=0x7f04901437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04900aeea0 0x7f04901437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 -- 172.21.15.6:0/1154206935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488009a20 con 0x7f04900c3030 2023-10-09T11:36:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0494aad700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0488013000 tx=0x7f0488019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800beb0 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048801d630 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900c6520 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048801da10 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.002+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900b2490 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.003+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0490067bc0 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.004+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0488024070 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.004+0000 7f0477fff700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.004+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0488086d80 con 0x7f04900c3030 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.004+0000 7f048ffff700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.005+0000 7f048ffff700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0484007fd0 tx=0x7f0484007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.009+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0488053f50 con 0x7f04900c3030 2023-10-09T11:36:14.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.202+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f049006a490 con 0x7f04900c3030 2023-10-09T11:36:14.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.203+0000 7f0477fff700 1 -- 172.21.15.6:0/1154206935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0488057570 con 0x7f04900c3030 2023-10-09T11:36:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:14.205 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:14.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.204+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 msgr2=0x7f047c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.204+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0484007fd0 tx=0x7f0484007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:14.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.204+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 msgr2=0x7f04900cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.204+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0488013000 tx=0x7f0488019000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 shutdown_connections 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04900c3030 0x7f04900cb8e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04900aeea0 0x7f04901437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 --2- 172.21.15.6:0/1154206935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04900af270 0x7f04900c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 >> 172.21.15.6:0/1154206935 conn(0x7f049006c660 msgr2=0x7f04900c26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 shutdown_connections 2023-10-09T11:36:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.205+0000 7f0496510700 1 -- 172.21.15.6:0/1154206935 wait complete. 2023-10-09T11:36:14.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T11:36:14.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T11:36:14.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T11:36:14.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T11:36:14.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T11:36:14.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T11:36:14.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T11:36:14.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T11:36:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.426+0000 7fcfc423c700 1 Processor -- start 2023-10-09T11:36:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.426+0000 7fcfc423c700 1 -- start start 2023-10-09T11:36:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fac93e0f700 1 Processor -- start 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fcfc423c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfbc159ca0 0x7fcfbc0690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fcfc423c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcfbc15a070 0x7fcfbc06a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fcfc423c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc06acc0 con 0x7fcfbc0c8900 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fcfc423c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc06a2f0 con 0x7fcfbc159ca0 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fcfc423c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0696e0 con 0x7fcfbc15a070 2023-10-09T11:36:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.428+0000 7fcfc27d9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfbc0c8900 0x7fcfbc0cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44192/0 (socket says 172.21.15.6:44192) 2023-10-09T11:36:14.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.428+0000 7fcfc27d9700 1 -- 172.21.15.6:0/1509624560 learned_addr learned my addr 172.21.15.6:0/1509624560 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160629516 0 0) 0x7fcfb8001110 con 0x7fcfbc0c8900 2023-10-09T11:36:14.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa8003570 con 0x7fcfbc0c8900 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7fac93e0f700 1 -- start start 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac93e0f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac93e0f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fac8c0c8d50 0x7fac8c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac93e0f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0ca550 con 0x7fac8c155c60 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac93e0f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0cb3b0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac93e0f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0cbf50 con 0x7fac8c156030 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776736874 0 0) 0x7fcfa8003570 con 0x7fcfbc0c8900 2023-10-09T11:36:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 >> v2:172.21.15.118:3300/0 conn(0x7fcfbc15a070 msgr2=0x7fcfbc06a780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac91bab700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fac8c155c60 0x7fac8c0cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52630/0 (socket says 172.21.15.6:52630) 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac91bab700 1 -- 172.21.15.6:0/3816751143 learned_addr learned my addr 172.21.15.6:0/3816751143 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac923ac700 1 --2- 172.21.15.6:0/3816751143 >> v2:172.21.15.118:3300/0 conn(0x7fac8c0c8d50 0x7fac8c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.118:3300/0 conn(0x7fcfbc15a070 0x7fcfbc06a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.118:3300/0 conn(0x7fcfbc15a070 0x7fcfbc06a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 >> v2:172.21.15.6:3300/0 conn(0x7fcfbc159ca0 msgr2=0x7fcfbc0690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.6:3300/0 conn(0x7fcfbc159ca0 0x7fcfbc0690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac913aa700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7f9c5da45700 1 Processor -- start 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.427+0000 7f9c5da45700 1 -- start start 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c5da45700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c5806f580 0x7f9c580caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c5da45700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c580692a0 0x7f9c5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c5da45700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5806d220 con 0x7f9c5806f950 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c5da45700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5806d500 con 0x7f9c580692a0 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c5da45700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580cb7b0 con 0x7f9c5806f580 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c580692a0 0x7f9c5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c580692a0 0x7f9c5806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36144/0 (socket says 172.21.15.6:36144) 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c577fe700 1 -- 172.21.15.6:0/3596181319 learned_addr learned my addr 172.21.15.6:0/3596181319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7f9c56ffd700 1 --2- 172.21.15.6:0/3596181319 >> v2:172.21.15.118:3300/0 conn(0x7f9c5806f580 0x7f9c580caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.6:3300/0 conn(0x7fcfbc159ca0 0x7fcfbc0690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0699c0 con 0x7fcfbc0c8900 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fcfb8001600 con 0x7fcfbc0c8900 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.6:3300/0 conn(0x7fcfbc159ca0 0x7fcfbc0690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 >> v1:172.21.15.6:6789/0 conn(0x7fcfbc0c8900 legacy=0x7fcfbc0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 0x7fcfa8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8005410 0x7fcfa800bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc06a2f0 con 0x7fcfa8003b30 2023-10-09T11:36:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0696e0 con 0x7fcfa8004810 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8014bd0 con 0x7fcfa8005410 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/1509624560 >> v2:172.21.15.118:3300/0 conn(0x7fcfbc15a070 0x7fcfbc06a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c577fe700 1 -- 172.21.15.6:0/3596181319 >> v2:172.21.15.118:3300/0 conn(0x7f9c5806f580 msgr2=0x7f9c580caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c577fe700 1 --2- 172.21.15.6:0/3596181319 >> v2:172.21.15.118:3300/0 conn(0x7f9c5806f580 0x7f9c580caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c577fe700 1 -- 172.21.15.6:0/3596181319 >> v1:172.21.15.6:6789/0 conn(0x7f9c5806f950 legacy=0x7f9c58068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c577fe700 1 -- 172.21.15.6:0/3596181319 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580cba90 con 0x7f9c580692a0 2023-10-09T11:36:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c577fe700 1 --2- 172.21.15.6:0/3596181319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580692a0 0x7f9c5806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a720 tx=0x7f9c50007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8351b6d0c66125c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 0x7fcfa8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac923ac700 1 -- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 msgr2=0x7fac8c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac923ac700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac923ac700 1 -- 172.21.15.6:0/3816751143 >> v1:172.21.15.118:6789/0 conn(0x7fac8c155c60 legacy=0x7fac8c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.429+0000 7fac923ac700 1 -- 172.21.15.6:0/3816751143 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0ca7a0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fac923ac700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c0c8d50 0x7fac8c159ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac8400bb80 tx=0x7fac8400b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bab91a10b1e3c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c55ffb700 1 -- 172.21.15.6:0/3596181319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000fcb0 con 0x7f9c580692a0 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc27d9700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8005410 0x7fcfa800bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 -- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8005410 msgr2=0x7fcfa800bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c55ffb700 1 -- 172.21.15.6:0/3596181319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000fe10 con 0x7f9c580692a0 2023-10-09T11:36:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7f9c55ffb700 1 -- 172.21.15.6:0/3596181319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50009260 con 0x7f9c580692a0 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8005410 0x7fcfa800bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 -- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa8004810 msgr2=0x7fcfa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa8004810 0x7fcfa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 -- 172.21.15.6:0/1509624560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8003570 con 0x7fcfa8003b30 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc27d9700 1 -- 172.21.15.6:0/1509624560 reap_dead start 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.430+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 0x7fcfa8003f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c520 tx=0x7fcfb4007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de706457cff1991 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007a70 con 0x7fcfa8003b30 2023-10-09T11:36:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fac90ba9700 1 -- 172.21.15.6:0/3816751143 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400b030 con 0x7fac8c0c8d50 2023-10-09T11:36:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fac90ba9700 1 -- 172.21.15.6:0/3816751143 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8400da90 con 0x7fac8c0c8d50 2023-10-09T11:36:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fac90ba9700 1 -- 172.21.15.6:0/3816751143 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8400de50 con 0x7fac8c0c8d50 2023-10-09T11:36:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 -- 172.21.15.6:0/3596181319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580692a0 msgr2=0x7f9c5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 --2- 172.21.15.6:0/3596181319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580692a0 0x7f9c5806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a720 tx=0x7f9c50007230 comp rx=0 tx=0).stop 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 -- 172.21.15.6:0/3596181319 shutdown_connections 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 --2- 172.21.15.6:0/3596181319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580692a0 0x7f9c5806d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 --2- 172.21.15.6:0/3596181319 >> v2:172.21.15.118:3300/0 conn(0x7f9c5806f580 0x7f9c580caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7f9c5da45700 1 -- 172.21.15.6:0/3596181319 >> 172.21.15.6:0/3596181319 conn(0x7f9c580cc980 msgr2=0x7f9c580ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb400ce10 con 0x7fcfa8003b30 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.431+0000 7fcfc0fd6700 1 -- 172.21.15.6:0/1509624560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400a660 con 0x7fcfa8003b30 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fcfc423c700 1 -- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 msgr2=0x7fcfa8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fcfc423c700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 0x7fcfa8003f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c520 tx=0x7fcfb4007740 comp rx=0 tx=0).stop 2023-10-09T11:36:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 -- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c0c8d50 msgr2=0x7fac8c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c0c8d50 0x7fac8c159ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac8400bb80 tx=0x7fac8400b420 comp rx=0 tx=0).stop 2023-10-09T11:36:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f9c5da45700 1 -- 172.21.15.6:0/3596181319 shutdown_connections 2023-10-09T11:36:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f9c5da45700 1 -- 172.21.15.6:0/3596181319 wait complete. 2023-10-09T11:36:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f3ff43e0700 1 Processor -- start 2023-10-09T11:36:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fcfc423c700 1 -- 172.21.15.6:0/1509624560 shutdown_connections 2023-10-09T11:36:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fcfc423c700 1 --2- 172.21.15.6:0/1509624560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa8003b30 0x7fcfa8003f40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fcfc423c700 1 -- 172.21.15.6:0/1509624560 >> 172.21.15.6:0/1509624560 conn(0x7fcfbc0cc980 msgr2=0x7fcfbc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 -- 172.21.15.6:0/3816751143 shutdown_connections 2023-10-09T11:36:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c0c8d50 0x7fac8c159ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 --2- 172.21.15.6:0/3816751143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 -- 172.21.15.6:0/3816751143 >> 172.21.15.6:0/3816751143 conn(0x7fac8c0cc980 msgr2=0x7fac8c0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f3ff43e0700 1 -- start start 2023-10-09T11:36:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 -- 172.21.15.6:0/3816751143 shutdown_connections 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f25daf1f700 1 Processor -- start 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f25daf1f700 1 -- start start 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f3ff43e0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fec1578d0 0x7f3fec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f3ff43e0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0d07c0 con 0x7f3fec157ca0 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f3ff43e0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0cfbb0 con 0x7f3fec06d120 2023-10-09T11:36:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f3ff43e0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0cfe90 con 0x7f3fec1578d0 2023-10-09T11:36:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7fac93e0f700 1 -- 172.21.15.6:0/3816751143 wait complete. 2023-10-09T11:36:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f9c5da45700 1 Processor -- start 2023-10-09T11:36:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25daf1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 0x7f25d40cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25daf1f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25d40cbd10 0x7f25d4069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25daf1f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d40cb880 con 0x7f25d40cc180 2023-10-09T11:36:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25daf1f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d406aa10 con 0x7f25d40cbd10 2023-10-09T11:36:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25daf1f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40cac70 con 0x7f25d4156420 2023-10-09T11:36:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f9c5da45700 1 -- start start 2023-10-09T11:36:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7fac93e0f700 1 Processor -- start 2023-10-09T11:36:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d94bc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f25d40cc180 0x7f25d40c71d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44222/0 (socket says 172.21.15.6:44222) 2023-10-09T11:36:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d94bc700 1 -- 172.21.15.6:0/1456561115 learned_addr learned my addr 172.21.15.6:0/1456561115 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7fac93e0f700 1 -- start start 2023-10-09T11:36:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fec1578d0 0x7f3fec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fec1578d0 0x7f3fec0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:35874/0 (socket says 172.21.15.6:35874) 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 -- 172.21.15.6:0/2148887039 learned_addr learned my addr 172.21.15.6:0/2148887039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25cbfff700 1 --2- 172.21.15.6:0/1456561115 >> v2:172.21.15.6:3300/0 conn(0x7f25d40cbd10 0x7f25d4069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/1456561115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 0x7f25d40cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 -- 172.21.15.6:0/2148887039 >> v1:172.21.15.118:6789/0 conn(0x7f3fec06d120 legacy=0x7f3fec06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 -- 172.21.15.6:0/2148887039 >> v1:172.21.15.6:6789/0 conn(0x7f3fec157ca0 legacy=0x7f3fec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f3ff217c700 1 -- 172.21.15.6:0/2148887039 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0d0170 con 0x7f3fec1578d0 2023-10-09T11:36:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d8cbb700 1 -- 172.21.15.6:0/1456561115 >> v2:172.21.15.6:3300/0 conn(0x7f25d40cbd10 msgr2=0x7f25d4069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/1456561115 >> v2:172.21.15.6:3300/0 conn(0x7f25d40cbd10 0x7f25d4069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d8cbb700 1 -- 172.21.15.6:0/1456561115 >> v1:172.21.15.6:6789/0 conn(0x7f25d40cc180 legacy=0x7f25d40c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f25d8cbb700 1 -- 172.21.15.6:0/1456561115 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40caf50 con 0x7f25d4156420 2023-10-09T11:36:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/1456561115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 0x7f25d40cd090 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098e0 tx=0x7f25d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1970d6e218cf5be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f3ff217c700 1 --2- 172.21.15.6:0/2148887039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec1578d0 0x7f3fec0cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80099b0 tx=0x7f3fe8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed84e472a954665e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c580692a0 0x7f9c580c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f3ff117a700 1 -- 172.21.15.6:0/2148887039 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800b820 con 0x7f3fec1578d0 2023-10-09T11:36:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f3ff117a700 1 -- 172.21.15.6:0/2148887039 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800b980 con 0x7f3fec1578d0 2023-10-09T11:36:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f3ff117a700 1 -- 172.21.15.6:0/2148887039 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800bd20 con 0x7f3fec1578d0 2023-10-09T11:36:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5806f580 0x7f9c580b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 0x7f9c58164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580afe00 con 0x7f9c5806f580 2023-10-09T11:36:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b00e0 con 0x7f9c580692a0 2023-10-09T11:36:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c5da45700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580b03c0 con 0x7f9c5806f950 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f9aa5dd0700 1 Processor -- start 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.432+0000 7f9aa5dd0700 1 -- start start 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f9aa5dd0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9aa015f450 0x7f9aa015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f9aa5dd0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00cbd70 con 0x7f9aa0069390 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 0x7fac8c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c155c60 0x7fac8c0c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f9aa5dd0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa015f820 con 0x7f9aa00ca980 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.433+0000 7f9aa5dd0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa00cb160 con 0x7f9aa015f450 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f9a9ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9aa0069390 0x7f9aa00c74f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44208/0 (socket says 172.21.15.6:44208) 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f9a9ffff700 1 -- 172.21.15.6:0/3623676784 learned_addr learned my addr 172.21.15.6:0/3623676784 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.434+0000 7f9a9f7fe700 1 --2- 172.21.15.6:0/3623676784 >> v2:172.21.15.6:3300/0 conn(0x7f9aa015f450 0x7f9aa015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/3623676784 >> v1:172.21.15.118:6789/0 conn(0x7f9aa00ca980 legacy=0x7f9aa0068c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0c6170 con 0x7fac8c0c8d50 2023-10-09T11:36:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0c4930 con 0x7fac8c155c60 2023-10-09T11:36:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac93e0f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c153670 con 0x7fac8c156030 2023-10-09T11:36:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/3623676784 >> v1:172.21.15.6:6789/0 conn(0x7f9aa0069390 legacy=0x7f9aa00c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/3623676784 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00cb440 con 0x7f9aa015f450 2023-10-09T11:36:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c56ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c580692a0 0x7f9c580c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c577fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 0x7f9c58164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c577fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 0x7f9c58164090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44464/0 (socket says 172.21.15.6:44464) 2023-10-09T11:36:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c577fe700 1 -- 172.21.15.6:0/364883219 learned_addr learned my addr 172.21.15.6:0/364883219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f9c567fc700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5806f580 0x7f9c580b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac91bab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 0x7fac8c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac91bab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 0x7fac8c152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36190/0 (socket says 172.21.15.6:36190) 2023-10-09T11:36:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac91bab700 1 -- 172.21.15.6:0/2313940425 learned_addr learned my addr 172.21.15.6:0/2313940425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7fac913aa700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c155c60 0x7fac8c0c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac923ac700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 -- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 msgr2=0x7f9c58164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 0x7f9c58164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 -- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c580692a0 msgr2=0x7f9c580c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c580692a0 0x7f9c580c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009580 con 0x7f9c5806f580 2023-10-09T11:36:14.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c577fe700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c5806f950 0x7f9c58164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 -- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 msgr2=0x7fac8c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fac8c156030 0x7fac8c06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 -- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c155c60 msgr2=0x7fac8c0c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac8c155c60 0x7fac8c0c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8400b6c0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2148887039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec1578d0 msgr2=0x7f3fec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f3ff43e0700 1 --2- 172.21.15.6:0/2148887039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec1578d0 0x7f3fec0cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80099b0 tx=0x7f3fe8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fcfc423c700 1 -- 172.21.15.6:0/1509624560 shutdown_connections 2023-10-09T11:36:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9c567fc700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5806f580 0x7f9c580b0ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800c8e0 tx=0x7f9c480016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fcfc423c700 1 -- 172.21.15.6:0/1509624560 wait complete. 2023-10-09T11:36:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9a9f7fe700 1 --2- 172.21.15.6:0/3623676784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa015f450 0x7f9aa015e920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a900098e0 tx=0x7f9a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28efadcf7b3a19c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9a9e7fc700 1 -- 172.21.15.6:0/3623676784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90009e80 con 0x7f9aa015f450 2023-10-09T11:36:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2148887039 shutdown_connections 2023-10-09T11:36:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f3ff43e0700 1 --2- 172.21.15.6:0/2148887039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec1578d0 0x7f3fec0cf4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2148887039 >> 172.21.15.6:0/2148887039 conn(0x7f3fec06bb90 msgr2=0x7f3fec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7fac91bab700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 0x7fac8c152810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac8000cae0 tx=0x7fac80007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f25cb7fe700 1 -- 172.21.15.6:0/1456561115 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0009e80 con 0x7f25d4156420 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f25cb7fe700 1 -- 172.21.15.6:0/1456561115 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000b860 con 0x7f25d4156420 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.435+0000 7f25cb7fe700 1 -- 172.21.15.6:0/1456561115 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000bbe0 con 0x7f25d4156420 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 -- 172.21.15.6:0/1456561115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 msgr2=0x7f25d40cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 --2- 172.21.15.6:0/1456561115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 0x7f25d40cd090 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098e0 tx=0x7f25d00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 -- 172.21.15.6:0/1456561115 shutdown_connections 2023-10-09T11:36:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 --2- 172.21.15.6:0/1456561115 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d4156420 0x7f25d40cd090 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 --2- 172.21.15.6:0/1456561115 >> v2:172.21.15.6:3300/0 conn(0x7f25d40cbd10 0x7f25d4069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f25daf1f700 1 -- 172.21.15.6:0/1456561115 >> 172.21.15.6:0/1456561115 conn(0x7f25d406c660 msgr2=0x7f25d40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80007030 con 0x7fac8c0c8d50 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac800071b0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8000a7a0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c165da0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c166000 con 0x7fac8c0c8d50 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9a9e7fc700 1 -- 172.21.15.6:0/3623676784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9000b820 con 0x7f9aa015f450 2023-10-09T11:36:14.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.436+0000 7f9a9e7fc700 1 -- 172.21.15.6:0/3623676784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000bba0 con 0x7f9aa015f450 2023-10-09T11:36:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/3623676784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa015f450 msgr2=0x7f9aa015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.437+0000 7f9aa5dd0700 1 --2- 172.21.15.6:0/3623676784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa015f450 0x7f9aa015e920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a900098e0 tx=0x7f9a900091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/3623676784 shutdown_connections 2023-10-09T11:36:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9aa5dd0700 1 --2- 172.21.15.6:0/3623676784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa015f450 0x7f9aa015e920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/3623676784 >> 172.21.15.6:0/3623676784 conn(0x7f9aa00ccdb0 msgr2=0x7f9aa00cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2148887039 shutdown_connections 2023-10-09T11:36:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2148887039 wait complete. 2023-10-09T11:36:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/3623676784 shutdown_connections 2023-10-09T11:36:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f25daf1f700 1 -- 172.21.15.6:0/1456561115 shutdown_connections 2023-10-09T11:36:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f25daf1f700 1 -- 172.21.15.6:0/1456561115 wait complete. 2023-10-09T11:36:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7fcfc423c700 1 Processor -- start 2023-10-09T11:36:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac8c067bc0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012630 con 0x7f9c5806f580 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c480127b0 con 0x7f9c5806f580 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012b70 con 0x7f9c5806f580 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580b06a0 con 0x7f9c5806f580 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c580c6030 con 0x7f9c5806f580 2023-10-09T11:36:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7f3ff43e0700 1 Processor -- start 2023-10-09T11:36:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/3623676784 wait complete. 2023-10-09T11:36:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7f3ff43e0700 1 -- start start 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.438+0000 7fcfc423c700 1 -- start start 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8003b30 0x7fcfbc0af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc166f60 0x7fcfbc14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfbc158290 0x7fcfbc158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc158c50 con 0x7fcfbc166f60 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b0a80 con 0x7fcfbc158290 2023-10-09T11:36:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fcfc423c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0afe70 con 0x7fcfa8003b30 2023-10-09T11:36:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f25daf1f700 1 Processor -- start 2023-10-09T11:36:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fcfc27d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfbc158290 0x7fcfbc158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c58067bc0 con 0x7f9c5806f580 2023-10-09T11:36:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f4529806700 1 Processor -- start 2023-10-09T11:36:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f4529806700 1 -- start start 2023-10-09T11:36:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f9aa5dd0700 1 Processor -- start 2023-10-09T11:36:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fcfc1fd8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8003b30 0x7fcfbc0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fcfc1fd8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8003b30 0x7fcfbc0af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44472/0 (socket says 172.21.15.6:44472) 2023-10-09T11:36:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fcfc1fd8700 1 -- 172.21.15.6:0/3738074806 learned_addr learned my addr 172.21.15.6:0/3738074806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.439+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac8000ab50 con 0x7fac8c0c8d50 2023-10-09T11:36:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fac89ffb700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac70067000 0x7fac700694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc166f60 0x7fcfbc14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac80055bc0 con 0x7fac8c0c8d50 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fac89ffb700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7fac7006f180 0x7fac70071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac70071c40 con 0x7fac7006f180 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fec06d120 0x7f3fec0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fec1578d0 0x7f3fec16a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec157ca0 0x7f3fec16a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0c7680 con 0x7f3fec1578d0 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0c71f0 con 0x7f3fec157ca0 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff43e0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0c65e0 con 0x7f3fec06d120 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff297d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec157ca0 0x7f3fec16a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff297d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec157ca0 0x7f3fec16a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:35906/0 (socket says 172.21.15.6:35906) 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f9aa5dd0700 1 -- start start 2023-10-09T11:36:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff297d700 1 -- 172.21.15.6:0/2044691702 learned_addr learned my addr 172.21.15.6:0/2044691702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fec06d120 0x7f3fec0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 0x7f9aa00c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa00ca980 0x7f9aa00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa015f450 0x7f9aa0140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01581b0 con 0x7f9aa00ca980 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0158450 con 0x7f9aa015f450 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9aa5dd0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0158730 con 0x7f9aa0069390 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9a9f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 0x7f9aa00c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9a9f7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 0x7f9aa00c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44488/0 (socket says 172.21.15.6:44488) 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/1847134975 learned_addr learned my addr 172.21.15.6:0/1847134975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fcfc27d9700 1 -- 172.21.15.6:0/3738074806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8003b30 msgr2=0x7fcfbc0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fcfc27d9700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfa8003b30 0x7fcfbc0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fcfc27d9700 1 -- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc166f60 msgr2=0x7fcfbc14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fcfc27d9700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc166f60 0x7fcfbc14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fcfc27d9700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0b0150 con 0x7fcfbc158290 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f4529806700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4524156db0 0x7f452406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f4529806700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 0x7f452406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f4529806700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452406ebd0 con 0x7f45241569e0 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f4529806700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240b2290 con 0x7f4524156db0 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f4529806700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524157c00 con 0x7f452406e770 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.440+0000 7f25daf1f700 1 -- start start 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 0x7f25d41777f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40cc180 0x7f25d4170be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25d4156420 0x7f25d4145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4177d30 con 0x7f25d4156420 2023-10-09T11:36:14.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41434d0 con 0x7f25d40cc180 2023-10-09T11:36:14.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f25daf1f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41437b0 con 0x7f25d40cbd10 2023-10-09T11:36:14.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7fac913aa700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac70067000 0x7fac700694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 -- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec157ca0 msgr2=0x7f3fec16a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec157ca0 0x7f3fec16a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 -- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fec1578d0 msgr2=0x7f3fec16a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fec1578d0 0x7f3fec16a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.441+0000 7f3ff217c700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80094f0 con 0x7f3fec06d120 2023-10-09T11:36:14.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9ffff700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa015f450 0x7f9aa0140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac80051800 con 0x7fac8c0c8d50 2023-10-09T11:36:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 0x7f25d41777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9effd700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa00ca980 0x7f9aa00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa015f450 msgr2=0x7f9aa0140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9f7fe700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa015f450 0x7f9aa0140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa00ca980 msgr2=0x7f9aa00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 0x7f25d41777f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44514/0 (socket says 172.21.15.6:44514) 2023-10-09T11:36:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 -- 172.21.15.6:0/2855113617 learned_addr learned my addr 172.21.15.6:0/2855113617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25cbfff700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40cc180 0x7f25d4170be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4524156db0 0x7f452406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45237fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 0x7f452406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4524156db0 0x7f452406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:35924/0 (socket says 172.21.15.6:35924) 2023-10-09T11:36:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 -- 172.21.15.6:0/3081577133 learned_addr learned my addr 172.21.15.6:0/3081577133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d94bc700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25d4156420 0x7f25d4145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7fac923ac700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7fac7006f180 0x7fac70071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f3ff217c700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fec06d120 0x7f3fec0c5b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8002000 tx=0x7f3fe8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9f7fe700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa00ca980 0x7f9aa00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9f7fe700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009420 con 0x7f9aa0069390 2023-10-09T11:36:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9a9effd700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9aa00ca980 0x7f9aa00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:14.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7fcfc27d9700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfbc158290 0x7fcfbc158710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc069820 tx=0x7fcfbc06a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 -- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40cc180 msgr2=0x7f25d4170be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40cc180 0x7f25d4170be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 -- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25d4156420 msgr2=0x7f25d4145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25d4156420 0x7f25d4145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f25d8cbb700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0009420 con 0x7f25d40cbd10 2023-10-09T11:36:14.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 -- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 msgr2=0x7f452406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 0x7f452406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 -- 172.21.15.6:0/3081577133 >> v1:172.21.15.6:6789/0 conn(0x7f45241569e0 legacy=0x7f45240b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45227fc700 1 -- 172.21.15.6:0/3081577133 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45241572d0 con 0x7f4524156db0 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f45237fe700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 0x7f452406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8010450 con 0x7fcfbc158290 2023-10-09T11:36:14.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c48003030 con 0x7f9c5806f580 2023-10-09T11:36:14.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80105d0 con 0x7fcfbc158290 2023-10-09T11:36:14.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc0b0430 con 0x7fcfbc158290 2023-10-09T11:36:14.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8010990 con 0x7fcfbc158290 2023-10-09T11:36:14.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f45227fc700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4524156db0 0x7f452406e230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45140099b0 tx=0x7f4514009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808cb01d26cbcd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fac913aa700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac70067000 0x7fac700694b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac8c06db60 tx=0x7fac78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f25d8cbb700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 0x7f25d41777f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25d00093f0 tx=0x7f25d0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fac923ac700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7fac7006f180 0x7fac70071590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f9c4effd700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c38067000 0x7f9c380694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc1673d0 con 0x7fcfbc158290 2023-10-09T11:36:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c48084a80 con 0x7f9c5806f580 2023-10-09T11:36:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfbc067bc0 con 0x7fcfbc158290 2023-10-09T11:36:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000b9d0 con 0x7f25d40cbd10 2023-10-09T11:36:14.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000bb30 con 0x7f25d40cbd10 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d001a680 con 0x7f25d40cbd10 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d4143a90 con 0x7f25d40cbd10 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d4144050 con 0x7f25d40cbd10 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== osd.2 v2:172.21.15.6:6800/86375 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fac70071c40 con 0x7fac7006f180 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800bc40 con 0x7f3fec06d120 2023-10-09T11:36:14.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8020070 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.442+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe801b6a0 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0c68c0 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0c6e80 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fec067ac0 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fe8022030 con 0x7f3fec06d120 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f9c4effd700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f9c3806f210 0x7f9c38071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c38071cd0 con 0x7f9c3806f210 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c48084e50 con 0x7f9c5806f580 2023-10-09T11:36:14.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f9c56ffd700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c38067000 0x7f9c380694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f9c577fe700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f9c3806f210 0x7f9c38071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f9c577fe700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f9c3806f210 0x7f9c38071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f9c56ffd700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c38067000 0x7f9c380694b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c580c2070 tx=0x7f9c4000e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f4521ffb700 1 -- 172.21.15.6:0/3081577133 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514009ea0 con 0x7f4524156db0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f4521ffb700 1 -- 172.21.15.6:0/3081577133 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451400b860 con 0x7f4524156db0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.443+0000 7f4521ffb700 1 -- 172.21.15.6:0/3081577133 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400bc00 con 0x7f4524156db0 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f4529806700 1 -- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4524156db0 msgr2=0x7f452406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f4529806700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4524156db0 0x7f452406e230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45140099b0 tx=0x7f4514009250 comp rx=0 tx=0).stop 2023-10-09T11:36:14.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.444+0000 7f9a9f7fe700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 0x7f9aa00c3e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a900030c0 tx=0x7f9a90016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== osd.4 v2:172.21.15.118:6800/86573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f9c38071cd0 con 0x7f9c3806f210 2023-10-09T11:36:14.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25d4067bc0 con 0x7f25d40cbd10 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f3fe27fc700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3fd0067000 0x7f3fd00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fe8086390 con 0x7f3fec06d120 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f3fe27fc700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f3fd006f210 0x7f3fd0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fd0071cd0 con 0x7f3fd006f210 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fe80889d0 con 0x7f3fec06d120 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9001b470 con 0x7f9aa0069390 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9001b5f0 con 0x7f9aa0069390 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9001b9b0 con 0x7f9aa0069390 2023-10-09T11:36:14.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0158a10 con 0x7f9aa0069390 2023-10-09T11:36:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00c43a0 con 0x7f9aa0069390 2023-10-09T11:36:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7f3ff197b700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3fd0067000 0x7f3fd00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7f3ff297d700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f3fd006f210 0x7f3fd0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25d001aab0 con 0x7f25d40cbd10 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.445+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfb80133e0 con 0x7fcfbc158290 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfb1ffb700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfa0066fb0 0x7fcfa0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcfb8083940 con 0x7fcfbc158290 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfb1ffb700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fcfa006f140 0x7fcfa0071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfa0071c00 con 0x7fcfa006f140 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fcfa006f140 0x7fcfa0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.446+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfa0066fb0 0x7fcfa0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a80000fd0 con 0x7f9aa0069390 2023-10-09T11:36:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7fcfc17d7700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fcfa006f140 0x7fcfa0071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25c8ff9700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0067000 0x7f25c00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f3ff297d700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f3fd006f210 0x7f3fd0071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f4529806700 1 -- 172.21.15.6:0/3081577133 shutdown_connections 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f4529806700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f452406e770 0x7f452406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f4529806700 1 --2- 172.21.15.6:0/3081577133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4524156db0 0x7f452406e230 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f4529806700 1 -- 172.21.15.6:0/3081577133 >> 172.21.15.6:0/3081577133 conn(0x7f452406cca0 msgr2=0x7f452406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfb8050b10 con 0x7fcfbc158290 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7fcfc1fd8700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfa0066fb0 0x7fcfa0069460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc1530c0 tx=0x7fcfb4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a9001c450 con 0x7f9aa0069390 2023-10-09T11:36:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a877fe700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a8c067000 0x7f9a8c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f3ff197b700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3fd0067000 0x7f3fd00694b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fec155800 tx=0x7f3fdc006c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a90086090 con 0x7f9aa0069390 2023-10-09T11:36:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f25d0086140 con 0x7f25d40cbd10 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25c8ff9700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7f25c006f190 0x7f25c00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25c0071c50 con 0x7f25c006f190 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d0053390 con 0x7f25d40cbd10 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.447+0000 7f25cbfff700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0067000 0x7f25c00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f25d94bc700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7f25c006f190 0x7f25c00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a877fe700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f9a8c06f210 0x7f9a8c071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a9effd700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a8c067000 0x7f9a8c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a8c071cd0 con 0x7f9a8c06f210 2023-10-09T11:36:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a900886d0 con 0x7f9aa0069390 2023-10-09T11:36:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f4529806700 1 -- 172.21.15.6:0/3081577133 shutdown_connections 2023-10-09T11:36:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== osd.0 v2:172.21.15.6:6821/86385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcfa0071c00 con 0x7fcfa006f140 2023-10-09T11:36:14.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f81f507d700 1 Processor -- start 2023-10-09T11:36:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== osd.3 v2:172.21.15.6:6816/86387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3fd0071cd0 con 0x7f3fd006f210 2023-10-09T11:36:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f9a9ffff700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f9a8c06f210 0x7f9a8c071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.449+0000 7f9a9effd700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a8c067000 0x7f9a8c0694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a94006fd0 tx=0x7f9a94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.449+0000 7f9a9ffff700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f9a8c06f210 0x7f9a8c071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.449+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== osd.7 v2:172.21.15.118:6823/86576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f9a8c071cd0 con 0x7f9a8c06f210 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f81f507d700 1 -- start start 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81f507d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81f01578d0 0x7f81f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81f507d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 0x7f81f006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81f507d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f00d07c0 con 0x7f81f0157ca0 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81f507d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f006da50 con 0x7f81f006d120 2023-10-09T11:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81f507d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00cfbb0 con 0x7f81f01578d0 2023-10-09T11:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f25cbfff700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0067000 0x7f25c00694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25d4155200 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81ef59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 0x7f81f006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.448+0000 7f4529806700 1 -- 172.21.15.6:0/3081577133 wait complete. 2023-10-09T11:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f4529806700 1 Processor -- start 2023-10-09T11:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81ef59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 0x7f81f006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36242/0 (socket says 172.21.15.6:36242) 2023-10-09T11:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81ef59e700 1 -- 172.21.15.6:0/1368302767 learned_addr learned my addr 172.21.15.6:0/1368302767 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f25d94bc700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7f25c006f190 0x7f25c00715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81eed9d700 1 --2- 172.21.15.6:0/1368302767 >> v2:172.21.15.118:3300/0 conn(0x7f81f01578d0 0x7f81f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81eed9d700 1 -- 172.21.15.6:0/1368302767 >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 msgr2=0x7f81f006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81eed9d700 1 --2- 172.21.15.6:0/1368302767 >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 0x7f81f006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81eed9d700 1 -- 172.21.15.6:0/1368302767 >> v1:172.21.15.6:6789/0 conn(0x7f81f0157ca0 legacy=0x7f81f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.450+0000 7f81eed9d700 1 -- 172.21.15.6:0/1368302767 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00cfe90 con 0x7f81f01578d0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.451+0000 7f81eed9d700 1 --2- 172.21.15.6:0/1368302767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f01578d0 0x7f81f00cf4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81f00646b0 tx=0x7f81e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e70d401691c6a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.451+0000 7f81edd9b700 1 -- 172.21.15.6:0/1368302767 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011630 con 0x7f81f01578d0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.451+0000 7f81edd9b700 1 -- 172.21.15.6:0/1368302767 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4011790 con 0x7f81f01578d0 2023-10-09T11:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.451+0000 7f81edd9b700 1 -- 172.21.15.6:0/1368302767 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011b50 con 0x7f81f01578d0 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.452+0000 7f81f507d700 1 -- 172.21.15.6:0/1368302767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f01578d0 msgr2=0x7f81f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.452+0000 7f81f507d700 1 --2- 172.21.15.6:0/1368302767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f01578d0 0x7f81f00cf4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81f00646b0 tx=0x7f81e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.452+0000 7f4529806700 1 -- start start 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f452406e770 0x7f45240ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45241569e0 0x7f4524144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 0x7f45241497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4524143f50 con 0x7f452406e770 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240af3a0 con 0x7f45241569e0 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4529806700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ae790 con 0x7f4524156db0 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f81f507d700 1 -- 172.21.15.6:0/1368302767 shutdown_connections 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f81f507d700 1 --2- 172.21.15.6:0/1368302767 >> v2:172.21.15.6:3300/0 conn(0x7f81f006d120 0x7f81f006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f81f507d700 1 --2- 172.21.15.6:0/1368302767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f01578d0 0x7f81f00cf4f0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81f00646b0 tx=0x7f81e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f81f507d700 1 -- 172.21.15.6:0/1368302767 >> 172.21.15.6:0/1368302767 conn(0x7f81f006bb90 msgr2=0x7f81f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f45237fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 0x7f45241497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f45237fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 0x7f45241497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44528/0 (socket says 172.21.15.6:44528) 2023-10-09T11:36:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f45237fe700 1 -- 172.21.15.6:0/3064223955 learned_addr learned my addr 172.21.15.6:0/3064223955 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f4522ffd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f452406e770 0x7f45240ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.453+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== osd.1 v2:172.21.15.6:6808/86376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f25c0071c50 con 0x7f25c006f190 2023-10-09T11:36:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 -- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 msgr2=0x7f45241497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f81f507d700 1 -- 172.21.15.6:0/1368302767 shutdown_connections 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 0x7f45241497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 -- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45241569e0 msgr2=0x7f4524144d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45241569e0 0x7f4524144d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518009420 con 0x7f452406e770 2023-10-09T11:36:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f45237fe700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4524156db0 0x7f45241497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f81f507d700 1 -- 172.21.15.6:0/1368302767 wait complete. 2023-10-09T11:36:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.454+0000 7f4522ffd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f452406e770 0x7f45240ae120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c910 tx=0x7f451c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.456+0000 7f81f507d700 1 Processor -- start 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.463+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c006ba0 con 0x7f452406e770 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.463+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c006d20 con 0x7f452406e770 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.463+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c012880 con 0x7f452406e770 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.464+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140094f0 con 0x7f452406e770 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.464+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240aed50 con 0x7f452406e770 2023-10-09T11:36:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.464+0000 7f81f507d700 1 -- start start 2023-10-09T11:36:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 --> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c580cbd70 con 0x7f9c3806f210 2023-10-09T11:36:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006d120 0x7f81f00b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4524068900 con 0x7f452406e770 2023-10-09T11:36:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f0157ca0 0x7f81f014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81f016f3b0 0x7f81f0089d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00898e0 con 0x7f81f006d120 2023-10-09T11:36:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b66d0 con 0x7f81f0157ca0 2023-10-09T11:36:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81f507d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0088fb0 con 0x7f81f016f3b0 2023-10-09T11:36:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 --> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fec0d0450 con 0x7f3fd006f210 2023-10-09T11:36:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81ef59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81f016f3b0 0x7f81f0089d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81ef59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81f016f3b0 0x7f81f0089d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44532/0 (socket says 172.21.15.6:44532) 2023-10-09T11:36:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.465+0000 7f81ef59e700 1 -- 172.21.15.6:0/3930224129 learned_addr learned my addr 172.21.15.6:0/3930224129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f9c4effd700 1 -- 172.21.15.6:0/364883219 <== osd.4 v2:172.21.15.118:6800/86573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c580cbd70 con 0x7f9c3806f210 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006d120 0x7f81f00b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 -- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81f016f3b0 msgr2=0x7f81f0089d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81f016f3b0 0x7f81f0089d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 -- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f0157ca0 msgr2=0x7f81f014d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f0157ca0 0x7f81f014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 -- 172.21.15.6:0/3930224129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009420 con 0x7f81f006d120 2023-10-09T11:36:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.466+0000 7f81eed9d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006d120 0x7f81f00b60f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81e4015000 tx=0x7f81e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451c012c70 con 0x7f452406e770 2023-10-09T11:36:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011b10 con 0x7f81f006d120 2023-10-09T11:36:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4020070 con 0x7f81f006d120 2023-10-09T11:36:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40276d0 con 0x7f81f006d120 2023-10-09T11:36:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f0089290 con 0x7f81f006d120 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f016f850 con 0x7f81f006d120 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510067080 0x7f4510069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f451c084da0 con 0x7f452406e770 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7f451006f290 0x7f45100716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4510071d50 con 0x7f451006f290 2023-10-09T11:36:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.467+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f451c0850d0 con 0x7f452406e770 2023-10-09T11:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.468+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81e4027a40 con 0x7f81f006d120 2023-10-09T11:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f81d6ffd700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81dc067000 0x7f81dc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81e4022070 con 0x7f81f006d120 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f9c3806f210 msgr2=0x7f9c38071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f9c3806f210 0x7f9c38071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c38067000 msgr2=0x7f9c380694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c38067000 0x7f9c380694b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c580c2070 tx=0x7f9c4000e040 comp rx=0 tx=0).stop 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5806f580 msgr2=0x7f9c580b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 --2- 172.21.15.6:0/364883219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c5806f580 0x7f9c580b0ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800c8e0 tx=0x7f9c480016f0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c577fe700 1 -- 172.21.15.6:0/364883219 reap_dead start 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 shutdown_connections 2023-10-09T11:36:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 >> 172.21.15.6:0/364883219 conn(0x7f9c580cc980 msgr2=0x7f9c58164d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f81f507d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7f81f008ac30 0x7f81f008b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 --> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81f00d0170 con 0x7f81f008ac30 2023-10-09T11:36:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 shutdown_connections 2023-10-09T11:36:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.469+0000 7f9c5da45700 1 -- 172.21.15.6:0/364883219 wait complete. 2023-10-09T11:36:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f81ef59e700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7f81f008ac30 0x7f81f008b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f45227fc700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510067080 0x7f4510069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f45237fe700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7f451006f290 0x7f45100716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f45227fc700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510067080 0x7f4510069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45140099b0 tx=0x7f4514017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f45237fe700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7f451006f290 0x7f45100716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.470+0000 7f81ef59e700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7f81f008ac30 0x7f81f008b000 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.471+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== osd.6 v2:172.21.15.118:6813/86575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f4510071d50 con 0x7f451006f290 2023-10-09T11:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.471+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== osd.5 v2:172.21.15.118:6803/86574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f81f00d0170 con 0x7f81f008ac30 2023-10-09T11:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.473+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 --> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac8c0caa80 con 0x7fac7006f180 2023-10-09T11:36:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.473+0000 7f81ee59c700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81dc067000 0x7f81dc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.473+0000 7fac89ffb700 1 -- 172.21.15.6:0/2313940425 <== osd.2 v2:172.21.15.6:6800/86375 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac8c0caa80 con 0x7fac7006f180 2023-10-09T11:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.474+0000 7f3fe27fc700 1 -- 172.21.15.6:0/2044691702 <== osd.3 v2:172.21.15.6:6816/86387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fec0d0450 con 0x7f3fd006f210 2023-10-09T11:36:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.474+0000 7f81ee59c700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81dc067000 0x7f81dc0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81f01580c0 tx=0x7f81e0006c40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f3fd006f210 msgr2=0x7f3fd0071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f3fd006f210 0x7f3fd0071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 --> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a80002d30 con 0x7f9a8c06f210 2023-10-09T11:36:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3fd0067000 msgr2=0x7f3fd00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3fd0067000 0x7f3fd00694b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fec155800 tx=0x7f3fdc006c60 comp rx=0 tx=0).stop 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fec06d120 msgr2=0x7f3fec0c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.476+0000 7f3ff43e0700 1 --2- 172.21.15.6:0/2044691702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3fec06d120 0x7f3fec0c5b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8002000 tx=0x7f3fe8016000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f3ff297d700 1 -- 172.21.15.6:0/2044691702 reap_dead start 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9a877fe700 1 -- 172.21.15.6:0/1847134975 <== osd.7 v2:172.21.15.118:6823/86576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a80002d30 con 0x7f9a8c06f210 2023-10-09T11:36:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 --> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfbc06acc0 con 0x7fcfa006f140 2023-10-09T11:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 shutdown_connections 2023-10-09T11:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 >> 172.21.15.6:0/2044691702 conn(0x7f3fec06bb90 msgr2=0x7f3fec156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 shutdown_connections 2023-10-09T11:36:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f3ff43e0700 1 -- 172.21.15.6:0/2044691702 wait complete. 2023-10-09T11:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f9a8c06f210 msgr2=0x7f9a8c071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f9a8c06f210 0x7f9a8c071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a8c067000 msgr2=0x7f9a8c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a8c067000 0x7f9a8c0694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a94006fd0 tx=0x7f9a94008040 comp rx=0 tx=0).stop 2023-10-09T11:36:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 msgr2=0x7f9aa00c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 --2- 172.21.15.6:0/1847134975 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9aa0069390 0x7f9aa00c3e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a900030c0 tx=0x7f9a90016000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9a9ffff700 1 -- 172.21.15.6:0/1847134975 reap_dead start 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 shutdown_connections 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 >> 172.21.15.6:0/1847134975 conn(0x7f9aa00ccdb0 msgr2=0x7f9aa00c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 shutdown_connections 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.477+0000 7f9aa5dd0700 1 -- 172.21.15.6:0/1847134975 wait complete. 2023-10-09T11:36:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7fac7006f180 msgr2=0x7fac70071590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7fac7006f180 0x7fac70071590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac70067000 msgr2=0x7fac700694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac70067000 0x7fac700694b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac8c06db60 tx=0x7fac78008040 comp rx=0 tx=0).stop 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 msgr2=0x7fac8c152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 --2- 172.21.15.6:0/2313940425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac8c0c8d50 0x7fac8c152810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac8000cae0 tx=0x7fac80007680 comp rx=0 tx=0).stop 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac923ac700 1 -- 172.21.15.6:0/2313940425 reap_dead start 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 shutdown_connections 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 >> 172.21.15.6:0/2313940425 conn(0x7fac8c0cc980 msgr2=0x7fac8c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 shutdown_connections 2023-10-09T11:36:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.478+0000 7fac93e0f700 1 -- 172.21.15.6:0/2313940425 wait complete. 2023-10-09T11:36:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.483+0000 7fcfb1ffb700 1 -- 172.21.15.6:0/3738074806 <== osd.0 v2:172.21.15.6:6821/86385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfbc06acc0 con 0x7fcfa006f140 2023-10-09T11:36:14.533 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T11:36:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.491+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fcfa006f140 msgr2=0x7fcfa0071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.491+0000 7fcfc423c700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fcfa006f140 0x7fcfa0071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.491+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 --> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25d40cb230 con 0x7f25c006f190 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7f25c8ff9700 1 -- 172.21.15.6:0/2855113617 <== osd.1 v2:172.21.15.6:6808/86376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25d40cb230 con 0x7f25c006f190 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfa0066fb0 msgr2=0x7fcfa0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7fcfc423c700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfa0066fb0 0x7fcfa0069460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc1530c0 tx=0x7fcfb4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfbc158290 msgr2=0x7fcfbc158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7fcfc423c700 1 --2- 172.21.15.6:0/3738074806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfbc158290 0x7fcfbc158710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc069820 tx=0x7fcfbc06a430 comp rx=0 tx=0).stop 2023-10-09T11:36:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7fcfc27d9700 1 -- 172.21.15.6:0/3738074806 reap_dead start 2023-10-09T11:36:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7f25c006f190 msgr2=0x7f25c00715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.492+0000 7f25daf1f700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7f25c006f190 0x7f25c00715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 shutdown_connections 2023-10-09T11:36:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 >> 172.21.15.6:0/3738074806 conn(0x7fcfbc0cc980 msgr2=0x7fcfbc06d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 shutdown_connections 2023-10-09T11:36:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7fcfc423c700 1 -- 172.21.15.6:0/3738074806 wait complete. 2023-10-09T11:36:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0067000 msgr2=0x7f25c00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7f25daf1f700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f25c0067000 0x7f25c00694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25d4155200 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 msgr2=0x7f25d41777f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7f25daf1f700 1 --2- 172.21.15.6:0/2855113617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f25d40cbd10 0x7f25d41777f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25d00093f0 tx=0x7f25d0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.493+0000 7f25d94bc700 1 -- 172.21.15.6:0/2855113617 reap_dead start 2023-10-09T11:36:14.538 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T11:36:14.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.498+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 shutdown_connections 2023-10-09T11:36:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.498+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 >> 172.21.15.6:0/2855113617 conn(0x7f25d406c660 msgr2=0x7f25d4147320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.499+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 shutdown_connections 2023-10-09T11:36:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.499+0000 7f25daf1f700 1 -- 172.21.15.6:0/2855113617 wait complete. 2023-10-09T11:36:14.540 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T11:36:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.500+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 --> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81f004bb80 con 0x7f81f008ac30 2023-10-09T11:36:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.500+0000 7f81d6ffd700 1 -- 172.21.15.6:0/3930224129 <== osd.5 v2:172.21.15.118:6803/86574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f81f004bb80 con 0x7f81f008ac30 2023-10-09T11:36:14.542 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:36:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.500+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 --> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f452406ebd0 con 0x7f451006f290 2023-10-09T11:36:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7f81f008ac30 msgr2=0x7f81f008b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7f81f008ac30 0x7f81f008b000 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81dc067000 msgr2=0x7f81dc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81dc067000 0x7f81dc0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81f01580c0 tx=0x7f81e0006c40 comp rx=0 tx=0).stop 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006d120 msgr2=0x7f81f00b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 --2- 172.21.15.6:0/3930224129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006d120 0x7f81f00b60f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81e4015000 tx=0x7f81e4016000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f450affd700 1 -- 172.21.15.6:0/3064223955 <== osd.6 v2:172.21.15.118:6813/86575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f452406ebd0 con 0x7f451006f290 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81ef59e700 1 -- 172.21.15.6:0/3930224129 reap_dead start 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 shutdown_connections 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 >> 172.21.15.6:0/3930224129 conn(0x7f81f006bb90 msgr2=0x7f81f01567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 shutdown_connections 2023-10-09T11:36:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f81f507d700 1 -- 172.21.15.6:0/3930224129 wait complete. 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7f451006f290 msgr2=0x7f45100716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f4529806700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7f451006f290 0x7f45100716a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.501+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510067080 msgr2=0x7f4510069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510067080 0x7f4510069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45140099b0 tx=0x7f4514017000 comp rx=0 tx=0).stop 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f452406e770 msgr2=0x7f45240ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 --2- 172.21.15.6:0/3064223955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f452406e770 0x7f45240ae120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f451c00c910 tx=0x7f451c0016f0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f45237fe700 1 -- 172.21.15.6:0/3064223955 reap_dead start 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 shutdown_connections 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 >> 172.21.15.6:0/3064223955 conn(0x7f452406cca0 msgr2=0x7f452406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 shutdown_connections 2023-10-09T11:36:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.502+0000 7f4529806700 1 -- 172.21.15.6:0/3064223955 wait complete. 2023-10-09T11:36:14.547 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T11:36:14.548 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T11:36:14.549 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:36:14.550 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:14.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T11:36:14.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.784+0000 7fc560d55700 1 Processor -- start 2023-10-09T11:36:14.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.784+0000 7fc560d55700 1 -- start start 2023-10-09T11:36:14.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.785+0000 7f811bbaf700 1 Processor -- start 2023-10-09T11:36:14.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.785+0000 7f811bbaf700 1 -- start start 2023-10-09T11:36:14.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.785+0000 7ff165544700 1 Processor -- start 2023-10-09T11:36:14.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.785+0000 7ff165544700 1 -- start start 2023-10-09T11:36:14.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.785+0000 7f23dcf39700 1 Processor -- start 2023-10-09T11:36:14.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f23dcf39700 1 -- start start 2023-10-09T11:36:14.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc560d55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc55c157ca0 0x7fc55c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc560d55700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc55c06d120 0x7fc55c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc560d55700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c06dac0 con 0x7fc55c1578d0 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc560d55700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c0d07c0 con 0x7fc55c06d120 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc560d55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cfbb0 con 0x7fc55c157ca0 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc55a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc55c1578d0 0x7fc55c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44254/0 (socket says 172.21.15.6:44254) 2023-10-09T11:36:14.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7fc55a59c700 1 -- 172.21.15.6:0/2259742965 learned_addr learned my addr 172.21.15.6:0/2259742965 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff165544700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff16006f2f0 0x7ff1600c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff165544700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600ca680 con 0x7ff1600c7550 2023-10-09T11:36:14.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff165544700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600c2800 con 0x7ff1600c7180 2023-10-09T11:36:14.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff165544700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600c7990 con 0x7ff16006f2f0 2023-10-09T11:36:14.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f47e7d76700 1 Processor -- start 2023-10-09T11:36:14.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f811bbaf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f811415a2a0 0x7f81140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f811bbaf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140b0ca0 con 0x7f811406dd60 2023-10-09T11:36:14.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f811bbaf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140b00d0 con 0x7f81140ceb30 2023-10-09T11:36:14.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7f811bbaf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811406e160 con 0x7f811415a2a0 2023-10-09T11:36:14.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f811914a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f81140ceb30 0x7f811406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52650/0 (socket says 172.21.15.6:52650) 2023-10-09T11:36:14.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f811914a700 1 -- 172.21.15.6:0/2183423050 learned_addr learned my addr 172.21.15.6:0/2183423050 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff15effd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff1600c7180 0x7ff1600abc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52646/0 (socket says 172.21.15.6:52646) 2023-10-09T11:36:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff15effd700 1 -- 172.21.15.6:0/1430483325 learned_addr learned my addr 172.21.15.6:0/1430483325 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.786+0000 7ff15e7fc700 1 --2- 172.21.15.6:0/1430483325 >> v2:172.21.15.6:3300/0 conn(0x7ff16006f2f0 0x7ff1600c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583411009 0 0) 0x7ff1600c2800 con 0x7ff1600c7180 2023-10-09T11:36:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff148003570 con 0x7ff1600c7180 2023-10-09T11:36:14.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f47e7d76700 1 -- start start 2023-10-09T11:36:14.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375905351 0 0) 0x7fc54c001110 con 0x7fc55c1578d0 2023-10-09T11:36:14.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc548003570 con 0x7fc55c1578d0 2023-10-09T11:36:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f811994b700 1 --2- 172.21.15.6:0/2183423050 >> v2:172.21.15.118:3300/0 conn(0x7f811415a2a0 0x7f81140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15e7fc700 1 -- 172.21.15.6:0/1430483325 >> v1:172.21.15.118:6789/0 conn(0x7ff1600c7180 legacy=0x7ff1600abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245093748 0 0) 0x7ff148003570 con 0x7ff1600c7180 2023-10-09T11:36:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7fc559d9b700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc55c157ca0 0x7fc55c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23dcf39700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23dcf39700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23d80cdc90 0x7f23d80ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23dcf39700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d81625c0 con 0x7f23d80b0a00 2023-10-09T11:36:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23dcf39700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80ad330 con 0x7f23d80cdc90 2023-10-09T11:36:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23dcf39700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8162dc0 con 0x7f23d80acf60 2023-10-09T11:36:14.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23d659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15e7fc700 1 -- 172.21.15.6:0/1430483325 >> v1:172.21.15.6:6789/0 conn(0x7ff1600c7550 legacy=0x7ff160155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7ff15e7fc700 1 -- 172.21.15.6:0/1430483325 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600c2ae0 con 0x7ff16006f2f0 2023-10-09T11:36:14.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23d659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44554/0 (socket says 172.21.15.6:44554) 2023-10-09T11:36:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f23d659c700 1 -- 172.21.15.6:0/1461180695 learned_addr learned my addr 172.21.15.6:0/1461180695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d6d9d700 1 --2- 172.21.15.6:0/1461180695 >> v2:172.21.15.6:3300/0 conn(0x7f23d80cdc90 0x7f23d80ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.787+0000 7f8118949700 1 -- 172.21.15.6:0/2183423050 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665873574 0 0) 0x7f81140b00d0 con 0x7f81140ceb30 2023-10-09T11:36:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f8118949700 1 -- 172.21.15.6:0/2183423050 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8100003570 con 0x7f81140ceb30 2023-10-09T11:36:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f811994b700 1 -- 172.21.15.6:0/2183423050 >> v1:172.21.15.118:6789/0 conn(0x7f81140ceb30 legacy=0x7f811406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f811994b700 1 -- 172.21.15.6:0/2183423050 >> v1:172.21.15.6:6789/0 conn(0x7f811406dd60 legacy=0x7f81140b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f811994b700 1 -- 172.21.15.6:0/2183423050 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140b0370 con 0x7f811415a2a0 2023-10-09T11:36:14.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7ff15e7fc700 1 --2- 172.21.15.6:0/1430483325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff1600c2220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff154010c10 tx=0x7ff1540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839c650e12edb297 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f811994b700 1 --2- 172.21.15.6:0/2183423050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811415a2a0 0x7f81140b1130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81040098e0 tx=0x7f81040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b390fe071c4b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55ad9d700 1 --2- 172.21.15.6:0/2259742965 >> v2:172.21.15.6:3300/0 conn(0x7fc55c06d120 0x7fc55c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f8118949700 1 -- 172.21.15.6:0/2183423050 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400b640 con 0x7f811415a2a0 2023-10-09T11:36:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f8118949700 1 -- 172.21.15.6:0/2183423050 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400b7a0 con 0x7f811415a2a0 2023-10-09T11:36:14.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f8118949700 1 -- 172.21.15.6:0/2183423050 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400bb60 con 0x7f811415a2a0 2023-10-09T11:36:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580017f0 con 0x7ff16006f2f0 2023-10-09T11:36:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400ba80 con 0x7ff16006f2f0 2023-10-09T11:36:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7ff15dffb700 1 -- 172.21.15.6:0/1430483325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400be20 con 0x7ff16006f2f0 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e00acf60 0x7f47e015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00b0a00 0x7f47e0161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f47e00cdc90 0x7f47e00ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00ad330 con 0x7f47e00acf60 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e0162dc0 con 0x7f47e00cdc90 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e7d76700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00ce5f0 con 0x7f47e00b0a00 2023-10-09T11:36:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e5b12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e00acf60 0x7f47e015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e6313700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f47e00cdc90 0x7f47e00ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e5b12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e00acf60 0x7f47e015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36302/0 (socket says 172.21.15.6:36302) 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e5b12700 1 -- 172.21.15.6:0/2921139437 learned_addr learned my addr 172.21.15.6:0/2921139437 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f47e5311700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00b0a00 0x7f47e0161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d659c700 1 -- 172.21.15.6:0/1461180695 >> v2:172.21.15.6:3300/0 conn(0x7f23d80cdc90 msgr2=0x7f23d80ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d659c700 1 --2- 172.21.15.6:0/1461180695 >> v2:172.21.15.6:3300/0 conn(0x7f23d80cdc90 0x7f23d80ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d659c700 1 -- 172.21.15.6:0/1461180695 >> v1:172.21.15.6:6789/0 conn(0x7f23d80b0a00 legacy=0x7f23d8161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d659c700 1 -- 172.21.15.6:0/1461180695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80ce5f0 con 0x7f23d80acf60 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d659c700 1 --2- 172.21.15.6:0/1461180695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0099b0 tx=0x7f23cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e94abb38ae9649 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425268970 0 0) 0x7fc548003570 con 0x7fc55c1578d0 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc55c157ca0 msgr2=0x7fc55c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc55c157ca0 0x7fc55c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 >> v2:172.21.15.6:3300/0 conn(0x7fc55c06d120 msgr2=0x7fc55c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 --2- 172.21.15.6:0/2259742965 >> v2:172.21.15.6:3300/0 conn(0x7fc55c06d120 0x7fc55c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0cfe90 con 0x7fc55c1578d0 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fc54c001600 con 0x7fc55c1578d0 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 >> v1:172.21.15.6:6789/0 conn(0x7fc55c1578d0 legacy=0x7fc55c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548003ae0 0x7fc548003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc548004810 0x7fc548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5480051c0 0x7fc54800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0d07c0 con 0x7fc548004810 2023-10-09T11:36:14.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0cfbb0 con 0x7fc5480051c0 2023-10-09T11:36:14.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54800c080 con 0x7fc548003ae0 2023-10-09T11:36:14.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f9c80ec0700 1 Processor -- start 2023-10-09T11:36:14.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7f23d559a700 1 -- 172.21.15.6:0/1461180695 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc009ea0 con 0x7f23d80acf60 2023-10-09T11:36:14.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f23d559a700 1 -- 172.21.15.6:0/1461180695 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00b820 con 0x7f23d80acf60 2023-10-09T11:36:14.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f23d559a700 1 -- 172.21.15.6:0/1461180695 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00bbc0 con 0x7f23d80acf60 2023-10-09T11:36:14.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.788+0000 7fc55ad9d700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5480051c0 0x7fc54800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f811bbaf700 1 -- 172.21.15.6:0/2183423050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811415a2a0 msgr2=0x7f81140b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f811bbaf700 1 --2- 172.21.15.6:0/2183423050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811415a2a0 0x7f81140b1130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81040098e0 tx=0x7f81040091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f811bbaf700 1 -- 172.21.15.6:0/2183423050 shutdown_connections 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f811bbaf700 1 --2- 172.21.15.6:0/2183423050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811415a2a0 0x7f81140b1130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f811bbaf700 1 -- 172.21.15.6:0/2183423050 >> 172.21.15.6:0/2183423050 conn(0x7f8114067640 msgr2=0x7f8114067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 -- 172.21.15.6:0/1430483325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 msgr2=0x7ff1600c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 --2- 172.21.15.6:0/1430483325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff1600c2220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff154010c10 tx=0x7ff1540090f0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 -- 172.21.15.6:0/1430483325 shutdown_connections 2023-10-09T11:36:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 --2- 172.21.15.6:0/1430483325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff1600c2220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 -- 172.21.15.6:0/1430483325 >> 172.21.15.6:0/1430483325 conn(0x7ff16006c660 msgr2=0x7ff1600cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 -- 172.21.15.6:0/1430483325 shutdown_connections 2023-10-09T11:36:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7ff165544700 1 -- 172.21.15.6:0/1430483325 wait complete. 2023-10-09T11:36:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 -- 172.21.15.6:0/1461180695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 msgr2=0x7f23d815f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 --2- 172.21.15.6:0/1461180695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0099b0 tx=0x7f23cc009250 comp rx=0 tx=0).stop 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc55a59c700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548003ae0 0x7fc548003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc548004810 0x7fc548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 -- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548003ae0 msgr2=0x7fc548003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548003ae0 0x7fc548003ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 -- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5480051c0 msgr2=0x7fc54800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5480051c0 0x7fc54800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 -- 172.21.15.6:0/2259742965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548003570 con 0x7fc548004810 2023-10-09T11:36:14.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7fc559d9b700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc548004810 0x7fc548004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc55c068510 tx=0x7fc5440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c0650cc7549ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 -- 172.21.15.6:0/1461180695 shutdown_connections 2023-10-09T11:36:14.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 --2- 172.21.15.6:0/1461180695 >> v2:172.21.15.6:3300/0 conn(0x7f23d80cdc90 0x7f23d80ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 --2- 172.21.15.6:0/1461180695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815f1c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 -- 172.21.15.6:0/1461180695 >> 172.21.15.6:0/1461180695 conn(0x7f23d806cca0 msgr2=0x7f23d806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 -- 172.21.15.6:0/2921139437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00b0a00 msgr2=0x7f47e0161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00b0a00 0x7f47e0161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 -- 172.21.15.6:0/2921139437 >> v2:172.21.15.118:3300/0 conn(0x7f47e00cdc90 msgr2=0x7f47e00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 --2- 172.21.15.6:0/2921139437 >> v2:172.21.15.118:3300/0 conn(0x7f47e00cdc90 0x7f47e00ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 -- 172.21.15.6:0/2921139437 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0162800 con 0x7f47e00acf60 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e5b12700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00acf60 0x7f47e015f1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47e0161df0 tx=0x7f47d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87c2a4f1d8e1662 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e4b10700 1 -- 172.21.15.6:0/2921139437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400b640 con 0x7f47e00acf60 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e4b10700 1 -- 172.21.15.6:0/2921139437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400b7a0 con 0x7f47e00acf60 2023-10-09T11:36:14.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f47e4b10700 1 -- 172.21.15.6:0/2921139437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400bb60 con 0x7f47e00acf60 2023-10-09T11:36:14.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.789+0000 7f9c80ec0700 1 -- start start 2023-10-09T11:36:14.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f811bbaf700 1 -- 172.21.15.6:0/2183423050 shutdown_connections 2023-10-09T11:36:14.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f811bbaf700 1 -- 172.21.15.6:0/2183423050 wait complete. 2023-10-09T11:36:14.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 -- 172.21.15.6:0/1461180695 shutdown_connections 2023-10-09T11:36:14.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f23dcf39700 1 -- 172.21.15.6:0/1461180695 wait complete. 2023-10-09T11:36:14.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c80ec0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c7c0aedc0 0x7f9c7c0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c80ec0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0c9120 con 0x7f9c7c0c2870 2023-10-09T11:36:14.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c80ec0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0c7620 con 0x7f9c7c0af190 2023-10-09T11:36:14.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c80ec0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c15e840 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c79d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9c7c0af190 0x7f9c7c068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52654/0 (socket says 172.21.15.6:52654) 2023-10-09T11:36:14.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f9c79d9b700 1 -- 172.21.15.6:0/1705136553 learned_addr learned my addr 172.21.15.6:0/1705136553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400e610 con 0x7fc548004810 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400e770 con 0x7fc548004810 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7fc55959a700 1 -- 172.21.15.6:0/2259742965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400eaf0 con 0x7fc548004810 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7ff165544700 1 Processor -- start 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f9c7a59c700 1 --2- 172.21.15.6:0/1705136553 >> v2:172.21.15.6:3300/0 conn(0x7f9c7c0aedc0 0x7f9c7c0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f9c7a59c700 1 -- 172.21.15.6:0/1705136553 >> v1:172.21.15.118:6789/0 conn(0x7f9c7c0af190 legacy=0x7f9c7c068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f9c7a59c700 1 -- 172.21.15.6:0/1705136553 >> v1:172.21.15.6:6789/0 conn(0x7f9c7c0c2870 legacy=0x7f9c7c0c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f9c7a59c700 1 -- 172.21.15.6:0/1705136553 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0c23e0 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f9c7a59c700 1 --2- 172.21.15.6:0/1705136553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0aedc0 0x7f9c7c0c8b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0098e0 tx=0x7f9c6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e0cf670b22a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7fc560d55700 1 -- 172.21.15.6:0/2259742965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc548004810 msgr2=0x7fc548004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7fc560d55700 1 --2- 172.21.15.6:0/2259742965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc548004810 0x7fc548004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc55c068510 tx=0x7fc5440091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7fc55ad9d700 1 -- 172.21.15.6:0/2259742965 reap_dead start 2023-10-09T11:36:14.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7f811bbaf700 1 Processor -- start 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f47e7d76700 1 -- 172.21.15.6:0/2921139437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00acf60 msgr2=0x7f47e015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.790+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00acf60 0x7f47e015f1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47e0161df0 tx=0x7f47d4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 -- 172.21.15.6:0/2921139437 shutdown_connections 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2921139437 >> v2:172.21.15.118:3300/0 conn(0x7f47e00cdc90 0x7f47e00ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00acf60 0x7f47e015f1c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2921139437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00b0a00 0x7f47e0161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 -- 172.21.15.6:0/2921139437 >> 172.21.15.6:0/2921139437 conn(0x7f47e006cca0 msgr2=0x7f47e006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 -- 172.21.15.6:0/2921139437 shutdown_connections 2023-10-09T11:36:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7f47e7d76700 1 -- 172.21.15.6:0/2921139437 wait complete. 2023-10-09T11:36:14.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7f23dcf39700 1 Processor -- start 2023-10-09T11:36:14.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7fc560d55700 1 -- 172.21.15.6:0/2259742965 shutdown_connections 2023-10-09T11:36:14.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7fc560d55700 1 -- 172.21.15.6:0/2259742965 >> 172.21.15.6:0/2259742965 conn(0x7fc55c06bb90 msgr2=0x7fc55c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7fc560d55700 1 -- 172.21.15.6:0/2259742965 shutdown_connections 2023-10-09T11:36:14.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7fc560d55700 1 -- 172.21.15.6:0/2259742965 wait complete. 2023-10-09T11:36:14.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7f811bbaf700 1 -- start start 2023-10-09T11:36:14.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7f47e7d76700 1 Processor -- start 2023-10-09T11:36:14.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.792+0000 7f23dcf39700 1 -- start start 2023-10-09T11:36:14.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f47e7d76700 1 -- start start 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23d80b0a00 0x7f23d80cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 0x7f23d80cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80a70c0 con 0x7f23d80b0a00 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80a6520 con 0x7f23d80cdc90 2023-10-09T11:36:14.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23dcf39700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80a6790 con 0x7f23d80acf60 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.791+0000 7ff165544700 1 -- start start 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff16014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 0x7ff1600aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 0x7ff1600c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600af3c0 con 0x7ff16006f2f0 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b0dd0 con 0x7ff1600c7550 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff165544700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600ad330 con 0x7ff1600c7180 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15e7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 0x7ff1600aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15e7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 0x7ff1600aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44582/0 (socket says 172.21.15.6:44582) 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff16014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15e7fc700 1 -- 172.21.15.6:0/268852519 learned_addr learned my addr 172.21.15.6:0/268852519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 0x7ff1600c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23d659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23d659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44576/0 (socket says 172.21.15.6:44576) 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23d659c700 1 -- 172.21.15.6:0/2308614197 learned_addr learned my addr 172.21.15.6:0/2308614197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7fc560d55700 1 Processor -- start 2023-10-09T11:36:14.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7fc560d55700 1 -- start start 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81140ceb30 0x7f8114153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 0x7f8114156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 -- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 msgr2=0x7ff1600aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 0x7ff1600aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 -- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 msgr2=0x7ff16014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff16014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7ff15f7fe700 1 -- 172.21.15.6:0/268852519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540107d0 con 0x7ff1600c7550 2023-10-09T11:36:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8114142510 con 0x7f811406dd60 2023-10-09T11:36:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141549d0 con 0x7f81140ceb30 2023-10-09T11:36:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f811bbaf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141566c0 con 0x7f811415a2a0 2023-10-09T11:36:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.793+0000 7f23d5d9b700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23d80b0a00 0x7f23d80cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d6d9d700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 0x7f23d80cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff15f7fe700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 0x7ff1600c3a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c440 tx=0x7ff150007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00acf60 0x7f47e01785d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00b0a00 0x7f47e00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00a8dc0 con 0x7f47e00b0a00 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00cb980 con 0x7f47e00cdc90 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e7d76700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00a81b0 con 0x7f47e00acf60 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36344/0 (socket says 172.21.15.6:36344) 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 -- 172.21.15.6:0/1968160563 learned_addr learned my addr 172.21.15.6:0/1968160563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811a14c700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 0x7f8114156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 -- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 msgr2=0x7f23d80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 0x7f23d80cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 -- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23d80b0a00 msgr2=0x7f23d80cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23d80b0a00 0x7f23d80cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 -- 172.21.15.6:0/2308614197 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0094f0 con 0x7f23d80acf60 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d6d9d700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 0x7f23d80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:14.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811914a700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81140ceb30 0x7f8114153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:36004/0 (socket says 172.21.15.6:36004) 2023-10-09T11:36:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 -- 172.21.15.6:0/2489673196 learned_addr learned my addr 172.21.15.6:0/2489673196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f23d659c700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009290 tx=0x7f23cc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 -- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 msgr2=0x7f8114156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150012420 con 0x7ff1600c7550 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600ad610 con 0x7ff1600c7550 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500125a0 con 0x7ff1600c7550 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150012960 con 0x7ff1600c7550 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600b0a60 con 0x7ff1600c7550 2023-10-09T11:36:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e5311700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00b0a00 0x7f47e00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 0x7f8114156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 -- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81140ceb30 msgr2=0x7f8114153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81140ceb30 0x7f8114153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811994b700 1 -- 172.21.15.6:0/1968160563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104009420 con 0x7f811406dd60 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 -- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00acf60 msgr2=0x7f47e01785d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00acf60 0x7f47e01785d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 -- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00b0a00 msgr2=0x7f47e00cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00b0a00 0x7f47e00cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f47e6313700 1 -- 172.21.15.6:0/2489673196 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40094f0 con 0x7f47e00cdc90 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7f811a14c700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 0x7f8114156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.794+0000 7fc560d55700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc560d55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c16d770 0x7fc55c168240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc560d55700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc55c168780 0x7fc55c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc560d55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c168be0 con 0x7fc55c16d770 2023-10-09T11:36:14.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc011a80 con 0x7f23d80acf60 2023-10-09T11:36:14.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc560d55700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c16cda0 con 0x7fc55c168780 2023-10-09T11:36:14.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc560d55700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c16c190 con 0x7fc548004810 2023-10-09T11:36:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f811994b700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8104013000 tx=0x7f8104017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f47e6313700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009df0 tx=0x7f47d800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44608/0 (socket says 172.21.15.6:44608) 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 -- 172.21.15.6:0/3892754060 learned_addr learned my addr 172.21.15.6:0/3892754060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc020070 con 0x7f23d80acf60 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc011e70 con 0x7f23d80acf60 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80a6a70 con 0x7f23d80acf60 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80cc6a0 con 0x7f23d80acf60 2023-10-09T11:36:14.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc559d9b700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c16d770 0x7fc55c168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104000cb0 con 0x7f811406dd60 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400b910 con 0x7f811406dd60 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104026480 con 0x7f811406dd60 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8114155df0 con 0x7f811406dd60 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141560f0 con 0x7f811406dd60 2023-10-09T11:36:14.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 -- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc55c168780 msgr2=0x7fc55c159070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc55c168780 0x7fc55c159070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 -- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c16d770 msgr2=0x7fc55c168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c16d770 0x7fc55c168240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 -- 172.21.15.6:0/3892754060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c16c470 con 0x7fc548004810 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.795+0000 7fc55a59c700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0012b0 tx=0x7fc54c009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.796+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff150012d50 con 0x7ff1600c7550 2023-10-09T11:36:14.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.796+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1600b0f60 con 0x7ff1600c7550 2023-10-09T11:36:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.796+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c007360 con 0x7fc548004810 2023-10-09T11:36:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.796+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114156470 con 0x7f811406dd60 2023-10-09T11:36:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.796+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8068900 con 0x7f23d80acf60 2023-10-09T11:36:14.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0074c0 con 0x7fc548004810 2023-10-09T11:36:14.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c004830 con 0x7fc548004810 2023-10-09T11:36:14.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c16c750 con 0x7fc548004810 2023-10-09T11:36:14.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c16a860 con 0x7fc548004810 2023-10-09T11:36:14.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7ff146ffd700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23cc022030 con 0x7f23d80acf60 2023-10-09T11:36:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1500837a0 con 0x7ff1600c7550 2023-10-09T11:36:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7ff15effd700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f9c7959a700 1 -- 172.21.15.6:0/1705136553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c009e80 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f741c02f700 1 Processor -- start 2023-10-09T11:36:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8104023030 con 0x7f811406dd60 2023-10-09T11:36:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f8109ffb700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 0x7f80f8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81040859c0 con 0x7f811406dd60 2023-10-09T11:36:14.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f9c7959a700 1 -- 172.21.15.6:0/1705136553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00b760 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f9c7959a700 1 -- 172.21.15.6:0/1705136553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00bb00 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7ff15effd700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 0x7ff14c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff158007fd0 tx=0x7ff158007c70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 -- 172.21.15.6:0/1705136553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0aedc0 msgr2=0x7f9c7c0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/1705136553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0aedc0 0x7f9c7c0c8b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0098e0 tx=0x7f9c6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f811914a700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 0x7f80f8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f811914a700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 0x7f80f8069530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f811415fd80 tx=0x7f8110009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 -- 172.21.15.6:0/1705136553 shutdown_connections 2023-10-09T11:36:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/1705136553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0aedc0 0x7f9c7c0c8b20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 -- 172.21.15.6:0/1705136553 >> 172.21.15.6:0/1705136553 conn(0x7f9c7c06c660 msgr2=0x7f9c7c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 -- 172.21.15.6:0/1705136553 shutdown_connections 2023-10-09T11:36:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f9c80ec0700 1 -- 172.21.15.6:0/1705136553 wait complete. 2023-10-09T11:36:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.797+0000 7f23c67fc700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 0x7f23c0069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23cc086040 con 0x7f23d80acf60 2023-10-09T11:36:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f23d5d9b700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 0x7f23c0069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7f23d5d9b700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 0x7f23c0069610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23d8172230 tx=0x7f23c80090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.799+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc54c004ba0 con 0x7fc548004810 2023-10-09T11:36:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7fc5527fc700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 0x7fc53c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc54c083e70 con 0x7fc548004810 2023-10-09T11:36:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7f741c02f700 1 -- start start 2023-10-09T11:36:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741c02f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f74140aedc0 0x7f74140c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741c02f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f74140c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741c02f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74140c9120 con 0x7f74140af190 2023-10-09T11:36:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741c02f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741415e840 con 0x7f74140aedc0 2023-10-09T11:36:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741c02f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74140c7620 con 0x7f74140c2870 2023-10-09T11:36:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800cb50 con 0x7f47e00cdc90 2023-10-09T11:36:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800f040 con 0x7f47e00cdc90 2023-10-09T11:36:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8014480 con 0x7f47e00cdc90 2023-10-09T11:36:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f74195ca700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74140af190 0x7f7414068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44290/0 (socket says 172.21.15.6:44290) 2023-10-09T11:36:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f74195ca700 1 -- 172.21.15.6:0/4130229702 learned_addr learned my addr 172.21.15.6:0/4130229702 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00a8490 con 0x7f47e00cdc90 2023-10-09T11:36:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741a5cc700 1 --2- 172.21.15.6:0/4130229702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f74140c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e00a8a50 con 0x7f47e00cdc90 2023-10-09T11:36:14.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7faa76333700 1 Processor -- start 2023-10-09T11:36:14.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.798+0000 7faa76333700 1 -- start start 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa76333700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 0x7faa70068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa76333700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006d220 con 0x7faa7006f580 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa76333700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006d500 con 0x7faa700c83a0 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa76333700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa700cb7b0 con 0x7faa7006f950 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa6ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa7006f580 0x7faa700caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44288/0 (socket says 172.21.15.6:44288) 2023-10-09T11:36:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa6ffff700 1 -- 172.21.15.6:0/2142382643 learned_addr learned my addr 172.21.15.6:0/2142382643 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7faa6f7fe700 1 --2- 172.21.15.6:0/2142382643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 0x7faa70068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741a5cc700 1 -- 172.21.15.6:0/4130229702 >> v2:172.21.15.118:3300/0 conn(0x7f74140aedc0 msgr2=0x7f74140c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:14.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741a5cc700 1 --2- 172.21.15.6:0/4130229702 >> v2:172.21.15.118:3300/0 conn(0x7f74140aedc0 0x7f74140c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.800+0000 7f741a5cc700 1 -- 172.21.15.6:0/4130229702 >> v1:172.21.15.6:6789/0 conn(0x7f74140af190 legacy=0x7f7414068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7f741a5cc700 1 -- 172.21.15.6:0/4130229702 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74140c23e0 con 0x7f74140c2870 2023-10-09T11:36:14.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5400052b0 con 0x7fc548004810 2023-10-09T11:36:14.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7f741a5cc700 1 --2- 172.21.15.6:0/4130229702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f74140c2cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74100098e0 tx=0x7f74100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd68e3ba0cdd64f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7f9c80ec0700 1 Processor -- start 2023-10-09T11:36:14.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7fc559d9b700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 0x7fc53c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7faa6f7fe700 1 -- 172.21.15.6:0/2142382643 >> v1:172.21.15.118:6789/0 conn(0x7faa700c83a0 legacy=0x7faa7006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7faa6f7fe700 1 -- 172.21.15.6:0/2142382643 >> v1:172.21.15.6:6789/0 conn(0x7faa7006f580 legacy=0x7faa700caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7faa6f7fe700 1 -- 172.21.15.6:0/2142382643 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700cba90 con 0x7faa7006f950 2023-10-09T11:36:14.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7faa6f7fe700 1 --2- 172.21.15.6:0/2142382643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 0x7faa70068b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa60009410 tx=0x7faa600095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2256e965e68f0e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7fc559d9b700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 0x7fc53c069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0cdb80 tx=0x7fc544019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0068900 con 0x7f47e00cdc90 2023-10-09T11:36:14.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.801+0000 7f9c80ec0700 1 -- start start 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c7c0aedc0 0x7f9c7c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c7c0af190 0x7f9c7c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c6850 con 0x7f9c7c0c2870 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c16f950 con 0x7f9c7c0af190 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c80ec0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b0e20 con 0x7f9c7c0aedc0 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36374/0 (socket says 172.21.15.6:36374) 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c7c0aedc0 0x7f9c7c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 -- 172.21.15.6:0/2157969186 learned_addr learned my addr 172.21.15.6:0/2157969186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff150050970 con 0x7ff1600c7550 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 -- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c7c0aedc0 msgr2=0x7f9c7c0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c7c0aedc0 0x7f9c7c0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 -- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c7c0af190 msgr2=0x7f9c7c0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c7c0af190 0x7f9c7c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.802+0000 7f9c7ad9d700 1 -- 172.21.15.6:0/2157969186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c009420 con 0x7f9c7c0c2870 2023-10-09T11:36:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.803+0000 7f9c7ad9d700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cb90 tx=0x7f9c74001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.803+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23cc053330 con 0x7f23d80acf60 2023-10-09T11:36:14.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.803+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d8014830 con 0x7f47e00cdc90 2023-10-09T11:36:14.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.804+0000 7f47ddffb700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 0x7f47c40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.804+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47d8085920 con 0x7f47e00cdc90 2023-10-09T11:36:14.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.804+0000 7f47e5b12700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 0x7f47c40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.804+0000 7f47e5b12700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 0x7f47c40694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47e0161df0 tx=0x7f47d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.805+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400a7a0 con 0x7f9c7c0c2870 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.806+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7400a900 con 0x7f9c7c0c2870 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.806+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400acc0 con 0x7f9c7c0c2870 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.806+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c0b1100 con 0x7f9c7c0c2870 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.806+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0b16c0 con 0x7f9c7c0c2870 2023-10-09T11:36:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.806+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8104052c10 con 0x7f811406dd60 2023-10-09T11:36:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.807+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d8052cf0 con 0x7f47e00cdc90 2023-10-09T11:36:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.807+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c0b1290 con 0x7f9c7c0c2870 2023-10-09T11:36:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.807+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc54c04d5a0 con 0x7fc548004810 2023-10-09T11:36:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.808+0000 7f7418dc9700 1 -- 172.21.15.6:0/4130229702 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410009e80 con 0x7f74140c2870 2023-10-09T11:36:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.808+0000 7f7418dc9700 1 -- 172.21.15.6:0/4130229702 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000b860 con 0x7f74140c2870 2023-10-09T11:36:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.808+0000 7f7418dc9700 1 -- 172.21.15.6:0/4130229702 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000bc00 con 0x7f74140c2870 2023-10-09T11:36:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.808+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c74003030 con 0x7f9c7c0c2870 2023-10-09T11:36:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.808+0000 7f9c6a7fc700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 0x7f9c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.809+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c740846a0 con 0x7f9c7c0c2870 2023-10-09T11:36:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.809+0000 7f741c02f700 1 -- 172.21.15.6:0/4130229702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 msgr2=0x7f74140c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.809+0000 7f741c02f700 1 --2- 172.21.15.6:0/4130229702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f74140c2cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74100098e0 tx=0x7f74100091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.810+0000 7f741c02f700 1 -- 172.21.15.6:0/4130229702 shutdown_connections 2023-10-09T11:36:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.810+0000 7f741c02f700 1 --2- 172.21.15.6:0/4130229702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f74140c2cf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.810+0000 7f741c02f700 1 --2- 172.21.15.6:0/4130229702 >> v2:172.21.15.118:3300/0 conn(0x7f74140aedc0 0x7f74140c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.810+0000 7f741c02f700 1 -- 172.21.15.6:0/4130229702 >> 172.21.15.6:0/4130229702 conn(0x7f741406c660 msgr2=0x7f74140cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.813+0000 7f9c7a59c700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 0x7f9c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.813+0000 7f9c7a59c700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 0x7f9c5c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0091e0 tx=0x7f9c6c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.814+0000 7faa6effd700 1 -- 172.21.15.6:0/2142382643 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000b760 con 0x7faa7006f950 2023-10-09T11:36:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.814+0000 7faa6effd700 1 -- 172.21.15.6:0/2142382643 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000b8c0 con 0x7faa7006f950 2023-10-09T11:36:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.814+0000 7faa6effd700 1 -- 172.21.15.6:0/2142382643 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000bc60 con 0x7faa7006f950 2023-10-09T11:36:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.815+0000 7faa76333700 1 -- 172.21.15.6:0/2142382643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 msgr2=0x7faa70068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.815+0000 7faa76333700 1 --2- 172.21.15.6:0/2142382643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 0x7faa70068b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa60009410 tx=0x7faa600095f0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.817+0000 7f741c02f700 1 -- 172.21.15.6:0/4130229702 shutdown_connections 2023-10-09T11:36:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.817+0000 7f741c02f700 1 -- 172.21.15.6:0/4130229702 wait complete. 2023-10-09T11:36:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.817+0000 7faa76333700 1 -- 172.21.15.6:0/2142382643 shutdown_connections 2023-10-09T11:36:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.817+0000 7faa76333700 1 --2- 172.21.15.6:0/2142382643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f950 0x7faa70068b90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.817+0000 7faa76333700 1 -- 172.21.15.6:0/2142382643 >> 172.21.15.6:0/2142382643 conn(0x7faa700cc980 msgr2=0x7faa700ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.819+0000 7f741c02f700 1 Processor -- start 2023-10-09T11:36:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.819+0000 7faa76333700 1 -- 172.21.15.6:0/2142382643 shutdown_connections 2023-10-09T11:36:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.819+0000 7f741c02f700 1 -- start start 2023-10-09T11:36:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 0x7f74141436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140af190 0x7f741415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140c4dc0 con 0x7f74140af190 2023-10-09T11:36:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414141b50 con 0x7f74140aedc0 2023-10-09T11:36:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741c02f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7414141e30 con 0x7f74140c2870 2023-10-09T11:36:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7faa76333700 1 -- 172.21.15.6:0/2142382643 wait complete. 2023-10-09T11:36:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741a5cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f7419dcb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 0x7f74141436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741a5cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44644/0 (socket says 172.21.15.6:44644) 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f741a5cc700 1 -- 172.21.15.6:0/2497851739 learned_addr learned my addr 172.21.15.6:0/2497851739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.820+0000 7f7419dcb700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 0x7f74141436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:36034/0 (socket says 172.21.15.6:36034) 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 -- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 msgr2=0x7f74141436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 0x7f74141436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 -- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140af190 msgr2=0x7f741415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140af190 0x7f741415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 -- 172.21.15.6:0/2497851739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009420 con 0x7f74140c2870 2023-10-09T11:36:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.821+0000 7f741a5cc700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74140c7760 tx=0x7f7410017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.822+0000 7faa76333700 1 Processor -- start 2023-10-09T11:36:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.822+0000 7faa76333700 1 -- start start 2023-10-09T11:36:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.823+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741001a640 con 0x7f74140c2870 2023-10-09T11:36:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.823+0000 7faa76333700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.823+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741001a7a0 con 0x7f74140c2870 2023-10-09T11:36:14.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.823+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741001ab40 con 0x7f74140c2870 2023-10-09T11:36:14.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414142110 con 0x7f74140c2870 2023-10-09T11:36:14.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741413ef80 con 0x7f74140c2870 2023-10-09T11:36:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa76333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7006f950 0x7faa700b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa76333700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa700c83a0 0x7faa70167220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa76333700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015e8a0 con 0x7faa7006f950 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa76333700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70166a30 con 0x7faa700c83a0 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa76333700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa70166470 con 0x7faa7006f580 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa6ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa6ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44660/0 (socket says 172.21.15.6:44660) 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa6ffff700 1 -- 172.21.15.6:0/1921959241 learned_addr learned my addr 172.21.15.6:0/1921959241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.824+0000 7faa748d0700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa700c83a0 0x7faa70167220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 -- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa700c83a0 msgr2=0x7faa70167220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa700c83a0 0x7faa70167220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 -- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7006f950 msgr2=0x7faa700b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7006f950 0x7faa700b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 -- 172.21.15.6:0/1921959241 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009160 con 0x7faa7006f580 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa6ffff700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa6800cc70 tx=0x7faa68001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800ce80 con 0x7faa7006f580 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800ab70 con 0x7faa7006f580 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680070f0 con 0x7faa7006f580 2023-10-09T11:36:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa701682d0 con 0x7faa7006f580 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70166090 con 0x7faa7006f580 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.828+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa68007520 con 0x7faa7006f580 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.829+0000 7faa57fff700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 0x7faa5c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.829+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa680848b0 con 0x7faa7006f580 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.829+0000 7faa6f7fe700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 0x7faa5c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.830+0000 7faa6f7fe700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 0x7faa5c0694b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa60009410 tx=0x7faa60015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.825+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c74051910 con 0x7f9c7c0c2870 2023-10-09T11:36:14.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.826+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7410011420 con 0x7f74140c2870 2023-10-09T11:36:14.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.827+0000 7f7409ffb700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 0x7f73f80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.827+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7410086570 con 0x7f74140c2870 2023-10-09T11:36:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.829+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414067bc0 con 0x7f74140c2870 2023-10-09T11:36:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.833+0000 7f7419dcb700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 0x7f73f80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.833+0000 7f7419dcb700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 0x7f73f80694b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7404006fd0 tx=0x7f7404008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.834+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74100537c0 con 0x7f74140c2870 2023-10-09T11:36:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.849+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa500052b0 con 0x7faa7006f580 2023-10-09T11:36:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:14.857+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa68051c00 con 0x7faa7006f580 2023-10-09T11:36:15.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.178+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f811404bb80 con 0x7f811406dd60 2023-10-09T11:36:15.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.190+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f23d81625c0 con 0x7f23d80acf60 2023-10-09T11:36:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.191+0000 7f8109ffb700 1 -- 172.21.15.6:0/1968160563 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8104015020 con 0x7f811406dd60 2023-10-09T11:36:15.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.191+0000 7f23c67fc700 1 -- 172.21.15.6:0/2308614197 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23d81625c0 con 0x7f23d80acf60 2023-10-09T11:36:15.201 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.201 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.200+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 msgr2=0x7f80f8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.200+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 0x7f80f8069530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f811415fd80 tx=0x7f8110009040 comp rx=0 tx=0).stop 2023-10-09T11:36:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.200+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 msgr2=0x7f81141426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.200+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8104013000 tx=0x7f8104017000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 shutdown_connections 2023-10-09T11:36:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8067080 0x7f80f8069530 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f811415fd80 tx=0x7f8110009040 comp rx=0 tx=0).stop 2023-10-09T11:36:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f811415a2a0 0x7f8114156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f811406dd60 0x7f81141426c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 --2- 172.21.15.6:0/1968160563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81140ceb30 0x7f8114153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 >> 172.21.15.6:0/1968160563 conn(0x7f8114067640 msgr2=0x7f8114160720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 msgr2=0x7f23c0069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 0x7f23c0069610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23d8172230 tx=0x7f23c80090f0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 msgr2=0x7f23d815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009290 tx=0x7f23cc016000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1600c2dc0 con 0x7ff1600c7550 2023-10-09T11:36:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.201+0000 7ff146ffd700 1 -- 172.21.15.6:0/268852519 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff150017020 con 0x7ff1600c7550 2023-10-09T11:36:15.209 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.205+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47e0162ae0 con 0x7f47e00cdc90 2023-10-09T11:36:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 shutdown_connections 2023-10-09T11:36:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f811bbaf700 1 -- 172.21.15.6:0/1968160563 wait complete. 2023-10-09T11:36:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 shutdown_connections 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f23c0067160 0x7f23c0069610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23d80cdc90 0x7f23d80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23d80acf60 0x7f23d815b3c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 --2- 172.21.15.6:0/2308614197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23d80b0a00 0x7f23d80cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 >> 172.21.15.6:0/2308614197 conn(0x7f23d806cca0 msgr2=0x7f23d815d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 msgr2=0x7ff14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 0x7ff14c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff158007fd0 tx=0x7ff158007c70 comp rx=0 tx=0).stop 2023-10-09T11:36:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 msgr2=0x7ff1600c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.206+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 0x7ff1600c3a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c440 tx=0x7ff150007e40 comp rx=0 tx=0).stop 2023-10-09T11:36:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.207+0000 7f47ddffb700 1 -- 172.21.15.6:0/2489673196 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47d8018020 con 0x7f47e00cdc90 2023-10-09T11:36:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.207+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 shutdown_connections 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.207+0000 7f23dcf39700 1 -- 172.21.15.6:0/2308614197 wait complete. 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 shutdown_connections 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1600c7550 0x7ff1600c3a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16006f2f0 0x7ff16014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 --2- 172.21.15.6:0/268852519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1600c7180 0x7ff1600aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 >> 172.21.15.6:0/268852519 conn(0x7ff16006c660 msgr2=0x7ff160154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.215 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 shutdown_connections 2023-10-09T11:36:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.208+0000 7ff165544700 1 -- 172.21.15.6:0/268852519 wait complete. 2023-10-09T11:36:15.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.213+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 msgr2=0x7f47c40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.213+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 0x7f47c40694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47e0161df0 tx=0x7f47d4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.213+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 msgr2=0x7f47e017b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.213+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009df0 tx=0x7f47d800b040 comp rx=0 tx=0).stop 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 shutdown_connections 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f47c4067000 0x7f47c40694b0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47e0161df0 tx=0x7f47d4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47e00cdc90 0x7f47e017b150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47e00acf60 0x7f47e01785d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 --2- 172.21.15.6:0/2489673196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e00b0a00 0x7f47e00cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.215+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 >> 172.21.15.6:0/2489673196 conn(0x7f47e006cca0 msgr2=0x7f47e015d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.216+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc540005560 con 0x7fc548004810 2023-10-09T11:36:15.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.220+0000 7fc5527fc700 1 -- 172.21.15.6:0/3892754060 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc54c019080 con 0x7fc548004810 2023-10-09T11:36:15.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.221+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 shutdown_connections 2023-10-09T11:36:15.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.223+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f741404bb80 con 0x7f74140c2870 2023-10-09T11:36:15.225 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.225+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 msgr2=0x7fc53c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.225+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 0x7fc53c069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0cdb80 tx=0x7fc544019000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.225+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 msgr2=0x7fc55c16d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.225+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0012b0 tx=0x7fc54c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 shutdown_connections 2023-10-09T11:36:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc53c067080 0x7fc53c069530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc55c168780 0x7fc55c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc548004810 0x7fc55c16d230 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 --2- 172.21.15.6:0/3892754060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c16d770 0x7fc55c168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 >> 172.21.15.6:0/3892754060 conn(0x7fc55c06bb90 msgr2=0x7fc55c156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7f7409ffb700 1 -- 172.21.15.6:0/2497851739 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7410015030 con 0x7f74140c2870 2023-10-09T11:36:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 shutdown_connections 2023-10-09T11:36:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.226+0000 7fc560d55700 1 -- 172.21.15.6:0/3892754060 wait complete. 2023-10-09T11:36:15.229 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.227+0000 7f47e7d76700 1 -- 172.21.15.6:0/2489673196 wait complete. 2023-10-09T11:36:15.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-09T11:36:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 msgr2=0x7f73f80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 0x7f73f80694b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7404006fd0 tx=0x7f7404008040 comp rx=0 tx=0).stop 2023-10-09T11:36:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 msgr2=0x7f741415fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74140c7760 tx=0x7f7410017000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c7c04bb80 con 0x7f9c7c0c2870 2023-10-09T11:36:15.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 shutdown_connections 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f73f8067000 0x7f73f80694b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74140c2870 0x7f741415fed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74140aedc0 0x7f74141436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 --2- 172.21.15.6:0/2497851739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140af190 0x7f741415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 >> 172.21.15.6:0/2497851739 conn(0x7f741406c660 msgr2=0x7f74140cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.230+0000 7f9c6a7fc700 1 -- 172.21.15.6:0/2157969186 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c74054f30 con 0x7f9c7c0c2870 2023-10-09T11:36:15.234 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.232+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 msgr2=0x7f9c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.232+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 0x7f9c5c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0091e0 tx=0x7f9c6c016000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.232+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 msgr2=0x7f9c7c16f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.232+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cb90 tx=0x7f9c74001820 comp rx=0 tx=0).stop 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 shutdown_connections 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c5c066f30 0x7f9c5c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c7c0c2870 0x7f9c7c16f410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c7c0aedc0 0x7f9c7c0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 --2- 172.21.15.6:0/2157969186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c7c0af190 0x7f9c7c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 >> 172.21.15.6:0/2157969186 conn(0x7f9c7c06c660 msgr2=0x7f9c7c0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 shutdown_connections 2023-10-09T11:36:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.233+0000 7f9c80ec0700 1 -- 172.21.15.6:0/2157969186 wait complete. 2023-10-09T11:36:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.234+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 shutdown_connections 2023-10-09T11:36:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.234+0000 7f741c02f700 1 -- 172.21.15.6:0/2497851739 wait complete. 2023-10-09T11:36:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.235+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faa50005830 con 0x7faa7006f580 2023-10-09T11:36:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.235+0000 7faa57fff700 1 -- 172.21.15.6:0/1921959241 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa68055220 con 0x7faa7006f580 2023-10-09T11:36:15.238 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 msgr2=0x7faa5c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 0x7faa5c0694b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa60009410 tx=0x7faa60015000 comp rx=0 tx=0).stop 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 msgr2=0x7faa700c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa6800cc70 tx=0x7faa68001a30 comp rx=0 tx=0).stop 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 shutdown_connections 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa5c067000 0x7faa5c0694b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa700c83a0 0x7faa70167220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7006f580 0x7faa700c5dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 --2- 172.21.15.6:0/1921959241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7006f950 0x7faa700b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 >> 172.21.15.6:0/1921959241 conn(0x7faa700cc980 msgr2=0x7faa700cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 shutdown_connections 2023-10-09T11:36:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:15.239+0000 7faa76333700 1 -- 172.21.15.6:0/1921959241 wait complete. 2023-10-09T11:36:15.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-09T11:36:15.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-09T11:36:15.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-09T11:36:15.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-09T11:36:15.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-09T11:36:16.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:36:16.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:36:16.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T11:36:16.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T11:36:16.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T11:36:16.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T11:36:16.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T11:36:16.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T11:36:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.415+0000 7facadaa0700 1 Processor -- start 2023-10-09T11:36:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.415+0000 7facadaa0700 1 -- start start 2023-10-09T11:36:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.416+0000 7facadaa0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 0x7faca80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.416+0000 7facadaa0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 0x7faca806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.416+0000 7facadaa0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80c7140 con 0x7faca80691b0 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.416+0000 7facadaa0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca806dbe0 con 0x7faca806d220 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.416+0000 7facadaa0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c7420 con 0x7faca8068de0 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 0x7faca806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 0x7faca806d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:36054/0 (socket says 172.21.15.6:36054) 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca7fff700 1 -- 172.21.15.6:0/1988725128 learned_addr learned my addr 172.21.15.6:0/1988725128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 --2- 172.21.15.6:0/1988725128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 0x7faca80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 -- 172.21.15.6:0/1988725128 >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 msgr2=0x7faca806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 --2- 172.21.15.6:0/1988725128 >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 0x7faca806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 -- 172.21.15.6:0/1988725128 >> v1:172.21.15.118:6789/0 conn(0x7faca80691b0 legacy=0x7faca80c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 -- 172.21.15.6:0/1988725128 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80c7700 con 0x7faca8068de0 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.417+0000 7faca77fe700 1 --2- 172.21.15.6:0/1988725128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 0x7faca80cb5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0098e0 tx=0x7fac9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcef9744f7ad7c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.418+0000 7faca67fc700 1 -- 172.21.15.6:0/1988725128 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011630 con 0x7faca8068de0 2023-10-09T11:36:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.418+0000 7faca67fc700 1 -- 172.21.15.6:0/1988725128 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c011790 con 0x7faca8068de0 2023-10-09T11:36:16.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.418+0000 7faca67fc700 1 -- 172.21.15.6:0/1988725128 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011b30 con 0x7faca8068de0 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 -- 172.21.15.6:0/1988725128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 msgr2=0x7faca80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 --2- 172.21.15.6:0/1988725128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 0x7faca80cb5c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0098e0 tx=0x7fac9c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 -- 172.21.15.6:0/1988725128 shutdown_connections 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 --2- 172.21.15.6:0/1988725128 >> v2:172.21.15.118:3300/0 conn(0x7faca806d220 0x7faca806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 --2- 172.21.15.6:0/1988725128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca8068de0 0x7faca80cb5c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 -- 172.21.15.6:0/1988725128 >> 172.21.15.6:0/1988725128 conn(0x7faca80cc980 msgr2=0x7faca80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 -- 172.21.15.6:0/1988725128 shutdown_connections 2023-10-09T11:36:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7facadaa0700 1 -- 172.21.15.6:0/1988725128 wait complete. 2023-10-09T11:36:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.422+0000 7facadaa0700 1 Processor -- start 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.420+0000 7fda04167700 1 Processor -- start 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.422+0000 7fda04167700 1 -- start start 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.423+0000 7fda04167700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9fc068de0 0x7fd9fc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.423+0000 7fda04167700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0c7140 con 0x7fd9fc06d220 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.423+0000 7fda04167700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0c7420 con 0x7fd9fc0691b0 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.423+0000 7fda04167700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c7700 con 0x7fd9fc068de0 2023-10-09T11:36:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7fda02704700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9fc06d220 0x7fd9fc15dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44296/0 (socket says 172.21.15.6:44296) 2023-10-09T11:36:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7fda02704700 1 -- 172.21.15.6:0/1564826452 learned_addr learned my addr 172.21.15.6:0/1564826452 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.423+0000 7facadaa0700 1 -- start start 2023-10-09T11:36:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faca8068de0 0x7faca81343c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faca80691b0 0x7faca81464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8135e70 con 0x7faca80691b0 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8134dd0 con 0x7faca8068de0 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7facadaa0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca81350b0 con 0x7faca806d220 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7faca7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7faca7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44678/0 (socket says 172.21.15.6:44678) 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7faca7fff700 1 -- 172.21.15.6:0/1644368739 learned_addr learned my addr 172.21.15.6:0/1644368739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.424+0000 7fda01f03700 1 --2- 172.21.15.6:0/1564826452 >> v2:172.21.15.118:3300/0 conn(0x7fd9fc068de0 0x7fd9fc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca77fe700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faca8068de0 0x7faca81343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 -- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faca8068de0 msgr2=0x7faca81343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faca8068de0 0x7faca81343c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 -- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faca80691b0 msgr2=0x7faca81464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faca80691b0 0x7faca81464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 -- 172.21.15.6:0/1644368739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009420 con 0x7faca806d220 2023-10-09T11:36:16.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7faca7fff700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faca0009db0 tx=0x7faca000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7fda01f03700 1 -- 172.21.15.6:0/1564826452 >> v1:172.21.15.118:6789/0 conn(0x7fd9fc0691b0 legacy=0x7fd9fc0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7fda01f03700 1 -- 172.21.15.6:0/1564826452 >> v1:172.21.15.6:6789/0 conn(0x7fd9fc06d220 legacy=0x7fd9fc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7fda01f03700 1 -- 172.21.15.6:0/1564826452 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0c79e0 con 0x7fd9fc068de0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.425+0000 7fda01f03700 1 --2- 172.21.15.6:0/1564826452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc068de0 0x7fd9fc0cb5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0098e0 tx=0x7fd9ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fd7ca1140ebb72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.426+0000 7fda00f01700 1 -- 172.21.15.6:0/1564826452 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec009e80 con 0x7fd9fc068de0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.426+0000 7fda00f01700 1 -- 172.21.15.6:0/1564826452 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec00b820 con 0x7fd9fc068de0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.426+0000 7fda00f01700 1 -- 172.21.15.6:0/1564826452 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00bba0 con 0x7fd9fc068de0 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 -- 172.21.15.6:0/1564826452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc068de0 msgr2=0x7fd9fc0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 --2- 172.21.15.6:0/1564826452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc068de0 0x7fd9fc0cb5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0098e0 tx=0x7fd9ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 -- 172.21.15.6:0/1564826452 shutdown_connections 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 --2- 172.21.15.6:0/1564826452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc068de0 0x7fd9fc0cb5c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 -- 172.21.15.6:0/1564826452 >> 172.21.15.6:0/1564826452 conn(0x7fd9fc0cc980 msgr2=0x7fd9fc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 -- 172.21.15.6:0/1564826452 shutdown_connections 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.427+0000 7fda04167700 1 -- 172.21.15.6:0/1564826452 wait complete. 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.428+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000c940 con 0x7faca806d220 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.428+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000f040 con 0x7faca806d220 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.428+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000ccf0 con 0x7faca806d220 2023-10-09T11:36:16.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.428+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8135390 con 0x7faca806d220 2023-10-09T11:36:16.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.428+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8135950 con 0x7faca806d220 2023-10-09T11:36:16.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.429+0000 7fda04167700 1 Processor -- start 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.430+0000 7fda04167700 1 -- start start 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9fc068de0 0x7fd9fc139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc0691b0 0x7fd9fc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc13f220 con 0x7fd9fc06d220 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc13f490 con 0x7fd9fc0691b0 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda04167700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc13f770 con 0x7fd9fc068de0 2023-10-09T11:36:16.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda02704700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda02704700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36420/0 (socket says 172.21.15.6:36420) 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.431+0000 7fda02704700 1 -- 172.21.15.6:0/1904211291 learned_addr learned my addr 172.21.15.6:0/1904211291 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda01702700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc0691b0 0x7fd9fc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda01f03700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9fc068de0 0x7fd9fc139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda02704700 1 -- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9fc068de0 msgr2=0x7fd9fc139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda02704700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9fc068de0 0x7fd9fc139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda02704700 1 -- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc0691b0 msgr2=0x7fd9fc06e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda02704700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc0691b0 0x7fd9fc06e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fda02704700 1 -- 172.21.15.6:0/1904211291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec009420 con 0x7fd9fc06d220 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faca0014650 con 0x7faca806d220 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fac8f7fe700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 0x7fac94069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.432+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faca0084ae0 con 0x7faca806d220 2023-10-09T11:36:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.433+0000 7fda02704700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ccc0 tx=0x7fd9f4005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.434+0000 7faca77fe700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 0x7fac94069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.434+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400ce70 con 0x7fd9fc06d220 2023-10-09T11:36:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.434+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400ab70 con 0x7fd9fc06d220 2023-10-09T11:36:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.434+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40070f0 con 0x7fd9fc06d220 2023-10-09T11:36:16.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.436+0000 7faca77fe700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 0x7fac94069560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0030c0 tx=0x7fac9c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.438+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc13fa50 con 0x7fd9fc06d220 2023-10-09T11:36:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.438+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc13a320 con 0x7fd9fc06d220 2023-10-09T11:36:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.439+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880052b0 con 0x7faca806d220 2023-10-09T11:36:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.441+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9f40074e0 con 0x7fd9fc06d220 2023-10-09T11:36:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.442+0000 7fd9f1ffb700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 0x7fd9e00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.442+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9f4084950 con 0x7fd9fc06d220 2023-10-09T11:36:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.443+0000 7fda01f03700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 0x7fd9e00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.443+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc067bc0 con 0x7fd9fc06d220 2023-10-09T11:36:16.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.443+0000 7fda01f03700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 0x7fd9e00694b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0030c0 tx=0x7fd9ec016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.445+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faca0051d30 con 0x7faca806d220 2023-10-09T11:36:16.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.454+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9f4051ca0 con 0x7fd9fc06d220 2023-10-09T11:36:16.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.478+0000 7f4e2bba1700 1 Processor -- start 2023-10-09T11:36:16.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.479+0000 7f4e2bba1700 1 -- start start 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2bba1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e240c8880 0x7f4e2406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2bba1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 0x7f4e241575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2bba1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2406ac50 con 0x7f4e24156d60 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2bba1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2406a400 con 0x7f4e240c8880 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2bba1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240c8fd0 con 0x7f4e24157130 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2993d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e24156d60 0x7f4e2406ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44298/0 (socket says 172.21.15.6:44298) 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.480+0000 7f4e2993d700 1 -- 172.21.15.6:0/3702111454 learned_addr learned my addr 172.21.15.6:0/3702111454 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.481+0000 7f4e2913c700 1 --2- 172.21.15.6:0/3702111454 >> v2:172.21.15.6:3300/0 conn(0x7f4e240c8880 0x7f4e2406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.481+0000 7f4e2a13e700 1 --2- 172.21.15.6:0/3702111454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 0x7f4e241575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2893b700 1 -- 172.21.15.6:0/3702111454 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765109134 0 0) 0x7f4e2406ac50 con 0x7f4e24156d60 2023-10-09T11:36:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2893b700 1 -- 172.21.15.6:0/3702111454 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e10003570 con 0x7f4e24156d60 2023-10-09T11:36:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2a13e700 1 -- 172.21.15.6:0/3702111454 >> v2:172.21.15.6:3300/0 conn(0x7f4e240c8880 msgr2=0x7f4e2406b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2a13e700 1 --2- 172.21.15.6:0/3702111454 >> v2:172.21.15.6:3300/0 conn(0x7f4e240c8880 0x7f4e2406b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2a13e700 1 -- 172.21.15.6:0/3702111454 >> v1:172.21.15.6:6789/0 conn(0x7f4e24156d60 legacy=0x7f4e2406ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.482+0000 7f4e2a13e700 1 -- 172.21.15.6:0/3702111454 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240c8cf0 con 0x7f4e24157130 2023-10-09T11:36:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f4e2a13e700 1 --2- 172.21.15.6:0/3702111454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 0x7f4e241575d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009e60 tx=0x7f4e1c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be2e14738dcc15cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f4e2893b700 1 -- 172.21.15.6:0/3702111454 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00e070 con 0x7f4e24157130 2023-10-09T11:36:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f4e2893b700 1 -- 172.21.15.6:0/3702111454 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00bb60 con 0x7f4e24157130 2023-10-09T11:36:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f4e2893b700 1 -- 172.21.15.6:0/3702111454 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c012430 con 0x7f4e24157130 2023-10-09T11:36:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f71c24ed700 1 Processor -- start 2023-10-09T11:36:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.483+0000 7f71c24ed700 1 -- start start 2023-10-09T11:36:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7f05d7052700 1 Processor -- start 2023-10-09T11:36:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7f4e2bba1700 1 -- 172.21.15.6:0/3702111454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 msgr2=0x7f4e241575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/3702111454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 0x7f4e241575d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009e60 tx=0x7f4e1c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7f05d7052700 1 -- start start 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7ff7d1faf700 1 Processor -- start 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.484+0000 7ff7d1faf700 1 -- start start 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 -- 172.21.15.6:0/3702111454 shutdown_connections 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/3702111454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e24157130 0x7f4e241575d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/3702111454 >> v2:172.21.15.6:3300/0 conn(0x7f4e240c8880 0x7f4e2406b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 -- 172.21.15.6:0/3702111454 >> 172.21.15.6:0/3702111454 conn(0x7f4e240c9ca0 msgr2=0x7f4e240ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c24ed700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71bc1569e0 0x7f71bc0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c24ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71bc06e940 0x7f71bc06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c24ed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc0b2290 con 0x7f71bc156db0 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c24ed700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc157c00 con 0x7f71bc06e940 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c24ed700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc1572d0 con 0x7f71bc1569e0 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71bbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71bc1569e0 0x7f71bc0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71bbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71bc1569e0 0x7f71bc0b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:36094/0 (socket says 172.21.15.6:36094) 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71bbfff700 1 -- 172.21.15.6:0/312428004 learned_addr learned my addr 172.21.15.6:0/312428004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d7052700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d7052700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05d00c2870 0x7f05d00c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d7052700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00c9120 con 0x7f05d00af190 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d7052700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d015e840 con 0x7f05d00c2870 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d7052700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c7620 con 0x7f05d00aedc0 2023-10-09T11:36:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7ff7d1faf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7cc0691b0 0x7ff7cc0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7ff7d1faf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0c7140 con 0x7ff7cc068de0 2023-10-09T11:36:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7ff7d1faf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc0c7420 con 0x7ff7cc0c8720 2023-10-09T11:36:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7ff7d1faf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c7700 con 0x7ff7cc0691b0 2023-10-09T11:36:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f71c0a8a700 1 --2- 172.21.15.6:0/312428004 >> v2:172.21.15.6:3300/0 conn(0x7f71bc06e940 0x7f71bc06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d4dee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d4dee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44706/0 (socket says 172.21.15.6:44706) 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f05d4dee700 1 -- 172.21.15.6:0/182104777 learned_addr learned my addr 172.21.15.6:0/182104777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 -- 172.21.15.6:0/3702111454 shutdown_connections 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.485+0000 7f4e2bba1700 1 -- 172.21.15.6:0/3702111454 wait complete. 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bbfff700 1 -- 172.21.15.6:0/312428004 >> v2:172.21.15.6:3300/0 conn(0x7f71bc06e940 msgr2=0x7f71bc06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bbfff700 1 --2- 172.21.15.6:0/312428004 >> v2:172.21.15.6:3300/0 conn(0x7f71bc06e940 0x7f71bc06bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bbfff700 1 -- 172.21.15.6:0/312428004 >> v1:172.21.15.6:6789/0 conn(0x7f71bc156db0 legacy=0x7f71bc06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bbfff700 1 -- 172.21.15.6:0/312428004 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc1575b0 con 0x7f71bc1569e0 2023-10-09T11:36:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7ff7cbfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff7cc0c8720 0x7ff7cc06d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52708/0 (socket says 172.21.15.6:52708) 2023-10-09T11:36:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7ff7cbfff700 1 -- 172.21.15.6:0/2866118680 learned_addr learned my addr 172.21.15.6:0/2866118680 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7ff7caffd700 1 --2- 172.21.15.6:0/2866118680 >> v2:172.21.15.118:3300/0 conn(0x7ff7cc0691b0 0x7ff7cc0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bbfff700 1 --2- 172.21.15.6:0/312428004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc0b17d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06f590 tx=0x7f71ac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631998e3bea44a28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f05d4dee700 1 -- 172.21.15.6:0/182104777 >> v2:172.21.15.118:3300/0 conn(0x7f05d00c2870 msgr2=0x7f05d00c2cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T11:36:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f05d4dee700 1 --2- 172.21.15.6:0/182104777 >> v2:172.21.15.118:3300/0 conn(0x7f05d00c2870 0x7f05d00c2cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f05d4dee700 1 -- 172.21.15.6:0/182104777 >> v1:172.21.15.118:6789/0 conn(0x7f05d00af190 legacy=0x7f05d0068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f05d4dee700 1 -- 172.21.15.6:0/182104777 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00c23e0 con 0x7f05d00aedc0 2023-10-09T11:36:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bb7fe700 1 -- 172.21.15.6:0/312428004 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00b820 con 0x7f71bc1569e0 2023-10-09T11:36:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bb7fe700 1 -- 172.21.15.6:0/312428004 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00b980 con 0x7f71bc1569e0 2023-10-09T11:36:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f71bb7fe700 1 -- 172.21.15.6:0/312428004 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00bd00 con 0x7f71bc1569e0 2023-10-09T11:36:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.486+0000 7f05d4dee700 1 --2- 172.21.15.6:0/182104777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0099b0 tx=0x7f05bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff073bbc6bd180 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f05cf7fe700 1 -- 172.21.15.6:0/182104777 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00b820 con 0x7f05d00aedc0 2023-10-09T11:36:16.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f05cf7fe700 1 -- 172.21.15.6:0/182104777 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00b980 con 0x7f05d00aedc0 2023-10-09T11:36:16.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f05cf7fe700 1 -- 172.21.15.6:0/182104777 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00bd20 con 0x7f05d00aedc0 2023-10-09T11:36:16.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f4e2bba1700 1 Processor -- start 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 -- 172.21.15.6:0/312428004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 msgr2=0x7f71bc0b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 --2- 172.21.15.6:0/312428004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc0b17d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06f590 tx=0x7f71ac009250 comp rx=0 tx=0).stop 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 -- 172.21.15.6:0/312428004 shutdown_connections 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 --2- 172.21.15.6:0/312428004 >> v2:172.21.15.6:3300/0 conn(0x7f71bc06e940 0x7f71bc06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 --2- 172.21.15.6:0/312428004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc0b17d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 -- 172.21.15.6:0/312428004 >> 172.21.15.6:0/312428004 conn(0x7f71bc06cca0 msgr2=0x7f71bc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 -- 172.21.15.6:0/312428004 shutdown_connections 2023-10-09T11:36:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.487+0000 7f71c24ed700 1 -- 172.21.15.6:0/312428004 wait complete. 2023-10-09T11:36:16.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.488+0000 7f05d7052700 1 -- 172.21.15.6:0/182104777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 msgr2=0x7f05d00c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.488+0000 7f05d7052700 1 --2- 172.21.15.6:0/182104777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0099b0 tx=0x7f05bc009250 comp rx=0 tx=0).stop 2023-10-09T11:36:16.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.488+0000 7f4e2bba1700 1 -- start start 2023-10-09T11:36:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649995863 0 0) 0x7ff7cc0c7140 con 0x7ff7cc068de0 2023-10-09T11:36:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b4003570 con 0x7ff7cc068de0 2023-10-09T11:36:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666350533 0 0) 0x7ff7cc0c7420 con 0x7ff7cc0c8720 2023-10-09T11:36:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7cc0c7140 con 0x7ff7cc0c8720 2023-10-09T11:36:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f71c24ed700 1 Processor -- start 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522639264 0 0) 0x7ff7b4003570 con 0x7ff7cc068de0 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 >> v2:172.21.15.118:3300/0 conn(0x7ff7cc0691b0 msgr2=0x7ff7cc0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 --2- 172.21.15.6:0/2866118680 >> v2:172.21.15.118:3300/0 conn(0x7ff7cc0691b0 0x7ff7cc0c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 >> v1:172.21.15.118:6789/0 conn(0x7ff7cc0c8720 legacy=0x7ff7cc06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0c79e0 con 0x7ff7cc068de0 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ff7bc001470 con 0x7ff7cc068de0 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 >> v1:172.21.15.6:6789/0 conn(0x7ff7cc068de0 legacy=0x7ff7cc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 0x7ff7b4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7b4004810 0x7ff7b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b40051c0 0x7ff7b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c7700 con 0x7ff7b4003bf0 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b400c160 con 0x7ff7b4004810 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b400c320 con 0x7ff7b40051c0 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e240c8880 0x7f4e240b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e24157130 0x7f4e2414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240b0f20 con 0x7f4e24156d60 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240b2090 con 0x7f4e24157130 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f4e2bba1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240b2370 con 0x7f4e240c8880 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36446/0 (socket says 172.21.15.6:36446) 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 -- 172.21.15.6:0/849435791 learned_addr learned my addr 172.21.15.6:0/849435791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2993d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e240c8880 0x7f4e240b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 0x7ff7b4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7caffd700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7b4004810 0x7ff7b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.489+0000 7f71c24ed700 1 -- start start 2023-10-09T11:36:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cbfff700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b40051c0 0x7ff7b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b40051c0 msgr2=0x7ff7b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b40051c0 0x7ff7b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7b4004810 msgr2=0x7ff7b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7b4004810 0x7ff7b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2866118680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0c79e0 con 0x7ff7b4003bf0 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 -- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e240c8880 msgr2=0x7f4e240b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e240c8880 0x7f4e240b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 -- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e24157130 msgr2=0x7f4e2414cff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e24157130 0x7f4e2414cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 -- 172.21.15.6:0/849435791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c009a20 con 0x7f4e24156d60 2023-10-09T11:36:16.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cbfff700 1 -- 172.21.15.6:0/2866118680 reap_dead start 2023-10-09T11:36:16.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7f4e2913c700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000d890 tx=0x7f4e20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.490+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 0x7ff7b4003fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc002ee0 tx=0x7ff7bc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71af8e1ab2786004 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200125f0 con 0x7f4e24156d60 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20012750 con 0x7f4e24156d60 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20012ad0 con 0x7f4e24156d60 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e240b2650 con 0x7f4e24156d60 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 0x7f71bc14a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 0x7f71bc16e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1494c0 con 0x7f71bc156db0 2023-10-09T11:36:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc149710 con 0x7f71bc1569e0 2023-10-09T11:36:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c24ed700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc1499f0 con 0x7f71bc06e940 2023-10-09T11:36:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00cb10 con 0x7ff7b4003bf0 2023-10-09T11:36:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c0a8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 0x7f71bc16e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c0a8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 0x7f71bc16e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36472/0 (socket says 172.21.15.6:36472) 2023-10-09T11:36:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71c0a8a700 1 -- 172.21.15.6:0/544614268 learned_addr learned my addr 172.21.15.6:0/544614268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00cc70 con 0x7ff7b4003bf0 2023-10-09T11:36:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7ff7ca7fc700 1 -- 172.21.15.6:0/2866118680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012420 con 0x7ff7b4003bf0 2023-10-09T11:36:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71bbfff700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 0x7f71bc14a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e240b2c10 con 0x7f4e24156d60 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 -- 172.21.15.6:0/182104777 shutdown_connections 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 --2- 172.21.15.6:0/182104777 >> v2:172.21.15.118:3300/0 conn(0x7f05d00c2870 0x7f05d00c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 --2- 172.21.15.6:0/182104777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c8b20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 -- 172.21.15.6:0/182104777 >> 172.21.15.6:0/182104777 conn(0x7f05d006c660 msgr2=0x7f05d00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 -- 172.21.15.6:0/182104777 shutdown_connections 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f05d7052700 1 -- 172.21.15.6:0/182104777 wait complete. 2023-10-09T11:36:16.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f699b329700 1 Processor -- start 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f699b329700 1 -- start start 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.491+0000 7f71b37fe700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f71bbfff700 1 -- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 msgr2=0x7f71bc142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f71bbfff700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f71bbfff700 1 -- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 msgr2=0x7f71bc16e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f71bbfff700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 0x7f71bc16e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f71bbfff700 1 -- 172.21.15.6:0/544614268 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0094f0 con 0x7f71bc06e940 2023-10-09T11:36:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f71bbfff700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 0x7f71bc14a4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71bc069450 tx=0x7f71ac016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f699b329700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f699b329700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f699413ffe0 0x7f699406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.492+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e24068080 con 0x7f4e24156d60 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f05d7052700 1 Processor -- start 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac011ce0 con 0x7f71bc06e940 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac020070 con 0x7f71bc06e940 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac01b6a0 con 0x7f71bc06e940 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 msgr2=0x7ff7b4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 0x7ff7b4003fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc002ee0 tx=0x7ff7bc007830 comp rx=0 tx=0).stop 2023-10-09T11:36:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f699b329700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69940698b0 con 0x7f6994063230 2023-10-09T11:36:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f699b329700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940692a0 con 0x7f699413ffe0 2023-10-09T11:36:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.493+0000 7f699b329700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699406d180 con 0x7f699413fc10 2023-10-09T11:36:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc149cd0 con 0x7f71bc06e940 2023-10-09T11:36:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc142ba0 con 0x7f71bc06e940 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44732/0 (socket says 172.21.15.6:44732) 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 -- 172.21.15.6:0/2114294436 learned_addr learned my addr 172.21.15.6:0/2114294436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 -- 172.21.15.6:0/2114294436 >> v2:172.21.15.6:3300/0 conn(0x7f699413ffe0 msgr2=0x7f699406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 --2- 172.21.15.6:0/2114294436 >> v2:172.21.15.6:3300/0 conn(0x7f699413ffe0 0x7f699406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 -- 172.21.15.6:0/2114294436 >> v1:172.21.15.6:6789/0 conn(0x7f6994063230 legacy=0x7f69940c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f69990c5700 1 -- 172.21.15.6:0/2114294436 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994069540 con 0x7f699413fc10 2023-10-09T11:36:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f69990c5700 1 --2- 172.21.15.6:0/2114294436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f699000bc50 tx=0x7f699000b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e241887cf1890b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e2001e460 con 0x7f4e24156d60 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f4e19ffb700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e20084b50 con 0x7f4e24156d60 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.497+0000 7f4e2993d700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.497+0000 7f4e2993d700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e14007fd0 tx=0x7f4e14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc142d90 con 0x7f71bc06e940 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.494+0000 7f05d7052700 1 -- start start 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05d00af190 0x7f05d01771d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05d00c2870 0x7f05d015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c7080 con 0x7f05d00af190 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c4bf0 con 0x7f05d00c2870 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d7052700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c4e60 con 0x7f05d00aedc0 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44744/0 (socket says 172.21.15.6:44744) 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 -- 172.21.15.6:0/353707195 learned_addr learned my addr 172.21.15.6:0/353707195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d55ef700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05d00c2870 0x7f05d015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 -- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05d00c2870 msgr2=0x7f05d015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05d00c2870 0x7f05d015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 -- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05d00af190 msgr2=0x7f05d01771d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05d00af190 0x7f05d01771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 -- 172.21.15.6:0/353707195 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0094f0 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7f05d4dee700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009290 tx=0x7f05bc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.496+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc011d70 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.496+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc020070 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.496+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00c5140 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.496+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d015cf20 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.496+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc01b6a0 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.497+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05bc022030 con 0x7f05d00aedc0 2023-10-09T11:36:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.498+0000 7f05ccff9700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 0x7f05b40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.498+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05bc0864e0 con 0x7f05d00aedc0 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2866118680 shutdown_connections 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2866118680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7b4003bf0 0x7ff7b4003fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2866118680 >> 172.21.15.6:0/2866118680 conn(0x7ff7cc0cc980 msgr2=0x7ff7cc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2866118680 shutdown_connections 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.495+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2866118680 wait complete. 2023-10-09T11:36:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.497+0000 7ff7d1faf700 1 Processor -- start 2023-10-09T11:36:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f05cffff700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 0x7f05b40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac0052b0 con 0x7f05d00aedc0 2023-10-09T11:36:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.498+0000 7ff7d1faf700 1 -- start start 2023-10-09T11:36:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7cc15a340 0x7ff7cc15be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7cc0c8f00 0x7ff7cc0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15d350 con 0x7ff7cc0c8f00 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c9890 con 0x7ff7cc15a340 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7d1faf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15c740 con 0x7ff7b4003bf0 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7cb7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7cb7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44756/0 (socket says 172.21.15.6:44756) 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2350528485 learned_addr learned my addr 172.21.15.6:0/2350528485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7ff7cbfff700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7cc0c8f00 0x7ff7cc0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f05cffff700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 0x7f05b40693b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05c4007fd0 tx=0x7f05c4007b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7cc15a340 msgr2=0x7ff7cc15be80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7cc15a340 0x7ff7cc15be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7cc0c8f00 msgr2=0x7ff7cc0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7cc0c8f00 0x7ff7cc0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 -- 172.21.15.6:0/2350528485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc15ca20 con 0x7ff7b4003bf0 2023-10-09T11:36:16.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7ff7cb7fe700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c130 tx=0x7ff7bc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71ac022030 con 0x7f71bc06e940 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.498+0000 7f2f1de3b700 1 Processor -- start 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.498+0000 7f2f1de3b700 1 -- start start 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f1de3b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f1806f580 0x7f2f180caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f1de3b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f1806f950 0x7f2f18068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f1de3b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1806d220 con 0x7f2f180c83a0 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f1de3b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1806d500 con 0x7f2f1806f580 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f1de3b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180cb7b0 con 0x7f2f1806f950 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f17fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f180c83a0 0x7f2f180c7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44336/0 (socket says 172.21.15.6:44336) 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.499+0000 7f2f17fff700 1 -- 172.21.15.6:0/292345598 learned_addr learned my addr 172.21.15.6:0/292345598 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.500+0000 7f2f177fe700 1 --2- 172.21.15.6:0/292345598 >> v2:172.21.15.6:3300/0 conn(0x7f2f1806f580 0x7f2f180caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f16ffd700 1 --2- 172.21.15.6:0/292345598 >> v2:172.21.15.118:3300/0 conn(0x7f2f1806f950 0x7f2f18068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f177fe700 1 -- 172.21.15.6:0/292345598 >> v2:172.21.15.118:3300/0 conn(0x7f2f1806f950 msgr2=0x7f2f18068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f177fe700 1 --2- 172.21.15.6:0/292345598 >> v2:172.21.15.118:3300/0 conn(0x7f2f1806f950 0x7f2f18068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f177fe700 1 -- 172.21.15.6:0/292345598 >> v1:172.21.15.6:6789/0 conn(0x7f2f180c83a0 legacy=0x7f2f180c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f177fe700 1 -- 172.21.15.6:0/292345598 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180cba90 con 0x7f2f1806f580 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f2f177fe700 1 --2- 172.21.15.6:0/292345598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f1806f580 0x7f2f180caf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cd7b0 tx=0x7f2f00007200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e549ce6b0f7a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e20051dc0 con 0x7f4e24156d60 2023-10-09T11:36:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f71b8ff9700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 0x7f719c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71ac086550 con 0x7f71bc06e940 2023-10-09T11:36:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.501+0000 7f71b37fe700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 0x7f719c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f167fc700 1 -- 172.21.15.6:0/292345598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000092e0 con 0x7f2f1806f580 2023-10-09T11:36:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71ac0537a0 con 0x7f71bc06e940 2023-10-09T11:36:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f167fc700 1 -- 172.21.15.6:0/292345598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000f9a0 con 0x7f2f1806f580 2023-10-09T11:36:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f167fc700 1 -- 172.21.15.6:0/292345598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000fd60 con 0x7f2f1806f580 2023-10-09T11:36:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f71b37fe700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 0x7f719c069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f71bc147940 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f1de3b700 1 -- 172.21.15.6:0/292345598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f1806f580 msgr2=0x7f2f180caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/292345598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f1806f580 0x7f2f180caf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cd7b0 tx=0x7f2f00007200 comp rx=0 tx=0).stop 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f1de3b700 1 -- 172.21.15.6:0/292345598 shutdown_connections 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.502+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/292345598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f1806f580 0x7f2f180caf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/292345598 >> v2:172.21.15.118:3300/0 conn(0x7f2f1806f950 0x7f2f18068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f2f1de3b700 1 -- 172.21.15.6:0/292345598 >> 172.21.15.6:0/292345598 conn(0x7f2f180cc980 msgr2=0x7f2f180ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f698bfff700 1 -- 172.21.15.6:0/2114294436 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000be60 con 0x7f699413fc10 2023-10-09T11:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f698bfff700 1 -- 172.21.15.6:0/2114294436 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699000de00 con 0x7f699413fc10 2023-10-09T11:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f698bfff700 1 -- 172.21.15.6:0/2114294436 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900196b0 con 0x7f699413fc10 2023-10-09T11:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f699b329700 1 -- 172.21.15.6:0/2114294436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 msgr2=0x7f699406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.503+0000 7f699b329700 1 --2- 172.21.15.6:0/2114294436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f699000bc50 tx=0x7f699000b4f0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc006a30 con 0x7ff7b4003bf0 2023-10-09T11:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc006b90 con 0x7ff7b4003bf0 2023-10-09T11:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0127f0 con 0x7ff7b4003bf0 2023-10-09T11:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc15cd00 con 0x7ff7b4003bf0 2023-10-09T11:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc150540 con 0x7ff7b4003bf0 2023-10-09T11:36:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.506+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05bc053750 con 0x7f05d00aedc0 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.507+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc067bc0 con 0x7ff7b4003bf0 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.507+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7bc024070 con 0x7ff7b4003bf0 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.508+0000 7ff7b37fe700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 0x7ff7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.508+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7bc086270 con 0x7ff7b4003bf0 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.509+0000 7ff7caffd700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 0x7ff7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.509+0000 7ff7caffd700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 0x7ff7b80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc171ec0 tx=0x7ff7c00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.510+0000 7f2f1de3b700 1 -- 172.21.15.6:0/292345598 shutdown_connections 2023-10-09T11:36:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 -- 172.21.15.6:0/2114294436 shutdown_connections 2023-10-09T11:36:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 --2- 172.21.15.6:0/2114294436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f699413fc10 0x7f699406c5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 --2- 172.21.15.6:0/2114294436 >> v2:172.21.15.6:3300/0 conn(0x7f699413ffe0 0x7f699406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 -- 172.21.15.6:0/2114294436 >> 172.21.15.6:0/2114294436 conn(0x7f69940c9ca0 msgr2=0x7f69940ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 -- 172.21.15.6:0/2114294436 shutdown_connections 2023-10-09T11:36:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.511+0000 7f699b329700 1 -- 172.21.15.6:0/2114294436 wait complete. 2023-10-09T11:36:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.512+0000 7f699b329700 1 Processor -- start 2023-10-09T11:36:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.512+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7bc0534e0 con 0x7ff7b4003bf0 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.512+0000 7f699b329700 1 -- start start 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f699413fc10 0x7f699413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699413ffe0 0x7f69940b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699413f220 con 0x7f699413ffe0 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69940b2540 con 0x7f699413fc10 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.513+0000 7f699b329700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940b1690 con 0x7f6994063230 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44764/0 (socket says 172.21.15.6:44764) 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 -- 172.21.15.6:0/562920096 learned_addr learned my addr 172.21.15.6:0/562920096 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69988c4700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f699413fc10 0x7f699413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69998c6700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699413ffe0 0x7f69940b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 -- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f699413fc10 msgr2=0x7f699413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f699413fc10 0x7f699413ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 -- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699413ffe0 msgr2=0x7f69940b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699413ffe0 0x7f69940b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.514+0000 7f69990c5700 1 -- 172.21.15.6:0/562920096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699000b790 con 0x7f6994063230 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f69990c5700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6990006fd0 tx=0x7f699001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990006bc0 con 0x7f6994063230 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699001e040 con 0x7f6994063230 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69940b1930 con 0x7f6994063230 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69940b1ef0 con 0x7f6994063230 2023-10-09T11:36:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.515+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900109a0 con 0x7f6994063230 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.517+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6990010d50 con 0x7f6994063230 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.517+0000 7f69897fa700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 0x7f69780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.518+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6990014070 con 0x7f6994063230 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.518+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740052b0 con 0x7f6994063230 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.521+0000 7f69988c4700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 0x7f69780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.521+0000 7f69988c4700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 0x7f69780693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69940ac530 tx=0x7f69840090f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.523+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6990053600 con 0x7f6994063230 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.521+0000 7f2f1de3b700 1 -- 172.21.15.6:0/292345598 wait complete. 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.523+0000 7f2f1de3b700 1 Processor -- start 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.523+0000 7f2f1de3b700 1 -- start start 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 0x7f2f1817e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f180c83a0 0x7f2f1817e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 0x7f2f1815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1817ee90 con 0x7f2f180b0440 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b14c0 con 0x7f2f180c83a0 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f1de3b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b08b0 con 0x7f2f1806f580 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f177fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 0x7f2f1817e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f177fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 0x7f2f1817e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44770/0 (socket says 172.21.15.6:44770) 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.524+0000 7f2f177fe700 1 -- 172.21.15.6:0/2176441060 learned_addr learned my addr 172.21.15.6:0/2176441060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 0x7f2f1815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 -- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 msgr2=0x7f2f1817e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 0x7f2f1817e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 -- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f180c83a0 msgr2=0x7f2f1817e950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f180c83a0 0x7f2f1817e950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 -- 172.21.15.6:0/2176441060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000094d0 con 0x7f2f180b0440 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.525+0000 7f2f17fff700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 0x7f2f1815de30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000cbc0 tx=0x7f2f100019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.537+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000a7f0 con 0x7f2f180b0440 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.537+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000a990 con 0x7f2f180b0440 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.537+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000ad50 con 0x7f2f180b0440 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.537+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f180b0b90 con 0x7f2f180b0440 2023-10-09T11:36:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.537+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f180b1150 con 0x7f2f180b0440 2023-10-09T11:36:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.540+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f10007300 con 0x7f2f180b0440 2023-10-09T11:36:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.541+0000 7f2f0f7fe700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 0x7f2ef8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.541+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f100847d0 con 0x7f2f180b0440 2023-10-09T11:36:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.542+0000 7f2f177fe700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 0x7f2ef8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:16.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.543+0000 7f2f177fe700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 0x7f2ef8069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f000030a0 tx=0x7f2f00019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:16.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.543+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0052b0 con 0x7f2f180b0440 2023-10-09T11:36:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.552+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f10051aa0 con 0x7f2f180b0440 2023-10-09T11:36:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.848+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fac88005560 con 0x7faca806d220 2023-10-09T11:36:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.848+0000 7fac8f7fe700 1 -- 172.21.15.6:0/1644368739 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faca0055350 con 0x7faca806d220 2023-10-09T11:36:16.852 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.851+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 msgr2=0x7fac94069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.851+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 0x7fac94069560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0030c0 tx=0x7fac9c016000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.851+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 msgr2=0x7faca8146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.851+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faca0009db0 tx=0x7faca000b040 comp rx=0 tx=0).stop 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 shutdown_connections 2023-10-09T11:36:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fac940670b0 0x7fac94069560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faca806d220 0x7faca8146a20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faca8068de0 0x7faca81343c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 --2- 172.21.15.6:0/1644368739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faca80691b0 0x7faca81464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 >> 172.21.15.6:0/1644368739 conn(0x7faca80cc980 msgr2=0x7faca80c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.852+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 shutdown_connections 2023-10-09T11:36:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.854+0000 7facadaa0700 1 -- 172.21.15.6:0/1644368739 wait complete. 2023-10-09T11:36:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.865+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9fc0c7cc0 con 0x7fd9fc06d220 2023-10-09T11:36:16.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-09T11:36:16.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.872+0000 7fd9f1ffb700 1 -- 172.21.15.6:0/1904211291 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9f40552c0 con 0x7fd9fc06d220 2023-10-09T11:36:16.873 INFO:teuthology.orchestra.run.smithi006.stdout:55834574853 2023-10-09T11:36:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.876+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 msgr2=0x7fd9e00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.876+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 0x7fd9e00694b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0030c0 tx=0x7fd9ec016000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.876+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 msgr2=0x7fd9fc06e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.876+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ccc0 tx=0x7fd9f4005400 comp rx=0 tx=0).stop 2023-10-09T11:36:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 shutdown_connections 2023-10-09T11:36:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd9e0067000 0x7fd9e00694b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06d220 0x7fd9fc06e7e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd9fc068de0 0x7fd9fc139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 --2- 172.21.15.6:0/1904211291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9fc0691b0 0x7fd9fc06e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 >> 172.21.15.6:0/1904211291 conn(0x7fd9fc0cc980 msgr2=0x7fd9fc0c2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 shutdown_connections 2023-10-09T11:36:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.880+0000 7fda04167700 1 -- 172.21.15.6:0/1904211291 wait complete. 2023-10-09T11:36:16.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.883+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e2404bb80 con 0x7f4e24156d60 2023-10-09T11:36:16.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.884+0000 7f4e19ffb700 1 -- 172.21.15.6:0/849435791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e200553e0 con 0x7f4e24156d60 2023-10-09T11:36:16.888 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.892+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 msgr2=0x7f4e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.892+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e14007fd0 tx=0x7f4e14009040 comp rx=0 tx=0).stop 2023-10-09T11:36:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.892+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 msgr2=0x7f4e240b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.892+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000d890 tx=0x7f4e20008040 comp rx=0 tx=0).stop 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 shutdown_connections 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e24157130 0x7f4e2414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e240c8880 0x7f4e240b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 --2- 172.21.15.6:0/849435791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e24156d60 0x7f4e240b09e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.893+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 >> 172.21.15.6:0/849435791 conn(0x7f4e240c9ca0 msgr2=0x7f4e240cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-09T11:36:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.894+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 shutdown_connections 2023-10-09T11:36:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.894+0000 7f4e2bba1700 1 -- 172.21.15.6:0/849435791 wait complete. 2023-10-09T11:36:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.901+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff7cc0c7cc0 con 0x7ff7b4003bf0 2023-10-09T11:36:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.901+0000 7ff7b37fe700 1 -- 172.21.15.6:0/2350528485 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7bc02c090 con 0x7ff7b4003bf0 2023-10-09T11:36:16.903 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71bc142d90 con 0x7f71bc06e940 2023-10-09T11:36:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 msgr2=0x7ff7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 0x7ff7b80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc171ec0 tx=0x7ff7c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 msgr2=0x7ff7cc150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400c130 tx=0x7ff7bc017000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7f71b8ff9700 1 -- 172.21.15.6:0/544614268 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71ac011e60 con 0x7f71bc06e940 2023-10-09T11:36:16.906 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 shutdown_connections 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7b8066f30 0x7ff7b80693e0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc171ec0 tx=0x7ff7c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7cc0c8f00 0x7ff7cc0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7b4003bf0 0x7ff7cc150000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 --2- 172.21.15.6:0/2350528485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7cc15a340 0x7ff7cc15be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 >> 172.21.15.6:0/2350528485 conn(0x7ff7cc0cc980 msgr2=0x7ff7cc06f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 shutdown_connections 2023-10-09T11:36:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.904+0000 7ff7d1faf700 1 -- 172.21.15.6:0/2350528485 wait complete. 2023-10-09T11:36:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.908+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 msgr2=0x7f719c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.908+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 0x7f719c069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f71bc147940 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.908+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 msgr2=0x7f71bc14a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.908+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 0x7f71bc14a4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f71bc069450 tx=0x7f71ac016000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 shutdown_connections 2023-10-09T11:36:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f719c067080 0x7f719c069530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71bc156db0 0x7f71bc16e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71bc06e940 0x7f71bc14a4d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 --2- 172.21.15.6:0/544614268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71bc1569e0 0x7f71bc142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 >> 172.21.15.6:0/544614268 conn(0x7f71bc06cca0 msgr2=0x7f71bc0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 shutdown_connections 2023-10-09T11:36:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.909+0000 7f71c24ed700 1 -- 172.21.15.6:0/544614268 wait complete. 2023-10-09T11:36:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.911+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05ac005830 con 0x7f05d00aedc0 2023-10-09T11:36:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.911+0000 7f05ccff9700 1 -- 172.21.15.6:0/353707195 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05bc056d70 con 0x7f05d00aedc0 2023-10-09T11:36:16.913 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-09T11:36:16.913 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.914+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 msgr2=0x7f05b40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.914+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 0x7f05b40693b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05c4007fd0 tx=0x7f05c4007b20 comp rx=0 tx=0).stop 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.914+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 msgr2=0x7f05d00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.914+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009290 tx=0x7f05bc016000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 shutdown_connections 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05b4066f00 0x7f05b40693b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05d00c2870 0x7f05d015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05d00aedc0 0x7f05d00c6b40 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009290 tx=0x7f05bc016000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 --2- 172.21.15.6:0/353707195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05d00af190 0x7f05d01771d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.915+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 >> 172.21.15.6:0/353707195 conn(0x7f05d006c660 msgr2=0x7f05d00c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.916+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 shutdown_connections 2023-10-09T11:36:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.916+0000 7f05d7052700 1 -- 172.21.15.6:0/353707195 wait complete. 2023-10-09T11:36:16.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-09T11:36:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.923+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6974005830 con 0x7f6994063230 2023-10-09T11:36:16.925 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.923+0000 7f69897fa700 1 -- 172.21.15.6:0/562920096 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6990056c20 con 0x7f6994063230 2023-10-09T11:36:16.925 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-09T11:36:16.928 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 msgr2=0x7f69780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 0x7f69780693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69940ac530 tx=0x7f69840090f0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 msgr2=0x7f6994158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6990006fd0 tx=0x7f699001b000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 shutdown_connections 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6978066f30 0x7f69780693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699413ffe0 0x7f69940b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6994063230 0x7f6994158f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 --2- 172.21.15.6:0/562920096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f699413fc10 0x7f699413ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 >> 172.21.15.6:0/562920096 conn(0x7f69940c9ca0 msgr2=0x7f69940c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 shutdown_connections 2023-10-09T11:36:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.927+0000 7f699b329700 1 -- 172.21.15.6:0/562920096 wait complete. 2023-10-09T11:36:16.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-09T11:36:16.935 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.937+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2efc005560 con 0x7f2f180b0440 2023-10-09T11:36:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.937+0000 7f2f0f7fe700 1 -- 172.21.15.6:0/2176441060 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f100550c0 con 0x7f2f180b0440 2023-10-09T11:36:16.939 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 msgr2=0x7f2ef8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 0x7f2ef8069530 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f000030a0 tx=0x7f2f00019000 comp rx=0 tx=0).stop 2023-10-09T11:36:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 msgr2=0x7f2f1815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 0x7f2f1815de30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000cbc0 tx=0x7f2f100019a0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 shutdown_connections 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2ef8067080 0x7f2ef8069530 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180b0440 0x7f2f1815de30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f1806f580 0x7f2f1817e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 --2- 172.21.15.6:0/2176441060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f180c83a0 0x7f2f1817e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 >> 172.21.15.6:0/2176441060 conn(0x7f2f180cc980 msgr2=0x7f2f18166480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 shutdown_connections 2023-10-09T11:36:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:16.939+0000 7f2f1de3b700 1 -- 172.21.15.6:0/2176441060 wait complete. 2023-10-09T11:36:16.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-09T11:36:16.943 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:16.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-09T11:36:16.953 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:17.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T11:36:17.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T11:36:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:17.999+0000 7f26ef45e700 1 Processor -- start 2023-10-09T11:36:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:17.999+0000 7f26ef45e700 1 -- start start 2023-10-09T11:36:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ef45e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ef45e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26e806d120 0x7f26e806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ef45e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e806dac0 con 0x7f26e81578d0 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ef45e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e80d07c0 con 0x7f26e806d120 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ef45e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80cfbb0 con 0x7f26e8157ca0 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26e806d120 0x7f26e806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26e806d120 0x7f26e806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36548/0 (socket says 172.21.15.6:36548) 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 -- 172.21.15.6:0/764392801 learned_addr learned my addr 172.21.15.6:0/764392801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ec9f9700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 -- 172.21.15.6:0/764392801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 msgr2=0x7f26e80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 -- 172.21.15.6:0/764392801 >> v1:172.21.15.118:6789/0 conn(0x7f26e81578d0 legacy=0x7f26e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.000+0000 7f26ed9fb700 1 -- 172.21.15.6:0/764392801 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80cfe90 con 0x7f26e806d120 2023-10-09T11:36:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ed9fb700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e806d580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009f20 tx=0x7f26e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bacbe73c57c908 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26dffff700 1 -- 172.21.15.6:0/764392801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000e070 con 0x7f26e806d120 2023-10-09T11:36:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26dffff700 1 -- 172.21.15.6:0/764392801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000ba80 con 0x7f26e806d120 2023-10-09T11:36:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26dffff700 1 -- 172.21.15.6:0/764392801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00092e0 con 0x7f26e806d120 2023-10-09T11:36:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 -- 172.21.15.6:0/764392801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 msgr2=0x7f26e806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e806d580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009f20 tx=0x7f26e0009840 comp rx=0 tx=0).stop 2023-10-09T11:36:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 -- 172.21.15.6:0/764392801 shutdown_connections 2023-10-09T11:36:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e806d580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 --2- 172.21.15.6:0/764392801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.001+0000 7f26ef45e700 1 -- 172.21.15.6:0/764392801 >> 172.21.15.6:0/764392801 conn(0x7f26e806bb90 msgr2=0x7f26e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.002+0000 7f26ef45e700 1 -- 172.21.15.6:0/764392801 shutdown_connections 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.002+0000 7f26ef45e700 1 -- 172.21.15.6:0/764392801 wait complete. 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.003+0000 7f26ef45e700 1 Processor -- start 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.003+0000 7f26ef45e700 1 -- start start 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26e81578d0 0x7f26e816b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e816d950 con 0x7f26e806d120 2023-10-09T11:36:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80c8aa0 con 0x7f26e81578d0 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e816bc10 con 0x7f26e8157ca0 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36550/0 (socket says 172.21.15.6:36550) 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 -- 172.21.15.6:0/1847479603 learned_addr learned my addr 172.21.15.6:0/1847479603 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ec9f9700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26e81578d0 0x7f26e816b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed9fb700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 -- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 msgr2=0x7f26e80c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 -- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26e81578d0 msgr2=0x7f26e816b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26e81578d0 0x7f26e816b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 -- 172.21.15.6:0/1847479603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009ae0 con 0x7f26e806d120 2023-10-09T11:36:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ed1fa700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c5c0 tx=0x7f26d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8011590 con 0x7f26e806d120 2023-10-09T11:36:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8011710 con 0x7f26e806d120 2023-10-09T11:36:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e80c6500 con 0x7f26e806d120 2023-10-09T11:36:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.004+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8011ad0 con 0x7f26e806d120 2023-10-09T11:36:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.005+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e80c6ac0 con 0x7f26e806d120 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.005+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e8067ac0 con 0x7f26e806d120 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.006+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26d801b3b0 con 0x7f26e806d120 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.007+0000 7f26dd7fa700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 0x7f26cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.007+0000 7f26ec9f9700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 0x7f26cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.007+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26d8083c70 con 0x7f26e806d120 2023-10-09T11:36:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.007+0000 7f26ec9f9700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 0x7f26cc0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26e815d1d0 tx=0x7f26e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.010+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26d8050ec0 con 0x7f26e806d120 2023-10-09T11:36:18.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.039+0000 7f123e522700 1 Processor -- start 2023-10-09T11:36:18.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.039+0000 7f123e522700 1 -- start start 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123e522700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 0x7f12380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123e522700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f123806d120 0x7f123806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123e522700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123806dac0 con 0x7f1238157ca0 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123e522700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380d07c0 con 0x7f123806d120 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123e522700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380cfbb0 con 0x7f12381578d0 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f123806d120 0x7f123806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f1237fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 0x7f12380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f12377fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1238157ca0 0x7f123815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52732/0 (socket says 172.21.15.6:52732) 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f123806d120 0x7f123806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36558/0 (socket says 172.21.15.6:36558) 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f12377fe700 1 -- 172.21.15.6:0/778751612 learned_addr learned my addr 172.21.15.6:0/778751612 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f1236ffd700 1 -- 172.21.15.6:0/778751612 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614661825 0 0) 0x7f122c001110 con 0x7f1238157ca0 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f1236ffd700 1 -- 172.21.15.6:0/778751612 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003570 con 0x7f1238157ca0 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 -- 172.21.15.6:0/778751612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 msgr2=0x7f12380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 0x7f12380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 -- 172.21.15.6:0/778751612 >> v1:172.21.15.118:6789/0 conn(0x7f1238157ca0 legacy=0x7f123815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 -- 172.21.15.6:0/778751612 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380cfe90 con 0x7f123806d120 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f1237fff700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 0x7f12380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.040+0000 7f123cabf700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f123806d120 0x7f123806d580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1230009e60 tx=0x7f1230009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a95475372e11d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f1236ffd700 1 -- 172.21.15.6:0/778751612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000e070 con 0x7f123806d120 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f1236ffd700 1 -- 172.21.15.6:0/778751612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000bab0 con 0x7f123806d120 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f1236ffd700 1 -- 172.21.15.6:0/778751612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000be30 con 0x7f123806d120 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 -- 172.21.15.6:0/778751612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f123806d120 msgr2=0x7f123806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f123806d120 0x7f123806d580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1230009e60 tx=0x7f1230009780 comp rx=0 tx=0).stop 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 -- 172.21.15.6:0/778751612 shutdown_connections 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f123806d120 0x7f123806d580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 --2- 172.21.15.6:0/778751612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12381578d0 0x7f12380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 -- 172.21.15.6:0/778751612 >> 172.21.15.6:0/778751612 conn(0x7f123806bb90 msgr2=0x7f123806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 -- 172.21.15.6:0/778751612 shutdown_connections 2023-10-09T11:36:18.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.041+0000 7f123e522700 1 -- 172.21.15.6:0/778751612 wait complete. 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.042+0000 7f123e522700 1 Processor -- start 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 -- start start 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f123806d120 0x7f123814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12381578d0 0x7f1238153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123814bef0 con 0x7f1238157ca0 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b3ba0 con 0x7f12381578d0 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123e522700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b3e80 con 0x7f123806d120 2023-10-09T11:36:18.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123cabf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123cabf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36570/0 (socket says 172.21.15.6:36570) 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.043+0000 7f123cabf700 1 -- 172.21.15.6:0/2922900637 learned_addr learned my addr 172.21.15.6:0/2922900637 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f1237fff700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f123806d120 0x7f123814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f12377fe700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12381578d0 0x7f1238153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 -- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f123806d120 msgr2=0x7f123814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f123806d120 0x7f123814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 -- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12381578d0 msgr2=0x7f1238153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12381578d0 0x7f1238153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 -- 172.21.15.6:0/2922900637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228009420 con 0x7f1238157ca0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123cabf700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f123806fe20 tx=0x7f1230019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230027470 con 0x7f1238157ca0 2023-10-09T11:36:18.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12300275f0 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300279b0 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230009a20 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.044+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12380b4440 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.045+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238067ac0 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.046+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1230024070 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.046+0000 7f121ffff700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.047+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1230087360 con 0x7f1238157ca0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.047+0000 7f1237fff700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.047+0000 7f1237fff700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 0x7f12240693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12280093f0 tx=0x7f1228008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.050+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1230054650 con 0x7f1238157ca0 2023-10-09T11:36:18.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.208+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f26e806dac0 con 0x7f26e806d120 2023-10-09T11:36:18.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.208+0000 7f26dd7fa700 1 -- 172.21.15.6:0/1847479603 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26e806dac0 con 0x7f26e806d120 2023-10-09T11:36:18.210 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 msgr2=0x7f26cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 0x7f26cc0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26e815d1d0 tx=0x7f26e4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 msgr2=0x7f26e816d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c5c0 tx=0x7f26d800c8d0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 shutdown_connections 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f26cc066f30 0x7f26cc0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26e8157ca0 0x7f26e80c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26e806d120 0x7f26e816d410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 --2- 172.21.15.6:0/1847479603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26e81578d0 0x7f26e816b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 >> 172.21.15.6:0/1847479603 conn(0x7f26e806bb90 msgr2=0x7f26e8155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 shutdown_connections 2023-10-09T11:36:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.210+0000 7f26ef45e700 1 -- 172.21.15.6:0/1847479603 wait complete. 2023-10-09T11:36:18.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-09T11:36:18.224 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.246+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f123804bb80 con 0x7f1238157ca0 2023-10-09T11:36:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.246+0000 7f121ffff700 1 -- 172.21.15.6:0/2922900637 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f123002c020 con 0x7f1238157ca0 2023-10-09T11:36:18.247 INFO:teuthology.orchestra.run.smithi006.stdout:55834574854 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 msgr2=0x7f12240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 0x7f12240693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12280093f0 tx=0x7f1228008040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 msgr2=0x7f12381544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f123806fe20 tx=0x7f1230019000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 shutdown_connections 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1224066f30 0x7f12240693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1238157ca0 0x7f12381544a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f123806d120 0x7f123814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 --2- 172.21.15.6:0/2922900637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12381578d0 0x7f1238153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 >> 172.21.15.6:0/2922900637 conn(0x7f123806bb90 msgr2=0x7f1238156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 shutdown_connections 2023-10-09T11:36:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.248+0000 7f123e522700 1 -- 172.21.15.6:0/2922900637 wait complete. 2023-10-09T11:36:18.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-09T11:36:18.262 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:18.262 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T11:36:18.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.419+0000 7f41319e8700 1 Processor -- start 2023-10-09T11:36:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.419+0000 7f41319e8700 1 -- start start 2023-10-09T11:36:18.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f41319e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f412c0ce1f0 0x7f412c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f41319e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f41319e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c15dfb0 con 0x7f412c0ac570 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f41319e8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c0acec0 con 0x7f412c0ce1f0 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f41319e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0ad1a0 con 0x7f412c0ce5c0 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f412c0ce1f0 0x7f412c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f412c0ac570 0x7f412c06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44352/0 (socket says 172.21.15.6:44352) 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412b7fe700 1 -- 172.21.15.6:0/2464220626 learned_addr learned my addr 172.21.15.6:0/2464220626 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f4123fff700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 -- 172.21.15.6:0/2464220626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 msgr2=0x7f412c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 -- 172.21.15.6:0/2464220626 >> v1:172.21.15.6:6789/0 conn(0x7f412c0ac570 legacy=0x7f412c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 -- 172.21.15.6:0/2464220626 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c15dc40 con 0x7f412c0ce1f0 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412a7fc700 1 -- 172.21.15.6:0/2464220626 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785369191 0 0) 0x7f412c15dfb0 con 0x7f412c0ac570 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f4123fff700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412affd700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ce1f0 0x7f412c0aacf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f411c0098e0 tx=0x7f411c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8076798542707ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412a7fc700 1 -- 172.21.15.6:0/2464220626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c009e80 con 0x7f412c0ce1f0 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412a7fc700 1 -- 172.21.15.6:0/2464220626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c00b860 con 0x7f412c0ce1f0 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.420+0000 7f412a7fc700 1 -- 172.21.15.6:0/2464220626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00bbe0 con 0x7f412c0ce1f0 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 -- 172.21.15.6:0/2464220626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ce1f0 msgr2=0x7f412c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ce1f0 0x7f412c0aacf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f411c0098e0 tx=0x7f411c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 -- 172.21.15.6:0/2464220626 shutdown_connections 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ce1f0 0x7f412c0aacf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 --2- 172.21.15.6:0/2464220626 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 -- 172.21.15.6:0/2464220626 >> 172.21.15.6:0/2464220626 conn(0x7f412c06cca0 msgr2=0x7f412c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 -- 172.21.15.6:0/2464220626 shutdown_connections 2023-10-09T11:36:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.421+0000 7f41319e8700 1 -- 172.21.15.6:0/2464220626 wait complete. 2023-10-09T11:36:18.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.422+0000 7f41319e8700 1 Processor -- start 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.422+0000 7f41319e8700 1 -- start start 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 0x7f412c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c15aa90 con 0x7f412c0ac570 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c16ea00 con 0x7f412c0ce1f0 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f41319e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c16e720 con 0x7f412c0ce5c0 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36580/0 (socket says 172.21.15.6:36580) 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 -- 172.21.15.6:0/3724373689 learned_addr learned my addr 172.21.15.6:0/3724373689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412b7fe700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f4123fff700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 0x7f412c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 -- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 msgr2=0x7f412c149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 -- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 msgr2=0x7f412c1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 0x7f412c1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 -- 172.21.15.6:0/3724373689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009420 con 0x7f412c0ac570 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f4123fff700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 0x7f412c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412b7fe700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.423+0000 7f412affd700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f412c06cc70 tx=0x7f411c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.424+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c01f070 con 0x7f412c0ac570 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.424+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c000cc0 con 0x7f412c0ac570 2023-10-09T11:36:18.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.424+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c025420 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.424+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c15a440 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.424+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c15f460 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.425+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c15f650 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.425+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f411c023070 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.425+0000 7f4122ffd700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 0x7f410c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.425+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f411c085af0 con 0x7f412c0ac570 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.425+0000 7f4123fff700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 0x7f410c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.426+0000 7f4123fff700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 0x7f410c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f412c15c570 tx=0x7f4114008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.430+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f411c052e10 con 0x7f412c0ac570 2023-10-09T11:36:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.618+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f412c15abd0 con 0x7f410c066f30 2023-10-09T11:36:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.625+0000 7f4122ffd700 1 -- 172.21.15.6:0/3724373689 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260108 (secure 0 0 0) 0x7f411400c040 con 0x7f410c066f30 2023-10-09T11:36:18.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.628+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 msgr2=0x7f410c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 0x7f410c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f412c15c570 tx=0x7f4114008040 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 msgr2=0x7f412c15ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f412c06cc70 tx=0x7f411c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 shutdown_connections 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f410c066f30 0x7f410c0693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412c0ce5c0 0x7f412c149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f412c0ac570 0x7f412c15ef20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 --2- 172.21.15.6:0/3724373689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f412c0ce1f0 0x7f412c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 >> 172.21.15.6:0/3724373689 conn(0x7f412c06cca0 msgr2=0x7f412c157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 shutdown_connections 2023-10-09T11:36:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.629+0000 7f41319e8700 1 -- 172.21.15.6:0/3724373689 wait complete. 2023-10-09T11:36:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:18.642 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:36:18.150368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002692"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079635+0000","last_change":"2023-10-09T11:36:04.078956+0000","last_active":"2023-10-09T11:36:04.079635+0000","last_peered":"2023-10-09T11:36:04.079635+0000","last_clean":"2023-10-09T11:36:04.079635+0000","last_became_active":"2023-10-09T11:36:04.078726+0000","last_became_peered":"2023-10-09T11:36:04.078726+0000","last_unstale":"2023-10-09T11:36:04.079635+0000","last_undegraded":"2023-10-09T11:36:04.079635+0000","last_fullsized":"2023-10-09T11:36:04.079635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:23.806661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077801+0000","last_change":"2023-10-09T11:36:04.077746+0000","last_active":"2023-10-09T11:36:04.077801+0000","last_peered":"2023-10-09T11:36:04.077801+0000","last_clean":"2023-10-09T11:36:04.077801+0000","last_became_active":"2023-10-09T11:36:04.077586+0000","last_became_peered":"2023-10-09T11:36:04.077586+0000","last_unstale":"2023-10-09T11:36:04.077801+0000","last_undegraded":"2023-10-09T11:36:04.077801+0000","last_fullsized":"2023-10-09T11:36:04.077801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067923+0000","last_change":"2023-10-09T11:36:04.067868+0000","last_active":"2023-10-09T11:36:04.067923+0000","last_peered":"2023-10-09T11:36:04.067923+0000","last_clean":"2023-10-09T11:36:04.067923+0000","last_became_active":"2023-10-09T11:36:04.067359+0000","last_became_peered":"2023-10-09T11:36:04.067359+0000","last_unstale":"2023-10-09T11:36:04.067923+0000","last_undegraded":"2023-10-09T11:36:04.067923+0000","last_fullsized":"2023-10-09T11:36:04.067923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081543+0000","last_change":"2023-10-09T11:36:04.081241+0000","last_active":"2023-10-09T11:36:04.081543+0000","last_peered":"2023-10-09T11:36:04.081543+0000","last_clean":"2023-10-09T11:36:04.081543+0000","last_became_active":"2023-10-09T11:36:04.080417+0000","last_became_peered":"2023-10-09T11:36:04.080417+0000","last_unstale":"2023-10-09T11:36:04.081543+0000","last_undegraded":"2023-10-09T11:36:04.081543+0000","last_fullsized":"2023-10-09T11:36:04.081543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079612+0000","last_change":"2023-10-09T11:36:04.078524+0000","last_active":"2023-10-09T11:36:04.079612+0000","last_peered":"2023-10-09T11:36:04.079612+0000","last_clean":"2023-10-09T11:36:04.079612+0000","last_became_active":"2023-10-09T11:36:04.078262+0000","last_became_peered":"2023-10-09T11:36:04.078262+0000","last_unstale":"2023-10-09T11:36:04.079612+0000","last_undegraded":"2023-10-09T11:36:04.079612+0000","last_fullsized":"2023-10-09T11:36:04.079612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069441+0000","last_change":"2023-10-09T11:36:04.068963+0000","last_active":"2023-10-09T11:36:04.069441+0000","last_peered":"2023-10-09T11:36:04.069441+0000","last_clean":"2023-10-09T11:36:04.069441+0000","last_became_active":"2023-10-09T11:36:04.068322+0000","last_became_peered":"2023-10-09T11:36:04.068322+0000","last_unstale":"2023-10-09T11:36:04.069441+0000","last_undegraded":"2023-10-09T11:36:04.069441+0000","last_fullsized":"2023-10-09T11:36:04.069441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079107+0000","last_change":"2023-10-09T11:36:04.078377+0000","last_active":"2023-10-09T11:36:04.079107+0000","last_peered":"2023-10-09T11:36:04.079107+0000","last_clean":"2023-10-09T11:36:04.079107+0000","last_became_active":"2023-10-09T11:36:04.077783+0000","last_became_peered":"2023-10-09T11:36:04.077783+0000","last_unstale":"2023-10-09T11:36:04.079107+0000","last_undegraded":"2023-10-09T11:36:04.079107+0000","last_fullsized":"2023-10-09T11:36:04.079107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086953+0000","last_change":"2023-10-09T11:36:04.085234+0000","last_active":"2023-10-09T11:36:04.086953+0000","last_peered":"2023-10-09T11:36:04.086953+0000","last_clean":"2023-10-09T11:36:04.086953+0000","last_became_active":"2023-10-09T11:36:04.081369+0000","last_became_peered":"2023-10-09T11:36:04.081369+0000","last_unstale":"2023-10-09T11:36:04.086953+0000","last_undegraded":"2023-10-09T11:36:04.086953+0000","last_fullsized":"2023-10-09T11:36:04.086953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073597+0000","last_change":"2023-10-09T11:36:04.073032+0000","last_active":"2023-10-09T11:36:04.073597+0000","last_peered":"2023-10-09T11:36:04.073597+0000","last_clean":"2023-10-09T11:36:04.073597+0000","last_became_active":"2023-10-09T11:36:04.072482+0000","last_became_peered":"2023-10-09T11:36:04.072482+0000","last_unstale":"2023-10-09T11:36:04.073597+0000","last_undegraded":"2023-10-09T11:36:04.073597+0000","last_fullsized":"2023-10-09T11:36:04.073597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:57.265856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077089+0000","last_change":"2023-10-09T11:36:04.076990+0000","last_active":"2023-10-09T11:36:04.077089+0000","last_peered":"2023-10-09T11:36:04.077089+0000","last_clean":"2023-10-09T11:36:04.077089+0000","last_became_active":"2023-10-09T11:36:04.076769+0000","last_became_peered":"2023-10-09T11:36:04.076769+0000","last_unstale":"2023-10-09T11:36:04.077089+0000","last_undegraded":"2023-10-09T11:36:04.077089+0000","last_fullsized":"2023-10-09T11:36:04.077089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070537+0000","last_change":"2023-10-09T11:36:04.070385+0000","last_active":"2023-10-09T11:36:04.070537+0000","last_peered":"2023-10-09T11:36:04.070537+0000","last_clean":"2023-10-09T11:36:04.070537+0000","last_became_active":"2023-10-09T11:36:04.070159+0000","last_became_peered":"2023-10-09T11:36:04.070159+0000","last_unstale":"2023-10-09T11:36:04.070537+0000","last_undegraded":"2023-10-09T11:36:04.070537+0000","last_fullsized":"2023-10-09T11:36:04.070537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070944+0000","last_change":"2023-10-09T11:36:04.070645+0000","last_active":"2023-10-09T11:36:04.070944+0000","last_peered":"2023-10-09T11:36:04.070944+0000","last_clean":"2023-10-09T11:36:04.070944+0000","last_became_active":"2023-10-09T11:36:04.070421+0000","last_became_peered":"2023-10-09T11:36:04.070421+0000","last_unstale":"2023-10-09T11:36:04.070944+0000","last_undegraded":"2023-10-09T11:36:04.070944+0000","last_fullsized":"2023-10-09T11:36:04.070944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081588+0000","last_change":"2023-10-09T11:36:04.081114+0000","last_active":"2023-10-09T11:36:04.081588+0000","last_peered":"2023-10-09T11:36:04.081588+0000","last_clean":"2023-10-09T11:36:04.081588+0000","last_became_active":"2023-10-09T11:36:04.080371+0000","last_became_peered":"2023-10-09T11:36:04.080371+0000","last_unstale":"2023-10-09T11:36:04.081588+0000","last_undegraded":"2023-10-09T11:36:04.081588+0000","last_fullsized":"2023-10-09T11:36:04.081588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072507+0000","last_change":"2023-10-09T11:36:04.072443+0000","last_active":"2023-10-09T11:36:04.072507+0000","last_peered":"2023-10-09T11:36:04.072507+0000","last_clean":"2023-10-09T11:36:04.072507+0000","last_became_active":"2023-10-09T11:36:04.072205+0000","last_became_peered":"2023-10-09T11:36:04.072205+0000","last_unstale":"2023-10-09T11:36:04.072507+0000","last_undegraded":"2023-10-09T11:36:04.072507+0000","last_fullsized":"2023-10-09T11:36:04.072507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073391+0000","last_change":"2023-10-09T11:36:04.073323+0000","last_active":"2023-10-09T11:36:04.073391+0000","last_peered":"2023-10-09T11:36:04.073391+0000","last_clean":"2023-10-09T11:36:04.073391+0000","last_became_active":"2023-10-09T11:36:04.073096+0000","last_became_peered":"2023-10-09T11:36:04.073096+0000","last_unstale":"2023-10-09T11:36:04.073391+0000","last_undegraded":"2023-10-09T11:36:04.073391+0000","last_fullsized":"2023-10-09T11:36:04.073391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069410+0000","last_change":"2023-10-09T11:36:04.068825+0000","last_active":"2023-10-09T11:36:04.069410+0000","last_peered":"2023-10-09T11:36:04.069410+0000","last_clean":"2023-10-09T11:36:04.069410+0000","last_became_active":"2023-10-09T11:36:04.067993+0000","last_became_peered":"2023-10-09T11:36:04.067993+0000","last_unstale":"2023-10-09T11:36:04.069410+0000","last_undegraded":"2023-10-09T11:36:04.069410+0000","last_fullsized":"2023-10-09T11:36:04.069410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076162+0000","last_change":"2023-10-09T11:36:04.075555+0000","last_active":"2023-10-09T11:36:04.076162+0000","last_peered":"2023-10-09T11:36:04.076162+0000","last_clean":"2023-10-09T11:36:04.076162+0000","last_became_active":"2023-10-09T11:36:04.074783+0000","last_became_peered":"2023-10-09T11:36:04.074783+0000","last_unstale":"2023-10-09T11:36:04.076162+0000","last_undegraded":"2023-10-09T11:36:04.076162+0000","last_fullsized":"2023-10-09T11:36:04.076162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074638+0000","last_change":"2023-10-09T11:36:04.073743+0000","last_active":"2023-10-09T11:36:04.074638+0000","last_peered":"2023-10-09T11:36:04.074638+0000","last_clean":"2023-10-09T11:36:04.074638+0000","last_became_active":"2023-10-09T11:36:04.073540+0000","last_became_peered":"2023-10-09T11:36:04.073540+0000","last_unstale":"2023-10-09T11:36:04.074638+0000","last_undegraded":"2023-10-09T11:36:04.074638+0000","last_fullsized":"2023-10-09T11:36:04.074638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078952+0000","last_change":"2023-10-09T11:36:04.077634+0000","last_active":"2023-10-09T11:36:04.078952+0000","last_peered":"2023-10-09T11:36:04.078952+0000","last_clean":"2023-10-09T11:36:04.078952+0000","last_became_active":"2023-10-09T11:36:04.077447+0000","last_became_peered":"2023-10-09T11:36:04.077447+0000","last_unstale":"2023-10-09T11:36:04.078952+0000","last_undegraded":"2023-10-09T11:36:04.078952+0000","last_fullsized":"2023-10-09T11:36:04.078952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:23.233430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083898+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:04.083898+0000","last_peered":"2023-10-09T11:36:04.083898+0000","last_clean":"2023-10-09T11:36:04.083898+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:04.083898+0000","last_undegraded":"2023-10-09T11:36:04.083898+0000","last_fullsized":"2023-10-09T11:36:04.083898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081372+0000","last_change":"2023-10-09T11:36:04.080046+0000","last_active":"2023-10-09T11:36:04.081372+0000","last_peered":"2023-10-09T11:36:04.081372+0000","last_clean":"2023-10-09T11:36:04.081372+0000","last_became_active":"2023-10-09T11:36:04.079611+0000","last_became_peered":"2023-10-09T11:36:04.079611+0000","last_unstale":"2023-10-09T11:36:04.081372+0000","last_undegraded":"2023-10-09T11:36:04.081372+0000","last_fullsized":"2023-10-09T11:36:04.081372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085869+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:04.085869+0000","last_peered":"2023-10-09T11:36:04.085869+0000","last_clean":"2023-10-09T11:36:04.085869+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:04.085869+0000","last_undegraded":"2023-10-09T11:36:04.085869+0000","last_fullsized":"2023-10-09T11:36:04.085869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068031+0000","last_change":"2023-10-09T11:36:04.067981+0000","last_active":"2023-10-09T11:36:04.068031+0000","last_peered":"2023-10-09T11:36:04.068031+0000","last_clean":"2023-10-09T11:36:04.068031+0000","last_became_active":"2023-10-09T11:36:04.067598+0000","last_became_peered":"2023-10-09T11:36:04.067598+0000","last_unstale":"2023-10-09T11:36:04.068031+0000","last_undegraded":"2023-10-09T11:36:04.068031+0000","last_fullsized":"2023-10-09T11:36:04.068031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079025+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:04.079025+0000","last_peered":"2023-10-09T11:36:04.079025+0000","last_clean":"2023-10-09T11:36:04.079025+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:04.079025+0000","last_undegraded":"2023-10-09T11:36:04.079025+0000","last_fullsized":"2023-10-09T11:36:04.079025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070274+0000","last_change":"2023-10-09T11:36:04.070208+0000","last_active":"2023-10-09T11:36:04.070274+0000","last_peered":"2023-10-09T11:36:04.070274+0000","last_clean":"2023-10-09T11:36:04.070274+0000","last_became_active":"2023-10-09T11:36:04.069970+0000","last_became_peered":"2023-10-09T11:36:04.069970+0000","last_unstale":"2023-10-09T11:36:04.070274+0000","last_undegraded":"2023-10-09T11:36:04.070274+0000","last_fullsized":"2023-10-09T11:36:04.070274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082152+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:04.082152+0000","last_peered":"2023-10-09T11:36:04.082152+0000","last_clean":"2023-10-09T11:36:04.082152+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:04.082152+0000","last_undegraded":"2023-10-09T11:36:04.082152+0000","last_fullsized":"2023-10-09T11:36:04.082152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067470+0000","last_change":"2023-10-09T11:36:04.067052+0000","last_active":"2023-10-09T11:36:04.067470+0000","last_peered":"2023-10-09T11:36:04.067470+0000","last_clean":"2023-10-09T11:36:04.067470+0000","last_became_active":"2023-10-09T11:36:04.066804+0000","last_became_peered":"2023-10-09T11:36:04.066804+0000","last_unstale":"2023-10-09T11:36:04.067470+0000","last_undegraded":"2023-10-09T11:36:04.067470+0000","last_fullsized":"2023-10-09T11:36:04.067470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080288+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:04.080288+0000","last_peered":"2023-10-09T11:36:04.080288+0000","last_clean":"2023-10-09T11:36:04.080288+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:04.080288+0000","last_undegraded":"2023-10-09T11:36:04.080288+0000","last_fullsized":"2023-10-09T11:36:04.080288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072277+0000","last_change":"2023-10-09T11:36:04.071963+0000","last_active":"2023-10-09T11:36:04.072277+0000","last_peered":"2023-10-09T11:36:04.072277+0000","last_clean":"2023-10-09T11:36:04.072277+0000","last_became_active":"2023-10-09T11:36:04.071760+0000","last_became_peered":"2023-10-09T11:36:04.071760+0000","last_unstale":"2023-10-09T11:36:04.072277+0000","last_undegraded":"2023-10-09T11:36:04.072277+0000","last_fullsized":"2023-10-09T11:36:04.072277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076254+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:04.076254+0000","last_peered":"2023-10-09T11:36:04.076254+0000","last_clean":"2023-10-09T11:36:04.076254+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:04.076254+0000","last_undegraded":"2023-10-09T11:36:04.076254+0000","last_fullsized":"2023-10-09T11:36:04.076254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066583+0000","last_change":"2023-10-09T11:36:04.066355+0000","last_active":"2023-10-09T11:36:04.066583+0000","last_peered":"2023-10-09T11:36:04.066583+0000","last_clean":"2023-10-09T11:36:04.066583+0000","last_became_active":"2023-10-09T11:36:04.066128+0000","last_became_peered":"2023-10-09T11:36:04.066128+0000","last_unstale":"2023-10-09T11:36:04.066583+0000","last_undegraded":"2023-10-09T11:36:04.066583+0000","last_fullsized":"2023-10-09T11:36:04.066583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076230+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:04.076230+0000","last_peered":"2023-10-09T11:36:04.076230+0000","last_clean":"2023-10-09T11:36:04.076230+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:04.076230+0000","last_undegraded":"2023-10-09T11:36:04.076230+0000","last_fullsized":"2023-10-09T11:36:04.076230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079241+0000","last_change":"2023-10-09T11:36:04.079049+0000","last_active":"2023-10-09T11:36:04.079241+0000","last_peered":"2023-10-09T11:36:04.079241+0000","last_clean":"2023-10-09T11:36:04.079241+0000","last_became_active":"2023-10-09T11:36:04.078834+0000","last_became_peered":"2023-10-09T11:36:04.078834+0000","last_unstale":"2023-10-09T11:36:04.079241+0000","last_undegraded":"2023-10-09T11:36:04.079241+0000","last_fullsized":"2023-10-09T11:36:04.079241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066626+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:04.066626+0000","last_peered":"2023-10-09T11:36:04.066626+0000","last_clean":"2023-10-09T11:36:04.066626+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:04.066626+0000","last_undegraded":"2023-10-09T11:36:04.066626+0000","last_fullsized":"2023-10-09T11:36:04.066626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086442+0000","last_change":"2023-10-09T11:36:04.086385+0000","last_active":"2023-10-09T11:36:04.086442+0000","last_peered":"2023-10-09T11:36:04.086442+0000","last_clean":"2023-10-09T11:36:04.086442+0000","last_became_active":"2023-10-09T11:36:04.086167+0000","last_became_peered":"2023-10-09T11:36:04.086167+0000","last_unstale":"2023-10-09T11:36:04.086442+0000","last_undegraded":"2023-10-09T11:36:04.086442+0000","last_fullsized":"2023-10-09T11:36:04.086442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068009+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:04.068009+0000","last_peered":"2023-10-09T11:36:04.068009+0000","last_clean":"2023-10-09T11:36:04.068009+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:04.068009+0000","last_undegraded":"2023-10-09T11:36:04.068009+0000","last_fullsized":"2023-10-09T11:36:04.068009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076195+0000","last_change":"2023-10-09T11:36:04.075850+0000","last_active":"2023-10-09T11:36:04.076195+0000","last_peered":"2023-10-09T11:36:04.076195+0000","last_clean":"2023-10-09T11:36:04.076195+0000","last_became_active":"2023-10-09T11:36:04.075362+0000","last_became_peered":"2023-10-09T11:36:04.075362+0000","last_unstale":"2023-10-09T11:36:04.076195+0000","last_undegraded":"2023-10-09T11:36:04.076195+0000","last_fullsized":"2023-10-09T11:36:04.076195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066187+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:04.066187+0000","last_peered":"2023-10-09T11:36:04.066187+0000","last_clean":"2023-10-09T11:36:04.066187+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:04.066187+0000","last_undegraded":"2023-10-09T11:36:04.066187+0000","last_fullsized":"2023-10-09T11:36:04.066187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067792+0000","last_change":"2023-10-09T11:36:04.067726+0000","last_active":"2023-10-09T11:36:04.067792+0000","last_peered":"2023-10-09T11:36:04.067792+0000","last_clean":"2023-10-09T11:36:04.067792+0000","last_became_active":"2023-10-09T11:36:04.067478+0000","last_became_peered":"2023-10-09T11:36:04.067478+0000","last_unstale":"2023-10-09T11:36:04.067792+0000","last_undegraded":"2023-10-09T11:36:04.067792+0000","last_fullsized":"2023-10-09T11:36:04.067792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077393+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:04.077393+0000","last_peered":"2023-10-09T11:36:04.077393+0000","last_clean":"2023-10-09T11:36:04.077393+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:04.077393+0000","last_undegraded":"2023-10-09T11:36:04.077393+0000","last_fullsized":"2023-10-09T11:36:04.077393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072210+0000","last_change":"2023-10-09T11:36:04.071867+0000","last_active":"2023-10-09T11:36:04.072210+0000","last_peered":"2023-10-09T11:36:04.072210+0000","last_clean":"2023-10-09T11:36:04.072210+0000","last_became_active":"2023-10-09T11:36:04.071610+0000","last_became_peered":"2023-10-09T11:36:04.071610+0000","last_unstale":"2023-10-09T11:36:04.072210+0000","last_undegraded":"2023-10-09T11:36:04.072210+0000","last_fullsized":"2023-10-09T11:36:04.072210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087147+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:04.087147+0000","last_peered":"2023-10-09T11:36:04.087147+0000","last_clean":"2023-10-09T11:36:04.087147+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:04.087147+0000","last_undegraded":"2023-10-09T11:36:04.087147+0000","last_fullsized":"2023-10-09T11:36:04.087147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085788+0000","last_change":"2023-10-09T11:36:04.085709+0000","last_active":"2023-10-09T11:36:04.085788+0000","last_peered":"2023-10-09T11:36:04.085788+0000","last_clean":"2023-10-09T11:36:04.085788+0000","last_became_active":"2023-10-09T11:36:04.085450+0000","last_became_peered":"2023-10-09T11:36:04.085450+0000","last_unstale":"2023-10-09T11:36:04.085788+0000","last_undegraded":"2023-10-09T11:36:04.085788+0000","last_fullsized":"2023-10-09T11:36:04.085788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:35.059638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082197+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:04.082197+0000","last_peered":"2023-10-09T11:36:04.082197+0000","last_clean":"2023-10-09T11:36:04.082197+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:04.082197+0000","last_undegraded":"2023-10-09T11:36:04.082197+0000","last_fullsized":"2023-10-09T11:36:04.082197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085055+0000","last_change":"2023-10-09T11:36:04.085019+0000","last_active":"2023-10-09T11:36:04.085055+0000","last_peered":"2023-10-09T11:36:04.085055+0000","last_clean":"2023-10-09T11:36:04.085055+0000","last_became_active":"2023-10-09T11:36:04.084628+0000","last_became_peered":"2023-10-09T11:36:04.084628+0000","last_unstale":"2023-10-09T11:36:04.085055+0000","last_undegraded":"2023-10-09T11:36:04.085055+0000","last_fullsized":"2023-10-09T11:36:04.085055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066123+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:04.066123+0000","last_peered":"2023-10-09T11:36:04.066123+0000","last_clean":"2023-10-09T11:36:04.066123+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:04.066123+0000","last_undegraded":"2023-10-09T11:36:04.066123+0000","last_fullsized":"2023-10-09T11:36:04.066123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072927+0000","last_change":"2023-10-09T11:36:04.072862+0000","last_active":"2023-10-09T11:36:04.072927+0000","last_peered":"2023-10-09T11:36:04.072927+0000","last_clean":"2023-10-09T11:36:04.072927+0000","last_became_active":"2023-10-09T11:36:04.072643+0000","last_became_peered":"2023-10-09T11:36:04.072643+0000","last_unstale":"2023-10-09T11:36:04.072927+0000","last_undegraded":"2023-10-09T11:36:04.072927+0000","last_fullsized":"2023-10-09T11:36:04.072927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068216+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:04.068216+0000","last_peered":"2023-10-09T11:36:04.068216+0000","last_clean":"2023-10-09T11:36:04.068216+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:04.068216+0000","last_undegraded":"2023-10-09T11:36:04.068216+0000","last_fullsized":"2023-10-09T11:36:04.068216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073388+0000","last_change":"2023-10-09T11:36:04.072942+0000","last_active":"2023-10-09T11:36:04.073388+0000","last_peered":"2023-10-09T11:36:04.073388+0000","last_clean":"2023-10-09T11:36:04.073388+0000","last_became_active":"2023-10-09T11:36:04.072713+0000","last_became_peered":"2023-10-09T11:36:04.072713+0000","last_unstale":"2023-10-09T11:36:04.073388+0000","last_undegraded":"2023-10-09T11:36:04.073388+0000","last_fullsized":"2023-10-09T11:36:04.073388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078402+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:04.078402+0000","last_peered":"2023-10-09T11:36:04.078402+0000","last_clean":"2023-10-09T11:36:04.078402+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:04.078402+0000","last_undegraded":"2023-10-09T11:36:04.078402+0000","last_fullsized":"2023-10-09T11:36:04.078402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078935+0000","last_change":"2023-10-09T11:36:04.077455+0000","last_active":"2023-10-09T11:36:04.078935+0000","last_peered":"2023-10-09T11:36:04.078935+0000","last_clean":"2023-10-09T11:36:04.078935+0000","last_became_active":"2023-10-09T11:36:04.075697+0000","last_became_peered":"2023-10-09T11:36:04.075697+0000","last_unstale":"2023-10-09T11:36:04.078935+0000","last_undegraded":"2023-10-09T11:36:04.078935+0000","last_fullsized":"2023-10-09T11:36:04.078935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082726+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:04.082726+0000","last_peered":"2023-10-09T11:36:04.082726+0000","last_clean":"2023-10-09T11:36:04.082726+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:04.082726+0000","last_undegraded":"2023-10-09T11:36:04.082726+0000","last_fullsized":"2023-10-09T11:36:04.082726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073739+0000","last_change":"2023-10-09T11:36:04.073672+0000","last_active":"2023-10-09T11:36:04.073739+0000","last_peered":"2023-10-09T11:36:04.073739+0000","last_clean":"2023-10-09T11:36:04.073739+0000","last_became_active":"2023-10-09T11:36:04.073078+0000","last_became_peered":"2023-10-09T11:36:04.073078+0000","last_unstale":"2023-10-09T11:36:04.073739+0000","last_undegraded":"2023-10-09T11:36:04.073739+0000","last_fullsized":"2023-10-09T11:36:04.073739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068917+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:04.068917+0000","last_peered":"2023-10-09T11:36:04.068917+0000","last_clean":"2023-10-09T11:36:04.068917+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:04.068917+0000","last_undegraded":"2023-10-09T11:36:04.068917+0000","last_fullsized":"2023-10-09T11:36:04.068917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081559+0000","last_change":"2023-10-09T11:36:04.081376+0000","last_active":"2023-10-09T11:36:04.081559+0000","last_peered":"2023-10-09T11:36:04.081559+0000","last_clean":"2023-10-09T11:36:04.081559+0000","last_became_active":"2023-10-09T11:36:04.080714+0000","last_became_peered":"2023-10-09T11:36:04.080714+0000","last_unstale":"2023-10-09T11:36:04.081559+0000","last_undegraded":"2023-10-09T11:36:04.081559+0000","last_fullsized":"2023-10-09T11:36:04.081559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066307+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:04.066307+0000","last_peered":"2023-10-09T11:36:04.066307+0000","last_clean":"2023-10-09T11:36:04.066307+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:04.066307+0000","last_undegraded":"2023-10-09T11:36:04.066307+0000","last_fullsized":"2023-10-09T11:36:04.066307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069101+0000","last_change":"2023-10-09T11:36:04.068591+0000","last_active":"2023-10-09T11:36:04.069101+0000","last_peered":"2023-10-09T11:36:04.069101+0000","last_clean":"2023-10-09T11:36:04.069101+0000","last_became_active":"2023-10-09T11:36:04.068323+0000","last_became_peered":"2023-10-09T11:36:04.068323+0000","last_unstale":"2023-10-09T11:36:04.069101+0000","last_undegraded":"2023-10-09T11:36:04.069101+0000","last_fullsized":"2023-10-09T11:36:04.069101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077971+0000","last_change":"2023-10-09T11:36:04.077889+0000","last_active":"2023-10-09T11:36:04.077971+0000","last_peered":"2023-10-09T11:36:04.077971+0000","last_clean":"2023-10-09T11:36:04.077971+0000","last_became_active":"2023-10-09T11:36:04.077682+0000","last_became_peered":"2023-10-09T11:36:04.077682+0000","last_unstale":"2023-10-09T11:36:04.077971+0000","last_undegraded":"2023-10-09T11:36:04.077971+0000","last_fullsized":"2023-10-09T11:36:04.077971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066047+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:04.066047+0000","last_peered":"2023-10-09T11:36:04.066047+0000","last_clean":"2023-10-09T11:36:04.066047+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:04.066047+0000","last_undegraded":"2023-10-09T11:36:04.066047+0000","last_fullsized":"2023-10-09T11:36:04.066047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081391+0000","last_change":"2023-10-09T11:36:04.080698+0000","last_active":"2023-10-09T11:36:04.081391+0000","last_peered":"2023-10-09T11:36:04.081391+0000","last_clean":"2023-10-09T11:36:04.081391+0000","last_became_active":"2023-10-09T11:36:04.080102+0000","last_became_peered":"2023-10-09T11:36:04.080102+0000","last_unstale":"2023-10-09T11:36:04.081391+0000","last_undegraded":"2023-10-09T11:36:04.081391+0000","last_fullsized":"2023-10-09T11:36:04.081391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066308+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:04.066308+0000","last_peered":"2023-10-09T11:36:04.066308+0000","last_clean":"2023-10-09T11:36:04.066308+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:04.066308+0000","last_undegraded":"2023-10-09T11:36:04.066308+0000","last_fullsized":"2023-10-09T11:36:04.066308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067759+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:04.067759+0000","last_peered":"2023-10-09T11:36:04.067759+0000","last_clean":"2023-10-09T11:36:04.067759+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:04.067759+0000","last_undegraded":"2023-10-09T11:36:04.067759+0000","last_fullsized":"2023-10-09T11:36:04.067759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067809+0000","last_change":"2023-10-09T11:36:04.067741+0000","last_active":"2023-10-09T11:36:04.067809+0000","last_peered":"2023-10-09T11:36:04.067809+0000","last_clean":"2023-10-09T11:36:04.067809+0000","last_became_active":"2023-10-09T11:36:04.067100+0000","last_became_peered":"2023-10-09T11:36:04.067100+0000","last_unstale":"2023-10-09T11:36:04.067809+0000","last_undegraded":"2023-10-09T11:36:04.067809+0000","last_fullsized":"2023-10-09T11:36:04.067809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067883+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:04.067883+0000","last_peered":"2023-10-09T11:36:04.067883+0000","last_clean":"2023-10-09T11:36:04.067883+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:04.067883+0000","last_undegraded":"2023-10-09T11:36:04.067883+0000","last_fullsized":"2023-10-09T11:36:04.067883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075638+0000","last_change":"2023-10-09T11:36:04.075567+0000","last_active":"2023-10-09T11:36:04.075638+0000","last_peered":"2023-10-09T11:36:04.075638+0000","last_clean":"2023-10-09T11:36:04.075638+0000","last_became_active":"2023-10-09T11:36:04.075313+0000","last_became_peered":"2023-10-09T11:36:04.075313+0000","last_unstale":"2023-10-09T11:36:04.075638+0000","last_undegraded":"2023-10-09T11:36:04.075638+0000","last_fullsized":"2023-10-09T11:36:04.075638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:36:05.064162+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:05.064162+0000","last_peered":"2023-10-09T11:36:05.064162+0000","last_clean":"2023-10-09T11:36:05.064162+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:05.064162+0000","last_undegraded":"2023-10-09T11:36:05.064162+0000","last_fullsized":"2023-10-09T11:36:05.064162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081604+0000","last_change":"2023-10-09T11:36:04.081186+0000","last_active":"2023-10-09T11:36:04.081604+0000","last_peered":"2023-10-09T11:36:04.081604+0000","last_clean":"2023-10-09T11:36:04.081604+0000","last_became_active":"2023-10-09T11:36:04.080933+0000","last_became_peered":"2023-10-09T11:36:04.080933+0000","last_unstale":"2023-10-09T11:36:04.081604+0000","last_undegraded":"2023-10-09T11:36:04.081604+0000","last_fullsized":"2023-10-09T11:36:04.081604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079780+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:04.079780+0000","last_peered":"2023-10-09T11:36:04.079780+0000","last_clean":"2023-10-09T11:36:04.079780+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:04.079780+0000","last_undegraded":"2023-10-09T11:36:04.079780+0000","last_fullsized":"2023-10-09T11:36:04.079780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072912+0000","last_change":"2023-10-09T11:36:04.072805+0000","last_active":"2023-10-09T11:36:04.072912+0000","last_peered":"2023-10-09T11:36:04.072912+0000","last_clean":"2023-10-09T11:36:04.072912+0000","last_became_active":"2023-10-09T11:36:04.072588+0000","last_became_peered":"2023-10-09T11:36:04.072588+0000","last_unstale":"2023-10-09T11:36:04.072912+0000","last_undegraded":"2023-10-09T11:36:04.072912+0000","last_fullsized":"2023-10-09T11:36:04.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071718+0000","last_change":"2023-10-09T11:36:04.071396+0000","last_active":"2023-10-09T11:36:04.071718+0000","last_peered":"2023-10-09T11:36:04.071718+0000","last_clean":"2023-10-09T11:36:04.071718+0000","last_became_active":"2023-10-09T11:36:04.071015+0000","last_became_peered":"2023-10-09T11:36:04.071015+0000","last_unstale":"2023-10-09T11:36:04.071718+0000","last_undegraded":"2023-10-09T11:36:04.071718+0000","last_fullsized":"2023-10-09T11:36:04.071718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069006+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:04.069006+0000","last_peered":"2023-10-09T11:36:04.069006+0000","last_clean":"2023-10-09T11:36:04.069006+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:04.069006+0000","last_undegraded":"2023-10-09T11:36:04.069006+0000","last_fullsized":"2023-10-09T11:36:04.069006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081346+0000","last_change":"2023-10-09T11:36:04.079699+0000","last_active":"2023-10-09T11:36:04.081346+0000","last_peered":"2023-10-09T11:36:04.081346+0000","last_clean":"2023-10-09T11:36:04.081346+0000","last_became_active":"2023-10-09T11:36:04.079452+0000","last_became_peered":"2023-10-09T11:36:04.079452+0000","last_unstale":"2023-10-09T11:36:04.081346+0000","last_undegraded":"2023-10-09T11:36:04.081346+0000","last_fullsized":"2023-10-09T11:36:04.081346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068665+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:04.068665+0000","last_peered":"2023-10-09T11:36:04.068665+0000","last_clean":"2023-10-09T11:36:04.068665+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:04.068665+0000","last_undegraded":"2023-10-09T11:36:04.068665+0000","last_fullsized":"2023-10-09T11:36:04.068665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087047+0000","last_change":"2023-10-09T11:36:04.086892+0000","last_active":"2023-10-09T11:36:04.087047+0000","last_peered":"2023-10-09T11:36:04.087047+0000","last_clean":"2023-10-09T11:36:04.087047+0000","last_became_active":"2023-10-09T11:36:04.086144+0000","last_became_peered":"2023-10-09T11:36:04.086144+0000","last_unstale":"2023-10-09T11:36:04.087047+0000","last_undegraded":"2023-10-09T11:36:04.087047+0000","last_fullsized":"2023-10-09T11:36:04.087047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080644+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:04.080644+0000","last_peered":"2023-10-09T11:36:04.080644+0000","last_clean":"2023-10-09T11:36:04.080644+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:04.080644+0000","last_undegraded":"2023-10-09T11:36:04.080644+0000","last_fullsized":"2023-10-09T11:36:04.080644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075657+0000","last_change":"2023-10-09T11:36:04.074171+0000","last_active":"2023-10-09T11:36:04.075657+0000","last_peered":"2023-10-09T11:36:04.075657+0000","last_clean":"2023-10-09T11:36:04.075657+0000","last_became_active":"2023-10-09T11:36:04.073930+0000","last_became_peered":"2023-10-09T11:36:04.073930+0000","last_unstale":"2023-10-09T11:36:04.075657+0000","last_undegraded":"2023-10-09T11:36:04.075657+0000","last_fullsized":"2023-10-09T11:36:04.075657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.065534+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:04.065534+0000","last_peered":"2023-10-09T11:36:04.065534+0000","last_clean":"2023-10-09T11:36:04.065534+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:04.065534+0000","last_undegraded":"2023-10-09T11:36:04.065534+0000","last_fullsized":"2023-10-09T11:36:04.065534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074310+0000","last_change":"2023-10-09T11:36:04.074247+0000","last_active":"2023-10-09T11:36:04.074310+0000","last_peered":"2023-10-09T11:36:04.074310+0000","last_clean":"2023-10-09T11:36:04.074310+0000","last_became_active":"2023-10-09T11:36:04.074025+0000","last_became_peered":"2023-10-09T11:36:04.074025+0000","last_unstale":"2023-10-09T11:36:04.074310+0000","last_undegraded":"2023-10-09T11:36:04.074310+0000","last_fullsized":"2023-10-09T11:36:04.074310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074519+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:04.074519+0000","last_peered":"2023-10-09T11:36:04.074519+0000","last_clean":"2023-10-09T11:36:04.074519+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:04.074519+0000","last_undegraded":"2023-10-09T11:36:04.074519+0000","last_fullsized":"2023-10-09T11:36:04.074519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080255+0000","last_change":"2023-10-09T11:36:04.079551+0000","last_active":"2023-10-09T11:36:04.080255+0000","last_peered":"2023-10-09T11:36:04.080255+0000","last_clean":"2023-10-09T11:36:04.080255+0000","last_became_active":"2023-10-09T11:36:04.079307+0000","last_became_peered":"2023-10-09T11:36:04.079307+0000","last_unstale":"2023-10-09T11:36:04.080255+0000","last_undegraded":"2023-10-09T11:36:04.080255+0000","last_fullsized":"2023-10-09T11:36:04.080255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083869+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:04.083869+0000","last_peered":"2023-10-09T11:36:04.083869+0000","last_clean":"2023-10-09T11:36:04.083869+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:04.083869+0000","last_undegraded":"2023-10-09T11:36:04.083869+0000","last_fullsized":"2023-10-09T11:36:04.083869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073623+0000","last_change":"2023-10-09T11:36:04.073410+0000","last_active":"2023-10-09T11:36:04.073623+0000","last_peered":"2023-10-09T11:36:04.073623+0000","last_clean":"2023-10-09T11:36:04.073623+0000","last_became_active":"2023-10-09T11:36:04.072808+0000","last_became_peered":"2023-10-09T11:36:04.072808+0000","last_unstale":"2023-10-09T11:36:04.073623+0000","last_undegraded":"2023-10-09T11:36:04.073623+0000","last_fullsized":"2023-10-09T11:36:04.073623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:22.124509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072611+0000","last_change":"2023-10-09T11:36:04.072547+0000","last_active":"2023-10-09T11:36:04.072611+0000","last_peered":"2023-10-09T11:36:04.072611+0000","last_clean":"2023-10-09T11:36:04.072611+0000","last_became_active":"2023-10-09T11:36:04.070914+0000","last_became_peered":"2023-10-09T11:36:04.070914+0000","last_unstale":"2023-10-09T11:36:04.072611+0000","last_undegraded":"2023-10-09T11:36:04.072611+0000","last_fullsized":"2023-10-09T11:36:04.072611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071473+0000","last_change":"2023-10-09T11:36:04.070407+0000","last_active":"2023-10-09T11:36:04.071473+0000","last_peered":"2023-10-09T11:36:04.071473+0000","last_clean":"2023-10-09T11:36:04.071473+0000","last_became_active":"2023-10-09T11:36:04.070183+0000","last_became_peered":"2023-10-09T11:36:04.070183+0000","last_unstale":"2023-10-09T11:36:04.071473+0000","last_undegraded":"2023-10-09T11:36:04.071473+0000","last_fullsized":"2023-10-09T11:36:04.071473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080238+0000","last_change":"2023-10-09T11:36:04.079371+0000","last_active":"2023-10-09T11:36:04.080238+0000","last_peered":"2023-10-09T11:36:04.080238+0000","last_clean":"2023-10-09T11:36:04.080238+0000","last_became_active":"2023-10-09T11:36:04.079152+0000","last_became_peered":"2023-10-09T11:36:04.079152+0000","last_unstale":"2023-10-09T11:36:04.080238+0000","last_undegraded":"2023-10-09T11:36:04.080238+0000","last_fullsized":"2023-10-09T11:36:04.080238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081639+0000","last_change":"2023-10-09T11:36:04.081536+0000","last_active":"2023-10-09T11:36:04.081639+0000","last_peered":"2023-10-09T11:36:04.081639+0000","last_clean":"2023-10-09T11:36:04.081639+0000","last_became_active":"2023-10-09T11:36:04.081054+0000","last_became_peered":"2023-10-09T11:36:04.081054+0000","last_unstale":"2023-10-09T11:36:04.081639+0000","last_undegraded":"2023-10-09T11:36:04.081639+0000","last_fullsized":"2023-10-09T11:36:04.081639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087035+0000","last_change":"2023-10-09T11:36:04.086736+0000","last_active":"2023-10-09T11:36:04.087035+0000","last_peered":"2023-10-09T11:36:04.087035+0000","last_clean":"2023-10-09T11:36:04.087035+0000","last_became_active":"2023-10-09T11:36:04.085787+0000","last_became_peered":"2023-10-09T11:36:04.085787+0000","last_unstale":"2023-10-09T11:36:04.087035+0000","last_undegraded":"2023-10-09T11:36:04.087035+0000","last_fullsized":"2023-10-09T11:36:04.087035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085923+0000","last_change":"2023-10-09T11:36:04.085863+0000","last_active":"2023-10-09T11:36:04.085923+0000","last_peered":"2023-10-09T11:36:04.085923+0000","last_clean":"2023-10-09T11:36:04.085923+0000","last_became_active":"2023-10-09T11:36:04.085616+0000","last_became_peered":"2023-10-09T11:36:04.085616+0000","last_unstale":"2023-10-09T11:36:04.085923+0000","last_undegraded":"2023-10-09T11:36:04.085923+0000","last_fullsized":"2023-10-09T11:36:04.085923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077303+0000","last_change":"2023-10-09T11:36:04.077191+0000","last_active":"2023-10-09T11:36:04.077303+0000","last_peered":"2023-10-09T11:36:04.077303+0000","last_clean":"2023-10-09T11:36:04.077303+0000","last_became_active":"2023-10-09T11:36:04.074565+0000","last_became_peered":"2023-10-09T11:36:04.074565+0000","last_unstale":"2023-10-09T11:36:04.077303+0000","last_undegraded":"2023-10-09T11:36:04.077303+0000","last_fullsized":"2023-10-09T11:36:04.077303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086970+0000","last_change":"2023-10-09T11:36:04.085672+0000","last_active":"2023-10-09T11:36:04.086970+0000","last_peered":"2023-10-09T11:36:04.086970+0000","last_clean":"2023-10-09T11:36:04.086970+0000","last_became_active":"2023-10-09T11:36:04.085373+0000","last_became_peered":"2023-10-09T11:36:04.085373+0000","last_unstale":"2023-10-09T11:36:04.086970+0000","last_undegraded":"2023-10-09T11:36:04.086970+0000","last_fullsized":"2023-10-09T11:36:04.086970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081601+0000","last_change":"2023-10-09T11:36:04.081476+0000","last_active":"2023-10-09T11:36:04.081601+0000","last_peered":"2023-10-09T11:36:04.081601+0000","last_clean":"2023-10-09T11:36:04.081601+0000","last_became_active":"2023-10-09T11:36:04.081002+0000","last_became_peered":"2023-10-09T11:36:04.081002+0000","last_unstale":"2023-10-09T11:36:04.081601+0000","last_undegraded":"2023-10-09T11:36:04.081601+0000","last_fullsized":"2023-10-09T11:36:04.081601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087021+0000","last_change":"2023-10-09T11:36:04.086449+0000","last_active":"2023-10-09T11:36:04.087021+0000","last_peered":"2023-10-09T11:36:04.087021+0000","last_clean":"2023-10-09T11:36:04.087021+0000","last_became_active":"2023-10-09T11:36:04.085477+0000","last_became_peered":"2023-10-09T11:36:04.085477+0000","last_unstale":"2023-10-09T11:36:04.087021+0000","last_undegraded":"2023-10-09T11:36:04.087021+0000","last_fullsized":"2023-10-09T11:36:04.087021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076180+0000","last_change":"2023-10-09T11:36:04.075706+0000","last_active":"2023-10-09T11:36:04.076180+0000","last_peered":"2023-10-09T11:36:04.076180+0000","last_clean":"2023-10-09T11:36:04.076180+0000","last_became_active":"2023-10-09T11:36:04.075096+0000","last_became_peered":"2023-10-09T11:36:04.075096+0000","last_unstale":"2023-10-09T11:36:04.076180+0000","last_undegraded":"2023-10-09T11:36:04.076180+0000","last_fullsized":"2023-10-09T11:36:04.076180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.084996+0000","last_change":"2023-10-09T11:36:04.084941+0000","last_active":"2023-10-09T11:36:04.084996+0000","last_peered":"2023-10-09T11:36:04.084996+0000","last_clean":"2023-10-09T11:36:04.084996+0000","last_became_active":"2023-10-09T11:36:04.084453+0000","last_became_peered":"2023-10-09T11:36:04.084453+0000","last_unstale":"2023-10-09T11:36:04.084996+0000","last_undegraded":"2023-10-09T11:36:04.084996+0000","last_fullsized":"2023-10-09T11:36:04.084996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073999+0000","last_change":"2023-10-09T11:36:04.073572+0000","last_active":"2023-10-09T11:36:04.073999+0000","last_peered":"2023-10-09T11:36:04.073999+0000","last_clean":"2023-10-09T11:36:04.073999+0000","last_became_active":"2023-10-09T11:36:04.073337+0000","last_became_peered":"2023-10-09T11:36:04.073337+0000","last_unstale":"2023-10-09T11:36:04.073999+0000","last_undegraded":"2023-10-09T11:36:04.073999+0000","last_fullsized":"2023-10-09T11:36:04.073999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.298}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.46}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9370000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1509999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9790000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.952}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.782}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.4210000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1609999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5679999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:18.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:18.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.799+0000 7f9126f52700 1 Processor -- start 2023-10-09T11:36:18.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.799+0000 7f9126f52700 1 -- start start 2023-10-09T11:36:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 0x7f91200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9120157ca0 0x7f912015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 0x7f912006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200d07c0 con 0x7f9120157ca0 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912006daa0 con 0x7f91201578d0 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f9126f52700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200cfbb0 con 0x7f912006d120 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f911ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9120157ca0 0x7f912015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f911ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9120157ca0 0x7f912015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36596/0 (socket says 172.21.15.6:36596) 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.800+0000 7f911ffff700 1 -- 172.21.15.6:0/567647782 learned_addr learned my addr 172.21.15.6:0/567647782 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f91254ef700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 0x7f912006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9124cee700 1 --2- 172.21.15.6:0/567647782 >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 0x7f91200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 -- 172.21.15.6:0/567647782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 msgr2=0x7f912006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 0x7f912006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 -- 172.21.15.6:0/567647782 >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 msgr2=0x7f91200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 --2- 172.21.15.6:0/567647782 >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 0x7f91200cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 -- 172.21.15.6:0/567647782 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200cfe90 con 0x7f9120157ca0 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9124cee700 1 --2- 172.21.15.6:0/567647782 >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 0x7f91200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f91254ef700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 0x7f912006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911ffff700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9120157ca0 0x7f912015af00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91200646b0 tx=0x7f9110009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce91d7e257cae90 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911f7fe700 1 -- 172.21.15.6:0/567647782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000e070 con 0x7f9120157ca0 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911f7fe700 1 -- 172.21.15.6:0/567647782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000ba50 con 0x7f9120157ca0 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f911f7fe700 1 -- 172.21.15.6:0/567647782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100092e0 con 0x7f9120157ca0 2023-10-09T11:36:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 -- 172.21.15.6:0/567647782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9120157ca0 msgr2=0x7f912015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9120157ca0 0x7f912015af00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f91200646b0 tx=0x7f9110009840 comp rx=0 tx=0).stop 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 -- 172.21.15.6:0/567647782 shutdown_connections 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f912006d120 0x7f912006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 --2- 172.21.15.6:0/567647782 >> v2:172.21.15.118:3300/0 conn(0x7f91201578d0 0x7f91200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 --2- 172.21.15.6:0/567647782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9120157ca0 0x7f912015af00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 -- 172.21.15.6:0/567647782 >> 172.21.15.6:0/567647782 conn(0x7f912006bb90 msgr2=0x7f912006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 -- 172.21.15.6:0/567647782 shutdown_connections 2023-10-09T11:36:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.801+0000 7f9126f52700 1 -- 172.21.15.6:0/567647782 wait complete. 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 Processor -- start 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 -- start start 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91201578d0 0x7f91200ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 0x7f912016d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200aaea0 con 0x7f912006d120 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200aa890 con 0x7f9120157ca0 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.803+0000 7f9126f52700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912016e0f0 con 0x7f91201578d0 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36598/0 (socket says 172.21.15.6:36598) 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 -- 172.21.15.6:0/1503658049 learned_addr learned my addr 172.21.15.6:0/1503658049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f911ffff700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91201578d0 0x7f91200ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f91254ef700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 0x7f912016d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 -- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91201578d0 msgr2=0x7f91200ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91201578d0 0x7f91200ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 -- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 msgr2=0x7f912016d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 0x7f912016d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 -- 172.21.15.6:0/1503658049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110009ae0 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f91254ef700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 0x7f912016d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9124cee700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f911800c830 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118011600 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118011760 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118011b20 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912016e3d0 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.804+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9120147ce0 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.805+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120067ac0 con 0x7f912006d120 2023-10-09T11:36:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.806+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91180193b0 con 0x7f912006d120 2023-10-09T11:36:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.806+0000 7f911cff9700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 0x7f91000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.806+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9118084580 con 0x7f912006d120 2023-10-09T11:36:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.806+0000 7f911ffff700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 0x7f91000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.807+0000 7f911ffff700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 0x7f91000693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91201580c0 tx=0x7f9110018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.810+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91180517f0 con 0x7f912006d120 2023-10-09T11:36:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:18.997+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91200aafe0 con 0x7f9100066f30 2023-10-09T11:36:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.005+0000 7f911cff9700 1 -- 172.21.15.6:0/1503658049 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260108 (secure 0 0 0) 0x7f911000bce0 con 0x7f9100066f30 2023-10-09T11:36:19.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 msgr2=0x7f91000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 0x7f91000693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91201580c0 tx=0x7f9110018000 comp rx=0 tx=0).stop 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 msgr2=0x7f91201477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f911800c830 tx=0x7f9118008040 comp rx=0 tx=0).stop 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 shutdown_connections 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9100066f30 0x7f91000693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9120157ca0 0x7f912016d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f912006d120 0x7f91201477a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 --2- 172.21.15.6:0/1503658049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91201578d0 0x7f91200ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 >> 172.21.15.6:0/1503658049 conn(0x7f912006bb90 msgr2=0x7f9120070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 shutdown_connections 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.008+0000 7f9126f52700 1 -- 172.21.15.6:0/1503658049 wait complete. 2023-10-09T11:36:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:19.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T11:36:18.150368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002692"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079635+0000","last_change":"2023-10-09T11:36:04.078956+0000","last_active":"2023-10-09T11:36:04.079635+0000","last_peered":"2023-10-09T11:36:04.079635+0000","last_clean":"2023-10-09T11:36:04.079635+0000","last_became_active":"2023-10-09T11:36:04.078726+0000","last_became_peered":"2023-10-09T11:36:04.078726+0000","last_unstale":"2023-10-09T11:36:04.079635+0000","last_undegraded":"2023-10-09T11:36:04.079635+0000","last_fullsized":"2023-10-09T11:36:04.079635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:23.806661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077801+0000","last_change":"2023-10-09T11:36:04.077746+0000","last_active":"2023-10-09T11:36:04.077801+0000","last_peered":"2023-10-09T11:36:04.077801+0000","last_clean":"2023-10-09T11:36:04.077801+0000","last_became_active":"2023-10-09T11:36:04.077586+0000","last_became_peered":"2023-10-09T11:36:04.077586+0000","last_unstale":"2023-10-09T11:36:04.077801+0000","last_undegraded":"2023-10-09T11:36:04.077801+0000","last_fullsized":"2023-10-09T11:36:04.077801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067923+0000","last_change":"2023-10-09T11:36:04.067868+0000","last_active":"2023-10-09T11:36:04.067923+0000","last_peered":"2023-10-09T11:36:04.067923+0000","last_clean":"2023-10-09T11:36:04.067923+0000","last_became_active":"2023-10-09T11:36:04.067359+0000","last_became_peered":"2023-10-09T11:36:04.067359+0000","last_unstale":"2023-10-09T11:36:04.067923+0000","last_undegraded":"2023-10-09T11:36:04.067923+0000","last_fullsized":"2023-10-09T11:36:04.067923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081543+0000","last_change":"2023-10-09T11:36:04.081241+0000","last_active":"2023-10-09T11:36:04.081543+0000","last_peered":"2023-10-09T11:36:04.081543+0000","last_clean":"2023-10-09T11:36:04.081543+0000","last_became_active":"2023-10-09T11:36:04.080417+0000","last_became_peered":"2023-10-09T11:36:04.080417+0000","last_unstale":"2023-10-09T11:36:04.081543+0000","last_undegraded":"2023-10-09T11:36:04.081543+0000","last_fullsized":"2023-10-09T11:36:04.081543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:38.061373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079612+0000","last_change":"2023-10-09T11:36:04.078524+0000","last_active":"2023-10-09T11:36:04.079612+0000","last_peered":"2023-10-09T11:36:04.079612+0000","last_clean":"2023-10-09T11:36:04.079612+0000","last_became_active":"2023-10-09T11:36:04.078262+0000","last_became_peered":"2023-10-09T11:36:04.078262+0000","last_unstale":"2023-10-09T11:36:04.079612+0000","last_undegraded":"2023-10-09T11:36:04.079612+0000","last_fullsized":"2023-10-09T11:36:04.079612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069441+0000","last_change":"2023-10-09T11:36:04.068963+0000","last_active":"2023-10-09T11:36:04.069441+0000","last_peered":"2023-10-09T11:36:04.069441+0000","last_clean":"2023-10-09T11:36:04.069441+0000","last_became_active":"2023-10-09T11:36:04.068322+0000","last_became_peered":"2023-10-09T11:36:04.068322+0000","last_unstale":"2023-10-09T11:36:04.069441+0000","last_undegraded":"2023-10-09T11:36:04.069441+0000","last_fullsized":"2023-10-09T11:36:04.069441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:17.857354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079107+0000","last_change":"2023-10-09T11:36:04.078377+0000","last_active":"2023-10-09T11:36:04.079107+0000","last_peered":"2023-10-09T11:36:04.079107+0000","last_clean":"2023-10-09T11:36:04.079107+0000","last_became_active":"2023-10-09T11:36:04.077783+0000","last_became_peered":"2023-10-09T11:36:04.077783+0000","last_unstale":"2023-10-09T11:36:04.079107+0000","last_undegraded":"2023-10-09T11:36:04.079107+0000","last_fullsized":"2023-10-09T11:36:04.079107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086953+0000","last_change":"2023-10-09T11:36:04.085234+0000","last_active":"2023-10-09T11:36:04.086953+0000","last_peered":"2023-10-09T11:36:04.086953+0000","last_clean":"2023-10-09T11:36:04.086953+0000","last_became_active":"2023-10-09T11:36:04.081369+0000","last_became_peered":"2023-10-09T11:36:04.081369+0000","last_unstale":"2023-10-09T11:36:04.086953+0000","last_undegraded":"2023-10-09T11:36:04.086953+0000","last_fullsized":"2023-10-09T11:36:04.086953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073597+0000","last_change":"2023-10-09T11:36:04.073032+0000","last_active":"2023-10-09T11:36:04.073597+0000","last_peered":"2023-10-09T11:36:04.073597+0000","last_clean":"2023-10-09T11:36:04.073597+0000","last_became_active":"2023-10-09T11:36:04.072482+0000","last_became_peered":"2023-10-09T11:36:04.072482+0000","last_unstale":"2023-10-09T11:36:04.073597+0000","last_undegraded":"2023-10-09T11:36:04.073597+0000","last_fullsized":"2023-10-09T11:36:04.073597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:57.265856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077089+0000","last_change":"2023-10-09T11:36:04.076990+0000","last_active":"2023-10-09T11:36:04.077089+0000","last_peered":"2023-10-09T11:36:04.077089+0000","last_clean":"2023-10-09T11:36:04.077089+0000","last_became_active":"2023-10-09T11:36:04.076769+0000","last_became_peered":"2023-10-09T11:36:04.076769+0000","last_unstale":"2023-10-09T11:36:04.077089+0000","last_undegraded":"2023-10-09T11:36:04.077089+0000","last_fullsized":"2023-10-09T11:36:04.077089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070537+0000","last_change":"2023-10-09T11:36:04.070385+0000","last_active":"2023-10-09T11:36:04.070537+0000","last_peered":"2023-10-09T11:36:04.070537+0000","last_clean":"2023-10-09T11:36:04.070537+0000","last_became_active":"2023-10-09T11:36:04.070159+0000","last_became_peered":"2023-10-09T11:36:04.070159+0000","last_unstale":"2023-10-09T11:36:04.070537+0000","last_undegraded":"2023-10-09T11:36:04.070537+0000","last_fullsized":"2023-10-09T11:36:04.070537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070944+0000","last_change":"2023-10-09T11:36:04.070645+0000","last_active":"2023-10-09T11:36:04.070944+0000","last_peered":"2023-10-09T11:36:04.070944+0000","last_clean":"2023-10-09T11:36:04.070944+0000","last_became_active":"2023-10-09T11:36:04.070421+0000","last_became_peered":"2023-10-09T11:36:04.070421+0000","last_unstale":"2023-10-09T11:36:04.070944+0000","last_undegraded":"2023-10-09T11:36:04.070944+0000","last_fullsized":"2023-10-09T11:36:04.070944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081588+0000","last_change":"2023-10-09T11:36:04.081114+0000","last_active":"2023-10-09T11:36:04.081588+0000","last_peered":"2023-10-09T11:36:04.081588+0000","last_clean":"2023-10-09T11:36:04.081588+0000","last_became_active":"2023-10-09T11:36:04.080371+0000","last_became_peered":"2023-10-09T11:36:04.080371+0000","last_unstale":"2023-10-09T11:36:04.081588+0000","last_undegraded":"2023-10-09T11:36:04.081588+0000","last_fullsized":"2023-10-09T11:36:04.081588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072507+0000","last_change":"2023-10-09T11:36:04.072443+0000","last_active":"2023-10-09T11:36:04.072507+0000","last_peered":"2023-10-09T11:36:04.072507+0000","last_clean":"2023-10-09T11:36:04.072507+0000","last_became_active":"2023-10-09T11:36:04.072205+0000","last_became_peered":"2023-10-09T11:36:04.072205+0000","last_unstale":"2023-10-09T11:36:04.072507+0000","last_undegraded":"2023-10-09T11:36:04.072507+0000","last_fullsized":"2023-10-09T11:36:04.072507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073391+0000","last_change":"2023-10-09T11:36:04.073323+0000","last_active":"2023-10-09T11:36:04.073391+0000","last_peered":"2023-10-09T11:36:04.073391+0000","last_clean":"2023-10-09T11:36:04.073391+0000","last_became_active":"2023-10-09T11:36:04.073096+0000","last_became_peered":"2023-10-09T11:36:04.073096+0000","last_unstale":"2023-10-09T11:36:04.073391+0000","last_undegraded":"2023-10-09T11:36:04.073391+0000","last_fullsized":"2023-10-09T11:36:04.073391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069410+0000","last_change":"2023-10-09T11:36:04.068825+0000","last_active":"2023-10-09T11:36:04.069410+0000","last_peered":"2023-10-09T11:36:04.069410+0000","last_clean":"2023-10-09T11:36:04.069410+0000","last_became_active":"2023-10-09T11:36:04.067993+0000","last_became_peered":"2023-10-09T11:36:04.067993+0000","last_unstale":"2023-10-09T11:36:04.069410+0000","last_undegraded":"2023-10-09T11:36:04.069410+0000","last_fullsized":"2023-10-09T11:36:04.069410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:23:18.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076162+0000","last_change":"2023-10-09T11:36:04.075555+0000","last_active":"2023-10-09T11:36:04.076162+0000","last_peered":"2023-10-09T11:36:04.076162+0000","last_clean":"2023-10-09T11:36:04.076162+0000","last_became_active":"2023-10-09T11:36:04.074783+0000","last_became_peered":"2023-10-09T11:36:04.074783+0000","last_unstale":"2023-10-09T11:36:04.076162+0000","last_undegraded":"2023-10-09T11:36:04.076162+0000","last_fullsized":"2023-10-09T11:36:04.076162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074638+0000","last_change":"2023-10-09T11:36:04.073743+0000","last_active":"2023-10-09T11:36:04.074638+0000","last_peered":"2023-10-09T11:36:04.074638+0000","last_clean":"2023-10-09T11:36:04.074638+0000","last_became_active":"2023-10-09T11:36:04.073540+0000","last_became_peered":"2023-10-09T11:36:04.073540+0000","last_unstale":"2023-10-09T11:36:04.074638+0000","last_undegraded":"2023-10-09T11:36:04.074638+0000","last_fullsized":"2023-10-09T11:36:04.074638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:06.081369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078952+0000","last_change":"2023-10-09T11:36:04.077634+0000","last_active":"2023-10-09T11:36:04.078952+0000","last_peered":"2023-10-09T11:36:04.078952+0000","last_clean":"2023-10-09T11:36:04.078952+0000","last_became_active":"2023-10-09T11:36:04.077447+0000","last_became_peered":"2023-10-09T11:36:04.077447+0000","last_unstale":"2023-10-09T11:36:04.078952+0000","last_undegraded":"2023-10-09T11:36:04.078952+0000","last_fullsized":"2023-10-09T11:36:04.078952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:23.233430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083898+0000","last_change":"2023-10-09T11:36:03.074646+0000","last_active":"2023-10-09T11:36:04.083898+0000","last_peered":"2023-10-09T11:36:04.083898+0000","last_clean":"2023-10-09T11:36:04.083898+0000","last_became_active":"2023-10-09T11:36:03.072521+0000","last_became_peered":"2023-10-09T11:36:03.072521+0000","last_unstale":"2023-10-09T11:36:04.083898+0000","last_undegraded":"2023-10-09T11:36:04.083898+0000","last_fullsized":"2023-10-09T11:36:04.083898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081372+0000","last_change":"2023-10-09T11:36:04.080046+0000","last_active":"2023-10-09T11:36:04.081372+0000","last_peered":"2023-10-09T11:36:04.081372+0000","last_clean":"2023-10-09T11:36:04.081372+0000","last_became_active":"2023-10-09T11:36:04.079611+0000","last_became_peered":"2023-10-09T11:36:04.079611+0000","last_unstale":"2023-10-09T11:36:04.081372+0000","last_undegraded":"2023-10-09T11:36:04.081372+0000","last_fullsized":"2023-10-09T11:36:04.081372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085869+0000","last_change":"2023-10-09T11:36:03.071936+0000","last_active":"2023-10-09T11:36:04.085869+0000","last_peered":"2023-10-09T11:36:04.085869+0000","last_clean":"2023-10-09T11:36:04.085869+0000","last_became_active":"2023-10-09T11:36:03.071669+0000","last_became_peered":"2023-10-09T11:36:03.071669+0000","last_unstale":"2023-10-09T11:36:04.085869+0000","last_undegraded":"2023-10-09T11:36:04.085869+0000","last_fullsized":"2023-10-09T11:36:04.085869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068031+0000","last_change":"2023-10-09T11:36:04.067981+0000","last_active":"2023-10-09T11:36:04.068031+0000","last_peered":"2023-10-09T11:36:04.068031+0000","last_clean":"2023-10-09T11:36:04.068031+0000","last_became_active":"2023-10-09T11:36:04.067598+0000","last_became_peered":"2023-10-09T11:36:04.067598+0000","last_unstale":"2023-10-09T11:36:04.068031+0000","last_undegraded":"2023-10-09T11:36:04.068031+0000","last_fullsized":"2023-10-09T11:36:04.068031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079025+0000","last_change":"2023-10-09T11:36:03.076134+0000","last_active":"2023-10-09T11:36:04.079025+0000","last_peered":"2023-10-09T11:36:04.079025+0000","last_clean":"2023-10-09T11:36:04.079025+0000","last_became_active":"2023-10-09T11:36:03.075924+0000","last_became_peered":"2023-10-09T11:36:03.075924+0000","last_unstale":"2023-10-09T11:36:04.079025+0000","last_undegraded":"2023-10-09T11:36:04.079025+0000","last_fullsized":"2023-10-09T11:36:04.079025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.070274+0000","last_change":"2023-10-09T11:36:04.070208+0000","last_active":"2023-10-09T11:36:04.070274+0000","last_peered":"2023-10-09T11:36:04.070274+0000","last_clean":"2023-10-09T11:36:04.070274+0000","last_became_active":"2023-10-09T11:36:04.069970+0000","last_became_peered":"2023-10-09T11:36:04.069970+0000","last_unstale":"2023-10-09T11:36:04.070274+0000","last_undegraded":"2023-10-09T11:36:04.070274+0000","last_fullsized":"2023-10-09T11:36:04.070274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082152+0000","last_change":"2023-10-09T11:36:03.072573+0000","last_active":"2023-10-09T11:36:04.082152+0000","last_peered":"2023-10-09T11:36:04.082152+0000","last_clean":"2023-10-09T11:36:04.082152+0000","last_became_active":"2023-10-09T11:36:03.072315+0000","last_became_peered":"2023-10-09T11:36:03.072315+0000","last_unstale":"2023-10-09T11:36:04.082152+0000","last_undegraded":"2023-10-09T11:36:04.082152+0000","last_fullsized":"2023-10-09T11:36:04.082152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:16.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067470+0000","last_change":"2023-10-09T11:36:04.067052+0000","last_active":"2023-10-09T11:36:04.067470+0000","last_peered":"2023-10-09T11:36:04.067470+0000","last_clean":"2023-10-09T11:36:04.067470+0000","last_became_active":"2023-10-09T11:36:04.066804+0000","last_became_peered":"2023-10-09T11:36:04.066804+0000","last_unstale":"2023-10-09T11:36:04.067470+0000","last_undegraded":"2023-10-09T11:36:04.067470+0000","last_fullsized":"2023-10-09T11:36:04.067470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080288+0000","last_change":"2023-10-09T11:36:03.072466+0000","last_active":"2023-10-09T11:36:04.080288+0000","last_peered":"2023-10-09T11:36:04.080288+0000","last_clean":"2023-10-09T11:36:04.080288+0000","last_became_active":"2023-10-09T11:36:03.072217+0000","last_became_peered":"2023-10-09T11:36:03.072217+0000","last_unstale":"2023-10-09T11:36:04.080288+0000","last_undegraded":"2023-10-09T11:36:04.080288+0000","last_fullsized":"2023-10-09T11:36:04.080288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072277+0000","last_change":"2023-10-09T11:36:04.071963+0000","last_active":"2023-10-09T11:36:04.072277+0000","last_peered":"2023-10-09T11:36:04.072277+0000","last_clean":"2023-10-09T11:36:04.072277+0000","last_became_active":"2023-10-09T11:36:04.071760+0000","last_became_peered":"2023-10-09T11:36:04.071760+0000","last_unstale":"2023-10-09T11:36:04.072277+0000","last_undegraded":"2023-10-09T11:36:04.072277+0000","last_fullsized":"2023-10-09T11:36:04.072277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:46.242501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076254+0000","last_change":"2023-10-09T11:36:03.074738+0000","last_active":"2023-10-09T11:36:04.076254+0000","last_peered":"2023-10-09T11:36:04.076254+0000","last_clean":"2023-10-09T11:36:04.076254+0000","last_became_active":"2023-10-09T11:36:03.074427+0000","last_became_peered":"2023-10-09T11:36:03.074427+0000","last_unstale":"2023-10-09T11:36:04.076254+0000","last_undegraded":"2023-10-09T11:36:04.076254+0000","last_fullsized":"2023-10-09T11:36:04.076254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066583+0000","last_change":"2023-10-09T11:36:04.066355+0000","last_active":"2023-10-09T11:36:04.066583+0000","last_peered":"2023-10-09T11:36:04.066583+0000","last_clean":"2023-10-09T11:36:04.066583+0000","last_became_active":"2023-10-09T11:36:04.066128+0000","last_became_peered":"2023-10-09T11:36:04.066128+0000","last_unstale":"2023-10-09T11:36:04.066583+0000","last_undegraded":"2023-10-09T11:36:04.066583+0000","last_fullsized":"2023-10-09T11:36:04.066583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076230+0000","last_change":"2023-10-09T11:36:03.076801+0000","last_active":"2023-10-09T11:36:04.076230+0000","last_peered":"2023-10-09T11:36:04.076230+0000","last_clean":"2023-10-09T11:36:04.076230+0000","last_became_active":"2023-10-09T11:36:03.076363+0000","last_became_peered":"2023-10-09T11:36:03.076363+0000","last_unstale":"2023-10-09T11:36:04.076230+0000","last_undegraded":"2023-10-09T11:36:04.076230+0000","last_fullsized":"2023-10-09T11:36:04.076230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:36.203436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079241+0000","last_change":"2023-10-09T11:36:04.079049+0000","last_active":"2023-10-09T11:36:04.079241+0000","last_peered":"2023-10-09T11:36:04.079241+0000","last_clean":"2023-10-09T11:36:04.079241+0000","last_became_active":"2023-10-09T11:36:04.078834+0000","last_became_peered":"2023-10-09T11:36:04.078834+0000","last_unstale":"2023-10-09T11:36:04.079241+0000","last_undegraded":"2023-10-09T11:36:04.079241+0000","last_fullsized":"2023-10-09T11:36:04.079241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066626+0000","last_change":"2023-10-09T11:36:03.068534+0000","last_active":"2023-10-09T11:36:04.066626+0000","last_peered":"2023-10-09T11:36:04.066626+0000","last_clean":"2023-10-09T11:36:04.066626+0000","last_became_active":"2023-10-09T11:36:03.068306+0000","last_became_peered":"2023-10-09T11:36:03.068306+0000","last_unstale":"2023-10-09T11:36:04.066626+0000","last_undegraded":"2023-10-09T11:36:04.066626+0000","last_fullsized":"2023-10-09T11:36:04.066626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086442+0000","last_change":"2023-10-09T11:36:04.086385+0000","last_active":"2023-10-09T11:36:04.086442+0000","last_peered":"2023-10-09T11:36:04.086442+0000","last_clean":"2023-10-09T11:36:04.086442+0000","last_became_active":"2023-10-09T11:36:04.086167+0000","last_became_peered":"2023-10-09T11:36:04.086167+0000","last_unstale":"2023-10-09T11:36:04.086442+0000","last_undegraded":"2023-10-09T11:36:04.086442+0000","last_fullsized":"2023-10-09T11:36:04.086442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068009+0000","last_change":"2023-10-09T11:36:03.077021+0000","last_active":"2023-10-09T11:36:04.068009+0000","last_peered":"2023-10-09T11:36:04.068009+0000","last_clean":"2023-10-09T11:36:04.068009+0000","last_became_active":"2023-10-09T11:36:03.076794+0000","last_became_peered":"2023-10-09T11:36:03.076794+0000","last_unstale":"2023-10-09T11:36:04.068009+0000","last_undegraded":"2023-10-09T11:36:04.068009+0000","last_fullsized":"2023-10-09T11:36:04.068009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076195+0000","last_change":"2023-10-09T11:36:04.075850+0000","last_active":"2023-10-09T11:36:04.076195+0000","last_peered":"2023-10-09T11:36:04.076195+0000","last_clean":"2023-10-09T11:36:04.076195+0000","last_became_active":"2023-10-09T11:36:04.075362+0000","last_became_peered":"2023-10-09T11:36:04.075362+0000","last_unstale":"2023-10-09T11:36:04.076195+0000","last_undegraded":"2023-10-09T11:36:04.076195+0000","last_fullsized":"2023-10-09T11:36:04.076195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066187+0000","last_change":"2023-10-09T11:36:03.075059+0000","last_active":"2023-10-09T11:36:04.066187+0000","last_peered":"2023-10-09T11:36:04.066187+0000","last_clean":"2023-10-09T11:36:04.066187+0000","last_became_active":"2023-10-09T11:36:03.074834+0000","last_became_peered":"2023-10-09T11:36:03.074834+0000","last_unstale":"2023-10-09T11:36:04.066187+0000","last_undegraded":"2023-10-09T11:36:04.066187+0000","last_fullsized":"2023-10-09T11:36:04.066187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067792+0000","last_change":"2023-10-09T11:36:04.067726+0000","last_active":"2023-10-09T11:36:04.067792+0000","last_peered":"2023-10-09T11:36:04.067792+0000","last_clean":"2023-10-09T11:36:04.067792+0000","last_became_active":"2023-10-09T11:36:04.067478+0000","last_became_peered":"2023-10-09T11:36:04.067478+0000","last_unstale":"2023-10-09T11:36:04.067792+0000","last_undegraded":"2023-10-09T11:36:04.067792+0000","last_fullsized":"2023-10-09T11:36:04.067792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077393+0000","last_change":"2023-10-09T11:36:03.071834+0000","last_active":"2023-10-09T11:36:04.077393+0000","last_peered":"2023-10-09T11:36:04.077393+0000","last_clean":"2023-10-09T11:36:04.077393+0000","last_became_active":"2023-10-09T11:36:03.071599+0000","last_became_peered":"2023-10-09T11:36:03.071599+0000","last_unstale":"2023-10-09T11:36:04.077393+0000","last_undegraded":"2023-10-09T11:36:04.077393+0000","last_fullsized":"2023-10-09T11:36:04.077393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072210+0000","last_change":"2023-10-09T11:36:04.071867+0000","last_active":"2023-10-09T11:36:04.072210+0000","last_peered":"2023-10-09T11:36:04.072210+0000","last_clean":"2023-10-09T11:36:04.072210+0000","last_became_active":"2023-10-09T11:36:04.071610+0000","last_became_peered":"2023-10-09T11:36:04.071610+0000","last_unstale":"2023-10-09T11:36:04.072210+0000","last_undegraded":"2023-10-09T11:36:04.072210+0000","last_fullsized":"2023-10-09T11:36:04.072210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:57.933905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087147+0000","last_change":"2023-10-09T11:36:03.073913+0000","last_active":"2023-10-09T11:36:04.087147+0000","last_peered":"2023-10-09T11:36:04.087147+0000","last_clean":"2023-10-09T11:36:04.087147+0000","last_became_active":"2023-10-09T11:36:03.073600+0000","last_became_peered":"2023-10-09T11:36:03.073600+0000","last_unstale":"2023-10-09T11:36:04.087147+0000","last_undegraded":"2023-10-09T11:36:04.087147+0000","last_fullsized":"2023-10-09T11:36:04.087147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085788+0000","last_change":"2023-10-09T11:36:04.085709+0000","last_active":"2023-10-09T11:36:04.085788+0000","last_peered":"2023-10-09T11:36:04.085788+0000","last_clean":"2023-10-09T11:36:04.085788+0000","last_became_active":"2023-10-09T11:36:04.085450+0000","last_became_peered":"2023-10-09T11:36:04.085450+0000","last_unstale":"2023-10-09T11:36:04.085788+0000","last_undegraded":"2023-10-09T11:36:04.085788+0000","last_fullsized":"2023-10-09T11:36:04.085788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:35.059638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082197+0000","last_change":"2023-10-09T11:36:03.069288+0000","last_active":"2023-10-09T11:36:04.082197+0000","last_peered":"2023-10-09T11:36:04.082197+0000","last_clean":"2023-10-09T11:36:04.082197+0000","last_became_active":"2023-10-09T11:36:03.069047+0000","last_became_peered":"2023-10-09T11:36:03.069047+0000","last_unstale":"2023-10-09T11:36:04.082197+0000","last_undegraded":"2023-10-09T11:36:04.082197+0000","last_fullsized":"2023-10-09T11:36:04.082197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:11.092536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085055+0000","last_change":"2023-10-09T11:36:04.085019+0000","last_active":"2023-10-09T11:36:04.085055+0000","last_peered":"2023-10-09T11:36:04.085055+0000","last_clean":"2023-10-09T11:36:04.085055+0000","last_became_active":"2023-10-09T11:36:04.084628+0000","last_became_peered":"2023-10-09T11:36:04.084628+0000","last_unstale":"2023-10-09T11:36:04.085055+0000","last_undegraded":"2023-10-09T11:36:04.085055+0000","last_fullsized":"2023-10-09T11:36:04.085055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066123+0000","last_change":"2023-10-09T11:36:03.070071+0000","last_active":"2023-10-09T11:36:04.066123+0000","last_peered":"2023-10-09T11:36:04.066123+0000","last_clean":"2023-10-09T11:36:04.066123+0000","last_became_active":"2023-10-09T11:36:03.069836+0000","last_became_peered":"2023-10-09T11:36:03.069836+0000","last_unstale":"2023-10-09T11:36:04.066123+0000","last_undegraded":"2023-10-09T11:36:04.066123+0000","last_fullsized":"2023-10-09T11:36:04.066123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072927+0000","last_change":"2023-10-09T11:36:04.072862+0000","last_active":"2023-10-09T11:36:04.072927+0000","last_peered":"2023-10-09T11:36:04.072927+0000","last_clean":"2023-10-09T11:36:04.072927+0000","last_became_active":"2023-10-09T11:36:04.072643+0000","last_became_peered":"2023-10-09T11:36:04.072643+0000","last_unstale":"2023-10-09T11:36:04.072927+0000","last_undegraded":"2023-10-09T11:36:04.072927+0000","last_fullsized":"2023-10-09T11:36:04.072927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068216+0000","last_change":"2023-10-09T11:36:03.074702+0000","last_active":"2023-10-09T11:36:04.068216+0000","last_peered":"2023-10-09T11:36:04.068216+0000","last_clean":"2023-10-09T11:36:04.068216+0000","last_became_active":"2023-10-09T11:36:03.073918+0000","last_became_peered":"2023-10-09T11:36:03.073918+0000","last_unstale":"2023-10-09T11:36:04.068216+0000","last_undegraded":"2023-10-09T11:36:04.068216+0000","last_fullsized":"2023-10-09T11:36:04.068216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073388+0000","last_change":"2023-10-09T11:36:04.072942+0000","last_active":"2023-10-09T11:36:04.073388+0000","last_peered":"2023-10-09T11:36:04.073388+0000","last_clean":"2023-10-09T11:36:04.073388+0000","last_became_active":"2023-10-09T11:36:04.072713+0000","last_became_peered":"2023-10-09T11:36:04.072713+0000","last_unstale":"2023-10-09T11:36:04.073388+0000","last_undegraded":"2023-10-09T11:36:04.073388+0000","last_fullsized":"2023-10-09T11:36:04.073388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078402+0000","last_change":"2023-10-09T11:36:03.073149+0000","last_active":"2023-10-09T11:36:04.078402+0000","last_peered":"2023-10-09T11:36:04.078402+0000","last_clean":"2023-10-09T11:36:04.078402+0000","last_became_active":"2023-10-09T11:36:03.072894+0000","last_became_peered":"2023-10-09T11:36:03.072894+0000","last_unstale":"2023-10-09T11:36:04.078402+0000","last_undegraded":"2023-10-09T11:36:04.078402+0000","last_fullsized":"2023-10-09T11:36:04.078402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.078935+0000","last_change":"2023-10-09T11:36:04.077455+0000","last_active":"2023-10-09T11:36:04.078935+0000","last_peered":"2023-10-09T11:36:04.078935+0000","last_clean":"2023-10-09T11:36:04.078935+0000","last_became_active":"2023-10-09T11:36:04.075697+0000","last_became_peered":"2023-10-09T11:36:04.075697+0000","last_unstale":"2023-10-09T11:36:04.078935+0000","last_undegraded":"2023-10-09T11:36:04.078935+0000","last_fullsized":"2023-10-09T11:36:04.078935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.082726+0000","last_change":"2023-10-09T11:36:03.064500+0000","last_active":"2023-10-09T11:36:04.082726+0000","last_peered":"2023-10-09T11:36:04.082726+0000","last_clean":"2023-10-09T11:36:04.082726+0000","last_became_active":"2023-10-09T11:36:03.064131+0000","last_became_peered":"2023-10-09T11:36:03.064131+0000","last_unstale":"2023-10-09T11:36:04.082726+0000","last_undegraded":"2023-10-09T11:36:04.082726+0000","last_fullsized":"2023-10-09T11:36:04.082726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:32:49.563205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073739+0000","last_change":"2023-10-09T11:36:04.073672+0000","last_active":"2023-10-09T11:36:04.073739+0000","last_peered":"2023-10-09T11:36:04.073739+0000","last_clean":"2023-10-09T11:36:04.073739+0000","last_became_active":"2023-10-09T11:36:04.073078+0000","last_became_peered":"2023-10-09T11:36:04.073078+0000","last_unstale":"2023-10-09T11:36:04.073739+0000","last_undegraded":"2023-10-09T11:36:04.073739+0000","last_fullsized":"2023-10-09T11:36:04.073739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068917+0000","last_change":"2023-10-09T11:36:03.074056+0000","last_active":"2023-10-09T11:36:04.068917+0000","last_peered":"2023-10-09T11:36:04.068917+0000","last_clean":"2023-10-09T11:36:04.068917+0000","last_became_active":"2023-10-09T11:36:03.073815+0000","last_became_peered":"2023-10-09T11:36:03.073815+0000","last_unstale":"2023-10-09T11:36:04.068917+0000","last_undegraded":"2023-10-09T11:36:04.068917+0000","last_fullsized":"2023-10-09T11:36:04.068917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:45.235692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081559+0000","last_change":"2023-10-09T11:36:04.081376+0000","last_active":"2023-10-09T11:36:04.081559+0000","last_peered":"2023-10-09T11:36:04.081559+0000","last_clean":"2023-10-09T11:36:04.081559+0000","last_became_active":"2023-10-09T11:36:04.080714+0000","last_became_peered":"2023-10-09T11:36:04.080714+0000","last_unstale":"2023-10-09T11:36:04.081559+0000","last_undegraded":"2023-10-09T11:36:04.081559+0000","last_fullsized":"2023-10-09T11:36:04.081559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066307+0000","last_change":"2023-10-09T11:36:03.070650+0000","last_active":"2023-10-09T11:36:04.066307+0000","last_peered":"2023-10-09T11:36:04.066307+0000","last_clean":"2023-10-09T11:36:04.066307+0000","last_became_active":"2023-10-09T11:36:03.069968+0000","last_became_peered":"2023-10-09T11:36:03.069968+0000","last_unstale":"2023-10-09T11:36:04.066307+0000","last_undegraded":"2023-10-09T11:36:04.066307+0000","last_fullsized":"2023-10-09T11:36:04.066307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:39.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069101+0000","last_change":"2023-10-09T11:36:04.068591+0000","last_active":"2023-10-09T11:36:04.069101+0000","last_peered":"2023-10-09T11:36:04.069101+0000","last_clean":"2023-10-09T11:36:04.069101+0000","last_became_active":"2023-10-09T11:36:04.068323+0000","last_became_peered":"2023-10-09T11:36:04.068323+0000","last_unstale":"2023-10-09T11:36:04.069101+0000","last_undegraded":"2023-10-09T11:36:04.069101+0000","last_fullsized":"2023-10-09T11:36:04.069101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:40.848886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077971+0000","last_change":"2023-10-09T11:36:04.077889+0000","last_active":"2023-10-09T11:36:04.077971+0000","last_peered":"2023-10-09T11:36:04.077971+0000","last_clean":"2023-10-09T11:36:04.077971+0000","last_became_active":"2023-10-09T11:36:04.077682+0000","last_became_peered":"2023-10-09T11:36:04.077682+0000","last_unstale":"2023-10-09T11:36:04.077971+0000","last_undegraded":"2023-10-09T11:36:04.077971+0000","last_fullsized":"2023-10-09T11:36:04.077971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066047+0000","last_change":"2023-10-09T11:36:03.068267+0000","last_active":"2023-10-09T11:36:04.066047+0000","last_peered":"2023-10-09T11:36:04.066047+0000","last_clean":"2023-10-09T11:36:04.066047+0000","last_became_active":"2023-10-09T11:36:03.068021+0000","last_became_peered":"2023-10-09T11:36:03.068021+0000","last_unstale":"2023-10-09T11:36:04.066047+0000","last_undegraded":"2023-10-09T11:36:04.066047+0000","last_fullsized":"2023-10-09T11:36:04.066047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081391+0000","last_change":"2023-10-09T11:36:04.080698+0000","last_active":"2023-10-09T11:36:04.081391+0000","last_peered":"2023-10-09T11:36:04.081391+0000","last_clean":"2023-10-09T11:36:04.081391+0000","last_became_active":"2023-10-09T11:36:04.080102+0000","last_became_peered":"2023-10-09T11:36:04.080102+0000","last_unstale":"2023-10-09T11:36:04.081391+0000","last_undegraded":"2023-10-09T11:36:04.081391+0000","last_fullsized":"2023-10-09T11:36:04.081391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:40.738243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.066308+0000","last_change":"2023-10-09T11:36:03.063629+0000","last_active":"2023-10-09T11:36:04.066308+0000","last_peered":"2023-10-09T11:36:04.066308+0000","last_clean":"2023-10-09T11:36:04.066308+0000","last_became_active":"2023-10-09T11:36:03.063361+0000","last_became_peered":"2023-10-09T11:36:03.063361+0000","last_unstale":"2023-10-09T11:36:04.066308+0000","last_undegraded":"2023-10-09T11:36:04.066308+0000","last_fullsized":"2023-10-09T11:36:04.066308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067759+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:04.067759+0000","last_peered":"2023-10-09T11:36:04.067759+0000","last_clean":"2023-10-09T11:36:04.067759+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:04.067759+0000","last_undegraded":"2023-10-09T11:36:04.067759+0000","last_fullsized":"2023-10-09T11:36:04.067759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067809+0000","last_change":"2023-10-09T11:36:04.067741+0000","last_active":"2023-10-09T11:36:04.067809+0000","last_peered":"2023-10-09T11:36:04.067809+0000","last_clean":"2023-10-09T11:36:04.067809+0000","last_became_active":"2023-10-09T11:36:04.067100+0000","last_became_peered":"2023-10-09T11:36:04.067100+0000","last_unstale":"2023-10-09T11:36:04.067809+0000","last_undegraded":"2023-10-09T11:36:04.067809+0000","last_fullsized":"2023-10-09T11:36:04.067809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:04.425048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.072868+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.072401+0000","last_became_peered":"2023-10-09T11:36:03.072401+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:53.953324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067883+0000","last_change":"2023-10-09T11:36:03.073553+0000","last_active":"2023-10-09T11:36:04.067883+0000","last_peered":"2023-10-09T11:36:04.067883+0000","last_clean":"2023-10-09T11:36:04.067883+0000","last_became_active":"2023-10-09T11:36:03.073080+0000","last_became_peered":"2023-10-09T11:36:03.073080+0000","last_unstale":"2023-10-09T11:36:04.067883+0000","last_undegraded":"2023-10-09T11:36:04.067883+0000","last_fullsized":"2023-10-09T11:36:04.067883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:05.074560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075638+0000","last_change":"2023-10-09T11:36:04.075567+0000","last_active":"2023-10-09T11:36:04.075638+0000","last_peered":"2023-10-09T11:36:04.075638+0000","last_clean":"2023-10-09T11:36:04.075638+0000","last_became_active":"2023-10-09T11:36:04.075313+0000","last_became_peered":"2023-10-09T11:36:04.075313+0000","last_unstale":"2023-10-09T11:36:04.075638+0000","last_undegraded":"2023-10-09T11:36:04.075638+0000","last_fullsized":"2023-10-09T11:36:04.075638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T11:36:05.064162+0000","last_change":"2023-10-09T11:36:03.075260+0000","last_active":"2023-10-09T11:36:05.064162+0000","last_peered":"2023-10-09T11:36:05.064162+0000","last_clean":"2023-10-09T11:36:05.064162+0000","last_became_active":"2023-10-09T11:36:03.075068+0000","last_became_peered":"2023-10-09T11:36:03.075068+0000","last_unstale":"2023-10-09T11:36:05.064162+0000","last_undegraded":"2023-10-09T11:36:05.064162+0000","last_fullsized":"2023-10-09T11:36:05.064162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:15:56.927096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081604+0000","last_change":"2023-10-09T11:36:04.081186+0000","last_active":"2023-10-09T11:36:04.081604+0000","last_peered":"2023-10-09T11:36:04.081604+0000","last_clean":"2023-10-09T11:36:04.081604+0000","last_became_active":"2023-10-09T11:36:04.080933+0000","last_became_peered":"2023-10-09T11:36:04.080933+0000","last_unstale":"2023-10-09T11:36:04.081604+0000","last_undegraded":"2023-10-09T11:36:04.081604+0000","last_fullsized":"2023-10-09T11:36:04.081604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:39:07.685027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.079780+0000","last_change":"2023-10-09T11:36:03.074849+0000","last_active":"2023-10-09T11:36:04.079780+0000","last_peered":"2023-10-09T11:36:04.079780+0000","last_clean":"2023-10-09T11:36:04.079780+0000","last_became_active":"2023-10-09T11:36:03.074186+0000","last_became_peered":"2023-10-09T11:36:03.074186+0000","last_unstale":"2023-10-09T11:36:04.079780+0000","last_undegraded":"2023-10-09T11:36:04.079780+0000","last_fullsized":"2023-10-09T11:36:04.079780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072912+0000","last_change":"2023-10-09T11:36:04.072805+0000","last_active":"2023-10-09T11:36:04.072912+0000","last_peered":"2023-10-09T11:36:04.072912+0000","last_clean":"2023-10-09T11:36:04.072912+0000","last_became_active":"2023-10-09T11:36:04.072588+0000","last_became_peered":"2023-10-09T11:36:04.072588+0000","last_unstale":"2023-10-09T11:36:04.072912+0000","last_undegraded":"2023-10-09T11:36:04.072912+0000","last_fullsized":"2023-10-09T11:36:04.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.067399+0000","last_change":"2023-10-09T11:36:03.070871+0000","last_active":"2023-10-09T11:36:04.067399+0000","last_peered":"2023-10-09T11:36:04.067399+0000","last_clean":"2023-10-09T11:36:04.067399+0000","last_became_active":"2023-10-09T11:36:03.070626+0000","last_became_peered":"2023-10-09T11:36:03.070626+0000","last_unstale":"2023-10-09T11:36:04.067399+0000","last_undegraded":"2023-10-09T11:36:04.067399+0000","last_fullsized":"2023-10-09T11:36:04.067399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:54.311526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071718+0000","last_change":"2023-10-09T11:36:04.071396+0000","last_active":"2023-10-09T11:36:04.071718+0000","last_peered":"2023-10-09T11:36:04.071718+0000","last_clean":"2023-10-09T11:36:04.071718+0000","last_became_active":"2023-10-09T11:36:04.071015+0000","last_became_peered":"2023-10-09T11:36:04.071015+0000","last_unstale":"2023-10-09T11:36:04.071718+0000","last_undegraded":"2023-10-09T11:36:04.071718+0000","last_fullsized":"2023-10-09T11:36:04.071718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:21.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.069006+0000","last_change":"2023-10-09T11:36:03.068307+0000","last_active":"2023-10-09T11:36:04.069006+0000","last_peered":"2023-10-09T11:36:04.069006+0000","last_clean":"2023-10-09T11:36:04.069006+0000","last_became_active":"2023-10-09T11:36:03.068052+0000","last_became_peered":"2023-10-09T11:36:03.068052+0000","last_unstale":"2023-10-09T11:36:04.069006+0000","last_undegraded":"2023-10-09T11:36:04.069006+0000","last_fullsized":"2023-10-09T11:36:04.069006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081346+0000","last_change":"2023-10-09T11:36:04.079699+0000","last_active":"2023-10-09T11:36:04.081346+0000","last_peered":"2023-10-09T11:36:04.081346+0000","last_clean":"2023-10-09T11:36:04.081346+0000","last_became_active":"2023-10-09T11:36:04.079452+0000","last_became_peered":"2023-10-09T11:36:04.079452+0000","last_unstale":"2023-10-09T11:36:04.081346+0000","last_undegraded":"2023-10-09T11:36:04.081346+0000","last_fullsized":"2023-10-09T11:36:04.081346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:55.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.068665+0000","last_change":"2023-10-09T11:36:03.073134+0000","last_active":"2023-10-09T11:36:04.068665+0000","last_peered":"2023-10-09T11:36:04.068665+0000","last_clean":"2023-10-09T11:36:04.068665+0000","last_became_active":"2023-10-09T11:36:03.070854+0000","last_became_peered":"2023-10-09T11:36:03.070854+0000","last_unstale":"2023-10-09T11:36:04.068665+0000","last_undegraded":"2023-10-09T11:36:04.068665+0000","last_fullsized":"2023-10-09T11:36:04.068665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:07.424392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087047+0000","last_change":"2023-10-09T11:36:04.086892+0000","last_active":"2023-10-09T11:36:04.087047+0000","last_peered":"2023-10-09T11:36:04.087047+0000","last_clean":"2023-10-09T11:36:04.087047+0000","last_became_active":"2023-10-09T11:36:04.086144+0000","last_became_peered":"2023-10-09T11:36:04.086144+0000","last_unstale":"2023-10-09T11:36:04.087047+0000","last_undegraded":"2023-10-09T11:36:04.087047+0000","last_fullsized":"2023-10-09T11:36:04.087047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:56:47.944395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080644+0000","last_change":"2023-10-09T11:36:03.068964+0000","last_active":"2023-10-09T11:36:04.080644+0000","last_peered":"2023-10-09T11:36:04.080644+0000","last_clean":"2023-10-09T11:36:04.080644+0000","last_became_active":"2023-10-09T11:36:03.068750+0000","last_became_peered":"2023-10-09T11:36:03.068750+0000","last_unstale":"2023-10-09T11:36:04.080644+0000","last_undegraded":"2023-10-09T11:36:04.080644+0000","last_fullsized":"2023-10-09T11:36:04.080644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.075657+0000","last_change":"2023-10-09T11:36:04.074171+0000","last_active":"2023-10-09T11:36:04.075657+0000","last_peered":"2023-10-09T11:36:04.075657+0000","last_clean":"2023-10-09T11:36:04.075657+0000","last_became_active":"2023-10-09T11:36:04.073930+0000","last_became_peered":"2023-10-09T11:36:04.073930+0000","last_unstale":"2023-10-09T11:36:04.075657+0000","last_undegraded":"2023-10-09T11:36:04.075657+0000","last_fullsized":"2023-10-09T11:36:04.075657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.065534+0000","last_change":"2023-10-09T11:36:03.069521+0000","last_active":"2023-10-09T11:36:04.065534+0000","last_peered":"2023-10-09T11:36:04.065534+0000","last_clean":"2023-10-09T11:36:04.065534+0000","last_became_active":"2023-10-09T11:36:03.069279+0000","last_became_peered":"2023-10-09T11:36:03.069279+0000","last_unstale":"2023-10-09T11:36:04.065534+0000","last_undegraded":"2023-10-09T11:36:04.065534+0000","last_fullsized":"2023-10-09T11:36:04.065534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:03.730449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074310+0000","last_change":"2023-10-09T11:36:04.074247+0000","last_active":"2023-10-09T11:36:04.074310+0000","last_peered":"2023-10-09T11:36:04.074310+0000","last_clean":"2023-10-09T11:36:04.074310+0000","last_became_active":"2023-10-09T11:36:04.074025+0000","last_became_peered":"2023-10-09T11:36:04.074025+0000","last_unstale":"2023-10-09T11:36:04.074310+0000","last_undegraded":"2023-10-09T11:36:04.074310+0000","last_fullsized":"2023-10-09T11:36:04.074310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:47.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.074519+0000","last_change":"2023-10-09T11:36:03.069505+0000","last_active":"2023-10-09T11:36:04.074519+0000","last_peered":"2023-10-09T11:36:04.074519+0000","last_clean":"2023-10-09T11:36:04.074519+0000","last_became_active":"2023-10-09T11:36:03.069240+0000","last_became_peered":"2023-10-09T11:36:03.069240+0000","last_unstale":"2023-10-09T11:36:04.074519+0000","last_undegraded":"2023-10-09T11:36:04.074519+0000","last_fullsized":"2023-10-09T11:36:04.074519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:24:20.338126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080255+0000","last_change":"2023-10-09T11:36:04.079551+0000","last_active":"2023-10-09T11:36:04.080255+0000","last_peered":"2023-10-09T11:36:04.080255+0000","last_clean":"2023-10-09T11:36:04.080255+0000","last_became_active":"2023-10-09T11:36:04.079307+0000","last_became_peered":"2023-10-09T11:36:04.079307+0000","last_unstale":"2023-10-09T11:36:04.080255+0000","last_undegraded":"2023-10-09T11:36:04.080255+0000","last_fullsized":"2023-10-09T11:36:04.080255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:16:20.521080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.083869+0000","last_change":"2023-10-09T11:36:03.066236+0000","last_active":"2023-10-09T11:36:04.083869+0000","last_peered":"2023-10-09T11:36:04.083869+0000","last_clean":"2023-10-09T11:36:04.083869+0000","last_became_active":"2023-10-09T11:36:03.065972+0000","last_became_peered":"2023-10-09T11:36:03.065972+0000","last_unstale":"2023-10-09T11:36:04.083869+0000","last_undegraded":"2023-10-09T11:36:04.083869+0000","last_fullsized":"2023-10-09T11:36:04.083869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:02.048296+0000","last_clean_scrub_stamp":"2023-10-09T11:36:02.048296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:40.335821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073623+0000","last_change":"2023-10-09T11:36:04.073410+0000","last_active":"2023-10-09T11:36:04.073623+0000","last_peered":"2023-10-09T11:36:04.073623+0000","last_clean":"2023-10-09T11:36:04.073623+0000","last_became_active":"2023-10-09T11:36:04.072808+0000","last_became_peered":"2023-10-09T11:36:04.072808+0000","last_unstale":"2023-10-09T11:36:04.073623+0000","last_undegraded":"2023-10-09T11:36:04.073623+0000","last_fullsized":"2023-10-09T11:36:04.073623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:22.124509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.072611+0000","last_change":"2023-10-09T11:36:04.072547+0000","last_active":"2023-10-09T11:36:04.072611+0000","last_peered":"2023-10-09T11:36:04.072611+0000","last_clean":"2023-10-09T11:36:04.072611+0000","last_became_active":"2023-10-09T11:36:04.070914+0000","last_became_peered":"2023-10-09T11:36:04.070914+0000","last_unstale":"2023-10-09T11:36:04.072611+0000","last_undegraded":"2023-10-09T11:36:04.072611+0000","last_fullsized":"2023-10-09T11:36:04.072611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.071473+0000","last_change":"2023-10-09T11:36:04.070407+0000","last_active":"2023-10-09T11:36:04.071473+0000","last_peered":"2023-10-09T11:36:04.071473+0000","last_clean":"2023-10-09T11:36:04.071473+0000","last_became_active":"2023-10-09T11:36:04.070183+0000","last_became_peered":"2023-10-09T11:36:04.070183+0000","last_unstale":"2023-10-09T11:36:04.071473+0000","last_undegraded":"2023-10-09T11:36:04.071473+0000","last_fullsized":"2023-10-09T11:36:04.071473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:54.960132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.080238+0000","last_change":"2023-10-09T11:36:04.079371+0000","last_active":"2023-10-09T11:36:04.080238+0000","last_peered":"2023-10-09T11:36:04.080238+0000","last_clean":"2023-10-09T11:36:04.080238+0000","last_became_active":"2023-10-09T11:36:04.079152+0000","last_became_peered":"2023-10-09T11:36:04.079152+0000","last_unstale":"2023-10-09T11:36:04.080238+0000","last_undegraded":"2023-10-09T11:36:04.080238+0000","last_fullsized":"2023-10-09T11:36:04.080238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:12.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081639+0000","last_change":"2023-10-09T11:36:04.081536+0000","last_active":"2023-10-09T11:36:04.081639+0000","last_peered":"2023-10-09T11:36:04.081639+0000","last_clean":"2023-10-09T11:36:04.081639+0000","last_became_active":"2023-10-09T11:36:04.081054+0000","last_became_peered":"2023-10-09T11:36:04.081054+0000","last_unstale":"2023-10-09T11:36:04.081639+0000","last_undegraded":"2023-10-09T11:36:04.081639+0000","last_fullsized":"2023-10-09T11:36:04.081639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:22.174113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087035+0000","last_change":"2023-10-09T11:36:04.086736+0000","last_active":"2023-10-09T11:36:04.087035+0000","last_peered":"2023-10-09T11:36:04.087035+0000","last_clean":"2023-10-09T11:36:04.087035+0000","last_became_active":"2023-10-09T11:36:04.085787+0000","last_became_peered":"2023-10-09T11:36:04.085787+0000","last_unstale":"2023-10-09T11:36:04.087035+0000","last_undegraded":"2023-10-09T11:36:04.087035+0000","last_fullsized":"2023-10-09T11:36:04.087035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.085923+0000","last_change":"2023-10-09T11:36:04.085863+0000","last_active":"2023-10-09T11:36:04.085923+0000","last_peered":"2023-10-09T11:36:04.085923+0000","last_clean":"2023-10-09T11:36:04.085923+0000","last_became_active":"2023-10-09T11:36:04.085616+0000","last_became_peered":"2023-10-09T11:36:04.085616+0000","last_unstale":"2023-10-09T11:36:04.085923+0000","last_undegraded":"2023-10-09T11:36:04.085923+0000","last_fullsized":"2023-10-09T11:36:04.085923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:09.490565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.077303+0000","last_change":"2023-10-09T11:36:04.077191+0000","last_active":"2023-10-09T11:36:04.077303+0000","last_peered":"2023-10-09T11:36:04.077303+0000","last_clean":"2023-10-09T11:36:04.077303+0000","last_became_active":"2023-10-09T11:36:04.074565+0000","last_became_peered":"2023-10-09T11:36:04.074565+0000","last_unstale":"2023-10-09T11:36:04.077303+0000","last_undegraded":"2023-10-09T11:36:04.077303+0000","last_fullsized":"2023-10-09T11:36:04.077303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:31:25.753076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.086970+0000","last_change":"2023-10-09T11:36:04.085672+0000","last_active":"2023-10-09T11:36:04.086970+0000","last_peered":"2023-10-09T11:36:04.086970+0000","last_clean":"2023-10-09T11:36:04.086970+0000","last_became_active":"2023-10-09T11:36:04.085373+0000","last_became_peered":"2023-10-09T11:36:04.085373+0000","last_unstale":"2023-10-09T11:36:04.086970+0000","last_undegraded":"2023-10-09T11:36:04.086970+0000","last_fullsized":"2023-10-09T11:36:04.086970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:12:31.319550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.081601+0000","last_change":"2023-10-09T11:36:04.081476+0000","last_active":"2023-10-09T11:36:04.081601+0000","last_peered":"2023-10-09T11:36:04.081601+0000","last_clean":"2023-10-09T11:36:04.081601+0000","last_became_active":"2023-10-09T11:36:04.081002+0000","last_became_peered":"2023-10-09T11:36:04.081002+0000","last_unstale":"2023-10-09T11:36:04.081601+0000","last_undegraded":"2023-10-09T11:36:04.081601+0000","last_fullsized":"2023-10-09T11:36:04.081601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:00.454459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.087021+0000","last_change":"2023-10-09T11:36:04.086449+0000","last_active":"2023-10-09T11:36:04.087021+0000","last_peered":"2023-10-09T11:36:04.087021+0000","last_clean":"2023-10-09T11:36:04.087021+0000","last_became_active":"2023-10-09T11:36:04.085477+0000","last_became_peered":"2023-10-09T11:36:04.085477+0000","last_unstale":"2023-10-09T11:36:04.087021+0000","last_undegraded":"2023-10-09T11:36:04.087021+0000","last_fullsized":"2023-10-09T11:36:04.087021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:48.596520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.076180+0000","last_change":"2023-10-09T11:36:04.075706+0000","last_active":"2023-10-09T11:36:04.076180+0000","last_peered":"2023-10-09T11:36:04.076180+0000","last_clean":"2023-10-09T11:36:04.076180+0000","last_became_active":"2023-10-09T11:36:04.075096+0000","last_became_peered":"2023-10-09T11:36:04.075096+0000","last_unstale":"2023-10-09T11:36:04.076180+0000","last_undegraded":"2023-10-09T11:36:04.076180+0000","last_fullsized":"2023-10-09T11:36:04.076180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.813094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.084996+0000","last_change":"2023-10-09T11:36:04.084941+0000","last_active":"2023-10-09T11:36:04.084996+0000","last_peered":"2023-10-09T11:36:04.084996+0000","last_clean":"2023-10-09T11:36:04.084996+0000","last_became_active":"2023-10-09T11:36:04.084453+0000","last_became_peered":"2023-10-09T11:36:04.084453+0000","last_unstale":"2023-10-09T11:36:04.084996+0000","last_undegraded":"2023-10-09T11:36:04.084996+0000","last_fullsized":"2023-10-09T11:36:04.084996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:18.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T11:36:04.073999+0000","last_change":"2023-10-09T11:36:04.073572+0000","last_active":"2023-10-09T11:36:04.073999+0000","last_peered":"2023-10-09T11:36:04.073999+0000","last_clean":"2023-10-09T11:36:04.073999+0000","last_became_active":"2023-10-09T11:36:04.073337+0000","last_became_peered":"2023-10-09T11:36:04.073337+0000","last_unstale":"2023-10-09T11:36:04.073999+0000","last_undegraded":"2023-10-09T11:36:04.073999+0000","last_fullsized":"2023-10-09T11:36:04.073999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:03.055104+0000","last_clean_scrub_stamp":"2023-10-09T11:36:03.055104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:27:55.806322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.298}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.46}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9370000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1509999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9790000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.952}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.782}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.4210000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1609999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5679999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:19.027 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T11:36:19.027 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T11:36:19.027 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T11:36:19.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T11:36:19.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.178+0000 7fd20629d700 1 Processor -- start 2023-10-09T11:36:19.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.178+0000 7fd20629d700 1 -- start start 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20629d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd20015b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20629d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000cfdd0 con 0x7fd20006d240 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20629d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000d00b0 con 0x7fd2001577e0 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20629d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000d0390 con 0x7fd200157bb0 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20483a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd20006d240 0x7fd20015ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44364/0 (socket says 172.21.15.6:44364) 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd20483a700 1 -- 172.21.15.6:0/3571911819 learned_addr learned my addr 172.21.15.6:0/3571911819 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1ff7fe700 1 --2- 172.21.15.6:0/3571911819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd20015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439263517 0 0) 0x7fd2000cfdd0 con 0x7fd20006d240 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec003570 con 0x7fd20006d240 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233295372 0 0) 0x7fd2000d00b0 con 0x7fd2001577e0 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2000cfdd0 con 0x7fd2001577e0 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/3571911819 >> v1:172.21.15.118:6789/0 conn(0x7fd2001577e0 legacy=0x7fd2000cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/3571911819 >> v1:172.21.15.6:6789/0 conn(0x7fd20006d240 legacy=0x7fd20015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/3571911819 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000d0670 con 0x7fd200157bb0 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.179+0000 7fd1ff7fe700 1 --2- 172.21.15.6:0/3571911819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd20015b070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009910 tx=0x7fd1f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e201f8c656ec723 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0011630 con 0x7fd200157bb0 2023-10-09T11:36:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0011790 con 0x7fd200157bb0 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd1feffd700 1 -- 172.21.15.6:0/3571911819 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0011b30 con 0x7fd200157bb0 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 -- 172.21.15.6:0/3571911819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 msgr2=0x7fd20015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 --2- 172.21.15.6:0/3571911819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd20015b070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009910 tx=0x7fd1f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 -- 172.21.15.6:0/3571911819 shutdown_connections 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 --2- 172.21.15.6:0/3571911819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd20015b070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 -- 172.21.15.6:0/3571911819 >> 172.21.15.6:0/3571911819 conn(0x7fd20006bb90 msgr2=0x7fd20006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 -- 172.21.15.6:0/3571911819 shutdown_connections 2023-10-09T11:36:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.180+0000 7fd20629d700 1 -- 172.21.15.6:0/3571911819 wait complete. 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.181+0000 7fd20629d700 1 Processor -- start 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.181+0000 7fd20629d700 1 -- start start 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20006d240 0x7fd200153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd200156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000b58a0 con 0x7fd2001577e0 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000b4f70 con 0x7fd20006d240 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20629d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000b5250 con 0x7fd200157bb0 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd1ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36610/0 (socket says 172.21.15.6:36610) 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/1151230905 learned_addr learned my addr 172.21.15.6:0/1151230905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd1fffff700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20006d240 0x7fd200153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.182+0000 7fd20483a700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd200156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 msgr2=0x7fd200156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd200156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20006d240 msgr2=0x7fd200153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20006d240 0x7fd200153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 -- 172.21.15.6:0/1151230905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0009420 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd20483a700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd200156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1ff7fe700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009f00 tx=0x7fd1f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f001f070 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0011900 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0023410 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2000b5530 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.183+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2001565d0 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.184+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000b5a50 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.184+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1f0023800 con 0x7fd2001577e0 2023-10-09T11:36:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.185+0000 7fd1f7fff700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 0x7fd1e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.185+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1f0085680 con 0x7fd2001577e0 2023-10-09T11:36:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.185+0000 7fd1fffff700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 0x7fd1e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.185+0000 7fd1fffff700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 0x7fd1e00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd200153ed0 tx=0x7fd1e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.189+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2000b5a50 con 0x7fd2001577e0 2023-10-09T11:36:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.428+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd2000b59e0 con 0x7fd2001577e0 2023-10-09T11:36:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.428+0000 7fd1f7fff700 1 -- 172.21.15.6:0/1151230905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd1f00528f0 con 0x7fd2001577e0 2023-10-09T11:36:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:19.430 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 msgr2=0x7fd1e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 0x7fd1e00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd200153ed0 tx=0x7fd1e8009040 comp rx=0 tx=0).stop 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 msgr2=0x7fd20016b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009f00 tx=0x7fd1f0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 shutdown_connections 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1e0066f30 0x7fd1e00693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd200157bb0 0x7fd200156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20006d240 0x7fd200153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 --2- 172.21.15.6:0/1151230905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2001577e0 0x7fd20016b6e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 >> 172.21.15.6:0/1151230905 conn(0x7fd20006bb90 msgr2=0x7fd20015b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 shutdown_connections 2023-10-09T11:36:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.430+0000 7fd20629d700 1 -- 172.21.15.6:0/1151230905 wait complete. 2023-10-09T11:36:19.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T11:36:19.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.561+0000 7f9246b8c700 1 Processor -- start 2023-10-09T11:36:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.561+0000 7f9246b8c700 1 -- start start 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f9246b8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9240157ca0 0x7f92400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f9246b8c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 0x7f924006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f9246b8c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400d07c0 con 0x7f92401578d0 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f9246b8c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924006da50 con 0x7f9240157ca0 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f9246b8c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400cfbb0 con 0x7f924006d120 2023-10-09T11:36:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f923ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9240157ca0 0x7f92400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f923ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9240157ca0 0x7f92400cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36626/0 (socket says 172.21.15.6:36626) 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.562+0000 7f923ffff700 1 -- 172.21.15.6:0/1181467148 learned_addr learned my addr 172.21.15.6:0/1181467148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9245129700 1 --2- 172.21.15.6:0/1181467148 >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 0x7f924006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923ffff700 1 -- 172.21.15.6:0/1181467148 >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 msgr2=0x7f924006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923ffff700 1 --2- 172.21.15.6:0/1181467148 >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 0x7f924006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923ffff700 1 -- 172.21.15.6:0/1181467148 >> v1:172.21.15.118:6789/0 conn(0x7f92401578d0 legacy=0x7f924015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923ffff700 1 -- 172.21.15.6:0/1181467148 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400cfe90 con 0x7f9240157ca0 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9245129700 1 --2- 172.21.15.6:0/1181467148 >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 0x7f924006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923ffff700 1 --2- 172.21.15.6:0/1181467148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240157ca0 0x7f92400cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9240068300 tx=0x7f9234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73d98e77d107929 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923f7fe700 1 -- 172.21.15.6:0/1181467148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400b820 con 0x7f9240157ca0 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923f7fe700 1 -- 172.21.15.6:0/1181467148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923400b980 con 0x7f9240157ca0 2023-10-09T11:36:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f923f7fe700 1 -- 172.21.15.6:0/1181467148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400bd20 con 0x7f9240157ca0 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 -- 172.21.15.6:0/1181467148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240157ca0 msgr2=0x7f92400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 --2- 172.21.15.6:0/1181467148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240157ca0 0x7f92400cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9240068300 tx=0x7f9234009250 comp rx=0 tx=0).stop 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 -- 172.21.15.6:0/1181467148 shutdown_connections 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 --2- 172.21.15.6:0/1181467148 >> v2:172.21.15.118:3300/0 conn(0x7f924006d120 0x7f924006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 --2- 172.21.15.6:0/1181467148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9240157ca0 0x7f92400cf4f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.563+0000 7f9246b8c700 1 -- 172.21.15.6:0/1181467148 >> 172.21.15.6:0/1181467148 conn(0x7f924006bb90 msgr2=0x7f924006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.564+0000 7f9246b8c700 1 -- 172.21.15.6:0/1181467148 shutdown_connections 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.564+0000 7f9246b8c700 1 -- 172.21.15.6:0/1181467148 wait complete. 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 Processor -- start 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 -- start start 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924006d120 0x7f924016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9240157ca0 0x7f92401537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924016a9d0 con 0x7f92401578d0 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.565+0000 7f9246b8c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ab2f0 con 0x7f924006d120 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f9246b8c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400ab5d0 con 0x7f9240157ca0 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36632/0 (socket says 172.21.15.6:36632) 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 -- 172.21.15.6:0/3255963954 learned_addr learned my addr 172.21.15.6:0/3255963954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f9244928700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924006d120 0x7f924016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f9245129700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9240157ca0 0x7f92401537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 -- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9240157ca0 msgr2=0x7f92401537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9240157ca0 0x7f92401537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 -- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924006d120 msgr2=0x7f924016a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924006d120 0x7f924016a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 -- 172.21.15.6:0/3255963954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92340094f0 con 0x7f92401578d0 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923ffff700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92340030c0 tx=0x7f9234016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234011db0 con 0x7f92401578d0 2023-10-09T11:36:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234020070 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924016c180 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923401b6a0 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.566+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924016bae0 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.567+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924016bfe0 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.568+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9234022030 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.568+0000 7f923cff9700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 0x7f922c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.568+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9234086410 con 0x7f92401578d0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.568+0000 7f9244928700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 0x7f922c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.568+0000 7f9244928700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 0x7f922c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9238007fd0 tx=0x7f92380026a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.572+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f924016bfe0 con 0x7f92401578d0 2023-10-09T11:36:19.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.768+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924016bfe0 con 0x7f92401578d0 2023-10-09T11:36:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.768+0000 7f923cff9700 1 -- 172.21.15.6:0/3255963954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f924016bfe0 con 0x7f92401578d0 2023-10-09T11:36:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:19.770 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 msgr2=0x7f922c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 0x7f922c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9238007fd0 tx=0x7f92380026a0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 msgr2=0x7f924016b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92340030c0 tx=0x7f9234016000 comp rx=0 tx=0).stop 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 shutdown_connections 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f922c066f30 0x7f922c0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9240157ca0 0x7f92401537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f924006d120 0x7f924016a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 --2- 172.21.15.6:0/3255963954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92401578d0 0x7f924016b5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.770+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 >> 172.21.15.6:0/3255963954 conn(0x7f924006bb90 msgr2=0x7f924015e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.771+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 shutdown_connections 2023-10-09T11:36:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.771+0000 7f9246b8c700 1 -- 172.21.15.6:0/3255963954 wait complete. 2023-10-09T11:36:19.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:19.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.905+0000 7f9a66dfe700 1 Processor -- start 2023-10-09T11:36:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.905+0000 7f9a66dfe700 1 -- start start 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a66dfe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9a6015a2a0 0x7f9a600b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a66dfe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a600ceb30 0x7f9a600cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a66dfe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a600b0ca0 con 0x7f9a6006d650 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a66dfe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6006e160 con 0x7f9a600ceb30 2023-10-09T11:36:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a66dfe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6006ea90 con 0x7f9a6015a2a0 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.906+0000 7f9a5ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a600ceb30 0x7f9a600cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a600ceb30 0x7f9a600cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36636/0 (socket says 172.21.15.6:36636) 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 -- 172.21.15.6:0/543430350 learned_addr learned my addr 172.21.15.6:0/543430350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a64b9a700 1 --2- 172.21.15.6:0/543430350 >> v2:172.21.15.118:3300/0 conn(0x7f9a6015a2a0 0x7f9a600b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 -- 172.21.15.6:0/543430350 >> v2:172.21.15.118:3300/0 conn(0x7f9a6015a2a0 msgr2=0x7f9a600b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 --2- 172.21.15.6:0/543430350 >> v2:172.21.15.118:3300/0 conn(0x7f9a6015a2a0 0x7f9a600b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 -- 172.21.15.6:0/543430350 >> v1:172.21.15.118:6789/0 conn(0x7f9a6006d650 legacy=0x7f9a6006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 -- 172.21.15.6:0/543430350 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600b00d0 con 0x7f9a600ceb30 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5ffff700 1 --2- 172.21.15.6:0/543430350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a600ceb30 0x7f9a600cefb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a600637a0 tx=0x7f9a50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5638098f19184f5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5f7fe700 1 -- 172.21.15.6:0/543430350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000e070 con 0x7f9a600ceb30 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5f7fe700 1 -- 172.21.15.6:0/543430350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000ba20 con 0x7f9a600ceb30 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.907+0000 7f9a5f7fe700 1 -- 172.21.15.6:0/543430350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500092e0 con 0x7f9a600ceb30 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 -- 172.21.15.6:0/543430350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a600ceb30 msgr2=0x7f9a600cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/543430350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a600ceb30 0x7f9a600cefb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a600637a0 tx=0x7f9a50009840 comp rx=0 tx=0).stop 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 -- 172.21.15.6:0/543430350 shutdown_connections 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/543430350 >> v2:172.21.15.118:3300/0 conn(0x7f9a6015a2a0 0x7f9a600b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/543430350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a600ceb30 0x7f9a600cefb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 -- 172.21.15.6:0/543430350 >> 172.21.15.6:0/543430350 conn(0x7f9a60067640 msgr2=0x7f9a60067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 -- 172.21.15.6:0/543430350 shutdown_connections 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.908+0000 7f9a66dfe700 1 -- 172.21.15.6:0/543430350 wait complete. 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.909+0000 7f9a66dfe700 1 Processor -- start 2023-10-09T11:36:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.909+0000 7f9a66dfe700 1 -- start start 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a600ceb30 0x7f9a6015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a6015a2a0 0x7f9a6015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60155390 con 0x7f9a6006d650 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6015cf40 con 0x7f9a600ceb30 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6015c910 con 0x7f9a6015a2a0 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36648/0 (socket says 172.21.15.6:36648) 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 -- 172.21.15.6:0/1936733420 learned_addr learned my addr 172.21.15.6:0/1936733420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a5ffff700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a600ceb30 0x7f9a6015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a6539b700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a6015a2a0 0x7f9a6015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 -- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a6015a2a0 msgr2=0x7f9a6015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a6015a2a0 0x7f9a6015f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 -- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a600ceb30 msgr2=0x7f9a6015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a600ceb30 0x7f9a6015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 -- 172.21.15.6:0/1936733420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009ae0 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a64b9a700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800e930 tx=0x7f9a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58013680 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a580137e0 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58013b80 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.910+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a600b31a0 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.911+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6015cbd0 con 0x7f9a6006d650 2023-10-09T11:36:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.911+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a60069e40 con 0x7f9a6006d650 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.912+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a5800c3e0 con 0x7f9a6006d650 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.912+0000 7f9a5cff9700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 0x7f9a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.912+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a58084620 con 0x7f9a6006d650 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.912+0000 7f9a5ffff700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 0x7f9a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.913+0000 7f9a5ffff700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 0x7f9a400693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009880 tx=0x7f9a50018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:19.916+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a58051890 con 0x7f9a6006d650 2023-10-09T11:36:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.111+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a6004bb80 con 0x7f9a6006d650 2023-10-09T11:36:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.111+0000 7f9a5cff9700 1 -- 172.21.15.6:0/1936733420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a58054eb0 con 0x7f9a6006d650 2023-10-09T11:36:20.113 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 msgr2=0x7f9a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 0x7f9a400693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009880 tx=0x7f9a50018000 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 msgr2=0x7f9a60148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800e930 tx=0x7f9a580091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 shutdown_connections 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a40066f30 0x7f9a400693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a6015a2a0 0x7f9a6015f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6006d650 0x7f9a60148870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 --2- 172.21.15.6:0/1936733420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a600ceb30 0x7f9a6015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 >> 172.21.15.6:0/1936733420 conn(0x7f9a60067640 msgr2=0x7f9a60156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 shutdown_connections 2023-10-09T11:36:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.113+0000 7f9a66dfe700 1 -- 172.21.15.6:0/1936733420 wait complete. 2023-10-09T11:36:20.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.246+0000 7fe2982c3700 1 Processor -- start 2023-10-09T11:36:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.247+0000 7fe2982c3700 1 -- start start 2023-10-09T11:36:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe2982c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2901578d0 0x7fe2900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe2982c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe29006d120 0x7fe29006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe2982c3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900d07c0 con 0x7fe290157ca0 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe2982c3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29006da50 con 0x7fe29006d120 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe2982c3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900cfbb0 con 0x7fe2901578d0 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe29006d120 0x7fe29006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe29006d120 0x7fe29006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36652/0 (socket says 172.21.15.6:36652) 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 -- 172.21.15.6:0/431420542 learned_addr learned my addr 172.21.15.6:0/431420542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe29605f700 1 --2- 172.21.15.6:0/431420542 >> v2:172.21.15.118:3300/0 conn(0x7fe2901578d0 0x7fe2900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 -- 172.21.15.6:0/431420542 >> v2:172.21.15.118:3300/0 conn(0x7fe2901578d0 msgr2=0x7fe2900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 --2- 172.21.15.6:0/431420542 >> v2:172.21.15.118:3300/0 conn(0x7fe2901578d0 0x7fe2900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 -- 172.21.15.6:0/431420542 >> v1:172.21.15.118:6789/0 conn(0x7fe290157ca0 legacy=0x7fe29015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 -- 172.21.15.6:0/431420542 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900cfe90 con 0x7fe29006d120 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe296860700 1 --2- 172.21.15.6:0/431420542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe29006d510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2900646b0 tx=0x7fe288009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363dca1e4c4ac341 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe29505d700 1 -- 172.21.15.6:0/431420542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800e070 con 0x7fe29006d120 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe29505d700 1 -- 172.21.15.6:0/431420542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800ba10 con 0x7fe29006d120 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.248+0000 7fe29505d700 1 -- 172.21.15.6:0/431420542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880092e0 con 0x7fe29006d120 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 -- 172.21.15.6:0/431420542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 msgr2=0x7fe29006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 --2- 172.21.15.6:0/431420542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe29006d510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2900646b0 tx=0x7fe288009840 comp rx=0 tx=0).stop 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 -- 172.21.15.6:0/431420542 shutdown_connections 2023-10-09T11:36:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 --2- 172.21.15.6:0/431420542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe29006d510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 --2- 172.21.15.6:0/431420542 >> v2:172.21.15.118:3300/0 conn(0x7fe2901578d0 0x7fe2900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 -- 172.21.15.6:0/431420542 >> 172.21.15.6:0/431420542 conn(0x7fe29006bb90 msgr2=0x7fe29006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 -- 172.21.15.6:0/431420542 shutdown_connections 2023-10-09T11:36:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.249+0000 7fe2982c3700 1 -- 172.21.15.6:0/431420542 wait complete. 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.250+0000 7fe2982c3700 1 Processor -- start 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.250+0000 7fe2982c3700 1 -- start start 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2901578d0 0x7fe29016a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 0x7fe2900c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2901550c0 con 0x7fe29006d120 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c6200 con 0x7fe290157ca0 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe2982c3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c8350 con 0x7fe2901578d0 2023-10-09T11:36:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36656/0 (socket says 172.21.15.6:36656) 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 -- 172.21.15.6:0/2278461584 learned_addr learned my addr 172.21.15.6:0/2278461584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe296860700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 0x7fe2900c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29585e700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2901578d0 0x7fe29016a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 -- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2901578d0 msgr2=0x7fe29016a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2901578d0 0x7fe29016a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 -- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 msgr2=0x7fe2900c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 0x7fe2900c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 -- 172.21.15.6:0/2278461584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009ae0 con 0x7fe29006d120 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe296860700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 0x7fe2900c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.251+0000 7fe29605f700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00d890 tx=0x7fe28c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.252+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00b600 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.252+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00b760 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.252+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900c8630 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.252+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00bae0 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.252+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900c5e90 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.253+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900c64e0 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.253+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe28c01e460 con 0x7fe29006d120 2023-10-09T11:36:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.253+0000 7fe2867fc700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.253+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe28c084bf0 con 0x7fe29006d120 2023-10-09T11:36:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.253+0000 7fe29585e700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.254+0000 7fe29585e700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 0x7fe2740693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe280006fd0 tx=0x7fe280008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.257+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe28c051e60 con 0x7fe29006d120 2023-10-09T11:36:20.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.449+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2900d0170 con 0x7fe29006d120 2023-10-09T11:36:20.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.449+0000 7fe2867fc700 1 -- 172.21.15.6:0/2278461584 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe28c055480 con 0x7fe29006d120 2023-10-09T11:36:20.451 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:20.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 msgr2=0x7fe2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 0x7fe2740693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe280006fd0 tx=0x7fe280008040 comp rx=0 tx=0).stop 2023-10-09T11:36:20.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 msgr2=0x7fe290154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00d890 tx=0x7fe28c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 shutdown_connections 2023-10-09T11:36:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe290157ca0 0x7fe2900c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe29006d120 0x7fe290154b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 --2- 172.21.15.6:0/2278461584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2901578d0 0x7fe29016a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 >> 172.21.15.6:0/2278461584 conn(0x7fe29006bb90 msgr2=0x7fe290156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 shutdown_connections 2023-10-09T11:36:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.451+0000 7fe2982c3700 1 -- 172.21.15.6:0/2278461584 wait complete. 2023-10-09T11:36:20.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.584+0000 7f2506ffe700 1 Processor -- start 2023-10-09T11:36:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.584+0000 7f2506ffe700 1 -- start start 2023-10-09T11:36:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2506ffe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25001578d0 0x7f25000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2506ffe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f250006d120 0x7f250006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2506ffe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000d07c0 con 0x7f2500157ca0 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2506ffe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250006da50 con 0x7f250006d120 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2506ffe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000cfbb0 con 0x7f25001578d0 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f250559b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f250006d120 0x7f250006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f24fffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2500157ca0 0x7f250015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44366/0 (socket says 172.21.15.6:44366) 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f24fffff700 1 -- 172.21.15.6:0/354136362 learned_addr learned my addr 172.21.15.6:0/354136362 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.585+0000 7f2504d9a700 1 --2- 172.21.15.6:0/354136362 >> v2:172.21.15.118:3300/0 conn(0x7f25001578d0 0x7f25000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f250559b700 1 -- 172.21.15.6:0/354136362 >> v2:172.21.15.118:3300/0 conn(0x7f25001578d0 msgr2=0x7f25000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f250559b700 1 --2- 172.21.15.6:0/354136362 >> v2:172.21.15.118:3300/0 conn(0x7f25001578d0 0x7f25000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f250559b700 1 -- 172.21.15.6:0/354136362 >> v1:172.21.15.6:6789/0 conn(0x7f2500157ca0 legacy=0x7f250015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f24ff7fe700 1 -- 172.21.15.6:0/354136362 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147803970 0 0) 0x7f25000d07c0 con 0x7f2500157ca0 2023-10-09T11:36:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f250559b700 1 -- 172.21.15.6:0/354136362 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000cfe90 con 0x7f250006d120 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f250559b700 1 --2- 172.21.15.6:0/354136362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250006d120 0x7f250006d510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25000646b0 tx=0x7f24f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a63c2968d6a95e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f24ff7fe700 1 -- 172.21.15.6:0/354136362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800e070 con 0x7f250006d120 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f24ff7fe700 1 -- 172.21.15.6:0/354136362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800bc30 con 0x7f250006d120 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f24ff7fe700 1 -- 172.21.15.6:0/354136362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8012430 con 0x7f250006d120 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 -- 172.21.15.6:0/354136362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250006d120 msgr2=0x7f250006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 --2- 172.21.15.6:0/354136362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250006d120 0x7f250006d510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25000646b0 tx=0x7f24f8009780 comp rx=0 tx=0).stop 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 -- 172.21.15.6:0/354136362 shutdown_connections 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 --2- 172.21.15.6:0/354136362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f250006d120 0x7f250006d510 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 --2- 172.21.15.6:0/354136362 >> v2:172.21.15.118:3300/0 conn(0x7f25001578d0 0x7f25000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.586+0000 7f2506ffe700 1 -- 172.21.15.6:0/354136362 >> 172.21.15.6:0/354136362 conn(0x7f250006bb90 msgr2=0x7f250006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.587+0000 7f2506ffe700 1 -- 172.21.15.6:0/354136362 shutdown_connections 2023-10-09T11:36:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.587+0000 7f2506ffe700 1 -- 172.21.15.6:0/354136362 wait complete. 2023-10-09T11:36:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.588+0000 7f2506ffe700 1 Processor -- start 2023-10-09T11:36:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.588+0000 7f2506ffe700 1 -- start start 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.588+0000 7f2506ffe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f250006d120 0x7f25000c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.588+0000 7f2506ffe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.588+0000 7f2506ffe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2500157ca0 0x7f250016d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2506ffe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c6490 con 0x7f25001578d0 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2506ffe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c6770 con 0x7f2500157ca0 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2506ffe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000c6a50 con 0x7f250006d120 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36676/0 (socket says 172.21.15.6:36676) 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 -- 172.21.15.6:0/856365544 learned_addr learned my addr 172.21.15.6:0/856365544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2504d9a700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f250006d120 0x7f25000c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f250559b700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2500157ca0 0x7f250016d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 -- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f250006d120 msgr2=0x7f25000c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f250006d120 0x7f25000c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 -- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2500157ca0 msgr2=0x7f250016d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2500157ca0 0x7f250016d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 -- 172.21.15.6:0/856365544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8009a20 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fffff700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c5e0 tx=0x7f24f4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4005b30 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f4005c90 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000c6d30 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007300 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.589+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000c70c0 con 0x7f25001578d0 2023-10-09T11:36:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.590+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000c7250 con 0x7f25001578d0 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.591+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24f40076b0 con 0x7f25001578d0 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.591+0000 7f24fcff9700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.591+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f24f4083a70 con 0x7f25001578d0 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.591+0000 7f2504d9a700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.591+0000 7f2504d9a700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24f0006fd0 tx=0x7f24f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.595+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25000c7250 con 0x7f25001578d0 2023-10-09T11:36:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.788+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25000c7250 con 0x7f25001578d0 2023-10-09T11:36:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.788+0000 7f24fcff9700 1 -- 172.21.15.6:0/856365544 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25000c7250 con 0x7f25001578d0 2023-10-09T11:36:20.791 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:20.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 msgr2=0x7f24ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 0x7f24ec0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24f0006fd0 tx=0x7f24f0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 msgr2=0x7f25000c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c5e0 tx=0x7f24f4000fe0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 shutdown_connections 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f24ec066f30 0x7f24ec0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2500157ca0 0x7f250016d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f250006d120 0x7f25000c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 --2- 172.21.15.6:0/856365544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25001578d0 0x7f25000c5b20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 >> 172.21.15.6:0/856365544 conn(0x7f250006bb90 msgr2=0x7f2500156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 shutdown_connections 2023-10-09T11:36:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.791+0000 7f2506ffe700 1 -- 172.21.15.6:0/856365544 wait complete. 2023-10-09T11:36:20.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.921+0000 7f83cc729700 1 Processor -- start 2023-10-09T11:36:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.921+0000 7f83cc729700 1 -- start start 2023-10-09T11:36:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83cc729700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83c4157ca0 0x7f83c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83cc729700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c406d120 0x7f83c406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83cc729700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40d07c0 con 0x7f83c41578d0 2023-10-09T11:36:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83cc729700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c406daa0 con 0x7f83c4157ca0 2023-10-09T11:36:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83cc729700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40cfbb0 con 0x7f83c406d120 2023-10-09T11:36:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83c9cc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83c4157ca0 0x7f83c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83ca4c5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83c41578d0 0x7f83c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44370/0 (socket says 172.21.15.6:44370) 2023-10-09T11:36:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.922+0000 7f83ca4c5700 1 -- 172.21.15.6:0/546568159 learned_addr learned my addr 172.21.15.6:0/546568159 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83cacc6700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c406d120 0x7f83c406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c9cc4700 1 -- 172.21.15.6:0/546568159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c406d120 msgr2=0x7f83c406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c9cc4700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c406d120 0x7f83c406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c9cc4700 1 -- 172.21.15.6:0/546568159 >> v1:172.21.15.6:6789/0 conn(0x7f83c41578d0 legacy=0x7f83c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c9cc4700 1 -- 172.21.15.6:0/546568159 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40cfe90 con 0x7f83c4157ca0 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c94c3700 1 -- 172.21.15.6:0/546568159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532222923 0 0) 0x7f83c40d07c0 con 0x7f83c41578d0 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c9cc4700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c4157ca0 0x7f83c40cf4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098e0 tx=0x7f83b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821aaf1ec3558b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c94c3700 1 -- 172.21.15.6:0/546568159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8009e80 con 0x7f83c4157ca0 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c94c3700 1 -- 172.21.15.6:0/546568159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800b860 con 0x7f83c4157ca0 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.923+0000 7f83c94c3700 1 -- 172.21.15.6:0/546568159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800bbe0 con 0x7f83c4157ca0 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 -- 172.21.15.6:0/546568159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c4157ca0 msgr2=0x7f83c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c4157ca0 0x7f83c40cf4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098e0 tx=0x7f83b80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 -- 172.21.15.6:0/546568159 shutdown_connections 2023-10-09T11:36:20.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c406d120 0x7f83c406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 --2- 172.21.15.6:0/546568159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c4157ca0 0x7f83c40cf4f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 -- 172.21.15.6:0/546568159 >> 172.21.15.6:0/546568159 conn(0x7f83c406bb90 msgr2=0x7f83c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 -- 172.21.15.6:0/546568159 shutdown_connections 2023-10-09T11:36:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.924+0000 7f83cc729700 1 -- 172.21.15.6:0/546568159 wait complete. 2023-10-09T11:36:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.925+0000 7f83cc729700 1 Processor -- start 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.925+0000 7f83cc729700 1 -- start start 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c406d120 0x7f83c40b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4157ca0 0x7f83c41594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c416b930 con 0x7f83c41578d0 2023-10-09T11:36:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40b6710 con 0x7f83c406d120 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40b4390 con 0x7f83c4157ca0 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36690/0 (socket says 172.21.15.6:36690) 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 -- 172.21.15.6:0/2721818803 learned_addr learned my addr 172.21.15.6:0/2721818803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83ca4c5700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c406d120 0x7f83c40b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cacc6700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4157ca0 0x7f83c41594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 -- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4157ca0 msgr2=0x7f83c41594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4157ca0 0x7f83c41594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 -- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c406d120 msgr2=0x7f83c40b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c406d120 0x7f83c40b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 -- 172.21.15.6:0/2721818803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009420 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c9cc4700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83c406fe20 tx=0x7f83b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800bbe0 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8000cc0 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c416b650 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.926+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011650 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.927+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c40b4020 con 0x7f83c41578d0 2023-10-09T11:36:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.927+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c415d420 con 0x7f83c41578d0 2023-10-09T11:36:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.928+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83b8011a40 con 0x7f83c41578d0 2023-10-09T11:36:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.928+0000 7f83c27fc700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 0x7f83b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.928+0000 7f83ca4c5700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 0x7f83b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.928+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83b8085af0 con 0x7f83c41578d0 2023-10-09T11:36:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.929+0000 7f83ca4c5700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 0x7f83b0069410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83bc002250 tx=0x7f83bc001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:20.933+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83b8052d60 con 0x7f83c41578d0 2023-10-09T11:36:21.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.170+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83c40b44d0 con 0x7f83c41578d0 2023-10-09T11:36:21.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.171+0000 7f83c27fc700 1 -- 172.21.15.6:0/2721818803 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f83b8015090 con 0x7f83c41578d0 2023-10-09T11:36:21.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 msgr2=0x7f83b0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 0x7f83b0069410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83bc002250 tx=0x7f83bc001a20 comp rx=0 tx=0).stop 2023-10-09T11:36:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 msgr2=0x7f83c4153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83c406fe20 tx=0x7f83b8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 shutdown_connections 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b0066f60 0x7f83b0069410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83c4157ca0 0x7f83c41594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83c406d120 0x7f83c40b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 --2- 172.21.15.6:0/2721818803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c41578d0 0x7f83c4153630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 >> 172.21.15.6:0/2721818803 conn(0x7f83c406bb90 msgr2=0x7f83c4070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 shutdown_connections 2023-10-09T11:36:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.173+0000 7f83cc729700 1 -- 172.21.15.6:0/2721818803 wait complete. 2023-10-09T11:36:21.177 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:21.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:21.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.304+0000 7f7b78dd4700 1 Processor -- start 2023-10-09T11:36:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.304+0000 7f7b78dd4700 1 -- start start 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b78dd4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7b741578d0 0x7f7b740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b78dd4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b740d07c0 con 0x7f7b74157ca0 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b78dd4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b740cfbb0 con 0x7f7b7406d120 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b78dd4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b740cfe90 con 0x7f7b741578d0 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b71d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7b74157ca0 0x7f7b7415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44382/0 (socket says 172.21.15.6:44382) 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b71d9b700 1 -- 172.21.15.6:0/1976224902 learned_addr learned my addr 172.21.15.6:0/1976224902 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b7259c700 1 --2- 172.21.15.6:0/1976224902 >> v2:172.21.15.118:3300/0 conn(0x7f7b741578d0 0x7f7b740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594682467 0 0) 0x7f7b740d07c0 con 0x7f7b74157ca0 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.305+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b60003570 con 0x7f7b74157ca0 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833214138 0 0) 0x7f7b740cfbb0 con 0x7f7b7406d120 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b740d07c0 con 0x7f7b7406d120 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2846332202 0 0) 0x7f7b60003570 con 0x7f7b74157ca0 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 >> v2:172.21.15.118:3300/0 conn(0x7f7b741578d0 msgr2=0x7f7b740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 --2- 172.21.15.6:0/1976224902 >> v2:172.21.15.118:3300/0 conn(0x7f7b741578d0 0x7f7b740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 >> v1:172.21.15.118:6789/0 conn(0x7f7b7406d120 legacy=0x7f7b7406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b740d0170 con 0x7f7b74157ca0 2023-10-09T11:36:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f7b5c001470 con 0x7f7b74157ca0 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7259c700 1 --2- 172.21.15.6:0/1976224902 >> v2:172.21.15.118:3300/0 conn(0x7f7b741578d0 0x7f7b740cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 >> v1:172.21.15.6:6789/0 conn(0x7f7b74157ca0 legacy=0x7f7b7415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60003bf0 0x7f7b60003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b60004810 0x7f7b60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 0x7f7b6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740cfe90 con 0x7f7b600051c0 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6000c0b0 con 0x7f7b60004810 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6000c270 con 0x7f7b60003bf0 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 0x7f7b6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b71d9b700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b60004810 0x7f7b60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b7259c700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60003bf0 0x7f7b60003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 -- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60003bf0 msgr2=0x7f7b60003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60003bf0 0x7f7b60003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 -- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b60004810 msgr2=0x7f7b60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b60004810 0x7f7b60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 -- 172.21.15.6:0/1976224902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60003570 con 0x7f7b600051c0 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 -- 172.21.15.6:0/1976224902 reap_dead start 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.306+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 0x7f7b6000ba60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002120 tx=0x7f7b640017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2b1b97b395207c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400c980 con 0x7f7b600051c0 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400cae0 con 0x7f7b600051c0 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b7159a700 1 -- 172.21.15.6:0/1976224902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400ce80 con 0x7f7b600051c0 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 -- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 msgr2=0x7f7b6000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 0x7f7b6000ba60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002120 tx=0x7f7b640017a0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 -- 172.21.15.6:0/1976224902 shutdown_connections 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/1976224902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b600051c0 0x7f7b6000ba60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 -- 172.21.15.6:0/1976224902 >> 172.21.15.6:0/1976224902 conn(0x7f7b7406bb90 msgr2=0x7f7b7406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 -- 172.21.15.6:0/1976224902 shutdown_connections 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.307+0000 7f7b78dd4700 1 -- 172.21.15.6:0/1976224902 wait complete. 2023-10-09T11:36:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.308+0000 7f7b78dd4700 1 Processor -- start 2023-10-09T11:36:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.308+0000 7f7b78dd4700 1 -- start start 2023-10-09T11:36:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 0x7f7b740b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740b6660 0x7f7b7413fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740b5f70 con 0x7f7b74140400 2023-10-09T11:36:21.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74140a40 con 0x7f7b600051c0 2023-10-09T11:36:21.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b78dd4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74140d20 con 0x7f7b740b6660 2023-10-09T11:36:21.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36718/0 (socket says 172.21.15.6:36718) 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 -- 172.21.15.6:0/583956711 learned_addr learned my addr 172.21.15.6:0/583956711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b7259c700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 0x7f7b740b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 -- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740b6660 msgr2=0x7f7b7413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b71d9b700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740b6660 0x7f7b7413fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740b6660 0x7f7b7413fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 -- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 msgr2=0x7f7b740b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 0x7f7b740b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b72d9d700 1 -- 172.21.15.6:0/583956711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74141000 con 0x7f7b74140400 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.309+0000 7f7b7259c700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 0x7f7b740b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b72d9d700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b7415b610 tx=0x7f7b64015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400c980 con 0x7f7b74140400 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400c6d0 con 0x7f7b74140400 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b741412e0 con 0x7f7b74140400 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6401e400 con 0x7f7b74140400 2023-10-09T11:36:21.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.310+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7415cbb0 con 0x7f7b74140400 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.311+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b741414d0 con 0x7f7b74140400 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.311+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b64019070 con 0x7f7b74140400 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.311+0000 7f7b6a7fc700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 0x7f7b54069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.312+0000 7f7b7259c700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 0x7f7b54069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.312+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b64085550 con 0x7f7b74140400 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.312+0000 7f7b7259c700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 0x7f7b54069410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c006f00 tx=0x7f7b6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.316+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b64052720 con 0x7f7b74140400 2023-10-09T11:36:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.510+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b740d0450 con 0x7f7b74140400 2023-10-09T11:36:21.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.511+0000 7f7b6a7fc700 1 -- 172.21.15.6:0/583956711 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7b64017090 con 0x7f7b74140400 2023-10-09T11:36:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:21.513 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:21.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 msgr2=0x7f7b54069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 0x7f7b54069410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c006f00 tx=0x7f7b6c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 msgr2=0x7f7b7415c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b7415b610 tx=0x7f7b64015000 comp rx=0 tx=0).stop 2023-10-09T11:36:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 shutdown_connections 2023-10-09T11:36:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b54066f60 0x7f7b54069410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b74140400 0x7f7b7415c670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b600051c0 0x7f7b740b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 --2- 172.21.15.6:0/583956711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b740b6660 0x7f7b7413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 >> 172.21.15.6:0/583956711 conn(0x7f7b7406bb90 msgr2=0x7f7b7406d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 shutdown_connections 2023-10-09T11:36:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.513+0000 7f7b78dd4700 1 -- 172.21.15.6:0/583956711 wait complete. 2023-10-09T11:36:21.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:21.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 Processor -- start 2023-10-09T11:36:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 -- start start 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ce41578d0 0x7f5ce40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ce4157ca0 0x7f5ce415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce40d07c0 con 0x7f5ce406d120 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40cfbb0 con 0x7f5ce41578d0 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.649+0000 7f5ce8cd9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40cfe90 con 0x7f5ce4157ca0 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ce41578d0 0x7f5ce40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ce41578d0 0x7f5ce40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36720/0 (socket says 172.21.15.6:36720) 2023-10-09T11:36:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 -- 172.21.15.6:0/127721590 learned_addr learned my addr 172.21.15.6:0/127721590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce1d9b700 1 --2- 172.21.15.6:0/127721590 >> v2:172.21.15.118:3300/0 conn(0x7f5ce4157ca0 0x7f5ce415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 -- 172.21.15.6:0/127721590 >> v2:172.21.15.118:3300/0 conn(0x7f5ce4157ca0 msgr2=0x7f5ce415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 --2- 172.21.15.6:0/127721590 >> v2:172.21.15.118:3300/0 conn(0x7f5ce4157ca0 0x7f5ce415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 -- 172.21.15.6:0/127721590 >> v1:172.21.15.118:6789/0 conn(0x7f5ce406d120 legacy=0x7f5ce406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 -- 172.21.15.6:0/127721590 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40d0170 con 0x7f5ce41578d0 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce259c700 1 --2- 172.21.15.6:0/127721590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41578d0 0x7f5ce40cf4f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4068510 tx=0x7f5cd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994ef95eba721b43 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce159a700 1 -- 172.21.15.6:0/127721590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd400e070 con 0x7f5ce41578d0 2023-10-09T11:36:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce159a700 1 -- 172.21.15.6:0/127721590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd400ba20 con 0x7f5ce41578d0 2023-10-09T11:36:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.650+0000 7f5ce159a700 1 -- 172.21.15.6:0/127721590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40092e0 con 0x7f5ce41578d0 2023-10-09T11:36:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/127721590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41578d0 msgr2=0x7f5ce40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/127721590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41578d0 0x7f5ce40cf4f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4068510 tx=0x7f5cd4009840 comp rx=0 tx=0).stop 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/127721590 shutdown_connections 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/127721590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce41578d0 0x7f5ce40cf4f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/127721590 >> v2:172.21.15.118:3300/0 conn(0x7f5ce4157ca0 0x7f5ce415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/127721590 >> 172.21.15.6:0/127721590 conn(0x7f5ce406bb90 msgr2=0x7f5ce406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/127721590 shutdown_connections 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.651+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/127721590 wait complete. 2023-10-09T11:36:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.652+0000 7f5ce8cd9700 1 Processor -- start 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.652+0000 7f5ce8cd9700 1 -- start start 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ce406d120 0x7f5ce4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c8850 con 0x7f5ce4157ca0 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c9390 con 0x7f5ce41578d0 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce8cd9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c7c40 con 0x7f5ce406d120 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:36374/0 (socket says 172.21.15.6:36374) 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 -- 172.21.15.6:0/277932717 learned_addr learned my addr 172.21.15.6:0/277932717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36732/0 (socket says 172.21.15.6:36732) 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce259c700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ce406d120 0x7f5ce4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 -- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ce406d120 msgr2=0x7f5ce4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ce406d120 0x7f5ce4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 -- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 msgr2=0x7f5ce41585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 -- 172.21.15.6:0/277932717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd4009ae0 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce2d9d700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5ce1d9b700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e900 tx=0x7f5ccc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.653+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc013680 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.654+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0137e0 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.654+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce40c7f20 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.654+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc013ba0 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.654+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce40c84e0 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.655+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce4067ac0 con 0x7f5ce41578d0 2023-10-09T11:36:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.655+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ccc0123d0 con 0x7f5ce41578d0 2023-10-09T11:36:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.655+0000 7f5cda7fc700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 0x7f5cc40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.655+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ccc0845f0 con 0x7f5ce41578d0 2023-10-09T11:36:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.655+0000 7f5ce259c700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 0x7f5cc40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.656+0000 7f5ce259c700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 0x7f5cc40693b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009880 tx=0x7f5cd4018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.660+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ccc051860 con 0x7f5ce41578d0 2023-10-09T11:36:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.850+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ce40d0450 con 0x7f5ce41578d0 2023-10-09T11:36:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.852+0000 7f5cda7fc700 1 -- 172.21.15.6:0/277932717 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ccc054e80 con 0x7f5ce41578d0 2023-10-09T11:36:21.853 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 msgr2=0x7f5cc40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 0x7f5cc40693b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009880 tx=0x7f5cd4018000 comp rx=0 tx=0).stop 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 msgr2=0x7f5ce40c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e900 tx=0x7f5ccc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 shutdown_connections 2023-10-09T11:36:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5cc4066f00 0x7f5cc40693b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ce4157ca0 0x7f5ce41585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ce406d120 0x7f5ce4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 --2- 172.21.15.6:0/277932717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ce41578d0 0x7f5ce40c7180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 >> 172.21.15.6:0/277932717 conn(0x7f5ce406bb90 msgr2=0x7f5ce406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 shutdown_connections 2023-10-09T11:36:21.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.853+0000 7f5ce8cd9700 1 -- 172.21.15.6:0/277932717 wait complete. 2023-10-09T11:36:21.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.987+0000 7f570287b700 1 Processor -- start 2023-10-09T11:36:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.987+0000 7f570287b700 1 -- start start 2023-10-09T11:36:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f570287b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc1578d0 0x7f56fc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f570287b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f56fc157ca0 0x7f56fc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f570287b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc0d07c0 con 0x7f56fc06d120 2023-10-09T11:36:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f570287b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0cfbb0 con 0x7f56fc157ca0 2023-10-09T11:36:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f570287b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0cfe90 con 0x7f56fc1578d0 2023-10-09T11:36:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f5700e18700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f56fc06d120 0x7f56fc15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44394/0 (socket says 172.21.15.6:44394) 2023-10-09T11:36:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f5700e18700 1 -- 172.21.15.6:0/1983186771 learned_addr learned my addr 172.21.15.6:0/1983186771 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 --2- 172.21.15.6:0/1983186771 >> v2:172.21.15.118:3300/0 conn(0x7f56fc157ca0 0x7f56fc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fbfff700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc1578d0 0x7f56fc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56faffd700 1 -- 172.21.15.6:0/1983186771 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534672024 0 0) 0x7f56fc0d07c0 con 0x7f56fc06d120 2023-10-09T11:36:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56faffd700 1 -- 172.21.15.6:0/1983186771 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e8003570 con 0x7f56fc06d120 2023-10-09T11:36:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 -- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc1578d0 msgr2=0x7f56fc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc1578d0 0x7f56fc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 -- 172.21.15.6:0/1983186771 >> v1:172.21.15.6:6789/0 conn(0x7f56fc06d120 legacy=0x7f56fc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 -- 172.21.15.6:0/1983186771 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0d0170 con 0x7f56fc157ca0 2023-10-09T11:36:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.988+0000 7f56fb7fe700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc157ca0 0x7f56fc15af00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0098e0 tx=0x7f56ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72146452693cf49c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f56faffd700 1 -- 172.21.15.6:0/1983186771 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011630 con 0x7f56fc157ca0 2023-10-09T11:36:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f56faffd700 1 -- 172.21.15.6:0/1983186771 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec011790 con 0x7f56fc157ca0 2023-10-09T11:36:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f56faffd700 1 -- 172.21.15.6:0/1983186771 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011b30 con 0x7f56fc157ca0 2023-10-09T11:36:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 -- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc157ca0 msgr2=0x7f56fc15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc157ca0 0x7f56fc15af00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0098e0 tx=0x7f56ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 -- 172.21.15.6:0/1983186771 shutdown_connections 2023-10-09T11:36:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc1578d0 0x7f56fc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 --2- 172.21.15.6:0/1983186771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc157ca0 0x7f56fc15af00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 -- 172.21.15.6:0/1983186771 >> 172.21.15.6:0/1983186771 conn(0x7f56fc06bb90 msgr2=0x7f56fc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 -- 172.21.15.6:0/1983186771 shutdown_connections 2023-10-09T11:36:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.989+0000 7f570287b700 1 -- 172.21.15.6:0/1983186771 wait complete. 2023-10-09T11:36:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.990+0000 7f570287b700 1 Processor -- start 2023-10-09T11:36:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 -- start start 2023-10-09T11:36:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc06d120 0x7f56fc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 0x7f56fc16d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0ae3c0 con 0x7f56fc157ca0 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc16e700 con 0x7f56fc1578d0 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f570287b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc16e420 con 0x7f56fc06d120 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f5700e18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f5700e18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36740/0 (socket says 172.21.15.6:36740) 2023-10-09T11:36:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.991+0000 7f5700e18700 1 -- 172.21.15.6:0/1209402524 learned_addr learned my addr 172.21.15.6:0/1209402524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56fb7fe700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 0x7f56fc16d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56fbfff700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc06d120 0x7f56fc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 -- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc06d120 msgr2=0x7f56fc0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc06d120 0x7f56fc0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 -- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 msgr2=0x7f56fc16d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 0x7f56fc16d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 -- 172.21.15.6:0/1209402524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009420 con 0x7f56fc157ca0 2023-10-09T11:36:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56fb7fe700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 0x7f56fc16d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f5700e18700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56f4001460 tx=0x7f56f4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400ce80 con 0x7f56fc157ca0 2023-10-09T11:36:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f400ab70 con 0x7f56fc157ca0 2023-10-09T11:36:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc0aa9c0 con 0x7f56fc157ca0 2023-10-09T11:36:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f40070f0 con 0x7f56fc157ca0 2023-10-09T11:36:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.992+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc0aaf80 con 0x7f56fc157ca0 2023-10-09T11:36:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.993+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc067ac0 con 0x7f56fc157ca0 2023-10-09T11:36:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.993+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56f4007520 con 0x7f56fc157ca0 2023-10-09T11:36:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.994+0000 7f56f3fff700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 0x7f56dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.994+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56f40849c0 con 0x7f56fc157ca0 2023-10-09T11:36:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.994+0000 7f56fbfff700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 0x7f56dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.994+0000 7f56fbfff700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 0x7f56dc0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009d40 tx=0x7f56e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:21.998+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56f4051cb0 con 0x7f56fc157ca0 2023-10-09T11:36:22.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.191+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56fc0ab170 con 0x7f56fc157ca0 2023-10-09T11:36:22.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.192+0000 7f56f3fff700 1 -- 172.21.15.6:0/1209402524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56f40552d0 con 0x7f56fc157ca0 2023-10-09T11:36:22.193 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:22.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 msgr2=0x7f56dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 0x7f56dc0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009d40 tx=0x7f56e4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 msgr2=0x7f56fc16dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56f4001460 tx=0x7f56f4001ae0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 shutdown_connections 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f56dc066f30 0x7f56dc0693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56fc157ca0 0x7f56fc16dd80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56fc06d120 0x7f56fc0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 --2- 172.21.15.6:0/1209402524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56fc1578d0 0x7f56fc16d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 >> 172.21.15.6:0/1209402524 conn(0x7f56fc06bb90 msgr2=0x7f56fc15c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 shutdown_connections 2023-10-09T11:36:22.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.194+0000 7f570287b700 1 -- 172.21.15.6:0/1209402524 wait complete. 2023-10-09T11:36:22.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.328+0000 7f1db72af700 1 Processor -- start 2023-10-09T11:36:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.328+0000 7f1db72af700 1 -- start start 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db72af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1db0157ca0 0x7f1db00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db72af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db006d120 0x7f1db006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db72af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00d07c0 con 0x7f1db01578d0 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db72af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db006daa0 con 0x7f1db0157ca0 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db72af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00cfbb0 con 0x7f1db006d120 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db504b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1db01578d0 0x7f1db015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44396/0 (socket says 172.21.15.6:44396) 2023-10-09T11:36:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db504b700 1 -- 172.21.15.6:0/2546182226 learned_addr learned my addr 172.21.15.6:0/2546182226 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 --2- 172.21.15.6:0/2546182226 >> v2:172.21.15.6:3300/0 conn(0x7f1db0157ca0 0x7f1db00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db584c700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db006d120 0x7f1db006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 -- 172.21.15.6:0/2546182226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db006d120 msgr2=0x7f1db006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db006d120 0x7f1db006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 -- 172.21.15.6:0/2546182226 >> v1:172.21.15.6:6789/0 conn(0x7f1db01578d0 legacy=0x7f1db015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1da7fff700 1 -- 172.21.15.6:0/2546182226 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040060286 0 0) 0x7f1db00d07c0 con 0x7f1db01578d0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 -- 172.21.15.6:0/2546182226 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00cfe90 con 0x7f1db0157ca0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.329+0000 7f1db484a700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db00cf4f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1da00098e0 tx=0x7f1da00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3f275e19698e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1da7fff700 1 -- 172.21.15.6:0/2546182226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da000b640 con 0x7f1db0157ca0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1da7fff700 1 -- 172.21.15.6:0/2546182226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da000b7a0 con 0x7f1db0157ca0 2023-10-09T11:36:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1da7fff700 1 -- 172.21.15.6:0/2546182226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da000bb40 con 0x7f1db0157ca0 2023-10-09T11:36:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 -- 172.21.15.6:0/2546182226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 msgr2=0x7f1db00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db00cf4f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1da00098e0 tx=0x7f1da00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 -- 172.21.15.6:0/2546182226 shutdown_connections 2023-10-09T11:36:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db006d120 0x7f1db006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 --2- 172.21.15.6:0/2546182226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db00cf4f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 -- 172.21.15.6:0/2546182226 >> 172.21.15.6:0/2546182226 conn(0x7f1db006bb90 msgr2=0x7f1db006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 -- 172.21.15.6:0/2546182226 shutdown_connections 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.330+0000 7f1db72af700 1 -- 172.21.15.6:0/2546182226 wait complete. 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.331+0000 7f1db72af700 1 Processor -- start 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.331+0000 7f1db72af700 1 -- start start 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 0x7f1db01487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 0x7f1db00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db016a090 con 0x7f1db0157ca0 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00ab0e0 con 0x7f1db006d120 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db72af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00ab3c0 con 0x7f1db01578d0 2023-10-09T11:36:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db584c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db584c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36758/0 (socket says 172.21.15.6:36758) 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db584c700 1 -- 172.21.15.6:0/475830030 learned_addr learned my addr 172.21.15.6:0/475830030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db484a700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 0x7f1db00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db504b700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 0x7f1db01487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db584c700 1 -- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 msgr2=0x7f1db00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.332+0000 7f1db584c700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 0x7f1db00aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db584c700 1 -- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 msgr2=0x7f1db01487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db584c700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 0x7f1db01487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db584c700 1 -- 172.21.15.6:0/475830030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0009420 con 0x7f1db0157ca0 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db504b700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 0x7f1db01487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db484a700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 0x7f1db00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db584c700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009e90 tx=0x7f1da800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800cc20 con 0x7f1db0157ca0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da800f040 con 0x7f1db0157ca0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8014480 con 0x7f1db0157ca0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00ab6a0 con 0x7f1db0157ca0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.333+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db0148cf0 con 0x7f1db0157ca0 2023-10-09T11:36:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.334+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0067ac0 con 0x7f1db0157ca0 2023-10-09T11:36:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.334+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1da8014830 con 0x7f1db0157ca0 2023-10-09T11:36:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.335+0000 7f1da57fa700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 0x7f1d940693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.335+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1da8084f50 con 0x7f1db0157ca0 2023-10-09T11:36:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.335+0000 7f1db504b700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 0x7f1d940693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.335+0000 7f1db504b700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 0x7f1d940693b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0011e0 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.339+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1da8055c50 con 0x7f1db0157ca0 2023-10-09T11:36:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.533+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1db00d0170 con 0x7f1db0157ca0 2023-10-09T11:36:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.533+0000 7f1da57fa700 1 -- 172.21.15.6:0/475830030 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1da8018020 con 0x7f1db0157ca0 2023-10-09T11:36:22.535 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 msgr2=0x7f1d940693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 0x7f1d940693b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0011e0 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 msgr2=0x7f1db0159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009e90 tx=0x7f1da800b040 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 shutdown_connections 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d94066f00 0x7f1d940693b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0157ca0 0x7f1db0159610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db006d120 0x7f1db01487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 --2- 172.21.15.6:0/475830030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1db01578d0 0x7f1db00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 >> 172.21.15.6:0/475830030 conn(0x7f1db006bb90 msgr2=0x7f1db00694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 shutdown_connections 2023-10-09T11:36:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.535+0000 7f1db72af700 1 -- 172.21.15.6:0/475830030 wait complete. 2023-10-09T11:36:22.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:22.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.666+0000 7f963d4df700 1 Processor -- start 2023-10-09T11:36:22.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.666+0000 7f963d4df700 1 -- start start 2023-10-09T11:36:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f963d4df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f963806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f963d4df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96380691f0 0x7f96380b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f963d4df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963806e280 con 0x7f9638159e60 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f963d4df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9638068d60 con 0x7f96380691f0 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f963d4df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963806dfa0 con 0x7f9638159a90 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f96380691f0 0x7f96380b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96367fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9638159e60 0x7f963806a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44406/0 (socket says 172.21.15.6:44406) 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96367fc700 1 -- 172.21.15.6:0/1884535991 learned_addr learned my addr 172.21.15.6:0/1884535991 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f9636ffd700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f963806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 -- 172.21.15.6:0/1884535991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 msgr2=0x7f963806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f963806d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 -- 172.21.15.6:0/1884535991 >> v1:172.21.15.6:6789/0 conn(0x7f9638159e60 legacy=0x7f963806a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 -- 172.21.15.6:0/1884535991 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638068710 con 0x7f96380691f0 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f9635ffb700 1 -- 172.21.15.6:0/1884535991 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117472161 0 0) 0x7f963806e280 con 0x7f9638159e60 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f96377fe700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f96380b2b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f96300098e0 tx=0x7f96300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8688680cb0daea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f9635ffb700 1 -- 172.21.15.6:0/1884535991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630009e80 con 0x7f96380691f0 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f9635ffb700 1 -- 172.21.15.6:0/1884535991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963000b860 con 0x7f96380691f0 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.667+0000 7f9635ffb700 1 -- 172.21.15.6:0/1884535991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963000bbe0 con 0x7f96380691f0 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 -- 172.21.15.6:0/1884535991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 msgr2=0x7f96380b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f96380b2b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f96300098e0 tx=0x7f96300091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 -- 172.21.15.6:0/1884535991 shutdown_connections 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f96380b2b20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 --2- 172.21.15.6:0/1884535991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f963806d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 -- 172.21.15.6:0/1884535991 >> 172.21.15.6:0/1884535991 conn(0x7f963806bb90 msgr2=0x7f963806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 -- 172.21.15.6:0/1884535991 shutdown_connections 2023-10-09T11:36:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.668+0000 7f963d4df700 1 -- 172.21.15.6:0/1884535991 wait complete. 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.669+0000 7f963d4df700 1 Processor -- start 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.669+0000 7f963d4df700 1 -- start start 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f96381518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9638159e60 0x7f963814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963814fa30 con 0x7f96380691f0 2023-10-09T11:36:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638152640 con 0x7f9638159e60 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f963d4df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9638152360 con 0x7f9638159a90 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36784/0 (socket says 172.21.15.6:36784) 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 -- 172.21.15.6:0/860873103 learned_addr learned my addr 172.21.15.6:0/860873103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f96377fe700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9638159e60 0x7f963814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f96367fc700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f96381518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 -- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 msgr2=0x7f96381518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f96381518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 -- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9638159e60 msgr2=0x7f963814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9638159e60 0x7f963814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.670+0000 7f9636ffd700 1 -- 172.21.15.6:0/860873103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009420 con 0x7f96380691f0 2023-10-09T11:36:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f9636ffd700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f962800e190 tx=0x7f9628009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800ecd0 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800ee30 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963814f3e0 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628014670 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.671+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963815ccb0 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.672+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9638067640 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.672+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9628014a20 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.672+0000 7f962effd700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.673+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9628084c60 con 0x7f96380691f0 2023-10-09T11:36:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.673+0000 7f96367fc700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.673+0000 7f96367fc700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96380b2ae0 tx=0x7f9620007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.677+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9628051e30 con 0x7f96380691f0 2023-10-09T11:36:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.912+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f963814fd10 con 0x7f96380691f0 2023-10-09T11:36:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.913+0000 7f962effd700 1 -- 172.21.15.6:0/860873103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f9628009a60 con 0x7f96380691f0 2023-10-09T11:36:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:22.915 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 msgr2=0x7f96180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 0x7f96180693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96380b2ae0 tx=0x7f9620007d30 comp rx=0 tx=0).stop 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 msgr2=0x7f963815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f962800e190 tx=0x7f9628009920 comp rx=0 tx=0).stop 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 shutdown_connections 2023-10-09T11:36:22.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9618066f30 0x7f96180693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9638159e60 0x7f963814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96380691f0 0x7f963815c770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 --2- 172.21.15.6:0/860873103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9638159a90 0x7f96381518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 >> 172.21.15.6:0/860873103 conn(0x7f963806bb90 msgr2=0x7f9638158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 shutdown_connections 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:22.915+0000 7f963d4df700 1 -- 172.21.15.6:0/860873103 wait complete. 2023-10-09T11:36:22.918 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:22.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:23.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.045+0000 7f3ad4e84700 1 Processor -- start 2023-10-09T11:36:23.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.045+0000 7f3ad4e84700 1 -- start start 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ad01578d0 0x7f3ad00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad0157ca0 0x7f3ad015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad00d07c0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad006daa0 con 0x7f3ad01578d0 2023-10-09T11:36:23.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ad4e84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00cfbb0 con 0x7f3ad006d120 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad0157ca0 0x7f3ad015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad0157ca0 0x7f3ad015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36786/0 (socket says 172.21.15.6:36786) 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 -- 172.21.15.6:0/1352177404 learned_addr learned my addr 172.21.15.6:0/1352177404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3ace59c700 1 --2- 172.21.15.6:0/1352177404 >> v2:172.21.15.118:3300/0 conn(0x7f3ad01578d0 0x7f3ad00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3aced9d700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 -- 172.21.15.6:0/1352177404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 msgr2=0x7f3ad006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 -- 172.21.15.6:0/1352177404 >> v2:172.21.15.118:3300/0 conn(0x7f3ad01578d0 msgr2=0x7f3ad00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 --2- 172.21.15.6:0/1352177404 >> v2:172.21.15.118:3300/0 conn(0x7f3ad01578d0 0x7f3ad00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.046+0000 7f3acdd9b700 1 -- 172.21.15.6:0/1352177404 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00cfe90 con 0x7f3ad0157ca0 2023-10-09T11:36:23.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3acdd9b700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad015af00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00646b0 tx=0x7f3ab8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3732c60cf006a2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3acd59a700 1 -- 172.21.15.6:0/1352177404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800b860 con 0x7f3ad0157ca0 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3acd59a700 1 -- 172.21.15.6:0/1352177404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800b9c0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3acd59a700 1 -- 172.21.15.6:0/1352177404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800bd60 con 0x7f3ad0157ca0 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1352177404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 msgr2=0x7f3ad015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad015af00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00646b0 tx=0x7f3ab8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1352177404 shutdown_connections 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1352177404 >> v2:172.21.15.118:3300/0 conn(0x7f3ad01578d0 0x7f3ad00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1352177404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad015af00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1352177404 >> 172.21.15.6:0/1352177404 conn(0x7f3ad006bb90 msgr2=0x7f3ad006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1352177404 shutdown_connections 2023-10-09T11:36:23.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.047+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1352177404 wait complete. 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.048+0000 7f3ad4e84700 1 Processor -- start 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.048+0000 7f3ad4e84700 1 -- start start 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad0144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 0x7f3ad0159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0145150 con 0x7f3ad0157ca0 2023-10-09T11:36:23.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00b22e0 con 0x7f3ad01578d0 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ad4e84700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00b25c0 con 0x7f3ad006d120 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3aced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3aced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36794/0 (socket says 172.21.15.6:36794) 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3aced9d700 1 -- 172.21.15.6:0/1605131606 learned_addr learned my addr 172.21.15.6:0/1605131606 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3ace59c700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.049+0000 7f3acdd9b700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 0x7f3ad0159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 -- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 msgr2=0x7f3ad0144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad0144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 -- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 msgr2=0x7f3ad0159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 0x7f3ad0159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 -- 172.21.15.6:0/1605131606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab80094f0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3acdd9b700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 0x7f3ad0159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ace59c700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3aced9d700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d890 tx=0x7f3ac8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80125f0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8012770 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad0144b00 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8012b30 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.050+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad0144670 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.051+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0067ac0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.052+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ac801e460 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.052+0000 7f3ac67fc700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.052+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ac80855d0 con 0x7f3ad0157ca0 2023-10-09T11:36:23.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.052+0000 7f3ace59c700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.053+0000 7f3ace59c700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 0x7f3ab00693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00075e0 tx=0x7f3ac00097e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.056+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ac8052840 con 0x7f3ad0157ca0 2023-10-09T11:36:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.249+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ad0145290 con 0x7f3ad0157ca0 2023-10-09T11:36:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.250+0000 7f3ac67fc700 1 -- 172.21.15.6:0/1605131606 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3ac8055e60 con 0x7f3ad0157ca0 2023-10-09T11:36:23.252 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:23.252 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 msgr2=0x7f3ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 0x7f3ab00693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00075e0 tx=0x7f3ac00097e0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 msgr2=0x7f3ad01598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800d890 tx=0x7f3ac8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 shutdown_connections 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad0157ca0 0x7f3ad01598b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ad006d120 0x7f3ad0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 --2- 172.21.15.6:0/1605131606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad01578d0 0x7f3ad0159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 >> 172.21.15.6:0/1605131606 conn(0x7f3ad006bb90 msgr2=0x7f3ad006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.252+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 shutdown_connections 2023-10-09T11:36:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.253+0000 7f3ad4e84700 1 -- 172.21.15.6:0/1605131606 wait complete. 2023-10-09T11:36:23.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:23.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.383+0000 7f04c52fe700 1 Processor -- start 2023-10-09T11:36:23.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.383+0000 7f04c52fe700 1 -- start start 2023-10-09T11:36:23.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04c52fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04c0159b40 0x7f04c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04c52fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00cee10 con 0x7f04c0159f10 2023-10-09T11:36:23.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04c52fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00cd040 con 0x7f04c0068e90 2023-10-09T11:36:23.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04c52fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00cd320 con 0x7f04c0159b40 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04c0159b40 0x7f04c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bf7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04c0159f10 0x7f04c0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42962/0 (socket says 172.21.15.6:42962) 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bf7fe700 1 -- 172.21.15.6:0/218377511 learned_addr learned my addr 172.21.15.6:0/218377511 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bffff700 1 -- 172.21.15.6:0/218377511 >> v1:172.21.15.118:6789/0 conn(0x7f04c0068e90 legacy=0x7f04c00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bffff700 1 -- 172.21.15.6:0/218377511 >> v1:172.21.15.6:6789/0 conn(0x7f04c0159f10 legacy=0x7f04c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04beffd700 1 -- 172.21.15.6:0/218377511 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646137664 0 0) 0x7f04c00cee10 con 0x7f04c0159f10 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bffff700 1 -- 172.21.15.6:0/218377511 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00ce7c0 con 0x7f04c0159b40 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.384+0000 7f04bffff700 1 --2- 172.21.15.6:0/218377511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0159b40 0x7f04c00cc600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04b00098e0 tx=0x7f04b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0a45ae1ca2376c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04beffd700 1 -- 172.21.15.6:0/218377511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0009e80 con 0x7f04c0159b40 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04beffd700 1 -- 172.21.15.6:0/218377511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000b860 con 0x7f04c0159b40 2023-10-09T11:36:23.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04beffd700 1 -- 172.21.15.6:0/218377511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000bbe0 con 0x7f04c0159b40 2023-10-09T11:36:23.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 -- 172.21.15.6:0/218377511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0159b40 msgr2=0x7f04c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 --2- 172.21.15.6:0/218377511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0159b40 0x7f04c00cc600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04b00098e0 tx=0x7f04b00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 -- 172.21.15.6:0/218377511 shutdown_connections 2023-10-09T11:36:23.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 --2- 172.21.15.6:0/218377511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0159b40 0x7f04c00cc600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 -- 172.21.15.6:0/218377511 >> 172.21.15.6:0/218377511 conn(0x7f04c00cd660 msgr2=0x7f04c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 -- 172.21.15.6:0/218377511 shutdown_connections 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.385+0000 7f04c52fe700 1 -- 172.21.15.6:0/218377511 wait complete. 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.386+0000 7f04c52fe700 1 Processor -- start 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 -- start start 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 0x7f04c015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 0x7f04c00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0157860 con 0x7f04c0068e90 2023-10-09T11:36:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015b200 con 0x7f04c0159b40 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c52fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0156f70 con 0x7f04c0159f10 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58698/0 (socket says 172.21.15.6:58698) 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04bffff700 1 -- 172.21.15.6:0/3873414308 learned_addr learned my addr 172.21.15.6:0/3873414308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04bf7fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 0x7f04c015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.387+0000 7f04c4afd700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 0x7f04c00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 -- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 msgr2=0x7f04c00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 0x7f04c00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 -- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 msgr2=0x7f04c015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 0x7f04c015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 -- 172.21.15.6:0/3873414308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009420 con 0x7f04c0068e90 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bf7fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 0x7f04c015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04c4afd700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 0x7f04c00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04bffff700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04c006fe10 tx=0x7f04b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b001f070 con 0x7f04c0068e90 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000b9d0 con 0x7f04c0068e90 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0025670 con 0x7f04c0068e90 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0157210 con 0x7f04c0068e90 2023-10-09T11:36:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.388+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c00b53c0 con 0x7f04c0068e90 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.389+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c00cb910 con 0x7f04c0068e90 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.389+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04b0023070 con 0x7f04c0068e90 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.390+0000 7f04b7fff700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.390+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04b0085b60 con 0x7f04c0068e90 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.390+0000 7f04bf7fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.390+0000 7f04bf7fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04c015a6c0 tx=0x7f04a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:23.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.394+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b0052dd0 con 0x7f04c0068e90 2023-10-09T11:36:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.634+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04c00ceaa0 con 0x7f04c0068e90 2023-10-09T11:36:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.635+0000 7f04b7fff700 1 -- 172.21.15.6:0/3873414308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f04b0015090 con 0x7f04c0068e90 2023-10-09T11:36:23.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:23.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 msgr2=0x7f04a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04c015a6c0 tx=0x7f04a8009040 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 msgr2=0x7f04c016b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04c006fe10 tx=0x7f04b0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 shutdown_connections 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04c0159f10 0x7f04c00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04c0068e90 0x7f04c016b3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 --2- 172.21.15.6:0/3873414308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04c0159b40 0x7f04c015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 >> 172.21.15.6:0/3873414308 conn(0x7f04c00cd660 msgr2=0x7f04c00c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:23.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 shutdown_connections 2023-10-09T11:36:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:23.637+0000 7f04c52fe700 1 -- 172.21.15.6:0/3873414308 wait complete. 2023-10-09T11:36:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:24.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:36:03.468524+0000', 'modified': '2023-10-09T11:36:07.085366+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/989530631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6836', 'nonce': 989530631}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 989530631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:36:24.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:36:24.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:36:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.174+0000 7f79dd9af700 1 Processor -- start 2023-10-09T11:36:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.174+0000 7f79dd9af700 1 -- start start 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79dd9af700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79d8159a90 0x7f79d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79dd9af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79d8159e60 0x7f79d806a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79dd9af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d806e280 con 0x7f79d80691f0 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79dd9af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d8068d60 con 0x7f79d8159e60 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79dd9af700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d806a9a0 con 0x7f79d8159a90 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79d8159e60 0x7f79d806a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79d80691f0 0x7f79d80b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42966/0 (socket says 172.21.15.6:42966) 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d77fe700 1 -- 172.21.15.6:0/3384023467 learned_addr learned my addr 172.21.15.6:0/3384023467 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:24.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79d8159e60 0x7f79d806a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58700/0 (socket says 172.21.15.6:58700) 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/3384023467 >> v2:172.21.15.118:3300/0 conn(0x7f79d8159a90 0x7f79d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 -- 172.21.15.6:0/3384023467 >> v2:172.21.15.118:3300/0 conn(0x7f79d8159a90 msgr2=0x7f79d806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 --2- 172.21.15.6:0/3384023467 >> v2:172.21.15.118:3300/0 conn(0x7f79d8159a90 0x7f79d806d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 -- 172.21.15.6:0/3384023467 >> v1:172.21.15.6:6789/0 conn(0x7f79d80691f0 legacy=0x7f79d80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d67fc700 1 -- 172.21.15.6:0/3384023467 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d806dfa0 con 0x7f79d8159e60 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.175+0000 7f79d5ffb700 1 -- 172.21.15.6:0/3384023467 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559693301 0 0) 0x7f79d806e280 con 0x7f79d80691f0 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79d67fc700 1 --2- 172.21.15.6:0/3384023467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d8159e60 0x7f79d806a460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79d8065b30 tx=0x7f79c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76c7c0328d4beea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79d5ffb700 1 -- 172.21.15.6:0/3384023467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000b6b0 con 0x7f79d8159e60 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79d5ffb700 1 -- 172.21.15.6:0/3384023467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000b810 con 0x7f79d8159e60 2023-10-09T11:36:24.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79d5ffb700 1 -- 172.21.15.6:0/3384023467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000bbb0 con 0x7f79d8159e60 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 -- 172.21.15.6:0/3384023467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d8159e60 msgr2=0x7f79d806a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 --2- 172.21.15.6:0/3384023467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d8159e60 0x7f79d806a460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79d8065b30 tx=0x7f79c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 -- 172.21.15.6:0/3384023467 shutdown_connections 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 --2- 172.21.15.6:0/3384023467 >> v2:172.21.15.118:3300/0 conn(0x7f79d8159a90 0x7f79d806d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 --2- 172.21.15.6:0/3384023467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d8159e60 0x7f79d806a460 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 -- 172.21.15.6:0/3384023467 >> 172.21.15.6:0/3384023467 conn(0x7f79d806bb90 msgr2=0x7f79d806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 -- 172.21.15.6:0/3384023467 shutdown_connections 2023-10-09T11:36:24.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.176+0000 7f79dd9af700 1 -- 172.21.15.6:0/3384023467 wait complete. 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.177+0000 7f79dd9af700 1 Processor -- start 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 -- start start 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79d8159a90 0x7f79d8158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79d8159e60 0x7f79d8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80c82d0 con 0x7f79d80691f0 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d81563d0 con 0x7f79d8159e60 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79dd9af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d816a630 con 0x7f79d8159a90 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58702/0 (socket says 172.21.15.6:58702) 2023-10-09T11:36:24.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79d6ffd700 1 -- 172.21.15.6:0/1640695895 learned_addr learned my addr 172.21.15.6:0/1640695895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79d77fe700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79d8159e60 0x7f79d8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.178+0000 7f79d67fc700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79d8159a90 0x7f79d8158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 -- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79d8159a90 msgr2=0x7f79d8158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79d8159a90 0x7f79d8158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 -- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79d8159e60 msgr2=0x7f79d8158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79d8159e60 0x7f79d8158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 -- 172.21.15.6:0/1640695895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0009420 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e190 tx=0x7f79c8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79ceffd700 1 -- 172.21.15.6:0/1640695895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800ecd0 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79ceffd700 1 -- 172.21.15.6:0/1640695895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800ee30 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80c7d10 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79ceffd700 1 -- 172.21.15.6:0/1640695895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8014670 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.179+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8156060 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.180+0000 7f79ceffd700 1 -- 172.21.15.6:0/1640695895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79c8014a20 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.181+0000 7f79ceffd700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 0x7f79b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.181+0000 7f79ceffd700 1 -- 172.21.15.6:0/1640695895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79c8084c10 con 0x7f79d80691f0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.181+0000 7f79d67fc700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 0x7f79b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.181+0000 7f79d67fc700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 0x7f79b80693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79c00093f0 tx=0x7f79c0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.183+0000 7f79e6ca7b80 1 Processor -- start 2023-10-09T11:36:24.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.183+0000 7f79e6ca7b80 1 -- start start 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.183+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912de92a70 con 0x55912df395f0 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912de90270 con 0x55912df86480 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55912de8c060 con 0x55912df3bb80 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58710/0 (socket says 172.21.15.6:58710) 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 -- 172.21.15.6:0/4045755639 learned_addr learned my addr 172.21.15.6:0/4045755639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d77fe700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 -- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 msgr2=0x55912df3bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df3bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 -- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 msgr2=0x55912df657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 -- 172.21.15.6:0/4045755639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55912dd26270 con 0x55912df395f0 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d77fe700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df3bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79d67fc700 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79c000bab0 tx=0x7f79c0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f39b3016d48dacc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79b7fff700 1 -- 172.21.15.6:0/4045755639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0021070 con 0x55912df395f0 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79b7fff700 1 -- 172.21.15.6:0/4045755639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000bae0 con 0x55912df395f0 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.184+0000 7f79b7fff700 1 -- 172.21.15.6:0/4045755639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0033480 con 0x55912df395f0 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/4045755639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 msgr2=0x55912df86850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79c000bab0 tx=0x7f79c0021000 comp rx=0 tx=0).stop 2023-10-09T11:36:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/4045755639 shutdown_connections 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df3bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/4045755639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df86850 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/4045755639 >> 172.21.15.6:0/4045755639 conn(0x55912df3d0c0 msgr2=0x55912df3d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/4045755639 shutdown_connections 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.185+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/4045755639 wait complete. 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.186+0000 7f79e6ca7b80 1 -- start start 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.186+0000 7f79e6ca7b80 1 Processor -- start 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df60050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df853a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912de37890 con 0x55912df395f0 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912de52ea0 con 0x55912df86480 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55912dd0ee30 con 0x55912df3bb80 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 10 client.0 _ll_register_callbacks cb 0x55912deff2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58726/0 (socket says 172.21.15.6:58726) 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 -- 172.21.15.6:0/180656980 learned_addr learned my addr 172.21.15.6:0/180656980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d77fe700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d67fc700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df60050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 -- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 msgr2=0x55912df60050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df60050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 -- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 msgr2=0x55912df853a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df853a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 -- 172.21.15.6:0/180656980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d806dfa0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79c8055ad0 tx=0x7f79c8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6709eb815c62c839 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c805cae0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79c8012da0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55912df30cd0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c80554a0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 10 client.4695 fetch_fsmap learned FSMap version 8 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.187+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55912dcc8fe0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55912df30cd0 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79c8070070 con 0x55912df395f0 2023-10-09T11:36:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 10 client.4695 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 20 client.4695 populate_metadata read hostname 'smithi006' 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df64340 0x55912df666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 4 client.4695 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 --> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55912df0daa0 con 0x55912df64340 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79d67fc700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df64340 0x55912df666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79b57fa700 10 client.4695 ms_handle_connect on v2:172.21.15.6:6836/989530631 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.188+0000 7f79d67fc700 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df64340 0x55912df666e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf2b3002fc275ff server_cookie=656515540923d688 in_seq=0 out_seq=0 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79b57fa700 1 -- 172.21.15.6:0/180656980 <== mds.0 v2:172.21.15.6:6836/989530631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55912df0daa0 con 0x55912df64340 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79b57fa700 10 client.4695 handle_command_reply: tid=0 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 client.4695 shutdown 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 msgr2=0x55912df82370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f79c8055ad0 tx=0x7f79c8020040 comp rx=0 tx=0).stop 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 shutdown_connections 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df86480 0x55912df853a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912df82370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df64340 0x55912df666e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/180656980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df60050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79b57fa700 0 client.4695 ms_handle_reset on v2:172.21.15.6:6836/989530631 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 >> 172.21.15.6:0/180656980 conn(0x55912df3d0c0 msgr2=0x55912df37e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 shutdown_connections 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/180656980 wait complete. 2023-10-09T11:36:24.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.189+0000 7f79e6ca7b80 20 client.4695 trim_cache size 0 max 16384 2023-10-09T11:36:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 Processor -- start 2023-10-09T11:36:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 -- start start 2023-10-09T11:36:24.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df395f0 0x55912df3ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df5f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.206+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912df349e0 con 0x55912df86480 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912df64050 con 0x55912df395f0 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55912df34730 con 0x55912df3bb80 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58734/0 (socket says 172.21.15.6:58734) 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 -- 172.21.15.6:0/98891070 learned_addr learned my addr 172.21.15.6:0/98891070 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df395f0 0x55912df3ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d67fc700 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df5f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 -- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 msgr2=0x55912df5f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df5f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 -- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df395f0 msgr2=0x55912df3ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df395f0 0x55912df3ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 -- 172.21.15.6:0/98891070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55912de5a780 con 0x55912df86480 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79d77fe700 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79d8156380 tx=0x7f79d0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e399343b302cb80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79ccff9700 1 -- 172.21.15.6:0/98891070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0016630 con 0x55912df86480 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79ccff9700 1 -- 172.21.15.6:0/98891070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0016790 con 0x55912df86480 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.207+0000 7f79ccff9700 1 -- 172.21.15.6:0/98891070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0016b10 con 0x55912df86480 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/98891070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 msgr2=0x55912df666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79d8156380 tx=0x7f79d0009040 comp rx=0 tx=0).stop 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/98891070 shutdown_connections 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df86480 0x55912df666b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df395f0 0x55912df3ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/98891070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df3bb80 0x55912df5f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/98891070 >> 172.21.15.6:0/98891070 conn(0x55912df3d0c0 msgr2=0x55912df37e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/98891070 shutdown_connections 2023-10-09T11:36:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/98891070 wait complete. 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 -- start start 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.208+0000 7f79e6ca7b80 1 Processor -- start 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df3bb80 0x55912df66810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df86480 0x55912df82de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912df83ac0 con 0x55912df395f0 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912df60350 con 0x55912df3bb80 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55912df66d50 con 0x55912df86480 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79e6ca7b80 10 client.0 _ll_register_callbacks cb 0x55912deff2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.209+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58736/0 (socket says 172.21.15.6:58736) 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 -- 172.21.15.6:0/67720841 learned_addr learned my addr 172.21.15.6:0/67720841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d67fc700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df3bb80 0x55912df66810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d77fe700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df86480 0x55912df82de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 -- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df86480 msgr2=0x55912df82de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df86480 0x55912df82de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 -- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df3bb80 msgr2=0x55912df66810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df3bb80 0x55912df66810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 -- 172.21.15.6:0/67720841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d0005dd0 con 0x55912df395f0 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79d6ffd700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e160 tx=0x7f79c806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220ae6c66b3ead73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:36:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80554a0 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79c805cae0 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79c000bae0 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c8073080 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 10 client.4701 fetch_fsmap learned FSMap version 8 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55912de41470 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000bae0 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f79c8052250 con 0x55912df395f0 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 10 client.4701 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 20 client.4701 populate_metadata read hostname 'smithi006' 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.210+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df39090 0x55912dfe1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 4 client.4701 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 --> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55912de2ee00 con 0x55912df39090 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79d67fc700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df39090 0x55912dfe1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79b57fa700 10 client.4701 ms_handle_connect on v2:172.21.15.6:6836/989530631 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79d67fc700 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df39090 0x55912dfe1c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e2e99aff222ac7 server_cookie=da7803bd909e7ddc in_seq=0 out_seq=0 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79b57fa700 1 -- 172.21.15.6:0/67720841 <== mds.0 v2:172.21.15.6:6836/989530631 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55912de2ee00 con 0x55912df39090 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79b57fa700 10 client.4701 handle_command_reply: tid=0 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 client.4701 shutdown 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 msgr2=0x55912dfe8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e160 tx=0x7f79c806a000 comp rx=0 tx=0).stop 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 shutdown_connections 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:6836/989530631,v1:172.21.15.6:6837/989530631] conn(0x55912df39090 0x55912dfe1c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55912df86480 0x55912df82de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55912df395f0 0x55912dfe8c70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 --2- 172.21.15.6:0/67720841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55912df3bb80 0x55912df66810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79b57fa700 0 client.4701 ms_handle_reset on v2:172.21.15.6:6836/989530631 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 >> 172.21.15.6:0/67720841 conn(0x55912df3d0c0 msgr2=0x55912df5f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 shutdown_connections 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.211+0000 7f79e6ca7b80 1 -- 172.21.15.6:0/67720841 wait complete. 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79e6ca7b80 20 client.4701 trim_cache size 0 max 16384 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:36:24.220 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4266, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 20.151186401, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 20, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 20, 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 27.192277713999999 2023-10-09T11:36:24.221 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:36:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 msgr2=0x7f79b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 0x7f79b80693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79c00093f0 tx=0x7f79c0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 msgr2=0x7f79d8153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e190 tx=0x7f79c8009920 comp rx=0 tx=0).stop 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 shutdown_connections 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f79b8066f30 0x7f79b80693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79d8159e60 0x7f79d8158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79d80691f0 0x7f79d8153850 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 --2- 172.21.15.6:0/1640695895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79d8159a90 0x7f79d8158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 >> 172.21.15.6:0/1640695895 conn(0x7f79d806bb90 msgr2=0x7f79d81556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 shutdown_connections 2023-10-09T11:36:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.212+0000 7f79dd9af700 1 -- 172.21.15.6:0/1640695895 wait complete. 2023-10-09T11:36:24.226 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T11:36:24.252 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T11:36:24.252 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T11:36:24.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.252 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:36:24.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-09T11:36:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-10-09T11:36:24.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:36:24.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.337 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:36:24.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-09T11:36:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-10-09T11:36:24.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:36:24.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.459 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:36:24.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-10-09T11:36:24.547 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-10-09T11:36:24.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:36:24.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.549 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:36:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:24.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-10-09T11:36:24.672 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-10-09T11:36:24.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:36:24.674 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-09T11:36:24.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.793+0000 7f68fdcf0700 1 Processor -- start 2023-10-09T11:36:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 -- start start 2023-10-09T11:36:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68f8069440 0x7f68f80698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68f80c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80cb880 con 0x7f68f8156420 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f806aa10 con 0x7f68f8069440 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68fdcf0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80c7b90 con 0x7f68f80c71d0 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68f77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f68f8156420 0x7f68f80cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42982/0 (socket says 172.21.15.6:42982) 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.794+0000 7f68f77fe700 1 -- 172.21.15.6:0/762247373 learned_addr learned my addr 172.21.15.6:0/762247373 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/762247373 >> v2:172.21.15.118:3300/0 conn(0x7f68f8069440 0x7f68f80698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839050833 0 0) 0x7f68f80cb880 con 0x7f68f8156420 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e0003570 con 0x7f68f8156420 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f7fff700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68f80c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152126405 0 0) 0x7f68e0003570 con 0x7f68f8156420 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 msgr2=0x7f68f80c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68f80c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 >> v2:172.21.15.118:3300/0 conn(0x7f68f8069440 msgr2=0x7f68f80698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 --2- 172.21.15.6:0/762247373 >> v2:172.21.15.118:3300/0 conn(0x7f68f8069440 0x7f68f80698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80cac70 con 0x7f68f8156420 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f68e8001470 con 0x7f68f8156420 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 >> v1:172.21.15.6:6789/0 conn(0x7f68f8156420 legacy=0x7f68f80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68e0003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68e0004d50 0x7f68e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f806aa10 con 0x7f68e00040b0 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80c7b90 con 0x7f68e0004d50 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000bb60 con 0x7f68f80c71d0 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f77fe700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68e0003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.795+0000 7f68f7fff700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68e0004d50 0x7f68e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 -- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 msgr2=0x7f68e0003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f80c71d0 0x7f68e0003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 -- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68e0004d50 msgr2=0x7f68e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68e0004d50 0x7f68e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 -- 172.21.15.6:0/762247373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0003570 con 0x7f68e00040b0 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68e0004810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006f00 tx=0x7f68ec00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b50b1be1054375 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00a760 con 0x7f68e00040b0 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00fa30 con 0x7f68e00040b0 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f67fc700 1 -- 172.21.15.6:0/762247373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00fbc0 con 0x7f68e00040b0 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 -- 172.21.15.6:0/762247373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 msgr2=0x7f68e0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/762247373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68e0004810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006f00 tx=0x7f68ec00a330 comp rx=0 tx=0).stop 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68f7fff700 1 -- 172.21.15.6:0/762247373 reap_dead start 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 -- 172.21.15.6:0/762247373 shutdown_connections 2023-10-09T11:36:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 -- 172.21.15.6:0/762247373 >> 172.21.15.6:0/762247373 conn(0x7f68f806c660 msgr2=0x7f68f80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 -- 172.21.15.6:0/762247373 shutdown_connections 2023-10-09T11:36:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.796+0000 7f68fdcf0700 1 -- 172.21.15.6:0/762247373 wait complete. 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.798+0000 7f68fdcf0700 1 Processor -- start 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.798+0000 7f68fdcf0700 1 -- start start 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.798+0000 7f68fdcf0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.798+0000 7f68fdcf0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f80c5870 0x7f68f81524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f8169b40 0x7f68f8169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80c5ce0 con 0x7f68e00040b0 2023-10-09T11:36:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81529f0 con 0x7f68f80c5870 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8153810 con 0x7f68f8169b40 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58744/0 (socket says 172.21.15.6:58744) 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 -- 172.21.15.6:0/621714055 learned_addr learned my addr 172.21.15.6:0/621714055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 -- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f8169b40 msgr2=0x7f68f8169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f8169b40 0x7f68f8169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 -- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f80c5870 msgr2=0x7f68f81524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f80c5870 0x7f68f81524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 -- 172.21.15.6:0/621714055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f81518b0 con 0x7f68e00040b0 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68f77fe700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000fd0 tx=0x7f68e8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8018030 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800f8a0 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800fc40 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8152c00 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.799+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f81531c0 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.800+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f8153af0 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.801+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68e801b070 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.801+0000 7f68df7fe700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 0x7f68e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.801+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68e8019070 con 0x7f68e00040b0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.801+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 0x7f68e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.801+0000 7f68f6ffd700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 0x7f68e40693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68f815c950 tx=0x7f68ec01d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:24.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:24.805+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68e80516e0 con 0x7f68e00040b0 2023-10-09T11:36:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.041+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68f80caf50 con 0x7f68e00040b0 2023-10-09T11:36:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.042+0000 7f68df7fe700 1 -- 172.21.15.6:0/621714055 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68e8054d00 con 0x7f68e00040b0 2023-10-09T11:36:25.043 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 msgr2=0x7f68e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 0x7f68e40693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68f815c950 tx=0x7f68ec01d000 comp rx=0 tx=0).stop 2023-10-09T11:36:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 msgr2=0x7f68f8153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68e8000fd0 tx=0x7f68e8001dc0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 shutdown_connections 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68e4066f30 0x7f68e40693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68f8169b40 0x7f68f8169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e00040b0 0x7f68f8153ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 --2- 172.21.15.6:0/621714055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68f80c5870 0x7f68f81524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 >> 172.21.15.6:0/621714055 conn(0x7f68f806c660 msgr2=0x7f68f80c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 shutdown_connections 2023-10-09T11:36:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:25.044+0000 7f68fdcf0700 1 -- 172.21.15.6:0/621714055 wait complete. 2023-10-09T11:36:25.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:36:25.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:25.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:36:25.057 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:36:25.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:25.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:36:25.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:36:25.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:25.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:25.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.058 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42477sec preferred_lft 42477sec 2023-10-09T11:36:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:36:25.075 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:25.075 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:25.075 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:36:25.075 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:36:25.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.075 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:25.075 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:25.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:36:25.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-10-09T11:36:25.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-10-09T11:36:25.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:36:25.076 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:25.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.268 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:25.312 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:36:25.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.314 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:36:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:25.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:36:25.346 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:25.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.630 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:36:25.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.645 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-09T11:36:25.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.700 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:25.701 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:25.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:36:25.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T11:36:25.701 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:25.791 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T11:36:25.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T11:36:25.792 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:25.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:25.986 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:25.986 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:25.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:36:25.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:36:25.986 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:26.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:26.080 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:26.095 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:36:26.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:26.095 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:26.149 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:36:26.150 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:26.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:26.261 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:26.262 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:26.350 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:26.350 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:36:26.372 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:36:26.374 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:26.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:26.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:36:26.400 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-09T11:36:26.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.558+0000 7fb16d2cf700 1 Processor -- start 2023-10-09T11:36:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.558+0000 7fb16d2cf700 1 -- start start 2023-10-09T11:36:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb16d2cf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 0x7fb1681581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb16d2cf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1681594b0 con 0x7fb1680cf7a0 2023-10-09T11:36:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb16d2cf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168158930 con 0x7fb1680cf3d0 2023-10-09T11:36:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb16d2cf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb168158710 con 0x7fb1680b0c00 2023-10-09T11:36:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb1677fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1680cf7a0 0x7fb168159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42988/0 (socket says 172.21.15.6:42988) 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.559+0000 7fb1677fe700 1 -- 172.21.15.6:0/692625614 learned_addr learned my addr 172.21.15.6:0/692625614 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095182400 0 0) 0x7fb1681594b0 con 0x7fb1680cf7a0 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb154003570 con 0x7fb1680cf7a0 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878827594 0 0) 0x7fb154003570 con 0x7fb1680cf7a0 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 msgr2=0x7fb1681581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 0x7fb1681581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 >> v1:172.21.15.118:6789/0 conn(0x7fb1680cf3d0 legacy=0x7fb1680b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168158c10 con 0x7fb1680cf7a0 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fb158001840 con 0x7fb1680cf7a0 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 >> v1:172.21.15.6:6789/0 conn(0x7fb1680cf7a0 legacy=0x7fb168159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 0x7fb154003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb154004180 0x7fb154004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb154004e70 0x7fb1540052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168158710 con 0x7fb154004e70 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400bd40 con 0x7fb154004180 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15400bf00 con 0x7fb1680b0c00 2023-10-09T11:36:26.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb1677fe700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb154004e70 0x7fb1540052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb166ffd700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 0x7fb154003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.560+0000 7fb1667fc700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb154004180 0x7fb154004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 -- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 msgr2=0x7fb154003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b0c00 0x7fb154003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 -- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb154004180 msgr2=0x7fb154004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb154004180 0x7fb154004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 -- 172.21.15.6:0/692625614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154003570 con 0x7fb154004e70 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb154004e70 0x7fb1540052e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb15800a8f0 tx=0x7fb168071f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862d3d176f590478 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012400 con 0x7fb154004e70 2023-10-09T11:36:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158012560 con 0x7fb154004e70 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb165ffb700 1 -- 172.21.15.6:0/692625614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012900 con 0x7fb154004e70 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb16d2cf700 1 -- 172.21.15.6:0/692625614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb154004e70 msgr2=0x7fb1540052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/692625614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb154004e70 0x7fb1540052e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb15800a8f0 tx=0x7fb168071f30 comp rx=0 tx=0).stop 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb1677fe700 1 -- 172.21.15.6:0/692625614 reap_dead start 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb16d2cf700 1 -- 172.21.15.6:0/692625614 shutdown_connections 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb16d2cf700 1 -- 172.21.15.6:0/692625614 >> 172.21.15.6:0/692625614 conn(0x7fb16806b4f0 msgr2=0x7fb168067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.561+0000 7fb16d2cf700 1 -- 172.21.15.6:0/692625614 shutdown_connections 2023-10-09T11:36:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.562+0000 7fb16d2cf700 1 -- 172.21.15.6:0/692625614 wait complete. 2023-10-09T11:36:26.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.563+0000 7fb16d2cf700 1 Processor -- start 2023-10-09T11:36:26.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.563+0000 7fb16d2cf700 1 -- start start 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.563+0000 7fb16d2cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1680ab180 0x7fb16806e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b01d0 0x7fb1680b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806e640 con 0x7fb1680ab550 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806d060 con 0x7fb1680ab180 2023-10-09T11:36:26.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806d340 con 0x7fb1680b01d0 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb166ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1680ab180 0x7fb16806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58760/0 (socket says 172.21.15.6:58760) 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 -- 172.21.15.6:0/3636486073 learned_addr learned my addr 172.21.15.6:0/3636486073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1667fc700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b01d0 0x7fb1680b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 -- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b01d0 msgr2=0x7fb1680b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b01d0 0x7fb1680b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 -- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1680ab180 msgr2=0x7fb16806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1680ab180 0x7fb16806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 -- 172.21.15.6:0/3636486073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16806d620 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb1677fe700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb158004c60 tx=0x7fb158016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012cb0 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158021070 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16806d900 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158026680 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.564+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680abee0 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.565+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16806de20 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.566+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb158023030 con 0x7fb1680ab550 2023-10-09T11:36:26.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.566+0000 7fb15effd700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 0x7fb1480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:26.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.566+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb158086200 con 0x7fb1680ab550 2023-10-09T11:36:26.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.566+0000 7fb166ffd700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 0x7fb1480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:26.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.567+0000 7fb166ffd700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 0x7fb1480693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb160007e20 tx=0x7fb160007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:26.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.571+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb16806de20 con 0x7fb1680ab550 2023-10-09T11:36:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.812+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb16806de20 con 0x7fb1680ab550 2023-10-09T11:36:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.812+0000 7fb15effd700 1 -- 172.21.15.6:0/3636486073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb16806de20 con 0x7fb1680ab550 2023-10-09T11:36:26.814 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.814+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 msgr2=0x7fb1480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.814+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 0x7fb1480693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb160007e20 tx=0x7fb160007d10 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 msgr2=0x7fb1680ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb158004c60 tx=0x7fb158016000 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 shutdown_connections 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb148066f30 0x7fb1480693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1680ab550 0x7fb1680ab9a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1680ab180 0x7fb16806e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 --2- 172.21.15.6:0/3636486073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1680b01d0 0x7fb1680b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 >> 172.21.15.6:0/3636486073 conn(0x7fb16806b4f0 msgr2=0x7fb1680cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 shutdown_connections 2023-10-09T11:36:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:26.815+0000 7fb16d2cf700 1 -- 172.21.15.6:0/3636486073 wait complete. 2023-10-09T11:36:26.828 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:36:26.828 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:26.828 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:36:26.828 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T11:36:26.828 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T11:36:26.829 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:36:26.829 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:36:26.829 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:26.829 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:36:26.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:26.829 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.845 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:26.846 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42475sec preferred_lft 42475sec 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:26.847 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link tentative 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:26.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:26.849 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:26.911 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:36:26.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:26.912 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:36:26.968 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:36:26.968 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:26.968 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:36:26.968 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:36:26.969 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:26.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:26.969 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:26.970 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:26.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:36:26.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:36:26.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:36:26.970 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.071 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:36:27.087 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:36:27.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.087 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-09T11:36:27.142 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T11:36:27.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.143 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:27.143 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:27.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:36:27.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T11:36:27.143 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:27.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:36:27.275 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.276 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 56:63:89:55:57:ce brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:36:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:36:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5463:89ff:fe55:57ce/64 scope link tentative 2023-10-09T11:36:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T11:36:27.366 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 56:63:89:55:57:ce brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5463:89ff:fe55:57ce/64 scope link 2023-10-09T11:36:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:27.378 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T11:36:27.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.379 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:27.379 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:27.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T11:36:27.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:36:27.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T11:36:27.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T11:36:27.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T11:36:27.380 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:27.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.600 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:36:27.600 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:36:27.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2023-10-09T11:36:27.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:36:27.600 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:36:27.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:27.681 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T11:36:27.696 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T11:36:27.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:27.696 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:36:27.751 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-09T11:36:27.751 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:27.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:27.832 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:27.832 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 2@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:27.852 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:27.873 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:27.873 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 2@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:27.875 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:27.875 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:27.875 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:36:27.875 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:36:27.875 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:36:27.877 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:27.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:27.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T11:36:27.943 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-09T11:36:27.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.103+0000 7f5a06365700 1 Processor -- start 2023-10-09T11:36:28.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.103+0000 7f5a06365700 1 -- start start 2023-10-09T11:36:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a00157ca0 0x7f5a0015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 0x7f5a0006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0006dac0 con 0x7f5a00157ca0 2023-10-09T11:36:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a000d07c0 con 0x7f5a0006d120 2023-10-09T11:36:28.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a06365700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000cfbb0 con 0x7f5a001578d0 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a00157ca0 0x7f5a0015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a00157ca0 0x7f5a0015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58770/0 (socket says 172.21.15.6:58770) 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 -- 172.21.15.6:0/3777349488 learned_addr learned my addr 172.21.15.6:0/3777349488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59fffff700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a04902700 1 --2- 172.21.15.6:0/3777349488 >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 0x7f5a0006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 -- 172.21.15.6:0/3777349488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 msgr2=0x7f5a000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 -- 172.21.15.6:0/3777349488 >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 msgr2=0x7f5a0006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 --2- 172.21.15.6:0/3777349488 >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 0x7f5a0006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 -- 172.21.15.6:0/3777349488 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000cfe90 con 0x7f5a00157ca0 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f5a04902700 1 --2- 172.21.15.6:0/3777349488 >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 0x7f5a0006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59ff7fe700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a0015af00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a000b3940 tx=0x7f59f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93a41c4da82a3ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:28.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59feffd700 1 -- 172.21.15.6:0/3777349488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0009e70 con 0x7f5a00157ca0 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59feffd700 1 -- 172.21.15.6:0/3777349488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000b860 con 0x7f5a00157ca0 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.104+0000 7f59feffd700 1 -- 172.21.15.6:0/3777349488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000bc00 con 0x7f5a00157ca0 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 -- 172.21.15.6:0/3777349488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 msgr2=0x7f5a0015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a0015af00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a000b3940 tx=0x7f59f0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 -- 172.21.15.6:0/3777349488 shutdown_connections 2023-10-09T11:36:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 --2- 172.21.15.6:0/3777349488 >> v2:172.21.15.118:3300/0 conn(0x7f5a0006d120 0x7f5a0006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 --2- 172.21.15.6:0/3777349488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a0015af00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 -- 172.21.15.6:0/3777349488 >> 172.21.15.6:0/3777349488 conn(0x7f5a0006bb90 msgr2=0x7f5a0006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 -- 172.21.15.6:0/3777349488 shutdown_connections 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.105+0000 7f5a06365700 1 -- 172.21.15.6:0/3777349488 wait complete. 2023-10-09T11:36:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.106+0000 7f5a06365700 1 Processor -- start 2023-10-09T11:36:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.106+0000 7f5a06365700 1 -- start start 2023-10-09T11:36:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 0x7f5a00148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a00069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000ab260 con 0x7f5a00157ca0 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000aa930 con 0x7f5a0006d120 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a06365700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000aac10 con 0x7f5a001578d0 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58782/0 (socket says 172.21.15.6:58782) 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 -- 172.21.15.6:0/1838718306 learned_addr learned my addr 172.21.15.6:0/1838718306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f59fffff700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 0x7f5a00148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f59ff7fe700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a00069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 -- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 msgr2=0x7f5a00069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a00069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 -- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 msgr2=0x7f5a00148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 0x7f5a00148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 -- 172.21.15.6:0/1838718306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00094f0 con 0x7f5a00157ca0 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f59fffff700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 0x7f5a00148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.107+0000 7f5a04902700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59f800d180 tx=0x7f59f8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.108+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800de20 con 0x7f5a00157ca0 2023-10-09T11:36:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.108+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800f040 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.108+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a000aaef0 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.108+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8015690 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.108+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0016dab0 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.109+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a00067ac0 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.109+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59f801e3b0 con 0x7f5a00157ca0 2023-10-09T11:36:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.109+0000 7f59f7fff700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.110+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59f8084bc0 con 0x7f5a00157ca0 2023-10-09T11:36:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.110+0000 7f59fffff700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.110+0000 7f59fffff700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 0x7f59e00693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009d80 tx=0x7f59e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.114+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59f8051e30 con 0x7f5a00157ca0 2023-10-09T11:36:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.352+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a000d0170 con 0x7f5a00157ca0 2023-10-09T11:36:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.353+0000 7f59f7fff700 1 -- 172.21.15.6:0/1838718306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f59f801a070 con 0x7f5a00157ca0 2023-10-09T11:36:28.355 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 msgr2=0x7f59e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 0x7f59e00693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009d80 tx=0x7f59e8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 msgr2=0x7f5a00069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59f800d180 tx=0x7f59f8009a50 comp rx=0 tx=0).stop 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 shutdown_connections 2023-10-09T11:36:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59e0066f30 0x7f59e00693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a00157ca0 0x7f5a00069f90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0006d120 0x7f5a00148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 --2- 172.21.15.6:0/1838718306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a001578d0 0x7f5a00069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:28.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 >> 172.21.15.6:0/1838718306 conn(0x7f5a0006bb90 msgr2=0x7f5a00068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:28.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 shutdown_connections 2023-10-09T11:36:28.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:28.355+0000 7f5a06365700 1 -- 172.21.15.6:0/1838718306 wait complete. 2023-10-09T11:36:28.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:36:28.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:36:28.370 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:28.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:28.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.370 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:36:28.388 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:28.388 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:28.389 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:28.390 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42486sec preferred_lft 42486sec 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:36:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:28.392 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T11:36:28.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.392 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:28.392 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:28.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-10-09T11:36:28.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-10-09T11:36:28.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-10-09T11:36:28.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T11:36:28.393 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:28.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.559 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:28.599 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:36:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.600 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:36:28.669 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:36:28.669 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:28.669 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:36:28.669 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:36:28.669 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:28.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:36:28.670 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:28.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.947 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:36:28.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:28.961 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-10-09T11:36:29.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:29.016 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:29.016 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:29.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:36:29.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T11:36:29.016 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:29.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T11:36:29.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T11:36:29.105 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:29.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:29.306 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:29.306 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:29.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:36:29.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T11:36:29.306 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:29.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:29.398 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:29.412 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:36:29.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:29.412 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:29.466 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:36:29.466 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:29.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:29.555 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:29.555 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:29.643 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:29.643 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:29.643 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:29.665 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:36:29.666 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:36:29.666 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:36:29.668 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:29.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:29.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:36:29.691 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-09T11:36:29.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:36:29.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.822+0000 7f9e4c6f8700 1 Processor -- start 2023-10-09T11:36:29.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.822+0000 7f9e4c6f8700 1 -- start start 2023-10-09T11:36:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4c6f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e44157ca0 0x7f9e440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4c6f8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e4406d120 0x7f9e4406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4c6f8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4406dac0 con 0x7f9e441578d0 2023-10-09T11:36:29.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4c6f8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440d07c0 con 0x7f9e4406d120 2023-10-09T11:36:29.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4c6f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440cfbb0 con 0x7f9e44157ca0 2023-10-09T11:36:29.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4ac95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e4406d120 0x7f9e4406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4ac95700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e4406d120 0x7f9e4406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58794/0 (socket says 172.21.15.6:58794) 2023-10-09T11:36:29.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e4ac95700 1 -- 172.21.15.6:0/3093334665 learned_addr learned my addr 172.21.15.6:0/3093334665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:29.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.823+0000 7f9e49c93700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e44157ca0 0x7f9e440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4ac95700 1 -- 172.21.15.6:0/3093334665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e44157ca0 msgr2=0x7f9e440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:29.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4ac95700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e44157ca0 0x7f9e440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4ac95700 1 -- 172.21.15.6:0/3093334665 >> v1:172.21.15.118:6789/0 conn(0x7f9e441578d0 legacy=0x7f9e4415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4ac95700 1 -- 172.21.15.6:0/3093334665 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440cfe90 con 0x7f9e4406d120 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4ac95700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e4406d120 0x7f9e4406d580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009f20 tx=0x7f9e3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4267e7c0dda1c9db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e49492700 1 -- 172.21.15.6:0/3093334665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00e070 con 0x7f9e4406d120 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e49492700 1 -- 172.21.15.6:0/3093334665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00ba80 con 0x7f9e4406d120 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e49492700 1 -- 172.21.15.6:0/3093334665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0092e0 con 0x7f9e4406d120 2023-10-09T11:36:29.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/3093334665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e4406d120 msgr2=0x7f9e4406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.824+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e4406d120 0x7f9e4406d580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009f20 tx=0x7f9e3c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/3093334665 shutdown_connections 2023-10-09T11:36:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e4406d120 0x7f9e4406d580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/3093334665 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e44157ca0 0x7f9e440cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/3093334665 >> 172.21.15.6:0/3093334665 conn(0x7f9e4406bb90 msgr2=0x7f9e4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/3093334665 shutdown_connections 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.825+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/3093334665 wait complete. 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 Processor -- start 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 -- start start 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e4406d120 0x7f9e4416d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e44157ca0 0x7f9e440c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4416d950 con 0x7f9e441578d0 2023-10-09T11:36:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c8aa0 con 0x7f9e44157ca0 2023-10-09T11:36:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.826+0000 7f9e4c6f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4416bc10 con 0x7f9e4406d120 2023-10-09T11:36:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58798/0 (socket says 172.21.15.6:58798) 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 -- 172.21.15.6:0/2013425278 learned_addr learned my addr 172.21.15.6:0/2013425278 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e4ac95700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e44157ca0 0x7f9e440c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e4a494700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e4406d120 0x7f9e4416d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 -- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e4406d120 msgr2=0x7f9e4416d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e4406d120 0x7f9e4416d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 -- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e44157ca0 msgr2=0x7f9e440c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e44157ca0 0x7f9e440c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 -- 172.21.15.6:0/2013425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c009ae0 con 0x7f9e441578d0 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e49c93700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800d890 tx=0x7f9e38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380125f0 con 0x7f9e441578d0 2023-10-09T11:36:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38012750 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e440c6500 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38012b10 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.827+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440c6ac0 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.828+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e440c8c50 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.829+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e3801e460 con 0x7f9e441578d0 2023-10-09T11:36:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.829+0000 7f9e427fc700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 0x7f9e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.829+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e380849c0 con 0x7f9e441578d0 2023-10-09T11:36:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.829+0000 7f9e4a494700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 0x7f9e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:29.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.830+0000 7f9e4a494700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 0x7f9e300693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e34003a80 tx=0x7f9e34007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:29.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:29.833+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e440c8c50 con 0x7f9e441578d0 2023-10-09T11:36:30.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.072+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e440c8c50 con 0x7f9e441578d0 2023-10-09T11:36:30.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.072+0000 7f9e427fc700 1 -- 172.21.15.6:0/2013425278 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e440c8c50 con 0x7f9e441578d0 2023-10-09T11:36:30.074 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 msgr2=0x7f9e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 0x7f9e300693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e34003a80 tx=0x7f9e34007ec0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 msgr2=0x7f9e4416b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800d890 tx=0x7f9e38008040 comp rx=0 tx=0).stop 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 shutdown_connections 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9e30066f30 0x7f9e300693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e44157ca0 0x7f9e440c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e4406d120 0x7f9e4416d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 --2- 172.21.15.6:0/2013425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e441578d0 0x7f9e4416b6d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 >> 172.21.15.6:0/2013425278 conn(0x7f9e4406bb90 msgr2=0x7f9e44155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 shutdown_connections 2023-10-09T11:36:30.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:30.074+0000 7f9e4c6f8700 1 -- 172.21.15.6:0/2013425278 wait complete. 2023-10-09T11:36:30.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:36:30.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:36:30.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.088 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:36:30.104 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:30.104 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:30.105 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42485sec preferred_lft 42485sec 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.106 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link tentative 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link tentative 2023-10-09T11:36:30.107 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.108 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:36:30.169 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:36:30.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.170 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:36:30.226 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:36:30.226 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:36:30.226 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:36:30.227 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:36:30.227 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:36:30.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.227 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:30.227 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:30.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:36:30.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:36:30.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:36:30.228 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:30.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.326 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:36:30.340 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:36:30.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.340 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-10-09T11:36:30.395 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T11:36:30.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.395 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:30.396 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:30.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:36:30.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T11:36:30.396 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:30.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.483 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.519 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:30.520 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 76:04:7e:df:15:6a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:36:30.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:36:30.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.520 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::7404:7eff:fedf:156a/64 scope link tentative 2023-10-09T11:36:30.520 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.539 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:36:30.612 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 76:04:7e:df:15:6a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::7404:7eff:fedf:156a/64 scope link tentative 2023-10-09T11:36:30.613 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:36:30.621 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T11:36:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T11:36:30.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T11:36:30.622 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:30.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:30.831 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:36:30.831 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:36:30.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2023-10-09T11:36:30.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T11:36:30.832 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:36:30.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:30.912 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T11:36:30.926 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T11:36:30.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:36:30.926 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:36:30.980 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-09T11:36:30.980 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:36:30.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:31.059 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:31.060 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:31.078 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:31.078 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 3@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:31.079 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 3@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:36:31.100 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:36:31.101 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:36:31.101 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:36:31.101 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:36:31.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:36:31.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:31.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T11:36:31.166 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T11:36:31.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:31.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.313+0000 7fb5d9eab700 1 Processor -- start 2023-10-09T11:36:31.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.313+0000 7fb5d9eab700 1 -- start start 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d9eab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 0x7fb5d40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d9eab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40b0ca0 con 0x7fb5d40ceb30 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d9eab700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d40b00d0 con 0x7fb5d406dd60 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d9eab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d406ea90 con 0x7fb5d415a2a0 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb5d40ceb30 0x7fb5d406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42998/0 (socket says 172.21.15.6:42998) 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.314+0000 7fb5d2ffd700 1 -- 172.21.15.6:0/280694121 learned_addr learned my addr 172.21.15.6:0/280694121 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d37fe700 1 --2- 172.21.15.6:0/280694121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 0x7fb5d40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074449255 0 0) 0x7fb5d40b0ca0 con 0x7fb5d40ceb30 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5bc003570 con 0x7fb5d40ceb30 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780981562 0 0) 0x7fb5d40b00d0 con 0x7fb5d406dd60 2023-10-09T11:36:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d40b0ca0 con 0x7fb5d406dd60 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d37fe700 1 -- 172.21.15.6:0/280694121 >> v1:172.21.15.118:6789/0 conn(0x7fb5d406dd60 legacy=0x7fb5d40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d37fe700 1 -- 172.21.15.6:0/280694121 >> v1:172.21.15.6:6789/0 conn(0x7fb5d40ceb30 legacy=0x7fb5d406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d37fe700 1 -- 172.21.15.6:0/280694121 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40b0370 con 0x7fb5d415a2a0 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d37fe700 1 --2- 172.21.15.6:0/280694121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 0x7fb5d40b1130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009910 tx=0x7fb5c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aef4f1abeaa9ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4011630 con 0x7fb5d415a2a0 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4011790 con 0x7fb5d415a2a0 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.315+0000 7fb5d27fc700 1 -- 172.21.15.6:0/280694121 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4011b30 con 0x7fb5d415a2a0 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 -- 172.21.15.6:0/280694121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 msgr2=0x7fb5d40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/280694121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 0x7fb5d40b1130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009910 tx=0x7fb5c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 -- 172.21.15.6:0/280694121 shutdown_connections 2023-10-09T11:36:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/280694121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d415a2a0 0x7fb5d40b1130 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 -- 172.21.15.6:0/280694121 >> 172.21.15.6:0/280694121 conn(0x7fb5d4067640 msgr2=0x7fb5d4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 -- 172.21.15.6:0/280694121 shutdown_connections 2023-10-09T11:36:31.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.316+0000 7fb5d9eab700 1 -- 172.21.15.6:0/280694121 wait complete. 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.317+0000 7fb5d9eab700 1 Processor -- start 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.317+0000 7fb5d9eab700 1 -- start start 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d406dd60 0x7fb5d415e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d40ceb30 0x7fb5d41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d416e240 con 0x7fb5d415a2a0 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d416e710 con 0x7fb5d406dd60 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d9eab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d415dbb0 con 0x7fb5d40ceb30 2023-10-09T11:36:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58814/0 (socket says 172.21.15.6:58814) 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d3fff700 1 -- 172.21.15.6:0/4175279092 learned_addr learned my addr 172.21.15.6:0/4175279092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d37fe700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d406dd60 0x7fb5d415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.318+0000 7fb5d2ffd700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d40ceb30 0x7fb5d41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 -- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d40ceb30 msgr2=0x7fb5d41562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d40ceb30 0x7fb5d41562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 -- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d406dd60 msgr2=0x7fb5d415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d406dd60 0x7fb5d415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 -- 172.21.15.6:0/4175279092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4009420 con 0x7fb5d415a2a0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d3fff700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c910 tx=0x7fb5cc0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00a7e0 con 0x7fb5d415a2a0 2023-10-09T11:36:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00a960 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d415e580 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00ad20 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.319+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d415d560 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.320+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d415dd20 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.320+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5cc012630 con 0x7fb5d415a2a0 2023-10-09T11:36:31.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.321+0000 7fb5bb7fe700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.321+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5cc0849f0 con 0x7fb5d415a2a0 2023-10-09T11:36:31.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.321+0000 7fb5d37fe700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.321+0000 7fb5d37fe700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 0x7fb5c00693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40cc740 tx=0x7fb5c4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.325+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5cc051d10 con 0x7fb5d415a2a0 2023-10-09T11:36:31.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.523+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5d40cf470 con 0x7fb5d415a2a0 2023-10-09T11:36:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.524+0000 7fb5bb7fe700 1 -- 172.21.15.6:0/4175279092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb5cc055330 con 0x7fb5d415a2a0 2023-10-09T11:36:31.525 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:31.525 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 msgr2=0x7fb5c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 0x7fb5c00693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40cc740 tx=0x7fb5c4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 msgr2=0x7fb5d4153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c910 tx=0x7fb5cc0027a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 shutdown_connections 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb5c0066f30 0x7fb5c00693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5d415a2a0 0x7fb5d4153530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d406dd60 0x7fb5d415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 --2- 172.21.15.6:0/4175279092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5d40ceb30 0x7fb5d41562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.525+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 >> 172.21.15.6:0/4175279092 conn(0x7fb5d4067640 msgr2=0x7fb5d40ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.526+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 shutdown_connections 2023-10-09T11:36:31.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.526+0000 7fb5d9eab700 1 -- 172.21.15.6:0/4175279092 wait complete. 2023-10-09T11:36:31.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:31.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:31.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.660+0000 7f66d1a3e700 1 Processor -- start 2023-10-09T11:36:31.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.660+0000 7f66d1a3e700 1 -- start start 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66d1a3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc159b40 0x7f66cc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66d1a3e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66cc159f10 0x7f66cc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66d1a3e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc0cee10 con 0x7f66cc0ccb40 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66d1a3e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0cd040 con 0x7f66cc159f10 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66d1a3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0cd320 con 0x7f66cc159b40 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66ca7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66cc159f10 0x7f66cc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66cb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f66cc0ccb40 0x7f66cc15d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43008/0 (socket says 172.21.15.6:43008) 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66cb7fe700 1 -- 172.21.15.6:0/690378678 learned_addr learned my addr 172.21.15.6:0/690378678 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66caffd700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc159b40 0x7f66cc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66ca7fc700 1 -- 172.21.15.6:0/690378678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc159b40 msgr2=0x7f66cc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66ca7fc700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc159b40 0x7f66cc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.661+0000 7f66ca7fc700 1 -- 172.21.15.6:0/690378678 >> v1:172.21.15.6:6789/0 conn(0x7f66cc0ccb40 legacy=0x7f66cc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66ca7fc700 1 -- 172.21.15.6:0/690378678 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0ce7c0 con 0x7f66cc159f10 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66c9ffb700 1 -- 172.21.15.6:0/690378678 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322881827 0 0) 0x7f66cc0cee10 con 0x7f66cc0ccb40 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66ca7fc700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc068780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098e0 tx=0x7f66b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6591353aaa3802d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66c9ffb700 1 -- 172.21.15.6:0/690378678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400b640 con 0x7f66cc159f10 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66c9ffb700 1 -- 172.21.15.6:0/690378678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b400b7a0 con 0x7f66cc159f10 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66c9ffb700 1 -- 172.21.15.6:0/690378678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400bb40 con 0x7f66cc159f10 2023-10-09T11:36:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 -- 172.21.15.6:0/690378678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 msgr2=0x7f66cc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc068780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098e0 tx=0x7f66b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 -- 172.21.15.6:0/690378678 shutdown_connections 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc159b40 0x7f66cc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/690378678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc068780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 -- 172.21.15.6:0/690378678 >> 172.21.15.6:0/690378678 conn(0x7f66cc0cd660 msgr2=0x7f66cc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 -- 172.21.15.6:0/690378678 shutdown_connections 2023-10-09T11:36:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.662+0000 7f66d1a3e700 1 -- 172.21.15.6:0/690378678 wait complete. 2023-10-09T11:36:31.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.664+0000 7f66d1a3e700 1 Processor -- start 2023-10-09T11:36:31.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.664+0000 7f66d1a3e700 1 -- start start 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.664+0000 7f66d1a3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc0ccb40 0x7f66cc158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.664+0000 7f66d1a3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66cc159b40 0x7f66cc157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0c9920 con 0x7f66cc159f10 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0c8d10 con 0x7f66cc159b40 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0c8ff0 con 0x7f66cc0ccb40 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58838/0 (socket says 172.21.15.6:58838) 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 -- 172.21.15.6:0/2106232761 learned_addr learned my addr 172.21.15.6:0/2106232761 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66caffd700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc0ccb40 0x7f66cc158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66ca7fc700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66cc159b40 0x7f66cc157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 -- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc0ccb40 msgr2=0x7f66cc158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc0ccb40 0x7f66cc158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 -- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66cc159b40 msgr2=0x7f66cc157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66cc159b40 0x7f66cc157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 -- 172.21.15.6:0/2106232761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009420 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66cb7fe700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c7e0 tx=0x7f66bc007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc005c00 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc005d80 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc0c92d0 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc007320 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.665+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc159140 con 0x7f66cc159f10 2023-10-09T11:36:31.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.666+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc0cc0e0 con 0x7f66cc159f10 2023-10-09T11:36:31.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.667+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66bc01b3b0 con 0x7f66cc159f10 2023-10-09T11:36:31.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.667+0000 7f66c2ffd700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 0x7f66ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:31.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.667+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66bc083970 con 0x7f66cc159f10 2023-10-09T11:36:31.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.667+0000 7f66caffd700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 0x7f66ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:31.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.668+0000 7f66caffd700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 0x7f66ac0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66c400f570 tx=0x7f66c400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:31.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.671+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66bc050be0 con 0x7f66cc159f10 2023-10-09T11:36:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.862+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66cc0ceaa0 con 0x7f66cc159f10 2023-10-09T11:36:31.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.862+0000 7f66c2ffd700 1 -- 172.21.15.6:0/2106232761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66bc017070 con 0x7f66cc159f10 2023-10-09T11:36:31.864 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 msgr2=0x7f66ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 0x7f66ac0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66c400f570 tx=0x7f66c400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 msgr2=0x7f66cc0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c7e0 tx=0x7f66bc007d90 comp rx=0 tx=0).stop 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 shutdown_connections 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f66ac066f30 0x7f66ac0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66cc159f10 0x7f66cc0c9db0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66cc0ccb40 0x7f66cc158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 --2- 172.21.15.6:0/2106232761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66cc159b40 0x7f66cc157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 >> 172.21.15.6:0/2106232761 conn(0x7f66cc0cd660 msgr2=0x7f66cc06efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 shutdown_connections 2023-10-09T11:36:31.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.864+0000 7f66d1a3e700 1 -- 172.21.15.6:0/2106232761 wait complete. 2023-10-09T11:36:31.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.998+0000 7fbf959d4700 1 Processor -- start 2023-10-09T11:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.998+0000 7fbf959d4700 1 -- start start 2023-10-09T11:36:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf959d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 0x7fbf900b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf959d4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 0x7fbf900cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf959d4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900cf4e0 con 0x7fbf9006d650 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf959d4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9006ea90 con 0x7fbf900ceb30 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf959d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b0ca0 con 0x7fbf9015a2a0 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf8f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf9006d650 0x7fbf9006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43016/0 (socket says 172.21.15.6:43016) 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf8f7fe700 1 -- 172.21.15.6:0/1375782738 learned_addr learned my addr 172.21.15.6:0/1375782738 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf8e7fc700 1 --2- 172.21.15.6:0/1375782738 >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 0x7fbf900cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:31.999+0000 7fbf8effd700 1 --2- 172.21.15.6:0/1375782738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 0x7fbf900b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8dffb700 1 -- 172.21.15.6:0/1375782738 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324130638 0 0) 0x7fbf900cf4e0 con 0x7fbf9006d650 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8dffb700 1 -- 172.21.15.6:0/1375782738 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf7c003570 con 0x7fbf9006d650 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8effd700 1 -- 172.21.15.6:0/1375782738 >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 msgr2=0x7fbf900cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8effd700 1 --2- 172.21.15.6:0/1375782738 >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 0x7fbf900cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8effd700 1 -- 172.21.15.6:0/1375782738 >> v1:172.21.15.6:6789/0 conn(0x7fbf9006d650 legacy=0x7fbf9006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8effd700 1 -- 172.21.15.6:0/1375782738 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900b00d0 con 0x7fbf9015a2a0 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8e7fc700 1 --2- 172.21.15.6:0/1375782738 >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 0x7fbf900cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8effd700 1 --2- 172.21.15.6:0/1375782738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 0x7fbf900b1130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e75a5f06217f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8dffb700 1 -- 172.21.15.6:0/1375782738 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011630 con 0x7fbf9015a2a0 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8dffb700 1 -- 172.21.15.6:0/1375782738 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88011790 con 0x7fbf9015a2a0 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.000+0000 7fbf8dffb700 1 -- 172.21.15.6:0/1375782738 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011b10 con 0x7fbf9015a2a0 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 -- 172.21.15.6:0/1375782738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 msgr2=0x7fbf900b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1375782738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 0x7fbf900b1130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf880098e0 tx=0x7fbf880091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 -- 172.21.15.6:0/1375782738 shutdown_connections 2023-10-09T11:36:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1375782738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9015a2a0 0x7fbf900b1130 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1375782738 >> v2:172.21.15.118:3300/0 conn(0x7fbf900ceb30 0x7fbf900cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 -- 172.21.15.6:0/1375782738 >> 172.21.15.6:0/1375782738 conn(0x7fbf90067640 msgr2=0x7fbf90067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 -- 172.21.15.6:0/1375782738 shutdown_connections 2023-10-09T11:36:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.001+0000 7fbf959d4700 1 -- 172.21.15.6:0/1375782738 wait complete. 2023-10-09T11:36:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.002+0000 7fbf959d4700 1 Processor -- start 2023-10-09T11:36:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.002+0000 7fbf959d4700 1 -- start start 2023-10-09T11:36:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9006d650 0x7fbf90150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf900ceb30 0x7fbf901500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9015f340 con 0x7fbf9015a2a0 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9015f5e0 con 0x7fbf900ceb30 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf959d4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9015f8c0 con 0x7fbf9006d650 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8effd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9006d650 0x7fbf90150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58844/0 (socket says 172.21.15.6:58844) 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 -- 172.21.15.6:0/1314478284 learned_addr learned my addr 172.21.15.6:0/1314478284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8e7fc700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf900ceb30 0x7fbf901500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 -- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9006d650 msgr2=0x7fbf90150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9006d650 0x7fbf90150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 -- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf900ceb30 msgr2=0x7fbf901500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf900ceb30 0x7fbf901500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 -- 172.21.15.6:0/1314478284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf78009420 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf8f7fe700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf80001460 tx=0x7fbf80001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000a890 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.003+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000a9f0 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.004+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf88009420 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.004+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000ad70 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.004+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf90150620 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.004+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf90069e40 con 0x7fbf9015a2a0 2023-10-09T11:36:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.005+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf80007300 con 0x7fbf9015a2a0 2023-10-09T11:36:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.005+0000 7fbf86ffd700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.005+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf800849b0 con 0x7fbf9015a2a0 2023-10-09T11:36:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.005+0000 7fbf8effd700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.006+0000 7fbf8effd700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 0x7fbf700693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf880091e0 tx=0x7fbf88017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.010+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf80051c10 con 0x7fbf9015a2a0 2023-10-09T11:36:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.204+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf901588c0 con 0x7fbf9015a2a0 2023-10-09T11:36:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.205+0000 7fbf86ffd700 1 -- 172.21.15.6:0/1314478284 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf80055230 con 0x7fbf9015a2a0 2023-10-09T11:36:32.207 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 msgr2=0x7fbf700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 0x7fbf700693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf880091e0 tx=0x7fbf88017000 comp rx=0 tx=0).stop 2023-10-09T11:36:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 msgr2=0x7fbf900b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf80001460 tx=0x7fbf80001ae0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 shutdown_connections 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf9015a2a0 0x7fbf900b2910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf9006d650 0x7fbf90150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 --2- 172.21.15.6:0/1314478284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf900ceb30 0x7fbf901500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 >> 172.21.15.6:0/1314478284 conn(0x7fbf90067640 msgr2=0x7fbf900ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 shutdown_connections 2023-10-09T11:36:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.207+0000 7fbf959d4700 1 -- 172.21.15.6:0/1314478284 wait complete. 2023-10-09T11:36:32.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.342+0000 7fd768ee4700 1 Processor -- start 2023-10-09T11:36:32.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.342+0000 7fd768ee4700 1 -- start start 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd768ee4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7640d0b80 0x7fd7640cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd768ee4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd76406d700 0x7fd76415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd768ee4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640cf2d0 con 0x7fd7640d02b0 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd768ee4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76415a690 con 0x7fd76406d700 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd768ee4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406dc00 con 0x7fd7640d0b80 2023-10-09T11:36:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd76406d700 0x7fd76415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd76406d700 0x7fd76415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58856/0 (socket says 172.21.15.6:58856) 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 -- 172.21.15.6:0/3719189670 learned_addr learned my addr 172.21.15.6:0/3719189670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd7637fe700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7640d0b80 0x7fd7640cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 -- 172.21.15.6:0/3719189670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7640d0b80 msgr2=0x7fd7640cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7640d0b80 0x7fd7640cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 -- 172.21.15.6:0/3719189670 >> v1:172.21.15.118:6789/0 conn(0x7fd7640d02b0 legacy=0x7fd76406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.343+0000 7fd763fff700 1 -- 172.21.15.6:0/3719189670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640cf570 con 0x7fd76406d700 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd763fff700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406d700 0x7fd76415b320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009f20 tx=0x7fd75c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3f5d022cea3c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd7627fc700 1 -- 172.21.15.6:0/3719189670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00e070 con 0x7fd76406d700 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd7627fc700 1 -- 172.21.15.6:0/3719189670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00b9d0 con 0x7fd76406d700 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd7627fc700 1 -- 172.21.15.6:0/3719189670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0092e0 con 0x7fd76406d700 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 -- 172.21.15.6:0/3719189670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406d700 msgr2=0x7fd76415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406d700 0x7fd76415b320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009f20 tx=0x7fd75c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 -- 172.21.15.6:0/3719189670 shutdown_connections 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd76406d700 0x7fd76415b320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 --2- 172.21.15.6:0/3719189670 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7640d0b80 0x7fd7640cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 -- 172.21.15.6:0/3719189670 >> 172.21.15.6:0/3719189670 conn(0x7fd764063230 msgr2=0x7fd764063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 -- 172.21.15.6:0/3719189670 shutdown_connections 2023-10-09T11:36:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.344+0000 7fd768ee4700 1 -- 172.21.15.6:0/3719189670 wait complete. 2023-10-09T11:36:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 Processor -- start 2023-10-09T11:36:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 -- start start 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76406d700 0x7fd764139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640d0b80 0x7fd764153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641529c0 con 0x7fd7640d02b0 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764154530 con 0x7fd7640d0b80 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd768ee4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764154810 con 0x7fd76406d700 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.346+0000 7fd762ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58860/0 (socket says 172.21.15.6:58860) 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 -- 172.21.15.6:0/2896388686 learned_addr learned my addr 172.21.15.6:0/2896388686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd7637fe700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76406d700 0x7fd764139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd763fff700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640d0b80 0x7fd764153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 -- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76406d700 msgr2=0x7fd764139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76406d700 0x7fd764139cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 -- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640d0b80 msgr2=0x7fd764153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640d0b80 0x7fd764153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 -- 172.21.15.6:0/2896388686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009ae0 con 0x7fd7640d02b0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd762ffd700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c590 tx=0x7fd75800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011590 con 0x7fd7640d02b0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758011710 con 0x7fd7640d02b0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764154af0 con 0x7fd7640d02b0 2023-10-09T11:36:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011ad0 con 0x7fd7640d02b0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.347+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641550b0 con 0x7fd7640d02b0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.348+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640676e0 con 0x7fd7640d02b0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.349+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd75801b3b0 con 0x7fd7640d02b0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.349+0000 7fd74b7fe700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.349+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd758083960 con 0x7fd7640d02b0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.349+0000 7fd7637fe700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.349+0000 7fd7637fe700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d10 tx=0x7fd7540091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.353+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd758050bd0 con 0x7fd7640d02b0 2023-10-09T11:36:32.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.545+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd764071b10 con 0x7fd7640d02b0 2023-10-09T11:36:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.545+0000 7fd74b7fe700 1 -- 172.21.15.6:0/2896388686 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd758017070 con 0x7fd7640d02b0 2023-10-09T11:36:32.547 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 msgr2=0x7fd7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd754009d10 tx=0x7fd7540091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 msgr2=0x7fd7641539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c590 tx=0x7fd75800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 shutdown_connections 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640d0b80 0x7fd764153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd76406d700 0x7fd764139cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 --2- 172.21.15.6:0/2896388686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7640d02b0 0x7fd7641539c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 >> 172.21.15.6:0/2896388686 conn(0x7fd764063230 msgr2=0x7fd7641574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 shutdown_connections 2023-10-09T11:36:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.547+0000 7fd768ee4700 1 -- 172.21.15.6:0/2896388686 wait complete. 2023-10-09T11:36:32.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.679+0000 7fd4fef59700 1 Processor -- start 2023-10-09T11:36:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.679+0000 7fd4fef59700 1 -- start start 2023-10-09T11:36:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fef59700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd4f80ce270 0x7fd4f806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fef59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4f806a020 0x7fd4f815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fef59700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80cbec0 con 0x7fd4f8157860 2023-10-09T11:36:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fef59700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f80cb9d0 con 0x7fd4f806a020 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fef59700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f815b2d0 con 0x7fd4f80ce270 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fe758700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4f806a020 0x7fd4f815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fdf57700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4f8157860 0x7fd4f80cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43026/0 (socket says 172.21.15.6:43026) 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fdf57700 1 -- 172.21.15.6:0/4035260537 learned_addr learned my addr 172.21.15.6:0/4035260537 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fd756700 1 --2- 172.21.15.6:0/4035260537 >> v2:172.21.15.118:3300/0 conn(0x7fd4f80ce270 0x7fd4f806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fe758700 1 -- 172.21.15.6:0/4035260537 >> v2:172.21.15.118:3300/0 conn(0x7fd4f80ce270 msgr2=0x7fd4f806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fe758700 1 --2- 172.21.15.6:0/4035260537 >> v2:172.21.15.118:3300/0 conn(0x7fd4f80ce270 0x7fd4f806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fe758700 1 -- 172.21.15.6:0/4035260537 >> v1:172.21.15.6:6789/0 conn(0x7fd4f8157860 legacy=0x7fd4f80cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fe758700 1 -- 172.21.15.6:0/4035260537 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80cc180 con 0x7fd4f806a020 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.680+0000 7fd4fcf55700 1 -- 172.21.15.6:0/4035260537 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382064994 0 0) 0x7fd4f80cbec0 con 0x7fd4f8157860 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fe758700 1 --2- 172.21.15.6:0/4035260537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f815a300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80b0540 tx=0x7fd4f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5f8c52846f313d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fcf55700 1 -- 172.21.15.6:0/4035260537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4011630 con 0x7fd4f806a020 2023-10-09T11:36:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fcf55700 1 -- 172.21.15.6:0/4035260537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4011790 con 0x7fd4f806a020 2023-10-09T11:36:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fcf55700 1 -- 172.21.15.6:0/4035260537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4011b30 con 0x7fd4f806a020 2023-10-09T11:36:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 -- 172.21.15.6:0/4035260537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 msgr2=0x7fd4f815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 --2- 172.21.15.6:0/4035260537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f815a300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80b0540 tx=0x7fd4f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 -- 172.21.15.6:0/4035260537 shutdown_connections 2023-10-09T11:36:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 --2- 172.21.15.6:0/4035260537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f815a300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 --2- 172.21.15.6:0/4035260537 >> v2:172.21.15.118:3300/0 conn(0x7fd4f80ce270 0x7fd4f806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 -- 172.21.15.6:0/4035260537 >> 172.21.15.6:0/4035260537 conn(0x7fd4f8063230 msgr2=0x7fd4f8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 -- 172.21.15.6:0/4035260537 shutdown_connections 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.681+0000 7fd4fef59700 1 -- 172.21.15.6:0/4035260537 wait complete. 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.682+0000 7fd4fef59700 1 Processor -- start 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.682+0000 7fd4fef59700 1 -- start start 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80ce270 0x7fd4f815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4f8157860 0x7fd4f814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f814fd10 con 0x7fd4f806a020 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f8150a80 con 0x7fd4f80ce270 2023-10-09T11:36:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fef59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f814ff00 con 0x7fd4f8157860 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fdf57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fdf57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58886/0 (socket says 172.21.15.6:58886) 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fdf57700 1 -- 172.21.15.6:0/383039173 learned_addr learned my addr 172.21.15.6:0/383039173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fd756700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80ce270 0x7fd4f815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.683+0000 7fd4fe758700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4f8157860 0x7fd4f814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 -- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4f8157860 msgr2=0x7fd4f814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4f8157860 0x7fd4f814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 -- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80ce270 msgr2=0x7fd4f815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80ce270 0x7fd4f815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 -- 172.21.15.6:0/383039173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009420 con 0x7fd4f806a020 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fdf57700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000cc70 tx=0x7fd4f0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000a890 con 0x7fd4f806a020 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000a9f0 con 0x7fd4f806a020 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f81501e0 con 0x7fd4f806a020 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000adb0 con 0x7fd4f806a020 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.684+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f81507a0 con 0x7fd4f806a020 2023-10-09T11:36:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.685+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f80690d0 con 0x7fd4f806a020 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.685+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4f0007300 con 0x7fd4f806a020 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.686+0000 7fd4edffb700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 0x7fd4dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.686+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4f00847e0 con 0x7fd4f806a020 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.686+0000 7fd4fd756700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 0x7fd4dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.686+0000 7fd4fd756700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 0x7fd4dc0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4f815c770 tx=0x7fd4e80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.690+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4f0051ad0 con 0x7fd4f806a020 2023-10-09T11:36:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.887+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4f8071b10 con 0x7fd4f806a020 2023-10-09T11:36:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.888+0000 7fd4edffb700 1 -- 172.21.15.6:0/383039173 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd4f00550f0 con 0x7fd4f806a020 2023-10-09T11:36:32.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:32.890 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 msgr2=0x7fd4dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 0x7fd4dc0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4f815c770 tx=0x7fd4e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 msgr2=0x7fd4f814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000cc70 tx=0x7fd4f0001a30 comp rx=0 tx=0).stop 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 shutdown_connections 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4dc066f30 0x7fd4dc0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4f8157860 0x7fd4f814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f806a020 0x7fd4f814b200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 --2- 172.21.15.6:0/383039173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4f80ce270 0x7fd4f815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 >> 172.21.15.6:0/383039173 conn(0x7fd4f8063230 msgr2=0x7fd4f8152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 shutdown_connections 2023-10-09T11:36:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:32.890+0000 7fd4fef59700 1 -- 172.21.15.6:0/383039173 wait complete. 2023-10-09T11:36:32.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:32.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:33.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.025+0000 7f590a076700 1 Processor -- start 2023-10-09T11:36:33.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.025+0000 7f590a076700 1 -- start start 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.025+0000 7f590a076700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59041578d0 0x7f59040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f590a076700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 0x7f590415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f590a076700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 0x7f590406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f590a076700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59040d07c0 con 0x7f59041578d0 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f590a076700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590406daa0 con 0x7f5904157ca0 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f590a076700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59040cfbb0 con 0x7f590406d120 2023-10-09T11:36:33.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59041578d0 0x7f59040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59041578d0 0x7f59040cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58902/0 (socket says 172.21.15.6:58902) 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 -- 172.21.15.6:0/737046486 learned_addr learned my addr 172.21.15.6:0/737046486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f5902ffd700 1 --2- 172.21.15.6:0/737046486 >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 0x7f590415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f5903fff700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 0x7f590406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 -- 172.21.15.6:0/737046486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 msgr2=0x7f590406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 0x7f590406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 -- 172.21.15.6:0/737046486 >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 msgr2=0x7f590415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 --2- 172.21.15.6:0/737046486 >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 0x7f590415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 -- 172.21.15.6:0/737046486 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040cfe90 con 0x7f59041578d0 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f5902ffd700 1 --2- 172.21.15.6:0/737046486 >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 0x7f590415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:33.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f5903fff700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 0x7f590406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59037fe700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59041578d0 0x7f59040cf4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5904068510 tx=0x7f58f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbaeaaafe1e190c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59027fc700 1 -- 172.21.15.6:0/737046486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400b860 con 0x7f59041578d0 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59027fc700 1 -- 172.21.15.6:0/737046486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400b9c0 con 0x7f59041578d0 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.026+0000 7f59027fc700 1 -- 172.21.15.6:0/737046486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400bd60 con 0x7f59041578d0 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 -- 172.21.15.6:0/737046486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59041578d0 msgr2=0x7f59040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59041578d0 0x7f59040cf4f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5904068510 tx=0x7f58f4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 -- 172.21.15.6:0/737046486 shutdown_connections 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f590406d120 0x7f590406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 --2- 172.21.15.6:0/737046486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59041578d0 0x7f59040cf4f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 --2- 172.21.15.6:0/737046486 >> v2:172.21.15.118:3300/0 conn(0x7f5904157ca0 0x7f590415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 -- 172.21.15.6:0/737046486 >> 172.21.15.6:0/737046486 conn(0x7f590406bb90 msgr2=0x7f590406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 -- 172.21.15.6:0/737046486 shutdown_connections 2023-10-09T11:36:33.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.027+0000 7f590a076700 1 -- 172.21.15.6:0/737046486 wait complete. 2023-10-09T11:36:33.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.028+0000 7f590a076700 1 Processor -- start 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.028+0000 7f590a076700 1 -- start start 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 0x7f59040aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5904157ca0 0x7f59040aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5904158d90 con 0x7f590406d120 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5904159d40 con 0x7f59041578d0 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f590a076700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59041598b0 con 0x7f5904157ca0 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58910/0 (socket says 172.21.15.6:58910) 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 -- 172.21.15.6:0/3707199196 learned_addr learned my addr 172.21.15.6:0/3707199196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:33.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f5902ffd700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 0x7f59040aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f5903fff700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5904157ca0 0x7f59040aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 -- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5904157ca0 msgr2=0x7f59040aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5904157ca0 0x7f59040aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 -- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 msgr2=0x7f59040aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 0x7f59040aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 -- 172.21.15.6:0/3707199196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40094f0 con 0x7f590406d120 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f5902ffd700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 0x7f59040aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.029+0000 7f59037fe700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58f40090b0 tx=0x7f58f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.030+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4026480 con 0x7f590406d120 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.030+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f401f070 con 0x7f590406d120 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.030+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59040ab990 con 0x7f590406d120 2023-10-09T11:36:33.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.030+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4026830 con 0x7f590406d120 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.030+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904159260 con 0x7f590406d120 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.031+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5904159b90 con 0x7f590406d120 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.031+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58f4026ba0 con 0x7f590406d120 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.032+0000 7f58eb7fe700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.032+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58f4021070 con 0x7f590406d120 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.032+0000 7f5902ffd700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.032+0000 7f5902ffd700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 0x7f58f00693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f590415c320 tx=0x7f58f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.036+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58f4053c80 con 0x7f590406d120 2023-10-09T11:36:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.230+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59040cead0 con 0x7f590406d120 2023-10-09T11:36:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.231+0000 7f58eb7fe700 1 -- 172.21.15.6:0/3707199196 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58f40150a0 con 0x7f590406d120 2023-10-09T11:36:33.232 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 msgr2=0x7f58f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 0x7f58f00693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f590415c320 tx=0x7f58f8008040 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 msgr2=0x7f5904147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58f40090b0 tx=0x7f58f4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 shutdown_connections 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5904157ca0 0x7f59040aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f590406d120 0x7f5904147670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 --2- 172.21.15.6:0/3707199196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59041578d0 0x7f59040aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 >> 172.21.15.6:0/3707199196 conn(0x7f590406bb90 msgr2=0x7f590415b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 shutdown_connections 2023-10-09T11:36:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.233+0000 7f590a076700 1 -- 172.21.15.6:0/3707199196 wait complete. 2023-10-09T11:36:33.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 Processor -- start 2023-10-09T11:36:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 -- start start 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c98157fe0 0x7f8c980b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c980b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c980b2890 con 0x7f8c980ceb30 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980b4070 con 0x7f8c98157fe0 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.367+0000 7f8c9e5b7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980b4350 con 0x7f8c981583b0 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c98157fe0 0x7f8c980b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c9cb54700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c980ceb30 0x7f8c980cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46484/0 (socket says 172.21.15.6:46484) 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c9cb54700 1 -- 172.21.15.6:0/3072388615 learned_addr learned my addr 172.21.15.6:0/3072388615 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c977fe700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c980b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 -- 172.21.15.6:0/3072388615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 msgr2=0x7f8c980b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c980b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 -- 172.21.15.6:0/3072388615 >> v1:172.21.15.6:6789/0 conn(0x7f8c980ceb30 legacy=0x7f8c980cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c96ffd700 1 -- 172.21.15.6:0/3072388615 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458614798 0 0) 0x7f8c980b2890 con 0x7f8c980ceb30 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 -- 172.21.15.6:0/3072388615 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980b4630 con 0x7f8c98157fe0 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c97fff700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c98157fe0 0x7f8c980b34c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098e0 tx=0x7f8c880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69886459ccc882dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c96ffd700 1 -- 172.21.15.6:0/3072388615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88009e80 con 0x7f8c98157fe0 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c96ffd700 1 -- 172.21.15.6:0/3072388615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800b860 con 0x7f8c98157fe0 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.368+0000 7f8c96ffd700 1 -- 172.21.15.6:0/3072388615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800bbe0 con 0x7f8c98157fe0 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/3072388615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c98157fe0 msgr2=0x7f8c980b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c98157fe0 0x7f8c980b34c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098e0 tx=0x7f8c880091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/3072388615 shutdown_connections 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c98157fe0 0x7f8c980b34c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/3072388615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c980b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/3072388615 >> 172.21.15.6:0/3072388615 conn(0x7f8c98067640 msgr2=0x7f8c98067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/3072388615 shutdown_connections 2023-10-09T11:36:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.369+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/3072388615 wait complete. 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.370+0000 7f8c9e5b7700 1 Processor -- start 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.370+0000 7f8c9e5b7700 1 -- start start 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c98157fe0 0x7f8c980cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c981551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c5490 con 0x7f8c980ceb30 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c4850 con 0x7f8c98157fe0 2023-10-09T11:36:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9e5b7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c72d0 con 0x7f8c981583b0 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48006/0 (socket says 172.21.15.6:48006) 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 -- 172.21.15.6:0/2268149989 learned_addr learned my addr 172.21.15.6:0/2268149989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c977fe700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c98157fe0 0x7f8c980cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c9cb54700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c981551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 -- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 msgr2=0x7f8c981551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c981551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 -- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c98157fe0 msgr2=0x7f8c980cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c98157fe0 0x7f8c980cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.371+0000 7f8c97fff700 1 -- 172.21.15.6:0/2268149989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88009420 con 0x7f8c980ceb30 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c97fff700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800b3c0 tx=0x7f8c88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800b9d0 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800bb70 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c980c75b0 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88011670 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.372+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c980c7b70 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.373+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c98069e40 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.373+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c88011aa0 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.373+0000 7f8c7ffff700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 0x7f8c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.374+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c88085cb0 con 0x7f8c980ceb30 2023-10-09T11:36:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.374+0000 7f8c977fe700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 0x7f8c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.374+0000 7f8c977fe700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 0x7f8c840693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c006fd0 tx=0x7f8c8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.378+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c88052f20 con 0x7f8c980ceb30 2023-10-09T11:36:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.570+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c980cc6b0 con 0x7f8c980ceb30 2023-10-09T11:36:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.571+0000 7f8c7ffff700 1 -- 172.21.15.6:0/2268149989 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c88056540 con 0x7f8c980ceb30 2023-10-09T11:36:33.572 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 msgr2=0x7f8c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 0x7f8c840693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c006fd0 tx=0x7f8c8c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 msgr2=0x7f8c980c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800b3c0 tx=0x7f8c88017000 comp rx=0 tx=0).stop 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 shutdown_connections 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c84066f30 0x7f8c840693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c981583b0 0x7f8c981551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c980ceb30 0x7f8c980c4310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 --2- 172.21.15.6:0/2268149989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c98157fe0 0x7f8c980cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 >> 172.21.15.6:0/2268149989 conn(0x7f8c98067640 msgr2=0x7f8c981535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 shutdown_connections 2023-10-09T11:36:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.573+0000 7f8c9e5b7700 1 -- 172.21.15.6:0/2268149989 wait complete. 2023-10-09T11:36:33.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:33.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.707+0000 7f4863f6c700 1 Processor -- start 2023-10-09T11:36:33.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.707+0000 7f4863f6c700 1 -- start start 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f485c15e170 0x7f485c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c15e540 0x7f485c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0cfdd0 0x7f485c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0cf940 con 0x7f485c15e540 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0cf010 con 0x7f485c15e170 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4863f6c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0cf2f0 con 0x7f485c0cfdd0 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4861507700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c15e540 0x7f485c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4861507700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f485c15e540 0x7f485c06d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48010/0 (socket says 172.21.15.6:48010) 2023-10-09T11:36:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.708+0000 7f4861507700 1 -- 172.21.15.6:0/2451137365 learned_addr learned my addr 172.21.15.6:0/2451137365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861d08700 1 --2- 172.21.15.6:0/2451137365 >> v2:172.21.15.118:3300/0 conn(0x7f485c15e170 0x7f485c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4862509700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0cfdd0 0x7f485c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 -- 172.21.15.6:0/2451137365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0cfdd0 msgr2=0x7f485c06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0cfdd0 0x7f485c06d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 -- 172.21.15.6:0/2451137365 >> v2:172.21.15.118:3300/0 conn(0x7f485c15e170 msgr2=0x7f485c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 --2- 172.21.15.6:0/2451137365 >> v2:172.21.15.118:3300/0 conn(0x7f485c15e170 0x7f485c0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 -- 172.21.15.6:0/2451137365 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0cf5d0 con 0x7f485c15e540 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4861507700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c06d120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f485c0646e0 tx=0x7f4850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f106214dcef87c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4860d06700 1 -- 172.21.15.6:0/2451137365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000b640 con 0x7f485c15e540 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4860d06700 1 -- 172.21.15.6:0/2451137365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000b7a0 con 0x7f485c15e540 2023-10-09T11:36:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.709+0000 7f4860d06700 1 -- 172.21.15.6:0/2451137365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bb60 con 0x7f485c15e540 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 -- 172.21.15.6:0/2451137365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 msgr2=0x7f485c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c06d120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f485c0646e0 tx=0x7f4850009250 comp rx=0 tx=0).stop 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 -- 172.21.15.6:0/2451137365 shutdown_connections 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c0cfdd0 0x7f485c06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 --2- 172.21.15.6:0/2451137365 >> v2:172.21.15.118:3300/0 conn(0x7f485c15e170 0x7f485c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 --2- 172.21.15.6:0/2451137365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c06d120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 -- 172.21.15.6:0/2451137365 >> 172.21.15.6:0/2451137365 conn(0x7f485c06bb90 msgr2=0x7f485c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 -- 172.21.15.6:0/2451137365 shutdown_connections 2023-10-09T11:36:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.710+0000 7f4863f6c700 1 -- 172.21.15.6:0/2451137365 wait complete. 2023-10-09T11:36:33.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.711+0000 7f4863f6c700 1 Processor -- start 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.711+0000 7f4863f6c700 1 -- start start 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0cfdd0 0x7f485c16e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c15e170 0x7f485c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15f240 con 0x7f485c15e540 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c161580 con 0x7f485c0cfdd0 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15e910 con 0x7f485c15e170 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48022/0 (socket says 172.21.15.6:48022) 2023-10-09T11:36:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 -- 172.21.15.6:0/4223643301 learned_addr learned my addr 172.21.15.6:0/4223643301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4861d08700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0cfdd0 0x7f485c16e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4861507700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c15e170 0x7f485c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 -- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c15e170 msgr2=0x7f485c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c15e170 0x7f485c1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 -- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0cfdd0 msgr2=0x7f485c16e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0cfdd0 0x7f485c16e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 -- 172.21.15.6:0/4223643301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500094f0 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4862509700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f484c009ef0 tx=0x7f484c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00cc20 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c00f040 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c014480 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.712+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c15ebf0 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.713+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c1569e0 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.714+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c15f3b0 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.714+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f484c014830 con 0x7f485c15e540 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.715+0000 7f4859ffb700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.715+0000 7f4861d08700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.715+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f484c085240 con 0x7f485c15e540 2023-10-09T11:36:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.715+0000 7f4861d08700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 0x7f48480693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f485c171bd0 tx=0x7f48540091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.719+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f484c0524b0 con 0x7f485c15e540 2023-10-09T11:36:33.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:33.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:36:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.912+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f485c0b35e0 con 0x7f485c15e540 2023-10-09T11:36:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.913+0000 7f4859ffb700 1 -- 172.21.15.6:0/4223643301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f484c055ad0 con 0x7f485c15e540 2023-10-09T11:36:33.915 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 msgr2=0x7f48480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 0x7f48480693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f485c171bd0 tx=0x7f48540091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 msgr2=0x7f485c160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f484c009ef0 tx=0x7f484c00b040 comp rx=0 tx=0).stop 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 shutdown_connections 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f485c15e540 0x7f485c160ac0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f485c0cfdd0 0x7f485c16e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 --2- 172.21.15.6:0/4223643301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f485c15e170 0x7f485c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 >> 172.21.15.6:0/4223643301 conn(0x7f485c06bb90 msgr2=0x7f485c0d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 shutdown_connections 2023-10-09T11:36:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:33.915+0000 7f4863f6c700 1 -- 172.21.15.6:0/4223643301 wait complete. 2023-10-09T11:36:33.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.045+0000 7f3fa0049700 1 Processor -- start 2023-10-09T11:36:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.045+0000 7f3fa0049700 1 -- start start 2023-10-09T11:36:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3fa0049700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f981578d0 0x7f3f980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3fa0049700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980d07c0 con 0x7f3f98157ca0 2023-10-09T11:36:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3fa0049700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980cfbb0 con 0x7f3f9806d120 2023-10-09T11:36:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3fa0049700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f980cfe90 con 0x7f3f981578d0 2023-10-09T11:36:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3f9dde5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f981578d0 0x7f3f980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3f9d5e4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f98157ca0 0x7f3f9815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46492/0 (socket says 172.21.15.6:46492) 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.046+0000 7f3f9d5e4700 1 -- 172.21.15.6:0/1170151264 learned_addr learned my addr 172.21.15.6:0/1170151264 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9dde5700 1 -- 172.21.15.6:0/1170151264 >> v1:172.21.15.118:6789/0 conn(0x7f3f9806d120 legacy=0x7f3f9806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9dde5700 1 -- 172.21.15.6:0/1170151264 >> v1:172.21.15.6:6789/0 conn(0x7f3f98157ca0 legacy=0x7f3f9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9dde5700 1 -- 172.21.15.6:0/1170151264 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980d0170 con 0x7f3f981578d0 2023-10-09T11:36:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9cde3700 1 -- 172.21.15.6:0/1170151264 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952421640 0 0) 0x7f3f980d07c0 con 0x7f3f98157ca0 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9dde5700 1 --2- 172.21.15.6:0/1170151264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f981578d0 0x7f3f980cf4f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f900098e0 tx=0x7f3f900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2580a8c1ad8c7633 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9cde3700 1 -- 172.21.15.6:0/1170151264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90009e80 con 0x7f3f981578d0 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9cde3700 1 -- 172.21.15.6:0/1170151264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000b820 con 0x7f3f981578d0 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3f9cde3700 1 -- 172.21.15.6:0/1170151264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000bba0 con 0x7f3f981578d0 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3fa0049700 1 -- 172.21.15.6:0/1170151264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f981578d0 msgr2=0x7f3f980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1170151264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f981578d0 0x7f3f980cf4f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f900098e0 tx=0x7f3f900091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3fa0049700 1 -- 172.21.15.6:0/1170151264 shutdown_connections 2023-10-09T11:36:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1170151264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f981578d0 0x7f3f980cf4f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.047+0000 7f3fa0049700 1 -- 172.21.15.6:0/1170151264 >> 172.21.15.6:0/1170151264 conn(0x7f3f9806bb90 msgr2=0x7f3f9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.048+0000 7f3fa0049700 1 -- 172.21.15.6:0/1170151264 shutdown_connections 2023-10-09T11:36:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.048+0000 7f3fa0049700 1 -- 172.21.15.6:0/1170151264 wait complete. 2023-10-09T11:36:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 Processor -- start 2023-10-09T11:36:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 -- start start 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 0x7f3f980b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f981578d0 0x7f3f981539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b51c0 con 0x7f3f98157ca0 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980b68d0 con 0x7f3f9806d120 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.049+0000 7f3fa0049700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9816b610 con 0x7f3f981578d0 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48046/0 (socket says 172.21.15.6:48046) 2023-10-09T11:36:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 -- 172.21.15.6:0/1111463569 learned_addr learned my addr 172.21.15.6:0/1111463569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9dde5700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 0x7f3f980b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9d5e4700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f981578d0 0x7f3f981539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 -- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f981578d0 msgr2=0x7f3f981539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f981578d0 0x7f3f981539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 -- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 msgr2=0x7f3f980b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 0x7f3f980b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 -- 172.21.15.6:0/1111463569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009420 con 0x7f3f98157ca0 2023-10-09T11:36:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9dde5700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 0x7f3f980b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f9e5e6700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c910 tx=0x7f3f88002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800a7e0 con 0x7f3f98157ca0 2023-10-09T11:36:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8800a940 con 0x7f3f98157ca0 2023-10-09T11:36:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9816b8f0 con 0x7f3f98157ca0 2023-10-09T11:36:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800ad00 con 0x7f3f98157ca0 2023-10-09T11:36:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.050+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980b4e50 con 0x7f3f98157ca0 2023-10-09T11:36:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.051+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98067ac0 con 0x7f3f98157ca0 2023-10-09T11:36:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.052+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f88012630 con 0x7f3f98157ca0 2023-10-09T11:36:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.052+0000 7f3f95ffb700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.052+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f88084a50 con 0x7f3f98157ca0 2023-10-09T11:36:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.052+0000 7f3f9dde5700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.053+0000 7f3f9dde5700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f900030c0 tx=0x7f3f90016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.057+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f88051c20 con 0x7f3f98157ca0 2023-10-09T11:36:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.251+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f980d0450 con 0x7f3f98157ca0 2023-10-09T11:36:34.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.251+0000 7f3f95ffb700 1 -- 172.21.15.6:0/1111463569 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3f8800ae60 con 0x7f3f98157ca0 2023-10-09T11:36:34.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:34.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 msgr2=0x7f3f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f900030c0 tx=0x7f3f90016000 comp rx=0 tx=0).stop 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 msgr2=0x7f3f9816aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800c910 tx=0x7f3f88002720 comp rx=0 tx=0).stop 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 shutdown_connections 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f98157ca0 0x7f3f9816aa30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f9806d120 0x7f3f980b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 --2- 172.21.15.6:0/1111463569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3f981578d0 0x7f3f981539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 >> 172.21.15.6:0/1111463569 conn(0x7f3f9806bb90 msgr2=0x7f3f9815a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 shutdown_connections 2023-10-09T11:36:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.254+0000 7f3fa0049700 1 -- 172.21.15.6:0/1111463569 wait complete. 2023-10-09T11:36:34.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:34.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:34.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.388+0000 7f2287174700 1 Processor -- start 2023-10-09T11:36:34.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.388+0000 7f2287174700 1 -- start start 2023-10-09T11:36:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2287174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228015a2a0 0x7f22800b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2287174700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22800ceb30 0x7f22800cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2287174700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22800cf4e0 con 0x7f228006d650 2023-10-09T11:36:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2287174700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228006ea90 con 0x7f22800ceb30 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2287174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22800b0ca0 con 0x7f228015a2a0 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f227ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22800ceb30 0x7f22800cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f227ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22800ceb30 0x7f22800cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48060/0 (socket says 172.21.15.6:48060) 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f227ffff700 1 -- 172.21.15.6:0/688615978 learned_addr learned my addr 172.21.15.6:0/688615978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.389+0000 7f2284f10700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228015a2a0 0x7f22800b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227ffff700 1 -- 172.21.15.6:0/688615978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228015a2a0 msgr2=0x7f22800b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227ffff700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228015a2a0 0x7f22800b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227ffff700 1 -- 172.21.15.6:0/688615978 >> v1:172.21.15.118:6789/0 conn(0x7f228006d650 legacy=0x7f228006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227ffff700 1 -- 172.21.15.6:0/688615978 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800b00d0 con 0x7f22800ceb30 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227ffff700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800cefa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f22740099b0 tx=0x7f2274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88f73e861cad8ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227f7fe700 1 -- 172.21.15.6:0/688615978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400b860 con 0x7f22800ceb30 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227f7fe700 1 -- 172.21.15.6:0/688615978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227400b9c0 con 0x7f22800ceb30 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f227f7fe700 1 -- 172.21.15.6:0/688615978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400bd60 con 0x7f22800ceb30 2023-10-09T11:36:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 -- 172.21.15.6:0/688615978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 msgr2=0x7f22800cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800cefa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f22740099b0 tx=0x7f2274009250 comp rx=0 tx=0).stop 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 -- 172.21.15.6:0/688615978 shutdown_connections 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228015a2a0 0x7f22800b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 --2- 172.21.15.6:0/688615978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800cefa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 -- 172.21.15.6:0/688615978 >> 172.21.15.6:0/688615978 conn(0x7f2280067640 msgr2=0x7f2280067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.390+0000 7f2287174700 1 -- 172.21.15.6:0/688615978 shutdown_connections 2023-10-09T11:36:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.391+0000 7f2287174700 1 -- 172.21.15.6:0/688615978 wait complete. 2023-10-09T11:36:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 Processor -- start 2023-10-09T11:36:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 -- start start 2023-10-09T11:36:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228006d650 0x7f228015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f228015a2a0 0x7f22800b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228015fd10 con 0x7f22800ceb30 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228015fa70 con 0x7f228015a2a0 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.392+0000 7f2287174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228015cec0 con 0x7f228006d650 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48072/0 (socket says 172.21.15.6:48072) 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 -- 172.21.15.6:0/744883488 learned_addr learned my addr 172.21.15.6:0/744883488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f2284f10700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228006d650 0x7f228015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f2285711700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f228015a2a0 0x7f22800b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 -- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228006d650 msgr2=0x7f228015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228006d650 0x7f228015f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 -- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f228015a2a0 msgr2=0x7f22800b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f228015a2a0 0x7f22800b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 -- 172.21.15.6:0/744883488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740094f0 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227ffff700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f228006f990 tx=0x7f2274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274011e40 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274024440 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228015d1a0 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274024800 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.393+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228015d760 con 0x7f22800ceb30 2023-10-09T11:36:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.394+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228015d950 con 0x7f22800ceb30 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.395+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f227401a420 con 0x7f22800ceb30 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.395+0000 7f227cff9700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 0x7f226c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.395+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22740863e0 con 0x7f22800ceb30 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.395+0000 7f2284f10700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 0x7f226c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.395+0000 7f2284f10700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 0x7f226c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f228015fef0 tx=0x7f22780097b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.399+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2274053650 con 0x7f22800ceb30 2023-10-09T11:36:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.592+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f228004bb80 con 0x7f22800ceb30 2023-10-09T11:36:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.593+0000 7f227cff9700 1 -- 172.21.15.6:0/744883488 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2274056c70 con 0x7f22800ceb30 2023-10-09T11:36:34.595 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 msgr2=0x7f226c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 0x7f226c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f228015fef0 tx=0x7f22780097b0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 msgr2=0x7f22800b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f228006f990 tx=0x7f2274017000 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 shutdown_connections 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f226c066f30 0x7f226c0693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f228015a2a0 0x7f22800b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f228006d650 0x7f228015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 --2- 172.21.15.6:0/744883488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22800ceb30 0x7f22800b2910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 >> 172.21.15.6:0/744883488 conn(0x7f2280067640 msgr2=0x7f22800cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 shutdown_connections 2023-10-09T11:36:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.595+0000 7f2287174700 1 -- 172.21.15.6:0/744883488 wait complete. 2023-10-09T11:36:34.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:34.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.729+0000 7f678f781700 1 Processor -- start 2023-10-09T11:36:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.729+0000 7f678f781700 1 -- start start 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678f781700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f67880b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678f781700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f678806d650 0x7f678806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678f781700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880b0ca0 con 0x7f678815a2a0 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678f781700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678806ea90 con 0x7f678806d650 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678f781700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880b00d0 con 0x7f67880cf240 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f678806d650 0x7f678806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678d51d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f678815a2a0 0x7f67880ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46498/0 (socket says 172.21.15.6:46498) 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678d51d700 1 -- 172.21.15.6:0/767400291 learned_addr learned my addr 172.21.15.6:0/767400291 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678cd1c700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f67880b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f6787fff700 1 -- 172.21.15.6:0/767400291 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256942736 0 0) 0x7f67880b0ca0 con 0x7f678815a2a0 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f6787fff700 1 -- 172.21.15.6:0/767400291 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6770003570 con 0x7f678815a2a0 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 -- 172.21.15.6:0/767400291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 msgr2=0x7f67880b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f67880b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 -- 172.21.15.6:0/767400291 >> v1:172.21.15.6:6789/0 conn(0x7f678815a2a0 legacy=0x7f67880ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 -- 172.21.15.6:0/767400291 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880b0370 con 0x7f678806d650 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f678dd1e700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678806da90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6780009e60 tx=0x7f6780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25e86212df910d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.730+0000 7f6787fff700 1 -- 172.21.15.6:0/767400291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000e070 con 0x7f678806d650 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f6787fff700 1 -- 172.21.15.6:0/767400291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000bab0 con 0x7f678806d650 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f6787fff700 1 -- 172.21.15.6:0/767400291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000be70 con 0x7f678806d650 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 -- 172.21.15.6:0/767400291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 msgr2=0x7f678806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678806da90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6780009e60 tx=0x7f6780009780 comp rx=0 tx=0).stop 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 -- 172.21.15.6:0/767400291 shutdown_connections 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678806da90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 --2- 172.21.15.6:0/767400291 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f67880b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 -- 172.21.15.6:0/767400291 >> 172.21.15.6:0/767400291 conn(0x7f6788067640 msgr2=0x7f6788067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 -- 172.21.15.6:0/767400291 shutdown_connections 2023-10-09T11:36:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.731+0000 7f678f781700 1 -- 172.21.15.6:0/767400291 wait complete. 2023-10-09T11:36:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.732+0000 7f678f781700 1 Processor -- start 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.732+0000 7f678f781700 1 -- start start 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f6788067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678815a2a0 0x7f6788067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c9c50 con 0x7f678806d650 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678816b000 con 0x7f678815a2a0 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678f781700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678816b2e0 con 0x7f67880cf240 2023-10-09T11:36:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678d51d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678d51d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48094/0 (socket says 172.21.15.6:48094) 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678d51d700 1 -- 172.21.15.6:0/763625100 learned_addr learned my addr 172.21.15.6:0/763625100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678dd1e700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678815a2a0 0x7f6788067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.733+0000 7f678cd1c700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f6788067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 -- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 msgr2=0x7f6788067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f6788067a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 -- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678815a2a0 msgr2=0x7f6788067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678815a2a0 0x7f6788067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 -- 172.21.15.6:0/763625100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009a20 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678d51d700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f677800c590 tx=0x7f6778007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778005b30 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778005cb0 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678816b5c0 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778007320 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.734+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678815b400 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.735+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6788069e40 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.735+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f677801b3b0 con 0x7f678806d650 2023-10-09T11:36:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.735+0000 7f67857fa700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:34.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.736+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67780839b0 con 0x7f678806d650 2023-10-09T11:36:34.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.736+0000 7f678cd1c700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:34.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.736+0000 7f678cd1c700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67880ada20 tx=0x7f677c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:34.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.740+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6778050c20 con 0x7f678806d650 2023-10-09T11:36:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.931+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f678804bb80 con 0x7f678806d650 2023-10-09T11:36:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.931+0000 7f67857fa700 1 -- 172.21.15.6:0/763625100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67780170a0 con 0x7f678806d650 2023-10-09T11:36:34.933 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 msgr2=0x7f67740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 0x7f67740693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67880ada20 tx=0x7f677c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 msgr2=0x7f678815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f677800c590 tx=0x7f6778007e00 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 shutdown_connections 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6774066f30 0x7f67740693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f678815a2a0 0x7f6788067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f678806d650 0x7f678815aec0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 --2- 172.21.15.6:0/763625100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67880cf240 0x7f6788067a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 >> 172.21.15.6:0/763625100 conn(0x7f6788067640 msgr2=0x7f678806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 shutdown_connections 2023-10-09T11:36:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:34.934+0000 7f678f781700 1 -- 172.21.15.6:0/763625100 wait complete. 2023-10-09T11:36:34.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:35.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.067+0000 7f318f177700 1 Processor -- start 2023-10-09T11:36:35.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.067+0000 7f318f177700 1 -- start start 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318f177700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31880d0b80 0x7f31880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318f177700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f31880d02b0 0x7f318806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318f177700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880cf2d0 con 0x7f31880d0f50 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318f177700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318815a690 con 0x7f31880d0b80 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318f177700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318806dc00 con 0x7f31880d02b0 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318e175700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31880d0b80 0x7f31880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318e976700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31880d0f50 0x7f318815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46510/0 (socket says 172.21.15.6:46510) 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318e976700 1 -- 172.21.15.6:0/3170727200 learned_addr learned my addr 172.21.15.6:0/3170727200 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:35.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.068+0000 7f318d974700 1 --2- 172.21.15.6:0/3170727200 >> v2:172.21.15.118:3300/0 conn(0x7f31880d02b0 0x7f318806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318e175700 1 -- 172.21.15.6:0/3170727200 >> v2:172.21.15.118:3300/0 conn(0x7f31880d02b0 msgr2=0x7f318806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318e175700 1 --2- 172.21.15.6:0/3170727200 >> v2:172.21.15.118:3300/0 conn(0x7f31880d02b0 0x7f318806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318e175700 1 -- 172.21.15.6:0/3170727200 >> v1:172.21.15.6:6789/0 conn(0x7f31880d0f50 legacy=0x7f318815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318e175700 1 -- 172.21.15.6:0/3170727200 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880cf570 con 0x7f31880d0b80 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318d173700 1 -- 172.21.15.6:0/3170727200 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000536222 0 0) 0x7f31880cf2d0 con 0x7f31880d0f50 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318e175700 1 --2- 172.21.15.6:0/3170727200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0b80 0x7f31880cfd70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31880ce9b0 tx=0x7f31840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a612e9bfaf174765 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318d173700 1 -- 172.21.15.6:0/3170727200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011630 con 0x7f31880d0b80 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318d173700 1 -- 172.21.15.6:0/3170727200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011790 con 0x7f31880d0b80 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.069+0000 7f318d173700 1 -- 172.21.15.6:0/3170727200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011b30 con 0x7f31880d0b80 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 -- 172.21.15.6:0/3170727200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0b80 msgr2=0x7f31880cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 --2- 172.21.15.6:0/3170727200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0b80 0x7f31880cfd70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31880ce9b0 tx=0x7f31840091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 -- 172.21.15.6:0/3170727200 shutdown_connections 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 --2- 172.21.15.6:0/3170727200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0b80 0x7f31880cfd70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 --2- 172.21.15.6:0/3170727200 >> v2:172.21.15.118:3300/0 conn(0x7f31880d02b0 0x7f318806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 -- 172.21.15.6:0/3170727200 >> 172.21.15.6:0/3170727200 conn(0x7f3188063230 msgr2=0x7f3188063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 -- 172.21.15.6:0/3170727200 shutdown_connections 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.070+0000 7f318f177700 1 -- 172.21.15.6:0/3170727200 wait complete. 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.071+0000 7f318f177700 1 Processor -- start 2023-10-09T11:36:35.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.071+0000 7f318f177700 1 -- start start 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31880d02b0 0x7f3188145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31880d0b80 0x7f3188146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880ae180 con 0x7f31880d0f50 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318816e450 con 0x7f31880d0b80 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318f177700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31880adb30 con 0x7f31880d02b0 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48110/0 (socket says 172.21.15.6:48110) 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 -- 172.21.15.6:0/2227681254 learned_addr learned my addr 172.21.15.6:0/2227681254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318d974700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31880d0b80 0x7f3188146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e175700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31880d02b0 0x7f3188145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 -- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31880d02b0 msgr2=0x7f3188145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31880d02b0 0x7f3188145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 -- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31880d0b80 msgr2=0x7f3188146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.072+0000 7f318e976700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31880d0b80 0x7f3188146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f318e976700 1 -- 172.21.15.6:0/2227681254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009420 con 0x7f31880d0f50 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f318e976700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f318000cbf0 tx=0x7f31800019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000a8b0 con 0x7f31880d0f50 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000aa10 con 0x7f31880d0f50 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31880ade10 con 0x7f31880d0f50 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000add0 con 0x7f31880d0f50 2023-10-09T11:36:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.073+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3188069050 con 0x7f31880d0f50 2023-10-09T11:36:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.074+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31880ad990 con 0x7f31880d0f50 2023-10-09T11:36:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.074+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3180007300 con 0x7f31880d0f50 2023-10-09T11:36:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.075+0000 7f317e7fc700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 0x7f316c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.075+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31800847d0 con 0x7f31880d0f50 2023-10-09T11:36:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.075+0000 7f318e175700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 0x7f316c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.075+0000 7f318e175700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 0x7f316c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31840093f0 tx=0x7f3184017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.079+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31880ad990 con 0x7f31880d0f50 2023-10-09T11:36:35.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.270+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31880ad990 con 0x7f31880d0f50 2023-10-09T11:36:35.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.270+0000 7f317e7fc700 1 -- 172.21.15.6:0/2227681254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31880ad990 con 0x7f31880d0f50 2023-10-09T11:36:35.272 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.272+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 msgr2=0x7f316c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.272+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 0x7f316c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31840093f0 tx=0x7f3184017000 comp rx=0 tx=0).stop 2023-10-09T11:36:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.272+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 msgr2=0x7f3188068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.272+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f318000cbf0 tx=0x7f31800019b0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 shutdown_connections 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f316c066f30 0x7f316c0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880d0f50 0x7f3188068950 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31880d02b0 0x7f3188145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 --2- 172.21.15.6:0/2227681254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31880d0b80 0x7f3188146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 >> 172.21.15.6:0/2227681254 conn(0x7f3188063230 msgr2=0x7f3188069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 shutdown_connections 2023-10-09T11:36:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.273+0000 7f318f177700 1 -- 172.21.15.6:0/2227681254 wait complete. 2023-10-09T11:36:35.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.407+0000 7fbf28c70700 1 Processor -- start 2023-10-09T11:36:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.407+0000 7fbf28c70700 1 -- start start 2023-10-09T11:36:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf28c70700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf241578d0 0x7fbf240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf28c70700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf240d07c0 con 0x7fbf2406d120 2023-10-09T11:36:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf28c70700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf240cfbb0 con 0x7fbf24157ca0 2023-10-09T11:36:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf28c70700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf240cfe90 con 0x7fbf241578d0 2023-10-09T11:36:35.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf2259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf241578d0 0x7fbf240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf22d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf2406d120 0x7fbf2406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46516/0 (socket says 172.21.15.6:46516) 2023-10-09T11:36:35.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf22d9d700 1 -- 172.21.15.6:0/557188922 learned_addr learned my addr 172.21.15.6:0/557188922 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:35.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.408+0000 7fbf2259c700 1 -- 172.21.15.6:0/557188922 >> v1:172.21.15.118:6789/0 conn(0x7fbf24157ca0 legacy=0x7fbf2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:35.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2259c700 1 -- 172.21.15.6:0/557188922 >> v1:172.21.15.6:6789/0 conn(0x7fbf2406d120 legacy=0x7fbf2406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2259c700 1 -- 172.21.15.6:0/557188922 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240d0170 con 0x7fbf241578d0 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2159a700 1 -- 172.21.15.6:0/557188922 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899877422 0 0) 0x7fbf240d07c0 con 0x7fbf2406d120 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2259c700 1 --2- 172.21.15.6:0/557188922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf241578d0 0x7fbf240cf4f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0098e0 tx=0x7fbf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b356a5d8adec7f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2159a700 1 -- 172.21.15.6:0/557188922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c009e80 con 0x7fbf241578d0 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2159a700 1 -- 172.21.15.6:0/557188922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00b820 con 0x7fbf241578d0 2023-10-09T11:36:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf2159a700 1 -- 172.21.15.6:0/557188922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00bba0 con 0x7fbf241578d0 2023-10-09T11:36:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 -- 172.21.15.6:0/557188922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf241578d0 msgr2=0x7fbf240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 --2- 172.21.15.6:0/557188922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf241578d0 0x7fbf240cf4f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0098e0 tx=0x7fbf1c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 -- 172.21.15.6:0/557188922 shutdown_connections 2023-10-09T11:36:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 --2- 172.21.15.6:0/557188922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf241578d0 0x7fbf240cf4f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 -- 172.21.15.6:0/557188922 >> 172.21.15.6:0/557188922 conn(0x7fbf2406bb90 msgr2=0x7fbf2406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.409+0000 7fbf28c70700 1 -- 172.21.15.6:0/557188922 shutdown_connections 2023-10-09T11:36:35.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.410+0000 7fbf28c70700 1 -- 172.21.15.6:0/557188922 wait complete. 2023-10-09T11:36:35.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 Processor -- start 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 -- start start 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 0x7fbf24154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf24157ca0 0x7fbf2416b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2416bc20 con 0x7fbf2406d120 2023-10-09T11:36:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2416bf00 con 0x7fbf24157ca0 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf28c70700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2416c1e0 con 0x7fbf241578d0 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf2259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf2259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48136/0 (socket says 172.21.15.6:48136) 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.411+0000 7fbf2259c700 1 -- 172.21.15.6:0/2524813525 learned_addr learned my addr 172.21.15.6:0/2524813525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf22d9d700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf24157ca0 0x7fbf2416b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf21d9b700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 0x7fbf24154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 -- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 msgr2=0x7fbf24154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 0x7fbf24154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 -- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf24157ca0 msgr2=0x7fbf2416b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf24157ca0 0x7fbf2416b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 -- 172.21.15.6:0/2524813525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009420 con 0x7fbf2406d120 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf21d9b700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 0x7fbf24154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf2259c700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0030c0 tx=0x7fbf1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00b990 con 0x7fbf2406d120 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c020070 con 0x7fbf2406d120 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2416c4c0 con 0x7fbf2406d120 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c01b450 con 0x7fbf2406d120 2023-10-09T11:36:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.412+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2416b910 con 0x7fbf2406d120 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.413+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf24067ac0 con 0x7fbf2406d120 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.413+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf1c022030 con 0x7fbf2406d120 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.414+0000 7fbf1a7fc700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 0x7fbf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.414+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf1c0864d0 con 0x7fbf2406d120 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.414+0000 7fbf21d9b700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 0x7fbf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.414+0000 7fbf21d9b700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 0x7fbf040693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c006fd0 tx=0x7fbf0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.418+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf1c053740 con 0x7fbf2406d120 2023-10-09T11:36:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.612+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf240d0450 con 0x7fbf2406d120 2023-10-09T11:36:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.613+0000 7fbf1a7fc700 1 -- 172.21.15.6:0/2524813525 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fbf1c056d60 con 0x7fbf2406d120 2023-10-09T11:36:35.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:35.614 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 msgr2=0x7fbf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 0x7fbf040693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c006fd0 tx=0x7fbf0c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 msgr2=0x7fbf2416a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0030c0 tx=0x7fbf1c016000 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 shutdown_connections 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbf04066f30 0x7fbf040693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf24157ca0 0x7fbf2416b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2406d120 0x7fbf2416a210 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 --2- 172.21.15.6:0/2524813525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf241578d0 0x7fbf24154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 >> 172.21.15.6:0/2524813525 conn(0x7fbf2406bb90 msgr2=0x7fbf2406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 shutdown_connections 2023-10-09T11:36:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.615+0000 7fbf28c70700 1 -- 172.21.15.6:0/2524813525 wait complete. 2023-10-09T11:36:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:35.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.749+0000 7fb0cdf3b700 1 Processor -- start 2023-10-09T11:36:35.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.749+0000 7fb0cdf3b700 1 -- start start 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0cdf3b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0cdf3b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80ac790 con 0x7fb0c81577d0 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0cdf3b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c815a320 con 0x7fb0c806d0e0 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0cdf3b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80ad0d0 con 0x7fb0c806e490 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0ccf39700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb0c81577d0 0x7fb0c80ac9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46520/0 (socket says 172.21.15.6:46520) 2023-10-09T11:36:35.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.750+0000 7fb0ccf39700 1 -- 172.21.15.6:0/1543156430 learned_addr learned my addr 172.21.15.6:0/1543156430 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c7fff700 1 --2- 172.21.15.6:0/1543156430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715131223 0 0) 0x7fb0c80ac790 con 0x7fb0c81577d0 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b8003570 con 0x7fb0c81577d0 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993723149 0 0) 0x7fb0c815a320 con 0x7fb0c806d0e0 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c80ac790 con 0x7fb0c806d0e0 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c7fff700 1 -- 172.21.15.6:0/1543156430 >> v1:172.21.15.118:6789/0 conn(0x7fb0c806d0e0 legacy=0x7fb0c80aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c7fff700 1 -- 172.21.15.6:0/1543156430 >> v1:172.21.15.6:6789/0 conn(0x7fb0c81577d0 legacy=0x7fb0c80ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c7fff700 1 -- 172.21.15.6:0/1543156430 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c806d530 con 0x7fb0c806e490 2023-10-09T11:36:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c7fff700 1 --2- 172.21.15.6:0/1543156430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c806cba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009910 tx=0x7fb0b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262c219d1df5b8d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4011630 con 0x7fb0c806e490 2023-10-09T11:36:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b4011790 con 0x7fb0c806e490 2023-10-09T11:36:35.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.751+0000 7fb0c77fe700 1 -- 172.21.15.6:0/1543156430 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4011b30 con 0x7fb0c806e490 2023-10-09T11:36:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/1543156430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 msgr2=0x7fb0c806cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/1543156430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c806cba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009910 tx=0x7fb0b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/1543156430 shutdown_connections 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/1543156430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c806cba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/1543156430 >> 172.21.15.6:0/1543156430 conn(0x7fb0c80cdb30 msgr2=0x7fb0c806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/1543156430 shutdown_connections 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.752+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/1543156430 wait complete. 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.753+0000 7fb0cdf3b700 1 Processor -- start 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.753+0000 7fb0cdf3b700 1 -- start start 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0c81577d0 0x7fb0c80afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80cce70 con 0x7fb0c806d0e0 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b12c0 con 0x7fb0c81577d0 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cdf3b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b06b0 con 0x7fb0c806e490 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48144/0 (socket says 172.21.15.6:48144) 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 -- 172.21.15.6:0/4195872324 learned_addr learned my addr 172.21.15.6:0/4195872324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0cd73a700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0c81577d0 0x7fb0c80afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0c7fff700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 -- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 msgr2=0x7fb0c80cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c80cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 -- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0c81577d0 msgr2=0x7fb0c80afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0c81577d0 0x7fb0c80afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.754+0000 7fb0ccf39700 1 -- 172.21.15.6:0/4195872324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4009420 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0ccf39700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c790 tx=0x7fb0bc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc005b30 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc005cd0 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c80b0990 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc007320 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.755+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c80b0f50 con 0x7fb0c806d0e0 2023-10-09T11:36:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.756+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c80b1630 con 0x7fb0c806d0e0 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.756+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0bc012400 con 0x7fb0c806d0e0 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.756+0000 7fb0c4ff9700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 0x7fb0ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.757+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0bc083910 con 0x7fb0c806d0e0 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.757+0000 7fb0c7fff700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 0x7fb0ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.757+0000 7fb0c7fff700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 0x7fb0ac0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009860 tx=0x7fb0b4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:35.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.761+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0bc04b5a0 con 0x7fb0c806d0e0 2023-10-09T11:36:35.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.954+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0c815a350 con 0x7fb0c806d0e0 2023-10-09T11:36:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.954+0000 7fb0c4ff9700 1 -- 172.21.15.6:0/4195872324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0bc017020 con 0x7fb0c806d0e0 2023-10-09T11:36:35.956 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:35.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 msgr2=0x7fb0ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 0x7fb0ac0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009860 tx=0x7fb0b4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 msgr2=0x7fb0c816aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c790 tx=0x7fb0bc007e80 comp rx=0 tx=0).stop 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 shutdown_connections 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0ac066f30 0x7fb0ac0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0c81577d0 0x7fb0c80afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0c806d0e0 0x7fb0c816aa70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 --2- 172.21.15.6:0/4195872324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0c806e490 0x7fb0c80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:35.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 >> 172.21.15.6:0/4195872324 conn(0x7fb0c80cdb30 msgr2=0x7fb0c8156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:35.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 shutdown_connections 2023-10-09T11:36:35.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:35.956+0000 7fb0cdf3b700 1 -- 172.21.15.6:0/4195872324 wait complete. 2023-10-09T11:36:35.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 Processor -- start 2023-10-09T11:36:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 -- start start 2023-10-09T11:36:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e38157ca0 0x7f0e380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3806d120 0x7f0e3806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e380d07c0 con 0x7f0e381578d0 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3806daa0 con 0x7f0e38157ca0 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.092+0000 7f0e3ec7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cfbb0 con 0x7f0e3806d120 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e38157ca0 0x7f0e380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e38157ca0 0x7f0e380cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48158/0 (socket says 172.21.15.6:48158) 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e3ca1a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0e381578d0 0x7f0e3815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37852/0 (socket says 172.21.15.6:37852) 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 -- 172.21.15.6:0/115176093 learned_addr learned my addr 172.21.15.6:0/115176093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e3d21b700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3806d120 0x7f0e3806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 -- 172.21.15.6:0/115176093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3806d120 msgr2=0x7f0e3806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3806d120 0x7f0e3806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 -- 172.21.15.6:0/115176093 >> v1:172.21.15.118:6789/0 conn(0x7f0e381578d0 legacy=0x7f0e3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 -- 172.21.15.6:0/115176093 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380cfe90 con 0x7f0e38157ca0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e377fe700 1 -- 172.21.15.6:0/115176093 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799941002 0 0) 0x7f0e380d07c0 con 0x7f0e381578d0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e37fff700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e38157ca0 0x7f0e380cf4f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009f20 tx=0x7f0e28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac5547697466e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e377fe700 1 -- 172.21.15.6:0/115176093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800e070 con 0x7f0e38157ca0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e377fe700 1 -- 172.21.15.6:0/115176093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800b9d0 con 0x7f0e38157ca0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.093+0000 7f0e377fe700 1 -- 172.21.15.6:0/115176093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280092e0 con 0x7f0e38157ca0 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/115176093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e38157ca0 msgr2=0x7f0e380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e38157ca0 0x7f0e380cf4f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009f20 tx=0x7f0e28009840 comp rx=0 tx=0).stop 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/115176093 shutdown_connections 2023-10-09T11:36:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e3806d120 0x7f0e3806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/115176093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e38157ca0 0x7f0e380cf4f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/115176093 >> 172.21.15.6:0/115176093 conn(0x7f0e3806bb90 msgr2=0x7f0e3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/115176093 shutdown_connections 2023-10-09T11:36:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.094+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/115176093 wait complete. 2023-10-09T11:36:36.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.095+0000 7f0e3ec7e700 1 Processor -- start 2023-10-09T11:36:36.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.095+0000 7f0e3ec7e700 1 -- start start 2023-10-09T11:36:36.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e381578d0 0x7f0e38158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e38157ca0 0x7f0e381591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380ac0f0 con 0x7f0e3806d120 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380ab4e0 con 0x7f0e381578d0 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ec7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380ab7c0 con 0x7f0e38157ca0 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48172/0 (socket says 172.21.15.6:48172) 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 -- 172.21.15.6:0/225109522 learned_addr learned my addr 172.21.15.6:0/225109522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e37fff700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e381578d0 0x7f0e38158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3d21b700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e38157ca0 0x7f0e381591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 -- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e38157ca0 msgr2=0x7f0e381591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e38157ca0 0x7f0e381591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 -- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e381578d0 msgr2=0x7f0e38158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e381578d0 0x7f0e38158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 -- 172.21.15.6:0/225109522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28009ae0 con 0x7f0e3806d120 2023-10-09T11:36:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.096+0000 7f0e3ca1a700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0e300011e0 tx=0x7f0e30007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.097+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30005a70 con 0x7f0e3806d120 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.097+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30005bd0 con 0x7f0e3806d120 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.097+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e380abaa0 con 0x7f0e3806d120 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.097+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300070d0 con 0x7f0e3806d120 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.097+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38154e90 con 0x7f0e3806d120 2023-10-09T11:36:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.098+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38067ac0 con 0x7f0e3806d120 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.098+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e30007480 con 0x7f0e3806d120 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.098+0000 7f0e34ff9700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 0x7f0e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.099+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e300839e0 con 0x7f0e3806d120 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.099+0000 7f0e37fff700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 0x7f0e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.099+0000 7f0e37fff700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 0x7f0e180693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e381580c0 tx=0x7f0e28018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.103+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e30050c50 con 0x7f0e3806d120 2023-10-09T11:36:36.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.294+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e380d0170 con 0x7f0e3806d120 2023-10-09T11:36:36.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.294+0000 7f0e34ff9700 1 -- 172.21.15.6:0/225109522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e30017020 con 0x7f0e3806d120 2023-10-09T11:36:36.296 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 msgr2=0x7f0e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 0x7f0e180693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e381580c0 tx=0x7f0e28018000 comp rx=0 tx=0).stop 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 msgr2=0x7f0e38154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0e300011e0 tx=0x7f0e30007e10 comp rx=0 tx=0).stop 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 shutdown_connections 2023-10-09T11:36:36.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e18066f30 0x7f0e180693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e38157ca0 0x7f0e381591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e3806d120 0x7f0e38154950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 --2- 172.21.15.6:0/225109522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e381578d0 0x7f0e38158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 >> 172.21.15.6:0/225109522 conn(0x7f0e3806bb90 msgr2=0x7f0e381584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 shutdown_connections 2023-10-09T11:36:36.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.296+0000 7f0e3ec7e700 1 -- 172.21.15.6:0/225109522 wait complete. 2023-10-09T11:36:36.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:36.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.430+0000 7fb24f59e700 1 Processor -- start 2023-10-09T11:36:36.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.430+0000 7fb24f59e700 1 -- start start 2023-10-09T11:36:36.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24f59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb25015a650 0x7fb250068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24f59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 0x7fb250069290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24f59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500c7b90 con 0x7fb2500c7690 2023-10-09T11:36:36.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24f59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2500c9380 con 0x7fb25015a650 2023-10-09T11:36:36.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24f59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500ab8b0 con 0x7fb25015b130 2023-10-09T11:36:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb25015a650 0x7fb250068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24ed9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 0x7fb250069290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24dd9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb2500c7690 0x7fb25015aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37866/0 (socket says 172.21.15.6:37866) 2023-10-09T11:36:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.431+0000 7fb24dd9b700 1 -- 172.21.15.6:0/2712352936 learned_addr learned my addr 172.21.15.6:0/2712352936 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24d59a700 1 -- 172.21.15.6:0/2712352936 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984394503 0 0) 0x7fb2500c7b90 con 0x7fb2500c7690 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24ed9d700 1 -- 172.21.15.6:0/2712352936 >> v2:172.21.15.118:3300/0 conn(0x7fb25015a650 msgr2=0x7fb250068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24ed9d700 1 --2- 172.21.15.6:0/2712352936 >> v2:172.21.15.118:3300/0 conn(0x7fb25015a650 0x7fb250068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24ed9d700 1 -- 172.21.15.6:0/2712352936 >> v1:172.21.15.118:6789/0 conn(0x7fb2500c7690 legacy=0x7fb25015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24ed9d700 1 -- 172.21.15.6:0/2712352936 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500c7e70 con 0x7fb25015b130 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24ed9d700 1 --2- 172.21.15.6:0/2712352936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 0x7fb250069290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb240009e60 tx=0x7fb240009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7176cd8a97beed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24d59a700 1 -- 172.21.15.6:0/2712352936 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000e070 con 0x7fb25015b130 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24d59a700 1 -- 172.21.15.6:0/2712352936 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24000bb60 con 0x7fb25015b130 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.432+0000 7fb24d59a700 1 -- 172.21.15.6:0/2712352936 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240012430 con 0x7fb25015b130 2023-10-09T11:36:36.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 -- 172.21.15.6:0/2712352936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 msgr2=0x7fb250069290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 --2- 172.21.15.6:0/2712352936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 0x7fb250069290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb240009e60 tx=0x7fb240009780 comp rx=0 tx=0).stop 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 -- 172.21.15.6:0/2712352936 shutdown_connections 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 --2- 172.21.15.6:0/2712352936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015b130 0x7fb250069290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 --2- 172.21.15.6:0/2712352936 >> v2:172.21.15.118:3300/0 conn(0x7fb25015a650 0x7fb250068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 -- 172.21.15.6:0/2712352936 >> 172.21.15.6:0/2712352936 conn(0x7fb25006c660 msgr2=0x7fb2500ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 -- 172.21.15.6:0/2712352936 shutdown_connections 2023-10-09T11:36:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.433+0000 7fb24f59e700 1 -- 172.21.15.6:0/2712352936 wait complete. 2023-10-09T11:36:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 Processor -- start 2023-10-09T11:36:36.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 -- start start 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2500c7690 0x7fb25016bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 0x7fb2500b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500ac450 con 0x7fb25015b130 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500ad2b0 con 0x7fb2500c7690 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.434+0000 7fb24f59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500ac6a0 con 0x7fb25015a650 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48188/0 (socket says 172.21.15.6:48188) 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 -- 172.21.15.6:0/3964487546 learned_addr learned my addr 172.21.15.6:0/3964487546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24e59c700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2500c7690 0x7fb25016bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24dd9b700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 0x7fb2500b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 -- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 msgr2=0x7fb2500b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 0x7fb2500b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 -- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2500c7690 msgr2=0x7fb25016bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2500c7690 0x7fb25016bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 -- 172.21.15.6:0/3964487546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240009a20 con 0x7fb25015b130 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24dd9b700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 0x7fb2500b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24ed9d700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb240013000 tx=0x7fb240019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240027470 con 0x7fb25015b130 2023-10-09T11:36:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400275f0 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2500ac980 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400279b0 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.435+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2500acf40 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.436+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25006aa50 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.437+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb240024070 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.437+0000 7fb2467fc700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.437+0000 7fb24e59c700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.437+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb240086d80 con 0x7fb25015b130 2023-10-09T11:36:36.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.438+0000 7fb24e59c700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb250154840 tx=0x7fb2480091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.442+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb240053ff0 con 0x7fb25015b130 2023-10-09T11:36:36.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.634+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb25015aee0 con 0x7fb25015b130 2023-10-09T11:36:36.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.635+0000 7fb2467fc700 1 -- 172.21.15.6:0/3964487546 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb240057610 con 0x7fb25015b130 2023-10-09T11:36:36.637 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:36.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 msgr2=0x7fb2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb250154840 tx=0x7fb2480091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 msgr2=0x7fb2500cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb240013000 tx=0x7fb240019000 comp rx=0 tx=0).stop 2023-10-09T11:36:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 shutdown_connections 2023-10-09T11:36:36.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb25015b130 0x7fb2500cbad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2500c7690 0x7fb25016bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 --2- 172.21.15.6:0/3964487546 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25015a650 0x7fb2500b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 >> 172.21.15.6:0/3964487546 conn(0x7fb25006c660 msgr2=0x7fb250068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 shutdown_connections 2023-10-09T11:36:36.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.636+0000 7fb24f59e700 1 -- 172.21.15.6:0/3964487546 wait complete. 2023-10-09T11:36:36.688 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-09T11:36:36.689 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T11:36:36.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-09T11:36:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.807+0000 7f9d2647c700 1 Processor -- start 2023-10-09T11:36:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.807+0000 7f9d2647c700 1 -- start start 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d2647c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d201578d0 0x7f9d200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d2647c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d20157ca0 0x7f9d2015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d2647c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200d07c0 con 0x7f9d2006d120 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d2647c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200cfbb0 con 0x7f9d20157ca0 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d2647c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200cfe90 con 0x7f9d201578d0 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d20157ca0 0x7f9d2015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d20157ca0 0x7f9d2015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48198/0 (socket says 172.21.15.6:48198) 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3429911558 learned_addr learned my addr 172.21.15.6:0/3429911558 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3429911558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d201578d0 msgr2=0x7f9d200cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 --2- 172.21.15.6:0/3429911558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d201578d0 0x7f9d200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3429911558 >> v1:172.21.15.118:6789/0 conn(0x7f9d2006d120 legacy=0x7f9d2015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.808+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3429911558 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200d0170 con 0x7f9d20157ca0 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d1f7fe700 1 --2- 172.21.15.6:0/3429911558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d20157ca0 0x7f9d2015af00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d140099b0 tx=0x7f9d14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a599fe09c204f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d1effd700 1 -- 172.21.15.6:0/3429911558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400b820 con 0x7f9d20157ca0 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d1effd700 1 -- 172.21.15.6:0/3429911558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400b980 con 0x7f9d20157ca0 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d1effd700 1 -- 172.21.15.6:0/3429911558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400bd20 con 0x7f9d20157ca0 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 -- 172.21.15.6:0/3429911558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d20157ca0 msgr2=0x7f9d2015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3429911558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d20157ca0 0x7f9d2015af00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d140099b0 tx=0x7f9d14009250 comp rx=0 tx=0).stop 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 -- 172.21.15.6:0/3429911558 shutdown_connections 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3429911558 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d201578d0 0x7f9d200cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3429911558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d20157ca0 0x7f9d2015af00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 -- 172.21.15.6:0/3429911558 >> 172.21.15.6:0/3429911558 conn(0x7f9d2006bb90 msgr2=0x7f9d2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 -- 172.21.15.6:0/3429911558 shutdown_connections 2023-10-09T11:36:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.809+0000 7f9d2647c700 1 -- 172.21.15.6:0/3429911558 wait complete. 2023-10-09T11:36:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.810+0000 7f9d2647c700 1 Processor -- start 2023-10-09T11:36:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 -- start start 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d2006d120 0x7f9d2016dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d20157ca0 0x7f9d2016a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2016eba0 con 0x7f9d201578d0 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c6ed0 con 0x7f9d20157ca0 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d2647c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2016abb0 con 0x7f9d2006d120 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48206/0 (socket says 172.21.15.6:48206) 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.811+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3470854201 learned_addr learned my addr 172.21.15.6:0/3470854201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d24a19700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d20157ca0 0x7f9d2016a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1ffff700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d2006d120 0x7f9d2016dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d2006d120 msgr2=0x7f9d2016dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d2006d120 0x7f9d2016dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d20157ca0 msgr2=0x7f9d2016a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d20157ca0 0x7f9d2016a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 -- 172.21.15.6:0/3470854201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140094f0 con 0x7f9d201578d0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d1f7fe700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009290 tx=0x7f9d14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14011e40 con 0x7f9d201578d0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1401f070 con 0x7f9d201578d0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2016e300 con 0x7f9d201578d0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d140266d0 con 0x7f9d201578d0 2023-10-09T11:36:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.812+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2016e8c0 con 0x7f9d201578d0 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.813+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20067ac0 con 0x7f9d201578d0 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.813+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d1401a440 con 0x7f9d201578d0 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.814+0000 7f9d07fff700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 0x7f9d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.814+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d14021070 con 0x7f9d201578d0 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.814+0000 7f9d1ffff700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 0x7f9d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.814+0000 7f9d1ffff700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 0x7f9d0c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009bf0 tx=0x7f9d100091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:36.818+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d14053730 con 0x7f9d201578d0 2023-10-09T11:36:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.092+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f9d200d0450 con 0x7f9d201578d0 2023-10-09T11:36:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.895+0000 7f9d07fff700 1 -- 172.21.15.6:0/3470854201 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9d14056d50 con 0x7f9d201578d0 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 msgr2=0x7f9d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 0x7f9d0c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009bf0 tx=0x7f9d100091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 msgr2=0x7f9d200c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009290 tx=0x7f9d14016000 comp rx=0 tx=0).stop 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 shutdown_connections 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d0c066f30 0x7f9d0c0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d20157ca0 0x7f9d2016a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d2006d120 0x7f9d2016dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 --2- 172.21.15.6:0/3470854201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d201578d0 0x7f9d200c6990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 >> 172.21.15.6:0/3470854201 conn(0x7f9d2006bb90 msgr2=0x7f9d2015da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 shutdown_connections 2023-10-09T11:36:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:37.898+0000 7f9d2647c700 1 -- 172.21.15.6:0/3470854201 wait complete. 2023-10-09T11:36:37.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T11:36:38.054 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_objectstore":"memstore"} 2023-10-09T11:36:38.055 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T11:36:38.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:36:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.176+0000 7fd7c2267700 1 Processor -- start 2023-10-09T11:36:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.176+0000 7fd7c2267700 1 -- start start 2023-10-09T11:36:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c2267700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd7bc157ca0 0x7fd7bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c2267700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7bc06d120 0x7fd7bc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c2267700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0d07c0 con 0x7fd7bc1578d0 2023-10-09T11:36:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c2267700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc06da50 con 0x7fd7bc06d120 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c2267700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc0cfbb0 con 0x7fd7bc157ca0 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7bbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7bc1578d0 0x7fd7bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46526/0 (socket says 172.21.15.6:46526) 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7bbfff700 1 -- 172.21.15.6:0/3090528536 learned_addr learned my addr 172.21.15.6:0/3090528536 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7bb7fe700 1 --2- 172.21.15.6:0/3090528536 >> v2:172.21.15.118:3300/0 conn(0x7fd7bc157ca0 0x7fd7bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c0804700 1 --2- 172.21.15.6:0/3090528536 >> v2:172.21.15.6:3300/0 conn(0x7fd7bc06d120 0x7fd7bc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7baffd700 1 -- 172.21.15.6:0/3090528536 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180809698 0 0) 0x7fd7bc0d07c0 con 0x7fd7bc1578d0 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7baffd700 1 -- 172.21.15.6:0/3090528536 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a4003570 con 0x7fd7bc1578d0 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c0804700 1 -- 172.21.15.6:0/3090528536 >> v2:172.21.15.118:3300/0 conn(0x7fd7bc157ca0 msgr2=0x7fd7bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c0804700 1 --2- 172.21.15.6:0/3090528536 >> v2:172.21.15.118:3300/0 conn(0x7fd7bc157ca0 0x7fd7bc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c0804700 1 -- 172.21.15.6:0/3090528536 >> v1:172.21.15.6:6789/0 conn(0x7fd7bc1578d0 legacy=0x7fd7bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.177+0000 7fd7c0804700 1 -- 172.21.15.6:0/3090528536 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0cfe90 con 0x7fd7bc06d120 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c0804700 1 --2- 172.21.15.6:0/3090528536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc06d120 0x7fd7bc06d510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc068510 tx=0x7fd7b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a999d1cdbcd5890f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7baffd700 1 -- 172.21.15.6:0/3090528536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400e070 con 0x7fd7bc06d120 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7baffd700 1 -- 172.21.15.6:0/3090528536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400bab0 con 0x7fd7bc06d120 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7baffd700 1 -- 172.21.15.6:0/3090528536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400be70 con 0x7fd7bc06d120 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 -- 172.21.15.6:0/3090528536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc06d120 msgr2=0x7fd7bc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 --2- 172.21.15.6:0/3090528536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc06d120 0x7fd7bc06d510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc068510 tx=0x7fd7b4009780 comp rx=0 tx=0).stop 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 -- 172.21.15.6:0/3090528536 shutdown_connections 2023-10-09T11:36:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 --2- 172.21.15.6:0/3090528536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc06d120 0x7fd7bc06d510 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 --2- 172.21.15.6:0/3090528536 >> v2:172.21.15.118:3300/0 conn(0x7fd7bc157ca0 0x7fd7bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 -- 172.21.15.6:0/3090528536 >> 172.21.15.6:0/3090528536 conn(0x7fd7bc06bb90 msgr2=0x7fd7bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 -- 172.21.15.6:0/3090528536 shutdown_connections 2023-10-09T11:36:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.178+0000 7fd7c2267700 1 -- 172.21.15.6:0/3090528536 wait complete. 2023-10-09T11:36:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.179+0000 7fd7c2267700 1 Processor -- start 2023-10-09T11:36:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 -- start start 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7bc06d120 0x7fd7bc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7bc1578d0 0x7fd7bc0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c5b20 con 0x7fd7bc157ca0 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c66a0 con 0x7fd7bc1578d0 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c2267700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c5d70 con 0x7fd7bc06d120 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c0804700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c0804700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48218/0 (socket says 172.21.15.6:48218) 2023-10-09T11:36:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.180+0000 7fd7c0804700 1 -- 172.21.15.6:0/2741664918 learned_addr learned my addr 172.21.15.6:0/2741664918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7bb7fe700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7bc1578d0 0x7fd7bc0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 -- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7bc06d120 msgr2=0x7fd7bc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7bc06d120 0x7fd7bc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 -- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7bc1578d0 msgr2=0x7fd7bc0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7bc1578d0 0x7fd7bc0c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 -- 172.21.15.6:0/2741664918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009a20 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c0804700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc06fe20 tx=0x7fd7b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4027470 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b40275d0 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc0c6050 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4027990 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.181+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc155040 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.182+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc067ac0 con 0x7fd7bc157ca0 2023-10-09T11:36:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.182+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7b4024070 con 0x7fd7bc157ca0 2023-10-09T11:36:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.183+0000 7fd7a3fff700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 0x7fd7a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.183+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7b4086f70 con 0x7fd7bc157ca0 2023-10-09T11:36:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.183+0000 7fd7bbfff700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 0x7fd7a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.183+0000 7fd7bbfff700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 0x7fd7a80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00058d0 tx=0x7fd7b00079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.187+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7b40b85a0 con 0x7fd7bc157ca0 2023-10-09T11:36:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.384+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd7bc0d0170 con 0x7fd7bc157ca0 2023-10-09T11:36:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.387+0000 7fd7a3fff700 1 -- 172.21.15.6:0/2741664918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7b40541e0 con 0x7fd7bc157ca0 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 msgr2=0x7fd7a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 0x7fd7a80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00058d0 tx=0x7fd7b00079d0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 msgr2=0x7fd7bc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc06fe20 tx=0x7fd7b4019000 comp rx=0 tx=0).stop 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 shutdown_connections 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd7a8066f30 0x7fd7a80693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7bc157ca0 0x7fd7bc068880 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7bc06d120 0x7fd7bc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 --2- 172.21.15.6:0/2741664918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7bc1578d0 0x7fd7bc0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 >> 172.21.15.6:0/2741664918 conn(0x7fd7bc06bb90 msgr2=0x7fd7bc06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 shutdown_connections 2023-10-09T11:36:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.389+0000 7fd7c2267700 1 -- 172.21.15.6:0/2741664918 wait complete. 2023-10-09T11:36:38.403 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:36:38.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:38.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:36:38.487 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:36:38.487 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:36:38.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:38.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T11:36:38.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:36:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:38.523 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:36:38.578 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:36:38.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:38.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T11:36:38.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:36:38.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:38.621 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:36:38.677 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T11:36:38.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:38.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T11:36:38.714 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:36:38.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:38.714 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T11:36:38.769 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T11:36:38.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:36:38.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T11:36:38.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:36:38.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:36:38.813 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T11:36:38.868 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:36:38.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:38.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.986+0000 7f0c9a6f1700 1 Processor -- start 2023-10-09T11:36:38.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 -- start start 2023-10-09T11:36:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c940af270 0x7f0c940c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940c3030 0x7f0c940c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9406aae0 con 0x7f0c940aeea0 2023-10-09T11:36:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940c8780 con 0x7f0c940af270 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.987+0000 7f0c9a6f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94069ed0 con 0x7f0c940c3030 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c940af270 0x7f0c940c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c940af270 0x7f0c940c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48232/0 (socket says 172.21.15.6:48232) 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 -- 172.21.15.6:0/2371644776 learned_addr learned my addr 172.21.15.6:0/2371644776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c98c8e700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940c3030 0x7f0c940c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 -- 172.21.15.6:0/2371644776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940c3030 msgr2=0x7f0c940c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940c3030 0x7f0c940c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 -- 172.21.15.6:0/2371644776 >> v1:172.21.15.118:6789/0 conn(0x7f0c940aeea0 legacy=0x7f0c940c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 -- 172.21.15.6:0/2371644776 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9406a1b0 con 0x7f0c940af270 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c937fe700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c940c7d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800bc50 tx=0x7f0c8800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a930e1a4ebbbb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c92ffd700 1 -- 172.21.15.6:0/2371644776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800de90 con 0x7f0c940af270 2023-10-09T11:36:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c92ffd700 1 -- 172.21.15.6:0/2371644776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8800be60 con 0x7f0c940af270 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.988+0000 7f0c92ffd700 1 -- 172.21.15.6:0/2371644776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880196b0 con 0x7f0c940af270 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/2371644776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 msgr2=0x7f0c940c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c940c7d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800bc50 tx=0x7f0c8800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/2371644776 shutdown_connections 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940c3030 0x7f0c940c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/2371644776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c940c7d00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/2371644776 >> 172.21.15.6:0/2371644776 conn(0x7f0c9406c660 msgr2=0x7f0c940cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/2371644776 shutdown_connections 2023-10-09T11:36:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.989+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/2371644776 wait complete. 2023-10-09T11:36:38.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.990+0000 7f0c9a6f1700 1 Processor -- start 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.990+0000 7f0c9a6f1700 1 -- start start 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940aeea0 0x7f0c94166db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940c3030 0x7f0c94156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9415a610 con 0x7f0c940af270 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941672f0 con 0x7f0c940c3030 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c9a6f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94157600 con 0x7f0c940aeea0 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48244/0 (socket says 172.21.15.6:48244) 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 -- 172.21.15.6:0/3940270516 learned_addr learned my addr 172.21.15.6:0/3940270516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:38.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c93fff700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940aeea0 0x7f0c94166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c98c8e700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940c3030 0x7f0c94156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 -- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940aeea0 msgr2=0x7f0c94166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940aeea0 0x7f0c94166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 -- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940c3030 msgr2=0x7f0c94156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940c3030 0x7f0c94156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 -- 172.21.15.6:0/3940270516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8800b790 con 0x7f0c940af270 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.991+0000 7f0c937fe700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b760 tx=0x7f0c8801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.992+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88010540 con 0x7f0c940af270 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.992+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880106a0 con 0x7f0c940af270 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.992+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c94159a00 con 0x7f0c940af270 2023-10-09T11:36:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.992+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88010a20 con 0x7f0c940af270 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.992+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94159fc0 con 0x7f0c940af270 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.993+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94167530 con 0x7f0c940af270 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.993+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c88022030 con 0x7f0c940af270 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.993+0000 7f0c7bfff700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 0x7f0c800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.993+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c88014070 con 0x7f0c940af270 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.993+0000 7f0c93fff700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 0x7f0c800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:38.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.994+0000 7f0c93fff700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 0x7f0c800693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c94156c80 tx=0x7f0c84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:38.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:38.998+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c94167530 con 0x7f0c940af270 2023-10-09T11:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.233+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c94167530 con 0x7f0c940af270 2023-10-09T11:36:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.234+0000 7f0c7bfff700 1 -- 172.21.15.6:0/3940270516 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f0c94167530 con 0x7f0c940af270 2023-10-09T11:36:39.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:39.236 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 msgr2=0x7f0c800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 0x7f0c800693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c94156c80 tx=0x7f0c84009040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 msgr2=0x7f0c94169160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b760 tx=0x7f0c8801b000 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 shutdown_connections 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c80066f30 0x7f0c800693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c940c3030 0x7f0c94156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c940aeea0 0x7f0c94166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 --2- 172.21.15.6:0/3940270516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c940af270 0x7f0c94169160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 >> 172.21.15.6:0/3940270516 conn(0x7f0c9406c660 msgr2=0x7f0c9406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 shutdown_connections 2023-10-09T11:36:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.236+0000 7f0c9a6f1700 1 -- 172.21.15.6:0/3940270516 wait complete. 2023-10-09T11:36:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:39.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.367+0000 7f70fe3bf700 1 Processor -- start 2023-10-09T11:36:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.367+0000 7f70fe3bf700 1 -- start start 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70f81578d0 0x7f70f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 0x7f70f815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f806d120 0x7f70f806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80d07c0 con 0x7f70f81578d0 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f806daa0 con 0x7f70f8157ca0 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fe3bf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80cfbb0 con 0x7f70f806d120 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70f81578d0 0x7f70f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70f81578d0 0x7f70f80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48254/0 (socket says 172.21.15.6:48254) 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 -- 172.21.15.6:0/62123691 learned_addr learned my addr 172.21.15.6:0/62123691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f77fe700 1 --2- 172.21.15.6:0/62123691 >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 0x7f70f815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70fc95c700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f806d120 0x7f70f806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 -- 172.21.15.6:0/62123691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f806d120 msgr2=0x7f70f806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f806d120 0x7f70f806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.368+0000 7f70f7fff700 1 -- 172.21.15.6:0/62123691 >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 msgr2=0x7f70f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f7fff700 1 --2- 172.21.15.6:0/62123691 >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 0x7f70f815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f7fff700 1 -- 172.21.15.6:0/62123691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80cfe90 con 0x7f70f81578d0 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f77fe700 1 --2- 172.21.15.6:0/62123691 >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 0x7f70f815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f7fff700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81578d0 0x7f70f80cf4f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70f8068510 tx=0x7f70e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875fae5317df3365 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f6ffd700 1 -- 172.21.15.6:0/62123691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800b860 con 0x7f70f81578d0 2023-10-09T11:36:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f6ffd700 1 -- 172.21.15.6:0/62123691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800b9c0 con 0x7f70f81578d0 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70f6ffd700 1 -- 172.21.15.6:0/62123691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800bd60 con 0x7f70f81578d0 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 -- 172.21.15.6:0/62123691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81578d0 msgr2=0x7f70f80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81578d0 0x7f70f80cf4f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70f8068510 tx=0x7f70e8009250 comp rx=0 tx=0).stop 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 -- 172.21.15.6:0/62123691 shutdown_connections 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f806d120 0x7f70f806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/62123691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f81578d0 0x7f70f80cf4f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/62123691 >> v2:172.21.15.118:3300/0 conn(0x7f70f8157ca0 0x7f70f815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 -- 172.21.15.6:0/62123691 >> 172.21.15.6:0/62123691 conn(0x7f70f806bb90 msgr2=0x7f70f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 -- 172.21.15.6:0/62123691 shutdown_connections 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.369+0000 7f70fe3bf700 1 -- 172.21.15.6:0/62123691 wait complete. 2023-10-09T11:36:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 Processor -- start 2023-10-09T11:36:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 -- start start 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f81578d0 0x7f70f8153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f8157ca0 0x7f70f80b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c6180 con 0x7f70f806d120 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80b56c0 con 0x7f70f8157ca0 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.371+0000 7f70fe3bf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80c6a50 con 0x7f70f81578d0 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48258/0 (socket says 172.21.15.6:48258) 2023-10-09T11:36:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 -- 172.21.15.6:0/3813873147 learned_addr learned my addr 172.21.15.6:0/3813873147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70fc95c700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f8157ca0 0x7f70f80b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f77fe700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f81578d0 0x7f70f8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 -- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f81578d0 msgr2=0x7f70f8153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f81578d0 0x7f70f8153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 -- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f8157ca0 msgr2=0x7f70f80b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f8157ca0 0x7f70f80b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 -- 172.21.15.6:0/3813873147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80094f0 con 0x7f70f806d120 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70f7fff700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009290 tx=0x7f70e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011e40 con 0x7f70f806d120 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e801f070 con 0x7f70f806d120 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f80c5bc0 con 0x7f70f806d120 2023-10-09T11:36:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80266d0 con 0x7f70f806d120 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.372+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f80b5350 con 0x7f70f806d120 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.373+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8067ac0 con 0x7f70f806d120 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.373+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70e8026a40 con 0x7f70f806d120 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.374+0000 7f70dffff700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.374+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70e8021070 con 0x7f70f806d120 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.374+0000 7f70f77fe700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.374+0000 7f70f77fe700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 0x7f70e40693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70f816d6e0 tx=0x7f70ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.378+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70e8053540 con 0x7f70f806d120 2023-10-09T11:36:39.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.573+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70f80d0170 con 0x7f70f806d120 2023-10-09T11:36:39.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.574+0000 7f70dffff700 1 -- 172.21.15.6:0/3813873147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f70e8056b60 con 0x7f70f806d120 2023-10-09T11:36:39.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:39.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:39.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 msgr2=0x7f70e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 0x7f70e40693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f70f816d6e0 tx=0x7f70ec008040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 msgr2=0x7f70f80c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009290 tx=0x7f70e8017000 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 shutdown_connections 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f70e4066f30 0x7f70e40693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f8157ca0 0x7f70f80b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70f806d120 0x7f70f80c6510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 --2- 172.21.15.6:0/3813873147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f81578d0 0x7f70f8153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 >> 172.21.15.6:0/3813873147 conn(0x7f70f806bb90 msgr2=0x7f70f81557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 shutdown_connections 2023-10-09T11:36:39.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.576+0000 7f70fe3bf700 1 -- 172.21.15.6:0/3813873147 wait complete. 2023-10-09T11:36:39.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:01.791442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:02.434502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:36:39.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.712+0000 7f02ccde7700 1 Processor -- start 2023-10-09T11:36:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.712+0000 7f02ccde7700 1 -- start start 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02ccde7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02c80d0f50 0x7f02c806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02ccde7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c806d990 con 0x7f02c80d0b80 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02ccde7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c80cf2d0 con 0x7f02c806d530 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02ccde7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c815a690 con 0x7f02c80d0f50 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02c77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02c80d0b80 0x7f02c80cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46534/0 (socket says 172.21.15.6:46534) 2023-10-09T11:36:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02c77fe700 1 -- 172.21.15.6:0/1075113852 learned_addr learned my addr 172.21.15.6:0/1075113852 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02c6ffd700 1 --2- 172.21.15.6:0/1075113852 >> v2:172.21.15.118:3300/0 conn(0x7f02c80d0f50 0x7f02c806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154713710 0 0) 0x7f02c806d990 con 0x7f02c80d0b80 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.713+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b0003570 con 0x7f02c80d0b80 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474064958 0 0) 0x7f02c80cf2d0 con 0x7f02c806d530 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c806d990 con 0x7f02c806d530 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c6ffd700 1 -- 172.21.15.6:0/1075113852 >> v1:172.21.15.118:6789/0 conn(0x7f02c806d530 legacy=0x7f02c815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c6ffd700 1 -- 172.21.15.6:0/1075113852 >> v1:172.21.15.6:6789/0 conn(0x7f02c80d0b80 legacy=0x7f02c80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c6ffd700 1 -- 172.21.15.6:0/1075113852 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80d0480 con 0x7f02c80d0f50 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c6ffd700 1 --2- 172.21.15.6:0/1075113852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c80d0f50 0x7f02c806cff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0098e0 tx=0x7f02bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6acb909089d3710f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc011630 con 0x7f02c80d0f50 2023-10-09T11:36:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc011790 con 0x7f02c80d0f50 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02c67fc700 1 -- 172.21.15.6:0/1075113852 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc011b30 con 0x7f02c80d0f50 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02ccde7700 1 -- 172.21.15.6:0/1075113852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c80d0f50 msgr2=0x7f02c806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.714+0000 7f02ccde7700 1 --2- 172.21.15.6:0/1075113852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c80d0f50 0x7f02c806cff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0098e0 tx=0x7f02bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.715+0000 7f02ccde7700 1 -- 172.21.15.6:0/1075113852 shutdown_connections 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.715+0000 7f02ccde7700 1 --2- 172.21.15.6:0/1075113852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c80d0f50 0x7f02c806cff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.715+0000 7f02ccde7700 1 -- 172.21.15.6:0/1075113852 >> 172.21.15.6:0/1075113852 conn(0x7f02c8063230 msgr2=0x7f02c8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.715+0000 7f02ccde7700 1 -- 172.21.15.6:0/1075113852 shutdown_connections 2023-10-09T11:36:39.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.715+0000 7f02ccde7700 1 -- 172.21.15.6:0/1075113852 wait complete. 2023-10-09T11:36:39.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.716+0000 7f02ccde7700 1 Processor -- start 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.716+0000 7f02ccde7700 1 -- start start 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c806d530 0x7f02c81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02c80d0b80 0x7f02c8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8157060 con 0x7f02c80d0f50 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c81561b0 con 0x7f02c806d530 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c8156450 con 0x7f02c80d0b80 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48260/0 (socket says 172.21.15.6:48260) 2023-10-09T11:36:39.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 -- 172.21.15.6:0/505290130 learned_addr learned my addr 172.21.15.6:0/505290130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c77fe700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c806d530 0x7f02c81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c6ffd700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02c80d0b80 0x7f02c8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 -- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02c80d0b80 msgr2=0x7f02c8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02c80d0b80 0x7f02c8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 -- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c806d530 msgr2=0x7f02c81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c806d530 0x7f02c81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 -- 172.21.15.6:0/505290130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc009420 con 0x7f02c80d0f50 2023-10-09T11:36:39.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02c7fff700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f02c000c910 tx=0x7f02c00027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0012630 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c00127b0 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0012b70 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c8156730 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.717+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c8156cf0 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.718+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c81571d0 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.719+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02c001b400 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.719+0000 7f02af7fe700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.719+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02c0084840 con 0x7f02c80d0f50 2023-10-09T11:36:39.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.719+0000 7f02c77fe700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:39.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.720+0000 7f02c77fe700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 0x7f02b40693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007fd0 tx=0x7f02b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:39.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.724+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02c0051ab0 con 0x7f02c80d0f50 2023-10-09T11:36:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.914+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02c80676e0 con 0x7f02c80d0f50 2023-10-09T11:36:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.915+0000 7f02af7fe700 1 -- 172.21.15.6:0/505290130 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02c0016020 con 0x7f02c80d0f50 2023-10-09T11:36:39.917 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 msgr2=0x7f02b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 0x7f02b40693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007fd0 tx=0x7f02b8009040 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 msgr2=0x7f02c80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f02c000c910 tx=0x7f02c00027a0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 shutdown_connections 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c80d0f50 0x7f02c80b5560 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02c806d530 0x7f02c81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 --2- 172.21.15.6:0/505290130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02c80d0b80 0x7f02c8155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 >> 172.21.15.6:0/505290130 conn(0x7f02c8063230 msgr2=0x7f02c8068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 shutdown_connections 2023-10-09T11:36:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:39.917+0000 7f02ccde7700 1 -- 172.21.15.6:0/505290130 wait complete. 2023-10-09T11:36:39.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:36:40.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.050+0000 7f332a9db700 1 Processor -- start 2023-10-09T11:36:40.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.050+0000 7f332a9db700 1 -- start start 2023-10-09T11:36:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f332a9db700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3324157ca0 0x7f33240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f332a9db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f332406d120 0x7f332406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f332a9db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33240d07c0 con 0x7f33241578d0 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f332a9db700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332406da50 con 0x7f332406d120 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f332a9db700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33240cfbb0 con 0x7f3324157ca0 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f3328f78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f332406d120 0x7f332406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f3323fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33241578d0 0x7f332415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46540/0 (socket says 172.21.15.6:46540) 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.051+0000 7f3323fff700 1 -- 172.21.15.6:0/3298848682 learned_addr learned my addr 172.21.15.6:0/3298848682 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f33237fe700 1 --2- 172.21.15.6:0/3298848682 >> v2:172.21.15.118:3300/0 conn(0x7f3324157ca0 0x7f33240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3328f78700 1 -- 172.21.15.6:0/3298848682 >> v2:172.21.15.118:3300/0 conn(0x7f3324157ca0 msgr2=0x7f33240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3328f78700 1 --2- 172.21.15.6:0/3298848682 >> v2:172.21.15.118:3300/0 conn(0x7f3324157ca0 0x7f33240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3328f78700 1 -- 172.21.15.6:0/3298848682 >> v1:172.21.15.6:6789/0 conn(0x7f33241578d0 legacy=0x7f332415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3322ffd700 1 -- 172.21.15.6:0/3298848682 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994947242 0 0) 0x7f33240d07c0 con 0x7f33241578d0 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3328f78700 1 -- 172.21.15.6:0/3298848682 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240cfe90 con 0x7f332406d120 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3328f78700 1 --2- 172.21.15.6:0/3298848682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f332406d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3324068510 tx=0x7f331c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9202f78fb9c75a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3322ffd700 1 -- 172.21.15.6:0/3298848682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c00e070 con 0x7f332406d120 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3322ffd700 1 -- 172.21.15.6:0/3298848682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c00bc30 con 0x7f332406d120 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.052+0000 7f3322ffd700 1 -- 172.21.15.6:0/3298848682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c012430 con 0x7f332406d120 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 -- 172.21.15.6:0/3298848682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 msgr2=0x7f332406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 --2- 172.21.15.6:0/3298848682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f332406d510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3324068510 tx=0x7f331c009780 comp rx=0 tx=0).stop 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 -- 172.21.15.6:0/3298848682 shutdown_connections 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 --2- 172.21.15.6:0/3298848682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f332406d510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 --2- 172.21.15.6:0/3298848682 >> v2:172.21.15.118:3300/0 conn(0x7f3324157ca0 0x7f33240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 -- 172.21.15.6:0/3298848682 >> 172.21.15.6:0/3298848682 conn(0x7f332406bb90 msgr2=0x7f332406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 -- 172.21.15.6:0/3298848682 shutdown_connections 2023-10-09T11:36:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.053+0000 7f332a9db700 1 -- 172.21.15.6:0/3298848682 wait complete. 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.054+0000 7f332a9db700 1 Processor -- start 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.054+0000 7f332a9db700 1 -- start start 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 0x7f3324153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 0x7f3324068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3324154470 con 0x7f332406d120 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332416a770 con 0x7f3324157ca0 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3324169e60 con 0x7f33241578d0 2023-10-09T11:36:40.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48274/0 (socket says 172.21.15.6:48274) 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 -- 172.21.15.6:0/2058163295 learned_addr learned my addr 172.21.15.6:0/2058163295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3328f78700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 0x7f3324068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f33237fe700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 0x7f3324153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 -- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 msgr2=0x7f3324153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 0x7f3324153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 -- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 msgr2=0x7f3324068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 0x7f3324068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 -- 172.21.15.6:0/2058163295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c009a20 con 0x7f332406d120 2023-10-09T11:36:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3328f78700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 0x7f3324068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f33237fe700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 0x7f3324153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f3323fff700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c7e0 tx=0x7f330c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c005b30 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c005c90 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33240b6110 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c007300 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.055+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332416a400 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.056+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3324067ac0 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.057+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f330c01b400 con 0x7f332406d120 2023-10-09T11:36:40.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.057+0000 7f331bfff700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 0x7f33040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.057+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f330c084030 con 0x7f332406d120 2023-10-09T11:36:40.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.057+0000 7f33237fe700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 0x7f33040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.058+0000 7f33237fe700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 0x7f33040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd8b0 tx=0x7f3314008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.061+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f330c051320 con 0x7f332406d120 2023-10-09T11:36:40.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.253+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33240d0170 con 0x7f332406d120 2023-10-09T11:36:40.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.253+0000 7f331bfff700 1 -- 172.21.15.6:0/2058163295 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f330c054940 con 0x7f332406d120 2023-10-09T11:36:40.255 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 msgr2=0x7f33040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 0x7f33040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd8b0 tx=0x7f3314008040 comp rx=0 tx=0).stop 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 msgr2=0x7f33240b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c7e0 tx=0x7f330c007df0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 shutdown_connections 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3304066f30 0x7f33040693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3324157ca0 0x7f3324068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f332406d120 0x7f33240b6810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 --2- 172.21.15.6:0/2058163295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33241578d0 0x7f3324153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 >> 172.21.15.6:0/2058163295 conn(0x7f332406bb90 msgr2=0x7f33241565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 shutdown_connections 2023-10-09T11:36:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.255+0000 7f332a9db700 1 -- 172.21.15.6:0/2058163295 wait complete. 2023-10-09T11:36:40.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:36:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.388+0000 7f4866647700 1 Processor -- start 2023-10-09T11:36:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.388+0000 7f4866647700 1 -- start start 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4866647700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015a2a0 0x7f48600b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4866647700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48600ceb30 0x7f48600cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4866647700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b0ca0 con 0x7f486006d650 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4866647700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486006ea90 con 0x7f486015a2a0 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4866647700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600cf4c0 con 0x7f48600ceb30 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f485ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015a2a0 0x7f48600b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4864be4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f486006d650 0x7f486006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46542/0 (socket says 172.21.15.6:46542) 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f485ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015a2a0 0x7f48600b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48282/0 (socket says 172.21.15.6:48282) 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.389+0000 7f4864be4700 1 -- 172.21.15.6:0/4125872285 learned_addr learned my addr 172.21.15.6:0/4125872285 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485f7fe700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48600ceb30 0x7f48600cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485ffff700 1 -- 172.21.15.6:0/4125872285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48600ceb30 msgr2=0x7f48600cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485ffff700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48600ceb30 0x7f48600cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485ffff700 1 -- 172.21.15.6:0/4125872285 >> v1:172.21.15.6:6789/0 conn(0x7f486006d650 legacy=0x7f486006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485ffff700 1 -- 172.21.15.6:0/4125872285 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600b00d0 con 0x7f486015a2a0 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485effd700 1 -- 172.21.15.6:0/4125872285 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557043461 0 0) 0x7f48600b0ca0 con 0x7f486006d650 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485ffff700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015a2a0 0x7f48600b1130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48500098e0 tx=0x7f48500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dedef19e821cbde server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485effd700 1 -- 172.21.15.6:0/4125872285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850009e80 con 0x7f486015a2a0 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485effd700 1 -- 172.21.15.6:0/4125872285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000b860 con 0x7f486015a2a0 2023-10-09T11:36:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f485effd700 1 -- 172.21.15.6:0/4125872285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bbe0 con 0x7f486015a2a0 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f4866647700 1 -- 172.21.15.6:0/4125872285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015a2a0 msgr2=0x7f48600b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.390+0000 7f4866647700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015a2a0 0x7f48600b1130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48500098e0 tx=0x7f48500091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 -- 172.21.15.6:0/4125872285 shutdown_connections 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015a2a0 0x7f48600b1130 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 --2- 172.21.15.6:0/4125872285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48600ceb30 0x7f48600cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 -- 172.21.15.6:0/4125872285 >> 172.21.15.6:0/4125872285 conn(0x7f4860067640 msgr2=0x7f4860067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 -- 172.21.15.6:0/4125872285 shutdown_connections 2023-10-09T11:36:40.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.391+0000 7f4866647700 1 -- 172.21.15.6:0/4125872285 wait complete. 2023-10-09T11:36:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.392+0000 7f4866647700 1 Processor -- start 2023-10-09T11:36:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.392+0000 7f4866647700 1 -- start start 2023-10-09T11:36:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48600ceb30 0x7f4860147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f486015a2a0 0x7f4860156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b2680 con 0x7f486006d650 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b1a70 con 0x7f48600ceb30 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b1d50 con 0x7f486015a2a0 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48288/0 (socket says 172.21.15.6:48288) 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 -- 172.21.15.6:0/3869072461 learned_addr learned my addr 172.21.15.6:0/3869072461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4864be4700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f486015a2a0 0x7f4860156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485f7fe700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48600ceb30 0x7f4860147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 -- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f486015a2a0 msgr2=0x7f4860156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f486015a2a0 0x7f4860156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 -- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48600ceb30 msgr2=0x7f4860147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48600ceb30 0x7f4860147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 -- 172.21.15.6:0/3869072461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009420 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f485ffff700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f486006f990 tx=0x7f4850017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bbe0 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850011420 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600b2030 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500117c0 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.393+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486015fa90 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.394+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860069e40 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.395+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4850011bb0 con 0x7f486006d650 2023-10-09T11:36:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.395+0000 7f4857fff700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.395+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4850085c40 con 0x7f486006d650 2023-10-09T11:36:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.395+0000 7f485f7fe700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.396+0000 7f485f7fe700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 0x7f48400693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f486015d2e0 tx=0x7f4848008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.400+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4850052eb0 con 0x7f486006d650 2023-10-09T11:36:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.590+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f486004bb80 con 0x7f486006d650 2023-10-09T11:36:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.591+0000 7f4857fff700 1 -- 172.21.15.6:0/3869072461 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4850011e60 con 0x7f486006d650 2023-10-09T11:36:40.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:36:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 msgr2=0x7f48400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 0x7f48400693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f486015d2e0 tx=0x7f4848008040 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 msgr2=0x7f486015f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f486006f990 tx=0x7f4850017000 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 shutdown_connections 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f486015a2a0 0x7f4860156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486006d650 0x7f486015f550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 --2- 172.21.15.6:0/3869072461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48600ceb30 0x7f4860147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 >> 172.21.15.6:0/3869072461 conn(0x7f4860067640 msgr2=0x7f48600ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 shutdown_connections 2023-10-09T11:36:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.593+0000 7f4866647700 1 -- 172.21.15.6:0/3869072461 wait complete. 2023-10-09T11:36:40.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.723+0000 7f30c5ec8700 1 Processor -- start 2023-10-09T11:36:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 -- start start 2023-10-09T11:36:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c01578d0 0x7f30c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30c0157ca0 0x7f30c015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00d07c0 con 0x7f30c006d120 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00cfbb0 con 0x7f30c0157ca0 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.724+0000 7f30c5ec8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cfe90 con 0x7f30c01578d0 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30c0157ca0 0x7f30c015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30bffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f30c006d120 0x7f30c015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46544/0 (socket says 172.21.15.6:46544) 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30bffff700 1 -- 172.21.15.6:0/3498571762 learned_addr learned my addr 172.21.15.6:0/3498571762 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30bf7fe700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c01578d0 0x7f30c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 -- 172.21.15.6:0/3498571762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c01578d0 msgr2=0x7f30c00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c01578d0 0x7f30c00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 -- 172.21.15.6:0/3498571762 >> v1:172.21.15.6:6789/0 conn(0x7f30c006d120 legacy=0x7f30c015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 -- 172.21.15.6:0/3498571762 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00d0170 con 0x7f30c0157ca0 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30be7fc700 1 -- 172.21.15.6:0/3498571762 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814588985 0 0) 0x7f30c00d07c0 con 0x7f30c006d120 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30beffd700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c0157ca0 0x7f30c015af00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f30b40098e0 tx=0x7f30b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25acd691d5c32480 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30be7fc700 1 -- 172.21.15.6:0/3498571762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4009e80 con 0x7f30c0157ca0 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30be7fc700 1 -- 172.21.15.6:0/3498571762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400b860 con 0x7f30c0157ca0 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.725+0000 7f30be7fc700 1 -- 172.21.15.6:0/3498571762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400bbe0 con 0x7f30c0157ca0 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 -- 172.21.15.6:0/3498571762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c0157ca0 msgr2=0x7f30c015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c0157ca0 0x7f30c015af00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f30b40098e0 tx=0x7f30b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 -- 172.21.15.6:0/3498571762 shutdown_connections 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c01578d0 0x7f30c00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/3498571762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c0157ca0 0x7f30c015af00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 -- 172.21.15.6:0/3498571762 >> 172.21.15.6:0/3498571762 conn(0x7f30c006bb90 msgr2=0x7f30c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 -- 172.21.15.6:0/3498571762 shutdown_connections 2023-10-09T11:36:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.726+0000 7f30c5ec8700 1 -- 172.21.15.6:0/3498571762 wait complete. 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.727+0000 7f30c5ec8700 1 Processor -- start 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.727+0000 7f30c5ec8700 1 -- start start 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c006d120 0x7f30c01551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 0x7f30c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00acba0 con 0x7f30c01578d0 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0155720 con 0x7f30c0157ca0 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30c5ec8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00abf90 con 0x7f30c006d120 2023-10-09T11:36:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48298/0 (socket says 172.21.15.6:48298) 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 -- 172.21.15.6:0/2393102689 learned_addr learned my addr 172.21.15.6:0/2393102689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30bffff700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 0x7f30c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30bf7fe700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c006d120 0x7f30c01551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 -- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c006d120 msgr2=0x7f30c01551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c006d120 0x7f30c01551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 -- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 msgr2=0x7f30c0068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 0x7f30c0068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 -- 172.21.15.6:0/2393102689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4009420 con 0x7f30c01578d0 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30bffff700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 0x7f30c0068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30beffd700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f30c006fe20 tx=0x7f30b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.728+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400bbe0 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.729+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4011420 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.729+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c00ac270 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.729+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40117e0 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.729+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00ac830 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.730+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c006c960 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.730+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30b4011bd0 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.730+0000 7f30a77fe700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.730+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30b4085f50 con 0x7f30c01578d0 2023-10-09T11:36:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.730+0000 7f30bf7fe700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.731+0000 7f30bf7fe700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 0x7f30ac0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f30b0006fd0 tx=0x7f30b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.735+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30b40531c0 con 0x7f30c01578d0 2023-10-09T11:36:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.975+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30c00d0450 con 0x7f30c01578d0 2023-10-09T11:36:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.976+0000 7f30a77fe700 1 -- 172.21.15.6:0/2393102689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f30b40567e0 con 0x7f30c01578d0 2023-10-09T11:36:40.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:40.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 msgr2=0x7f30ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 0x7f30ac0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f30b0006fd0 tx=0x7f30b0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 msgr2=0x7f30c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f30c006fe20 tx=0x7f30b4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 shutdown_connections 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f30ac066f30 0x7f30ac0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30c0157ca0 0x7f30c0068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30c006d120 0x7f30c01551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 --2- 172.21.15.6:0/2393102689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c01578d0 0x7f30c0068880 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 >> 172.21.15.6:0/2393102689 conn(0x7f30c006bb90 msgr2=0x7f30c015aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 shutdown_connections 2023-10-09T11:36:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:40.978+0000 7f30c5ec8700 1 -- 172.21.15.6:0/2393102689 wait complete. 2023-10-09T11:36:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:40.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.109+0000 7fee67572700 1 Processor -- start 2023-10-09T11:36:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.109+0000 7fee67572700 1 -- start start 2023-10-09T11:36:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee67572700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fee601578d0 0x7fee600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee67572700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600d07c0 con 0x7fee60157ca0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee67572700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600cfbb0 con 0x7fee6006d120 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee67572700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600cfe90 con 0x7fee601578d0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee64b0d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee60157ca0 0x7fee6015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46560/0 (socket says 172.21.15.6:46560) 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee64b0d700 1 -- 172.21.15.6:0/1148832092 learned_addr learned my addr 172.21.15.6:0/1148832092 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee6530e700 1 --2- 172.21.15.6:0/1148832092 >> v2:172.21.15.118:3300/0 conn(0x7fee601578d0 0x7fee600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266737083 0 0) 0x7fee600d07c0 con 0x7fee60157ca0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee48003570 con 0x7fee60157ca0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2862679905 0 0) 0x7fee48003570 con 0x7fee60157ca0 2023-10-09T11:36:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 >> v2:172.21.15.118:3300/0 conn(0x7fee601578d0 msgr2=0x7fee600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 --2- 172.21.15.6:0/1148832092 >> v2:172.21.15.118:3300/0 conn(0x7fee601578d0 0x7fee600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 >> v1:172.21.15.118:6789/0 conn(0x7fee6006d120 legacy=0x7fee6006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600d0170 con 0x7fee60157ca0 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fee54001470 con 0x7fee60157ca0 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 >> v1:172.21.15.6:6789/0 conn(0x7fee60157ca0 legacy=0x7fee6015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee48003a60 0x7fee48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 0x7fee4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600cfe90 con 0x7fee480051c0 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800c0d0 con 0x7fee48003a60 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.110+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800c290 con 0x7fee48004810 2023-10-09T11:36:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 0x7fee4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee6530e700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee48003a60 0x7fee48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee64b0d700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 -- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee48004810 msgr2=0x7fee48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 -- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee48003a60 msgr2=0x7fee48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee48003a60 0x7fee48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 -- 172.21.15.6:0/1148832092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48003570 con 0x7fee480051c0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee64b0d700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee48004810 0x7fee48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 -- 172.21.15.6:0/1148832092 reap_dead start 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee65b0f700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 0x7fee4800ba60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee50001fc0 tx=0x7fee50001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8be53414ba16020 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50001950 con 0x7fee480051c0 2023-10-09T11:36:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000c8b0 con 0x7fee480051c0 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.111+0000 7fee5ffff700 1 -- 172.21.15.6:0/1148832092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000cc90 con 0x7fee480051c0 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 -- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 msgr2=0x7fee4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 0x7fee4800ba60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee50001fc0 tx=0x7fee50001640 comp rx=0 tx=0).stop 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 -- 172.21.15.6:0/1148832092 shutdown_connections 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 --2- 172.21.15.6:0/1148832092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee480051c0 0x7fee4800ba60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 -- 172.21.15.6:0/1148832092 >> 172.21.15.6:0/1148832092 conn(0x7fee6006bb90 msgr2=0x7fee6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 -- 172.21.15.6:0/1148832092 shutdown_connections 2023-10-09T11:36:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.112+0000 7fee67572700 1 -- 172.21.15.6:0/1148832092 wait complete. 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.113+0000 7fee67572700 1 Processor -- start 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.113+0000 7fee67572700 1 -- start start 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee480051c0 0x7fee601466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee600b44e0 0x7fee60069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b4aa0 con 0x7fee600b4070 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b4d80 con 0x7fee480051c0 2023-10-09T11:36:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee67572700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b5060 con 0x7fee600b44e0 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48306/0 (socket says 172.21.15.6:48306) 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 -- 172.21.15.6:0/3628333027 learned_addr learned my addr 172.21.15.6:0/3628333027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee6530e700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee480051c0 0x7fee601466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee65b0f700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee600b44e0 0x7fee60069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 -- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee600b44e0 msgr2=0x7fee60069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee600b44e0 0x7fee60069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 -- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee480051c0 msgr2=0x7fee601466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee480051c0 0x7fee601466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 -- 172.21.15.6:0/3628333027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600b5340 con 0x7fee600b4070 2023-10-09T11:36:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee64b0d700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee54001c00 tx=0x7fee54000da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400a4f0 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.114+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54010040 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.115+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6015cf40 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.115+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400a860 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.115+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6015b6a0 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.116+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60067ac0 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.116+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee5400ac10 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.117+0000 7fee5d7fa700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.117+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee54083900 con 0x7fee600b4070 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.117+0000 7fee6530e700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.117+0000 7fee6530e700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 0x7fee4c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee58006f00 tx=0x7fee580091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.121+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee5404d5a0 con 0x7fee600b4070 2023-10-09T11:36:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.314+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee600d0450 con 0x7fee600b4070 2023-10-09T11:36:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.315+0000 7fee5d7fa700 1 -- 172.21.15.6:0/3628333027 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fee54019070 con 0x7fee600b4070 2023-10-09T11:36:41.316 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:41.317 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 msgr2=0x7fee4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 0x7fee4c0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee58006f00 tx=0x7fee580091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 msgr2=0x7fee60069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee54001c00 tx=0x7fee54000da0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 shutdown_connections 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee600b44e0 0x7fee60069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee480051c0 0x7fee601466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 --2- 172.21.15.6:0/3628333027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee600b4070 0x7fee60069820 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 >> 172.21.15.6:0/3628333027 conn(0x7fee6006bb90 msgr2=0x7fee6006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 shutdown_connections 2023-10-09T11:36:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.317+0000 7fee67572700 1 -- 172.21.15.6:0/3628333027 wait complete. 2023-10-09T11:36:41.331 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:36:41.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:41.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.448+0000 7f0dbd89e700 1 Processor -- start 2023-10-09T11:36:41.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.448+0000 7f0dbd89e700 1 -- start start 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0dbd89e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0db8156420 0x7f0db80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0dbd89e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db80cc250 0x7f0db8069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0dbd89e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80cb880 con 0x7f0db8069980 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0dbd89e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db806aa10 con 0x7f0db80cc250 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0dbd89e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80cac70 con 0x7f0db8156420 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0db67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db80cc250 0x7f0db8069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0db67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0db80cc250 0x7f0db8069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48316/0 (socket says 172.21.15.6:48316) 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0db67fc700 1 -- 172.21.15.6:0/3194855063 learned_addr learned my addr 172.21.15.6:0/3194855063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.449+0000 7f0db6ffd700 1 --2- 172.21.15.6:0/3194855063 >> v2:172.21.15.118:3300/0 conn(0x7f0db8156420 0x7f0db80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db67fc700 1 -- 172.21.15.6:0/3194855063 >> v2:172.21.15.118:3300/0 conn(0x7f0db8156420 msgr2=0x7f0db80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db67fc700 1 --2- 172.21.15.6:0/3194855063 >> v2:172.21.15.118:3300/0 conn(0x7f0db8156420 0x7f0db80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db67fc700 1 -- 172.21.15.6:0/3194855063 >> v1:172.21.15.118:6789/0 conn(0x7f0db8069980 legacy=0x7f0db80c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db67fc700 1 -- 172.21.15.6:0/3194855063 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80caf50 con 0x7f0db80cc250 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db67fc700 1 --2- 172.21.15.6:0/3194855063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db80cc250 0x7f0db8069440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c39e0 tx=0x7f0da0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd046da26765ae24 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db5ffb700 1 -- 172.21.15.6:0/3194855063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000b860 con 0x7f0db80cc250 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db5ffb700 1 -- 172.21.15.6:0/3194855063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000b9c0 con 0x7f0db80cc250 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0db5ffb700 1 -- 172.21.15.6:0/3194855063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000bd60 con 0x7f0db80cc250 2023-10-09T11:36:41.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 -- 172.21.15.6:0/3194855063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db80cc250 msgr2=0x7f0db8069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/3194855063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db80cc250 0x7f0db8069440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c39e0 tx=0x7f0da0009250 comp rx=0 tx=0).stop 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 -- 172.21.15.6:0/3194855063 shutdown_connections 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/3194855063 >> v2:172.21.15.118:3300/0 conn(0x7f0db8156420 0x7f0db80cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/3194855063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db80cc250 0x7f0db8069440 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 -- 172.21.15.6:0/3194855063 >> 172.21.15.6:0/3194855063 conn(0x7f0db806c660 msgr2=0x7f0db80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 -- 172.21.15.6:0/3194855063 shutdown_connections 2023-10-09T11:36:41.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.450+0000 7f0dbd89e700 1 -- 172.21.15.6:0/3194855063 wait complete. 2023-10-09T11:36:41.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 Processor -- start 2023-10-09T11:36:41.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 -- start start 2023-10-09T11:36:41.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db80cc250 0x7f0db80c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0db8156420 0x7f0db8141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8144750 con 0x7f0db8069980 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8126a80 con 0x7f0db80cc250 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.452+0000 7f0dbd89e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db813e820 con 0x7f0db8156420 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48322/0 (socket says 172.21.15.6:48322) 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 -- 172.21.15.6:0/2003365247 learned_addr learned my addr 172.21.15.6:0/2003365247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db67fc700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db80cc250 0x7f0db80c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db77fe700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0db8156420 0x7f0db8141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 -- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0db8156420 msgr2=0x7f0db8141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0db8156420 0x7f0db8141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 -- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db80cc250 msgr2=0x7f0db80c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db80cc250 0x7f0db80c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 -- 172.21.15.6:0/2003365247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00094f0 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0db6ffd700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0db000d860 tx=0x7f0db0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db00125f0 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0012770 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db813eb00 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0012b30 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.453+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db813e520 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.454+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db813f020 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.454+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0db0013480 con 0x7f0db8069980 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.455+0000 7f0daeffd700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.455+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0db0084880 con 0x7f0db8069980 2023-10-09T11:36:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.455+0000 7f0db67fc700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.455+0000 7f0db67fc700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 0x7f0d980693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c39e0 tx=0x7f0da0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.459+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db813f020 con 0x7f0db8069980 2023-10-09T11:36:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.693+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db813f020 con 0x7f0db8069980 2023-10-09T11:36:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.693+0000 7f0daeffd700 1 -- 172.21.15.6:0/2003365247 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f0db813f020 con 0x7f0db8069980 2023-10-09T11:36:41.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:41.695 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 msgr2=0x7f0d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 0x7f0d980693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c39e0 tx=0x7f0da0017000 comp rx=0 tx=0).stop 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 msgr2=0x7f0db81429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0db000d860 tx=0x7f0db0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 shutdown_connections 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0db8156420 0x7f0db8141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0db8069980 0x7f0db81429f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 --2- 172.21.15.6:0/2003365247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db80cc250 0x7f0db80c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 >> 172.21.15.6:0/2003365247 conn(0x7f0db806c660 msgr2=0x7f0db806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 shutdown_connections 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.695+0000 7f0dbd89e700 1 -- 172.21.15.6:0/2003365247 wait complete. 2023-10-09T11:36:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:41.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:41.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.825+0000 7f4500aa4700 1 Processor -- start 2023-10-09T11:36:41.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.826+0000 7f4500aa4700 1 -- start start 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.826+0000 7f4500aa4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.826+0000 7f4500aa4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44fc0cf240 0x7f44fc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f4500aa4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44fc0b2890 con 0x7f44fc1583b0 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f4500aa4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0b4070 con 0x7f44fc0cf240 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f4500aa4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0b4350 con 0x7f44fc157fe0 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44f9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44fc1583b0 0x7f44fc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46566/0 (socket says 172.21.15.6:46566) 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44f9d9b700 1 -- 172.21.15.6:0/1257243676 learned_addr learned my addr 172.21.15.6:0/1257243676 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:41.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 --2- 172.21.15.6:0/1257243676 >> v2:172.21.15.118:3300/0 conn(0x7f44fc0cf240 0x7f44fc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fa59c700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540577602 0 0) 0x7f44fc0b2890 con 0x7f44fc1583b0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e8003570 con 0x7f44fc1583b0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 -- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 msgr2=0x7f44fc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179591141 0 0) 0x7f44e8003570 con 0x7f44fc1583b0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 -- 172.21.15.6:0/1257243676 >> v1:172.21.15.6:6789/0 conn(0x7f44fc1583b0 legacy=0x7f44fc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 -- 172.21.15.6:0/1257243676 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0b4630 con 0x7f44fc0cf240 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fa59c700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.827+0000 7f44fad9d700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc0b3a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009e60 tx=0x7f44ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181636c2d471f7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00e070 con 0x7f44fc0cf240 2023-10-09T11:36:41.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec00bab0 con 0x7f44fc0cf240 2023-10-09T11:36:41.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f44f959a700 1 -- 172.21.15.6:0/1257243676 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00be50 con 0x7f44fc0cf240 2023-10-09T11:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 -- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 msgr2=0x7f44fc0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc0b3a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009e60 tx=0x7f44ec009780 comp rx=0 tx=0).stop 2023-10-09T11:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 -- 172.21.15.6:0/1257243676 shutdown_connections 2023-10-09T11:36:41.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc0b3a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 --2- 172.21.15.6:0/1257243676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 -- 172.21.15.6:0/1257243676 >> 172.21.15.6:0/1257243676 conn(0x7f44fc067640 msgr2=0x7f44fc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 -- 172.21.15.6:0/1257243676 shutdown_connections 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.828+0000 7f4500aa4700 1 -- 172.21.15.6:0/1257243676 wait complete. 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.829+0000 7f4500aa4700 1 Processor -- start 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.829+0000 7f4500aa4700 1 -- start start 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15eb90 con 0x7f44fc1583b0 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc14df00 con 0x7f44fc0cf240 2023-10-09T11:36:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f4500aa4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15df80 con 0x7f44fc157fe0 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48332/0 (socket says 172.21.15.6:48332) 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 -- 172.21.15.6:0/2370008818 learned_addr learned my addr 172.21.15.6:0/2370008818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fa59c700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44f9d9b700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 -- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 msgr2=0x7f44fc152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 -- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 msgr2=0x7f44fc14d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.830+0000 7f44fad9d700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc14d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44fad9d700 1 -- 172.21.15.6:0/2370008818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009420 con 0x7f44fc1583b0 2023-10-09T11:36:41.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44f9d9b700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44fad9d700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06f990 tx=0x7f44ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0070c0 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec012e60 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec009a20 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec026620 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.831+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc15e540 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.832+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc069e40 con 0x7f44fc1583b0 2023-10-09T11:36:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.832+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44ec026a50 con 0x7f44fc1583b0 2023-10-09T11:36:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.833+0000 7f44f27fc700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.833+0000 7f44fa59c700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.833+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44ec086430 con 0x7f44fc1583b0 2023-10-09T11:36:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.833+0000 7f44fa59c700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 0x7f44dc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44f40093f0 tx=0x7f44f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:41.837+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44ec0536a0 con 0x7f44fc1583b0 2023-10-09T11:36:42.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.075+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44fc0cc6b0 con 0x7f44fc1583b0 2023-10-09T11:36:42.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.076+0000 7f44f27fc700 1 -- 172.21.15.6:0/2370008818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f44ec056cc0 con 0x7f44fc1583b0 2023-10-09T11:36:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:42.078 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1859728606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1859728606},{"type":"v1","addr":"172.21.15.118:6834","nonce":1859728606}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2652723510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2652723510},{"type":"v1","addr":"172.21.15.118:6835","nonce":2652723510}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3999864563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3999864563},{"type":"v1","addr":"172.21.15.6:6835","nonce":3999864563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:03.468524+0000","modified":"2023-10-09T11:36:07.085366+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/989530631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":989530631},{"type":"v1","addr":"172.21.15.6:6837","nonce":989530631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 msgr2=0x7f44dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 0x7f44dc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44f40093f0 tx=0x7f44f4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 msgr2=0x7f44fc152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06f990 tx=0x7f44ec019000 comp rx=0 tx=0).stop 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 shutdown_connections 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44dc066f30 0x7f44dc0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc1583b0 0x7f44fc152ba0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44fc0cf240 0x7f44fc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 --2- 172.21.15.6:0/2370008818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44fc157fe0 0x7f44fc152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 >> 172.21.15.6:0/2370008818 conn(0x7f44fc067640 msgr2=0x7f44fc153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 shutdown_connections 2023-10-09T11:36:42.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.078+0000 7f4500aa4700 1 -- 172.21.15.6:0/2370008818 wait complete. 2023-10-09T11:36:42.081 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-10-09T11:36:42.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:42.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.208+0000 7feb74286700 1 Processor -- start 2023-10-09T11:36:42.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.208+0000 7feb74286700 1 -- start start 2023-10-09T11:36:42.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb74286700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c15daa0 0x7feb6c15de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb74286700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb6c0cae00 0x7feb6c159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb74286700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6c06d350 con 0x7feb6c0cb270 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb74286700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c0c9ac0 con 0x7feb6c0cae00 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb74286700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c15e3b0 con 0x7feb6c15daa0 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb71821700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb6c0cae00 0x7feb6c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb71821700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb6c0cae00 0x7feb6c159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48336/0 (socket says 172.21.15.6:48336) 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.209+0000 7feb71821700 1 -- 172.21.15.6:0/1822536754 learned_addr learned my addr 172.21.15.6:0/1822536754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71821700 1 -- 172.21.15.6:0/1822536754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c15daa0 msgr2=0x7feb6c15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb72022700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c15daa0 0x7feb6c15de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71821700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c15daa0 0x7feb6c15de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71821700 1 -- 172.21.15.6:0/1822536754 >> v1:172.21.15.118:6789/0 conn(0x7feb6c0cb270 legacy=0x7feb6c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71821700 1 -- 172.21.15.6:0/1822536754 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c06c740 con 0x7feb6c0cae00 2023-10-09T11:36:42.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71821700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c159540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635d5ffc811da2a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71020700 1 -- 172.21.15.6:0/1822536754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000b860 con 0x7feb6c0cae00 2023-10-09T11:36:42.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71020700 1 -- 172.21.15.6:0/1822536754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000b9c0 con 0x7feb6c0cae00 2023-10-09T11:36:42.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.210+0000 7feb71020700 1 -- 172.21.15.6:0/1822536754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bd60 con 0x7feb6c0cae00 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 -- 172.21.15.6:0/1822536754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 msgr2=0x7feb6c159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c159540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60009250 comp rx=0 tx=0).stop 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 -- 172.21.15.6:0/1822536754 shutdown_connections 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c15daa0 0x7feb6c15de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 --2- 172.21.15.6:0/1822536754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c159540 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 -- 172.21.15.6:0/1822536754 >> 172.21.15.6:0/1822536754 conn(0x7feb6c0c9ca0 msgr2=0x7feb6c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 -- 172.21.15.6:0/1822536754 shutdown_connections 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.211+0000 7feb74286700 1 -- 172.21.15.6:0/1822536754 wait complete. 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.212+0000 7feb74286700 1 Processor -- start 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.212+0000 7feb74286700 1 -- start start 2023-10-09T11:36:42.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 0x7feb6c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 0x7feb6c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c15a920 con 0x7feb6c0cae00 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c16d5a0 con 0x7feb6c15daa0 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c16a510 con 0x7feb6c0cb270 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48344/0 (socket says 172.21.15.6:48344) 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 -- 172.21.15.6:0/3666290103 learned_addr learned my addr 172.21.15.6:0/3666290103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:42.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb71821700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 0x7feb6c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72823700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 0x7feb6c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 -- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 msgr2=0x7feb6c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 0x7feb6c0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 -- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 msgr2=0x7feb6c0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 0x7feb6c0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 -- 172.21.15.6:0/3666290103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600094f0 con 0x7feb6c0cae00 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb71821700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 0x7feb6c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72823700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 0x7feb6c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb72022700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feb6400c7d0 tx=0x7feb64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64011600 con 0x7feb6c0cae00 2023-10-09T11:36:42.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64011760 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64011b20 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c16a7f0 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.213+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c16adb0 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.214+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c16d7c0 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.215+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb640193f0 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.215+0000 7feb6a7fc700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.215+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb640849b0 con 0x7feb6c0cae00 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.215+0000 7feb71821700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.216+0000 7feb71821700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.219+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb6c16d7c0 con 0x7feb6c0cae00 2023-10-09T11:36:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.413+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb6c16d760 con 0x7feb6c0cae00 2023-10-09T11:36:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.414+0000 7feb6a7fc700 1 -- 172.21.15.6:0/3666290103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7feb640556b0 con 0x7feb6c0cae00 2023-10-09T11:36:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:42.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:05.061344+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:01.791442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:02.434502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 msgr2=0x7feb580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60017000 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 msgr2=0x7feb6c0ac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feb6400c7d0 tx=0x7feb64008040 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 shutdown_connections 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb6c15daa0 0x7feb6c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb6c0cae00 0x7feb6c0ac720 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 --2- 172.21.15.6:0/3666290103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb6c0cb270 0x7feb6c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 >> 172.21.15.6:0/3666290103 conn(0x7feb6c0c9ca0 msgr2=0x7feb6c15c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 shutdown_connections 2023-10-09T11:36:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.416+0000 7feb74286700 1 -- 172.21.15.6:0/3666290103 wait complete. 2023-10-09T11:36:42.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:36:42.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.552+0000 7efda93c1700 1 Processor -- start 2023-10-09T11:36:42.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.552+0000 7efda93c1700 1 -- start start 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda93c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efda40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda93c1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40d07c0 con 0x7efda4157ca0 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda93c1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40cfbb0 con 0x7efda406d120 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda93c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40cfe90 con 0x7efda41578d0 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efda4157ca0 0x7efda415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46576/0 (socket says 172.21.15.6:46576) 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda27fc700 1 -- 172.21.15.6:0/2959421170 learned_addr learned my addr 172.21.15.6:0/2959421170 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:42.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efda40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226303163 0 0) 0x7efda40d07c0 con 0x7efda4157ca0 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd90003570 con 0x7efda4157ca0 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682140733 0 0) 0x7efda40cfbb0 con 0x7efda406d120 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda40d07c0 con 0x7efda406d120 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901185137 0 0) 0x7efd90003570 con 0x7efda4157ca0 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 msgr2=0x7efda40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efda40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 >> v1:172.21.15.118:6789/0 conn(0x7efda406d120 legacy=0x7efda415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40d0170 con 0x7efda4157ca0 2023-10-09T11:36:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7efd8c001470 con 0x7efda4157ca0 2023-10-09T11:36:42.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 >> v1:172.21.15.6:6789/0 conn(0x7efda4157ca0 legacy=0x7efda415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efd90004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efd90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd90004d50 0x7efd900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40cfe90 con 0x7efd90003c20 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9000bbf0 con 0x7efd90004d50 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.553+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9000bd60 con 0x7efda41578d0 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efd90004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda27fc700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efd90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda37fe700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd90004d50 0x7efd900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 -- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 msgr2=0x7efd90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda41578d0 0x7efd90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 -- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd90004d50 msgr2=0x7efd900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd90004d50 0x7efd900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 -- 172.21.15.6:0/2959421170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90003570 con 0x7efd90003c20 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efd90004010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006f00 tx=0x7efd9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1045803244b13871 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e710 con 0x7efd90003c20 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00e870 con 0x7efd90003c20 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.554+0000 7efda1ffb700 1 -- 172.21.15.6:0/2959421170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00ec30 con 0x7efd90003c20 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 -- 172.21.15.6:0/2959421170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 msgr2=0x7efd90004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 --2- 172.21.15.6:0/2959421170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efd90004010 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006f00 tx=0x7efd9c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda37fe700 1 -- 172.21.15.6:0/2959421170 reap_dead start 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 -- 172.21.15.6:0/2959421170 shutdown_connections 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 -- 172.21.15.6:0/2959421170 >> 172.21.15.6:0/2959421170 conn(0x7efda406bb90 msgr2=0x7efda406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 -- 172.21.15.6:0/2959421170 shutdown_connections 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.555+0000 7efda93c1700 1 -- 172.21.15.6:0/2959421170 wait complete. 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.556+0000 7efda93c1700 1 Processor -- start 2023-10-09T11:36:42.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.556+0000 7efda93c1700 1 -- start start 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda40cd620 0x7efda4069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda4155090 0x7efda4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda416ead0 con 0x7efd90003c20 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda416dec0 con 0x7efda4155090 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda416e1a0 con 0x7efda40cd620 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48370/0 (socket says 172.21.15.6:48370) 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 -- 172.21.15.6:0/2962271046 learned_addr learned my addr 172.21.15.6:0/2962271046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda27fc700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda40cd620 0x7efda4069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda37fe700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda4155090 0x7efda4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 -- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda40cd620 msgr2=0x7efda4069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda40cd620 0x7efda4069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 -- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda4155090 msgr2=0x7efda4155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda4155090 0x7efda4155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 -- 172.21.15.6:0/2962271046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda416e480 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda2ffd700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efd900057a0 tx=0x7efd9c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c022070 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00e9e0 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.557+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda416e760 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.558+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e710 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.558+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda406a430 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.559+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda406a650 con 0x7efd90003c20 2023-10-09T11:36:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.559+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd9c01c660 con 0x7efd90003c20 2023-10-09T11:36:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.559+0000 7efd9affd700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.559+0000 7efda27fc700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.559+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd9c085b20 con 0x7efd90003c20 2023-10-09T11:36:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.560+0000 7efda27fc700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efda40cd9f0 tx=0x7efda415b610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.564+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd9c052e40 con 0x7efd90003c20 2023-10-09T11:36:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.801+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efda40d0450 con 0x7efd90003c20 2023-10-09T11:36:42.803 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:36:42.802+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:36:42.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.805+0000 7efd9affd700 1 -- 172.21.15.6:0/2962271046 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7efd9c056460 con 0x7efd90003c20 2023-10-09T11:36:42.808 INFO:tasks.ceph.mds.c.smithi006.stderr: -1788> 2023-10-09T11:36:08.040+0000 7f04a4ff0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 msgr2=0x7efd840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efda40cd9f0 tx=0x7efda415b610 comp rx=0 tx=0).stop 2023-10-09T11:36:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 msgr2=0x7efda4158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efd900057a0 tx=0x7efd9c01a000 comp rx=0 tx=0).stop 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 shutdown_connections 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda4155090 0x7efda4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd90003c20 0x7efda4158fd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 --2- 172.21.15.6:0/2962271046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efda40cd620 0x7efda4069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 >> 172.21.15.6:0/2962271046 conn(0x7efda406bb90 msgr2=0x7efda4156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 shutdown_connections 2023-10-09T11:36:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.808+0000 7efda93c1700 1 -- 172.21.15.6:0/2962271046 wait complete. 2023-10-09T11:36:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:36:42.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:36:42.831 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:36:42.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.946+0000 7fee54790700 1 Processor -- start 2023-10-09T11:36:42.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.946+0000 7fee54790700 1 -- start start 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee54790700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee4c15a2a0 0x7fee4c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee54790700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c0ceb30 0x7fee4c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee54790700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0b0ca0 con 0x7fee4c06d650 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee54790700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c06ea90 con 0x7fee4c15a2a0 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee54790700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0cf4c0 con 0x7fee4c0ceb30 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.947+0000 7fee5252c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee4c15a2a0 0x7fee4c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee4c15a2a0 0x7fee4c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48396/0 (socket says 172.21.15.6:48396) 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 -- 172.21.15.6:0/2779012135 learned_addr learned my addr 172.21.15.6:0/2779012135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee51d2b700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c0ceb30 0x7fee4c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 -- 172.21.15.6:0/2779012135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c0ceb30 msgr2=0x7fee4c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c0ceb30 0x7fee4c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 -- 172.21.15.6:0/2779012135 >> v1:172.21.15.118:6789/0 conn(0x7fee4c06d650 legacy=0x7fee4c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 -- 172.21.15.6:0/2779012135 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0b00d0 con 0x7fee4c15a2a0 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5252c700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c15a2a0 0x7fee4c0b1130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fee44009f20 tx=0x7fee44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170dd07cbbae946f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5152a700 1 -- 172.21.15.6:0/2779012135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400e070 con 0x7fee4c15a2a0 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5152a700 1 -- 172.21.15.6:0/2779012135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400ba80 con 0x7fee4c15a2a0 2023-10-09T11:36:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.948+0000 7fee5152a700 1 -- 172.21.15.6:0/2779012135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440092e0 con 0x7fee4c15a2a0 2023-10-09T11:36:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 -- 172.21.15.6:0/2779012135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c15a2a0 msgr2=0x7fee4c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c15a2a0 0x7fee4c0b1130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fee44009f20 tx=0x7fee44009840 comp rx=0 tx=0).stop 2023-10-09T11:36:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 -- 172.21.15.6:0/2779012135 shutdown_connections 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c15a2a0 0x7fee4c0b1130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 --2- 172.21.15.6:0/2779012135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c0ceb30 0x7fee4c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 -- 172.21.15.6:0/2779012135 >> 172.21.15.6:0/2779012135 conn(0x7fee4c067640 msgr2=0x7fee4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 -- 172.21.15.6:0/2779012135 shutdown_connections 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.949+0000 7fee54790700 1 -- 172.21.15.6:0/2779012135 wait complete. 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.950+0000 7fee54790700 1 Processor -- start 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.950+0000 7fee54790700 1 -- start start 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee4c0ceb30 0x7fee4c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c15a2a0 0x7fee4c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0b32e0 con 0x7fee4c06d650 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15cab0 con 0x7fee4c0ceb30 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15cd90 con 0x7fee4c15a2a0 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48400/0 (socket says 172.21.15.6:48400) 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 -- 172.21.15.6:0/2302333691 learned_addr learned my addr 172.21.15.6:0/2302333691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee51d2b700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee4c0ceb30 0x7fee4c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee52d2d700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c15a2a0 0x7fee4c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 -- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c15a2a0 msgr2=0x7fee4c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c15a2a0 0x7fee4c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 -- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee4c0ceb30 msgr2=0x7fee4c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee4c0ceb30 0x7fee4c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 -- 172.21.15.6:0/2302333691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44009ae0 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee5252c700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b6c0 tx=0x7fee44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440088b0 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44008a10 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c15d070 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44008dd0 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.951+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0b2840 con 0x7fee4c06d650 2023-10-09T11:36:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.952+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c069e40 con 0x7fee4c06d650 2023-10-09T11:36:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.953+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee44003040 con 0x7fee4c06d650 2023-10-09T11:36:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.953+0000 7fee4a7fc700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.953+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fee44085fa0 con 0x7fee4c06d650 2023-10-09T11:36:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.953+0000 7fee51d2b700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.954+0000 7fee51d2b700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee4c155840 tx=0x7fee40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:42.958+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee44053270 con 0x7fee4c06d650 2023-10-09T11:36:43.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.199+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fee4c04bb80 con 0x7fee4c06d650 2023-10-09T11:36:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.806+0000 7fee4a7fc700 1 -- 172.21.15.6:0/2302333691 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee44008f30 con 0x7fee4c06d650 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 msgr2=0x7fee380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 0x7fee380693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee4c155840 tx=0x7fee40008040 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 msgr2=0x7fee4c0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b6c0 tx=0x7fee44018000 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 shutdown_connections 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee38066f30 0x7fee380693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee4c15a2a0 0x7fee4c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c06d650 0x7fee4c0b2300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 --2- 172.21.15.6:0/2302333691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee4c0ceb30 0x7fee4c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 >> 172.21.15.6:0/2302333691 conn(0x7fee4c067640 msgr2=0x7fee4c157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 shutdown_connections 2023-10-09T11:36:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.809+0000 7fee54790700 1 -- 172.21.15.6:0/2302333691 wait complete. 2023-10-09T11:36:43.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:36:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.995+0000 7faa8bbe8700 1 Processor -- start 2023-10-09T11:36:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 -- start start 2023-10-09T11:36:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa840cf240 0x7faa840b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8406d650 0x7faa8406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa840b0ca0 con 0x7faa8415a2a0 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8406ea90 con 0x7faa8406d650 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.996+0000 7faa8bbe8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa840b00d0 con 0x7faa840cf240 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8406d650 0x7faa8406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8406d650 0x7faa8406da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32906/0 (socket says 172.21.15.6:32906) 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 -- 172.21.15.6:0/1980720746 learned_addr learned my addr 172.21.15.6:0/1980720746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa89183700 1 --2- 172.21.15.6:0/1980720746 >> v2:172.21.15.118:3300/0 conn(0x7faa840cf240 0x7faa840b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 -- 172.21.15.6:0/1980720746 >> v2:172.21.15.118:3300/0 conn(0x7faa840cf240 msgr2=0x7faa840b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 --2- 172.21.15.6:0/1980720746 >> v2:172.21.15.118:3300/0 conn(0x7faa840cf240 0x7faa840b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 -- 172.21.15.6:0/1980720746 >> v1:172.21.15.118:6789/0 conn(0x7faa8415a2a0 legacy=0x7faa840ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 -- 172.21.15.6:0/1980720746 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840b0370 con 0x7faa8406d650 2023-10-09T11:36:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa8a185700 1 --2- 172.21.15.6:0/1980720746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa8406da20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa840713b0 tx=0x7faa74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199fb93823f3cfc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa88982700 1 -- 172.21.15.6:0/1980720746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400b860 con 0x7faa8406d650 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa88982700 1 -- 172.21.15.6:0/1980720746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400b9c0 con 0x7faa8406d650 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.997+0000 7faa88982700 1 -- 172.21.15.6:0/1980720746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400bd60 con 0x7faa8406d650 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1980720746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 msgr2=0x7faa8406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1980720746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa8406da20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa840713b0 tx=0x7faa74009250 comp rx=0 tx=0).stop 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1980720746 shutdown_connections 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1980720746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa8406da20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1980720746 >> v2:172.21.15.118:3300/0 conn(0x7faa840cf240 0x7faa840b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1980720746 >> 172.21.15.6:0/1980720746 conn(0x7faa84067640 msgr2=0x7faa84067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1980720746 shutdown_connections 2023-10-09T11:36:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.998+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1980720746 wait complete. 2023-10-09T11:36:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.999+0000 7faa8bbe8700 1 Processor -- start 2023-10-09T11:36:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:43.999+0000 7faa8bbe8700 1 -- start start 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa840cf240 0x7faa84067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8415a2a0 0x7faa84067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8415c9a0 con 0x7faa8406d650 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa840b47f0 con 0x7faa8415a2a0 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8bbe8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8416e100 con 0x7faa840cf240 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32922/0 (socket says 172.21.15.6:32922) 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 -- 172.21.15.6:0/1892452916 learned_addr learned my addr 172.21.15.6:0/1892452916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa8a185700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8415a2a0 0x7faa84067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89183700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa840cf240 0x7faa84067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 -- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa840cf240 msgr2=0x7faa84067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa840cf240 0x7faa84067a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 -- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8415a2a0 msgr2=0x7faa84067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8415a2a0 0x7faa84067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 -- 172.21.15.6:0/1892452916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa740094f0 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa89984700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00c910 tx=0x7faa7c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.000+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c012630 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.001+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c0127b0 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.001+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8416e3e0 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.001+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c012b70 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.001+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa84145ae0 con 0x7faa8406d650 2023-10-09T11:36:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.002+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84145d60 con 0x7faa8406d650 2023-10-09T11:36:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.002+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa7c003030 con 0x7faa8406d650 2023-10-09T11:36:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.002+0000 7faa81ffb700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.003+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7faa7c084520 con 0x7faa8406d650 2023-10-09T11:36:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.003+0000 7faa89183700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.003+0000 7faa89183700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 0x7faa700693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa840b3dc0 tx=0x7faa78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.007+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa7c0551d0 con 0x7faa8406d650 2023-10-09T11:36:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.203+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa8404bb80 con 0x7faa8406d650 2023-10-09T11:36:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.922+0000 7faa81ffb700 1 -- 172.21.15.6:0/1892452916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa7c054d60 con 0x7faa8406d650 2023-10-09T11:36:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 msgr2=0x7faa700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 0x7faa700693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa840b3dc0 tx=0x7faa78008040 comp rx=0 tx=0).stop 2023-10-09T11:36:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 msgr2=0x7faa840b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00c910 tx=0x7faa7c001710 comp rx=0 tx=0).stop 2023-10-09T11:36:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 shutdown_connections 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa70066f30 0x7faa700693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa8415a2a0 0x7faa84067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8406d650 0x7faa840b42b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 --2- 172.21.15.6:0/1892452916 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa840cf240 0x7faa84067a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.925+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 >> 172.21.15.6:0/1892452916 conn(0x7faa84067640 msgr2=0x7faa840ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.926+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 shutdown_connections 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:44.926+0000 7faa8bbe8700 1 -- 172.21.15.6:0/1892452916 wait complete. 2023-10-09T11:36:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:36:44.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:36:45.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.067+0000 7f13227f1700 1 Processor -- start 2023-10-09T11:36:45.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.067+0000 7f13227f1700 1 -- start start 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f13227f1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f131c0cf240 0x7f131c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f13227f1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c0b0ca0 con 0x7f131c06d650 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f13227f1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c0b00d0 con 0x7f131c15a2a0 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f13227f1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c06ea90 con 0x7f131c0cf240 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f1320d8e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f131c06d650 0x7f131c06da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51274/0 (socket says 172.21.15.6:51274) 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f1320d8e700 1 -- 172.21.15.6:0/3188946520 learned_addr learned my addr 172.21.15.6:0/3188946520 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.068+0000 7f131b7fe700 1 --2- 172.21.15.6:0/3188946520 >> v2:172.21.15.118:3300/0 conn(0x7f131c0cf240 0x7f131c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070363411 0 0) 0x7f131c0b0ca0 con 0x7f131c06d650 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1308003570 con 0x7f131c06d650 2023-10-09T11:36:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833721382 0 0) 0x7f131c0b00d0 con 0x7f131c15a2a0 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f131c0b0ca0 con 0x7f131c15a2a0 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3196425740 0 0) 0x7f1308003570 con 0x7f131c06d650 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131b7fe700 1 -- 172.21.15.6:0/3188946520 >> v1:172.21.15.118:6789/0 conn(0x7f131c15a2a0 legacy=0x7f131c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131b7fe700 1 -- 172.21.15.6:0/3188946520 >> v1:172.21.15.6:6789/0 conn(0x7f131c06d650 legacy=0x7f131c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131b7fe700 1 -- 172.21.15.6:0/3188946520 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0b0370 con 0x7f131c0cf240 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131b7fe700 1 --2- 172.21.15.6:0/3188946520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c0cf240 0x7f131c0b1130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f667a4c2435f87b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140017f0 con 0x7f131c0cf240 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011420 con 0x7f131c0cf240 2023-10-09T11:36:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.069+0000 7f131affd700 1 -- 172.21.15.6:0/3188946520 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040117c0 con 0x7f131c0cf240 2023-10-09T11:36:45.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 -- 172.21.15.6:0/3188946520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c0cf240 msgr2=0x7f131c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 --2- 172.21.15.6:0/3188946520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c0cf240 0x7f131c0b1130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 -- 172.21.15.6:0/3188946520 shutdown_connections 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 --2- 172.21.15.6:0/3188946520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c0cf240 0x7f131c0b1130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 -- 172.21.15.6:0/3188946520 >> 172.21.15.6:0/3188946520 conn(0x7f131c067640 msgr2=0x7f131c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 -- 172.21.15.6:0/3188946520 shutdown_connections 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.070+0000 7f13227f1700 1 -- 172.21.15.6:0/3188946520 wait complete. 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.071+0000 7f13227f1700 1 Processor -- start 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.071+0000 7f13227f1700 1 -- start start 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c0cf240 0x7f131c141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c15a2a0 0x7f131c15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c15e3e0 con 0x7f131c06d650 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c142db0 con 0x7f131c15a2a0 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f13227f1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c15d7d0 con 0x7f131c0cf240 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32930/0 (socket says 172.21.15.6:32930) 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 -- 172.21.15.6:0/832962673 learned_addr learned my addr 172.21.15.6:0/832962673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f1320d8e700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c15a2a0 0x7f131c15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131b7fe700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c0cf240 0x7f131c141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 -- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c0cf240 msgr2=0x7f131c141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c0cf240 0x7f131c141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 -- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c15a2a0 msgr2=0x7f131c15ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c15a2a0 0x7f131c15ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 -- 172.21.15.6:0/832962673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009420 con 0x7f131c06d650 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.072+0000 7f131bfff700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c580 tx=0x7f130c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.073+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c010510 con 0x7f131c06d650 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.073+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c010670 con 0x7f131c06d650 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.073+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c15dab0 con 0x7f131c06d650 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.073+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c010a30 con 0x7f131c06d650 2023-10-09T11:36:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.073+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c15e070 con 0x7f131c06d650 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.074+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c069e40 con 0x7f131c06d650 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.074+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f130c01b400 con 0x7f131c06d650 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.074+0000 7f1313fff700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.074+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f130c084140 con 0x7f131c06d650 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.075+0000 7f131b7fe700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.075+0000 7f131b7fe700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f1304016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.079+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f130c051510 con 0x7f131c06d650 2023-10-09T11:36:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.271+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f131c04bb80 con 0x7f131c06d650 2023-10-09T11:36:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.926+0000 7f1313fff700 1 -- 172.21.15.6:0/832962673 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f130c054b30 con 0x7f131c06d650 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.929+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 msgr2=0x7f12fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.929+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f1304016000 comp rx=0 tx=0).stop 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.929+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 msgr2=0x7f131c142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.929+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c580 tx=0x7f130c007e10 comp rx=0 tx=0).stop 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 shutdown_connections 2023-10-09T11:36:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c15a2a0 0x7f131c15ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c06d650 0x7f131c142870 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 --2- 172.21.15.6:0/832962673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c0cf240 0x7f131c141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 >> 172.21.15.6:0/832962673 conn(0x7f131c067640 msgr2=0x7f131c156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 shutdown_connections 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:45.930+0000 7f13227f1700 1 -- 172.21.15.6:0/832962673 wait complete. 2023-10-09T11:36:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:36:45.947 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:36:45.947 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:36:45.947 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:36:45.948 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:45.948 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:36:45.948 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:36:45.948 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:36:45.948 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:45.948 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:36:45.948 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:36:45.949 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:36:45.949 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:45.949 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:36:45.949 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:36:45.949 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:36:45.949 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:36:45.957 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:36:45.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:36:45.958 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:36:45.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:36:45.959 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:36:45.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:36:45.960 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:36:45.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:36:46.000 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:36:46.000 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:46.001 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:36:46.002 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:46.003 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:36:46.003 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:46.003 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:36:46.004 DEBUG:teuthology.parallel:result is None 2023-10-09T11:36:46.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:36:46.081 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:36:46.081 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:36:46.083 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:36:46.083 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:36:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.132+0000 7fb21571a700 1 Processor -- start 2023-10-09T11:36:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.132+0000 7fb21571a700 1 -- start start 2023-10-09T11:36:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb21571a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb21571a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb210159f10 0x7fb210068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb21571a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2100cee10 con 0x7fb2100ccb40 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb21571a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2100cd040 con 0x7fb210159f10 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb21571a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100cd320 con 0x7fb210159b40 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb210159f10 0x7fb210068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb214f19700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2100ccb40 0x7fb21015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51292/0 (socket says 172.21.15.6:51292) 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb214f19700 1 -- 172.21.15.6:0/4004267259 learned_addr learned my addr 172.21.15.6:0/4004267259 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20ffff700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20f7fe700 1 -- 172.21.15.6:0/4004267259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 msgr2=0x7fb2100cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20f7fe700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20f7fe700 1 -- 172.21.15.6:0/4004267259 >> v1:172.21.15.6:6789/0 conn(0x7fb2100ccb40 legacy=0x7fb21015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20f7fe700 1 -- 172.21.15.6:0/4004267259 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100ce7c0 con 0x7fb210159f10 2023-10-09T11:36:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20effd700 1 -- 172.21.15.6:0/4004267259 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679224237 0 0) 0x7fb2100cee10 con 0x7fb2100ccb40 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.133+0000 7fb20ffff700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb20f7fe700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb210159f10 0x7fb210068780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098e0 tx=0x7fb2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fbd303efc8df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb20effd700 1 -- 172.21.15.6:0/4004267259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200009e80 con 0x7fb210159f10 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb20effd700 1 -- 172.21.15.6:0/4004267259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20000b860 con 0x7fb210159f10 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb20effd700 1 -- 172.21.15.6:0/4004267259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20000bbe0 con 0x7fb210159f10 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 -- 172.21.15.6:0/4004267259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb210159f10 msgr2=0x7fb210068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb210159f10 0x7fb210068780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098e0 tx=0x7fb2000091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 -- 172.21.15.6:0/4004267259 shutdown_connections 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 --2- 172.21.15.6:0/4004267259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb210159f10 0x7fb210068780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 -- 172.21.15.6:0/4004267259 >> 172.21.15.6:0/4004267259 conn(0x7fb2100cd660 msgr2=0x7fb2100cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 -- 172.21.15.6:0/4004267259 shutdown_connections 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.134+0000 7fb21571a700 1 -- 172.21.15.6:0/4004267259 wait complete. 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.135+0000 7fb21571a700 1 Processor -- start 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 -- start start 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb210159f10 0x7fb21015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb210157660 con 0x7fb2100ccb40 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100c9f80 con 0x7fb210159f10 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb21571a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100ca260 con 0x7fb210159b40 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb20ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb20ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32986/0 (socket says 172.21.15.6:32986) 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.136+0000 7fb20ffff700 1 -- 172.21.15.6:0/648609666 learned_addr learned my addr 172.21.15.6:0/648609666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb214f19700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb210159f10 0x7fb21015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20f7fe700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 -- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 msgr2=0x7fb2100c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 -- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb210159f10 msgr2=0x7fb21015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb210159f10 0x7fb21015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 -- 172.21.15.6:0/648609666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200009420 con 0x7fb2100ccb40 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb20ffff700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e8d0 tx=0x7fb204008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400ee70 con 0x7fb2100ccb40 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400c5e0 con 0x7fb2100ccb40 2023-10-09T11:36:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2100ca540 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400c980 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.137+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2100c9b60 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.138+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2100cb890 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.138+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb204013410 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.139+0000 7fb1f7fff700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.139+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb204084090 con 0x7fb2100ccb40 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.139+0000 7fb20f7fe700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.139+0000 7fb20f7fe700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2100cad20 tx=0x7fb200017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.143+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb204051600 con 0x7fb2100ccb40 2023-10-09T11:36:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.351+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb2100ca6d0 con 0x7fb2100ccb40 2023-10-09T11:36:46.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.939+0000 7fb1f7fff700 1 -- 172.21.15.6:0/648609666 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb204054c20 con 0x7fb2100ccb40 2023-10-09T11:36:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 msgr2=0x7fb1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2100cad20 tx=0x7fb200017000 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 msgr2=0x7fb210160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e8d0 tx=0x7fb204008040 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 shutdown_connections 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb210159f10 0x7fb21015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2100ccb40 0x7fb210160850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 --2- 172.21.15.6:0/648609666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb210159b40 0x7fb2100c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.942+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 >> 172.21.15.6:0/648609666 conn(0x7fb2100cd660 msgr2=0x7fb2100cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:46.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.943+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 shutdown_connections 2023-10-09T11:36:46.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:46.943+0000 7fb21571a700 1 -- 172.21.15.6:0/648609666 wait complete. 2023-10-09T11:36:46.946 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:36:46.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:36:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 Processor -- start 2023-10-09T11:36:47.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 -- start start 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 0x7f235c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0d07c0 con 0x7f235c06d120 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0cfbb0 con 0x7f235c157ca0 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.083+0000 7f2362e83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0cfe90 con 0x7f235c1578d0 2023-10-09T11:36:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f235bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 0x7f235c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2361420700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f235c06d120 0x7f235c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:42770/0 (socket says 172.21.15.6:42770) 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2361420700 1 -- 172.21.15.6:0/3397009687 learned_addr learned my addr 172.21.15.6:0/3397009687 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 -- 172.21.15.6:0/3397009687 >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 msgr2=0x7f235c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 --2- 172.21.15.6:0/3397009687 >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 0x7f235c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 -- 172.21.15.6:0/3397009687 >> v1:172.21.15.118:6789/0 conn(0x7f235c06d120 legacy=0x7f235c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 -- 172.21.15.6:0/3397009687 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c0d0170 con 0x7f235c1578d0 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f235bfff700 1 --2- 172.21.15.6:0/3397009687 >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 0x7f235c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.084+0000 7f2360c1f700 1 --2- 172.21.15.6:0/3397009687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0cf4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2354009e60 tx=0x7f2354009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5810a9a1fbd3998 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f235b7fe700 1 -- 172.21.15.6:0/3397009687 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400e070 con 0x7f235c1578d0 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f235b7fe700 1 -- 172.21.15.6:0/3397009687 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235400bb60 con 0x7f235c1578d0 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f235b7fe700 1 -- 172.21.15.6:0/3397009687 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354012430 con 0x7f235c1578d0 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 -- 172.21.15.6:0/3397009687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 msgr2=0x7f235c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 --2- 172.21.15.6:0/3397009687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0cf4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2354009e60 tx=0x7f2354009780 comp rx=0 tx=0).stop 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 -- 172.21.15.6:0/3397009687 shutdown_connections 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 --2- 172.21.15.6:0/3397009687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0cf4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 --2- 172.21.15.6:0/3397009687 >> v2:172.21.15.118:3300/0 conn(0x7f235c157ca0 0x7f235c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 -- 172.21.15.6:0/3397009687 >> 172.21.15.6:0/3397009687 conn(0x7f235c06bb90 msgr2=0x7f235c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 -- 172.21.15.6:0/3397009687 shutdown_connections 2023-10-09T11:36:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.085+0000 7f2362e83700 1 -- 172.21.15.6:0/3397009687 wait complete. 2023-10-09T11:36:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.086+0000 7f2362e83700 1 Processor -- start 2023-10-09T11:36:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.086+0000 7f2362e83700 1 -- start start 2023-10-09T11:36:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c06d120 0x7f235c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b1510 con 0x7f235c157ca0 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1550d0 con 0x7f235c06d120 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2362e83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b0890 con 0x7f235c1578d0 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2361420700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2361420700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32998/0 (socket says 172.21.15.6:32998) 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2361420700 1 -- 172.21.15.6:0/888755636 learned_addr learned my addr 172.21.15.6:0/888755636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f2360c1f700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c06d120 0x7f235c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.087+0000 7f235bfff700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 -- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 msgr2=0x7f235c0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 -- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c06d120 msgr2=0x7f235c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c06d120 0x7f235c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 -- 172.21.15.6:0/888755636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c009420 con 0x7f235c157ca0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2361420700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f234400c5c0 tx=0x7f2344007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344005b30 con 0x7f235c157ca0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344005cb0 con 0x7f235c157ca0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2354009a20 con 0x7f235c157ca0 2023-10-09T11:36:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344007320 con 0x7f235c157ca0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.088+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c0b0e50 con 0x7f235c157ca0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.089+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c067ac0 con 0x7f235c157ca0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.089+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f234401b3b0 con 0x7f235c157ca0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.090+0000 7f2358ff9700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.090+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f23440835a0 con 0x7f235c157ca0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.090+0000 7f2360c1f700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.090+0000 7f2360c1f700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23540097c0 tx=0x7f2354019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.095+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2344050b60 con 0x7f235c157ca0 2023-10-09T11:36:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.365+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f235c0d0450 con 0x7f235c157ca0 2023-10-09T11:36:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.366+0000 7f2358ff9700 1 -- 172.21.15.6:0/888755636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2344017090 con 0x7f235c157ca0 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:36:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:36:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:36:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:36:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:36:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:36:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-10-09T11:36:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNlsZhrBhAA07npqMKdfFOu+swRYNSTpw==", 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNlX7RrBhAAVKMftIS5w1W7gXjX1kSZtA==", 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNlwr1rBhAASwvksmicZKrGAXgptnM2nA==", 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNlRcZrBhAAwhgTeCT39SCbIZG5HJTBqw==", 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNlOs9rBhAAmHTGLlUVtrERGuLg/HvO1A==", 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T11:36:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCS5SNl7tdrBhAA85Bd3TTCMg5DiTa+sNlD7Q==", 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:36:47.390 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:36:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 msgr2=0x7f233c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 0x7f233c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f23540097c0 tx=0x7f2354019000 comp rx=0 tx=0).stop 2023-10-09T11:36:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 msgr2=0x7f235c16b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f234400c5c0 tx=0x7f2344007ef0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 shutdown_connections 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f233c066f30 0x7f233c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f235c157ca0 0x7f235c16b1e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c06d120 0x7f235c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 --2- 172.21.15.6:0/888755636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f235c1578d0 0x7f235c0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 >> 172.21.15.6:0/888755636 conn(0x7f235c06bb90 msgr2=0x7f235c1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 shutdown_connections 2023-10-09T11:36:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.368+0000 7f2362e83700 1 -- 172.21.15.6:0/888755636 wait complete. 2023-10-09T11:36:47.394 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T11:36:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.512+0000 7f2ab9e19700 1 Processor -- start 2023-10-09T11:36:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.512+0000 7f2ab9e19700 1 -- start start 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab9e19700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ab41578d0 0x7f2ab40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab9e19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ab4157ca0 0x7f2ab415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab9e19700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40d07c0 con 0x7f2ab406d120 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab9e19700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40cfbb0 con 0x7f2ab41578d0 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab9e19700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40cfe90 con 0x7f2ab4157ca0 2023-10-09T11:36:47.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ab41578d0 0x7f2ab40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ab41578d0 0x7f2ab40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33014/0 (socket says 172.21.15.6:33014) 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 -- 172.21.15.6:0/404980498 learned_addr learned my addr 172.21.15.6:0/404980498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 -- 172.21.15.6:0/404980498 >> v2:172.21.15.118:3300/0 conn(0x7f2ab4157ca0 msgr2=0x7f2ab415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab2ffd700 1 --2- 172.21.15.6:0/404980498 >> v2:172.21.15.118:3300/0 conn(0x7f2ab4157ca0 0x7f2ab415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 --2- 172.21.15.6:0/404980498 >> v2:172.21.15.118:3300/0 conn(0x7f2ab4157ca0 0x7f2ab415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 -- 172.21.15.6:0/404980498 >> v1:172.21.15.118:6789/0 conn(0x7f2ab406d120 legacy=0x7f2ab406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 -- 172.21.15.6:0/404980498 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40d0170 con 0x7f2ab41578d0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.513+0000 7f2ab37fe700 1 --2- 172.21.15.6:0/404980498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab41578d0 0x7f2ab40cf4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4068510 tx=0x7f2aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c37eb6685d7210 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab27fc700 1 -- 172.21.15.6:0/404980498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400b820 con 0x7f2ab41578d0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab27fc700 1 -- 172.21.15.6:0/404980498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa400b980 con 0x7f2ab41578d0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab27fc700 1 -- 172.21.15.6:0/404980498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400bd20 con 0x7f2ab41578d0 2023-10-09T11:36:47.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 -- 172.21.15.6:0/404980498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab41578d0 msgr2=0x7f2ab40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/404980498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab41578d0 0x7f2ab40cf4f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4068510 tx=0x7f2aa4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 -- 172.21.15.6:0/404980498 shutdown_connections 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/404980498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab41578d0 0x7f2ab40cf4f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/404980498 >> v2:172.21.15.118:3300/0 conn(0x7f2ab4157ca0 0x7f2ab415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 -- 172.21.15.6:0/404980498 >> 172.21.15.6:0/404980498 conn(0x7f2ab406bb90 msgr2=0x7f2ab406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 -- 172.21.15.6:0/404980498 shutdown_connections 2023-10-09T11:36:47.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.514+0000 7f2ab9e19700 1 -- 172.21.15.6:0/404980498 wait complete. 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.515+0000 7f2ab9e19700 1 Processor -- start 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 -- start start 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ab406d120 0x7f2ab40cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab41578d0 0x7f2ab41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40cde90 con 0x7f2ab4157ca0 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41444c0 con 0x7f2ab41578d0 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab9e19700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab41447a0 con 0x7f2ab406d120 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33018/0 (socket says 172.21.15.6:33018) 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.516+0000 7f2ab3fff700 1 -- 172.21.15.6:0/128269313 learned_addr learned my addr 172.21.15.6:0/128269313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab37fe700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ab406d120 0x7f2ab40cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab2ffd700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab41578d0 0x7f2ab41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 -- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ab406d120 msgr2=0x7f2ab40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ab406d120 0x7f2ab40cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 -- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab41578d0 msgr2=0x7f2ab41464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab41578d0 0x7f2ab41464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 -- 172.21.15.6:0/128269313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40094f0 con 0x7f2ab4157ca0 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab3fff700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c930 tx=0x7f2aac0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00ce70 con 0x7f2ab4157ca0 2023-10-09T11:36:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00a7e0 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4144a80 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00aba0 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.517+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab40b5e20 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.518+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab4145280 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.518+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2aac012420 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.519+0000 7f2a9b7fe700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 0x7f2aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.519+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2aac0845b0 con 0x7f2ab4157ca0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.519+0000 7f2ab37fe700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 0x7f2aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.519+0000 7f2ab37fe700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 0x7f2aa00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4068510 tx=0x7f2aa4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.523+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ab4145280 con 0x7f2ab4157ca0 2023-10-09T11:36:47.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.793+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2ab4145280 con 0x7f2ab4157ca0 2023-10-09T11:36:47.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.796+0000 7f2a9b7fe700 1 -- 172.21.15.6:0/128269313 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2ab4145280 con 0x7f2ab4157ca0 2023-10-09T11:36:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 msgr2=0x7f2aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 0x7f2aa00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4068510 tx=0x7f2aa4016000 comp rx=0 tx=0).stop 2023-10-09T11:36:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 msgr2=0x7f2ab41439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c930 tx=0x7f2aac0026e0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 shutdown_connections 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2aa0066f30 0x7f2aa00693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4157ca0 0x7f2ab41439d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ab406d120 0x7f2ab40cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 --2- 172.21.15.6:0/128269313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ab41578d0 0x7f2ab41464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 >> 172.21.15.6:0/128269313 conn(0x7f2ab406bb90 msgr2=0x7f2ab4154720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 shutdown_connections 2023-10-09T11:36:47.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.799+0000 7f2ab9e19700 1 -- 172.21.15.6:0/128269313 wait complete. 2023-10-09T11:36:47.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T11:36:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.930+0000 7fb256f78700 1 Processor -- start 2023-10-09T11:36:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.930+0000 7fb256f78700 1 -- start start 2023-10-09T11:36:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb256f78700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2501578d0 0x7fb2500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb256f78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 0x7fb25015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb256f78700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500d07c0 con 0x7fb25006d120 2023-10-09T11:36:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb256f78700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2500cfbb0 con 0x7fb2501578d0 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb256f78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500cfe90 con 0x7fb250157ca0 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb255515700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb25006d120 0x7fb25015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51300/0 (socket says 172.21.15.6:51300) 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb255515700 1 -- 172.21.15.6:0/763265748 learned_addr learned my addr 172.21.15.6:0/763265748 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb254d14700 1 --2- 172.21.15.6:0/763265748 >> v2:172.21.15.118:3300/0 conn(0x7fb2501578d0 0x7fb2500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.931+0000 7fb24ffff700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 0x7fb25015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24f7fe700 1 -- 172.21.15.6:0/763265748 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488637750 0 0) 0x7fb2500d07c0 con 0x7fb25006d120 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24f7fe700 1 -- 172.21.15.6:0/763265748 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c003570 con 0x7fb25006d120 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb254d14700 1 -- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 msgr2=0x7fb25015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb254d14700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 0x7fb25015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb254d14700 1 -- 172.21.15.6:0/763265748 >> v1:172.21.15.6:6789/0 conn(0x7fb25006d120 legacy=0x7fb25015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb254d14700 1 -- 172.21.15.6:0/763265748 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500d0170 con 0x7fb2501578d0 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24ffff700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 0x7fb25015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb254d14700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb2500cf4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb248009e60 tx=0x7fb248009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f1805b547deef1b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24f7fe700 1 -- 172.21.15.6:0/763265748 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24800e070 con 0x7fb2501578d0 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24f7fe700 1 -- 172.21.15.6:0/763265748 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24800bab0 con 0x7fb2501578d0 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.932+0000 7fb24f7fe700 1 -- 172.21.15.6:0/763265748 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24800be70 con 0x7fb2501578d0 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 -- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 msgr2=0x7fb2500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb2500cf4f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb248009e60 tx=0x7fb248009780 comp rx=0 tx=0).stop 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 -- 172.21.15.6:0/763265748 shutdown_connections 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb2500cf4f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 --2- 172.21.15.6:0/763265748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb250157ca0 0x7fb25015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 -- 172.21.15.6:0/763265748 >> 172.21.15.6:0/763265748 conn(0x7fb25006bb90 msgr2=0x7fb25006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 -- 172.21.15.6:0/763265748 shutdown_connections 2023-10-09T11:36:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.933+0000 7fb256f78700 1 -- 172.21.15.6:0/763265748 wait complete. 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.934+0000 7fb256f78700 1 Processor -- start 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.934+0000 7fb256f78700 1 -- start start 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25006d120 0x7fb250069010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb25015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25016a360 con 0x7fb250157ca0 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b4f50 con 0x7fb2501578d0 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb256f78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500b5230 con 0x7fb25006d120 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33030/0 (socket says 172.21.15.6:33030) 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 -- 172.21.15.6:0/1942057744 learned_addr learned my addr 172.21.15.6:0/1942057744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb24ffff700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb25015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb254d14700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25006d120 0x7fb250069010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 -- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25006d120 msgr2=0x7fb250069010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25006d120 0x7fb250069010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 -- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 msgr2=0x7fb25015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb25015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 -- 172.21.15.6:0/1942057744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240009420 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb255515700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb2380010e0 tx=0x7fb238007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238005c00 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.935+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238005d60 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.936+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb248009a20 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.936+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380072e0 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.936+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2500b57f0 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.936+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb250067ac0 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.937+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb238012400 con 0x7fb250157ca0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.937+0000 7fb24cff9700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.937+0000 7fb254d14700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.938+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb2380834f0 con 0x7fb250157ca0 2023-10-09T11:36:47.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.938+0000 7fb254d14700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb2480097c0 tx=0x7fb248019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:47.943+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb23804b5a0 con 0x7fb250157ca0 2023-10-09T11:36:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.215+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb2500d0450 con 0x7fb250157ca0 2023-10-09T11:36:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.221+0000 7fb24cff9700 1 -- 172.21.15.6:0/1942057744 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb238017020 con 0x7fb250157ca0 2023-10-09T11:36:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 msgr2=0x7fb2300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb2480097c0 tx=0x7fb248019000 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 msgr2=0x7fb2501534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb2380010e0 tx=0x7fb238007dd0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 shutdown_connections 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb230066f30 0x7fb2300693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb250157ca0 0x7fb2501534c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb25006d120 0x7fb250069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 --2- 172.21.15.6:0/1942057744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2501578d0 0x7fb25015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 >> 172.21.15.6:0/1942057744 conn(0x7fb25006bb90 msgr2=0x7fb250069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 shutdown_connections 2023-10-09T11:36:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.223+0000 7fb256f78700 1 -- 172.21.15.6:0/1942057744 wait complete. 2023-10-09T11:36:48.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T11:36:48.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 Processor -- start 2023-10-09T11:36:48.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 -- start start 2023-10-09T11:36:48.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc41578d0 0x7f3dc40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3dc406d120 0x7f3dc406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc406dac0 con 0x7f3dc4157ca0 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40d07c0 con 0x7f3dc406d120 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.355+0000 7f3dc8ce9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40cfbb0 con 0x7f3dc41578d0 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3dc406d120 0x7f3dc406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3dc406d120 0x7f3dc406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33044/0 (socket says 172.21.15.6:33044) 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 -- 172.21.15.6:0/4031889846 learned_addr learned my addr 172.21.15.6:0/4031889846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 -- 172.21.15.6:0/4031889846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc41578d0 msgr2=0x7f3dc40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc259c700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc41578d0 0x7f3dc40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc41578d0 0x7f3dc40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 -- 172.21.15.6:0/4031889846 >> v1:172.21.15.118:6789/0 conn(0x7f3dc4157ca0 legacy=0x7f3dc415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 -- 172.21.15.6:0/4031889846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40cfe90 con 0x7f3dc406d120 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc2d9d700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc406d580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009f20 tx=0x7f3dbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42c39fb7677df53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc159a700 1 -- 172.21.15.6:0/4031889846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00e070 con 0x7f3dc406d120 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc159a700 1 -- 172.21.15.6:0/4031889846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc00ba40 con 0x7f3dc406d120 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.356+0000 7f3dc159a700 1 -- 172.21.15.6:0/4031889846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0092e0 con 0x7f3dc406d120 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4031889846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 msgr2=0x7f3dc406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc406d580 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009f20 tx=0x7f3dbc009840 comp rx=0 tx=0).stop 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4031889846 shutdown_connections 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc406d580 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4031889846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc41578d0 0x7f3dc40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4031889846 >> 172.21.15.6:0/4031889846 conn(0x7f3dc406bb90 msgr2=0x7f3dc406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4031889846 shutdown_connections 2023-10-09T11:36:48.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.357+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4031889846 wait complete. 2023-10-09T11:36:48.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.358+0000 7f3dc8ce9700 1 Processor -- start 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.358+0000 7f3dc8ce9700 1 -- start start 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41578d0 0x7f3dc40b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 0x7f3dc4156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4152b30 con 0x7f3dc406d120 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc414e280 con 0x7f3dc41578d0 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc8ce9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4151eb0 con 0x7f3dc4157ca0 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33058/0 (socket says 172.21.15.6:33058) 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 -- 172.21.15.6:0/4026310508 learned_addr learned my addr 172.21.15.6:0/4026310508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:48.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc1d9b700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41578d0 0x7f3dc40b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc2d9d700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 0x7f3dc4156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 -- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 msgr2=0x7f3dc4156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 0x7f3dc4156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 -- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41578d0 msgr2=0x7f3dc40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41578d0 0x7f3dc40b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 -- 172.21.15.6:0/4026310508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009ae0 con 0x7f3dc406d120 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc2d9d700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 0x7f3dc4156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dc259c700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c7d0 tx=0x7f3db4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.359+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011600 con 0x7f3dc406d120 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.360+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4011760 con 0x7f3dc406d120 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.360+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc4152190 con 0x7f3dc406d120 2023-10-09T11:36:48.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.360+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011b20 con 0x7f3dc406d120 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.360+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc4152750 con 0x7f3dc406d120 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.361+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc4152c70 con 0x7f3dc406d120 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.361+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3db4018350 con 0x7f3dc406d120 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.361+0000 7f3dba7fc700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 0x7f3da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.361+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3db40840f0 con 0x7f3dc406d120 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.361+0000 7f3dc1d9b700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 0x7f3da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.362+0000 7f3dc1d9b700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 0x7f3da40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4156c90 tx=0x7f3dac009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.366+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3db40516b0 con 0x7f3dc406d120 2023-10-09T11:36:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.637+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3dc414e820 con 0x7f3dc406d120 2023-10-09T11:36:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.643+0000 7f3dba7fc700 1 -- 172.21.15.6:0/4026310508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3db4054cd0 con 0x7f3dc406d120 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 msgr2=0x7f3da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 0x7f3da40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4156c90 tx=0x7f3dac009060 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 msgr2=0x7f3dc414dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3db400c7d0 tx=0x7f3db4008040 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 shutdown_connections 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3da4066f30 0x7f3da40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dc4157ca0 0x7f3dc4156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dc406d120 0x7f3dc414dd40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 --2- 172.21.15.6:0/4026310508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41578d0 0x7f3dc40b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 >> 172.21.15.6:0/4026310508 conn(0x7f3dc406bb90 msgr2=0x7f3dc4158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 shutdown_connections 2023-10-09T11:36:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.645+0000 7f3dc8ce9700 1 -- 172.21.15.6:0/4026310508 wait complete. 2023-10-09T11:36:48.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T11:36:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 Processor -- start 2023-10-09T11:36:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 -- start start 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f613c1578d0 0x7f613c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0d07c0 con 0x7f613c157ca0 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0cfbb0 con 0x7f613c06d120 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.777+0000 7f61414b7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c0cfe90 con 0x7f613c1578d0 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f613c157ca0 0x7f613c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51316/0 (socket says 172.21.15.6:51316) 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613a7fc700 1 -- 172.21.15.6:0/2988219004 learned_addr learned my addr 172.21.15.6:0/2988219004 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613affd700 1 --2- 172.21.15.6:0/2988219004 >> v2:172.21.15.118:3300/0 conn(0x7f613c1578d0 0x7f613c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259079956 0 0) 0x7f613c0d07c0 con 0x7f613c157ca0 2023-10-09T11:36:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6128003570 con 0x7f613c157ca0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713335735 0 0) 0x7f613c0cfbb0 con 0x7f613c06d120 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f613c0d07c0 con 0x7f613c06d120 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613affd700 1 -- 172.21.15.6:0/2988219004 >> v1:172.21.15.118:6789/0 conn(0x7f613c06d120 legacy=0x7f613c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613affd700 1 -- 172.21.15.6:0/2988219004 >> v1:172.21.15.6:6789/0 conn(0x7f613c157ca0 legacy=0x7f613c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836628357 0 0) 0x7f6128003570 con 0x7f613c157ca0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613affd700 1 -- 172.21.15.6:0/2988219004 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0d0170 con 0x7f613c1578d0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f613affd700 1 --2- 172.21.15.6:0/2988219004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c1578d0 0x7f613c0cf4f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098e0 tx=0x7f612c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c32cde6862250d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.778+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124001470 con 0x7f613c1578d0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c011420 con 0x7f613c1578d0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f6139ffb700 1 -- 172.21.15.6:0/2988219004 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0117c0 con 0x7f613c1578d0 2023-10-09T11:36:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 -- 172.21.15.6:0/2988219004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c1578d0 msgr2=0x7f613c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 --2- 172.21.15.6:0/2988219004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c1578d0 0x7f613c0cf4f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098e0 tx=0x7f612c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 -- 172.21.15.6:0/2988219004 shutdown_connections 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 --2- 172.21.15.6:0/2988219004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c1578d0 0x7f613c0cf4f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 -- 172.21.15.6:0/2988219004 >> 172.21.15.6:0/2988219004 conn(0x7f613c06bb90 msgr2=0x7f613c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 -- 172.21.15.6:0/2988219004 shutdown_connections 2023-10-09T11:36:48.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.779+0000 7f61414b7700 1 -- 172.21.15.6:0/2988219004 wait complete. 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.780+0000 7f61414b7700 1 Processor -- start 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.780+0000 7f61414b7700 1 -- start start 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f613c1578d0 0x7f613c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 0x7f613c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c16a880 con 0x7f613c06d120 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c16ab20 con 0x7f613c157ca0 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f61414b7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0b43f0 con 0x7f613c1578d0 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33064/0 (socket says 172.21.15.6:33064) 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 -- 172.21.15.6:0/2613608136 learned_addr learned my addr 172.21.15.6:0/2613608136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613a7fc700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f613c1578d0 0x7f613c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613b7fe700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 0x7f613c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 -- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f613c1578d0 msgr2=0x7f613c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f613c1578d0 0x7f613c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 -- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 msgr2=0x7f613c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 0x7f613c152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613affd700 1 -- 172.21.15.6:0/2613608136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009420 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.781+0000 7f613b7fe700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 0x7f613c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f613affd700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f613c06fe20 tx=0x7f612c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c01cbe0 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c01cd40 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c01a6a0 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c0b46d0 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.782+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0b40e0 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.783+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c0b4bf0 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.783+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f612c01aa50 con 0x7f613c06d120 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.784+0000 7f6132ffd700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.784+0000 7f613a7fc700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:48.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.784+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f612c085c40 con 0x7f613c06d120 2023-10-09T11:36:48.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.784+0000 7f613a7fc700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 0x7f611c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f613c06dbd0 tx=0x7f6124000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:48.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:48.789+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f613c0b4bf0 con 0x7f613c06d120 2023-10-09T11:36:49.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.059+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f613c0b4bf0 con 0x7f613c06d120 2023-10-09T11:36:49.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.065+0000 7f6132ffd700 1 -- 172.21.15.6:0/2613608136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f613c0b4bf0 con 0x7f613c06d120 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 msgr2=0x7f611c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 0x7f611c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f613c06dbd0 tx=0x7f6124000bc0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 msgr2=0x7f613c0b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f613c06fe20 tx=0x7f612c016000 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 shutdown_connections 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f611c066f30 0x7f611c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f613c157ca0 0x7f613c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c06d120 0x7f613c0b62b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 --2- 172.21.15.6:0/2613608136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f613c1578d0 0x7f613c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 >> 172.21.15.6:0/2613608136 conn(0x7f613c06bb90 msgr2=0x7f613c069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 shutdown_connections 2023-10-09T11:36:49.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.067+0000 7f61414b7700 1 -- 172.21.15.6:0/2613608136 wait complete. 2023-10-09T11:36:49.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T11:36:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.198+0000 7f3e7775b700 1 Processor -- start 2023-10-09T11:36:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 -- start start 2023-10-09T11:36:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e7006d120 0x7f3e7006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7006dac0 con 0x7f3e701578d0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700d07c0 con 0x7f3e7006d120 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.199+0000 7f3e7775b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700cfbb0 con 0x7f3e70157ca0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e754f7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3e701578d0 0x7f3e7015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51324/0 (socket says 172.21.15.6:51324) 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e754f7700 1 -- 172.21.15.6:0/1291322149 learned_addr learned my addr 172.21.15.6:0/1291322149 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e74cf6700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280187619 0 0) 0x7f3e60001490 con 0x7f3e701578d0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/1291322149 >> v2:172.21.15.118:3300/0 conn(0x7f3e7006d120 0x7f3e7006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e58003570 con 0x7f3e701578d0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994567965 0 0) 0x7f3e58003570 con 0x7f3e701578d0 2023-10-09T11:36:49.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 msgr2=0x7f3e700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 >> v2:172.21.15.118:3300/0 conn(0x7f3e7006d120 msgr2=0x7f3e7006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 --2- 172.21.15.6:0/1291322149 >> v2:172.21.15.118:3300/0 conn(0x7f3e7006d120 0x7f3e7006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700cfe90 con 0x7f3e701578d0 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f3e60001980 con 0x7f3e701578d0 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 >> v1:172.21.15.6:6789/0 conn(0x7f3e701578d0 legacy=0x7f3e7015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e58003a60 0x7f3e58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e58004d50 0x7f3e580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700d07c0 con 0x7f3e58003a60 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700cfbb0 con 0x7f3e58004d50 2023-10-09T11:36:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5800ba60 con 0x7f3e70157ca0 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e754f7700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e58003a60 0x7f3e58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e74cf6700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.200+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e58004d50 0x7f3e580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 -- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 msgr2=0x7f3e58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e70157ca0 0x7f3e58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 -- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e58004d50 msgr2=0x7f3e580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e58004d50 0x7f3e580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 -- 172.21.15.6:0/1291322149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58003570 con 0x7f3e58003a60 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e58004d50 0x7f3e580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e754f7700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e58003a60 0x7f3e58003e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000aaf0 tx=0x7f3e700d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831e5154ea6411f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000a480 con 0x7f3e58003a60 2023-10-09T11:36:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6000c570 con 0x7f3e58003a60 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e6ffff700 1 -- 172.21.15.6:0/1291322149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000c910 con 0x7f3e58003a60 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e7775b700 1 -- 172.21.15.6:0/1291322149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e58003a60 msgr2=0x7f3e58003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e7775b700 1 --2- 172.21.15.6:0/1291322149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e58003a60 0x7f3e58003e70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000aaf0 tx=0x7f3e700d0730 comp rx=0 tx=0).stop 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e75cf8700 1 -- 172.21.15.6:0/1291322149 reap_dead start 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e7775b700 1 -- 172.21.15.6:0/1291322149 shutdown_connections 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e7775b700 1 -- 172.21.15.6:0/1291322149 >> 172.21.15.6:0/1291322149 conn(0x7f3e7006bb90 msgr2=0x7f3e7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.201+0000 7f3e7775b700 1 -- 172.21.15.6:0/1291322149 shutdown_connections 2023-10-09T11:36:49.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.202+0000 7f3e7775b700 1 -- 172.21.15.6:0/1291322149 wait complete. 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 Processor -- start 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 -- start start 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e58003a60 0x7f3e7015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e70153940 0x7f3e700ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700b5990 con 0x7f3e700b5e20 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7006a620 con 0x7f3e70153940 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.203+0000 7f3e7775b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70153fb0 con 0x7f3e58003a60 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33092/0 (socket says 172.21.15.6:33092) 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 -- 172.21.15.6:0/3163531687 learned_addr learned my addr 172.21.15.6:0/3163531687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e754f7700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e58003a60 0x7f3e7015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e74cf6700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e70153940 0x7f3e700ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 -- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e58003a60 msgr2=0x7f3e7015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e58003a60 0x7f3e7015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 -- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e70153940 msgr2=0x7f3e700ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e70153940 0x7f3e700ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 -- 172.21.15.6:0/3163531687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70154290 con 0x7f3e700b5e20 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e75cf8700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3e70063f70 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011ed0 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68015670 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700b5620 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68015a30 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.204+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e700cd4f0 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.205+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e700b5b40 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.206+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e68020460 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.206+0000 7f3e6d7fa700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.206+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e680841d0 con 0x7f3e700b5e20 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.206+0000 7f3e754f7700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.206+0000 7f3e754f7700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e7015d4c0 tx=0x7f3e60016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.210+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e700b5b40 con 0x7f3e700b5e20 2023-10-09T11:36:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.482+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3e700b57b0 con 0x7f3e700b5e20 2023-10-09T11:36:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.485+0000 7f3e6d7fa700 1 -- 172.21.15.6:0/3163531687 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e68082e60 con 0x7f3e700b5e20 2023-10-09T11:36:49.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 msgr2=0x7f3e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e7015d4c0 tx=0x7f3e60016000 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 msgr2=0x7f3e700b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3e70063f70 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 shutdown_connections 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e700b5e20 0x7f3e700b62a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e58003a60 0x7f3e7015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 --2- 172.21.15.6:0/3163531687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e70153940 0x7f3e700ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 >> 172.21.15.6:0/3163531687 conn(0x7f3e7006bb90 msgr2=0x7f3e70156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 shutdown_connections 2023-10-09T11:36:49.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.488+0000 7f3e7775b700 1 -- 172.21.15.6:0/3163531687 wait complete. 2023-10-09T11:36:49.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T11:36:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.619+0000 7f1a51435700 1 Processor -- start 2023-10-09T11:36:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.619+0000 7f1a51435700 1 -- start start 2023-10-09T11:36:49.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a51435700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 0x7f1a4c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a51435700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a4c06d650 0x7f1a4c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a51435700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0b0ca0 con 0x7f1a4c15a2a0 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a51435700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c06ea90 con 0x7f1a4c06d650 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a51435700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0b00d0 con 0x7f1a4c0cf240 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a4b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a4c06d650 0x7f1a4c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a4affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a4c15a2a0 0x7f1a4c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51328/0 (socket says 172.21.15.6:51328) 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a4b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a4c06d650 0x7f1a4c06da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33096/0 (socket says 172.21.15.6:33096) 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.620+0000 7f1a4affd700 1 -- 172.21.15.6:0/1855366616 learned_addr learned my addr 172.21.15.6:0/1855366616 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4b7fe700 1 -- 172.21.15.6:0/1855366616 >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 msgr2=0x7f1a4c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/1855366616 >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 0x7f1a4c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a49ffb700 1 -- 172.21.15.6:0/1855366616 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496763384 0 0) 0x7f1a4c0b0ca0 con 0x7f1a4c15a2a0 2023-10-09T11:36:49.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4b7fe700 1 --2- 172.21.15.6:0/1855366616 >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 0x7f1a4c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4b7fe700 1 -- 172.21.15.6:0/1855366616 >> v1:172.21.15.6:6789/0 conn(0x7f1a4c15a2a0 legacy=0x7f1a4c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4b7fe700 1 -- 172.21.15.6:0/1855366616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0b0370 con 0x7f1a4c06d650 2023-10-09T11:36:49.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/1855366616 >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 0x7f1a4c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:49.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a4b7fe700 1 --2- 172.21.15.6:0/1855366616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c06da20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0713b0 tx=0x7f1a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3da950ed78c89a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a49ffb700 1 -- 172.21.15.6:0/1855366616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00b6b0 con 0x7f1a4c06d650 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a49ffb700 1 -- 172.21.15.6:0/1855366616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c00b810 con 0x7f1a4c06d650 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a49ffb700 1 -- 172.21.15.6:0/1855366616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00bbb0 con 0x7f1a4c06d650 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a51435700 1 -- 172.21.15.6:0/1855366616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 msgr2=0x7f1a4c06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.621+0000 7f1a51435700 1 --2- 172.21.15.6:0/1855366616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c06da20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0713b0 tx=0x7f1a3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 -- 172.21.15.6:0/1855366616 shutdown_connections 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 --2- 172.21.15.6:0/1855366616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c06da20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 --2- 172.21.15.6:0/1855366616 >> v2:172.21.15.118:3300/0 conn(0x7f1a4c0cf240 0x7f1a4c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 -- 172.21.15.6:0/1855366616 >> 172.21.15.6:0/1855366616 conn(0x7f1a4c067640 msgr2=0x7f1a4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 -- 172.21.15.6:0/1855366616 shutdown_connections 2023-10-09T11:36:49.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.622+0000 7f1a51435700 1 -- 172.21.15.6:0/1855366616 wait complete. 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.623+0000 7f1a51435700 1 Processor -- start 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.623+0000 7f1a51435700 1 -- start start 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 0x7f1a4c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a4c15a2a0 0x7f1a4c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c16d2c0 con 0x7f1a4c06d650 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c16ad00 con 0x7f1a4c0cf240 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a51435700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c16a0f0 con 0x7f1a4c15a2a0 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33100/0 (socket says 172.21.15.6:33100) 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 -- 172.21.15.6:0/2922574816 learned_addr learned my addr 172.21.15.6:0/2922574816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4b7fe700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a4c15a2a0 0x7f1a4c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 0x7f1a4c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 -- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a4c15a2a0 msgr2=0x7f1a4c0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a4c15a2a0 0x7f1a4c0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 -- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 msgr2=0x7f1a4c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 0x7f1a4c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 -- 172.21.15.6:0/2922574816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009420 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 0x7f1a4c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.624+0000 7f1a4affd700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400cc70 tx=0x7f1a44001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.625+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400a8e0 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.625+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400aa40 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.625+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400adc0 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.625+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c16a3d0 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.625+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c16a990 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.626+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c069e40 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.626+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a44007300 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.626+0000 7f1a42ffd700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.626+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1a44084540 con 0x7f1a4c06d650 2023-10-09T11:36:49.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.627+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:49.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.627+0000 7f1a4a7fc700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 0x7f1a2c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0b1640 tx=0x7f1a34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:49.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.631+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a44051b80 con 0x7f1a4c06d650 2023-10-09T11:36:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.902+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1a4c04bb80 con 0x7f1a4c06d650 2023-10-09T11:36:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.906+0000 7f1a42ffd700 1 -- 172.21.15.6:0/2922574816 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1a440551a0 con 0x7f1a4c06d650 2023-10-09T11:36:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 msgr2=0x7f1a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 0x7f1a2c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0b1640 tx=0x7f1a34008040 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 msgr2=0x7f1a4c16cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400cc70 tx=0x7f1a44001a30 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 shutdown_connections 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a4c15a2a0 0x7f1a4c0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c06d650 0x7f1a4c16cd80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 --2- 172.21.15.6:0/2922574816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a4c0cf240 0x7f1a4c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 >> 172.21.15.6:0/2922574816 conn(0x7f1a4c067640 msgr2=0x7f1a4c156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:49.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 shutdown_connections 2023-10-09T11:36:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:49.908+0000 7f1a51435700 1 -- 172.21.15.6:0/2922574816 wait complete. 2023-10-09T11:36:49.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.040+0000 7fb4b34f2700 1 Processor -- start 2023-10-09T11:36:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.040+0000 7fb4b34f2700 1 -- start start 2023-10-09T11:36:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b34f2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b34f2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0d07c0 con 0x7fb4ac157ca0 2023-10-09T11:36:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b34f2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0cfbb0 con 0x7fb4ac1578d0 2023-10-09T11:36:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b34f2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0cfe90 con 0x7fb4ac06d830 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b1a8f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b0a8d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb4ac157ca0 0x7fb4ac06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51336/0 (socket says 172.21.15.6:51336) 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b1a8f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33110/0 (socket says 172.21.15.6:33110) 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.041+0000 7fb4b0a8d700 1 -- 172.21.15.6:0/2139273013 learned_addr learned my addr 172.21.15.6:0/2139273013 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b1a8f700 1 -- 172.21.15.6:0/2139273013 >> v1:172.21.15.118:6789/0 conn(0x7fb4ac1578d0 legacy=0x7fb4ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b1a8f700 1 -- 172.21.15.6:0/2139273013 >> v1:172.21.15.6:6789/0 conn(0x7fb4ac157ca0 legacy=0x7fb4ac06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4abfff700 1 -- 172.21.15.6:0/2139273013 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233684136 0 0) 0x7fb4ac0d07c0 con 0x7fb4ac157ca0 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b1a8f700 1 -- 172.21.15.6:0/2139273013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0d0170 con 0x7fb4ac06d830 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b1a8f700 1 --2- 172.21.15.6:0/2139273013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40098e0 tx=0x7fb4a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2a7f3f596a1aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4abfff700 1 -- 172.21.15.6:0/2139273013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4009e80 con 0x7fb4ac06d830 2023-10-09T11:36:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4abfff700 1 -- 172.21.15.6:0/2139273013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400b820 con 0x7fb4ac06d830 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4abfff700 1 -- 172.21.15.6:0/2139273013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400bba0 con 0x7fb4ac06d830 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b34f2700 1 -- 172.21.15.6:0/2139273013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac06d830 msgr2=0x7fb4ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/2139273013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40098e0 tx=0x7fb4a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b34f2700 1 -- 172.21.15.6:0/2139273013 shutdown_connections 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/2139273013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac06d830 0x7fb4ac0cf4f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.042+0000 7fb4b34f2700 1 -- 172.21.15.6:0/2139273013 >> 172.21.15.6:0/2139273013 conn(0x7fb4ac06bb90 msgr2=0x7fb4ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.043+0000 7fb4b34f2700 1 -- 172.21.15.6:0/2139273013 shutdown_connections 2023-10-09T11:36:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.043+0000 7fb4b34f2700 1 -- 172.21.15.6:0/2139273013 wait complete. 2023-10-09T11:36:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.044+0000 7fb4b34f2700 1 Processor -- start 2023-10-09T11:36:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.044+0000 7fb4b34f2700 1 -- start start 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.044+0000 7fb4b34f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4ac06d830 0x7fb4ac16b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.044+0000 7fb4b34f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4ac157ca0 0x7fb4ac155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac159390 con 0x7fb4ac1578d0 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b2690 con 0x7fb4ac157ca0 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b2970 con 0x7fb4ac06d830 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33120/0 (socket says 172.21.15.6:33120) 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 -- 172.21.15.6:0/1887090955 learned_addr learned my addr 172.21.15.6:0/1887090955 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b1a8f700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4ac157ca0 0x7fb4ac155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b128e700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4ac06d830 0x7fb4ac16b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 -- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4ac06d830 msgr2=0x7fb4ac16b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4ac06d830 0x7fb4ac16b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 -- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4ac157ca0 msgr2=0x7fb4ac155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4ac157ca0 0x7fb4ac155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 -- 172.21.15.6:0/1887090955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009420 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b0a8d700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c5e0 tx=0x7fb4a0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0005b30 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a0005c90 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac0b2c50 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0007300 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.045+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac16be00 con 0x7fb4ac1578d0 2023-10-09T11:36:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.046+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac067ac0 con 0x7fb4ac1578d0 2023-10-09T11:36:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.047+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4a00076b0 con 0x7fb4ac1578d0 2023-10-09T11:36:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.047+0000 7fb4a97fa700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 0x7fb4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.047+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb4a0083710 con 0x7fb4ac1578d0 2023-10-09T11:36:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.047+0000 7fb4b128e700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 0x7fb4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.048+0000 7fb4b128e700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 0x7fb4980693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb49c007fd0 tx=0x7fb49c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.051+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4a0050cd0 con 0x7fb4ac1578d0 2023-10-09T11:36:50.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.245+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4ac0d0450 con 0x7fb4ac1578d0 2023-10-09T11:36:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.246+0000 7fb4a97fa700 1 -- 172.21.15.6:0/1887090955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12086 (secure 0 0 0) 0x7fb4a00542f0 con 0x7fb4ac1578d0 2023-10-09T11:36:50.247 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:50.247 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:46.944896+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 msgr2=0x7fb4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 0x7fb4980693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb49c007fd0 tx=0x7fb49c009040 comp rx=0 tx=0).stop 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 msgr2=0x7fb4ac154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c5e0 tx=0x7fb4a0000fe0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 shutdown_connections 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb498066f30 0x7fb4980693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4ac157ca0 0x7fb4ac155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4ac06d830 0x7fb4ac16b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 --2- 172.21.15.6:0/1887090955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4ac1578d0 0x7fb4ac154520 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 >> 172.21.15.6:0/1887090955 conn(0x7fb4ac06bb90 msgr2=0x7fb4ac069630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 shutdown_connections 2023-10-09T11:36:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.248+0000 7fb4b34f2700 1 -- 172.21.15.6:0/1887090955 wait complete. 2023-10-09T11:36:50.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:36:50.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:36:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.382+0000 7fe6a9033700 1 Processor -- start 2023-10-09T11:36:50.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.382+0000 7fe6a9033700 1 -- start start 2023-10-09T11:36:50.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a9033700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 0x7fe6a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a9033700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 0x7fe6a415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a9033700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40d07c0 con 0x7fe6a406d120 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a9033700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40cfbb0 con 0x7fe6a41578d0 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a9033700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40cfe90 con 0x7fe6a4157ca0 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a359e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe6a406d120 0x7fe6a415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51338/0 (socket says 172.21.15.6:51338) 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a359e700 1 -- 172.21.15.6:0/2779278530 learned_addr learned my addr 172.21.15.6:0/2779278530 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a259c700 1 --2- 172.21.15.6:0/2779278530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 0x7fe6a415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a2d9d700 1 --2- 172.21.15.6:0/2779278530 >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 0x7fe6a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a1d9b700 1 -- 172.21.15.6:0/2779278530 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084171126 0 0) 0x7fe6a40d07c0 con 0x7fe6a406d120 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.383+0000 7fe6a1d9b700 1 -- 172.21.15.6:0/2779278530 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe690003570 con 0x7fe6a406d120 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a259c700 1 -- 172.21.15.6:0/2779278530 >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 msgr2=0x7fe6a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a259c700 1 --2- 172.21.15.6:0/2779278530 >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 0x7fe6a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a259c700 1 -- 172.21.15.6:0/2779278530 >> v1:172.21.15.6:6789/0 conn(0x7fe6a406d120 legacy=0x7fe6a415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a259c700 1 -- 172.21.15.6:0/2779278530 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40d0170 con 0x7fe6a4157ca0 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a2d9d700 1 --2- 172.21.15.6:0/2779278530 >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 0x7fe6a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a259c700 1 --2- 172.21.15.6:0/2779278530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 0x7fe6a415af00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0098e0 tx=0x7fe68c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fabd6e716a5fe27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a1d9b700 1 -- 172.21.15.6:0/2779278530 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011630 con 0x7fe6a4157ca0 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a1d9b700 1 -- 172.21.15.6:0/2779278530 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c011790 con 0x7fe6a4157ca0 2023-10-09T11:36:50.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a1d9b700 1 -- 172.21.15.6:0/2779278530 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011b30 con 0x7fe6a4157ca0 2023-10-09T11:36:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a9033700 1 -- 172.21.15.6:0/2779278530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 msgr2=0x7fe6a415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a9033700 1 --2- 172.21.15.6:0/2779278530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 0x7fe6a415af00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0098e0 tx=0x7fe68c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.384+0000 7fe6a9033700 1 -- 172.21.15.6:0/2779278530 shutdown_connections 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.385+0000 7fe6a9033700 1 --2- 172.21.15.6:0/2779278530 >> v2:172.21.15.118:3300/0 conn(0x7fe6a41578d0 0x7fe6a40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.385+0000 7fe6a9033700 1 --2- 172.21.15.6:0/2779278530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a4157ca0 0x7fe6a415af00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.385+0000 7fe6a9033700 1 -- 172.21.15.6:0/2779278530 >> 172.21.15.6:0/2779278530 conn(0x7fe6a406bb90 msgr2=0x7fe6a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.385+0000 7fe6a9033700 1 -- 172.21.15.6:0/2779278530 shutdown_connections 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.385+0000 7fe6a9033700 1 -- 172.21.15.6:0/2779278530 wait complete. 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 Processor -- start 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 -- start start 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a406d120 0x7fe6a40b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 0x7fe6a4154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c6060 con 0x7fe6a41578d0 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c62c0 con 0x7fe6a4157ca0 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.386+0000 7fe6a9033700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c65a0 con 0x7fe6a406d120 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33130/0 (socket says 172.21.15.6:33130) 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 -- 172.21.15.6:0/3905692465 learned_addr learned my addr 172.21.15.6:0/3905692465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a2d9d700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a406d120 0x7fe6a40b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a359e700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 0x7fe6a4154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 -- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a406d120 msgr2=0x7fe6a40b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a406d120 0x7fe6a40b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 -- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 msgr2=0x7fe6a4154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 0x7fe6a4154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 -- 172.21.15.6:0/3905692465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694009a20 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a359e700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 0x7fe6a4154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a259c700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4068330 tx=0x7fe68c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011b10 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c000cc0 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c009420 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c023600 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.387+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a40c6b60 con 0x7fe6a41578d0 2023-10-09T11:36:50.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.388+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a40c6d80 con 0x7fe6a41578d0 2023-10-09T11:36:50.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.389+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe68c0239f0 con 0x7fe6a41578d0 2023-10-09T11:36:50.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.389+0000 7fe69affd700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.389+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe68c085600 con 0x7fe6a41578d0 2023-10-09T11:36:50.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.389+0000 7fe6a2d9d700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.390+0000 7fe6a2d9d700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 0x7fe6840693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe6a416d6d0 tx=0x7fe69400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.393+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe68c052bc0 con 0x7fe6a41578d0 2023-10-09T11:36:50.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.584+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6a40d0450 con 0x7fe6a41578d0 2023-10-09T11:36:50.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.584+0000 7fe69affd700 1 -- 172.21.15.6:0/3905692465 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe68c0150a0 con 0x7fe6a41578d0 2023-10-09T11:36:50.585 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:36:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 msgr2=0x7fe6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 0x7fe6840693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe6a416d6d0 tx=0x7fe69400b040 comp rx=0 tx=0).stop 2023-10-09T11:36:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 msgr2=0x7fe6a40c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4068330 tx=0x7fe68c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 shutdown_connections 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe684066f30 0x7fe6840693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6a4157ca0 0x7fe6a4154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6a406d120 0x7fe6a40b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 --2- 172.21.15.6:0/3905692465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6a41578d0 0x7fe6a40c5b20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.586+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 >> 172.21.15.6:0/3905692465 conn(0x7fe6a406bb90 msgr2=0x7fe6a4069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.587+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 shutdown_connections 2023-10-09T11:36:50.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.587+0000 7fe6a9033700 1 -- 172.21.15.6:0/3905692465 wait complete. 2023-10-09T11:36:50.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:36:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.717+0000 7f06a2e29700 1 Processor -- start 2023-10-09T11:36:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.717+0000 7f06a2e29700 1 -- start start 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a2e29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a2e29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0b35d0 con 0x7f069c0b3170 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a2e29700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c069d10 con 0x7f069c157a60 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a2e29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c15c130 con 0x7f069c06c190 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a13c6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f069c0b3170 0x7f069c06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51344/0 (socket says 172.21.15.6:51344) 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f06a13c6700 1 -- 172.21.15.6:0/32104171 learned_addr learned my addr 172.21.15.6:0/32104171 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069bfff700 1 --2- 172.21.15.6:0/32104171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581911342 0 0) 0x7f068c001110 con 0x7f069c0b3170 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684003570 con 0x7f069c0b3170 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151936278 0 0) 0x7f069c069d10 con 0x7f069c157a60 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068c001110 con 0x7f069c157a60 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069bfff700 1 -- 172.21.15.6:0/32104171 >> v1:172.21.15.118:6789/0 conn(0x7f069c157a60 legacy=0x7f069c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069bfff700 1 -- 172.21.15.6:0/32104171 >> v1:172.21.15.6:6789/0 conn(0x7f069c0b3170 legacy=0x7f069c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.718+0000 7f069bfff700 1 -- 172.21.15.6:0/32104171 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c15c410 con 0x7f069c06c190 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f069bfff700 1 --2- 172.21.15.6:0/32104171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c0b2c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0690009910 tx=0x7f06900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eacfe0be401bf3ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690011630 con 0x7f069c06c190 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690011790 con 0x7f069c06c190 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f069b7fe700 1 -- 172.21.15.6:0/32104171 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690011b30 con 0x7f069c06c190 2023-10-09T11:36:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 -- 172.21.15.6:0/32104171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 msgr2=0x7f069c0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 --2- 172.21.15.6:0/32104171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c0b2c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0690009910 tx=0x7f06900091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 -- 172.21.15.6:0/32104171 shutdown_connections 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 --2- 172.21.15.6:0/32104171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c0b2c30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 -- 172.21.15.6:0/32104171 >> 172.21.15.6:0/32104171 conn(0x7f069c06cca0 msgr2=0x7f069c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 -- 172.21.15.6:0/32104171 shutdown_connections 2023-10-09T11:36:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.719+0000 7f06a2e29700 1 -- 172.21.15.6:0/32104171 wait complete. 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.720+0000 7f06a2e29700 1 Processor -- start 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.721+0000 7f06a2e29700 1 -- start start 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.721+0000 7f06a2e29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.721+0000 7f06a2e29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.721+0000 7f06a2e29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069c157a60 0x7f069c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a2e29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c14fbf0 con 0x7f069c0b3170 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a2e29700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0cbdf0 con 0x7f069c157a60 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a2e29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0cb500 con 0x7f069c06c190 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33144/0 (socket says 172.21.15.6:33144) 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 -- 172.21.15.6:0/1967537885 learned_addr learned my addr 172.21.15.6:0/1967537885 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a0bc5700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a13c6700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069c157a60 0x7f069c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 -- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 msgr2=0x7f069c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 -- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069c157a60 msgr2=0x7f069c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069c157a60 0x7f069c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 -- 172.21.15.6:0/1967537885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009420 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a0bc5700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f069bfff700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0690009f00 tx=0x7f0690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069001f070 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690000bc0 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0cb7a0 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690025420 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.722+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c159800 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.723+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c0cbf60 con 0x7f069c0b3170 2023-10-09T11:36:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.724+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0690023070 con 0x7f069c0b3170 2023-10-09T11:36:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.724+0000 7f0698ff9700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 0x7f06880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.724+0000 7f06a0bc5700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 0x7f06880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.724+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0690085630 con 0x7f069c0b3170 2023-10-09T11:36:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.725+0000 7f06a0bc5700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 0x7f06880693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f069c169d60 tx=0x7f0694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.729+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0690052bf0 con 0x7f069c0b3170 2023-10-09T11:36:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.924+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f069c15c6f0 con 0x7f069c0b3170 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.924+0000 7f0698ff9700 1 -- 172.21.15.6:0/1967537885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0690015060 con 0x7f069c0b3170 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:36:50.925 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 msgr2=0x7f06880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 0x7f06880693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f069c169d60 tx=0x7f0694009040 comp rx=0 tx=0).stop 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 msgr2=0x7f069c158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0690009f00 tx=0x7f0690017000 comp rx=0 tx=0).stop 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 shutdown_connections 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0688066f30 0x7f06880693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069c157a60 0x7f069c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f069c06c190 0x7f069c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 --2- 172.21.15.6:0/1967537885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069c0b3170 0x7f069c158c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 >> 172.21.15.6:0/1967537885 conn(0x7f069c06cca0 msgr2=0x7f069c15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 shutdown_connections 2023-10-09T11:36:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:50.926+0000 7f06a2e29700 1 -- 172.21.15.6:0/1967537885 wait complete. 2023-10-09T11:36:50.939 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:36:50.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:36:51.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.062+0000 7ff1c370e700 1 Processor -- start 2023-10-09T11:36:51.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 -- start start 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff1bc157ca0 0x7ff1bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1bc06d120 0x7ff1bc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0d07c0 con 0x7ff1bc1578d0 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc06da50 con 0x7ff1bc06d120 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.063+0000 7ff1c370e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0cfbb0 con 0x7ff1bc157ca0 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1bc06d120 0x7ff1bc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c14aa700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff1bc1578d0 0x7ff1bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51356/0 (socket says 172.21.15.6:51356) 2023-10-09T11:36:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1bc06d120 0x7ff1bc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33150/0 (socket says 172.21.15.6:33150) 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c14aa700 1 -- 172.21.15.6:0/3165068699 learned_addr learned my addr 172.21.15.6:0/3165068699 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 -- 172.21.15.6:0/3165068699 >> v2:172.21.15.118:3300/0 conn(0x7ff1bc157ca0 msgr2=0x7ff1bc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c0ca9700 1 --2- 172.21.15.6:0/3165068699 >> v2:172.21.15.118:3300/0 conn(0x7ff1bc157ca0 0x7ff1bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 --2- 172.21.15.6:0/3165068699 >> v2:172.21.15.118:3300/0 conn(0x7ff1bc157ca0 0x7ff1bc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 -- 172.21.15.6:0/3165068699 >> v1:172.21.15.6:6789/0 conn(0x7ff1bc1578d0 legacy=0x7ff1bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1bbfff700 1 -- 172.21.15.6:0/3165068699 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879612668 0 0) 0x7ff1bc0d07c0 con 0x7ff1bc1578d0 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 -- 172.21.15.6:0/3165068699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0cfe90 con 0x7ff1bc06d120 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1c1cab700 1 --2- 172.21.15.6:0/3165068699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc06d510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc068510 tx=0x7ff1ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53b14377e6ffbd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1bbfff700 1 -- 172.21.15.6:0/3165068699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00b6b0 con 0x7ff1bc06d120 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1bbfff700 1 -- 172.21.15.6:0/3165068699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00b810 con 0x7ff1bc06d120 2023-10-09T11:36:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.064+0000 7ff1bbfff700 1 -- 172.21.15.6:0/3165068699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00bbb0 con 0x7ff1bc06d120 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 -- 172.21.15.6:0/3165068699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 msgr2=0x7ff1bc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 --2- 172.21.15.6:0/3165068699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc06d510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc068510 tx=0x7ff1ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 -- 172.21.15.6:0/3165068699 shutdown_connections 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 --2- 172.21.15.6:0/3165068699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc06d510 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 --2- 172.21.15.6:0/3165068699 >> v2:172.21.15.118:3300/0 conn(0x7ff1bc157ca0 0x7ff1bc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 -- 172.21.15.6:0/3165068699 >> 172.21.15.6:0/3165068699 conn(0x7ff1bc06bb90 msgr2=0x7ff1bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 -- 172.21.15.6:0/3165068699 shutdown_connections 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.065+0000 7ff1c370e700 1 -- 172.21.15.6:0/3165068699 wait complete. 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.066+0000 7ff1c370e700 1 Processor -- start 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.066+0000 7ff1c370e700 1 -- start start 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1bc1578d0 0x7ff1bc0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1bc157ca0 0x7ff1bc16d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0c6490 con 0x7ff1bc06d120 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0c6770 con 0x7ff1bc157ca0 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c370e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0c6a50 con 0x7ff1bc1578d0 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33162/0 (socket says 172.21.15.6:33162) 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 -- 172.21.15.6:0/2135565120 learned_addr learned my addr 172.21.15.6:0/2135565120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c1cab700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1bc157ca0 0x7ff1bc16d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c0ca9700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1bc1578d0 0x7ff1bc0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 -- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1bc1578d0 msgr2=0x7ff1bc0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1bc1578d0 0x7ff1bc0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 -- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1bc157ca0 msgr2=0x7ff1bc16d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1bc157ca0 0x7ff1bc16d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.067+0000 7ff1c14aa700 1 -- 172.21.15.6:0/2135565120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac009420 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1c14aa700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cd80 tx=0x7ff1b4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400aa60 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400abc0 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc0c6d30 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40070f0 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.068+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc0c70c0 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.069+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc0c6ec0 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.069+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1b40074e0 con 0x7ff1bc06d120 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.069+0000 7ff1b97fa700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.070+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff1b4084570 con 0x7ff1bc06d120 2023-10-09T11:36:51.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.070+0000 7ff1c0ca9700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:51.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.070+0000 7ff1c0ca9700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 0x7ff1a80693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b5770 tx=0x7ff1b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:51.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.074+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1b4051bb0 con 0x7ff1bc06d120 2023-10-09T11:36:51.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.267+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff1bc0d0170 con 0x7ff1bc06d120 2023-10-09T11:36:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.967+0000 7ff1b97fa700 1 -- 172.21.15.6:0/2135565120 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff1b4001c20 con 0x7ff1bc06d120 2023-10-09T11:36:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.972+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 msgr2=0x7ff1a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.972+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 0x7ff1a80693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0b5770 tx=0x7ff1b0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.972+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 msgr2=0x7ff1bc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.972+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cd80 tx=0x7ff1b4001ae0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 shutdown_connections 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff1a8066f30 0x7ff1a80693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1bc157ca0 0x7ff1bc16d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc06d120 0x7ff1bc0c7530 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 --2- 172.21.15.6:0/2135565120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff1bc1578d0 0x7ff1bc0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 >> 172.21.15.6:0/2135565120 conn(0x7ff1bc06bb90 msgr2=0x7ff1bc156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 shutdown_connections 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:51.973+0000 7ff1c370e700 1 -- 172.21.15.6:0/2135565120 wait complete. 2023-10-09T11:36:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:36:51.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:36:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.120+0000 7fe2e0a72700 1 Processor -- start 2023-10-09T11:36:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.120+0000 7fe2e0a72700 1 -- start start 2023-10-09T11:36:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 0x7fe2dc068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc157b90 0x7fe2dc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cca80 con 0x7fe2dc0cb790 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cedd0 con 0x7fe2dc1577c0 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.121+0000 7fe2e0a72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cc4c0 con 0x7fe2dc157b90 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33164/0 (socket says 172.21.15.6:33164) 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 -- 172.21.15.6:0/4073226625 learned_addr learned my addr 172.21.15.6:0/4073226625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2da59c700 1 --2- 172.21.15.6:0/4073226625 >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 0x7fe2dc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2d9d9b700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc157b90 0x7fe2dc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 -- 172.21.15.6:0/4073226625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc157b90 msgr2=0x7fe2dc068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc157b90 0x7fe2dc068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 -- 172.21.15.6:0/4073226625 >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 msgr2=0x7fe2dc068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/4073226625 >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 0x7fe2dc068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 -- 172.21.15.6:0/4073226625 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0cc7a0 con 0x7fe2dc0cb790 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2da59c700 1 --2- 172.21.15.6:0/4073226625 >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 0x7fe2dc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc068220 tx=0x7fe2d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9bebdd6cc7fc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2d959a700 1 -- 172.21.15.6:0/4073226625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400b860 con 0x7fe2dc0cb790 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2d959a700 1 -- 172.21.15.6:0/4073226625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400b9c0 con 0x7fe2dc0cb790 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.122+0000 7fe2d959a700 1 -- 172.21.15.6:0/4073226625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400bd60 con 0x7fe2dc0cb790 2023-10-09T11:36:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 -- 172.21.15.6:0/4073226625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc0cb790 msgr2=0x7fe2dc0cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc068220 tx=0x7fe2d4009250 comp rx=0 tx=0).stop 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 -- 172.21.15.6:0/4073226625 shutdown_connections 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc0cb790 0x7fe2dc0cbbf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/4073226625 >> v2:172.21.15.118:3300/0 conn(0x7fe2dc1577c0 0x7fe2dc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/4073226625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc157b90 0x7fe2dc068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 -- 172.21.15.6:0/4073226625 >> 172.21.15.6:0/4073226625 conn(0x7fe2dc0d0df0 msgr2=0x7fe2dc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 -- 172.21.15.6:0/4073226625 shutdown_connections 2023-10-09T11:36:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.123+0000 7fe2e0a72700 1 -- 172.21.15.6:0/4073226625 wait complete. 2023-10-09T11:36:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.124+0000 7fe2e0a72700 1 Processor -- start 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.124+0000 7fe2e0a72700 1 -- start start 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc0cb790 0x7fe2dc1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2dc1577c0 0x7fe2dc159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc15cf70 con 0x7fe2dc157b90 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16a450 con 0x7fe2dc1577c0 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2e0a72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc169b20 con 0x7fe2dc0cb790 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33172/0 (socket says 172.21.15.6:33172) 2023-10-09T11:36:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 -- 172.21.15.6:0/48174396 learned_addr learned my addr 172.21.15.6:0/48174396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2da59c700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc0cb790 0x7fe2dc1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2d9d9b700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2dc1577c0 0x7fe2dc159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 -- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc0cb790 msgr2=0x7fe2dc1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc0cb790 0x7fe2dc1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 -- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2dc1577c0 msgr2=0x7fe2dc159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2dc1577c0 0x7fe2dc159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 -- 172.21.15.6:0/48174396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40094f0 con 0x7fe2dc157b90 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2dad9d700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06fd60 tx=0x7fe2d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.125+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4011ea0 con 0x7fe2dc157b90 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.126+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d401a630 con 0x7fe2dc157b90 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.126+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d401aa10 con 0x7fe2dc157b90 2023-10-09T11:36:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.126+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc169e00 con 0x7fe2dc157b90 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.126+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc1697d0 con 0x7fe2dc157b90 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.127+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc16a5c0 con 0x7fe2dc157b90 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.127+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d402d440 con 0x7fe2dc157b90 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.128+0000 7fe2d27fc700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.128+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe2d4085fd0 con 0x7fe2dc157b90 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.128+0000 7fe2da59c700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.128+0000 7fe2da59c700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00d6e0 tx=0x7fe2cc007850 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.132+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d4053380 con 0x7fe2dc157b90 2023-10-09T11:36:52.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.325+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe2dc0cea60 con 0x7fe2dc157b90 2023-10-09T11:36:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.970+0000 7fe2d27fc700 1 -- 172.21.15.6:0/48174396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe2d4006d70 con 0x7fe2dc157b90 2023-10-09T11:36:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.979+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 msgr2=0x7fe2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.979+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00d6e0 tx=0x7fe2cc007850 comp rx=0 tx=0).stop 2023-10-09T11:36:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.979+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 msgr2=0x7fe2dc159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.979+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06fd60 tx=0x7fe2d4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 shutdown_connections 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2dc157b90 0x7fe2dc159640 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2dc0cb790 0x7fe2dc1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 --2- 172.21.15.6:0/48174396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2dc1577c0 0x7fe2dc159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.981+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 >> 172.21.15.6:0/48174396 conn(0x7fe2dc0d0df0 msgr2=0x7fe2dc1551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:52.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.982+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 shutdown_connections 2023-10-09T11:36:52.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:52.982+0000 7fe2e0a72700 1 -- 172.21.15.6:0/48174396 wait complete. 2023-10-09T11:36:52.984 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:36:52.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:36:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.122+0000 7f8072e71700 1 Processor -- start 2023-10-09T11:36:53.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.122+0000 7f8072e71700 1 -- start start 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f8072e71700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 0x7f806c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f8072e71700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f806c15c5e0 0x7f806c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f8072e71700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c15bc10 con 0x7f806c069120 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f8072e71700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c158ba0 con 0x7f806c15c5e0 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f8072e71700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c158e80 con 0x7f806c157ab0 2023-10-09T11:36:53.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f806bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f806c15c5e0 0x7f806c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f806bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f806c15c5e0 0x7f806c06bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33188/0 (socket says 172.21.15.6:33188) 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.123+0000 7f806bfff700 1 -- 172.21.15.6:0/10344429 learned_addr learned my addr 172.21.15.6:0/10344429 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f8070c0d700 1 --2- 172.21.15.6:0/10344429 >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 0x7f806c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806bfff700 1 -- 172.21.15.6:0/10344429 >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 msgr2=0x7f806c15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806bfff700 1 --2- 172.21.15.6:0/10344429 >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 0x7f806c15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806bfff700 1 -- 172.21.15.6:0/10344429 >> v1:172.21.15.118:6789/0 conn(0x7f806c069120 legacy=0x7f806c06a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806bfff700 1 -- 172.21.15.6:0/10344429 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c159160 con 0x7f806c15c5e0 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f8070c0d700 1 --2- 172.21.15.6:0/10344429 >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 0x7f806c15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806bfff700 1 --2- 172.21.15.6:0/10344429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c15c5e0 0x7f806c06bb90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f806c068f20 tx=0x7f8060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19987cbe6e26eed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806b7fe700 1 -- 172.21.15.6:0/10344429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000b820 con 0x7f806c15c5e0 2023-10-09T11:36:53.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806b7fe700 1 -- 172.21.15.6:0/10344429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000b980 con 0x7f806c15c5e0 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f806b7fe700 1 -- 172.21.15.6:0/10344429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000bd20 con 0x7f806c15c5e0 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f8072e71700 1 -- 172.21.15.6:0/10344429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c15c5e0 msgr2=0x7f806c06bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.124+0000 7f8072e71700 1 --2- 172.21.15.6:0/10344429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c15c5e0 0x7f806c06bb90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f806c068f20 tx=0x7f8060009250 comp rx=0 tx=0).stop 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 -- 172.21.15.6:0/10344429 shutdown_connections 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 --2- 172.21.15.6:0/10344429 >> v2:172.21.15.118:3300/0 conn(0x7f806c157ab0 0x7f806c15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 --2- 172.21.15.6:0/10344429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c15c5e0 0x7f806c06bb90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 -- 172.21.15.6:0/10344429 >> 172.21.15.6:0/10344429 conn(0x7f806c0c9ca0 msgr2=0x7f806c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 -- 172.21.15.6:0/10344429 shutdown_connections 2023-10-09T11:36:53.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.125+0000 7f8072e71700 1 -- 172.21.15.6:0/10344429 wait complete. 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.126+0000 7f8072e71700 1 Processor -- start 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.126+0000 7f8072e71700 1 -- start start 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 0x7f806c168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 0x7f806c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0c42e0 con 0x7f806c157ab0 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c1691e0 con 0x7f806c15c5e0 2023-10-09T11:36:53.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0c50d0 con 0x7f806c069120 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33196/0 (socket says 172.21.15.6:33196) 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 -- 172.21.15.6:0/1781213219 learned_addr learned my addr 172.21.15.6:0/1781213219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f807140e700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 0x7f806c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8070c0d700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 0x7f806c168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 -- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 msgr2=0x7f806c168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 0x7f806c168ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 -- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 msgr2=0x7f806c0c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 0x7f806c0c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 -- 172.21.15.6:0/1781213219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600094f0 con 0x7f806c157ab0 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f807140e700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 0x7f806c0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8070c0d700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 0x7f806c168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:53.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f806bfff700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f80600030c0 tx=0x7f8060016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011e60 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8060020070 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806001b6a0 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c0c44c0 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.127+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c0c4a80 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.128+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c0c5240 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.129+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8060022030 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.129+0000 7f8068ff9700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 0x7f80580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.130+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f80600867f0 con 0x7f806c157ab0 2023-10-09T11:36:53.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.130+0000 7f8070c0d700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 0x7f80580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:53.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.130+0000 7f8070c0d700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 0x7f80580693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:53.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.133+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8060053b40 con 0x7f806c157ab0 2023-10-09T11:36:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.370+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f806c0c5240 con 0x7f806c157ab0 2023-10-09T11:36:53.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:53.991+0000 7f8068ff9700 1 -- 172.21.15.6:0/1781213219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8060057160 con 0x7f806c157ab0 2023-10-09T11:36:54.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.003+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 msgr2=0x7f80580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.003+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 0x7f80580693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:54.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.003+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 msgr2=0x7f806c0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.003+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f80600030c0 tx=0x7f8060016000 comp rx=0 tx=0).stop 2023-10-09T11:36:54.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 shutdown_connections 2023-10-09T11:36:54.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8058066f30 0x7f80580693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f806c15c5e0 0x7f806c0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f806c069120 0x7f806c168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 --2- 172.21.15.6:0/1781213219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f806c157ab0 0x7f806c0b17b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 >> 172.21.15.6:0/1781213219 conn(0x7f806c0c9ca0 msgr2=0x7f806c06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 shutdown_connections 2023-10-09T11:36:54.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.004+0000 7f8072e71700 1 -- 172.21.15.6:0/1781213219 wait complete. 2023-10-09T11:36:54.011 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T11:36:54.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:54.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.141+0000 7f6fb4631700 1 Processor -- start 2023-10-09T11:36:54.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.141+0000 7f6fb4631700 1 -- start start 2023-10-09T11:36:54.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb4631700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6fac15a2a0 0x7f6fac0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb4631700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fac0ceb30 0x7f6fac0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb4631700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0b0ca0 con 0x7f6fac06d650 2023-10-09T11:36:54.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb4631700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac06e160 con 0x7f6fac0ceb30 2023-10-09T11:36:54.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb4631700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac06ea90 con 0x7f6fac15a2a0 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.142+0000 7f6fb1bcc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fac0ceb30 0x7f6fac0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb2bce700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6fac06d650 0x7f6fac06da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48350/0 (socket says 172.21.15.6:48350) 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb2bce700 1 -- 172.21.15.6:0/3162685986 learned_addr learned my addr 172.21.15.6:0/3162685986 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb23cd700 1 --2- 172.21.15.6:0/3162685986 >> v2:172.21.15.118:3300/0 conn(0x7f6fac15a2a0 0x7f6fac0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb1bcc700 1 -- 172.21.15.6:0/3162685986 >> v2:172.21.15.118:3300/0 conn(0x7f6fac15a2a0 msgr2=0x7f6fac0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb1bcc700 1 --2- 172.21.15.6:0/3162685986 >> v2:172.21.15.118:3300/0 conn(0x7f6fac15a2a0 0x7f6fac0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb1bcc700 1 -- 172.21.15.6:0/3162685986 >> v1:172.21.15.6:6789/0 conn(0x7f6fac06d650 legacy=0x7f6fac06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb1bcc700 1 -- 172.21.15.6:0/3162685986 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0b00d0 con 0x7f6fac0ceb30 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb13cb700 1 -- 172.21.15.6:0/3162685986 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829645016 0 0) 0x7f6fac0b0ca0 con 0x7f6fac06d650 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb1bcc700 1 --2- 172.21.15.6:0/3162685986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac0ceb30 0x7f6fac0cefb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0637a0 tx=0x7f6fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53f99d7701f8c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb13cb700 1 -- 172.21.15.6:0/3162685986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000b6b0 con 0x7f6fac0ceb30 2023-10-09T11:36:54.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb13cb700 1 -- 172.21.15.6:0/3162685986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000b810 con 0x7f6fac0ceb30 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.143+0000 7f6fb13cb700 1 -- 172.21.15.6:0/3162685986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000bbb0 con 0x7f6fac0ceb30 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 -- 172.21.15.6:0/3162685986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac0ceb30 msgr2=0x7f6fac0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 --2- 172.21.15.6:0/3162685986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac0ceb30 0x7f6fac0cefb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0637a0 tx=0x7f6fa00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 -- 172.21.15.6:0/3162685986 shutdown_connections 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 --2- 172.21.15.6:0/3162685986 >> v2:172.21.15.118:3300/0 conn(0x7f6fac15a2a0 0x7f6fac0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 --2- 172.21.15.6:0/3162685986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac0ceb30 0x7f6fac0cefb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 -- 172.21.15.6:0/3162685986 >> 172.21.15.6:0/3162685986 conn(0x7f6fac067640 msgr2=0x7f6fac067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 -- 172.21.15.6:0/3162685986 shutdown_connections 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.144+0000 7f6fb4631700 1 -- 172.21.15.6:0/3162685986 wait complete. 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.145+0000 7f6fb4631700 1 Processor -- start 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.145+0000 7f6fb4631700 1 -- start start 2023-10-09T11:36:54.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fac06d650 0x7f6fac15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fac0ceb30 0x7f6fac15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac147da0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac15d8f0 con 0x7f6fac0ceb30 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0cb320 con 0x7f6fac06d650 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36468/0 (socket says 172.21.15.6:36468) 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 -- 172.21.15.6:0/828891067 learned_addr learned my addr 172.21.15.6:0/828891067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb1bcc700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fac0ceb30 0x7f6fac15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb23cd700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fac06d650 0x7f6fac15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 -- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fac06d650 msgr2=0x7f6fac15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fac06d650 0x7f6fac15d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 -- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fac0ceb30 msgr2=0x7f6fac15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fac0ceb30 0x7f6fac15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 -- 172.21.15.6:0/828891067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009420 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb2bce700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400cc90 tx=0x7f6fa4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400cea0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa400ab70 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac0cb600 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40070f0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.146+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac0caf40 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.147+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac069e40 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.148+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fa40074a0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.148+0000 7f6faa7fc700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.148+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6fa4084ad0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.148+0000 7f6fb23cd700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.149+0000 7f6fb23cd700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 0x7f6f980693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006fd0 tx=0x7f6f9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.153+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa4051ca0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.344+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fac04bb80 con 0x7f6fac15a2a0 2023-10-09T11:36:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.345+0000 7f6faa7fc700 1 -- 172.21.15.6:0/828891067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f6fa40552c0 con 0x7f6fac15a2a0 2023-10-09T11:36:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:54.346 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:53.371173+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 msgr2=0x7f6f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 0x7f6f980693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006fd0 tx=0x7f6f9c008040 comp rx=0 tx=0).stop 2023-10-09T11:36:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 msgr2=0x7f6fac147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400cc90 tx=0x7f6fa4001a80 comp rx=0 tx=0).stop 2023-10-09T11:36:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 shutdown_connections 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fac15a2a0 0x7f6fac147860 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fac06d650 0x7f6fac15d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 --2- 172.21.15.6:0/828891067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fac0ceb30 0x7f6fac15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 >> 172.21.15.6:0/828891067 conn(0x7f6fac067640 msgr2=0x7f6fac0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 shutdown_connections 2023-10-09T11:36:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.347+0000 7f6fb4631700 1 -- 172.21.15.6:0/828891067 wait complete. 2023-10-09T11:36:54.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:54.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 Processor -- start 2023-10-09T11:36:54.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 -- start start 2023-10-09T11:36:54.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04001578d0 0x7f04000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f040006d120 0x7f040006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040006dac0 con 0x7f0400157ca0 2023-10-09T11:36:54.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000d07c0 con 0x7f040006d120 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.478+0000 7f0406857700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04000cfbb0 con 0x7f04001578d0 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f040006d120 0x7f040006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f040006d120 0x7f040006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36474/0 (socket says 172.21.15.6:36474) 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03ff7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0400157ca0 0x7f040015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48352/0 (socket says 172.21.15.6:48352) 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 -- 172.21.15.6:0/3450111230 learned_addr learned my addr 172.21.15.6:0/3450111230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03fffff700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04001578d0 0x7f04000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 -- 172.21.15.6:0/3450111230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04001578d0 msgr2=0x7f04000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04001578d0 0x7f04000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 -- 172.21.15.6:0/3450111230 >> v1:172.21.15.6:6789/0 conn(0x7f0400157ca0 legacy=0x7f040015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 -- 172.21.15.6:0/3450111230 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000cfe90 con 0x7f040006d120 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03feffd700 1 -- 172.21.15.6:0/3450111230 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062828838 0 0) 0x7f03f4001110 con 0x7f0400157ca0 2023-10-09T11:36:54.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f0404df4700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f040006d120 0x7f040006d580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009f20 tx=0x7f03f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6177fc4412c763e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03feffd700 1 -- 172.21.15.6:0/3450111230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f800e070 con 0x7f040006d120 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03feffd700 1 -- 172.21.15.6:0/3450111230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f800b9d0 con 0x7f040006d120 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.479+0000 7f03feffd700 1 -- 172.21.15.6:0/3450111230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80092e0 con 0x7f040006d120 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 -- 172.21.15.6:0/3450111230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f040006d120 msgr2=0x7f040006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f040006d120 0x7f040006d580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009f20 tx=0x7f03f8009840 comp rx=0 tx=0).stop 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 -- 172.21.15.6:0/3450111230 shutdown_connections 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f040006d120 0x7f040006d580 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 --2- 172.21.15.6:0/3450111230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04001578d0 0x7f04000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 -- 172.21.15.6:0/3450111230 >> 172.21.15.6:0/3450111230 conn(0x7f040006bb90 msgr2=0x7f040006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 -- 172.21.15.6:0/3450111230 shutdown_connections 2023-10-09T11:36:54.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.480+0000 7f0406857700 1 -- 172.21.15.6:0/3450111230 wait complete. 2023-10-09T11:36:54.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.481+0000 7f0406857700 1 Processor -- start 2023-10-09T11:36:54.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.481+0000 7f0406857700 1 -- start start 2023-10-09T11:36:54.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f040006d120 0x7f0400068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04001578d0 0x7f0400169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040016ae40 con 0x7f0400157ca0 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400159c10 con 0x7f04001578d0 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0406857700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040016a7a0 con 0x7f040006d120 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36490/0 (socket says 172.21.15.6:36490) 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 -- 172.21.15.6:0/531556694 learned_addr learned my addr 172.21.15.6:0/531556694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f03ff7fe700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04001578d0 0x7f0400169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f03fffff700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f040006d120 0x7f0400068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 -- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f040006d120 msgr2=0x7f0400068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f040006d120 0x7f0400068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 -- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04001578d0 msgr2=0x7f0400169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04001578d0 0x7f0400169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 -- 172.21.15.6:0/531556694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8009ae0 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.482+0000 7f0404df4700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f040006fe20 tx=0x7f03f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.483+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8008c70 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.483+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8008df0 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.483+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80266b0 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.483+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040016aa80 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.483+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040016b370 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.484+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400067ac0 con 0x7f0400157ca0 2023-10-09T11:36:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.484+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03f8003040 con 0x7f0400157ca0 2023-10-09T11:36:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.484+0000 7f03e7fff700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.485+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03f80864f0 con 0x7f0400157ca0 2023-10-09T11:36:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.485+0000 7f03fffff700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.485+0000 7f03fffff700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 0x7f03ec0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009d40 tx=0x7f03f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.489+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03f8053760 con 0x7f0400157ca0 2023-10-09T11:36:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.684+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04000d0170 con 0x7f0400157ca0 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.685+0000 7f03e7fff700 1 -- 172.21.15.6:0/531556694 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f03f8056d80 con 0x7f0400157ca0 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:54.686 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:53.371173+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 msgr2=0x7f03ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 0x7f03ec0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009d40 tx=0x7f03f0008040 comp rx=0 tx=0).stop 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 msgr2=0x7f040016a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f040006fe20 tx=0x7f03f8018000 comp rx=0 tx=0).stop 2023-10-09T11:36:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 shutdown_connections 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f03ec066f30 0x7f03ec0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.687+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0400157ca0 0x7f040016a1b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.688+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f040006d120 0x7f0400068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.688+0000 7f0406857700 1 --2- 172.21.15.6:0/531556694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04001578d0 0x7f0400169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.688+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 >> 172.21.15.6:0/531556694 conn(0x7f040006bb90 msgr2=0x7f040015c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.688+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 shutdown_connections 2023-10-09T11:36:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.688+0000 7f0406857700 1 -- 172.21.15.6:0/531556694 wait complete. 2023-10-09T11:36:54.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:36:54.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.822+0000 7f84b6276700 1 Processor -- start 2023-10-09T11:36:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.822+0000 7f84b6276700 1 -- start start 2023-10-09T11:36:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b6276700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84b00d0f50 0x7f84b006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b6276700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b6276700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b006d990 con 0x7f84b00d0b80 2023-10-09T11:36:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b6276700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b015a690 con 0x7f84b00d0f50 2023-10-09T11:36:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b6276700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00cf2d0 con 0x7f84b006d530 2023-10-09T11:36:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b5a75700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b4a73700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84b00d0f50 0x7f84b006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b5274700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f84b00d0b80 0x7f84b00cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:40282/0 (socket says 172.21.15.6:40282) 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b5a75700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44506/0 (socket says 172.21.15.6:44506) 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b5274700 1 -- 172.21.15.6:0/619458633 learned_addr learned my addr 172.21.15.6:0/619458633 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.823+0000 7f84b4a73700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84b00d0f50 0x7f84b006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:33892/0 (socket says 172.21.15.6:33892) 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b4a73700 1 -- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 msgr2=0x7f84b015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b4a73700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b4a73700 1 -- 172.21.15.6:0/619458633 >> v1:172.21.15.118:6789/0 conn(0x7f84b00d0b80 legacy=0x7f84b00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b4a73700 1 -- 172.21.15.6:0/619458633 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00d0480 con 0x7f84b00d0f50 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b5a75700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84b4a73700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00d0f50 0x7f84b006cff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84a40098e0 tx=0x7f84a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b14238f82309b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84affff700 1 -- 172.21.15.6:0/619458633 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400b640 con 0x7f84b00d0f50 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84affff700 1 -- 172.21.15.6:0/619458633 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400b7a0 con 0x7f84b00d0f50 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.824+0000 7f84affff700 1 -- 172.21.15.6:0/619458633 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a400bb40 con 0x7f84b00d0f50 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 -- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00d0f50 msgr2=0x7f84b006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00d0f50 0x7f84b006cff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84a40098e0 tx=0x7f84a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 -- 172.21.15.6:0/619458633 shutdown_connections 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b006d530 0x7f84b015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 --2- 172.21.15.6:0/619458633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00d0f50 0x7f84b006cff0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 -- 172.21.15.6:0/619458633 >> 172.21.15.6:0/619458633 conn(0x7f84b0063230 msgr2=0x7f84b0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 -- 172.21.15.6:0/619458633 shutdown_connections 2023-10-09T11:36:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.825+0000 7f84b6276700 1 -- 172.21.15.6:0/619458633 wait complete. 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.826+0000 7f84b6276700 1 Processor -- start 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.826+0000 7f84b6276700 1 -- start start 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 0x7f84b014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 0x7f84b00ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00ad1e0 con 0x7f84b00d0b80 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00ad670 con 0x7f84b006d530 2023-10-09T11:36:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b6276700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00ac5d0 con 0x7f84b00d0f50 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b5274700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 0x7f84b014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36500/0 (socket says 172.21.15.6:36500) 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 -- 172.21.15.6:0/1471504310 learned_addr learned my addr 172.21.15.6:0/1471504310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b5a75700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 0x7f84b00ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 -- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 msgr2=0x7f84b00ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 0x7f84b00ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 -- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 msgr2=0x7f84b014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 0x7f84b014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b4a73700 1 -- 172.21.15.6:0/1471504310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8009420 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b5a75700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 0x7f84b00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.827+0000 7f84b5274700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 0x7f84b014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84b4a73700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84b006fcc0 tx=0x7f84a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a401bcf0 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a401be90 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a4009420 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011670 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.828+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b00acb90 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.829+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00ad390 con 0x7f84b00d0b80 2023-10-09T11:36:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.829+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84a40119e0 con 0x7f84b00d0b80 2023-10-09T11:36:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.829+0000 7f84ad7fa700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.830+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84a4085a20 con 0x7f84b00d0b80 2023-10-09T11:36:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.830+0000 7f84b5274700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.830+0000 7f84b5274700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84b0161010 tx=0x7f84a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:54.834+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b00ad390 con 0x7f84b00d0b80 2023-10-09T11:36:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:55.073+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f84b00676e0 con 0x7f84b00d0b80 2023-10-09T11:36:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.011+0000 7f84ad7fa700 1 -- 172.21.15.6:0/1471504310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84a4052d50 con 0x7f84b00d0b80 2023-10-09T11:36:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 msgr2=0x7f849c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84b0161010 tx=0x7f84a0009040 comp rx=0 tx=0).stop 2023-10-09T11:36:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 msgr2=0x7f84b00ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84b006fcc0 tx=0x7f84a4017000 comp rx=0 tx=0).stop 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 shutdown_connections 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0f50 0x7f84b00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b006d530 0x7f84b014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 --2- 172.21.15.6:0/1471504310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84b00d0b80 0x7f84b00ade70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 >> 172.21.15.6:0/1471504310 conn(0x7f84b0063230 msgr2=0x7f84b006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 shutdown_connections 2023-10-09T11:36:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.014+0000 7f84b6276700 1 -- 172.21.15.6:0/1471504310 wait complete. 2023-10-09T11:36:56.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:36:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.158+0000 7f84552f8700 1 Processor -- start 2023-10-09T11:36:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.158+0000 7f84552f8700 1 -- start start 2023-10-09T11:36:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f84552f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f84500cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f84552f8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8450159f10 0x7f8450068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f84552f8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500cee10 con 0x7f84500ccb40 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f84552f8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84500cd040 con 0x7f8450159f10 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f84552f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500cd320 con 0x7f8450159b40 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84500ccb40 0x7f845015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48362/0 (socket says 172.21.15.6:48362) 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844f7fe700 1 -- 172.21.15.6:0/4076439682 learned_addr learned my addr 172.21.15.6:0/4076439682 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844e7fc700 1 --2- 172.21.15.6:0/4076439682 >> v2:172.21.15.118:3300/0 conn(0x7f8450159f10 0x7f8450068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889982802 0 0) 0x7f84500cee10 con 0x7f84500ccb40 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844effd700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f84500cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.159+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003570 con 0x7f84500ccb40 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848994519 0 0) 0x7f843c003570 con 0x7f84500ccb40 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 msgr2=0x7f84500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f84500cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 >> v2:172.21.15.118:3300/0 conn(0x7f8450159f10 msgr2=0x7f8450068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 --2- 172.21.15.6:0/4076439682 >> v2:172.21.15.118:3300/0 conn(0x7f8450159f10 0x7f8450068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500ce7c0 con 0x7f84500ccb40 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f84400017f0 con 0x7f84500ccb40 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 >> v1:172.21.15.6:6789/0 conn(0x7f84500ccb40 legacy=0x7f845015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c003a60 0x7f843c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c004810 0x7f843c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f843c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500cd040 con 0x7f843c004810 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500cd320 con 0x7f843c003a60 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00ba60 con 0x7f8450159b40 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c004810 0x7f843c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844effd700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c003a60 0x7f843c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844f7fe700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f843c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 -- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 msgr2=0x7f843c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8450159b40 0x7f843c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 -- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c003a60 msgr2=0x7f843c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c003a60 0x7f843c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 -- 172.21.15.6:0/4076439682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c003570 con 0x7f843c004810 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844effd700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f843c003a60 0x7f843c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.160+0000 7f844e7fc700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c004810 0x7f843c004c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8438009c30 tx=0x7f84380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bf0e0a056ad966 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800e710 con 0x7f843c004810 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843800e870 con 0x7f843c004810 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f844dffb700 1 -- 172.21.15.6:0/4076439682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800ec30 con 0x7f843c004810 2023-10-09T11:36:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 -- 172.21.15.6:0/4076439682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c004810 msgr2=0x7f843c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 --2- 172.21.15.6:0/4076439682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f843c004810 0x7f843c004c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8438009c30 tx=0x7f84380091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f844f7fe700 1 -- 172.21.15.6:0/4076439682 reap_dead start 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 -- 172.21.15.6:0/4076439682 shutdown_connections 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 -- 172.21.15.6:0/4076439682 >> 172.21.15.6:0/4076439682 conn(0x7f84500cd660 msgr2=0x7f84500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 -- 172.21.15.6:0/4076439682 shutdown_connections 2023-10-09T11:36:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.161+0000 7f84552f8700 1 -- 172.21.15.6:0/4076439682 wait complete. 2023-10-09T11:36:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.162+0000 7f84552f8700 1 Processor -- start 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.162+0000 7f84552f8700 1 -- start start 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 0x7f8450158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84500c7f60 0x7f845015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450159400 con 0x7f845015b710 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845015c510 con 0x7f84500c7f60 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f84552f8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500c8820 con 0x7f843c004810 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36532/0 (socket says 172.21.15.6:36532) 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f844f7fe700 1 -- 172.21.15.6:0/127588078 learned_addr learned my addr 172.21.15.6:0/127588078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f844effd700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 0x7f8450158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.163+0000 7f844e7fc700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84500c7f60 0x7f845015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 -- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 msgr2=0x7f8450158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 0x7f8450158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 -- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84500c7f60 msgr2=0x7f845015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84500c7f60 0x7f845015bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 -- 172.21.15.6:0/127588078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500c8b00 con 0x7f845015b710 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844effd700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 0x7f8450158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f844f7fe700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8450067a80 tx=0x7f8440002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844000ae50 con 0x7f845015b710 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84400133f0 con 0x7f845015b710 2023-10-09T11:36:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500c8de0 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400137b0 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.164+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845015b1f0 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.165+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8450063e90 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.165+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8440013b20 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.166+0000 7f8446ffd700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 0x7f84300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.166+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8440085060 con 0x7f845015b710 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.166+0000 7f844effd700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 0x7f84300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.166+0000 7f844effd700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 0x7f84300693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8448009720 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.170+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84400522d0 con 0x7f845015b710 2023-10-09T11:36:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:56.406+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84500ceaa0 con 0x7f845015b710 2023-10-09T11:36:57.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.015+0000 7f8446ffd700 1 -- 172.21.15.6:0/127588078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84400558f0 con 0x7f845015b710 2023-10-09T11:36:57.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 msgr2=0x7f84300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 0x7f84300693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8448009720 tx=0x7f8448008040 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 msgr2=0x7f84500ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8450067a80 tx=0x7f8440002210 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 shutdown_connections 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8430066f30 0x7f84300693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845015b710 0x7f84500ca390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f843c004810 0x7f8450158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 --2- 172.21.15.6:0/127588078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84500c7f60 0x7f845015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 >> 172.21.15.6:0/127588078 conn(0x7f84500cd660 msgr2=0x7f845006e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 shutdown_connections 2023-10-09T11:36:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.018+0000 7f84552f8700 1 -- 172.21.15.6:0/127588078 wait complete. 2023-10-09T11:36:57.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.158+0000 7fc588c58700 1 Processor -- start 2023-10-09T11:36:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.158+0000 7fc588c58700 1 -- start start 2023-10-09T11:36:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc588c58700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc58415daa0 0x7fc58415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc588c58700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5840cae00 0x7fc584159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc588c58700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58406d350 con 0x7fc5840cb2a0 2023-10-09T11:36:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc588c58700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840c9ac0 con 0x7fc5840cae00 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc588c58700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58415e3b0 con 0x7fc58415daa0 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5840cae00 0x7fc584159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc582d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5840cb2a0 0x7fc584159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48364/0 (socket says 172.21.15.6:48364) 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc582d9d700 1 -- 172.21.15.6:0/852837176 learned_addr learned my addr 172.21.15.6:0/852837176 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc58259c700 1 --2- 172.21.15.6:0/852837176 >> v2:172.21.15.118:3300/0 conn(0x7fc58415daa0 0x7fc58415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 -- 172.21.15.6:0/852837176 >> v2:172.21.15.118:3300/0 conn(0x7fc58415daa0 msgr2=0x7fc58415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 --2- 172.21.15.6:0/852837176 >> v2:172.21.15.118:3300/0 conn(0x7fc58415daa0 0x7fc58415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 -- 172.21.15.6:0/852837176 >> v1:172.21.15.6:6789/0 conn(0x7fc5840cb2a0 legacy=0x7fc584159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc58159a700 1 -- 172.21.15.6:0/852837176 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964211998 0 0) 0x7fc58406d350 con 0x7fc5840cb2a0 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 -- 172.21.15.6:0/852837176 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58406c740 con 0x7fc5840cae00 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.159+0000 7fc581d9b700 1 --2- 172.21.15.6:0/852837176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc584159540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc584068b30 tx=0x7fc56c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fba7b04d929d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc58159a700 1 -- 172.21.15.6:0/852837176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00b6b0 con 0x7fc5840cae00 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc58159a700 1 -- 172.21.15.6:0/852837176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00b810 con 0x7fc5840cae00 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc58159a700 1 -- 172.21.15.6:0/852837176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00bbb0 con 0x7fc5840cae00 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 -- 172.21.15.6:0/852837176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 msgr2=0x7fc584159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 --2- 172.21.15.6:0/852837176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc584159540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc584068b30 tx=0x7fc56c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 -- 172.21.15.6:0/852837176 shutdown_connections 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 --2- 172.21.15.6:0/852837176 >> v2:172.21.15.118:3300/0 conn(0x7fc58415daa0 0x7fc58415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 --2- 172.21.15.6:0/852837176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc584159540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 -- 172.21.15.6:0/852837176 >> 172.21.15.6:0/852837176 conn(0x7fc5840c9ca0 msgr2=0x7fc5840ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 -- 172.21.15.6:0/852837176 shutdown_connections 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.160+0000 7fc588c58700 1 -- 172.21.15.6:0/852837176 wait complete. 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.161+0000 7fc588c58700 1 Processor -- start 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.161+0000 7fc588c58700 1 -- start start 2023-10-09T11:36:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5840cb2a0 0x7fc5840aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 0x7fc5840c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416a6a0 con 0x7fc5840cae00 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840ab2c0 con 0x7fc5840cb2a0 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc588c58700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416a050 con 0x7fc58415daa0 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc58259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc58259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36552/0 (socket says 172.21.15.6:36552) 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc58259c700 1 -- 172.21.15.6:0/1230310026 learned_addr learned my addr 172.21.15.6:0/1230310026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc581d9b700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5840cb2a0 0x7fc5840aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.162+0000 7fc582d9d700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 0x7fc5840c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 -- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 msgr2=0x7fc5840c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 0x7fc5840c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 -- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5840cb2a0 msgr2=0x7fc5840aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5840cb2a0 0x7fc5840aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 -- 172.21.15.6:0/1230310026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c009420 con 0x7fc5840cae00 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc582d9d700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 0x7fc5840c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc58259c700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fa0 tx=0x7fc57c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00ec70 con 0x7fc5840cae00 2023-10-09T11:36:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00edd0 con 0x7fc5840cae00 2023-10-09T11:36:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58416a330 con 0x7fc5840cae00 2023-10-09T11:36:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c014670 con 0x7fc5840cae00 2023-10-09T11:36:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.163+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584169cb0 con 0x7fc5840cae00 2023-10-09T11:36:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.164+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc584068080 con 0x7fc5840cae00 2023-10-09T11:36:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.164+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc57c0149e0 con 0x7fc5840cae00 2023-10-09T11:36:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.165+0000 7fc57a7fc700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.165+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc57c084bd0 con 0x7fc5840cae00 2023-10-09T11:36:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.165+0000 7fc581d9b700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.165+0000 7fc581d9b700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 0x7fc5640693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0093f0 tx=0x7fc56c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.169+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc57c051e40 con 0x7fc5840cae00 2023-10-09T11:36:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.405+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc58416a980 con 0x7fc5840cae00 2023-10-09T11:36:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.406+0000 7fc57a7fc700 1 -- 172.21.15.6:0/1230310026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fc57c055460 con 0x7fc5840cae00 2023-10-09T11:36:57.406 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:57.406 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 msgr2=0x7fc5640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 0x7fc5640693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0093f0 tx=0x7fc56c017000 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 msgr2=0x7fc58415a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fa0 tx=0x7fc57c009880 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 shutdown_connections 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc564066f30 0x7fc5640693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc58415daa0 0x7fc5840c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5840cae00 0x7fc58415a150 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 --2- 172.21.15.6:0/1230310026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5840cb2a0 0x7fc5840aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 >> 172.21.15.6:0/1230310026 conn(0x7fc5840c9ca0 msgr2=0x7fc5840c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 shutdown_connections 2023-10-09T11:36:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.408+0000 7fc588c58700 1 -- 172.21.15.6:0/1230310026 wait complete. 2023-10-09T11:36:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:36:57.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:36:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.538+0000 7f5b127a7700 1 Processor -- start 2023-10-09T11:36:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.538+0000 7f5b127a7700 1 -- start start 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b127a7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b0c06d830 0x7f5b0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b127a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0d07c0 con 0x7f5b0c1578d0 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b127a7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0cfbb0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b127a7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0cfe90 con 0x7f5b0c06d830 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b0bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b0c1578d0 0x7f5b0c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48380/0 (socket says 172.21.15.6:48380) 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.539+0000 7f5b0bfff700 1 -- 172.21.15.6:0/1304083697 learned_addr learned my addr 172.21.15.6:0/1304083697 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b10d44700 1 --2- 172.21.15.6:0/1304083697 >> v2:172.21.15.118:3300/0 conn(0x7f5b0c06d830 0x7f5b0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566232441 0 0) 0x7f5b0c0d07c0 con 0x7f5b0c1578d0 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af8003570 con 0x7f5b0c1578d0 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b10d44700 1 -- 172.21.15.6:0/1304083697 >> v1:172.21.15.118:6789/0 conn(0x7f5b0c157ca0 legacy=0x7f5b0c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b10d44700 1 -- 172.21.15.6:0/1304083697 >> v1:172.21.15.6:6789/0 conn(0x7f5b0c1578d0 legacy=0x7f5b0c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907227274 0 0) 0x7f5b0c0cfbb0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b10d44700 1 -- 172.21.15.6:0/1304083697 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0d0170 con 0x7f5b0c06d830 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b10d44700 1 --2- 172.21.15.6:0/1304083697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c0cf4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009e60 tx=0x7f5b04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb655e1dea7a5244 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400e070 con 0x7f5b0c06d830 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400bb60 con 0x7f5b0c06d830 2023-10-09T11:36:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.540+0000 7f5b0affd700 1 -- 172.21.15.6:0/1304083697 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400bee0 con 0x7f5b0c06d830 2023-10-09T11:36:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 -- 172.21.15.6:0/1304083697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 msgr2=0x7f5b0c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1304083697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c0cf4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009e60 tx=0x7f5b04009780 comp rx=0 tx=0).stop 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 -- 172.21.15.6:0/1304083697 shutdown_connections 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1304083697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c0cf4f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 -- 172.21.15.6:0/1304083697 >> 172.21.15.6:0/1304083697 conn(0x7f5b0c06bb90 msgr2=0x7f5b0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 -- 172.21.15.6:0/1304083697 shutdown_connections 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.541+0000 7f5b127a7700 1 -- 172.21.15.6:0/1304083697 wait complete. 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.542+0000 7f5b127a7700 1 Processor -- start 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.542+0000 7f5b127a7700 1 -- start start 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 0x7f5b0c16a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0abc30 con 0x7f5b0c157ca0 2023-10-09T11:36:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0ab900 con 0x7f5b0c06d830 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b127a7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c16ac60 con 0x7f5b0c1578d0 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36560/0 (socket says 172.21.15.6:36560) 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 -- 172.21.15.6:0/1662494060 learned_addr learned my addr 172.21.15.6:0/1662494060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b0b7fe700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 0x7f5b0c16a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 -- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 msgr2=0x7f5b0c16a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 0x7f5b0c16a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 -- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 msgr2=0x7f5b0c145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 -- 172.21.15.6:0/1662494060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04009a20 con 0x7f5b0c157ca0 2023-10-09T11:36:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b0b7fe700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 0x7f5b0c16a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.543+0000 7f5b10d44700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c06fe20 tx=0x7f5b04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.544+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04027470 con 0x7f5b0c157ca0 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.544+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b040275d0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.544+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c16af40 con 0x7f5b0c157ca0 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.544+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04027950 con 0x7f5b0c157ca0 2023-10-09T11:36:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.544+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c1458d0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.545+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0abde0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.545+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b04024070 con 0x7f5b0c157ca0 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.545+0000 7f5b03fff700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.545+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b04086d60 con 0x7f5b0c157ca0 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.545+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.546+0000 7f5b0bfff700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 0x7f5aec0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0af910 tx=0x7f5af4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.550+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b0c0abde0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.743+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b0c15a4d0 con 0x7f5b0c157ca0 2023-10-09T11:36:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.743+0000 7f5b03fff700 1 -- 172.21.15.6:0/1662494060 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5b0402c020 con 0x7f5b0c157ca0 2023-10-09T11:36:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:57.744 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:36:54.986899+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:36:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 msgr2=0x7f5aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 0x7f5aec0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0af910 tx=0x7f5af4009040 comp rx=0 tx=0).stop 2023-10-09T11:36:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 msgr2=0x7f5b0c0ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c06fe20 tx=0x7f5b04019000 comp rx=0 tx=0).stop 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 shutdown_connections 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b0c157ca0 0x7f5b0c0ac0c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0c06d830 0x7f5b0c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 --2- 172.21.15.6:0/1662494060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b0c1578d0 0x7f5b0c16a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 >> 172.21.15.6:0/1662494060 conn(0x7f5b0c06bb90 msgr2=0x7f5b0c069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 shutdown_connections 2023-10-09T11:36:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.746+0000 7f5b127a7700 1 -- 172.21.15.6:0/1662494060 wait complete. 2023-10-09T11:36:57.758 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:36:57.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.877+0000 7fad70ac1700 1 Processor -- start 2023-10-09T11:36:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.877+0000 7fad70ac1700 1 -- start start 2023-10-09T11:36:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 0x7fad6c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad6c0ceb30 0x7fad6c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0cf4d0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0b2890 con 0x7fad6c157fe0 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad70ac1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0b4070 con 0x7fad6c1583b0 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad6ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad6c0ceb30 0x7fad6c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad6ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad6c0ceb30 0x7fad6c0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36562/0 (socket says 172.21.15.6:36562) 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.878+0000 7fad6ad9d700 1 -- 172.21.15.6:0/4084209134 learned_addr learned my addr 172.21.15.6:0/4084209134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6a59c700 1 --2- 172.21.15.6:0/4084209134 >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 0x7fad6c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad69d9b700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 -- 172.21.15.6:0/4084209134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 msgr2=0x7fad6c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 -- 172.21.15.6:0/4084209134 >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 msgr2=0x7fad6c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 --2- 172.21.15.6:0/4084209134 >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 0x7fad6c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 -- 172.21.15.6:0/4084209134 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0b4350 con 0x7fad6c0ceb30 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad69d9b700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6a59c700 1 --2- 172.21.15.6:0/4084209134 >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 0x7fad6c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6ad9d700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0cef90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fad6c064d90 tx=0x7fad5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fde0b6ad646c77 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6959a700 1 -- 172.21.15.6:0/4084209134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00e070 con 0x7fad6c0ceb30 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6959a700 1 -- 172.21.15.6:0/4084209134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00ba50 con 0x7fad6c0ceb30 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad6959a700 1 -- 172.21.15.6:0/4084209134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0092e0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad70ac1700 1 -- 172.21.15.6:0/4084209134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 msgr2=0x7fad6c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.879+0000 7fad70ac1700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0cef90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fad6c064d90 tx=0x7fad5c009840 comp rx=0 tx=0).stop 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 -- 172.21.15.6:0/4084209134 shutdown_connections 2023-10-09T11:36:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0cef90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 --2- 172.21.15.6:0/4084209134 >> v2:172.21.15.118:3300/0 conn(0x7fad6c157fe0 0x7fad6c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 --2- 172.21.15.6:0/4084209134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 -- 172.21.15.6:0/4084209134 >> 172.21.15.6:0/4084209134 conn(0x7fad6c067640 msgr2=0x7fad6c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 -- 172.21.15.6:0/4084209134 shutdown_connections 2023-10-09T11:36:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.880+0000 7fad70ac1700 1 -- 172.21.15.6:0/4084209134 wait complete. 2023-10-09T11:36:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 Processor -- start 2023-10-09T11:36:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 -- start start 2023-10-09T11:36:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad6c157fe0 0x7fad6c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c14e190 con 0x7fad6c0ceb30 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1685e0 con 0x7fad6c157fe0 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.881+0000 7fad70ac1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c14f290 con 0x7fad6c1583b0 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36578/0 (socket says 172.21.15.6:36578) 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 -- 172.21.15.6:0/3260486811 learned_addr learned my addr 172.21.15.6:0/3260486811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6ad9d700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad69d9b700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad6c157fe0 0x7fad6c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 -- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 msgr2=0x7fad6c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 -- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad6c157fe0 msgr2=0x7fad6c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad6c157fe0 0x7fad6c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 -- 172.21.15.6:0/3260486811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009ae0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad6a59c700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fad6400e900 tx=0x7fad64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400eea0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6400c5e0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c0c5f20 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6400c980 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.882+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c14ecd0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.883+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c069e40 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.884+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad6400cd30 con 0x7fad6c0ceb30 2023-10-09T11:36:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.884+0000 7fad627fc700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.884+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad640843a0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.884+0000 7fad69d9b700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.885+0000 7fad69d9b700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 0x7fad4c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fad6c14ff60 tx=0x7fad54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:57.888+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad640550a0 con 0x7fad6c0ceb30 2023-10-09T11:36:57.954 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-09T11:36:57.954+0000 7ffa282ab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:36:58.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.079+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad6c168720 con 0x7fad4c066f30 2023-10-09T11:36:58.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.086+0000 7fad627fc700 1 -- 172.21.15.6:0/3260486811 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269403 (secure 0 0 0) 0x7fad54010640 con 0x7fad4c066f30 2023-10-09T11:36:58.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 msgr2=0x7fad4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 0x7fad4c0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fad6c14ff60 tx=0x7fad54008040 comp rx=0 tx=0).stop 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 msgr2=0x7fad6c0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fad6400e900 tx=0x7fad64008040 comp rx=0 tx=0).stop 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 shutdown_connections 2023-10-09T11:36:58.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fad4c066f30 0x7fad4c0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fad6c1583b0 0x7fad6c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad6c0ceb30 0x7fad6c0c59e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 --2- 172.21.15.6:0/3260486811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad6c157fe0 0x7fad6c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 >> 172.21.15.6:0/3260486811 conn(0x7fad6c067640 msgr2=0x7fad6c1553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.089+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 shutdown_connections 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.090+0000 7fad70ac1700 1 -- 172.21.15.6:0/3260486811 wait complete. 2023-10-09T11:36:58.093 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:58.102 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-09T11:36:56.157154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560455,"statfs":{"total":1600000000,"available":1597906291,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.192193"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971425+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:56.550491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.976995+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:42.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969961+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:14.874325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971572+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:30.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972486+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:08.882522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977229+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:16.402442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977189+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:14.874325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.975819+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:58.955962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971046+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:56.550491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973353+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:40.325537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977865+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:16.402442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969530+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:00.487586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972000+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:13.126188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.979232+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:09.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971114+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:29.251039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977567+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:29.251039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.976812+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:09.011707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973862+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:14.874325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.975872+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.289644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972114+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:11.372535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972003+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:52.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970605+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:16.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972330+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:11.568942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969898+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:26.321681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972890+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:09.011707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973811+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:26.321681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973149+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.358404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969136+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:40.325537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970367+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:04.610737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.976234+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:00.487586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971015+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:23.380783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.974630+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:11.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972998+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:52.912811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.974767+0000","last_change":"2023-10-09T11:36:52.974767+0000","last_active":"2023-10-09T11:36:52.974767+0000","last_peered":"2023-10-09T11:36:52.974767+0000","last_clean":"2023-10-09T11:36:52.974767+0000","last_became_active":"2023-10-09T11:36:52.974550+0000","last_became_peered":"2023-10-09T11:36:52.974550+0000","last_unstale":"2023-10-09T11:36:52.974767+0000","last_undegraded":"2023-10-09T11:36:52.974767+0000","last_fullsized":"2023-10-09T11:36:52.974767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:23.117169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970923+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:04.610737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.979848+0000","last_change":"2023-10-09T11:36:52.979848+0000","last_active":"2023-10-09T11:36:52.979848+0000","last_peered":"2023-10-09T11:36:52.979848+0000","last_clean":"2023-10-09T11:36:52.979848+0000","last_became_active":"2023-10-09T11:36:52.979673+0000","last_became_peered":"2023-10-09T11:36:52.979673+0000","last_unstale":"2023-10-09T11:36:52.979848+0000","last_undegraded":"2023-10-09T11:36:52.979848+0000","last_fullsized":"2023-10-09T11:36:52.979848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971611+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:11.568942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978920+0000","last_change":"2023-10-09T11:36:52.978920+0000","last_active":"2023-10-09T11:36:52.978920+0000","last_peered":"2023-10-09T11:36:52.978920+0000","last_clean":"2023-10-09T11:36:52.978920+0000","last_became_active":"2023-10-09T11:36:52.978662+0000","last_became_peered":"2023-10-09T11:36:52.978662+0000","last_unstale":"2023-10-09T11:36:52.978920+0000","last_undegraded":"2023-10-09T11:36:52.978920+0000","last_fullsized":"2023-10-09T11:36:52.978920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:29.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971875+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:24.173615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.980172+0000","last_change":"2023-10-09T11:36:52.980172+0000","last_active":"2023-10-09T11:36:52.980172+0000","last_peered":"2023-10-09T11:36:52.980172+0000","last_clean":"2023-10-09T11:36:52.980172+0000","last_became_active":"2023-10-09T11:36:52.979968+0000","last_became_peered":"2023-10-09T11:36:52.979968+0000","last_unstale":"2023-10-09T11:36:52.980172+0000","last_undegraded":"2023-10-09T11:36:52.980172+0000","last_fullsized":"2023-10-09T11:36:52.980172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:33.160024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.975072+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:40.325537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.981472+0000","last_change":"2023-10-09T11:36:52.981472+0000","last_active":"2023-10-09T11:36:52.981472+0000","last_peered":"2023-10-09T11:36:52.981472+0000","last_clean":"2023-10-09T11:36:52.981472+0000","last_became_active":"2023-10-09T11:36:52.980906+0000","last_became_peered":"2023-10-09T11:36:52.980906+0000","last_unstale":"2023-10-09T11:36:52.981472+0000","last_undegraded":"2023-10-09T11:36:52.981472+0000","last_fullsized":"2023-10-09T11:36:52.981472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:48.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969195+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:07.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.979226+0000","last_change":"2023-10-09T11:36:52.979226+0000","last_active":"2023-10-09T11:36:52.979226+0000","last_peered":"2023-10-09T11:36:52.979226+0000","last_clean":"2023-10-09T11:36:52.979226+0000","last_became_active":"2023-10-09T11:36:52.978984+0000","last_became_peered":"2023-10-09T11:36:52.978984+0000","last_unstale":"2023-10-09T11:36:52.979226+0000","last_undegraded":"2023-10-09T11:36:52.979226+0000","last_fullsized":"2023-10-09T11:36:52.979226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:24.301960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971222+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:31:51.165809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.982497+0000","last_change":"2023-10-09T11:36:52.982497+0000","last_active":"2023-10-09T11:36:52.982497+0000","last_peered":"2023-10-09T11:36:52.982497+0000","last_clean":"2023-10-09T11:36:52.982497+0000","last_became_active":"2023-10-09T11:36:52.980583+0000","last_became_peered":"2023-10-09T11:36:52.980583+0000","last_unstale":"2023-10-09T11:36:52.982497+0000","last_undegraded":"2023-10-09T11:36:52.982497+0000","last_fullsized":"2023-10-09T11:36:52.982497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:51.624277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970848+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:52.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978007+0000","last_change":"2023-10-09T11:36:52.978007+0000","last_active":"2023-10-09T11:36:52.978007+0000","last_peered":"2023-10-09T11:36:52.978007+0000","last_clean":"2023-10-09T11:36:52.978007+0000","last_became_active":"2023-10-09T11:36:52.977026+0000","last_became_peered":"2023-10-09T11:36:52.977026+0000","last_unstale":"2023-10-09T11:36:52.978007+0000","last_undegraded":"2023-10-09T11:36:52.978007+0000","last_fullsized":"2023-10-09T11:36:52.978007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:55.409539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.968854+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:09.011707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.981816+0000","last_change":"2023-10-09T11:36:52.981816+0000","last_active":"2023-10-09T11:36:52.981816+0000","last_peered":"2023-10-09T11:36:52.981816+0000","last_clean":"2023-10-09T11:36:52.981816+0000","last_became_active":"2023-10-09T11:36:52.981578+0000","last_became_peered":"2023-10-09T11:36:52.981578+0000","last_unstale":"2023-10-09T11:36:52.981816+0000","last_undegraded":"2023-10-09T11:36:52.981816+0000","last_fullsized":"2023-10-09T11:36:52.981816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:23.171745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971351+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:58.955962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.980903+0000","last_change":"2023-10-09T11:36:52.980903+0000","last_active":"2023-10-09T11:36:52.980903+0000","last_peered":"2023-10-09T11:36:52.980903+0000","last_clean":"2023-10-09T11:36:52.980903+0000","last_became_active":"2023-10-09T11:36:52.980718+0000","last_became_peered":"2023-10-09T11:36:52.980718+0000","last_unstale":"2023-10-09T11:36:52.980903+0000","last_undegraded":"2023-10-09T11:36:52.980903+0000","last_fullsized":"2023-10-09T11:36:52.980903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:12.658888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971517+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:00.487586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.979789+0000","last_change":"2023-10-09T11:36:52.979789+0000","last_active":"2023-10-09T11:36:52.979789+0000","last_peered":"2023-10-09T11:36:52.979789+0000","last_clean":"2023-10-09T11:36:52.979789+0000","last_became_active":"2023-10-09T11:36:52.979583+0000","last_became_peered":"2023-10-09T11:36:52.979583+0000","last_unstale":"2023-10-09T11:36:52.979789+0000","last_undegraded":"2023-10-09T11:36:52.979789+0000","last_fullsized":"2023-10-09T11:36:52.979789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:29.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.968763+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:11.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.982677+0000","last_change":"2023-10-09T11:36:52.982677+0000","last_active":"2023-10-09T11:36:52.982677+0000","last_peered":"2023-10-09T11:36:52.982677+0000","last_clean":"2023-10-09T11:36:52.982677+0000","last_became_active":"2023-10-09T11:36:52.980843+0000","last_became_peered":"2023-10-09T11:36:52.980843+0000","last_unstale":"2023-10-09T11:36:52.982677+0000","last_undegraded":"2023-10-09T11:36:52.982677+0000","last_fullsized":"2023-10-09T11:36:52.982677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.356534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972930+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:11.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.977866+0000","last_change":"2023-10-09T11:36:52.977866+0000","last_active":"2023-10-09T11:36:52.977866+0000","last_peered":"2023-10-09T11:36:52.977866+0000","last_clean":"2023-10-09T11:36:52.977866+0000","last_became_active":"2023-10-09T11:36:52.976717+0000","last_became_peered":"2023-10-09T11:36:52.976717+0000","last_unstale":"2023-10-09T11:36:52.977866+0000","last_undegraded":"2023-10-09T11:36:52.977866+0000","last_fullsized":"2023-10-09T11:36:52.977866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:23.117169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.975898+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:29.251039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.975933+0000","last_change":"2023-10-09T11:36:52.975933+0000","last_active":"2023-10-09T11:36:52.975933+0000","last_peered":"2023-10-09T11:36:52.975933+0000","last_clean":"2023-10-09T11:36:52.975933+0000","last_became_active":"2023-10-09T11:36:52.975700+0000","last_became_peered":"2023-10-09T11:36:52.975700+0000","last_unstale":"2023-10-09T11:36:52.975933+0000","last_undegraded":"2023-10-09T11:36:52.975933+0000","last_fullsized":"2023-10-09T11:36:52.975933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:22.378913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.975423+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:07.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.982950+0000","last_change":"2023-10-09T11:36:52.982950+0000","last_active":"2023-10-09T11:36:52.982950+0000","last_peered":"2023-10-09T11:36:52.982950+0000","last_clean":"2023-10-09T11:36:52.982950+0000","last_became_active":"2023-10-09T11:36:52.981713+0000","last_became_peered":"2023-10-09T11:36:52.981713+0000","last_unstale":"2023-10-09T11:36:52.982950+0000","last_undegraded":"2023-10-09T11:36:52.982950+0000","last_fullsized":"2023-10-09T11:36:52.982950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.009837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972071+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:11.568942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.983532+0000","last_change":"2023-10-09T11:36:52.983532+0000","last_active":"2023-10-09T11:36:52.983532+0000","last_peered":"2023-10-09T11:36:52.983532+0000","last_clean":"2023-10-09T11:36:52.983532+0000","last_became_active":"2023-10-09T11:36:52.982791+0000","last_became_peered":"2023-10-09T11:36:52.982791+0000","last_unstale":"2023-10-09T11:36:52.983532+0000","last_undegraded":"2023-10-09T11:36:52.983532+0000","last_fullsized":"2023-10-09T11:36:52.983532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:51.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970838+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:23.380783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.982746+0000","last_change":"2023-10-09T11:36:52.982746+0000","last_active":"2023-10-09T11:36:52.982746+0000","last_peered":"2023-10-09T11:36:52.982746+0000","last_clean":"2023-10-09T11:36:52.982746+0000","last_became_active":"2023-10-09T11:36:52.982494+0000","last_became_peered":"2023-10-09T11:36:52.982494+0000","last_unstale":"2023-10-09T11:36:52.982746+0000","last_undegraded":"2023-10-09T11:36:52.982746+0000","last_fullsized":"2023-10-09T11:36:52.982746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:15.103301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.969499+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:58.955962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.977383+0000","last_change":"2023-10-09T11:36:52.977383+0000","last_active":"2023-10-09T11:36:52.977383+0000","last_peered":"2023-10-09T11:36:52.977383+0000","last_clean":"2023-10-09T11:36:52.977383+0000","last_became_active":"2023-10-09T11:36:52.975186+0000","last_became_peered":"2023-10-09T11:36:52.975186+0000","last_unstale":"2023-10-09T11:36:52.977383+0000","last_undegraded":"2023-10-09T11:36:52.977383+0000","last_fullsized":"2023-10-09T11:36:52.977383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:28.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971397+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:52.912811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.972539+0000","last_change":"2023-10-09T11:36:52.972539+0000","last_active":"2023-10-09T11:36:52.972539+0000","last_peered":"2023-10-09T11:36:52.972539+0000","last_clean":"2023-10-09T11:36:52.972539+0000","last_became_active":"2023-10-09T11:36:52.972305+0000","last_became_peered":"2023-10-09T11:36:52.972305+0000","last_unstale":"2023-10-09T11:36:52.972539+0000","last_undegraded":"2023-10-09T11:36:52.972539+0000","last_fullsized":"2023-10-09T11:36:52.972539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:54.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.974377+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:46:20.398047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.981633+0000","last_change":"2023-10-09T11:36:52.981633+0000","last_active":"2023-10-09T11:36:52.981633+0000","last_peered":"2023-10-09T11:36:52.981633+0000","last_clean":"2023-10-09T11:36:52.981633+0000","last_became_active":"2023-10-09T11:36:52.981238+0000","last_became_peered":"2023-10-09T11:36:52.981238+0000","last_unstale":"2023-10-09T11:36:52.981633+0000","last_undegraded":"2023-10-09T11:36:52.981633+0000","last_fullsized":"2023-10-09T11:36:52.981633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:39.075107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972802+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:21.766238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978268+0000","last_change":"2023-10-09T11:36:52.978268+0000","last_active":"2023-10-09T11:36:52.978268+0000","last_peered":"2023-10-09T11:36:52.978268+0000","last_clean":"2023-10-09T11:36:52.978268+0000","last_became_active":"2023-10-09T11:36:52.977836+0000","last_became_peered":"2023-10-09T11:36:52.977836+0000","last_unstale":"2023-10-09T11:36:52.978268+0000","last_undegraded":"2023-10-09T11:36:52.978268+0000","last_fullsized":"2023-10-09T11:36:52.978268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:22.378913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971623+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:42.908433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978579+0000","last_change":"2023-10-09T11:36:52.978579+0000","last_active":"2023-10-09T11:36:52.978579+0000","last_peered":"2023-10-09T11:36:52.978579+0000","last_clean":"2023-10-09T11:36:52.978579+0000","last_became_active":"2023-10-09T11:36:52.978344+0000","last_became_peered":"2023-10-09T11:36:52.978344+0000","last_unstale":"2023-10-09T11:36:52.978579+0000","last_undegraded":"2023-10-09T11:36:52.978579+0000","last_fullsized":"2023-10-09T11:36:52.978579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973997+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:55.893537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978194+0000","last_change":"2023-10-09T11:36:52.978194+0000","last_active":"2023-10-09T11:36:52.978194+0000","last_peered":"2023-10-09T11:36:52.978194+0000","last_clean":"2023-10-09T11:36:52.978194+0000","last_became_active":"2023-10-09T11:36:52.977608+0000","last_became_peered":"2023-10-09T11:36:52.977608+0000","last_unstale":"2023-10-09T11:36:52.978194+0000","last_undegraded":"2023-10-09T11:36:52.978194+0000","last_fullsized":"2023-10-09T11:36:52.978194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:54.785201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977052+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:26.321681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.980641+0000","last_change":"2023-10-09T11:36:52.980641+0000","last_active":"2023-10-09T11:36:52.980641+0000","last_peered":"2023-10-09T11:36:52.980641+0000","last_clean":"2023-10-09T11:36:52.980641+0000","last_became_active":"2023-10-09T11:36:52.980368+0000","last_became_peered":"2023-10-09T11:36:52.980368+0000","last_unstale":"2023-10-09T11:36:52.980641+0000","last_undegraded":"2023-10-09T11:36:52.980641+0000","last_fullsized":"2023-10-09T11:36:52.980641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:51.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971232+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:08:49.549484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978421+0000","last_change":"2023-10-09T11:36:52.978421+0000","last_active":"2023-10-09T11:36:52.978421+0000","last_peered":"2023-10-09T11:36:52.978421+0000","last_clean":"2023-10-09T11:36:52.978421+0000","last_became_active":"2023-10-09T11:36:52.978043+0000","last_became_peered":"2023-10-09T11:36:52.978043+0000","last_unstale":"2023-10-09T11:36:52.978421+0000","last_undegraded":"2023-10-09T11:36:52.978421+0000","last_fullsized":"2023-10-09T11:36:52.978421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:31:50.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.968467+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:24.173615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978416+0000","last_change":"2023-10-09T11:36:52.978416+0000","last_active":"2023-10-09T11:36:52.978416+0000","last_peered":"2023-10-09T11:36:52.978416+0000","last_clean":"2023-10-09T11:36:52.978416+0000","last_became_active":"2023-10-09T11:36:52.978117+0000","last_became_peered":"2023-10-09T11:36:52.978117+0000","last_unstale":"2023-10-09T11:36:52.978416+0000","last_undegraded":"2023-10-09T11:36:52.978416+0000","last_fullsized":"2023-10-09T11:36:52.978416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:03.608867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.972609+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:52.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.977886+0000","last_change":"2023-10-09T11:36:52.977886+0000","last_active":"2023-10-09T11:36:52.977886+0000","last_peered":"2023-10-09T11:36:52.977886+0000","last_clean":"2023-10-09T11:36:52.977886+0000","last_became_active":"2023-10-09T11:36:52.977554+0000","last_became_peered":"2023-10-09T11:36:52.977554+0000","last_unstale":"2023-10-09T11:36:52.977886+0000","last_undegraded":"2023-10-09T11:36:52.977886+0000","last_fullsized":"2023-10-09T11:36:52.977886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971712+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:31:51.165809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.974753+0000","last_change":"2023-10-09T11:36:52.974753+0000","last_active":"2023-10-09T11:36:52.974753+0000","last_peered":"2023-10-09T11:36:52.974753+0000","last_clean":"2023-10-09T11:36:52.974753+0000","last_became_active":"2023-10-09T11:36:52.974461+0000","last_became_peered":"2023-10-09T11:36:52.974461+0000","last_unstale":"2023-10-09T11:36:52.974753+0000","last_undegraded":"2023-10-09T11:36:52.974753+0000","last_fullsized":"2023-10-09T11:36:52.974753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:15.103301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.973269+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:30.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.978263+0000","last_change":"2023-10-09T11:36:52.978263+0000","last_active":"2023-10-09T11:36:52.978263+0000","last_peered":"2023-10-09T11:36:52.978263+0000","last_clean":"2023-10-09T11:36:52.978263+0000","last_became_active":"2023-10-09T11:36:52.977517+0000","last_became_peered":"2023-10-09T11:36:52.977517+0000","last_unstale":"2023-10-09T11:36:52.978263+0000","last_undegraded":"2023-10-09T11:36:52.978263+0000","last_fullsized":"2023-10-09T11:36:52.978263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:55.548621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.971080+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:07.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.973332+0000","last_change":"2023-10-09T11:36:52.973332+0000","last_active":"2023-10-09T11:36:52.973332+0000","last_peered":"2023-10-09T11:36:52.973332+0000","last_clean":"2023-10-09T11:36:52.973332+0000","last_became_active":"2023-10-09T11:36:52.973068+0000","last_became_peered":"2023-10-09T11:36:52.973068+0000","last_unstale":"2023-10-09T11:36:52.973332+0000","last_undegraded":"2023-10-09T11:36:52.973332+0000","last_fullsized":"2023-10-09T11:36:52.973332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:20.764368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.970200+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:13.660758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.982899+0000","last_change":"2023-10-09T11:36:52.982899+0000","last_active":"2023-10-09T11:36:52.982899+0000","last_peered":"2023-10-09T11:36:52.982899+0000","last_clean":"2023-10-09T11:36:52.982899+0000","last_became_active":"2023-10-09T11:36:52.982300+0000","last_became_peered":"2023-10-09T11:36:52.982300+0000","last_unstale":"2023-10-09T11:36:52.982899+0000","last_undegraded":"2023-10-09T11:36:52.982899+0000","last_fullsized":"2023-10-09T11:36:52.982899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:10.326129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:36:52.964159+0000","last_change":"2023-10-09T11:36:52.977458+0000","last_active":"2023-10-09T11:36:52.964159+0000","last_peered":"2023-10-09T11:36:52.964159+0000","last_clean":"2023-10-09T11:36:52.964159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:36:52.964159+0000","last_undegraded":"2023-10-09T11:36:52.964159+0000","last_fullsized":"2023-10-09T11:36:52.964159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.289644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-09T11:36:52.975705+0000","last_change":"2023-10-09T11:36:52.975705+0000","last_active":"2023-10-09T11:36:52.975705+0000","last_peered":"2023-10-09T11:36:52.975705+0000","last_clean":"2023-10-09T11:36:52.975705+0000","last_became_active":"2023-10-09T11:36:52.975500+0000","last_became_peered":"2023-10-09T11:36:52.975500+0000","last_unstale":"2023-10-09T11:36:52.975705+0000","last_undegraded":"2023-10-09T11:36:52.975705+0000","last_fullsized":"2023-10-09T11:36:52.975705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:55.409539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-09T11:36:51.966945+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:51.966945+0000","last_peered":"2023-10-09T11:36:51.966945+0000","last_clean":"2023-10-09T11:36:51.966945+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:51.966945+0000","last_undegraded":"2023-10-09T11:36:51.966945+0000","last_fullsized":"2023-10-09T11:36:51.966945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":688,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194624,"statfs":{"total":200000000,"available":199295384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.77100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.747},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.71299999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.69699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7589999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.298,"5min":5.298,"15min":5.298},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.437}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.65700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3949999999999996,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.31}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.38}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.9340000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52700000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195200,"statfs":{"total":200000000,"available":199885752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:58.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:36:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.261+0000 7f751de54700 1 Processor -- start 2023-10-09T11:36:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.261+0000 7f751de54700 1 -- start start 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f751de54700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75181578d0 0x7f75180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f751de54700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f751815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f751de54700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180d07c0 con 0x7f751806d120 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f751de54700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180cfbb0 con 0x7f75181578d0 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f751de54700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cfe90 con 0x7f7518157ca0 2023-10-09T11:36:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f7517fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f751806d120 0x7f751815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48392/0 (socket says 172.21.15.6:48392) 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f7517fff700 1 -- 172.21.15.6:0/464353511 learned_addr learned my addr 172.21.15.6:0/464353511 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f75177fe700 1 --2- 172.21.15.6:0/464353511 >> v2:172.21.15.118:3300/0 conn(0x7f75181578d0 0x7f75180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.262+0000 7f7516ffd700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f751815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328323937 0 0) 0x7f75180d07c0 con 0x7f751806d120 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7500003570 con 0x7f751806d120 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1257214603 0 0) 0x7f7500003570 con 0x7f751806d120 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 msgr2=0x7f751815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f751815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 >> v2:172.21.15.118:3300/0 conn(0x7f75181578d0 msgr2=0x7f75180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 --2- 172.21.15.6:0/464353511 >> v2:172.21.15.118:3300/0 conn(0x7f75181578d0 0x7f75180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180d0170 con 0x7f751806d120 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f75100017f0 con 0x7f751806d120 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 >> v1:172.21.15.6:6789/0 conn(0x7f751806d120 legacy=0x7f751815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7500003a60 0x7f7500003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f7500004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500004d50 0x7f75000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cfbb0 con 0x7f7500004d50 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cfe90 con 0x7f7500003a60 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750000ba60 con 0x7f7518157ca0 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500004d50 0x7f75000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f75177fe700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7500003a60 0x7f7500003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7516ffd700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f7500004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 -- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 msgr2=0x7f7500004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7518157ca0 0x7f7500004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 -- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7500003a60 msgr2=0x7f7500003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7500003a60 0x7f7500003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.263+0000 7f7517fff700 1 -- 172.21.15.6:0/464353511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500003570 con 0x7f7500004d50 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f7517fff700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500004d50 0x7f75000051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f751000a970 tx=0x7f75180d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb220c690462059 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100070d0 con 0x7f7500004d50 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510007270 con 0x7f7500004d50 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f75167fc700 1 -- 172.21.15.6:0/464353511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510007630 con 0x7f7500004d50 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 -- 172.21.15.6:0/464353511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500004d50 msgr2=0x7f75000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 --2- 172.21.15.6:0/464353511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500004d50 0x7f75000051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f751000a970 tx=0x7f75180d0730 comp rx=0 tx=0).stop 2023-10-09T11:36:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f7517fff700 1 -- 172.21.15.6:0/464353511 reap_dead start 2023-10-09T11:36:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 -- 172.21.15.6:0/464353511 shutdown_connections 2023-10-09T11:36:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 -- 172.21.15.6:0/464353511 >> 172.21.15.6:0/464353511 conn(0x7f751806bb90 msgr2=0x7f751806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 -- 172.21.15.6:0/464353511 shutdown_connections 2023-10-09T11:36:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.264+0000 7f751de54700 1 -- 172.21.15.6:0/464353511 wait complete. 2023-10-09T11:36:58.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 Processor -- start 2023-10-09T11:36:58.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 -- start start 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7518153410 0x7f7518154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f751816a120 0x7f751816a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751816b320 con 0x7f75181537e0 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7518153f90 con 0x7f7518153410 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f751de54700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751816ab00 con 0x7f751816a120 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f7516ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.266+0000 7f7516ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36600/0 (socket says 172.21.15.6:36600) 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 -- 172.21.15.6:0/3726950764 learned_addr learned my addr 172.21.15.6:0/3726950764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f75177fe700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7518153410 0x7f7518154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7517fff700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f751816a120 0x7f751816a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 -- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f751816a120 msgr2=0x7f751816a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f751816a120 0x7f751816a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 -- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7518153410 msgr2=0x7f7518154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7518153410 0x7f7518154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 -- 172.21.15.6:0/3726950764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518155790 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f7516ffd700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f750c006ac0 tx=0x7f750c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00fa10 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00fb70 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7518155a70 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c014440 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.267+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751816b850 con 0x7f75181537e0 2023-10-09T11:36:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.268+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751816ba40 con 0x7f75181537e0 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.269+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f750c014870 con 0x7f75181537e0 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.269+0000 7f74ff7fe700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.269+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f750c018030 con 0x7f75181537e0 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.269+0000 7f75177fe700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.269+0000 7f75177fe700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7518156630 tx=0x7f7508008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.273+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f750c0522b0 con 0x7f75181537e0 2023-10-09T11:36:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.461+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75180d0450 con 0x7f7504066f30 2023-10-09T11:36:58.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.469+0000 7f74ff7fe700 1 -- 172.21.15.6:0/3726950764 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284339 (secure 0 0 0) 0x7f75180d0450 con 0x7f7504066f30 2023-10-09T11:36:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 msgr2=0x7f75040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7518156630 tx=0x7f7508008040 comp rx=0 tx=0).stop 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 msgr2=0x7f75181550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f750c006ac0 tx=0x7f750c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 shutdown_connections 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f751816a120 0x7f751816a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7518153410 0x7f7518154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 --2- 172.21.15.6:0/3726950764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75181537e0 0x7f75181550c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 >> 172.21.15.6:0/3726950764 conn(0x7f751806bb90 msgr2=0x7f75181568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 shutdown_connections 2023-10-09T11:36:58.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.472+0000 7f751de54700 1 -- 172.21.15.6:0/3726950764 wait complete. 2023-10-09T11:36:58.476 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:36:58.484 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-09T11:36:58.157448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560300,"statfs":{"total":1600000000,"available":1597747231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000994"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.996948+0000","last_change":"2023-10-09T11:36:53.996848+0000","last_active":"2023-10-09T11:36:53.996948+0000","last_peered":"2023-10-09T11:36:53.996948+0000","last_clean":"2023-10-09T11:36:53.996948+0000","last_became_active":"2023-10-09T11:36:53.996602+0000","last_became_peered":"2023-10-09T11:36:53.996602+0000","last_unstale":"2023-10-09T11:36:53.996948+0000","last_undegraded":"2023-10-09T11:36:53.996948+0000","last_fullsized":"2023-10-09T11:36:53.996948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:30.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.006527+0000","last_change":"2023-10-09T11:36:54.004982+0000","last_active":"2023-10-09T11:36:54.006527+0000","last_peered":"2023-10-09T11:36:54.006527+0000","last_clean":"2023-10-09T11:36:54.006527+0000","last_became_active":"2023-10-09T11:36:54.004787+0000","last_became_peered":"2023-10-09T11:36:54.004787+0000","last_unstale":"2023-10-09T11:36:54.006527+0000","last_undegraded":"2023-10-09T11:36:54.006527+0000","last_fullsized":"2023-10-09T11:36:54.006527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:35.442982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001138+0000","last_change":"2023-10-09T11:36:54.000952+0000","last_active":"2023-10-09T11:36:54.001138+0000","last_peered":"2023-10-09T11:36:54.001138+0000","last_clean":"2023-10-09T11:36:54.001138+0000","last_became_active":"2023-10-09T11:36:54.000413+0000","last_became_peered":"2023-10-09T11:36:54.000413+0000","last_unstale":"2023-10-09T11:36:54.001138+0000","last_undegraded":"2023-10-09T11:36:54.001138+0000","last_fullsized":"2023-10-09T11:36:54.001138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:22.672603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.003588+0000","last_change":"2023-10-09T11:36:54.003533+0000","last_active":"2023-10-09T11:36:54.003588+0000","last_peered":"2023-10-09T11:36:54.003588+0000","last_clean":"2023-10-09T11:36:54.003588+0000","last_became_active":"2023-10-09T11:36:54.003321+0000","last_became_peered":"2023-10-09T11:36:54.003321+0000","last_unstale":"2023-10-09T11:36:54.003588+0000","last_undegraded":"2023-10-09T11:36:54.003588+0000","last_fullsized":"2023-10-09T11:36:54.003588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:07.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.993021+0000","last_change":"2023-10-09T11:36:53.992954+0000","last_active":"2023-10-09T11:36:53.993021+0000","last_peered":"2023-10-09T11:36:53.993021+0000","last_clean":"2023-10-09T11:36:53.993021+0000","last_became_active":"2023-10-09T11:36:53.992698+0000","last_became_peered":"2023-10-09T11:36:53.992698+0000","last_unstale":"2023-10-09T11:36:53.993021+0000","last_undegraded":"2023-10-09T11:36:53.993021+0000","last_fullsized":"2023-10-09T11:36:53.993021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:29.720391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999580+0000","last_change":"2023-10-09T11:36:53.996804+0000","last_active":"2023-10-09T11:36:53.999580+0000","last_peered":"2023-10-09T11:36:53.999580+0000","last_clean":"2023-10-09T11:36:53.999580+0000","last_became_active":"2023-10-09T11:36:53.996560+0000","last_became_peered":"2023-10-09T11:36:53.996560+0000","last_unstale":"2023-10-09T11:36:53.999580+0000","last_undegraded":"2023-10-09T11:36:53.999580+0000","last_fullsized":"2023-10-09T11:36:53.999580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:38.723563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999980+0000","last_change":"2023-10-09T11:36:53.999908+0000","last_active":"2023-10-09T11:36:53.999980+0000","last_peered":"2023-10-09T11:36:53.999980+0000","last_clean":"2023-10-09T11:36:53.999980+0000","last_became_active":"2023-10-09T11:36:53.999119+0000","last_became_peered":"2023-10-09T11:36:53.999119+0000","last_unstale":"2023-10-09T11:36:53.999980+0000","last_undegraded":"2023-10-09T11:36:53.999980+0000","last_fullsized":"2023-10-09T11:36:53.999980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:01.590710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000191+0000","last_change":"2023-10-09T11:36:54.000072+0000","last_active":"2023-10-09T11:36:54.000191+0000","last_peered":"2023-10-09T11:36:54.000191+0000","last_clean":"2023-10-09T11:36:54.000191+0000","last_became_active":"2023-10-09T11:36:53.999429+0000","last_became_peered":"2023-10-09T11:36:53.999429+0000","last_unstale":"2023-10-09T11:36:54.000191+0000","last_undegraded":"2023-10-09T11:36:54.000191+0000","last_fullsized":"2023-10-09T11:36:54.000191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:47.089560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001136+0000","last_change":"2023-10-09T11:36:53.999987+0000","last_active":"2023-10-09T11:36:54.001136+0000","last_peered":"2023-10-09T11:36:54.001136+0000","last_clean":"2023-10-09T11:36:54.001136+0000","last_became_active":"2023-10-09T11:36:53.999743+0000","last_became_peered":"2023-10-09T11:36:53.999743+0000","last_unstale":"2023-10-09T11:36:54.001136+0000","last_undegraded":"2023-10-09T11:36:54.001136+0000","last_fullsized":"2023-10-09T11:36:54.001136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:30.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.004273+0000","last_change":"2023-10-09T11:36:54.004187+0000","last_active":"2023-10-09T11:36:54.004273+0000","last_peered":"2023-10-09T11:36:54.004273+0000","last_clean":"2023-10-09T11:36:54.004273+0000","last_became_active":"2023-10-09T11:36:54.003867+0000","last_became_peered":"2023-10-09T11:36:54.003867+0000","last_unstale":"2023-10-09T11:36:54.004273+0000","last_undegraded":"2023-10-09T11:36:54.004273+0000","last_fullsized":"2023-10-09T11:36:54.004273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:42.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000163+0000","last_change":"2023-10-09T11:36:54.000051+0000","last_active":"2023-10-09T11:36:54.000163+0000","last_peered":"2023-10-09T11:36:54.000163+0000","last_clean":"2023-10-09T11:36:54.000163+0000","last_became_active":"2023-10-09T11:36:53.999811+0000","last_became_peered":"2023-10-09T11:36:53.999811+0000","last_unstale":"2023-10-09T11:36:54.000163+0000","last_undegraded":"2023-10-09T11:36:54.000163+0000","last_fullsized":"2023-10-09T11:36:54.000163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:30.575001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002192+0000","last_change":"2023-10-09T11:36:54.001980+0000","last_active":"2023-10-09T11:36:54.002192+0000","last_peered":"2023-10-09T11:36:54.002192+0000","last_clean":"2023-10-09T11:36:54.002192+0000","last_became_active":"2023-10-09T11:36:54.001310+0000","last_became_peered":"2023-10-09T11:36:54.001310+0000","last_unstale":"2023-10-09T11:36:54.002192+0000","last_undegraded":"2023-10-09T11:36:54.002192+0000","last_fullsized":"2023-10-09T11:36:54.002192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:01.590710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000151+0000","last_change":"2023-10-09T11:36:54.000043+0000","last_active":"2023-10-09T11:36:54.000151+0000","last_peered":"2023-10-09T11:36:54.000151+0000","last_clean":"2023-10-09T11:36:54.000151+0000","last_became_active":"2023-10-09T11:36:53.999731+0000","last_became_peered":"2023-10-09T11:36:53.999731+0000","last_unstale":"2023-10-09T11:36:54.000151+0000","last_undegraded":"2023-10-09T11:36:54.000151+0000","last_fullsized":"2023-10-09T11:36:54.000151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:40.076977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.006666+0000","last_change":"2023-10-09T11:36:54.006242+0000","last_active":"2023-10-09T11:36:54.006666+0000","last_peered":"2023-10-09T11:36:54.006666+0000","last_clean":"2023-10-09T11:36:54.006666+0000","last_became_active":"2023-10-09T11:36:54.005946+0000","last_became_peered":"2023-10-09T11:36:54.005946+0000","last_unstale":"2023-10-09T11:36:54.006666+0000","last_undegraded":"2023-10-09T11:36:54.006666+0000","last_fullsized":"2023-10-09T11:36:54.006666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:00.991625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.995634+0000","last_change":"2023-10-09T11:36:53.995536+0000","last_active":"2023-10-09T11:36:53.995634+0000","last_peered":"2023-10-09T11:36:53.995634+0000","last_clean":"2023-10-09T11:36:53.995634+0000","last_became_active":"2023-10-09T11:36:53.995140+0000","last_became_peered":"2023-10-09T11:36:53.995140+0000","last_unstale":"2023-10-09T11:36:53.995634+0000","last_undegraded":"2023-10-09T11:36:53.995634+0000","last_fullsized":"2023-10-09T11:36:53.995634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:38.346962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.004254+0000","last_change":"2023-10-09T11:36:54.004210+0000","last_active":"2023-10-09T11:36:54.004254+0000","last_peered":"2023-10-09T11:36:54.004254+0000","last_clean":"2023-10-09T11:36:54.004254+0000","last_became_active":"2023-10-09T11:36:54.003997+0000","last_became_peered":"2023-10-09T11:36:54.003997+0000","last_unstale":"2023-10-09T11:36:54.004254+0000","last_undegraded":"2023-10-09T11:36:54.004254+0000","last_fullsized":"2023-10-09T11:36:54.004254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:22.672603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000280+0000","last_change":"2023-10-09T11:36:54.000237+0000","last_active":"2023-10-09T11:36:54.000280+0000","last_peered":"2023-10-09T11:36:54.000280+0000","last_clean":"2023-10-09T11:36:54.000280+0000","last_became_active":"2023-10-09T11:36:53.999349+0000","last_became_peered":"2023-10-09T11:36:53.999349+0000","last_unstale":"2023-10-09T11:36:54.000280+0000","last_undegraded":"2023-10-09T11:36:54.000280+0000","last_fullsized":"2023-10-09T11:36:54.000280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:42.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002700+0000","last_change":"2023-10-09T11:36:54.002632+0000","last_active":"2023-10-09T11:36:54.002700+0000","last_peered":"2023-10-09T11:36:54.002700+0000","last_clean":"2023-10-09T11:36:54.002700+0000","last_became_active":"2023-10-09T11:36:54.002423+0000","last_became_peered":"2023-10-09T11:36:54.002423+0000","last_unstale":"2023-10-09T11:36:54.002700+0000","last_undegraded":"2023-10-09T11:36:54.002700+0000","last_fullsized":"2023-10-09T11:36:54.002700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:19.225353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002333+0000","last_change":"2023-10-09T11:36:54.002253+0000","last_active":"2023-10-09T11:36:54.002333+0000","last_peered":"2023-10-09T11:36:54.002333+0000","last_clean":"2023-10-09T11:36:54.002333+0000","last_became_active":"2023-10-09T11:36:54.001459+0000","last_became_peered":"2023-10-09T11:36:54.001459+0000","last_unstale":"2023-10-09T11:36:54.002333+0000","last_undegraded":"2023-10-09T11:36:54.002333+0000","last_fullsized":"2023-10-09T11:36:54.002333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:45.813616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.995352+0000","last_change":"2023-10-09T11:36:53.995278+0000","last_active":"2023-10-09T11:36:53.995352+0000","last_peered":"2023-10-09T11:36:53.995352+0000","last_clean":"2023-10-09T11:36:53.995352+0000","last_became_active":"2023-10-09T11:36:53.994628+0000","last_became_peered":"2023-10-09T11:36:53.994628+0000","last_unstale":"2023-10-09T11:36:53.995352+0000","last_undegraded":"2023-10-09T11:36:53.995352+0000","last_fullsized":"2023-10-09T11:36:53.995352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:55.787071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.993515+0000","last_change":"2023-10-09T11:36:53.993383+0000","last_active":"2023-10-09T11:36:53.993515+0000","last_peered":"2023-10-09T11:36:53.993515+0000","last_clean":"2023-10-09T11:36:53.993515+0000","last_became_active":"2023-10-09T11:36:53.993164+0000","last_became_peered":"2023-10-09T11:36:53.993164+0000","last_unstale":"2023-10-09T11:36:53.993515+0000","last_undegraded":"2023-10-09T11:36:53.993515+0000","last_fullsized":"2023-10-09T11:36:53.993515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.358404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002565+0000","last_change":"2023-10-09T11:36:54.002502+0000","last_active":"2023-10-09T11:36:54.002565+0000","last_peered":"2023-10-09T11:36:54.002565+0000","last_clean":"2023-10-09T11:36:54.002565+0000","last_became_active":"2023-10-09T11:36:54.002282+0000","last_became_peered":"2023-10-09T11:36:54.002282+0000","last_unstale":"2023-10-09T11:36:54.002565+0000","last_undegraded":"2023-10-09T11:36:54.002565+0000","last_fullsized":"2023-10-09T11:36:54.002565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:09.011707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999446+0000","last_change":"2023-10-09T11:36:53.999375+0000","last_active":"2023-10-09T11:36:53.999446+0000","last_peered":"2023-10-09T11:36:53.999446+0000","last_clean":"2023-10-09T11:36:53.999446+0000","last_became_active":"2023-10-09T11:36:53.999159+0000","last_became_peered":"2023-10-09T11:36:53.999159+0000","last_unstale":"2023-10-09T11:36:53.999446+0000","last_undegraded":"2023-10-09T11:36:53.999446+0000","last_fullsized":"2023-10-09T11:36:53.999446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:11.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.998116+0000","last_change":"2023-10-09T11:36:53.998020+0000","last_active":"2023-10-09T11:36:53.998116+0000","last_peered":"2023-10-09T11:36:53.998116+0000","last_clean":"2023-10-09T11:36:53.998116+0000","last_became_active":"2023-10-09T11:36:53.997645+0000","last_became_peered":"2023-10-09T11:36:53.997645+0000","last_unstale":"2023-10-09T11:36:53.998116+0000","last_undegraded":"2023-10-09T11:36:53.998116+0000","last_fullsized":"2023-10-09T11:36:53.998116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.289644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000620+0000","last_change":"2023-10-09T11:36:53.999943+0000","last_active":"2023-10-09T11:36:54.000620+0000","last_peered":"2023-10-09T11:36:54.000620+0000","last_clean":"2023-10-09T11:36:54.000620+0000","last_became_active":"2023-10-09T11:36:53.999714+0000","last_became_peered":"2023-10-09T11:36:53.999714+0000","last_unstale":"2023-10-09T11:36:54.000620+0000","last_undegraded":"2023-10-09T11:36:54.000620+0000","last_fullsized":"2023-10-09T11:36:54.000620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:29.251039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001632+0000","last_change":"2023-10-09T11:36:54.001542+0000","last_active":"2023-10-09T11:36:54.001632+0000","last_peered":"2023-10-09T11:36:54.001632+0000","last_clean":"2023-10-09T11:36:54.001632+0000","last_became_active":"2023-10-09T11:36:54.001186+0000","last_became_peered":"2023-10-09T11:36:54.001186+0000","last_unstale":"2023-10-09T11:36:54.001632+0000","last_undegraded":"2023-10-09T11:36:54.001632+0000","last_fullsized":"2023-10-09T11:36:54.001632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:51:22.672603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001899+0000","last_change":"2023-10-09T11:36:54.001842+0000","last_active":"2023-10-09T11:36:54.001899+0000","last_peered":"2023-10-09T11:36:54.001899+0000","last_clean":"2023-10-09T11:36:54.001899+0000","last_became_active":"2023-10-09T11:36:54.001612+0000","last_became_peered":"2023-10-09T11:36:54.001612+0000","last_unstale":"2023-10-09T11:36:54.001899+0000","last_undegraded":"2023-10-09T11:36:54.001899+0000","last_fullsized":"2023-10-09T11:36:54.001899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:26.321681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.995265+0000","last_change":"2023-10-09T11:36:53.995179+0000","last_active":"2023-10-09T11:36:53.995265+0000","last_peered":"2023-10-09T11:36:53.995265+0000","last_clean":"2023-10-09T11:36:53.995265+0000","last_became_active":"2023-10-09T11:36:53.994936+0000","last_became_peered":"2023-10-09T11:36:53.994936+0000","last_unstale":"2023-10-09T11:36:53.995265+0000","last_undegraded":"2023-10-09T11:36:53.995265+0000","last_fullsized":"2023-10-09T11:36:53.995265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:38.723563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.003094+0000","last_change":"2023-10-09T11:36:54.002999+0000","last_active":"2023-10-09T11:36:54.003094+0000","last_peered":"2023-10-09T11:36:54.003094+0000","last_clean":"2023-10-09T11:36:54.003094+0000","last_became_active":"2023-10-09T11:36:54.002768+0000","last_became_peered":"2023-10-09T11:36:54.002768+0000","last_unstale":"2023-10-09T11:36:54.003094+0000","last_undegraded":"2023-10-09T11:36:54.003094+0000","last_fullsized":"2023-10-09T11:36:54.003094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:07.913325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000593+0000","last_change":"2023-10-09T11:36:54.000502+0000","last_active":"2023-10-09T11:36:54.000593+0000","last_peered":"2023-10-09T11:36:54.000593+0000","last_clean":"2023-10-09T11:36:54.000593+0000","last_became_active":"2023-10-09T11:36:53.999145+0000","last_became_peered":"2023-10-09T11:36:53.999145+0000","last_unstale":"2023-10-09T11:36:54.000593+0000","last_undegraded":"2023-10-09T11:36:54.000593+0000","last_fullsized":"2023-10-09T11:36:54.000593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:38.723563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.996442+0000","last_change":"2023-10-09T11:36:53.996368+0000","last_active":"2023-10-09T11:36:53.996442+0000","last_peered":"2023-10-09T11:36:53.996442+0000","last_clean":"2023-10-09T11:36:53.996442+0000","last_became_active":"2023-10-09T11:36:53.996143+0000","last_became_peered":"2023-10-09T11:36:53.996143+0000","last_unstale":"2023-10-09T11:36:53.996442+0000","last_undegraded":"2023-10-09T11:36:53.996442+0000","last_fullsized":"2023-10-09T11:36:53.996442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:24.173615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000578+0000","last_change":"2023-10-09T11:36:54.000387+0000","last_active":"2023-10-09T11:36:54.000578+0000","last_peered":"2023-10-09T11:36:54.000578+0000","last_clean":"2023-10-09T11:36:54.000578+0000","last_became_active":"2023-10-09T11:36:53.999672+0000","last_became_peered":"2023-10-09T11:36:53.999672+0000","last_unstale":"2023-10-09T11:36:54.000578+0000","last_undegraded":"2023-10-09T11:36:54.000578+0000","last_fullsized":"2023-10-09T11:36:54.000578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:09.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.998680+0000","last_change":"2023-10-09T11:36:53.998582+0000","last_active":"2023-10-09T11:36:53.998680+0000","last_peered":"2023-10-09T11:36:53.998680+0000","last_clean":"2023-10-09T11:36:53.998680+0000","last_became_active":"2023-10-09T11:36:53.998355+0000","last_became_peered":"2023-10-09T11:36:53.998355+0000","last_unstale":"2023-10-09T11:36:53.998680+0000","last_undegraded":"2023-10-09T11:36:53.998680+0000","last_fullsized":"2023-10-09T11:36:53.998680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:24.173615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.009047+0000","last_change":"2023-10-09T11:36:52.974767+0000","last_active":"2023-10-09T11:36:54.009047+0000","last_peered":"2023-10-09T11:36:54.009047+0000","last_clean":"2023-10-09T11:36:54.009047+0000","last_became_active":"2023-10-09T11:36:52.974550+0000","last_became_peered":"2023-10-09T11:36:52.974550+0000","last_unstale":"2023-10-09T11:36:54.009047+0000","last_undegraded":"2023-10-09T11:36:54.009047+0000","last_fullsized":"2023-10-09T11:36:54.009047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:23.117169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002438+0000","last_change":"2023-10-09T11:36:54.002190+0000","last_active":"2023-10-09T11:36:54.002438+0000","last_peered":"2023-10-09T11:36:54.002438+0000","last_clean":"2023-10-09T11:36:54.002438+0000","last_became_active":"2023-10-09T11:36:54.001925+0000","last_became_peered":"2023-10-09T11:36:54.001925+0000","last_unstale":"2023-10-09T11:36:54.002438+0000","last_undegraded":"2023-10-09T11:36:54.002438+0000","last_fullsized":"2023-10-09T11:36:54.002438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:52.626147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.007875+0000","last_change":"2023-10-09T11:36:52.979848+0000","last_active":"2023-10-09T11:36:54.007875+0000","last_peered":"2023-10-09T11:36:54.007875+0000","last_clean":"2023-10-09T11:36:54.007875+0000","last_became_active":"2023-10-09T11:36:52.979673+0000","last_became_peered":"2023-10-09T11:36:52.979673+0000","last_unstale":"2023-10-09T11:36:54.007875+0000","last_undegraded":"2023-10-09T11:36:54.007875+0000","last_fullsized":"2023-10-09T11:36:54.007875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002369+0000","last_change":"2023-10-09T11:36:54.001805+0000","last_active":"2023-10-09T11:36:54.002369+0000","last_peered":"2023-10-09T11:36:54.002369+0000","last_clean":"2023-10-09T11:36:54.002369+0000","last_became_active":"2023-10-09T11:36:54.001568+0000","last_became_peered":"2023-10-09T11:36:54.001568+0000","last_unstale":"2023-10-09T11:36:54.002369+0000","last_undegraded":"2023-10-09T11:36:54.002369+0000","last_fullsized":"2023-10-09T11:36:54.002369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:40.325537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.007652+0000","last_change":"2023-10-09T11:36:52.978920+0000","last_active":"2023-10-09T11:36:54.007652+0000","last_peered":"2023-10-09T11:36:54.007652+0000","last_clean":"2023-10-09T11:36:54.007652+0000","last_became_active":"2023-10-09T11:36:52.978662+0000","last_became_peered":"2023-10-09T11:36:52.978662+0000","last_unstale":"2023-10-09T11:36:54.007652+0000","last_undegraded":"2023-10-09T11:36:54.007652+0000","last_fullsized":"2023-10-09T11:36:54.007652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:29.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001870+0000","last_change":"2023-10-09T11:36:54.001809+0000","last_active":"2023-10-09T11:36:54.001870+0000","last_peered":"2023-10-09T11:36:54.001870+0000","last_clean":"2023-10-09T11:36:54.001870+0000","last_became_active":"2023-10-09T11:36:54.001560+0000","last_became_peered":"2023-10-09T11:36:54.001560+0000","last_unstale":"2023-10-09T11:36:54.001870+0000","last_undegraded":"2023-10-09T11:36:54.001870+0000","last_fullsized":"2023-10-09T11:36:54.001870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:55:00.487586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.008995+0000","last_change":"2023-10-09T11:36:52.980172+0000","last_active":"2023-10-09T11:36:54.008995+0000","last_peered":"2023-10-09T11:36:54.008995+0000","last_clean":"2023-10-09T11:36:54.008995+0000","last_became_active":"2023-10-09T11:36:52.979968+0000","last_became_peered":"2023-10-09T11:36:52.979968+0000","last_unstale":"2023-10-09T11:36:54.008995+0000","last_undegraded":"2023-10-09T11:36:54.008995+0000","last_fullsized":"2023-10-09T11:36:54.008995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:33.160024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002879+0000","last_change":"2023-10-09T11:36:54.002701+0000","last_active":"2023-10-09T11:36:54.002879+0000","last_peered":"2023-10-09T11:36:54.002879+0000","last_clean":"2023-10-09T11:36:54.002879+0000","last_became_active":"2023-10-09T11:36:54.002383+0000","last_became_peered":"2023-10-09T11:36:54.002383+0000","last_unstale":"2023-10-09T11:36:54.002879+0000","last_undegraded":"2023-10-09T11:36:54.002879+0000","last_fullsized":"2023-10-09T11:36:54.002879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:38.346962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.008483+0000","last_change":"2023-10-09T11:36:52.981472+0000","last_active":"2023-10-09T11:36:54.008483+0000","last_peered":"2023-10-09T11:36:54.008483+0000","last_clean":"2023-10-09T11:36:54.008483+0000","last_became_active":"2023-10-09T11:36:52.980906+0000","last_became_peered":"2023-10-09T11:36:52.980906+0000","last_unstale":"2023-10-09T11:36:54.008483+0000","last_undegraded":"2023-10-09T11:36:54.008483+0000","last_fullsized":"2023-10-09T11:36:54.008483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:48.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.994312+0000","last_change":"2023-10-09T11:36:53.994249+0000","last_active":"2023-10-09T11:36:53.994312+0000","last_peered":"2023-10-09T11:36:53.994312+0000","last_clean":"2023-10-09T11:36:53.994312+0000","last_became_active":"2023-10-09T11:36:53.994013+0000","last_became_peered":"2023-10-09T11:36:53.994013+0000","last_unstale":"2023-10-09T11:36:53.994312+0000","last_undegraded":"2023-10-09T11:36:53.994312+0000","last_fullsized":"2023-10-09T11:36:53.994312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:19.225353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.007166+0000","last_change":"2023-10-09T11:36:52.979226+0000","last_active":"2023-10-09T11:36:54.007166+0000","last_peered":"2023-10-09T11:36:54.007166+0000","last_clean":"2023-10-09T11:36:54.007166+0000","last_became_active":"2023-10-09T11:36:52.978984+0000","last_became_peered":"2023-10-09T11:36:52.978984+0000","last_unstale":"2023-10-09T11:36:54.007166+0000","last_undegraded":"2023-10-09T11:36:54.007166+0000","last_fullsized":"2023-10-09T11:36:54.007166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:24.301960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001096+0000","last_change":"2023-10-09T11:36:53.996632+0000","last_active":"2023-10-09T11:36:54.001096+0000","last_peered":"2023-10-09T11:36:54.001096+0000","last_clean":"2023-10-09T11:36:54.001096+0000","last_became_active":"2023-10-09T11:36:53.995905+0000","last_became_peered":"2023-10-09T11:36:53.995905+0000","last_unstale":"2023-10-09T11:36:54.001096+0000","last_undegraded":"2023-10-09T11:36:54.001096+0000","last_fullsized":"2023-10-09T11:36:54.001096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:11.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.992039+0000","last_change":"2023-10-09T11:36:52.982497+0000","last_active":"2023-10-09T11:36:53.992039+0000","last_peered":"2023-10-09T11:36:53.992039+0000","last_clean":"2023-10-09T11:36:53.992039+0000","last_became_active":"2023-10-09T11:36:52.980583+0000","last_became_peered":"2023-10-09T11:36:52.980583+0000","last_unstale":"2023-10-09T11:36:53.992039+0000","last_undegraded":"2023-10-09T11:36:53.992039+0000","last_fullsized":"2023-10-09T11:36:53.992039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:51.624277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999546+0000","last_change":"2023-10-09T11:36:53.999372+0000","last_active":"2023-10-09T11:36:53.999546+0000","last_peered":"2023-10-09T11:36:53.999546+0000","last_clean":"2023-10-09T11:36:53.999546+0000","last_became_active":"2023-10-09T11:36:53.998942+0000","last_became_peered":"2023-10-09T11:36:53.998942+0000","last_unstale":"2023-10-09T11:36:53.999546+0000","last_undegraded":"2023-10-09T11:36:53.999546+0000","last_fullsized":"2023-10-09T11:36:53.999546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:14.874325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.990874+0000","last_change":"2023-10-09T11:36:52.978007+0000","last_active":"2023-10-09T11:36:53.990874+0000","last_peered":"2023-10-09T11:36:53.990874+0000","last_clean":"2023-10-09T11:36:53.990874+0000","last_became_active":"2023-10-09T11:36:52.977026+0000","last_became_peered":"2023-10-09T11:36:52.977026+0000","last_unstale":"2023-10-09T11:36:53.990874+0000","last_undegraded":"2023-10-09T11:36:53.990874+0000","last_fullsized":"2023-10-09T11:36:53.990874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:55.409539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002208+0000","last_change":"2023-10-09T11:36:54.002114+0000","last_active":"2023-10-09T11:36:54.002208+0000","last_peered":"2023-10-09T11:36:54.002208+0000","last_clean":"2023-10-09T11:36:54.002208+0000","last_became_active":"2023-10-09T11:36:54.001600+0000","last_became_peered":"2023-10-09T11:36:54.001600+0000","last_unstale":"2023-10-09T11:36:54.002208+0000","last_undegraded":"2023-10-09T11:36:54.002208+0000","last_fullsized":"2023-10-09T11:36:54.002208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:00:16.402442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.991681+0000","last_change":"2023-10-09T11:36:52.981816+0000","last_active":"2023-10-09T11:36:53.991681+0000","last_peered":"2023-10-09T11:36:53.991681+0000","last_clean":"2023-10-09T11:36:53.991681+0000","last_became_active":"2023-10-09T11:36:52.981578+0000","last_became_peered":"2023-10-09T11:36:52.981578+0000","last_unstale":"2023-10-09T11:36:53.991681+0000","last_undegraded":"2023-10-09T11:36:53.991681+0000","last_fullsized":"2023-10-09T11:36:53.991681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:23.171745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001616+0000","last_change":"2023-10-09T11:36:54.001405+0000","last_active":"2023-10-09T11:36:54.001616+0000","last_peered":"2023-10-09T11:36:54.001616+0000","last_clean":"2023-10-09T11:36:54.001616+0000","last_became_active":"2023-10-09T11:36:54.000424+0000","last_became_peered":"2023-10-09T11:36:54.000424+0000","last_unstale":"2023-10-09T11:36:54.001616+0000","last_undegraded":"2023-10-09T11:36:54.001616+0000","last_fullsized":"2023-10-09T11:36:54.001616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:38.346962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.988026+0000","last_change":"2023-10-09T11:36:52.980903+0000","last_active":"2023-10-09T11:36:53.988026+0000","last_peered":"2023-10-09T11:36:53.988026+0000","last_clean":"2023-10-09T11:36:53.988026+0000","last_became_active":"2023-10-09T11:36:52.980718+0000","last_became_peered":"2023-10-09T11:36:52.980718+0000","last_unstale":"2023-10-09T11:36:53.988026+0000","last_undegraded":"2023-10-09T11:36:53.988026+0000","last_fullsized":"2023-10-09T11:36:53.988026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:12.658888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002638+0000","last_change":"2023-10-09T11:36:54.002579+0000","last_active":"2023-10-09T11:36:54.002638+0000","last_peered":"2023-10-09T11:36:54.002638+0000","last_clean":"2023-10-09T11:36:54.002638+0000","last_became_active":"2023-10-09T11:36:54.002019+0000","last_became_peered":"2023-10-09T11:36:54.002019+0000","last_unstale":"2023-10-09T11:36:54.002638+0000","last_undegraded":"2023-10-09T11:36:54.002638+0000","last_fullsized":"2023-10-09T11:36:54.002638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:47.089560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.009264+0000","last_change":"2023-10-09T11:36:52.979789+0000","last_active":"2023-10-09T11:36:54.009264+0000","last_peered":"2023-10-09T11:36:54.009264+0000","last_clean":"2023-10-09T11:36:54.009264+0000","last_became_active":"2023-10-09T11:36:52.979583+0000","last_became_peered":"2023-10-09T11:36:52.979583+0000","last_unstale":"2023-10-09T11:36:54.009264+0000","last_undegraded":"2023-10-09T11:36:54.009264+0000","last_fullsized":"2023-10-09T11:36:54.009264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:29.128414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001153+0000","last_change":"2023-10-09T11:36:54.001082+0000","last_active":"2023-10-09T11:36:54.001153+0000","last_peered":"2023-10-09T11:36:54.001153+0000","last_clean":"2023-10-09T11:36:54.001153+0000","last_became_active":"2023-10-09T11:36:54.000739+0000","last_became_peered":"2023-10-09T11:36:54.000739+0000","last_unstale":"2023-10-09T11:36:54.001153+0000","last_undegraded":"2023-10-09T11:36:54.001153+0000","last_fullsized":"2023-10-09T11:36:54.001153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:53:09.878422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.011596+0000","last_change":"2023-10-09T11:36:52.982677+0000","last_active":"2023-10-09T11:36:54.011596+0000","last_peered":"2023-10-09T11:36:54.011596+0000","last_clean":"2023-10-09T11:36:54.011596+0000","last_became_active":"2023-10-09T11:36:52.980843+0000","last_became_peered":"2023-10-09T11:36:52.980843+0000","last_unstale":"2023-10-09T11:36:54.011596+0000","last_undegraded":"2023-10-09T11:36:54.011596+0000","last_fullsized":"2023-10-09T11:36:54.011596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.356534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999292+0000","last_change":"2023-10-09T11:36:53.999240+0000","last_active":"2023-10-09T11:36:53.999292+0000","last_peered":"2023-10-09T11:36:53.999292+0000","last_clean":"2023-10-09T11:36:53.999292+0000","last_became_active":"2023-10-09T11:36:53.998978+0000","last_became_peered":"2023-10-09T11:36:53.998978+0000","last_unstale":"2023-10-09T11:36:53.999292+0000","last_undegraded":"2023-10-09T11:36:53.999292+0000","last_fullsized":"2023-10-09T11:36:53.999292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.289644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.008332+0000","last_change":"2023-10-09T11:36:52.977866+0000","last_active":"2023-10-09T11:36:54.008332+0000","last_peered":"2023-10-09T11:36:54.008332+0000","last_clean":"2023-10-09T11:36:54.008332+0000","last_became_active":"2023-10-09T11:36:52.976717+0000","last_became_peered":"2023-10-09T11:36:52.976717+0000","last_unstale":"2023-10-09T11:36:54.008332+0000","last_undegraded":"2023-10-09T11:36:54.008332+0000","last_fullsized":"2023-10-09T11:36:54.008332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:23.117169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999562+0000","last_change":"2023-10-09T11:36:53.996358+0000","last_active":"2023-10-09T11:36:53.999562+0000","last_peered":"2023-10-09T11:36:53.999562+0000","last_clean":"2023-10-09T11:36:53.999562+0000","last_became_active":"2023-10-09T11:36:53.996055+0000","last_became_peered":"2023-10-09T11:36:53.996055+0000","last_unstale":"2023-10-09T11:36:53.999562+0000","last_undegraded":"2023-10-09T11:36:53.999562+0000","last_fullsized":"2023-10-09T11:36:53.999562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:01.590710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.998746+0000","last_change":"2023-10-09T11:36:52.975933+0000","last_active":"2023-10-09T11:36:53.998746+0000","last_peered":"2023-10-09T11:36:53.998746+0000","last_clean":"2023-10-09T11:36:53.998746+0000","last_became_active":"2023-10-09T11:36:52.975700+0000","last_became_peered":"2023-10-09T11:36:52.975700+0000","last_unstale":"2023-10-09T11:36:53.998746+0000","last_undegraded":"2023-10-09T11:36:53.998746+0000","last_fullsized":"2023-10-09T11:36:53.998746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:22.378913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002614+0000","last_change":"2023-10-09T11:36:54.002568+0000","last_active":"2023-10-09T11:36:54.002614+0000","last_peered":"2023-10-09T11:36:54.002614+0000","last_clean":"2023-10-09T11:36:54.002614+0000","last_became_active":"2023-10-09T11:36:54.002087+0000","last_became_peered":"2023-10-09T11:36:54.002087+0000","last_unstale":"2023-10-09T11:36:54.002614+0000","last_undegraded":"2023-10-09T11:36:54.002614+0000","last_fullsized":"2023-10-09T11:36:54.002614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:35.442982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.997976+0000","last_change":"2023-10-09T11:36:52.982950+0000","last_active":"2023-10-09T11:36:53.997976+0000","last_peered":"2023-10-09T11:36:53.997976+0000","last_clean":"2023-10-09T11:36:53.997976+0000","last_became_active":"2023-10-09T11:36:52.981713+0000","last_became_peered":"2023-10-09T11:36:52.981713+0000","last_unstale":"2023-10-09T11:36:53.997976+0000","last_undegraded":"2023-10-09T11:36:53.997976+0000","last_fullsized":"2023-10-09T11:36:53.997976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.009837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.996992+0000","last_change":"2023-10-09T11:36:53.996938+0000","last_active":"2023-10-09T11:36:53.996992+0000","last_peered":"2023-10-09T11:36:53.996992+0000","last_clean":"2023-10-09T11:36:53.996992+0000","last_became_active":"2023-10-09T11:36:53.996705+0000","last_became_peered":"2023-10-09T11:36:53.996705+0000","last_unstale":"2023-10-09T11:36:53.996992+0000","last_undegraded":"2023-10-09T11:36:53.996992+0000","last_fullsized":"2023-10-09T11:36:53.996992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:52.912811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.011991+0000","last_change":"2023-10-09T11:36:52.983532+0000","last_active":"2023-10-09T11:36:54.011991+0000","last_peered":"2023-10-09T11:36:54.011991+0000","last_clean":"2023-10-09T11:36:54.011991+0000","last_became_active":"2023-10-09T11:36:52.982791+0000","last_became_peered":"2023-10-09T11:36:52.982791+0000","last_unstale":"2023-10-09T11:36:54.011991+0000","last_undegraded":"2023-10-09T11:36:54.011991+0000","last_fullsized":"2023-10-09T11:36:54.011991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:51.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.994018+0000","last_change":"2023-10-09T11:36:53.993905+0000","last_active":"2023-10-09T11:36:53.994018+0000","last_peered":"2023-10-09T11:36:53.994018+0000","last_clean":"2023-10-09T11:36:53.994018+0000","last_became_active":"2023-10-09T11:36:53.993682+0000","last_became_peered":"2023-10-09T11:36:53.993682+0000","last_unstale":"2023-10-09T11:36:53.994018+0000","last_undegraded":"2023-10-09T11:36:53.994018+0000","last_fullsized":"2023-10-09T11:36:53.994018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:52.912811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.009527+0000","last_change":"2023-10-09T11:36:52.982746+0000","last_active":"2023-10-09T11:36:54.009527+0000","last_peered":"2023-10-09T11:36:54.009527+0000","last_clean":"2023-10-09T11:36:54.009527+0000","last_became_active":"2023-10-09T11:36:52.982494+0000","last_became_peered":"2023-10-09T11:36:52.982494+0000","last_unstale":"2023-10-09T11:36:54.009527+0000","last_undegraded":"2023-10-09T11:36:54.009527+0000","last_fullsized":"2023-10-09T11:36:54.009527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:15.103301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.992563+0000","last_change":"2023-10-09T11:36:53.992342+0000","last_active":"2023-10-09T11:36:53.992563+0000","last_peered":"2023-10-09T11:36:53.992563+0000","last_clean":"2023-10-09T11:36:53.992563+0000","last_became_active":"2023-10-09T11:36:53.992082+0000","last_became_peered":"2023-10-09T11:36:53.992082+0000","last_unstale":"2023-10-09T11:36:53.992563+0000","last_undegraded":"2023-10-09T11:36:53.992563+0000","last_fullsized":"2023-10-09T11:36:53.992563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:42.308194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.008156+0000","last_change":"2023-10-09T11:36:52.977383+0000","last_active":"2023-10-09T11:36:54.008156+0000","last_peered":"2023-10-09T11:36:54.008156+0000","last_clean":"2023-10-09T11:36:54.008156+0000","last_became_active":"2023-10-09T11:36:52.975186+0000","last_became_peered":"2023-10-09T11:36:52.975186+0000","last_unstale":"2023-10-09T11:36:54.008156+0000","last_undegraded":"2023-10-09T11:36:54.008156+0000","last_fullsized":"2023-10-09T11:36:54.008156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:16:28.718521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999935+0000","last_change":"2023-10-09T11:36:53.999846+0000","last_active":"2023-10-09T11:36:53.999935+0000","last_peered":"2023-10-09T11:36:53.999935+0000","last_clean":"2023-10-09T11:36:53.999935+0000","last_became_active":"2023-10-09T11:36:53.998552+0000","last_became_peered":"2023-10-09T11:36:53.998552+0000","last_unstale":"2023-10-09T11:36:53.999935+0000","last_undegraded":"2023-10-09T11:36:53.999935+0000","last_fullsized":"2023-10-09T11:36:53.999935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:58.955962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.007337+0000","last_change":"2023-10-09T11:36:52.972539+0000","last_active":"2023-10-09T11:36:54.007337+0000","last_peered":"2023-10-09T11:36:54.007337+0000","last_clean":"2023-10-09T11:36:54.007337+0000","last_became_active":"2023-10-09T11:36:52.972305+0000","last_became_peered":"2023-10-09T11:36:52.972305+0000","last_unstale":"2023-10-09T11:36:54.007337+0000","last_undegraded":"2023-10-09T11:36:54.007337+0000","last_fullsized":"2023-10-09T11:36:54.007337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:54.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999985+0000","last_change":"2023-10-09T11:36:53.999896+0000","last_active":"2023-10-09T11:36:53.999985+0000","last_peered":"2023-10-09T11:36:53.999985+0000","last_clean":"2023-10-09T11:36:53.999985+0000","last_became_active":"2023-10-09T11:36:53.999198+0000","last_became_peered":"2023-10-09T11:36:53.999198+0000","last_unstale":"2023-10-09T11:36:53.999985+0000","last_undegraded":"2023-10-09T11:36:53.999985+0000","last_fullsized":"2023-10-09T11:36:53.999985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:50.060198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.988988+0000","last_change":"2023-10-09T11:36:52.981633+0000","last_active":"2023-10-09T11:36:53.988988+0000","last_peered":"2023-10-09T11:36:53.988988+0000","last_clean":"2023-10-09T11:36:53.988988+0000","last_became_active":"2023-10-09T11:36:52.981238+0000","last_became_peered":"2023-10-09T11:36:52.981238+0000","last_unstale":"2023-10-09T11:36:53.988988+0000","last_undegraded":"2023-10-09T11:36:53.988988+0000","last_fullsized":"2023-10-09T11:36:53.988988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:39.075107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.005402+0000","last_change":"2023-10-09T11:36:54.005315+0000","last_active":"2023-10-09T11:36:54.005402+0000","last_peered":"2023-10-09T11:36:54.005402+0000","last_clean":"2023-10-09T11:36:54.005402+0000","last_became_active":"2023-10-09T11:36:54.005090+0000","last_became_peered":"2023-10-09T11:36:54.005090+0000","last_unstale":"2023-10-09T11:36:54.005402+0000","last_undegraded":"2023-10-09T11:36:54.005402+0000","last_fullsized":"2023-10-09T11:36:54.005402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:49.379548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.009002+0000","last_change":"2023-10-09T11:36:52.978268+0000","last_active":"2023-10-09T11:36:54.009002+0000","last_peered":"2023-10-09T11:36:54.009002+0000","last_clean":"2023-10-09T11:36:54.009002+0000","last_became_active":"2023-10-09T11:36:52.977836+0000","last_became_peered":"2023-10-09T11:36:52.977836+0000","last_unstale":"2023-10-09T11:36:54.009002+0000","last_undegraded":"2023-10-09T11:36:54.009002+0000","last_fullsized":"2023-10-09T11:36:54.009002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:21:22.378913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.996102+0000","last_change":"2023-10-09T11:36:53.996040+0000","last_active":"2023-10-09T11:36:53.996102+0000","last_peered":"2023-10-09T11:36:53.996102+0000","last_clean":"2023-10-09T11:36:53.996102+0000","last_became_active":"2023-10-09T11:36:53.995887+0000","last_became_peered":"2023-10-09T11:36:53.995887+0000","last_unstale":"2023-10-09T11:36:53.996102+0000","last_undegraded":"2023-10-09T11:36:53.996102+0000","last_fullsized":"2023-10-09T11:36:53.996102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:56.411409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.993705+0000","last_change":"2023-10-09T11:36:52.978579+0000","last_active":"2023-10-09T11:36:53.993705+0000","last_peered":"2023-10-09T11:36:53.993705+0000","last_clean":"2023-10-09T11:36:53.993705+0000","last_became_active":"2023-10-09T11:36:52.978344+0000","last_became_peered":"2023-10-09T11:36:52.978344+0000","last_unstale":"2023-10-09T11:36:53.993705+0000","last_undegraded":"2023-10-09T11:36:53.993705+0000","last_fullsized":"2023-10-09T11:36:53.993705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.993854+0000","last_change":"2023-10-09T11:36:53.993692+0000","last_active":"2023-10-09T11:36:53.993854+0000","last_peered":"2023-10-09T11:36:53.993854+0000","last_clean":"2023-10-09T11:36:53.993854+0000","last_became_active":"2023-10-09T11:36:53.993480+0000","last_became_peered":"2023-10-09T11:36:53.993480+0000","last_unstale":"2023-10-09T11:36:53.993854+0000","last_undegraded":"2023-10-09T11:36:53.993854+0000","last_fullsized":"2023-10-09T11:36:53.993854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:24.119039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.991203+0000","last_change":"2023-10-09T11:36:52.978194+0000","last_active":"2023-10-09T11:36:53.991203+0000","last_peered":"2023-10-09T11:36:53.991203+0000","last_clean":"2023-10-09T11:36:53.991203+0000","last_became_active":"2023-10-09T11:36:52.977608+0000","last_became_peered":"2023-10-09T11:36:52.977608+0000","last_unstale":"2023-10-09T11:36:53.991203+0000","last_undegraded":"2023-10-09T11:36:53.991203+0000","last_fullsized":"2023-10-09T11:36:53.991203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:54.785201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000561+0000","last_change":"2023-10-09T11:36:53.999520+0000","last_active":"2023-10-09T11:36:54.000561+0000","last_peered":"2023-10-09T11:36:54.000561+0000","last_clean":"2023-10-09T11:36:54.000561+0000","last_became_active":"2023-10-09T11:36:53.998876+0000","last_became_peered":"2023-10-09T11:36:53.998876+0000","last_unstale":"2023-10-09T11:36:54.000561+0000","last_undegraded":"2023-10-09T11:36:54.000561+0000","last_fullsized":"2023-10-09T11:36:54.000561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:19.225353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.988905+0000","last_change":"2023-10-09T11:36:52.980641+0000","last_active":"2023-10-09T11:36:53.988905+0000","last_peered":"2023-10-09T11:36:53.988905+0000","last_clean":"2023-10-09T11:36:53.988905+0000","last_became_active":"2023-10-09T11:36:52.980368+0000","last_became_peered":"2023-10-09T11:36:52.980368+0000","last_unstale":"2023-10-09T11:36:53.988905+0000","last_undegraded":"2023-10-09T11:36:53.988905+0000","last_fullsized":"2023-10-09T11:36:53.988905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:12:51.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.994407+0000","last_change":"2023-10-09T11:36:53.994346+0000","last_active":"2023-10-09T11:36:53.994407+0000","last_peered":"2023-10-09T11:36:53.994407+0000","last_clean":"2023-10-09T11:36:53.994407+0000","last_became_active":"2023-10-09T11:36:53.994139+0000","last_became_peered":"2023-10-09T11:36:53.994139+0000","last_unstale":"2023-10-09T11:36:53.994407+0000","last_undegraded":"2023-10-09T11:36:53.994407+0000","last_fullsized":"2023-10-09T11:36:53.994407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:09:25.303830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.008709+0000","last_change":"2023-10-09T11:36:52.978421+0000","last_active":"2023-10-09T11:36:54.008709+0000","last_peered":"2023-10-09T11:36:54.008709+0000","last_clean":"2023-10-09T11:36:54.008709+0000","last_became_active":"2023-10-09T11:36:52.978043+0000","last_became_peered":"2023-10-09T11:36:52.978043+0000","last_unstale":"2023-10-09T11:36:54.008709+0000","last_undegraded":"2023-10-09T11:36:54.008709+0000","last_fullsized":"2023-10-09T11:36:54.008709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:31:50.163939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002176+0000","last_change":"2023-10-09T11:36:54.001810+0000","last_active":"2023-10-09T11:36:54.002176+0000","last_peered":"2023-10-09T11:36:54.002176+0000","last_clean":"2023-10-09T11:36:54.002176+0000","last_became_active":"2023-10-09T11:36:54.001013+0000","last_became_peered":"2023-10-09T11:36:54.001013+0000","last_unstale":"2023-10-09T11:36:54.002176+0000","last_undegraded":"2023-10-09T11:36:54.002176+0000","last_fullsized":"2023-10-09T11:36:54.002176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:35.442982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.989322+0000","last_change":"2023-10-09T11:36:52.978416+0000","last_active":"2023-10-09T11:36:54.989322+0000","last_peered":"2023-10-09T11:36:54.989322+0000","last_clean":"2023-10-09T11:36:54.989322+0000","last_became_active":"2023-10-09T11:36:52.978117+0000","last_became_peered":"2023-10-09T11:36:52.978117+0000","last_unstale":"2023-10-09T11:36:54.989322+0000","last_undegraded":"2023-10-09T11:36:54.989322+0000","last_fullsized":"2023-10-09T11:36:54.989322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:03.608867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.999956+0000","last_change":"2023-10-09T11:36:53.999892+0000","last_active":"2023-10-09T11:36:53.999956+0000","last_peered":"2023-10-09T11:36:53.999956+0000","last_clean":"2023-10-09T11:36:53.999956+0000","last_became_active":"2023-10-09T11:36:53.999652+0000","last_became_peered":"2023-10-09T11:36:53.999652+0000","last_unstale":"2023-10-09T11:36:53.999956+0000","last_undegraded":"2023-10-09T11:36:53.999956+0000","last_fullsized":"2023-10-09T11:36:53.999956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:09.011707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.998529+0000","last_change":"2023-10-09T11:36:52.977886+0000","last_active":"2023-10-09T11:36:53.998529+0000","last_peered":"2023-10-09T11:36:53.998529+0000","last_clean":"2023-10-09T11:36:53.998529+0000","last_became_active":"2023-10-09T11:36:52.977554+0000","last_became_peered":"2023-10-09T11:36:52.977554+0000","last_unstale":"2023-10-09T11:36:53.998529+0000","last_undegraded":"2023-10-09T11:36:53.998529+0000","last_fullsized":"2023-10-09T11:36:53.998529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:49.058328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.996316+0000","last_change":"2023-10-09T11:36:53.996252+0000","last_active":"2023-10-09T11:36:53.996316+0000","last_peered":"2023-10-09T11:36:53.996316+0000","last_clean":"2023-10-09T11:36:53.996316+0000","last_became_active":"2023-10-09T11:36:53.996026+0000","last_became_peered":"2023-10-09T11:36:53.996026+0000","last_unstale":"2023-10-09T11:36:53.996316+0000","last_undegraded":"2023-10-09T11:36:53.996316+0000","last_fullsized":"2023-10-09T11:36:53.996316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.358404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.988526+0000","last_change":"2023-10-09T11:36:52.974753+0000","last_active":"2023-10-09T11:36:53.988526+0000","last_peered":"2023-10-09T11:36:53.988526+0000","last_clean":"2023-10-09T11:36:53.988526+0000","last_became_active":"2023-10-09T11:36:52.974461+0000","last_became_peered":"2023-10-09T11:36:52.974461+0000","last_unstale":"2023-10-09T11:36:53.988526+0000","last_undegraded":"2023-10-09T11:36:53.988526+0000","last_fullsized":"2023-10-09T11:36:53.988526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:15.103301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.997798+0000","last_change":"2023-10-09T11:36:53.997743+0000","last_active":"2023-10-09T11:36:53.997798+0000","last_peered":"2023-10-09T11:36:53.997798+0000","last_clean":"2023-10-09T11:36:53.997798+0000","last_became_active":"2023-10-09T11:36:53.997547+0000","last_became_peered":"2023-10-09T11:36:53.997547+0000","last_unstale":"2023-10-09T11:36:53.997798+0000","last_undegraded":"2023-10-09T11:36:53.997798+0000","last_fullsized":"2023-10-09T11:36:53.997798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.358404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.998377+0000","last_change":"2023-10-09T11:36:52.978263+0000","last_active":"2023-10-09T11:36:53.998377+0000","last_peered":"2023-10-09T11:36:53.998377+0000","last_clean":"2023-10-09T11:36:53.998377+0000","last_became_active":"2023-10-09T11:36:52.977517+0000","last_became_peered":"2023-10-09T11:36:52.977517+0000","last_unstale":"2023-10-09T11:36:53.998377+0000","last_undegraded":"2023-10-09T11:36:53.998377+0000","last_fullsized":"2023-10-09T11:36:53.998377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:51:55.548621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.002497+0000","last_change":"2023-10-09T11:36:54.002439+0000","last_active":"2023-10-09T11:36:54.002497+0000","last_peered":"2023-10-09T11:36:54.002497+0000","last_clean":"2023-10-09T11:36:54.002497+0000","last_became_active":"2023-10-09T11:36:54.001737+0000","last_became_peered":"2023-10-09T11:36:54.001737+0000","last_unstale":"2023-10-09T11:36:54.002497+0000","last_undegraded":"2023-10-09T11:36:54.002497+0000","last_fullsized":"2023-10-09T11:36:54.002497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:30.575001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.989667+0000","last_change":"2023-10-09T11:36:52.973332+0000","last_active":"2023-10-09T11:36:53.989667+0000","last_peered":"2023-10-09T11:36:53.989667+0000","last_clean":"2023-10-09T11:36:53.989667+0000","last_became_active":"2023-10-09T11:36:52.973068+0000","last_became_peered":"2023-10-09T11:36:52.973068+0000","last_unstale":"2023-10-09T11:36:53.989667+0000","last_undegraded":"2023-10-09T11:36:53.989667+0000","last_fullsized":"2023-10-09T11:36:53.989667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:20.764368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.001153+0000","last_change":"2023-10-09T11:36:54.000735+0000","last_active":"2023-10-09T11:36:54.001153+0000","last_peered":"2023-10-09T11:36:54.001153+0000","last_clean":"2023-10-09T11:36:54.001153+0000","last_became_active":"2023-10-09T11:36:54.000580+0000","last_became_peered":"2023-10-09T11:36:54.000580+0000","last_unstale":"2023-10-09T11:36:54.001153+0000","last_undegraded":"2023-10-09T11:36:54.001153+0000","last_fullsized":"2023-10-09T11:36:54.001153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:33:24.173615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.000755+0000","last_change":"2023-10-09T11:36:52.982899+0000","last_active":"2023-10-09T11:36:54.000755+0000","last_peered":"2023-10-09T11:36:54.000755+0000","last_clean":"2023-10-09T11:36:54.000755+0000","last_became_active":"2023-10-09T11:36:52.982300+0000","last_became_peered":"2023-10-09T11:36:52.982300+0000","last_unstale":"2023-10-09T11:36:54.000755+0000","last_undegraded":"2023-10-09T11:36:54.000755+0000","last_fullsized":"2023-10-09T11:36:54.000755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:10.326129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:54.004295+0000","last_change":"2023-10-09T11:36:54.004260+0000","last_active":"2023-10-09T11:36:54.004295+0000","last_peered":"2023-10-09T11:36:54.004295+0000","last_clean":"2023-10-09T11:36:54.004295+0000","last_became_active":"2023-10-09T11:36:54.004067+0000","last_became_peered":"2023-10-09T11:36:54.004067+0000","last_unstale":"2023-10-09T11:36:54.004295+0000","last_undegraded":"2023-10-09T11:36:54.004295+0000","last_fullsized":"2023-10-09T11:36:54.004295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:52.964159+0000","last_clean_scrub_stamp":"2023-10-09T11:36:52.964159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:45.813616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.993828+0000","last_change":"2023-10-09T11:36:52.975705+0000","last_active":"2023-10-09T11:36:53.993828+0000","last_peered":"2023-10-09T11:36:53.993828+0000","last_clean":"2023-10-09T11:36:53.993828+0000","last_became_active":"2023-10-09T11:36:52.975500+0000","last_became_peered":"2023-10-09T11:36:52.975500+0000","last_unstale":"2023-10-09T11:36:53.993828+0000","last_undegraded":"2023-10-09T11:36:53.993828+0000","last_fullsized":"2023-10-09T11:36:53.993828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:36:51.962289+0000","last_clean_scrub_stamp":"2023-10-09T11:36:51.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:55.409539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-09T11:36:53.995295+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:36:53.995295+0000","last_peered":"2023-10-09T11:36:53.995295+0000","last_clean":"2023-10-09T11:36:53.995295+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:36:53.995295+0000","last_undegraded":"2023-10-09T11:36:53.995295+0000","last_fullsized":"2023-10-09T11:36:53.995295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.75}]},{"osd":5,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.73799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7589999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.626}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.298,"5min":5.298,"15min":5.298},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.67900000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3949999999999996,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.441},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.378},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39500000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.436},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.495}]},{"osd":2,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.69199999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.73299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.433}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.9340000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195182,"statfs":{"total":200000000,"available":199866376,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.47099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.443},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72099999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59899999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.69199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.32600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.437},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.627},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199866342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":7.4210000000000003,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":7.4459999999999997,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.61099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.274,"5min":5.274,"15min":5.274},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":7.5679999999999996,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.5460000000000003,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.499}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.377},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.433},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.72199999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T11:36:58.493 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:36:58.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:36:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.652+0000 7f26870cd700 1 Processor -- start 2023-10-09T11:36:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.652+0000 7f26870cd700 1 -- start start 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f26870cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 0x7f26800cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f26870cd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800cca80 con 0x7f26801577c0 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f26870cd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800cedd0 con 0x7f2680157b90 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f26870cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800cc4c0 con 0x7f2680068f20 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f2684e69700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f26801577c0 0x7f2680068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48402/0 (socket says 172.21.15.6:48402) 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f2684e69700 1 -- 172.21.15.6:0/3372730728 learned_addr learned my addr 172.21.15.6:0/3372730728 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267ffff700 1 --2- 172.21.15.6:0/3372730728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 0x7f26800cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803653195 0 0) 0x7f26800cca80 con 0x7f26801577c0 2023-10-09T11:36:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2668003570 con 0x7f26801577c0 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922175753 0 0) 0x7f26800cedd0 con 0x7f2680157b90 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267ffff700 1 -- 172.21.15.6:0/3372730728 >> v1:172.21.15.118:6789/0 conn(0x7f2680157b90 legacy=0x7f26800cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267ffff700 1 -- 172.21.15.6:0/3372730728 >> v1:172.21.15.6:6789/0 conn(0x7f26801577c0 legacy=0x7f2680068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.653+0000 7f267ffff700 1 -- 172.21.15.6:0/3372730728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800cc7a0 con 0x7f2680068f20 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f267ffff700 1 --2- 172.21.15.6:0/3372730728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 0x7f26800cb790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2674009910 tx=0x7f26740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe57179b9680fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400b680 con 0x7f2680068f20 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267400b7e0 con 0x7f2680068f20 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f267f7fe700 1 -- 172.21.15.6:0/3372730728 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400bba0 con 0x7f2680068f20 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 -- 172.21.15.6:0/3372730728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 msgr2=0x7f26800cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 --2- 172.21.15.6:0/3372730728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 0x7f26800cb790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2674009910 tx=0x7f26740091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 -- 172.21.15.6:0/3372730728 shutdown_connections 2023-10-09T11:36:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 --2- 172.21.15.6:0/3372730728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680068f20 0x7f26800cb790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 -- 172.21.15.6:0/3372730728 >> 172.21.15.6:0/3372730728 conn(0x7f26800d0df0 msgr2=0x7f26800d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 -- 172.21.15.6:0/3372730728 shutdown_connections 2023-10-09T11:36:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.654+0000 7f26870cd700 1 -- 172.21.15.6:0/3372730728 wait complete. 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.655+0000 7f26870cd700 1 Processor -- start 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 -- start start 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2680068f20 0x7f26800b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 0x7f26800c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c8fe0 con 0x7f26801577c0 2023-10-09T11:36:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c83d0 con 0x7f2680068f20 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f26870cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c86b0 con 0x7f2680157b90 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f267ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f267ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36608/0 (socket says 172.21.15.6:36608) 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.656+0000 7f267ffff700 1 -- 172.21.15.6:0/157730831 learned_addr learned my addr 172.21.15.6:0/157730831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f2684e69700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2680068f20 0x7f26800b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f268566a700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 0x7f26800c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 -- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 msgr2=0x7f26800c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 0x7f26800c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 -- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2680068f20 msgr2=0x7f26800b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2680068f20 0x7f26800b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 -- 172.21.15.6:0/157730831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674009420 con 0x7f26801577c0 2023-10-09T11:36:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f268566a700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 0x7f26800c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267ffff700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f268006fd60 tx=0x7f2674017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400bb60 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674027450 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26800c8990 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740277f0 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.657+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800b4b20 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.658+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268015d800 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.659+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f267401a430 con 0x7f26801577c0 2023-10-09T11:36:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.659+0000 7f267cff9700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.659+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2674086560 con 0x7f26801577c0 2023-10-09T11:36:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.659+0000 7f2684e69700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.659+0000 7f2684e69700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26700058d0 tx=0x7f2670009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.663+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2674053880 con 0x7f26801577c0 2023-10-09T11:36:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.938+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f26800c9120 con 0x7f26801577c0 2023-10-09T11:36:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.942+0000 7f267cff9700 1 -- 172.21.15.6:0/157730831 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2674056ea0 con 0x7f26801577c0 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 msgr2=0x7f266c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 0x7f266c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26700058d0 tx=0x7f2670009040 comp rx=0 tx=0).stop 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 msgr2=0x7f26800c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f268006fd60 tx=0x7f2674017000 comp rx=0 tx=0).stop 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 shutdown_connections 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f266c066f30 0x7f266c0693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2680157b90 0x7f26800c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2680068f20 0x7f26800b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 --2- 172.21.15.6:0/157730831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26801577c0 0x7f26800c9470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 >> 172.21.15.6:0/157730831 conn(0x7f26800d0df0 msgr2=0x7f26800c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 shutdown_connections 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:58.944+0000 7f26870cd700 1 -- 172.21.15.6:0/157730831 wait complete. 2023-10-09T11:36:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:36:58.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:36:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.076+0000 7f96359f3700 1 Processor -- start 2023-10-09T11:36:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.076+0000 7f96359f3700 1 -- start start 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f96359f3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9630157ca0 0x7f96300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f96359f3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f963006d120 0x7f963006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f96359f3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96300d07c0 con 0x7f96301578d0 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f96359f3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963006da50 con 0x7f9630157ca0 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f96359f3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300cfbb0 con 0x7f963006d120 2023-10-09T11:36:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9630157ca0 0x7f96300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9630157ca0 0x7f96300cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36612/0 (socket says 172.21.15.6:36612) 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96301578d0 0x7f963015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48406/0 (socket says 172.21.15.6:48406) 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 -- 172.21.15.6:0/2169837021 learned_addr learned my addr 172.21.15.6:0/2169837021 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 -- 172.21.15.6:0/2169837021 >> v2:172.21.15.118:3300/0 conn(0x7f963006d120 msgr2=0x7f963006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 --2- 172.21.15.6:0/2169837021 >> v2:172.21.15.118:3300/0 conn(0x7f963006d120 0x7f963006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 -- 172.21.15.6:0/2169837021 >> v1:172.21.15.6:6789/0 conn(0x7f96301578d0 legacy=0x7f963015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 -- 172.21.15.6:0/2169837021 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300cfe90 con 0x7f9630157ca0 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962e7fc700 1 --2- 172.21.15.6:0/2169837021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300cf4f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9630068300 tx=0x7f9618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aca105304c60e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.077+0000 7f962dffb700 1 -- 172.21.15.6:0/2169837021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800b860 con 0x7f9630157ca0 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f962dffb700 1 -- 172.21.15.6:0/2169837021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800b9c0 con 0x7f9630157ca0 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f962dffb700 1 -- 172.21.15.6:0/2169837021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bd60 con 0x7f9630157ca0 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 -- 172.21.15.6:0/2169837021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 msgr2=0x7f96300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 --2- 172.21.15.6:0/2169837021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300cf4f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9630068300 tx=0x7f9618009250 comp rx=0 tx=0).stop 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 -- 172.21.15.6:0/2169837021 shutdown_connections 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 --2- 172.21.15.6:0/2169837021 >> v2:172.21.15.118:3300/0 conn(0x7f963006d120 0x7f963006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 --2- 172.21.15.6:0/2169837021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300cf4f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 -- 172.21.15.6:0/2169837021 >> 172.21.15.6:0/2169837021 conn(0x7f963006bb90 msgr2=0x7f963006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 -- 172.21.15.6:0/2169837021 shutdown_connections 2023-10-09T11:36:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.078+0000 7f96359f3700 1 -- 172.21.15.6:0/2169837021 wait complete. 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.079+0000 7f96359f3700 1 Processor -- start 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.079+0000 7f96359f3700 1 -- start start 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f963006d120 0x7f9630149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96301578d0 0x7f96300ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963016a370 con 0x7f9630157ca0 2023-10-09T11:36:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96300ab1f0 con 0x7f963006d120 2023-10-09T11:36:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f96359f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96300aa930 con 0x7f96301578d0 2023-10-09T11:36:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36628/0 (socket says 172.21.15.6:36628) 2023-10-09T11:36:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 -- 172.21.15.6:0/2258632116 learned_addr learned my addr 172.21.15.6:0/2258632116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962effd700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f963006d120 0x7f9630149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 -- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96301578d0 msgr2=0x7f96300ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96301578d0 0x7f96300ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 -- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f963006d120 msgr2=0x7f9630149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f963006d120 0x7f9630149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.080+0000 7f962f7fe700 1 -- 172.21.15.6:0/2258632116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180094f0 con 0x7f9630157ca0 2023-10-09T11:36:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f962f7fe700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f962000bc60 tx=0x7f9620009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200092e0 con 0x7f9630157ca0 2023-10-09T11:36:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000c7b0 con 0x7f9630157ca0 2023-10-09T11:36:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9630149d50 con 0x7f9630157ca0 2023-10-09T11:36:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000cb90 con 0x7f9630157ca0 2023-10-09T11:36:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.081+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96300aae80 con 0x7f9630157ca0 2023-10-09T11:36:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.082+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96300ab3a0 con 0x7f9630157ca0 2023-10-09T11:36:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.082+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9620012070 con 0x7f9630157ca0 2023-10-09T11:36:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.082+0000 7f9626ffd700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 0x7f96100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.082+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96200841f0 con 0x7f9630157ca0 2023-10-09T11:36:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.083+0000 7f962effd700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 0x7f96100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.083+0000 7f962effd700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 0x7f96100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.087+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96300ab3a0 con 0x7f9630157ca0 2023-10-09T11:36:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.328+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96300ab3a0 con 0x7f9630157ca0 2023-10-09T11:36:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.329+0000 7f9626ffd700 1 -- 172.21.15.6:0/2258632116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f96300ab3a0 con 0x7f9630157ca0 2023-10-09T11:36:59.329 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:36:59.329 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:36:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 msgr2=0x7f96100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 0x7f96100693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 msgr2=0x7f96300ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f962000bc60 tx=0x7f9620009840 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 shutdown_connections 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9610066f30 0x7f96100693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630157ca0 0x7f96300ad7d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f963006d120 0x7f9630149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 --2- 172.21.15.6:0/2258632116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96301578d0 0x7f96300ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 >> 172.21.15.6:0/2258632116 conn(0x7f963006bb90 msgr2=0x7f963006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 shutdown_connections 2023-10-09T11:36:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.331+0000 7f96359f3700 1 -- 172.21.15.6:0/2258632116 wait complete. 2023-10-09T11:36:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:36:59.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:36:53.371494+0000', 'modified': '2023-10-09T11:36:57.010394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/4029072358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6835', 'nonce': 4029072358}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 4029072358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:36:59.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:36:59.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:36:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.872+0000 7f190d863700 1 Processor -- start 2023-10-09T11:36:59.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.872+0000 7f190d863700 1 -- start start 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f190d863700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f190d863700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f190806d120 0x7f190806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f190d863700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190806dac0 con 0x7f19081578d0 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f190d863700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080d07c0 con 0x7f190806d120 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f190d863700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080cfbb0 con 0x7f1908157ca0 2023-10-09T11:36:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19067fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f190806d120 0x7f190806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f1906ffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f19081578d0 0x7f190815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:40318/0 (socket says 172.21.15.6:40318) 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19067fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:44628/0 (socket says 172.21.15.6:44628) 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f1906ffd700 1 -- 172.21.15.6:0/1292888823 learned_addr learned my addr 172.21.15.6:0/1292888823 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f190806d120 0x7f190806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:34070/0 (socket says 172.21.15.6:34070) 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 -- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 msgr2=0x7f19080cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 -- 172.21.15.6:0/1292888823 >> v1:172.21.15.118:6789/0 conn(0x7f19081578d0 legacy=0x7f190815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19077fe700 1 -- 172.21.15.6:0/1292888823 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080cfe90 con 0x7f190806d120 2023-10-09T11:36:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f1905ffb700 1 -- 172.21.15.6:0/1292888823 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457353321 0 0) 0x7f1900001110 con 0x7f19081578d0 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.873+0000 7f19067fc700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f19077fe700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f190806d120 0x7f190806d580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e60 tx=0x7f18f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a124a104d2fe8b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f1905ffb700 1 -- 172.21.15.6:0/1292888823 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800e070 con 0x7f190806d120 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f1905ffb700 1 -- 172.21.15.6:0/1292888823 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800bb60 con 0x7f190806d120 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f1905ffb700 1 -- 172.21.15.6:0/1292888823 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8012430 con 0x7f190806d120 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 -- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f190806d120 msgr2=0x7f190806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f190806d120 0x7f190806d580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e60 tx=0x7f18f8009780 comp rx=0 tx=0).stop 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 -- 172.21.15.6:0/1292888823 shutdown_connections 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f190806d120 0x7f190806d580 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 --2- 172.21.15.6:0/1292888823 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1908157ca0 0x7f19080cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 -- 172.21.15.6:0/1292888823 >> 172.21.15.6:0/1292888823 conn(0x7f190806bb90 msgr2=0x7f190806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 -- 172.21.15.6:0/1292888823 shutdown_connections 2023-10-09T11:36:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.874+0000 7f190d863700 1 -- 172.21.15.6:0/1292888823 wait complete. 2023-10-09T11:36:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 Processor -- start 2023-10-09T11:36:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 -- start start 2023-10-09T11:36:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19081578d0 0x7f19080b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1908157ca0 0x7f1908152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080b47c0 con 0x7f190806d120 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190814b930 con 0x7f1908157ca0 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.876+0000 7f190d863700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908153f10 con 0x7f19081578d0 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36640/0 (socket says 172.21.15.6:36640) 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 -- 172.21.15.6:0/2079930064 learned_addr learned my addr 172.21.15.6:0/2079930064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f19067fc700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19081578d0 0x7f19080b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f19077fe700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1908157ca0 0x7f1908152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 -- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19081578d0 msgr2=0x7f19080b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19081578d0 0x7f19080b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 -- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1908157ca0 msgr2=0x7f1908152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1908157ca0 0x7f1908152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 -- 172.21.15.6:0/2079930064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009420 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f190000c810 tx=0x7f1900007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f18feffd700 1 -- 172.21.15.6:0/2079930064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900005b30 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f18feffd700 1 -- 172.21.15.6:0/2079930064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900005c90 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8009a20 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f18feffd700 1 -- 172.21.15.6:0/2079930064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900007300 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.877+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19081535e0 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.879+0000 7f18feffd700 1 -- 172.21.15.6:0/2079930064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f190001b3b0 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.879+0000 7f18feffd700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 0x7f18e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.879+0000 7f18feffd700 1 -- 172.21.15.6:0/2079930064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19000838a0 con 0x7f190806d120 2023-10-09T11:36:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.879+0000 7f19067fc700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 0x7f18e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.880+0000 7f19067fc700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 0x7f18e80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1908150480 tx=0x7f18f00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.881+0000 7f1916b5bb80 1 Processor -- start 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.881+0000 7f1916b5bb80 1 -- start start 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 0x55b570174e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b570170cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5700cba70 con 0x55b5701bed00 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5700c9270 con 0x55b570174a50 2023-10-09T11:36:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5700c5060 con 0x55b57019df60 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36646/0 (socket says 172.21.15.6:36646) 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 -- 172.21.15.6:0/3853261667 learned_addr learned my addr 172.21.15.6:0/3853261667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1906ffd700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 0x55b570174e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 -- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 msgr2=0x55b570170cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19077fe700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b570170cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b570170cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 -- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 msgr2=0x55b570174e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 0x55b570174e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f19067fc700 1 -- 172.21.15.6:0/3853261667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56ff5f270 con 0x55b5701bed00 2023-10-09T11:36:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.882+0000 7f1906ffd700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 0x55b570174e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f19067fc700 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f18f0011fc0 tx=0x7f18f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59294bd4e7bf4ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f18e7fff700 1 -- 172.21.15.6:0/3853261667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0021420 con 0x55b5701bed00 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f18e7fff700 1 -- 172.21.15.6:0/3853261667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0021580 con 0x55b5701bed00 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f18e7fff700 1 -- 172.21.15.6:0/3853261667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0021940 con 0x55b5701bed00 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3853261667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 msgr2=0x55b57019da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.883+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f18f0011fc0 tx=0x7f18f0016000 comp rx=0 tx=0).stop 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3853261667 shutdown_connections 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b570170cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570174a50 0x55b570174e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3853261667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5701bed00 0x55b57019da20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3853261667 >> 172.21.15.6:0/3853261667 conn(0x55b570176370 msgr2=0x55b570176740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3853261667 shutdown_connections 2023-10-09T11:36:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3853261667 wait complete. 2023-10-09T11:36:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 -- start start 2023-10-09T11:36:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.884+0000 7f1916b5bb80 1 Processor -- start 2023-10-09T11:36:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5701bed00 0x55b5701b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b570070890 con 0x55b570174a50 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57008bea0 con 0x55b5701bed00 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b56ff47e30 con 0x55b57019df60 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1916b5bb80 10 client.0 _ll_register_callbacks cb 0x55b570138110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36654/0 (socket says 172.21.15.6:36654) 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.885+0000 7f1906ffd700 1 -- 172.21.15.6:0/2900097766 learned_addr learned my addr 172.21.15.6:0/2900097766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 -- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 msgr2=0x55b5701bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f19067fc700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f19077fe700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5701bed00 0x55b5701b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 -- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5701bed00 msgr2=0x55b5701b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5701bed00 0x55b5701b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 -- 172.21.15.6:0/2900097766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f0011c10 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1906ffd700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1900081e70 tx=0x7f1900081d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad462da27fa61766 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900005e00 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1900052b70 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b570169b70 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1900070250 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 10 client.5148 fetch_fsmap learned FSMap version 17 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b56ff01fe0 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b570169b70 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1900053cc0 con 0x55b570174a50 2023-10-09T11:36:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 10 client.5148 fetch_fsmap finished waiting for FSMap version 17 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 10 client.5148 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 20 client.5148 populate_metadata read hostname 'smithi006' 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701cb090 0x55b5701b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 4 client.5148 mds_command: new command op to 4968 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 --> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b570146aa0 con 0x55b5701cb090 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.886+0000 7f19067fc700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701cb090 0x55b5701b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.887+0000 7f18e57fa700 10 client.5148 ms_handle_connect on v2:172.21.15.6:6835/4029072358 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.887+0000 7f19067fc700 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701cb090 0x55b5701b8b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed05a78a686212cc server_cookie=aa7e78b500563f65 in_seq=0 out_seq=0 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.887+0000 7f18e57fa700 1 -- 172.21.15.6:0/2900097766 <== mds.0 v2:172.21.15.6:6835/4029072358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b570146aa0 con 0x55b5701cb090 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.887+0000 7f18e57fa700 10 client.5148 handle_command_reply: tid=0 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.887+0000 7f1916b5bb80 1 client.5148 shutdown 2023-10-09T11:36:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 msgr2=0x55b5701cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1900081e70 tx=0x7f1900081d20 comp rx=0 tx=0).stop 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 shutdown_connections 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701cb090 0x55b5701b8b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5701bed00 0x55b5701b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b5701cdfb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/2900097766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f18e57fa700 0 client.5148 ms_handle_reset on v2:172.21.15.6:6835/4029072358 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 >> 172.21.15.6:0/2900097766 conn(0x55b570176370 msgr2=0x55b570177a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 shutdown_connections 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 1 -- 172.21.15.6:0/2900097766 wait complete. 2023-10-09T11:36:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.888+0000 7f1916b5bb80 20 client.5148 trim_cache size 0 max 16384 2023-10-09T11:36:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 Processor -- start 2023-10-09T11:36:59.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 -- start start 2023-10-09T11:36:59.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570170ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5701772f0 con 0x55b570174a50 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b570176740 con 0x55b570176370 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5701bc970 con 0x55b57019df60 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f19067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f19067fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36658/0 (socket says 172.21.15.6:36658) 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.905+0000 7f19067fc700 1 -- 172.21.15.6:0/3358379963 learned_addr learned my addr 172.21.15.6:0/3358379963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19077fe700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f1906ffd700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570170ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 -- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 msgr2=0x55b5701bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 -- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 msgr2=0x55b570170ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570170ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 -- 172.21.15.6:0/3358379963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b570093780 con 0x55b570174a50 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f1906ffd700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570170ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f19067fc700 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f18f00030c0 tx=0x7f18f0033250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43383c1234ffdec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f18fcff9700 1 -- 172.21.15.6:0/3358379963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0033070 con 0x55b570174a50 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f18fcff9700 1 -- 172.21.15.6:0/3358379963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0006c70 con 0x55b570174a50 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f18fcff9700 1 -- 172.21.15.6:0/3358379963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00216f0 con 0x55b570174a50 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3358379963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 msgr2=0x55b570171000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.906+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f18f00030c0 tx=0x7f18f0033250 comp rx=0 tx=0).stop 2023-10-09T11:36:59.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3358379963 shutdown_connections 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570170ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/3358379963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570171000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3358379963 >> 172.21.15.6:0/3358379963 conn(0x55b570173fa0 msgr2=0x55b5701b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3358379963 shutdown_connections 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 -- 172.21.15.6:0/3358379963 wait complete. 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 -- start start 2023-10-09T11:36:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.907+0000 7f1916b5bb80 1 Processor -- start 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570221ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5701b6e80 con 0x55b570174a50 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b570221a50 con 0x55b570176370 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5702216e0 con 0x55b57019df60 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1916b5bb80 10 client.0 _ll_register_callbacks cb 0x55b570138110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:36:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36662/0 (socket says 172.21.15.6:36662) 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 -- 172.21.15.6:0/1517672906 learned_addr learned my addr 172.21.15.6:0/1517672906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f19077fe700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f19067fc700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570221ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 -- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 msgr2=0x55b5701b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 -- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 msgr2=0x55b570221ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570221ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f1906ffd700 1 -- 172.21.15.6:0/1517672906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b56ff5f270 con 0x55b570174a50 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.908+0000 7f19067fc700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570221ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1906ffd700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1900054760 tx=0x7f190006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea68b7615846209 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:36:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190005b770 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1900005e00 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18f0021580 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1900053cc0 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 10 client.5154 fetch_fsmap learned FSMap version 17 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b57007a470 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0021580 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f190005b2e0 con 0x55b570174a50 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 10 client.5154 fetch_fsmap finished waiting for FSMap version 17 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 10 client.5154 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 20 client.5154 populate_metadata read hostname 'smithi006' 2023-10-09T11:36:59.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701bed00 0x55b5701d8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 4 client.5154 mds_command: new command op to 4968 tid=0[{"prefix": "status"}] 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 --> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b570067e00 con 0x55b5701bed00 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.909+0000 7f19067fc700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701bed00 0x55b5701d8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f18e57fa700 10 client.5154 ms_handle_connect on v2:172.21.15.6:6835/4029072358 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f19067fc700 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701bed00 0x55b5701d8bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281eff2d758ab81b server_cookie=bb4eceeff8af6eb2 in_seq=0 out_seq=0 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f18e57fa700 1 -- 172.21.15.6:0/1517672906 <== mds.0 v2:172.21.15.6:6835/4029072358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b570067e00 con 0x55b5701bed00 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f18e57fa700 10 client.5154 handle_command_reply: tid=0 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 client.5154 shutdown 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 msgr2=0x55b570220cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1900054760 tx=0x7f190006a000 comp rx=0 tx=0).stop 2023-10-09T11:36:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 shutdown_connections 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b57019df60 0x55b5701b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b570174a50 0x55b570220cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.6:6835/4029072358,v1:172.21.15.6:6837/4029072358] conn(0x55b5701bed00 0x55b5701d8bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 --2- 172.21.15.6:0/1517672906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b570176370 0x55b570221ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 >> 172.21.15.6:0/1517672906 conn(0x55b570173fa0 msgr2=0x55b570170ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f18e57fa700 0 client.5154 ms_handle_reset on v2:172.21.15.6:6835/4029072358 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 shutdown_connections 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 1 -- 172.21.15.6:0/1517672906 wait complete. 2023-10-09T11:36:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.910+0000 7f1916b5bb80 20 client.5154 trim_cache size 0 max 16384 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4968, 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9232451599999996, 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 31, 2023-10-09T11:36:59.919 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 31, 2023-10-09T11:36:59.920 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.827684700000001 2023-10-09T11:36:59.920 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:36:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 msgr2=0x7f18e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 0x7f18e80693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1908150480 tx=0x7f18f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 msgr2=0x7f190814b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f190000c810 tx=0x7f1900007c50 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 shutdown_connections 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e8066f30 0x7f18e80693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1908157ca0 0x7f1908152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f190806d120 0x7f190814b3f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 --2- 172.21.15.6:0/2079930064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19081578d0 0x7f19080b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 >> 172.21.15.6:0/2079930064 conn(0x7f190806bb90 msgr2=0x7f1908155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 shutdown_connections 2023-10-09T11:36:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:36:59.911+0000 7f190d863700 1 -- 172.21.15.6:0/2079930064 wait complete. 2023-10-09T11:36:59.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.041+0000 7f29f4012700 1 Processor -- start 2023-10-09T11:37:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.041+0000 7f29f4012700 1 -- start start 2023-10-09T11:37:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f4012700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29ec15a2a0 0x7f29ec0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f4012700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 0x7f29ec0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f4012700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec0b0ca0 con 0x7f29ec0ceb30 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f4012700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec06e160 con 0x7f29ec15a2a0 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f4012700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec06ea90 con 0x7f29ec06dd60 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f1dae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29ec15a2a0 0x7f29ec0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f1dae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29ec15a2a0 0x7f29ec0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36678/0 (socket says 172.21.15.6:36678) 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.042+0000 7f29f1dae700 1 -- 172.21.15.6:0/2109006650 learned_addr learned my addr 172.21.15.6:0/2109006650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f25af700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 0x7f29ec0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f1dae700 1 -- 172.21.15.6:0/2109006650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 msgr2=0x7f29ec0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f1dae700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 0x7f29ec0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f1dae700 1 -- 172.21.15.6:0/2109006650 >> v1:172.21.15.118:6789/0 conn(0x7f29ec0ceb30 legacy=0x7f29ec06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f1dae700 1 -- 172.21.15.6:0/2109006650 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0b00d0 con 0x7f29ec15a2a0 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f25af700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 0x7f29ec0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f1dae700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0b1130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009f20 tx=0x7f29dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d13a942b74f059 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f0dac700 1 -- 172.21.15.6:0/2109006650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00e070 con 0x7f29ec15a2a0 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f0dac700 1 -- 172.21.15.6:0/2109006650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00ba40 con 0x7f29ec15a2a0 2023-10-09T11:37:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.043+0000 7f29f0dac700 1 -- 172.21.15.6:0/2109006650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0092e0 con 0x7f29ec15a2a0 2023-10-09T11:37:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 -- 172.21.15.6:0/2109006650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec15a2a0 msgr2=0x7f29ec0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0b1130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009f20 tx=0x7f29dc009840 comp rx=0 tx=0).stop 2023-10-09T11:37:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 -- 172.21.15.6:0/2109006650 shutdown_connections 2023-10-09T11:37:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec06dd60 0x7f29ec0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 --2- 172.21.15.6:0/2109006650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0b1130 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 -- 172.21.15.6:0/2109006650 >> 172.21.15.6:0/2109006650 conn(0x7f29ec067640 msgr2=0x7f29ec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 -- 172.21.15.6:0/2109006650 shutdown_connections 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.044+0000 7f29f4012700 1 -- 172.21.15.6:0/2109006650 wait complete. 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.045+0000 7f29f4012700 1 Processor -- start 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.045+0000 7f29f4012700 1 -- start start 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec0ceb30 0x7f29ec0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15ecb0 con 0x7f29ec06dd60 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15e0a0 con 0x7f29ec15a2a0 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15e380 con 0x7f29ec0ceb30 2023-10-09T11:37:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36684/0 (socket says 172.21.15.6:36684) 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 -- 172.21.15.6:0/4237112230 learned_addr learned my addr 172.21.15.6:0/4237112230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f25af700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f15ad700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec0ceb30 0x7f29ec0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 -- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec0ceb30 msgr2=0x7f29ec0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec0ceb30 0x7f29ec0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 -- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29ec15a2a0 msgr2=0x7f29ec0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 -- 172.21.15.6:0/4237112230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009ae0 con 0x7f29ec06dd60 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f1dae700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06f990 tx=0x7f29dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc012aa0 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc012c00 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec15e660 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.046+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc01d420 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.047+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec143180 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.047+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec069e40 con 0x7f29ec06dd60 2023-10-09T11:37:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.048+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29dc01d810 con 0x7f29ec06dd60 2023-10-09T11:37:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.048+0000 7f29e9ffb700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.048+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29dc085c40 con 0x7f29ec06dd60 2023-10-09T11:37:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.048+0000 7f29f15ad700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.049+0000 7f29f15ad700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 0x7f29d80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29ec15c7a0 tx=0x7f29e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.053+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29dc052eb0 con 0x7f29ec06dd60 2023-10-09T11:37:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.290+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29ec071b10 con 0x7f29ec06dd60 2023-10-09T11:37:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.291+0000 7f29e9ffb700 1 -- 172.21.15.6:0/4237112230 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29dc02a060 con 0x7f29ec06dd60 2023-10-09T11:37:00.292 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 msgr2=0x7f29d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 0x7f29d80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29ec15c7a0 tx=0x7f29e0009040 comp rx=0 tx=0).stop 2023-10-09T11:37:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 msgr2=0x7f29ec142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06f990 tx=0x7f29dc017000 comp rx=0 tx=0).stop 2023-10-09T11:37:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 shutdown_connections 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f29d8066f30 0x7f29d80693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29ec15a2a0 0x7f29ec0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29ec06dd60 0x7f29ec142c40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 --2- 172.21.15.6:0/4237112230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29ec0ceb30 0x7f29ec0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 >> 172.21.15.6:0/4237112230 conn(0x7f29ec067640 msgr2=0x7f29ec157910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 shutdown_connections 2023-10-09T11:37:00.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:00.293+0000 7f29f4012700 1 -- 172.21.15.6:0/4237112230 wait complete. 2023-10-09T11:37:00.305 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:00.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:00.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.307 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:00.322 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42441sec preferred_lft 42441sec 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.323 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:37:00.324 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.325 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:00.325 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:37:00.325 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:37:00.325 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:00.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.325 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:00.386 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:37:00.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.388 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:00.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:37:00.445 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:37:00.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.547 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:37:00.562 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:37:00.562 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:37:00.562 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:00.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:37:00.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:00.627 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:00.682 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:00.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:00.683 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:00.737 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:37:00.737 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:00.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:00.818 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:00.819 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:00.837 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:00.859 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:00.860 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:37:00.860 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:37:00.860 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:37:00.862 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:00.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:00.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:00.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.089+0000 7f2e3583e700 1 Processor -- start 2023-10-09T11:37:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.089+0000 7f2e3583e700 1 -- start start 2023-10-09T11:37:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e3583e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e30159d40 0x7f2e300d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e3583e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 0x7f2e300ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e3583e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e300ce290 con 0x7f2e3015a110 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e3583e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300cda30 con 0x7f2e30159d40 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e3583e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300cdcd0 con 0x7f2e300b3230 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e30159d40 0x7f2e300d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e30159d40 0x7f2e300d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36694/0 (socket says 172.21.15.6:36694) 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 -- 172.21.15.6:0/664279944 learned_addr learned my addr 172.21.15.6:0/664279944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 -- 172.21.15.6:0/664279944 >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 msgr2=0x7f2e300ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2f7fe700 1 --2- 172.21.15.6:0/664279944 >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 0x7f2e300ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 --2- 172.21.15.6:0/664279944 >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 0x7f2e300ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 -- 172.21.15.6:0/664279944 >> v1:172.21.15.118:6789/0 conn(0x7f2e3015a110 legacy=0x7f2e300b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 -- 172.21.15.6:0/664279944 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300cdfb0 con 0x7f2e30159d40 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2f7fe700 1 --2- 172.21.15.6:0/664279944 >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 0x7f2e300ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2effd700 1 --2- 172.21.15.6:0/664279944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e30159d40 0x7f2e300d06d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2e300cc9c0 tx=0x7f2e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f5e5175950fe7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2dffb700 1 -- 172.21.15.6:0/664279944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000b820 con 0x7f2e30159d40 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2dffb700 1 -- 172.21.15.6:0/664279944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2000b980 con 0x7f2e30159d40 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.090+0000 7f2e2dffb700 1 -- 172.21.15.6:0/664279944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000bd20 con 0x7f2e30159d40 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 -- 172.21.15.6:0/664279944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e30159d40 msgr2=0x7f2e300d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 --2- 172.21.15.6:0/664279944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e30159d40 0x7f2e300d06d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2e300cc9c0 tx=0x7f2e20009250 comp rx=0 tx=0).stop 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 -- 172.21.15.6:0/664279944 shutdown_connections 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 --2- 172.21.15.6:0/664279944 >> v2:172.21.15.118:3300/0 conn(0x7f2e300b3230 0x7f2e300ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 --2- 172.21.15.6:0/664279944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e30159d40 0x7f2e300d06d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 -- 172.21.15.6:0/664279944 >> 172.21.15.6:0/664279944 conn(0x7f2e3006bb90 msgr2=0x7f2e3006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 -- 172.21.15.6:0/664279944 shutdown_connections 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.091+0000 7f2e3583e700 1 -- 172.21.15.6:0/664279944 wait complete. 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.092+0000 7f2e3583e700 1 Processor -- start 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.092+0000 7f2e3583e700 1 -- start start 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 0x7f2e300ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e3015a110 0x7f2e300c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015ee50 con 0x7f2e300b3230 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300c85f0 con 0x7f2e30159d40 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e3583e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300cac70 con 0x7f2e3015a110 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36708/0 (socket says 172.21.15.6:36708) 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 -- 172.21.15.6:0/1219031991 learned_addr learned my addr 172.21.15.6:0/1219031991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2f7fe700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e3015a110 0x7f2e300c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2e7fc700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 0x7f2e300ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 -- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e3015a110 msgr2=0x7f2e300c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e3015a110 0x7f2e300c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 -- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 msgr2=0x7f2e300ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 0x7f2e300ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2effd700 1 -- 172.21.15.6:0/1219031991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200094f0 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.093+0000 7f2e2e7fc700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 0x7f2e300ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e2effd700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009290 tx=0x7f2e20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20011e20 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2001b680 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3015eb70 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001ba40 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.094+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e300c8280 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.095+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e300c7de0 con 0x7f2e300b3230 2023-10-09T11:37:01.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.095+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e2001c450 con 0x7f2e300b3230 2023-10-09T11:37:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.096+0000 7f2e16ffd700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.096+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e20086290 con 0x7f2e300b3230 2023-10-09T11:37:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.096+0000 7f2e2e7fc700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.096+0000 7f2e2e7fc700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 0x7f2e1c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006fd0 tx=0x7f2e24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.100+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e20053500 con 0x7f2e300b3230 2023-10-09T11:37:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.337+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e300cb900 con 0x7f2e300b3230 2023-10-09T11:37:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.338+0000 7f2e16ffd700 1 -- 172.21.15.6:0/1219031991 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e20056b20 con 0x7f2e300b3230 2023-10-09T11:37:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 msgr2=0x7f2e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 0x7f2e1c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006fd0 tx=0x7f2e24008040 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 msgr2=0x7f2e3015e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009290 tx=0x7f2e20016000 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 shutdown_connections 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2e1c066f30 0x7f2e1c0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e3015a110 0x7f2e300c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e300b3230 0x7f2e3015e4b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 --2- 172.21.15.6:0/1219031991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e30159d40 0x7f2e300ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 >> 172.21.15.6:0/1219031991 conn(0x7f2e3006bb90 msgr2=0x7f2e30150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 shutdown_connections 2023-10-09T11:37:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:01.340+0000 7f2e3583e700 1 -- 172.21.15.6:0/1219031991 wait complete. 2023-10-09T11:37:01.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:01.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:01.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:01.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.353 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:37:01.371 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42453sec preferred_lft 42453sec 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:37:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:01.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.375 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:01.439 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:37:01.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.440 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:37:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:37:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:37:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:37:01.498 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:01.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:37:01.499 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:37:01.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.603 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:37:01.618 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:37:01.619 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:37:01.619 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:01.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.619 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:37:01.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:01.684 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:01.738 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:01.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:01.739 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:01.793 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:37:01.793 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:01.793 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:37:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:37:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:37:01.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:01.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:01.915 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:01.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.109+0000 7fadf8e8f700 1 Processor -- start 2023-10-09T11:37:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.109+0000 7fadf8e8f700 1 -- start start 2023-10-09T11:37:02.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf8e8f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fadf41578d0 0x7fadf40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf8e8f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40d07c0 con 0x7fadf406d120 2023-10-09T11:37:02.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf8e8f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40cfbb0 con 0x7fadf4157ca0 2023-10-09T11:37:02.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf8e8f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40cfe90 con 0x7fadf41578d0 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf2d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fadf406d120 0x7fadf406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48418/0 (socket says 172.21.15.6:48418) 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf2d9d700 1 -- 172.21.15.6:0/2264392525 learned_addr learned my addr 172.21.15.6:0/2264392525 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf259c700 1 --2- 172.21.15.6:0/2264392525 >> v2:172.21.15.118:3300/0 conn(0x7fadf41578d0 0x7fadf40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164032070 0 0) 0x7fadf40d07c0 con 0x7fadf406d120 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003570 con 0x7fadf406d120 2023-10-09T11:37:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169922155 0 0) 0x7fadf40cfbb0 con 0x7fadf4157ca0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf40d07c0 con 0x7fadf4157ca0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf259c700 1 -- 172.21.15.6:0/2264392525 >> v1:172.21.15.118:6789/0 conn(0x7fadf4157ca0 legacy=0x7fadf415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf259c700 1 -- 172.21.15.6:0/2264392525 >> v1:172.21.15.6:6789/0 conn(0x7fadf406d120 legacy=0x7fadf406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.110+0000 7fadf259c700 1 -- 172.21.15.6:0/2264392525 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40d0170 con 0x7fadf41578d0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf259c700 1 --2- 172.21.15.6:0/2264392525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf41578d0 0x7fadf40cf4f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fade40098e0 tx=0x7fade40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb10b4663f3bb8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4011630 con 0x7fadf41578d0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade4011790 con 0x7fadf41578d0 2023-10-09T11:37:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf159a700 1 -- 172.21.15.6:0/2264392525 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4011b30 con 0x7fadf41578d0 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 -- 172.21.15.6:0/2264392525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf41578d0 msgr2=0x7fadf40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/2264392525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf41578d0 0x7fadf40cf4f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fade40098e0 tx=0x7fade40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 -- 172.21.15.6:0/2264392525 shutdown_connections 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/2264392525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf41578d0 0x7fadf40cf4f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 -- 172.21.15.6:0/2264392525 >> 172.21.15.6:0/2264392525 conn(0x7fadf406bb90 msgr2=0x7fadf406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 -- 172.21.15.6:0/2264392525 shutdown_connections 2023-10-09T11:37:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.111+0000 7fadf8e8f700 1 -- 172.21.15.6:0/2264392525 wait complete. 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.112+0000 7fadf8e8f700 1 Processor -- start 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 -- start start 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 0x7fadf40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4157ca0 0x7fadf40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40afaf0 con 0x7fadf406d120 2023-10-09T11:37:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b1b50 con 0x7fadf4157ca0 2023-10-09T11:37:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf8e8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b1220 con 0x7fadf41578d0 2023-10-09T11:37:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36722/0 (socket says 172.21.15.6:36722) 2023-10-09T11:37:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.113+0000 7fadf259c700 1 -- 172.21.15.6:0/4069519959 learned_addr learned my addr 172.21.15.6:0/4069519959 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf1d9b700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 0x7fadf40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf2d9d700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4157ca0 0x7fadf40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 -- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 msgr2=0x7fadf40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 0x7fadf40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 -- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4157ca0 msgr2=0x7fadf40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4157ca0 0x7fadf40acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 -- 172.21.15.6:0/4069519959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4009420 con 0x7fadf406d120 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf1d9b700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 0x7fadf40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf259c700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadf406fe20 tx=0x7fade4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade401f070 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade4000c90 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf40b1500 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4025420 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.114+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf40af7c0 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.115+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf4067ac0 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.115+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fade4023070 con 0x7fadf406d120 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.116+0000 7fade27fc700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.116+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fade4085920 con 0x7fadf406d120 2023-10-09T11:37:02.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.116+0000 7fadf1d9b700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.116+0000 7fadf1d9b700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 0x7fadd40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fade8007fd0 tx=0x7fade8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.120+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fade4052b90 con 0x7fadf406d120 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.357+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf40d0450 con 0x7fadf406d120 2023-10-09T11:37:02.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.358+0000 7fade27fc700 1 -- 172.21.15.6:0/4069519959 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fade402a090 con 0x7fadf406d120 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:02.359 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:02.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 msgr2=0x7fadd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 0x7fadd40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fade8007fd0 tx=0x7fade8009040 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 msgr2=0x7fadf40af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadf406fe20 tx=0x7fade4017000 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 shutdown_connections 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fadd4066f30 0x7fadd40693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadf4157ca0 0x7fadf40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf406d120 0x7fadf40af280 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 --2- 172.21.15.6:0/4069519959 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fadf41578d0 0x7fadf40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 >> 172.21.15.6:0/4069519959 conn(0x7fadf406bb90 msgr2=0x7fadf415ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 shutdown_connections 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.360+0000 7fadf8e8f700 1 -- 172.21.15.6:0/4069519959 wait complete. 2023-10-09T11:37:02.363 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:02.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T11:37:02.511 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":4968,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5131215620000003,"mdsmap_epoch":17,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":16.417563734000002} 2023-10-09T11:37:02.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 4968, "mdsmap_epoch": 17, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 8.513121562, "state": "up:active", "uptime": 16.417563734, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:37:02.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-09T11:37:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.629+0000 7f7e758a8700 1 Processor -- start 2023-10-09T11:37:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.629+0000 7f7e758a8700 1 -- start start 2023-10-09T11:37:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e758a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 0x7f7e7015b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e758a8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700cfdd0 con 0x7f7e701577e0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e758a8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700d00b0 con 0x7f7e70157bb0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e758a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700d0390 con 0x7f7e7006d950 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e6effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7e701577e0 0x7f7e700cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48426/0 (socket says 172.21.15.6:48426) 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.630+0000 7f7e6effd700 1 -- 172.21.15.6:0/1392602324 learned_addr learned my addr 172.21.15.6:0/1392602324 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6f7fe700 1 --2- 172.21.15.6:0/1392602324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 0x7f7e7015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257446093 0 0) 0x7f7e700cfdd0 con 0x7f7e701577e0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003570 con 0x7f7e701577e0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412451539 0 0) 0x7f7e700d00b0 con 0x7f7e70157bb0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e700cfdd0 con 0x7f7e70157bb0 2023-10-09T11:37:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6f7fe700 1 -- 172.21.15.6:0/1392602324 >> v1:172.21.15.118:6789/0 conn(0x7f7e70157bb0 legacy=0x7f7e7006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6f7fe700 1 -- 172.21.15.6:0/1392602324 >> v1:172.21.15.6:6789/0 conn(0x7f7e701577e0 legacy=0x7f7e700cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6f7fe700 1 -- 172.21.15.6:0/1392602324 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700d0670 con 0x7f7e7006d950 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6f7fe700 1 --2- 172.21.15.6:0/1392602324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 0x7f7e7015b070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009e90 tx=0x7f7e60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525174467a0d0aea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000e070 con 0x7f7e7006d950 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000bb80 con 0x7f7e7006d950 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.631+0000 7f7e6dffb700 1 -- 172.21.15.6:0/1392602324 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60012430 con 0x7f7e7006d950 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 -- 172.21.15.6:0/1392602324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 msgr2=0x7f7e7015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 --2- 172.21.15.6:0/1392602324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 0x7f7e7015b070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009e90 tx=0x7f7e60009780 comp rx=0 tx=0).stop 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 -- 172.21.15.6:0/1392602324 shutdown_connections 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 --2- 172.21.15.6:0/1392602324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e7006d950 0x7f7e7015b070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 -- 172.21.15.6:0/1392602324 >> 172.21.15.6:0/1392602324 conn(0x7f7e7006bb90 msgr2=0x7f7e7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 -- 172.21.15.6:0/1392602324 shutdown_connections 2023-10-09T11:37:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.632+0000 7f7e758a8700 1 -- 172.21.15.6:0/1392602324 wait complete. 2023-10-09T11:37:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.633+0000 7f7e758a8700 1 Processor -- start 2023-10-09T11:37:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.633+0000 7f7e758a8700 1 -- start start 2023-10-09T11:37:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e701577e0 0x7f7e70152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e70157bb0 0x7f7e70151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700b6a80 con 0x7f7e7006d950 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700b4f90 con 0x7f7e701577e0 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70158350 con 0x7f7e70157bb0 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36736/0 (socket says 172.21.15.6:36736) 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 -- 172.21.15.6:0/294414741 learned_addr learned my addr 172.21.15.6:0/294414741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6e7fc700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e701577e0 0x7f7e70152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6f7fe700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e70157bb0 0x7f7e70151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 -- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e70157bb0 msgr2=0x7f7e70151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e70157bb0 0x7f7e70151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 -- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e701577e0 msgr2=0x7f7e70152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e701577e0 0x7f7e70152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 -- 172.21.15.6:0/294414741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009a20 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e6effd700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c790 tx=0x7f7e68007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68005b30 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68005c90 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.634+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70152b40 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.635+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68007300 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.635+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70152e60 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.635+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e70067850 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.636+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e6801b3b0 con 0x7f7e7006d950 2023-10-09T11:37:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.636+0000 7f7e66ffd700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.636+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e68083a10 con 0x7f7e7006d950 2023-10-09T11:37:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.636+0000 7f7e6e7fc700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.637+0000 7f7e6e7fc700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 0x7f7e500693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c5cf0 tx=0x7f7e58007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.641+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e68050c80 con 0x7f7e7006d950 2023-10-09T11:37:02.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.916+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f7e7004bb80 con 0x7f7e7006d950 2023-10-09T11:37:02.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.916+0000 7f7e66ffd700 1 -- 172.21.15.6:0/294414741 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f7e68017020 con 0x7f7e7006d950 2023-10-09T11:37:02.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:02.917 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:02.917 INFO:teuthology.orchestra.run.smithi006.stdout: "stats": { 2023-10-09T11:37:02.917 INFO:teuthology.orchestra.run.smithi006.stdout: "total_bytes": 1600000000, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "total_avail_bytes": 1597747231, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_bytes": 2252769, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_raw_bytes": 2252769, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_raw_ratio": 0.0014079805696383119, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "num_osds": 8, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "num_per_pool_osds": 0, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "num_per_pool_omap_osds": 0 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "stats_by_class": { 2023-10-09T11:37:02.918 INFO:teuthology.orchestra.run.smithi006.stdout: "hdd": { 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "total_bytes": 1600000000, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "total_avail_bytes": 1597747231, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_bytes": 2252769, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_raw_bytes": 2252769, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "total_used_raw_ratio": 0.0014079805696383119 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "name": ".mgr", 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 1, 2023-10-09T11:37:02.919 INFO:teuthology.orchestra.run.smithi006.stdout: "stats": { 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "stored": 590368, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "objects": 2, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "kb_used": 577, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "bytes_used": 590368, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "percent_used": 0.00052957510342821479, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "max_avail": 557102656 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs_metadata", 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4, 2023-10-09T11:37:02.920 INFO:teuthology.orchestra.run.smithi006.stdout: "stats": { 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "stored": 2306, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "objects": 22, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "kb_used": 3, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "bytes_used": 2306, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "percent_used": 2.0696322735602735e-06, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max_avail": 557102656 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs_data", 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5, 2023-10-09T11:37:02.921 INFO:teuthology.orchestra.run.smithi006.stdout: "stats": { 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "stored": 0, 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "objects": 0, 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "kb_used": 0, 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "bytes_used": 0, 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "percent_used": 0, 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: "max_avail": 557102656 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:02.922 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 msgr2=0x7f7e500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 0x7f7e500693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e700c5cf0 tx=0x7f7e58007d50 comp rx=0 tx=0).stop 2023-10-09T11:37:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 msgr2=0x7f7e700b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c790 tx=0x7f7e68007ea0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 shutdown_connections 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7e70157bb0 0x7f7e70151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e7006d950 0x7f7e700b48a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 --2- 172.21.15.6:0/294414741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e701577e0 0x7f7e70152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.918+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 >> 172.21.15.6:0/294414741 conn(0x7f7e7006bb90 msgr2=0x7f7e701552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.919+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 shutdown_connections 2023-10-09T11:37:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:02.919+0000 7f7e758a8700 1 -- 172.21.15.6:0/294414741 wait complete. 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:37:02.931 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:37:03.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:03.186 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:37:03.256 INFO:teuthology.orchestra.run.smithi006.stdout:client4981 2023-10-09T11:37:03.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:03.257 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client4981/osdmap') 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:37:03.335 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:37:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:37:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:37:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:37:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:791 bytes copied, 3.7941e-05 s, 20.8 MB/s 2023-10-09T11:37:03.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-09T11:37:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.497+0000 7faa83397700 1 Processor -- start 2023-10-09T11:37:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.497+0000 7faa83397700 1 -- start start 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa83397700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa7c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa83397700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0b0ca0 con 0x7faa7c15a2a0 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa83397700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0b00d0 con 0x7faa7c06d650 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa83397700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c06ea90 con 0x7faa7c0cf240 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa81133700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa7c15a2a0 0x7faa7c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34678/0 (socket says 172.21.15.6:34678) 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa81133700 1 -- 172.21.15.6:0/1227849775 learned_addr learned my addr 172.21.15.6:0/1227849775 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa80932700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa7c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017710918 0 0) 0x7faa7c0b0ca0 con 0x7faa7c15a2a0 2023-10-09T11:37:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64003570 con 0x7faa7c15a2a0 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2486649623 0 0) 0x7faa64003570 con 0x7faa7c15a2a0 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 msgr2=0x7faa7c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa7c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 >> v1:172.21.15.118:6789/0 conn(0x7faa7c06d650 legacy=0x7faa7c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0b0370 con 0x7faa7c15a2a0 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7faa6c0017f0 con 0x7faa7c15a2a0 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 >> v1:172.21.15.6:6789/0 conn(0x7faa7c15a2a0 legacy=0x7faa7c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa64003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa64003fd0 0x7faa64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa64004d50 0x7faa640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c06ea90 con 0x7faa64004d50 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400bb40 con 0x7faa64003fd0 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.498+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400bd00 con 0x7faa7c0cf240 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa64003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81934700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa64004d50 0x7faa640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa80932700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa64003fd0 0x7faa64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 -- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa64003fd0 msgr2=0x7faa64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa64003fd0 0x7faa64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 -- 172.21.15.6:0/1227849775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa64004d50 msgr2=0x7faa640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa64004d50 0x7faa640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 -- 172.21.15.6:0/1227849775 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64003570 con 0x7faa7c0cf240 2023-10-09T11:37:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81934700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa64004d50 0x7faa640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa81133700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa64003a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00a950 tx=0x7faa6c0021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75cafa10ead8486 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0070d0 con 0x7faa7c0cf240 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c007250 con 0x7faa7c0cf240 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.499+0000 7faa7bfff700 1 -- 172.21.15.6:0/1227849775 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c007610 con 0x7faa7c0cf240 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 -- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 msgr2=0x7faa64003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 --2- 172.21.15.6:0/1227849775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c0cf240 0x7faa64003a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00a950 tx=0x7faa6c0021f0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa81934700 1 -- 172.21.15.6:0/1227849775 reap_dead start 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 -- 172.21.15.6:0/1227849775 shutdown_connections 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 -- 172.21.15.6:0/1227849775 >> 172.21.15.6:0/1227849775 conn(0x7faa7c067640 msgr2=0x7faa7c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 -- 172.21.15.6:0/1227849775 shutdown_connections 2023-10-09T11:37:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.500+0000 7faa83397700 1 -- 172.21.15.6:0/1227849775 wait complete. 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.501+0000 7faa83397700 1 Processor -- start 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.501+0000 7faa83397700 1 -- start start 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa7c16dfc0 0x7faa7c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c15c870 0x7faa7c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c15e520 con 0x7faa7c0cf240 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c16e7a0 con 0x7faa7c16dfc0 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa83397700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c16ea80 con 0x7faa7c15c870 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46862/0 (socket says 172.21.15.6:46862) 2023-10-09T11:37:03.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 -- 172.21.15.6:0/2341549027 learned_addr learned my addr 172.21.15.6:0/2341549027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81934700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c15c870 0x7faa7c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 -- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c15c870 msgr2=0x7faa7c156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c15c870 0x7faa7c156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa80932700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa7c16dfc0 0x7faa7c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 -- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa7c16dfc0 msgr2=0x7faa7c0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa7c16dfc0 0x7faa7c0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 -- 172.21.15.6:0/2341549027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c16ed60 con 0x7faa7c0cf240 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.502+0000 7faa81133700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00a410 tx=0x7faa6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0075d0 con 0x7faa7c0cf240 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c027420 con 0x7faa7c0cf240 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c15e7c0 con 0x7faa7c0cf240 2023-10-09T11:37:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0275b0 con 0x7faa7c0cf240 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c16e430 con 0x7faa7c0cf240 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.503+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c15eb30 con 0x7faa7c0cf240 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.504+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa6c024020 con 0x7faa7c0cf240 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.504+0000 7faa797fa700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.504+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa6c086400 con 0x7faa7c0cf240 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.504+0000 7faa80932700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.505+0000 7faa80932700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 0x7faa680693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa7c15dd80 tx=0x7faa70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.509+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa6c053720 con 0x7faa7c0cf240 2023-10-09T11:37:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:03.710+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7faa7c16eef0 con 0x7faa7c0cf240 2023-10-09T11:37:03.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:03.867 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.031+0000 7faa797fa700 1 -- 172.21.15.6:0/2341549027 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) v1 ==== 93+0+0 (secure 0 0 0) 0x7faa6c056d40 con 0x7faa7c0cf240 2023-10-09T11:37:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.033+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 msgr2=0x7faa680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.033+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 0x7faa680693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa7c15dd80 tx=0x7faa70008040 comp rx=0 tx=0).stop 2023-10-09T11:37:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.033+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 msgr2=0x7faa7c16b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.033+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00a410 tx=0x7faa6c015000 comp rx=0 tx=0).stop 2023-10-09T11:37:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 shutdown_connections 2023-10-09T11:37:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa68066f30 0x7faa680693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa7c15c870 0x7faa7c156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0cf240 0x7faa7c16b4f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 --2- 172.21.15.6:0/2341549027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa7c16dfc0 0x7faa7c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.034+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 >> 172.21.15.6:0/2341549027 conn(0x7faa7c067640 msgr2=0x7faa7c0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.035+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 shutdown_connections 2023-10-09T11:37:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.035+0000 7faa83397700 1 -- 172.21.15.6:0/2341549027 wait complete. 2023-10-09T11:37:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:pauserd,pausewr is set 2023-10-09T11:37:04.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-09T11:37:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.166+0000 7f4dc8643700 1 Processor -- start 2023-10-09T11:37:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.166+0000 7f4dc8643700 1 -- start start 2023-10-09T11:37:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.167+0000 7f4dc8643700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 0x7f4dc00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.167+0000 7f4dc8643700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.167+0000 7f4dc8643700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00b2890 con 0x7f4dc01583b0 2023-10-09T11:37:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.167+0000 7f4dc8643700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc00b4070 con 0x7f4dc0157fe0 2023-10-09T11:37:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.167+0000 7f4dc8643700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00b4350 con 0x7f4dc00cf240 2023-10-09T11:37:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc63df700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 0x7f4dc00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:48102/0 (socket says 172.21.15.6:48102) 2023-10-09T11:37:04.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 -- 172.21.15.6:0/730673425 learned_addr learned my addr 172.21.15.6:0/730673425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 -- 172.21.15.6:0/730673425 >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 msgr2=0x7f4dc00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 --2- 172.21.15.6:0/730673425 >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 0x7f4dc00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 -- 172.21.15.6:0/730673425 >> v1:172.21.15.118:6789/0 conn(0x7f4dc01583b0 legacy=0x7f4dc00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 -- 172.21.15.6:0/730673425 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00b4630 con 0x7f4dc00cf240 2023-10-09T11:37:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc63df700 1 --2- 172.21.15.6:0/730673425 >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 0x7f4dc00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc6be0700 1 --2- 172.21.15.6:0/730673425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009f20 tx=0x7f4db0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae3b8796d3d42c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.168+0000 7f4dc53dd700 1 -- 172.21.15.6:0/730673425 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000e070 con 0x7f4dc00cf240 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc53dd700 1 -- 172.21.15.6:0/730673425 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000b9d0 con 0x7f4dc00cf240 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc53dd700 1 -- 172.21.15.6:0/730673425 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00092e0 con 0x7f4dc00cf240 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 -- 172.21.15.6:0/730673425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 msgr2=0x7f4dc00b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 --2- 172.21.15.6:0/730673425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009f20 tx=0x7f4db0009840 comp rx=0 tx=0).stop 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 -- 172.21.15.6:0/730673425 shutdown_connections 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 --2- 172.21.15.6:0/730673425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc00cf240 0x7f4dc00b3a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 --2- 172.21.15.6:0/730673425 >> v2:172.21.15.118:3300/0 conn(0x7f4dc0157fe0 0x7f4dc00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 -- 172.21.15.6:0/730673425 >> 172.21.15.6:0/730673425 conn(0x7f4dc0067640 msgr2=0x7f4dc0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 -- 172.21.15.6:0/730673425 shutdown_connections 2023-10-09T11:37:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.169+0000 7f4dc8643700 1 -- 172.21.15.6:0/730673425 wait complete. 2023-10-09T11:37:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.170+0000 7f4dc8643700 1 Processor -- start 2023-10-09T11:37:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.170+0000 7f4dc8643700 1 -- start start 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dc00cf240 0x7f4dc0143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc01583b0 0x7f4dc015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0153320 con 0x7f4dc0157fe0 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cade0 con 0x7f4dc00cf240 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc8643700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00ca1d0 con 0x7f4dc01583b0 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc5bde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc5bde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46864/0 (socket says 172.21.15.6:46864) 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc5bde700 1 -- 172.21.15.6:0/4114633535 learned_addr learned my addr 172.21.15.6:0/4114633535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc63df700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dc00cf240 0x7f4dc0143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.171+0000 7f4dc6be0700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc01583b0 0x7f4dc015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 -- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc01583b0 msgr2=0x7f4dc015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc01583b0 0x7f4dc015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 -- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dc00cf240 msgr2=0x7f4dc0143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dc00cf240 0x7f4dc0143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009420 con 0x7f4dc0157fe0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc5bde700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c590 tx=0x7f4db400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011590 con 0x7f4dc0157fe0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4011710 con 0x7f4dc0157fe0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db0009ae0 con 0x7f4dc0157fe0 2023-10-09T11:37:04.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011ad0 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.172+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00ca790 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.173+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc006b6d0 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.173+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4db401b3b0 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.174+0000 7f4dbe7fc700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.174+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4db4083a60 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.174+0000 7f4dc63df700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.174+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=33+}) v3 -- 0x7f4dac06ea50 con 0x7f4dc0157fe0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.174+0000 7f4dc63df700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 0x7f4dac0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4dc015d830 tx=0x7f4db80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.178+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4db4017030 con 0x7f4dc0157fe0 2023-10-09T11:37:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:04.386+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f4dc00caf20 con 0x7f4dc0157fe0 2023-10-09T11:37:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.037+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(33..33 src has 1..33) v4 ==== 280+0+0 (secure 0 0 0) 0x7f4db4054ff0 con 0x7f4dc0157fe0 2023-10-09T11:37:05.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.037+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=34}) v3 -- 0x7f4dac06f3a0 con 0x7f4dc0157fe0 2023-10-09T11:37:05.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.040+0000 7f4dbe7fc700 1 -- 172.21.15.6:0/4114633535 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4db4017070 con 0x7f4dc0157fe0 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 msgr2=0x7f4dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 0x7f4dac0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4dc015d830 tx=0x7f4db80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 msgr2=0x7f4dc015cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c590 tx=0x7f4db400c8a0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 shutdown_connections 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4dac066f30 0x7f4dac0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dc01583b0 0x7f4dc015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dc00cf240 0x7f4dc0143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 --2- 172.21.15.6:0/4114633535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dc0157fe0 0x7f4dc015cc80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 >> 172.21.15.6:0/4114633535 conn(0x7f4dc0067640 msgr2=0x7f4dc00b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 shutdown_connections 2023-10-09T11:37:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.043+0000 7f4dc8643700 1 -- 172.21.15.6:0/4114633535 wait complete. 2023-10-09T11:37:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:pauserd,pausewr is unset 2023-10-09T11:37:05.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.180+0000 7fb9f05cc700 1 Processor -- start 2023-10-09T11:37:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.180+0000 7fb9f05cc700 1 -- start start 2023-10-09T11:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9f05cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 0x7fb9e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9f05cc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80d07c0 con 0x7fb9e806d120 2023-10-09T11:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9f05cc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80cfbb0 con 0x7fb9e81578d0 2023-10-09T11:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9f05cc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80cfe90 con 0x7fb9e8157ca0 2023-10-09T11:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9eeb69700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9e806d120 0x7fb9e815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34688/0 (socket says 172.21.15.6:34688) 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9eeb69700 1 -- 172.21.15.6:0/3118377110 learned_addr learned my addr 172.21.15.6:0/3118377110 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9edb67700 1 --2- 172.21.15.6:0/3118377110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 0x7fb9e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327238321 0 0) 0x7fb9e80d07c0 con 0x7fb9e806d120 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d4003570 con 0x7fb9e806d120 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666072785 0 0) 0x7fb9e80cfbb0 con 0x7fb9e81578d0 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e80d07c0 con 0x7fb9e81578d0 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627561980 0 0) 0x7fb9d4003570 con 0x7fb9e806d120 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9edb67700 1 -- 172.21.15.6:0/3118377110 >> v1:172.21.15.118:6789/0 conn(0x7fb9e81578d0 legacy=0x7fb9e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9edb67700 1 -- 172.21.15.6:0/3118377110 >> v1:172.21.15.6:6789/0 conn(0x7fb9e806d120 legacy=0x7fb9e815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.181+0000 7fb9edb67700 1 -- 172.21.15.6:0/3118377110 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80d0170 con 0x7fb9e8157ca0 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9edb67700 1 --2- 172.21.15.6:0/3118377110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 0x7fb9e80cf4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009910 tx=0x7fb9d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd50c941b0975e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00017f0 con 0x7fb9e8157ca0 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8011420 con 0x7fb9e8157ca0 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9ed366700 1 -- 172.21.15.6:0/3118377110 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80117a0 con 0x7fb9e8157ca0 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9f05cc700 1 -- 172.21.15.6:0/3118377110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 msgr2=0x7fb9e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/3118377110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 0x7fb9e80cf4f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009910 tx=0x7fb9d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9f05cc700 1 -- 172.21.15.6:0/3118377110 shutdown_connections 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/3118377110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e8157ca0 0x7fb9e80cf4f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.182+0000 7fb9f05cc700 1 -- 172.21.15.6:0/3118377110 >> 172.21.15.6:0/3118377110 conn(0x7fb9e806bb90 msgr2=0x7fb9e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.183+0000 7fb9f05cc700 1 -- 172.21.15.6:0/3118377110 shutdown_connections 2023-10-09T11:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.183+0000 7fb9f05cc700 1 -- 172.21.15.6:0/3118377110 wait complete. 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 Processor -- start 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 -- start start 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 0x7fb9e814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 0x7fb9e815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e814f880 con 0x7fb9e81578d0 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e816af10 con 0x7fb9e8157ca0 2023-10-09T11:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9f05cc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80b4a30 con 0x7fb9e806d120 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9edb67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9edb67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46868/0 (socket says 172.21.15.6:46868) 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.184+0000 7fb9edb67700 1 -- 172.21.15.6:0/1369942784 learned_addr learned my addr 172.21.15.6:0/1369942784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9eeb69700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 0x7fb9e815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9ee368700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 0x7fb9e814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 -- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 msgr2=0x7fb9e814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 0x7fb9e814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 -- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 msgr2=0x7fb9e815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 0x7fb9e815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 -- 172.21.15.6:0/1369942784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009420 con 0x7fb9e81578d0 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9eeb69700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 0x7fb9e815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9ee368700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 0x7fb9e814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9edb67700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009860 tx=0x7fb9d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d801cc50 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d801cdb0 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d801a6a0 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e814b0b0 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.185+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e816b120 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.186+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e8067ac0 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.186+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9d801aad0 con 0x7fb9e81578d0 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.187+0000 7fb9de7fc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 0x7fb9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.187+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9d8085ea0 con 0x7fb9e81578d0 2023-10-09T11:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.187+0000 7fb9ee368700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 0x7fb9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.187+0000 7fb9ee368700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 0x7fb9cc0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4000c00 tx=0x7fb9e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.191+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9d8053110 con 0x7fb9e81578d0 2023-10-09T11:37:05.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.383+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9e80d0450 con 0x7fb9e81578d0 2023-10-09T11:37:05.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.384+0000 7fb9de7fc700 1 -- 172.21.15.6:0/1369942784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb9d8056730 con 0x7fb9e81578d0 2023-10-09T11:37:05.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:05.385 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:05.033333+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:05.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.385+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 msgr2=0x7fb9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.385+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 0x7fb9cc0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4000c00 tx=0x7fb9e4009040 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.385+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 msgr2=0x7fb9e814ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.385+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009860 tx=0x7fb9d8016000 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 shutdown_connections 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb9cc066f30 0x7fb9cc0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9e8157ca0 0x7fb9e815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9e806d120 0x7fb9e814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 --2- 172.21.15.6:0/1369942784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e81578d0 0x7fb9e814ab70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 >> 172.21.15.6:0/1369942784 conn(0x7fb9e806bb90 msgr2=0x7fb9e8154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 shutdown_connections 2023-10-09T11:37:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.386+0000 7fb9f05cc700 1 -- 172.21.15.6:0/1369942784 wait complete. 2023-10-09T11:37:05.398 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:37:05.398 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:37:05.398 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:37:05.398 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:37:05.399 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:37:05.399 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:37:05.399 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:37:05.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:05.653 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:37:05.722 INFO:teuthology.orchestra.run.smithi006.stdout:client4981 2023-10-09T11:37:05.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:05.723 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client4981/osdmap') 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:37:05.800 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:37:05.801 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:37:05.801 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:37:05.801 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:37:05.801 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:37:05.801 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:37:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:37:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:37:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:791 bytes copied, 3.7543e-05 s, 21.1 MB/s 2023-10-09T11:37:05.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.960+0000 7f6247a3d700 1 Processor -- start 2023-10-09T11:37:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 -- start start 2023-10-09T11:37:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f624015a2a0 0x7f62400b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62400ceb30 0x7f62400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 0x7f624006da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624006ea90 con 0x7f62400ceb30 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400cf4e0 con 0x7f624006d650 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6247a3d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b0ca0 con 0x7f624015a2a0 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.961+0000 7f6244fd8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62400ceb30 0x7f62400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62400ceb30 0x7f62400cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46880/0 (socket says 172.21.15.6:46880) 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 -- 172.21.15.6:0/2103619766 learned_addr learned my addr 172.21.15.6:0/2103619766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f62457d9700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f624015a2a0 0x7f62400b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6245fda700 1 --2- 172.21.15.6:0/2103619766 >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 0x7f624006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 -- 172.21.15.6:0/2103619766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f624015a2a0 msgr2=0x7f62400b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f624015a2a0 0x7f62400b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 -- 172.21.15.6:0/2103619766 >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 msgr2=0x7f624006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 --2- 172.21.15.6:0/2103619766 >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 0x7f624006da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 -- 172.21.15.6:0/2103619766 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400b00d0 con 0x7f62400ceb30 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6245fda700 1 --2- 172.21.15.6:0/2103619766 >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 0x7f624006da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f6244fd8700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400ceb30 0x7f62400cefa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f624006b970 tx=0x7f6234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7e72e2cf58c72b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f623ffff700 1 -- 172.21.15.6:0/2103619766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400b860 con 0x7f62400ceb30 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f623ffff700 1 -- 172.21.15.6:0/2103619766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400b9c0 con 0x7f62400ceb30 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.962+0000 7f623ffff700 1 -- 172.21.15.6:0/2103619766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400bd60 con 0x7f62400ceb30 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 -- 172.21.15.6:0/2103619766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400ceb30 msgr2=0x7f62400cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400ceb30 0x7f62400cefa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f624006b970 tx=0x7f6234009250 comp rx=0 tx=0).stop 2023-10-09T11:37:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 -- 172.21.15.6:0/2103619766 shutdown_connections 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 --2- 172.21.15.6:0/2103619766 >> v2:172.21.15.118:3300/0 conn(0x7f624006d650 0x7f624006da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f624015a2a0 0x7f62400b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 --2- 172.21.15.6:0/2103619766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400ceb30 0x7f62400cefa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 -- 172.21.15.6:0/2103619766 >> 172.21.15.6:0/2103619766 conn(0x7f6240067640 msgr2=0x7f6240067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 -- 172.21.15.6:0/2103619766 shutdown_connections 2023-10-09T11:37:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.963+0000 7f6247a3d700 1 -- 172.21.15.6:0/2103619766 wait complete. 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.964+0000 7f6247a3d700 1 Processor -- start 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.964+0000 7f6247a3d700 1 -- start start 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400ceb30 0x7f62400cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 0x7f62400cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cc7e0 con 0x7f624006d650 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cbbd0 con 0x7f624015a2a0 2023-10-09T11:37:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6247a3d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cbeb0 con 0x7f62400ceb30 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46888/0 (socket says 172.21.15.6:46888) 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 -- 172.21.15.6:0/1664371026 learned_addr learned my addr 172.21.15.6:0/1664371026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6244fd8700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400ceb30 0x7f62400cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6245fda700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 0x7f62400cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 -- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400ceb30 msgr2=0x7f62400cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400ceb30 0x7f62400cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 -- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 msgr2=0x7f62400cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 0x7f62400cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f62457d9700 1 -- 172.21.15.6:0/1664371026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340094f0 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.965+0000 7f6245fda700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 0x7f62400cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f62457d9700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6238009fa0 tx=0x7f6238009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800ec70 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800edd0 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400cc190 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238014670 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.966+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62401446e0 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.967+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6240069e40 con 0x7f624006d650 2023-10-09T11:37:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.967+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62380149e0 con 0x7f624006d650 2023-10-09T11:37:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.968+0000 7f623d7fa700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.968+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6238084c10 con 0x7f624006d650 2023-10-09T11:37:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.968+0000 7f6244fd8700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.968+0000 7f6244fd8700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f624006b970 tx=0x7f6234017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:05.972+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6238051e80 con 0x7f624006d650 2023-10-09T11:37:06.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.208+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f624004bb80 con 0x7f624006d650 2023-10-09T11:37:06.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.209+0000 7f623d7fa700 1 -- 172.21.15.6:0/1664371026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f62380099c0 con 0x7f624006d650 2023-10-09T11:37:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:06.210 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.210+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 msgr2=0x7f622c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.210+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f624006b970 tx=0x7f6234017000 comp rx=0 tx=0).stop 2023-10-09T11:37:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.210+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 msgr2=0x7f62401441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.210+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6238009fa0 tx=0x7f6238009880 comp rx=0 tx=0).stop 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 shutdown_connections 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f624015a2a0 0x7f62400cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006d650 0x7f62401441a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 --2- 172.21.15.6:0/1664371026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400ceb30 0x7f62400cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 >> 172.21.15.6:0/1664371026 conn(0x7f6240067640 msgr2=0x7f62400cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 shutdown_connections 2023-10-09T11:37:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:06.211+0000 7f6247a3d700 1 -- 172.21.15.6:0/1664371026 wait complete. 2023-10-09T11:37:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:06.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 33 2023-10-09T11:37:06.359 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-09T11:37:06.359 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:37:06.359 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:37:06.360 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:37:06.360 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:37:06.360 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:37:06.360 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:37:06.360 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:37:06.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:06.614 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:37:06.684 INFO:teuthology.orchestra.run.smithi006.stdout:client4981 2023-10-09T11:37:06.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:06.684 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client4981/osdmap') 2023-10-09T11:37:06.761 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:37:06.762 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:37:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:37:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:37:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:791 bytes copied, 3.6599e-05 s, 21.6 MB/s 2023-10-09T11:37:06.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:06.764 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:37:06.832 INFO:teuthology.orchestra.run.smithi006.stdout:client4981 2023-10-09T11:37:06.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:06.832 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client4981/osdmap') 2023-10-09T11:37:06.910 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-09T11:37:06.910 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.910 INFO:teuthology.orchestra.run.smithi006.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:37:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:37:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:37:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:37:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:791 bytes copied, 3.737e-05 s, 21.2 MB/s 2023-10-09T11:37:06.913 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:37:06.913 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:37:06.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:06.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:07.033 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:37:07.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:37:07.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:07.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:07.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:37:07.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:07.095 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:37:07.111 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:37:07.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:07.111 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:07.149 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:37:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:07.149 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:37:07.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:07.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.322+0000 7f66a04f3700 1 Processor -- start 2023-10-09T11:37:07.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.322+0000 7f66a04f3700 1 -- start start 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.322+0000 7f66a04f3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6698157ca0 0x7f66980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f66a04f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f66a04f3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980d07c0 con 0x7f66981578d0 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f66a04f3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669806daa0 con 0x7f6698157ca0 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f66a04f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66980cfbb0 con 0x7f669806d120 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6698157ca0 0x7f66980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6698157ca0 0x7f66980cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46890/0 (socket says 172.21.15.6:46890) 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 -- 172.21.15.6:0/1310210436 learned_addr learned my addr 172.21.15.6:0/1310210436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669ea90700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 -- 172.21.15.6:0/1310210436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 msgr2=0x7f669806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 -- 172.21.15.6:0/1310210436 >> v1:172.21.15.118:6789/0 conn(0x7f66981578d0 legacy=0x7f669815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 -- 172.21.15.6:0/1310210436 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980cfe90 con 0x7f6698157ca0 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669da8e700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6698157ca0 0x7f66980cf4f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f668c0099b0 tx=0x7f668c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26991e1182a65073 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669d28d700 1 -- 172.21.15.6:0/1310210436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c009ea0 con 0x7f6698157ca0 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669d28d700 1 -- 172.21.15.6:0/1310210436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00b860 con 0x7f6698157ca0 2023-10-09T11:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.323+0000 7f669d28d700 1 -- 172.21.15.6:0/1310210436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00bc00 con 0x7f6698157ca0 2023-10-09T11:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 -- 172.21.15.6:0/1310210436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6698157ca0 msgr2=0x7f66980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6698157ca0 0x7f66980cf4f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f668c0099b0 tx=0x7f668c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 -- 172.21.15.6:0/1310210436 shutdown_connections 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 --2- 172.21.15.6:0/1310210436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6698157ca0 0x7f66980cf4f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 -- 172.21.15.6:0/1310210436 >> 172.21.15.6:0/1310210436 conn(0x7f669806bb90 msgr2=0x7f669806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 -- 172.21.15.6:0/1310210436 shutdown_connections 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.324+0000 7f66a04f3700 1 -- 172.21.15.6:0/1310210436 wait complete. 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.325+0000 7f66a04f3700 1 Processor -- start 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.325+0000 7f66a04f3700 1 -- start start 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669816e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6698157ca0 0x7f6698068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669816ba00 con 0x7f66981578d0 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669816eec0 con 0x7f6698157ca0 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f66a04f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669816ae80 con 0x7f669806d120 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46892/0 (socket says 172.21.15.6:46892) 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669e28f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669816e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 -- 172.21.15.6:0/2417775224 learned_addr learned my addr 172.21.15.6:0/2417775224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669ea90700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6698157ca0 0x7f6698068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 -- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 msgr2=0x7f669816e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669816e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 -- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6698157ca0 msgr2=0x7f6698068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6698157ca0 0x7f6698068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669da8e700 1 -- 172.21.15.6:0/2417775224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0094f0 con 0x7f66981578d0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.326+0000 7f669e28f700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669816e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f669da8e700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f669806fe20 tx=0x7f668c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c000d10 con 0x7f66981578d0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00bbe0 con 0x7f66981578d0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c011670 con 0x7f66981578d0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669816b160 con 0x7f66981578d0 2023-10-09T11:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.327+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669816b720 con 0x7f66981578d0 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.328+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698067ac0 con 0x7f66981578d0 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.328+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f668c011aa0 con 0x7f66981578d0 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.328+0000 7f66967fc700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 0x7f66840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.328+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f668c085c40 con 0x7f66981578d0 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.329+0000 7f669e28f700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 0x7f66840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.329+0000 7f669e28f700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 0x7f66840693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6688007fd0 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.333+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f668c052eb0 con 0x7f66981578d0 2023-10-09T11:37:07.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.571+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66980d0170 con 0x7f66981578d0 2023-10-09T11:37:07.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.572+0000 7f66967fc700 1 -- 172.21.15.6:0/2417775224 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f668c015090 con 0x7f66981578d0 2023-10-09T11:37:07.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:07.573 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.573+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 msgr2=0x7f66840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.573+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 0x7f66840693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6688007fd0 tx=0x7f6688009040 comp rx=0 tx=0).stop 2023-10-09T11:37:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.573+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 msgr2=0x7f6698068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.573+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f669806fe20 tx=0x7f668c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.573+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 shutdown_connections 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6684066f30 0x7f66840693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6698157ca0 0x7f6698068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f669806d120 0x7f669816e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 --2- 172.21.15.6:0/2417775224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66981578d0 0x7f6698068880 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 >> 172.21.15.6:0/2417775224 conn(0x7f669806bb90 msgr2=0x7f6698156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 shutdown_connections 2023-10-09T11:37:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.574+0000 7f66a04f3700 1 -- 172.21.15.6:0/2417775224 wait complete. 2023-10-09T11:37:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:07.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.703+0000 7fa8cb763700 1 Processor -- start 2023-10-09T11:37:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.704+0000 7fa8cb763700 1 -- start start 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.704+0000 7fa8cb763700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 0x7fa8c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8cb763700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40d07c0 con 0x7fa8c406d120 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8cb763700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40cfbb0 con 0x7fa8c4157ca0 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8cb763700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40cfe90 con 0x7fa8c41578d0 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c9d00700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8c406d120 0x7fa8c415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34704/0 (socket says 172.21.15.6:34704) 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c9d00700 1 -- 172.21.15.6:0/3099122553 learned_addr learned my addr 172.21.15.6:0/3099122553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c94ff700 1 --2- 172.21.15.6:0/3099122553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 0x7fa8c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731294064 0 0) 0x7fa8c40d07c0 con 0x7fa8c406d120 2023-10-09T11:37:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ac003570 con 0x7fa8c406d120 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886555147 0 0) 0x7fa8c40cfbb0 con 0x7fa8c4157ca0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c40d07c0 con 0x7fa8c4157ca0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3099122553 >> v1:172.21.15.118:6789/0 conn(0x7fa8c4157ca0 legacy=0x7fa8c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3099122553 >> v1:172.21.15.6:6789/0 conn(0x7fa8c406d120 legacy=0x7fa8c415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475571708 0 0) 0x7fa8ac003570 con 0x7fa8c406d120 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3099122553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c40d0170 con 0x7fa8c41578d0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.705+0000 7fa8c94ff700 1 --2- 172.21.15.6:0/3099122553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 0x7fa8c40cf4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009910 tx=0x7fa8b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf9e94938a1e059 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0017f0 con 0x7fa8c41578d0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b4011420 con 0x7fa8c41578d0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8c3fff700 1 -- 172.21.15.6:0/3099122553 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40117c0 con 0x7fa8c41578d0 2023-10-09T11:37:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 -- 172.21.15.6:0/3099122553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 msgr2=0x7fa8c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3099122553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 0x7fa8c40cf4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009910 tx=0x7fa8b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 -- 172.21.15.6:0/3099122553 shutdown_connections 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3099122553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c41578d0 0x7fa8c40cf4f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 -- 172.21.15.6:0/3099122553 >> 172.21.15.6:0/3099122553 conn(0x7fa8c406bb90 msgr2=0x7fa8c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 -- 172.21.15.6:0/3099122553 shutdown_connections 2023-10-09T11:37:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.706+0000 7fa8cb763700 1 -- 172.21.15.6:0/3099122553 wait complete. 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.707+0000 7fa8cb763700 1 Processor -- start 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.707+0000 7fa8cb763700 1 -- start start 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c41578d0 0x7fa8c40ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 0x7fa8c40aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40aa9c0 con 0x7fa8c406d120 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40aac60 con 0x7fa8c41578d0 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8cb763700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40aaf40 con 0x7fa8c4157ca0 2023-10-09T11:37:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8c94ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8c94ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46908/0 (socket says 172.21.15.6:46908) 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.708+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3967216435 learned_addr learned my addr 172.21.15.6:0/3967216435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c9d00700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 0x7fa8c40aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c8cfe700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c41578d0 0x7fa8c40ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 msgr2=0x7fa8c40aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 0x7fa8c40aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c41578d0 msgr2=0x7fa8c40ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c41578d0 0x7fa8c40ac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 -- 172.21.15.6:0/3967216435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009420 con 0x7fa8c406d120 2023-10-09T11:37:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c9d00700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 0x7fa8c40aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c94ff700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40091e0 tx=0x7fa8b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b401cc90 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b401cdf0 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c40ab220 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b401a6a0 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.709+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c40aba20 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.710+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c416b780 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.710+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8b401aad0 con 0x7fa8c406d120 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.711+0000 7fa8c17fa700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 0x7fa8b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.711+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8b4086470 con 0x7fa8c406d120 2023-10-09T11:37:07.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.711+0000 7fa8c8cfe700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 0x7fa8b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:07.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.711+0000 7fa8c8cfe700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 0x7fa8b00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8002730 tx=0x7fa8b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:07.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.715+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b40536e0 con 0x7fa8c406d120 2023-10-09T11:37:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.906+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c40ab740 con 0x7fa8c406d120 2023-10-09T11:37:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.907+0000 7fa8c17fa700 1 -- 172.21.15.6:0/3967216435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa8c40ab740 con 0x7fa8c406d120 2023-10-09T11:37:07.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:07.908 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:05.033333+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 msgr2=0x7fa8b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 0x7fa8b00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8002730 tx=0x7fa8b8009040 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 msgr2=0x7fa8c4148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40091e0 tx=0x7fa8b4016000 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 shutdown_connections 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa8b0066f30 0x7fa8b00693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8c4157ca0 0x7fa8c40aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c406d120 0x7fa8c4148ac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 --2- 172.21.15.6:0/3967216435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c41578d0 0x7fa8c40ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 >> 172.21.15.6:0/3967216435 conn(0x7fa8c406bb90 msgr2=0x7fa8c406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 shutdown_connections 2023-10-09T11:37:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:07.909+0000 7fa8cb763700 1 -- 172.21.15.6:0/3967216435 wait complete. 2023-10-09T11:37:07.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:36:51.297473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:36:52.354838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:37:07.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:37:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.043+0000 7f3e7759e700 1 Processor -- start 2023-10-09T11:37:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.043+0000 7f3e7759e700 1 -- start start 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 0x7f3e78159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78159b40 0x7f3e780ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e780aeeb0 0x7f3e7806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780af310 con 0x7f3e780aeeb0 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e780ae1e0 con 0x7f3e78157a90 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78158c90 con 0x7f3e78159b40 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e76d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e780aeeb0 0x7f3e7806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e76d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e780aeeb0 0x7f3e7806cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46912/0 (socket says 172.21.15.6:46912) 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e76d9d700 1 -- 172.21.15.6:0/682135529 learned_addr learned my addr 172.21.15.6:0/682135529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e7659c700 1 --2- 172.21.15.6:0/682135529 >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 0x7f3e78159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.044+0000 7f3e75d9b700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78159b40 0x7f3e780ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 -- 172.21.15.6:0/682135529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78159b40 msgr2=0x7f3e780ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78159b40 0x7f3e780ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 -- 172.21.15.6:0/682135529 >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 msgr2=0x7f3e78159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 --2- 172.21.15.6:0/682135529 >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 0x7f3e78159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 -- 172.21.15.6:0/682135529 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78158f70 con 0x7f3e780aeeb0 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e7659c700 1 --2- 172.21.15.6:0/682135529 >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 0x7f3e78159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.045+0000 7f3e76d9d700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e780aeeb0 0x7f3e7806cba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3e78071610 tx=0x7f3e70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2f6cb0b6571c66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7559a700 1 -- 172.21.15.6:0/682135529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000e070 con 0x7f3e780aeeb0 2023-10-09T11:37:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7559a700 1 -- 172.21.15.6:0/682135529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000b970 con 0x7f3e780aeeb0 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7559a700 1 -- 172.21.15.6:0/682135529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700092e0 con 0x7f3e780aeeb0 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 -- 172.21.15.6:0/682135529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e780aeeb0 msgr2=0x7f3e7806cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e780aeeb0 0x7f3e7806cba0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3e78071610 tx=0x7f3e70009840 comp rx=0 tx=0).stop 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 -- 172.21.15.6:0/682135529 shutdown_connections 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e780aeeb0 0x7f3e7806cba0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 --2- 172.21.15.6:0/682135529 >> v2:172.21.15.118:3300/0 conn(0x7f3e78157a90 0x7f3e78159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 --2- 172.21.15.6:0/682135529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e78159b40 0x7f3e780ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 -- 172.21.15.6:0/682135529 >> 172.21.15.6:0/682135529 conn(0x7f3e780cdb30 msgr2=0x7f3e7806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 -- 172.21.15.6:0/682135529 shutdown_connections 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.047+0000 7f3e7759e700 1 -- 172.21.15.6:0/682135529 wait complete. 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.048+0000 7f3e7759e700 1 Processor -- start 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 -- start start 2023-10-09T11:37:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e780aeeb0 0x7f3e780c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e78159b40 0x7f3e7806a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780aff60 con 0x7f3e78157a90 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780b1e60 con 0x7f3e78159b40 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e7759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7816a020 con 0x7f3e780aeeb0 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e75d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e75d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46922/0 (socket says 172.21.15.6:46922) 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.049+0000 7f3e75d9b700 1 -- 172.21.15.6:0/2942646450 learned_addr learned my addr 172.21.15.6:0/2942646450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e7659c700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e780aeeb0 0x7f3e780c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e76d9d700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e78159b40 0x7f3e7806a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 -- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e780aeeb0 msgr2=0x7f3e780c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e780aeeb0 0x7f3e780c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 -- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e78159b40 msgr2=0x7f3e7806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e78159b40 0x7f3e7806a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 -- 172.21.15.6:0/2942646450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009420 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e75d9b700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000ec80 tx=0x7f3e600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000c850 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6000c9b0 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e70009ae0 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000cd50 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.050+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7816a5e0 con 0x7f3e78157a90 2023-10-09T11:37:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.051+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7816a950 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.051+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e60013680 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.052+0000 7f3e6e7fc700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 0x7f3e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.052+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e600847b0 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.052+0000 7f3e7659c700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 0x7f3e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.052+0000 7f3e7659c700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 0x7f3e580693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009ea0 tx=0x7f3e680091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.056+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e60051a20 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.247+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e780c9ca0 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.247+0000 7f3e6e7fc700 1 -- 172.21.15.6:0/2942646450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e60055040 con 0x7f3e78157a90 2023-10-09T11:37:08.328 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 msgr2=0x7f3e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 0x7f3e580693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009ea0 tx=0x7f3e680091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 msgr2=0x7f3e78148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000ec80 tx=0x7f3e600091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 shutdown_connections 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e58066f30 0x7f3e580693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e78159b40 0x7f3e7806a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e780aeeb0 0x7f3e780c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 --2- 172.21.15.6:0/2942646450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e78157a90 0x7f3e78148ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 >> 172.21.15.6:0/2942646450 conn(0x7f3e780cdb30 msgr2=0x7f3e7806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 shutdown_connections 2023-10-09T11:37:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.249+0000 7f3e7759e700 1 -- 172.21.15.6:0/2942646450 wait complete. 2023-10-09T11:37:08.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:37:08.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.455+0000 7f72bc775700 1 Processor -- start 2023-10-09T11:37:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.455+0000 7f72bc775700 1 -- start start 2023-10-09T11:37:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bc775700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 0x7f72b40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bc775700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 0x7f72b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bc775700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b406dac0 con 0x7f72b4157ca0 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bc775700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b40d07c0 con 0x7f72b406d120 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bc775700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40cfbb0 con 0x7f72b41578d0 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72b9d10700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72b4157ca0 0x7f72b415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34712/0 (socket says 172.21.15.6:34712) 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72b9d10700 1 -- 172.21.15.6:0/350575161 learned_addr learned my addr 172.21.15.6:0/350575161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72ba511700 1 --2- 172.21.15.6:0/350575161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 0x7f72b40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72bad12700 1 --2- 172.21.15.6:0/350575161 >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 0x7f72b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72b950f700 1 -- 172.21.15.6:0/350575161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342651008 0 0) 0x7f72a8001110 con 0x7f72b4157ca0 2023-10-09T11:37:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72b950f700 1 -- 172.21.15.6:0/350575161 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f729c003570 con 0x7f72b4157ca0 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72ba511700 1 -- 172.21.15.6:0/350575161 >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 msgr2=0x7f72b406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72ba511700 1 --2- 172.21.15.6:0/350575161 >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 0x7f72b406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72ba511700 1 -- 172.21.15.6:0/350575161 >> v1:172.21.15.6:6789/0 conn(0x7f72b4157ca0 legacy=0x7f72b415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.456+0000 7f72ba511700 1 -- 172.21.15.6:0/350575161 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40cfe90 con 0x7f72b41578d0 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bad12700 1 --2- 172.21.15.6:0/350575161 >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 0x7f72b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72ba511700 1 --2- 172.21.15.6:0/350575161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 0x7f72b40cf4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009e60 tx=0x7f72a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6df316672d24c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72b950f700 1 -- 172.21.15.6:0/350575161 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400e070 con 0x7f72b41578d0 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72b950f700 1 -- 172.21.15.6:0/350575161 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a400bab0 con 0x7f72b41578d0 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72b950f700 1 -- 172.21.15.6:0/350575161 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400be70 con 0x7f72b41578d0 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 -- 172.21.15.6:0/350575161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 msgr2=0x7f72b40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 --2- 172.21.15.6:0/350575161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 0x7f72b40cf4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009e60 tx=0x7f72a4009780 comp rx=0 tx=0).stop 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 -- 172.21.15.6:0/350575161 shutdown_connections 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 --2- 172.21.15.6:0/350575161 >> v2:172.21.15.118:3300/0 conn(0x7f72b406d120 0x7f72b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 --2- 172.21.15.6:0/350575161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b41578d0 0x7f72b40cf4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 -- 172.21.15.6:0/350575161 >> 172.21.15.6:0/350575161 conn(0x7f72b406bb90 msgr2=0x7f72b406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.457+0000 7f72bc775700 1 -- 172.21.15.6:0/350575161 shutdown_connections 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.458+0000 7f72bc775700 1 -- 172.21.15.6:0/350575161 wait complete. 2023-10-09T11:37:08.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 Processor -- start 2023-10-09T11:37:08.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 -- start start 2023-10-09T11:37:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b406d120 0x7f72b4142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72b4157ca0 0x7f72b40689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b416daf0 con 0x7f72b41578d0 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b416ddb0 con 0x7f72b4157ca0 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72bc775700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b416e090 con 0x7f72b406d120 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72b9d10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72b9d10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46934/0 (socket says 172.21.15.6:46934) 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.459+0000 7f72b9d10700 1 -- 172.21.15.6:0/1509582312 learned_addr learned my addr 172.21.15.6:0/1509582312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72bad12700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72b4157ca0 0x7f72b40689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72ba511700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b406d120 0x7f72b4142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 -- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b406d120 msgr2=0x7f72b4142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b406d120 0x7f72b4142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 -- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72b4157ca0 msgr2=0x7f72b40689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72b4157ca0 0x7f72b40689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 -- 172.21.15.6:0/1509582312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac009420 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b9d10700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c590 tx=0x7f72a8007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8005b30 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8005cb0 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a4009a20 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007320 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.460+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b416e650 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.461+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b416e870 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.461+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72a801b3b0 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.462+0000 7f72b27fc700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 0x7f72a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.462+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72a8083930 con 0x7f72b41578d0 2023-10-09T11:37:08.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.462+0000 7f72ba511700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 0x7f72a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.462+0000 7f72ba511700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 0x7f72a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72a40011d0 tx=0x7f72a4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.466+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72a8050ba0 con 0x7f72b41578d0 2023-10-09T11:37:08.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.657+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72b406dac0 con 0x7f72b41578d0 2023-10-09T11:37:08.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.657+0000 7f72b27fc700 1 -- 172.21.15.6:0/1509582312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72b406dac0 con 0x7f72b41578d0 2023-10-09T11:37:08.658 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 msgr2=0x7f72a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 0x7f72a00693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72a40011d0 tx=0x7f72a4019000 comp rx=0 tx=0).stop 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 msgr2=0x7f72b4143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c590 tx=0x7f72a8007c70 comp rx=0 tx=0).stop 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 shutdown_connections 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72a0066f30 0x7f72a00693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72b4157ca0 0x7f72b40689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72b406d120 0x7f72b4142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 --2- 172.21.15.6:0/1509582312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b41578d0 0x7f72b4143430 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 >> 172.21.15.6:0/1509582312 conn(0x7f72b406bb90 msgr2=0x7f72b4155960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 shutdown_connections 2023-10-09T11:37:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.659+0000 7f72bc775700 1 -- 172.21.15.6:0/1509582312 wait complete. 2023-10-09T11:37:08.672 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:37:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.793+0000 7f508fcbb700 1 Processor -- start 2023-10-09T11:37:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.793+0000 7f508fcbb700 1 -- start start 2023-10-09T11:37:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508fcbb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5088157ca0 0x7f50880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508fcbb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880d07c0 con 0x7f50881578d0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508fcbb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880cfbb0 con 0x7f508806d120 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508fcbb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50880cfe90 con 0x7f5088157ca0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508da57700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f50881578d0 0x7f508815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34724/0 (socket says 172.21.15.6:34724) 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508da57700 1 -- 172.21.15.6:0/106974152 learned_addr learned my addr 172.21.15.6:0/106974152 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508d256700 1 --2- 172.21.15.6:0/106974152 >> v2:172.21.15.118:3300/0 conn(0x7f5088157ca0 0x7f50880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593290462 0 0) 0x7f50880d07c0 con 0x7f50881578d0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5070003570 con 0x7f50881578d0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914348174 0 0) 0x7f5070003570 con 0x7f50881578d0 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 >> v2:172.21.15.118:3300/0 conn(0x7f5088157ca0 msgr2=0x7f50880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 --2- 172.21.15.6:0/106974152 >> v2:172.21.15.118:3300/0 conn(0x7f5088157ca0 0x7f50880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 >> v1:172.21.15.118:6789/0 conn(0x7f508806d120 legacy=0x7f508806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880d0170 con 0x7f50881578d0 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f50800017f0 con 0x7f50881578d0 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 >> v1:172.21.15.6:6789/0 conn(0x7f50881578d0 legacy=0x7f508815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 0x7f5070003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070004810 0x7f5070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50700051c0 0x7f507000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880cfe90 con 0x7f5070003a60 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507000c0d0 con 0x7f5070004810 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.794+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507000c290 con 0x7f50700051c0 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 0x7f5070003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508d256700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070004810 0x7f5070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508e258700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50700051c0 0x7f507000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 -- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50700051c0 msgr2=0x7f507000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50700051c0 0x7f507000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 -- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070004810 msgr2=0x7f5070004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070004810 0x7f5070004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 -- 172.21.15.6:0/106974152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070003570 con 0x7f5070003a60 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508e258700 1 -- 172.21.15.6:0/106974152 reap_dead start 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508da57700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 0x7f5070003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f508000a930 tx=0x7f50800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c664a86e5b4c55c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800070d0 con 0x7f5070003a60 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080007230 con 0x7f5070003a60 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.795+0000 7f508ca55700 1 -- 172.21.15.6:0/106974152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800075d0 con 0x7f5070003a60 2023-10-09T11:37:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 -- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 msgr2=0x7f5070003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 0x7f5070003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f508000a930 tx=0x7f50800021d0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 -- 172.21.15.6:0/106974152 shutdown_connections 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 --2- 172.21.15.6:0/106974152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070003a60 0x7f5070003e70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 -- 172.21.15.6:0/106974152 >> 172.21.15.6:0/106974152 conn(0x7f508806bb90 msgr2=0x7f508806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 -- 172.21.15.6:0/106974152 shutdown_connections 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.796+0000 7f508fcbb700 1 -- 172.21.15.6:0/106974152 wait complete. 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.797+0000 7f508fcbb700 1 Processor -- start 2023-10-09T11:37:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.797+0000 7f508fcbb700 1 -- start start 2023-10-09T11:37:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070003a60 0x7f50880c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50880c7720 0x7f508816d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508815e400 con 0x7f508815da40 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880c87c0 con 0x7f5070003a60 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50880c7bb0 con 0x7f50880c7720 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46958/0 (socket says 172.21.15.6:46958) 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 -- 172.21.15.6:0/3839813639 learned_addr learned my addr 172.21.15.6:0/3839813639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508d256700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50880c7720 0x7f508816d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508da57700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070003a60 0x7f50880c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 -- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50880c7720 msgr2=0x7f508816d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50880c7720 0x7f508816d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 -- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070003a60 msgr2=0x7f50880c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070003a60 0x7f50880c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 -- 172.21.15.6:0/3839813639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880c7e90 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508e258700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5088063f70 tx=0x7f5078007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078006a30 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5078006bb0 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50880c8170 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.798+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078007030 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.799+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508806a2c0 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.800+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508816a880 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.800+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50780073a0 con 0x7f508815da40 2023-10-09T11:37:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.800+0000 7f5085ffb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 0x7f50740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.800+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5078083be0 con 0x7f508815da40 2023-10-09T11:37:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.800+0000 7f508da57700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 0x7f50740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.801+0000 7f508da57700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 0x7f50740693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5080002250 tx=0x7f5080013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.805+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f508816a880 con 0x7f508815da40 2023-10-09T11:37:08.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.996+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f508816a880 con 0x7f508815da40 2023-10-09T11:37:08.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.996+0000 7f5085ffb700 1 -- 172.21.15.6:0/3839813639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f508816a880 con 0x7f508815da40 2023-10-09T11:37:08.997 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:37:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 msgr2=0x7f50740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 0x7f50740693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5080002250 tx=0x7f5080013000 comp rx=0 tx=0).stop 2023-10-09T11:37:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 msgr2=0x7f508815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5088063f70 tx=0x7f5078007d30 comp rx=0 tx=0).stop 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 shutdown_connections 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5074066f30 0x7f50740693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f508815da40 0x7f508815dec0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5070003a60 0x7f50880c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 --2- 172.21.15.6:0/3839813639 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50880c7720 0x7f508816d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.998+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 >> 172.21.15.6:0/3839813639 conn(0x7f508806bb90 msgr2=0x7f5088068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.999+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 shutdown_connections 2023-10-09T11:37:09.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:08.999+0000 7f508fcbb700 1 -- 172.21.15.6:0/3839813639 wait complete. 2023-10-09T11:37:09.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:09.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.131+0000 7f962fc57700 1 Processor -- start 2023-10-09T11:37:09.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.131+0000 7f962fc57700 1 -- start start 2023-10-09T11:37:09.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962fc57700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9628157ca0 0x7f96280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962fc57700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 0x7f962806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962fc57700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280d07c0 con 0x7f96281578d0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962fc57700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962806daa0 con 0x7f9628157ca0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962fc57700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280cfbb0 con 0x7f962806d120 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962d9f3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96281578d0 0x7f962815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34728/0 (socket says 172.21.15.6:34728) 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962d9f3700 1 -- 172.21.15.6:0/3851828845 learned_addr learned my addr 172.21.15.6:0/3851828845 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.132+0000 7f962d1f2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9628157ca0 0x7f96280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962c9f1700 1 -- 172.21.15.6:0/3851828845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643096936 0 0) 0x7f96280d07c0 con 0x7f96281578d0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962e1f4700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 0x7f962806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962c9f1700 1 -- 172.21.15.6:0/3851828845 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9610003570 con 0x7f96281578d0 2023-10-09T11:37:09.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962d1f2700 1 -- 172.21.15.6:0/3851828845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 msgr2=0x7f962806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962d1f2700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 0x7f962806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962d1f2700 1 -- 172.21.15.6:0/3851828845 >> v1:172.21.15.6:6789/0 conn(0x7f96281578d0 legacy=0x7f962815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962d1f2700 1 -- 172.21.15.6:0/3851828845 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280cfe90 con 0x7f9628157ca0 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962e1f4700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 0x7f962806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962d1f2700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9628157ca0 0x7f96280cf4f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f961c0098e0 tx=0x7f961c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f74cd86fd1c8f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962c9f1700 1 -- 172.21.15.6:0/3851828845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00b640 con 0x7f9628157ca0 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962c9f1700 1 -- 172.21.15.6:0/3851828845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c00b7a0 con 0x7f9628157ca0 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962c9f1700 1 -- 172.21.15.6:0/3851828845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00bb20 con 0x7f9628157ca0 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962fc57700 1 -- 172.21.15.6:0/3851828845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9628157ca0 msgr2=0x7f96280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.133+0000 7f962fc57700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9628157ca0 0x7f96280cf4f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f961c0098e0 tx=0x7f961c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 -- 172.21.15.6:0/3851828845 shutdown_connections 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f962806d120 0x7f962806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 --2- 172.21.15.6:0/3851828845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9628157ca0 0x7f96280cf4f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 -- 172.21.15.6:0/3851828845 >> 172.21.15.6:0/3851828845 conn(0x7f962806bb90 msgr2=0x7f962806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 -- 172.21.15.6:0/3851828845 shutdown_connections 2023-10-09T11:37:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.134+0000 7f962fc57700 1 -- 172.21.15.6:0/3851828845 wait complete. 2023-10-09T11:37:09.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 Processor -- start 2023-10-09T11:37:09.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 -- start start 2023-10-09T11:37:09.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96281578d0 0x7f96280c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9628157ca0 0x7f96280c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96280b5630 con 0x7f962806d120 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962816d990 con 0x7f96281578d0 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.135+0000 7f962fc57700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280b4a20 con 0x7f9628157ca0 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46968/0 (socket says 172.21.15.6:46968) 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 -- 172.21.15.6:0/4102326164 learned_addr learned my addr 172.21.15.6:0/4102326164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d1f2700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96281578d0 0x7f96280c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962e1f4700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9628157ca0 0x7f96280c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 -- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9628157ca0 msgr2=0x7f96280c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9628157ca0 0x7f96280c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 -- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96281578d0 msgr2=0x7f96280c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96281578d0 0x7f96280c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 -- 172.21.15.6:0/4102326164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009420 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962d9f3700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f96200011e0 tx=0x7f9620007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620005b30 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620005c90 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96280b4d00 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620007300 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.136+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96280b52c0 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.137+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9628067ac0 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.138+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9620007670 con 0x7f962806d120 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.138+0000 7f9625ffb700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.138+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9620083940 con 0x7f962806d120 2023-10-09T11:37:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.138+0000 7f962d1f2700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.139+0000 7f962d1f2700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 0x7f96140693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96281580c0 tx=0x7f961c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.142+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9620050bb0 con 0x7f962806d120 2023-10-09T11:37:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.375+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96280d0170 con 0x7f962806d120 2023-10-09T11:37:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.376+0000 7f9625ffb700 1 -- 172.21.15.6:0/4102326164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f9620017020 con 0x7f962806d120 2023-10-09T11:37:09.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:09.377 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 msgr2=0x7f96140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 0x7f96140693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96281580c0 tx=0x7f961c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 msgr2=0x7f962816d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f96200011e0 tx=0x7f9620007df0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 shutdown_connections 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9614066f30 0x7f96140693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9628157ca0 0x7f96280c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f962806d120 0x7f962816d450 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 --2- 172.21.15.6:0/4102326164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96281578d0 0x7f96280c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 >> 172.21.15.6:0/4102326164 conn(0x7f962806bb90 msgr2=0x7f9628155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 shutdown_connections 2023-10-09T11:37:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.378+0000 7f962fc57700 1 -- 172.21.15.6:0/4102326164 wait complete. 2023-10-09T11:37:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:09.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:09.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.508+0000 7f2bf7159700 1 Processor -- start 2023-10-09T11:37:09.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.508+0000 7f2bf7159700 1 -- start start 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf7159700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2bf0157ca0 0x7f2bf00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf7159700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf00d07c0 con 0x7f2bf01578d0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf7159700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf00cfbb0 con 0x7f2bf006d120 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf7159700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00cfe90 con 0x7f2bf0157ca0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf4ef5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2bf01578d0 0x7f2bf015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34738/0 (socket says 172.21.15.6:34738) 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bf4ef5700 1 -- 172.21.15.6:0/3981549073 learned_addr learned my addr 172.21.15.6:0/3981549073 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2beffff700 1 --2- 172.21.15.6:0/3981549073 >> v2:172.21.15.118:3300/0 conn(0x7f2bf0157ca0 0x7f2bf00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.509+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554141630 0 0) 0x7f2bf00d07c0 con 0x7f2bf01578d0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd8003570 con 0x7f2bf01578d0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023374364 0 0) 0x7f2bd8003570 con 0x7f2bf01578d0 2023-10-09T11:37:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2beffff700 1 -- 172.21.15.6:0/3981549073 >> v1:172.21.15.118:6789/0 conn(0x7f2bf006d120 legacy=0x7f2bf006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2beffff700 1 -- 172.21.15.6:0/3981549073 >> v1:172.21.15.6:6789/0 conn(0x7f2bf01578d0 legacy=0x7f2bf015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2beffff700 1 -- 172.21.15.6:0/3981549073 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00d0170 con 0x7f2bf0157ca0 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2beffff700 1 --2- 172.21.15.6:0/3981549073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf00cf4f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2be40098e0 tx=0x7f2be40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35cb7bb32d1f56de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80017f0 con 0x7f2bf0157ca0 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be4011420 con 0x7f2bf0157ca0 2023-10-09T11:37:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.510+0000 7f2bef7fe700 1 -- 172.21.15.6:0/3981549073 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40117c0 con 0x7f2bf0157ca0 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 -- 172.21.15.6:0/3981549073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 msgr2=0x7f2bf00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 --2- 172.21.15.6:0/3981549073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf00cf4f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2be40098e0 tx=0x7f2be40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 -- 172.21.15.6:0/3981549073 shutdown_connections 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 --2- 172.21.15.6:0/3981549073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf00cf4f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 -- 172.21.15.6:0/3981549073 >> 172.21.15.6:0/3981549073 conn(0x7f2bf006bb90 msgr2=0x7f2bf006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 -- 172.21.15.6:0/3981549073 shutdown_connections 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.511+0000 7f2bf7159700 1 -- 172.21.15.6:0/3981549073 wait complete. 2023-10-09T11:37:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.512+0000 7f2bf7159700 1 Processor -- start 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.512+0000 7f2bf7159700 1 -- start start 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2bf006d120 0x7f2bf013d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf016e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0159e80 con 0x7f2bf01578d0 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf016a890 con 0x7f2bf0157ca0 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf7159700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0159270 con 0x7f2bf006d120 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46970/0 (socket says 172.21.15.6:46970) 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 -- 172.21.15.6:0/1103425673 learned_addr learned my addr 172.21.15.6:0/1103425673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf56f6700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf016e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2bf4ef5700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2bf006d120 0x7f2bf013d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 -- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2bf006d120 msgr2=0x7f2bf013d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2bf006d120 0x7f2bf013d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 -- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 msgr2=0x7f2bf016e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf016e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 -- 172.21.15.6:0/1103425673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009420 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2beffff700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2be40091e0 tx=0x7f2be4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.513+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be401cb30 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.514+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be401cc90 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.514+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf0159550 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.514+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be401a6a0 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.514+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf0159b10 con 0x7f2bf01578d0 2023-10-09T11:37:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.514+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0159ca0 con 0x7f2bf01578d0 2023-10-09T11:37:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.515+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2be401aa50 con 0x7f2bf01578d0 2023-10-09T11:37:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.515+0000 7f2becff9700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 0x7f2bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.515+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2be4085d20 con 0x7f2bf01578d0 2023-10-09T11:37:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.515+0000 7f2bf4ef5700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 0x7f2bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.516+0000 7f2bf4ef5700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 0x7f2bdc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2be8007fd0 tx=0x7f2be8007c70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.520+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2be4052f90 con 0x7f2bf01578d0 2023-10-09T11:37:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.712+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bf006e7e0 con 0x7f2bf01578d0 2023-10-09T11:37:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.713+0000 7f2becff9700 1 -- 172.21.15.6:0/1103425673 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f2be40565b0 con 0x7f2bf01578d0 2023-10-09T11:37:09.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:05.033333+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 msgr2=0x7f2bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 0x7f2bdc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2be8007fd0 tx=0x7f2be8007c70 comp rx=0 tx=0).stop 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 msgr2=0x7f2bf014d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2be40091e0 tx=0x7f2be4016000 comp rx=0 tx=0).stop 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 shutdown_connections 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2bdc066f30 0x7f2bdc0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bf0157ca0 0x7f2bf016e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2bf006d120 0x7f2bf013d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 --2- 172.21.15.6:0/1103425673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf01578d0 0x7f2bf014d950 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 >> 172.21.15.6:0/1103425673 conn(0x7f2bf006bb90 msgr2=0x7f2bf0070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 shutdown_connections 2023-10-09T11:37:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.715+0000 7f2bf7159700 1 -- 172.21.15.6:0/1103425673 wait complete. 2023-10-09T11:37:09.728 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:37:09.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 Processor -- start 2023-10-09T11:37:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 -- start start 2023-10-09T11:37:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c15a2a0 0x7f1c9c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0cf4e0 con 0x7f1c9c0ceb30 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c06ea90 con 0x7f1c9c06dd60 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.846+0000 7f1ca2497700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b0ca0 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46978/0 (socket says 172.21.15.6:46978) 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1204325574 learned_addr learned my addr 172.21.15.6:0/1204325574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1c9bfff700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c15a2a0 0x7f1c9c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1204325574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c15a2a0 msgr2=0x7f1c9c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c15a2a0 0x7f1c9c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1204325574 >> v1:172.21.15.118:6789/0 conn(0x7f1c9c0ceb30 legacy=0x7f1c9c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1204325574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0b00d0 con 0x7f1c9c06dd60 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1ca0a34700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009f20 tx=0x7f1c94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878de344ca5215f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1c9affd700 1 -- 172.21.15.6:0/1204325574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400e070 con 0x7f1c9c06dd60 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1c9affd700 1 -- 172.21.15.6:0/1204325574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400ba40 con 0x7f1c9c06dd60 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.847+0000 7f1c9affd700 1 -- 172.21.15.6:0/1204325574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940092e0 con 0x7f1c9c06dd60 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 -- 172.21.15.6:0/1204325574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c06dd60 msgr2=0x7f1c9c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009f20 tx=0x7f1c94009840 comp rx=0 tx=0).stop 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 -- 172.21.15.6:0/1204325574 shutdown_connections 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c0cefa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1204325574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c15a2a0 0x7f1c9c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 -- 172.21.15.6:0/1204325574 >> 172.21.15.6:0/1204325574 conn(0x7f1c9c067640 msgr2=0x7f1c9c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 -- 172.21.15.6:0/1204325574 shutdown_connections 2023-10-09T11:37:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.848+0000 7f1ca2497700 1 -- 172.21.15.6:0/1204325574 wait complete. 2023-10-09T11:37:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.849+0000 7f1ca2497700 1 Processor -- start 2023-10-09T11:37:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.849+0000 7f1ca2497700 1 -- start start 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c16b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c0ceb30 0x7f1c9c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c16dcc0 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c1564a0 con 0x7f1c9c06dd60 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca2497700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c156780 con 0x7f1c9c0ceb30 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46986/0 (socket says 172.21.15.6:46986) 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1747912351 learned_addr learned my addr 172.21.15.6:0/1747912351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1c9bfff700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c16b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1c9b7fe700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c0ceb30 0x7f1c9c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c0ceb30 msgr2=0x7f1c9c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c0ceb30 0x7f1c9c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 msgr2=0x7f1c9c16b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c16b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1ca0a34700 1 -- 172.21.15.6:0/1747912351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94009ae0 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.850+0000 7f1c9bfff700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c16b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1ca0a34700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06f990 tx=0x7f1c94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940032f0 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94012d00 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c156a60 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9401d670 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.851+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c156190 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.852+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c069e40 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.852+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c9401da60 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.853+0000 7f1c83fff700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 0x7f1c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.853+0000 7f1c9bfff700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 0x7f1c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.853+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c94085c70 con 0x7f1c9c15a2a0 2023-10-09T11:37:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.853+0000 7f1c9bfff700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 0x7f1c880693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c90006fd0 tx=0x7f1c90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:09.857+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c94052ee0 con 0x7f1c9c15a2a0 2023-10-09T11:37:10.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.095+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c9c0b4aa0 con 0x7f1c9c15a2a0 2023-10-09T11:37:10.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.095+0000 7f1c83fff700 1 -- 172.21.15.6:0/1747912351 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1c94056500 con 0x7f1c9c15a2a0 2023-10-09T11:37:10.096 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:10.096 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:10.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 msgr2=0x7f1c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 0x7f1c880693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c90006fd0 tx=0x7f1c90008040 comp rx=0 tx=0).stop 2023-10-09T11:37:10.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 msgr2=0x7f1c9c142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06f990 tx=0x7f1c94017000 comp rx=0 tx=0).stop 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 shutdown_connections 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c88066f30 0x7f1c880693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c9c15a2a0 0x7f1c9c142f40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c9c06dd60 0x7f1c9c16b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 --2- 172.21.15.6:0/1747912351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c9c0ceb30 0x7f1c9c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.097+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 >> 172.21.15.6:0/1747912351 conn(0x7f1c9c067640 msgr2=0x7f1c9c0cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.098+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 shutdown_connections 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.098+0000 7f1ca2497700 1 -- 172.21.15.6:0/1747912351 wait complete. 2023-10-09T11:37:10.099 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:10.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:10.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.228+0000 7f75d0a8d700 1 Processor -- start 2023-10-09T11:37:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.228+0000 7f75d0a8d700 1 -- start start 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75d0a8d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75cc0ce1f0 0x7f75cc0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75d0a8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75cc06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75d0a8d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc15dfb0 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75d0a8d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0acec0 con 0x7f75cc0ce1f0 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75d0a8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0ad1a0 con 0x7f75cc0ac570 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75cc0ce5c0 0x7f75cc15e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34750/0 (socket says 172.21.15.6:34750) 2023-10-09T11:37:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c9d9b700 1 -- 172.21.15.6:0/1118477526 learned_addr learned my addr 172.21.15.6:0/1118477526 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991018398 0 0) 0x7f75cc15dfb0 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75cad9d700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75cc06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1118477526 >> v2:172.21.15.118:3300/0 conn(0x7f75cc0ce1f0 0x7f75cc0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b8003570 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517821938 0 0) 0x7f75b8003570 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 msgr2=0x7f75cc06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75cc06e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 >> v2:172.21.15.118:3300/0 conn(0x7f75cc0ce1f0 msgr2=0x7f75cc0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 --2- 172.21.15.6:0/1118477526 >> v2:172.21.15.118:3300/0 conn(0x7f75cc0ce1f0 0x7f75cc0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc15dc40 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.229+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f75b4001470 con 0x7f75cc0ce5c0 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 >> v1:172.21.15.6:6789/0 conn(0x7f75cc0ce5c0 legacy=0x7f75cc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8003a60 0x7f75b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b8004d50 0x7f75b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0acec0 con 0x7f75b8003a60 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0ad1a0 con 0x7f75b8004d50 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b800ba60 con 0x7f75cc0ac570 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8003a60 0x7f75b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c9d9b700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75cad9d700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b8004d50 0x7f75b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 -- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 msgr2=0x7f75b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75cc0ac570 0x7f75b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 -- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b8004d50 msgr2=0x7f75b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75b8004d50 0x7f75b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 -- 172.21.15.6:0/1118477526 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8003570 con 0x7f75b8003a60 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8003a60 0x7f75b8003e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e210 tx=0x7f75c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5469d2df0d806ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ea60 con 0x7f75b8003a60 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400f040 con 0x7f75b8003a60 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.230+0000 7f75c959a700 1 -- 172.21.15.6:0/1118477526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ee10 con 0x7f75b8003a60 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1118477526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8003a60 msgr2=0x7f75b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1118477526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8003a60 0x7f75b8003e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f75c400e210 tx=0x7f75c400b040 comp rx=0 tx=0).stop 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75cad9d700 1 -- 172.21.15.6:0/1118477526 reap_dead start 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1118477526 shutdown_connections 2023-10-09T11:37:10.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1118477526 >> 172.21.15.6:0/1118477526 conn(0x7f75cc06cca0 msgr2=0x7f75cc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1118477526 shutdown_connections 2023-10-09T11:37:10.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.231+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1118477526 wait complete. 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.232+0000 7f75d0a8d700 1 Processor -- start 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.232+0000 7f75d0a8d700 1 -- start start 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b8003a60 0x7f75cc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75cc155a10 0x7f75cc1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc155800 con 0x7f75cc16a060 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0af670 con 0x7f75cc155a10 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75d0a8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0aeaa0 con 0x7f75b8003a60 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75ca59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b8003a60 0x7f75cc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47010/0 (socket says 172.21.15.6:47010) 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 -- 172.21.15.6:0/1911095119 learned_addr learned my addr 172.21.15.6:0/1911095119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75c9d9b700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75cc155a10 0x7f75cc1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 -- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b8003a60 msgr2=0x7f75cc154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b8003a60 0x7f75cc154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 -- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75cc155a10 msgr2=0x7f75cc1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75cc155a10 0x7f75cc1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 -- 172.21.15.6:0/1911095119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0aed40 con 0x7f75cc16a060 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.233+0000 7f75cad9d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f75cc06b2e0 tx=0x7f75bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc013750 con 0x7f75cc16a060 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0138b0 con 0x7f75cc16a060 2023-10-09T11:37:10.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0af020 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc013c50 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc154c20 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.234+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc155de0 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.235+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75bc014440 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.235+0000 7f75c27fc700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 0x7f75ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.235+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75bc084a30 con 0x7f75cc16a060 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.235+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 0x7f75ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.236+0000 7f75ca59c700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 0x7f75ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75c400afd0 tx=0x7f75c401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.240+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75bc051d20 con 0x7f75cc16a060 2023-10-09T11:37:10.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.477+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75cc0aca10 con 0x7f75cc16a060 2023-10-09T11:37:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.477+0000 7f75c27fc700 1 -- 172.21.15.6:0/1911095119 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f75bc022090 con 0x7f75cc16a060 2023-10-09T11:37:10.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:10.478 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:36:53.371494+0000","modified":"2023-10-09T11:36:57.010394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/4029072358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":4029072358},{"type":"v1","addr":"172.21.15.6:6837","nonce":4029072358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 msgr2=0x7f75ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 0x7f75ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75c400afd0 tx=0x7f75c401a000 comp rx=0 tx=0).stop 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 msgr2=0x7f75cc0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f75cc06b2e0 tx=0x7f75bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 shutdown_connections 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f75ac066f30 0x7f75ac0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc16a060 0x7f75cc0b2060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.479+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75b8003a60 0x7f75cc154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.480+0000 7f75d0a8d700 1 --2- 172.21.15.6:0/1911095119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75cc155a10 0x7f75cc1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.480+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 >> 172.21.15.6:0/1911095119 conn(0x7f75cc06cca0 msgr2=0x7f75cc1565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.480+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 shutdown_connections 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.480+0000 7f75d0a8d700 1 -- 172.21.15.6:0/1911095119 wait complete. 2023-10-09T11:37:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-10-09T11:37:10.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.610+0000 7f66a5d72700 1 Processor -- start 2023-10-09T11:37:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.610+0000 7f66a5d72700 1 -- start start 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.611+0000 7f66a5d72700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ce1f0 0x7f66a00aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.611+0000 7f66a5d72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 0x7f66a006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.611+0000 7f66a5d72700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a015dfb0 con 0x7f66a00ce5c0 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.611+0000 7f66a5d72700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00acec0 con 0x7f66a00ce1f0 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.611+0000 7f66a5d72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00ad1a0 con 0x7f66a00ac570 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ce1f0 0x7f66a00aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 0x7f66a006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66a00ce1f0 0x7f66a00aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:53916/0 (socket says 172.21.15.6:53916) 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669effd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f66a00ce5c0 0x7f66a015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:43320/0 (socket says 172.21.15.6:43320) 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669ffff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 0x7f66a006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:48324/0 (socket says 172.21.15.6:48324) 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 -- 172.21.15.6:0/256824153 learned_addr learned my addr 172.21.15.6:0/256824153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 -- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 msgr2=0x7f66a006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 --2- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 0x7f66a006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 -- 172.21.15.6:0/256824153 >> v1:172.21.15.118:6789/0 conn(0x7f66a00ce5c0 legacy=0x7f66a015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 -- 172.21.15.6:0/256824153 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a015dc40 con 0x7f66a00ce1f0 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669e7fc700 1 -- 172.21.15.6:0/256824153 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369906282 0 0) 0x7f66a015dfb0 con 0x7f66a00ce5c0 2023-10-09T11:37:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669f7fe700 1 --2- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce1f0 0x7f66a00aacf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66900099b0 tx=0x7f6690009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1752e07126cf4ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669e7fc700 1 -- 172.21.15.6:0/256824153 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690009ea0 con 0x7f66a00ce1f0 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669e7fc700 1 -- 172.21.15.6:0/256824153 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000b860 con 0x7f66a00ce1f0 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.612+0000 7f669e7fc700 1 -- 172.21.15.6:0/256824153 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000bc00 con 0x7f66a00ce1f0 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 -- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce1f0 msgr2=0x7f66a00aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 --2- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce1f0 0x7f66a00aacf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66900099b0 tx=0x7f6690009250 comp rx=0 tx=0).stop 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 -- 172.21.15.6:0/256824153 shutdown_connections 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 --2- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ac570 0x7f66a006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 --2- 172.21.15.6:0/256824153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce1f0 0x7f66a00aacf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 -- 172.21.15.6:0/256824153 >> 172.21.15.6:0/256824153 conn(0x7f66a006cca0 msgr2=0x7f66a006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 -- 172.21.15.6:0/256824153 shutdown_connections 2023-10-09T11:37:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.613+0000 7f66a5d72700 1 -- 172.21.15.6:0/256824153 wait complete. 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.614+0000 7f66a5d72700 1 Processor -- start 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.614+0000 7f66a5d72700 1 -- start start 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ce1f0 0x7f66a00c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce5c0 0x7f66a016a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00b0450 con 0x7f66a00ac570 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0156740 con 0x7f66a00ce5c0 2023-10-09T11:37:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f66a5d72700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00ae9e0 con 0x7f66a00ce1f0 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47022/0 (socket says 172.21.15.6:47022) 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 -- 172.21.15.6:0/2928783007 learned_addr learned my addr 172.21.15.6:0/2928783007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669effd700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ce1f0 0x7f66a00c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669ffff700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce5c0 0x7f66a016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 -- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ce1f0 msgr2=0x7f66a00c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ce1f0 0x7f66a00c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 -- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce5c0 msgr2=0x7f66a016a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce5c0 0x7f66a016a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 -- 172.21.15.6:0/2928783007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900094f0 con 0x7f66a00ac570 2023-10-09T11:37:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.615+0000 7f669f7fe700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f66a006cc70 tx=0x7f6690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.616+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690000d10 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.616+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00addd0 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.616+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000bbe0 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.616+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690011690 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.616+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a00ae390 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.617+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a00aecc0 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.617+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6690011ac0 con 0x7f66a00ac570 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.617+0000 7f66877fe700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.617+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6690085ec0 con 0x7f66a00ac570 2023-10-09T11:37:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.617+0000 7f669effd700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.618+0000 7f669effd700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f66a0157da0 tx=0x7f6694007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.622+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6690053130 con 0x7f66a00ac570 2023-10-09T11:37:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.815+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66a00aca10 con 0x7f66a00ac570 2023-10-09T11:37:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.816+0000 7f66877fe700 1 -- 172.21.15.6:0/2928783007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6690056750 con 0x7f66a00ac570 2023-10-09T11:37:10.817 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:10.817 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:05.033333+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:36:51.297473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T11:36:52.354838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 msgr2=0x7f668c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 0x7f668c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f66a0157da0 tx=0x7f6694007d50 comp rx=0 tx=0).stop 2023-10-09T11:37:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 msgr2=0x7f66a00aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f66a006cc70 tx=0x7f6690017000 comp rx=0 tx=0).stop 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 shutdown_connections 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f668c066f30 0x7f668c0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00ce5c0 0x7f66a016a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a00ac570 0x7f66a00aee70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 --2- 172.21.15.6:0/2928783007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66a00ce1f0 0x7f66a00c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.818+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 >> 172.21.15.6:0/2928783007 conn(0x7f66a006cca0 msgr2=0x7f66a006e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.819+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 shutdown_connections 2023-10-09T11:37:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.819+0000 7f66a5d72700 1 -- 172.21.15.6:0/2928783007 wait complete. 2023-10-09T11:37:10.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:37:10.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.952+0000 7fdc4e8b6700 1 Processor -- start 2023-10-09T11:37:10.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.952+0000 7fdc4e8b6700 1 -- start start 2023-10-09T11:37:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4e8b6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc481578d0 0x7fdc480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4e8b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc4806d120 0x7fdc4806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4e8b6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4806dac0 con 0x7fdc48157ca0 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4e8b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480d07c0 con 0x7fdc4806d120 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4e8b6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480cfbb0 con 0x7fdc481578d0 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4ce53700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc4806d120 0x7fdc4806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4ce53700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc4806d120 0x7fdc4806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47030/0 (socket says 172.21.15.6:47030) 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc4ce53700 1 -- 172.21.15.6:0/2068862822 learned_addr learned my addr 172.21.15.6:0/2068862822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc477fe700 1 --1- 172.21.15.6:0/2068862822 >> v1:172.21.15.118:6789/0 conn(0x7fdc48157ca0 0x7fdc4815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:43322/0 (socket says 172.21.15.6:43322) 2023-10-09T11:37:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.953+0000 7fdc47fff700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc481578d0 0x7fdc480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc46ffd700 1 -- 172.21.15.6:0/2068862822 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722525281 0 0) 0x7fdc30001110 con 0x7fdc48157ca0 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4ce53700 1 -- 172.21.15.6:0/2068862822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc481578d0 msgr2=0x7fdc480cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4ce53700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc481578d0 0x7fdc480cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4ce53700 1 -- 172.21.15.6:0/2068862822 >> v1:172.21.15.118:6789/0 conn(0x7fdc48157ca0 legacy=0x7fdc4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4ce53700 1 -- 172.21.15.6:0/2068862822 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480cfe90 con 0x7fdc4806d120 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4ce53700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4806d120 0x7fdc4806d580 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009f20 tx=0x7fdc40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1365c09b2cf9535a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc46ffd700 1 -- 172.21.15.6:0/2068862822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000e070 con 0x7fdc4806d120 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc46ffd700 1 -- 172.21.15.6:0/2068862822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000b9d0 con 0x7fdc4806d120 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc46ffd700 1 -- 172.21.15.6:0/2068862822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400092e0 con 0x7fdc4806d120 2023-10-09T11:37:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/2068862822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4806d120 msgr2=0x7fdc4806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4806d120 0x7fdc4806d580 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009f20 tx=0x7fdc40009840 comp rx=0 tx=0).stop 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/2068862822 shutdown_connections 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc4806d120 0x7fdc4806d580 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.954+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/2068862822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc481578d0 0x7fdc480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.955+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/2068862822 >> 172.21.15.6:0/2068862822 conn(0x7fdc4806bb90 msgr2=0x7fdc4806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.955+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/2068862822 shutdown_connections 2023-10-09T11:37:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.955+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/2068862822 wait complete. 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.956+0000 7fdc4e8b6700 1 Processor -- start 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.956+0000 7fdc4e8b6700 1 -- start start 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.956+0000 7fdc4e8b6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc4806d120 0x7fdc480b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.956+0000 7fdc4e8b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc48157ca0 0x7fdc4814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480b4f20 con 0x7fdc481578d0 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48152210 con 0x7fdc48157ca0 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481518e0 con 0x7fdc4806d120 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47038/0 (socket says 172.21.15.6:47038) 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 -- 172.21.15.6:0/3566978391 learned_addr learned my addr 172.21.15.6:0/3566978391 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc47fff700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc4806d120 0x7fdc480b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4ce53700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc48157ca0 0x7fdc4814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 -- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc4806d120 msgr2=0x7fdc480b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc4806d120 0x7fdc480b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 -- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc48157ca0 msgr2=0x7fdc4814d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc48157ca0 0x7fdc4814d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 -- 172.21.15.6:0/3566978391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009ae0 con 0x7fdc481578d0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc477fe700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c5e0 tx=0x7fdc30001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30005a70 con 0x7fdc481578d0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30005bd0 con 0x7fdc481578d0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48151bc0 con 0x7fdc481578d0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc300070d0 con 0x7fdc481578d0 2023-10-09T11:37:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.957+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480b4af0 con 0x7fdc481578d0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.958+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc48067ac0 con 0x7fdc481578d0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.959+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc30007480 con 0x7fdc481578d0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.959+0000 7fdc3ffff700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 0x7fdc280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.959+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc300837c0 con 0x7fdc481578d0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.959+0000 7fdc47fff700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 0x7fdc280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.959+0000 7fdc47fff700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 0x7fdc280693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009db0 tx=0x7fdc380091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:10.963+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc30050a30 con 0x7fdc481578d0 2023-10-09T11:37:11.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.207+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc48152060 con 0x7fdc481578d0 2023-10-09T11:37:11.208 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:37:11.207+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:37:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.212+0000 7fdc3ffff700 1 -- 172.21.15.6:0/3566978391 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc30017090 con 0x7fdc481578d0 2023-10-09T11:37:11.214 INFO:tasks.ceph.mds.c.smithi006.stderr: -3348> 2023-10-09T11:36:57.954+0000 7ffa282ab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:37:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 msgr2=0x7fdc280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 0x7fdc280693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009db0 tx=0x7fdc380091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 msgr2=0x7fdc48155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c5e0 tx=0x7fdc30001040 comp rx=0 tx=0).stop 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 shutdown_connections 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdc28066f30 0x7fdc280693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc48157ca0 0x7fdc4814d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc4806d120 0x7fdc480b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 --2- 172.21.15.6:0/3566978391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc481578d0 0x7fdc48155580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 >> 172.21.15.6:0/3566978391 conn(0x7fdc4806bb90 msgr2=0x7fdc48070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 shutdown_connections 2023-10-09T11:37:11.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.214+0000 7fdc4e8b6700 1 -- 172.21.15.6:0/3566978391 wait complete. 2023-10-09T11:37:11.217 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:37:11.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:37:11.239 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:37:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.348+0000 7f1ebf59e700 1 Processor -- start 2023-10-09T11:37:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.348+0000 7f1ebf59e700 1 -- start start 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebf59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ec00d0f50 0x7f1ec006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebf59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec006d990 con 0x7f1ec006d530 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebf59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00cf2d0 con 0x7f1ec00d0b80 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebf59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec015a690 con 0x7f1ec00d0f50 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1ec006d530 0x7f1ec015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34762/0 (socket says 172.21.15.6:34762) 2023-10-09T11:37:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebed9d700 1 -- 172.21.15.6:0/2076193735 learned_addr learned my addr 172.21.15.6:0/2076193735 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/2076193735 >> v2:172.21.15.118:3300/0 conn(0x7f1ec00d0f50 0x7f1ec006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.349+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780571428 0 0) 0x7f1ec006d990 con 0x7f1ec006d530 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eac003570 con 0x7f1ec006d530 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715500621 0 0) 0x7f1eac003570 con 0x7f1ec006d530 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 >> v2:172.21.15.118:3300/0 conn(0x7f1ec00d0f50 msgr2=0x7f1ec006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 --2- 172.21.15.6:0/2076193735 >> v2:172.21.15.118:3300/0 conn(0x7f1ec00d0f50 0x7f1ec006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 >> v1:172.21.15.118:6789/0 conn(0x7f1ec00d0b80 legacy=0x7f1ec00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00d0480 con 0x7f1ec006d530 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f1eb8001470 con 0x7f1ec006d530 2023-10-09T11:37:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/2076193735 >> v2:172.21.15.118:3300/0 conn(0x7f1ec00d0f50 0x7f1ec006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 >> v1:172.21.15.6:6789/0 conn(0x7f1ec006d530 legacy=0x7f1ec015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1eac003a60 0x7f1eac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eac004810 0x7f1eac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1eac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec015a690 con 0x7f1eac0051c0 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac00c0d0 con 0x7f1eac004810 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac00c290 con 0x7f1eac003a60 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1eac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eac004810 0x7f1eac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebe59c700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1eac003a60 0x7f1eac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 -- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1eac003a60 msgr2=0x7f1eac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1eac003a60 0x7f1eac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 -- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eac004810 msgr2=0x7f1eac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1eac004810 0x7f1eac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 -- 172.21.15.6:0/2076193735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac003570 con 0x7f1eac0051c0 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 -- 172.21.15.6:0/2076193735 reap_dead start 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.350+0000 7f1ebed9d700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1eac00ba60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c390 tx=0x7f1ec00cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9676ff44633e9ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800cc60 con 0x7f1eac0051c0 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800cdc0 con 0x7f1eac0051c0 2023-10-09T11:37:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebd59a700 1 -- 172.21.15.6:0/2076193735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8005b70 con 0x7f1eac0051c0 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 -- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 msgr2=0x7f1eac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1eac00ba60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c390 tx=0x7f1ec00cf460 comp rx=0 tx=0).stop 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 -- 172.21.15.6:0/2076193735 shutdown_connections 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/2076193735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1eac00ba60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 -- 172.21.15.6:0/2076193735 >> 172.21.15.6:0/2076193735 conn(0x7f1ec0063230 msgr2=0x7f1ec0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 -- 172.21.15.6:0/2076193735 shutdown_connections 2023-10-09T11:37:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.351+0000 7f1ebf59e700 1 -- 172.21.15.6:0/2076193735 wait complete. 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.352+0000 7f1ebf59e700 1 Processor -- start 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.352+0000 7f1ebf59e700 1 -- start start 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec016d240 0x7f1ec015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec015bc20 0x7f1ec016a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec016d6b0 con 0x7f1eac0051c0 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec015c090 con 0x7f1ec016d240 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00afcf0 con 0x7f1ec015bc20 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47074/0 (socket says 172.21.15.6:47074) 2023-10-09T11:37:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 -- 172.21.15.6:0/3259732459 learned_addr learned my addr 172.21.15.6:0/3259732459 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec016d240 0x7f1ec015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebed9d700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec015bc20 0x7f1ec016a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 -- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec015bc20 msgr2=0x7f1ec016a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec015bc20 0x7f1ec016a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 -- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec016d240 msgr2=0x7f1ec015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec016d240 0x7f1ec015b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.353+0000 7f1ebe59c700 1 -- 172.21.15.6:0/3259732459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00af400 con 0x7f1eac0051c0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1ebe59c700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000ec20 tx=0x7f1eb0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0006ba0 con 0x7f1eac0051c0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0006d00 con 0x7f1eac0051c0 2023-10-09T11:37:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00af6a0 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000c9b0 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.354+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec016b1c0 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.355+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec00afb40 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.355+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb0014480 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.355+0000 7f1eb67fc700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.356+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f1eb0084620 con 0x7f1eac0051c0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.356+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.356+0000 7f1ebdd9b700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00b1290 tx=0x7f1ea80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.360+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb0051840 con 0x7f1eac0051c0 2023-10-09T11:37:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:11.599+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1ec00676e0 con 0x7f1eac0051c0 2023-10-09T11:37:12.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.212+0000 7f1eb67fc700 1 -- 172.21.15.6:0/3259732459 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1eb0054e60 con 0x7f1eac0051c0 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 msgr2=0x7f1ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00b1290 tx=0x7f1ea80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 msgr2=0x7f1ec016b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000ec20 tx=0x7f1eb0001640 comp rx=0 tx=0).stop 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 shutdown_connections 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ec015bc20 0x7f1ec016a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0051c0 0x7f1ec016b460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 --2- 172.21.15.6:0/3259732459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ec016d240 0x7f1ec015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 >> 172.21.15.6:0/3259732459 conn(0x7f1ec0063230 msgr2=0x7f1ec00b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 shutdown_connections 2023-10-09T11:37:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.214+0000 7f1ebf59e700 1 -- 172.21.15.6:0/3259732459 wait complete. 2023-10-09T11:37:12.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:37:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.393+0000 7f866094a700 1 Processor -- start 2023-10-09T11:37:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.393+0000 7f866094a700 1 -- start start 2023-10-09T11:37:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f866094a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f865c1578d0 0x7f865c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f866094a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c0d07c0 con 0x7f865c157ca0 2023-10-09T11:37:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f866094a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c0cfbb0 con 0x7f865c06d120 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f866094a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c0cfe90 con 0x7f865c1578d0 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f865a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f865c1578d0 0x7f865c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f865c1578d0 0x7f865c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47076/0 (socket says 172.21.15.6:47076) 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.394+0000 7f8659d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f865c157ca0 0x7f865c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34772/0 (socket says 172.21.15.6:34772) 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 -- 172.21.15.6:0/4188280057 learned_addr learned my addr 172.21.15.6:0/4188280057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 -- 172.21.15.6:0/4188280057 >> v1:172.21.15.118:6789/0 conn(0x7f865c06d120 legacy=0x7f865c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 -- 172.21.15.6:0/4188280057 >> v1:172.21.15.6:6789/0 conn(0x7f865c157ca0 legacy=0x7f865c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865959a700 1 -- 172.21.15.6:0/4188280057 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294511157 0 0) 0x7f865c0d07c0 con 0x7f865c157ca0 2023-10-09T11:37:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 -- 172.21.15.6:0/4188280057 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0d0170 con 0x7f865c1578d0 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865a59c700 1 --2- 172.21.15.6:0/4188280057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0cf4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f86540099b0 tx=0x7f8654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f11ecefa76fbc16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865959a700 1 -- 172.21.15.6:0/4188280057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400b860 con 0x7f865c1578d0 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865959a700 1 -- 172.21.15.6:0/4188280057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400b9c0 con 0x7f865c1578d0 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.395+0000 7f865959a700 1 -- 172.21.15.6:0/4188280057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400bd60 con 0x7f865c1578d0 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 -- 172.21.15.6:0/4188280057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 msgr2=0x7f865c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 --2- 172.21.15.6:0/4188280057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0cf4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f86540099b0 tx=0x7f8654009250 comp rx=0 tx=0).stop 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 -- 172.21.15.6:0/4188280057 shutdown_connections 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 --2- 172.21.15.6:0/4188280057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0cf4f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 -- 172.21.15.6:0/4188280057 >> 172.21.15.6:0/4188280057 conn(0x7f865c06bb90 msgr2=0x7f865c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 -- 172.21.15.6:0/4188280057 shutdown_connections 2023-10-09T11:37:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.396+0000 7f866094a700 1 -- 172.21.15.6:0/4188280057 wait complete. 2023-10-09T11:37:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.397+0000 7f866094a700 1 Processor -- start 2023-10-09T11:37:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.397+0000 7f866094a700 1 -- start start 2023-10-09T11:37:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865c06d120 0x7f865c0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865c157ca0 0x7f865c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c153160 con 0x7f865c1578d0 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b56f0 con 0x7f865c157ca0 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b5fc0 con 0x7f865c06d120 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47090/0 (socket says 172.21.15.6:47090) 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 -- 172.21.15.6:0/1911466273 learned_addr learned my addr 172.21.15.6:0/1911466273 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f865a59c700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865c06d120 0x7f865c0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f865ad9d700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865c157ca0 0x7f865c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 -- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865c06d120 msgr2=0x7f865c0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865c06d120 0x7f865c0b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 -- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865c157ca0 msgr2=0x7f865c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865c157ca0 0x7f865c154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 -- 172.21.15.6:0/1911466273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540094f0 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f8659d9b700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f864400c530 tx=0x7f8644007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644005a70 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644005bd0 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c16ab50 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.398+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440070d0 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.399+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c16b110 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.399+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c153310 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.400+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86440074c0 con 0x7f865c1578d0 2023-10-09T11:37:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.400+0000 7f86527fc700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:12.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.400+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8644083a90 con 0x7f865c1578d0 2023-10-09T11:37:12.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.400+0000 7f865a59c700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:12.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.401+0000 7f865a59c700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 0x7f863c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86540099b0 tx=0x7f8654017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:12.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.405+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f865c153310 con 0x7f865c1578d0 2023-10-09T11:37:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:12.598+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f865c067b50 con 0x7f865c1578d0 2023-10-09T11:37:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.214+0000 7f86527fc700 1 -- 172.21.15.6:0/1911466273 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8644017020 con 0x7f865c1578d0 2023-10-09T11:37:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 msgr2=0x7f863c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 0x7f863c0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f86540099b0 tx=0x7f8654017000 comp rx=0 tx=0).stop 2023-10-09T11:37:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 msgr2=0x7f865c0b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f864400c530 tx=0x7f8644007f30 comp rx=0 tx=0).stop 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 shutdown_connections 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f863c066f30 0x7f863c0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f865c157ca0 0x7f865c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865c06d120 0x7f865c0b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 --2- 172.21.15.6:0/1911466273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c1578d0 0x7f865c0b3ba0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 >> 172.21.15.6:0/1911466273 conn(0x7f865c06bb90 msgr2=0x7f865c1558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 shutdown_connections 2023-10-09T11:37:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.216+0000 7f866094a700 1 -- 172.21.15.6:0/1911466273 wait complete. 2023-10-09T11:37:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:37:13.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:37:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.353+0000 7f5dad9e7700 1 Processor -- start 2023-10-09T11:37:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.353+0000 7f5dad9e7700 1 -- start start 2023-10-09T11:37:13.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5dad9e7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5da80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5dad9e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da80d07c0 con 0x7f5da8157ca0 2023-10-09T11:37:13.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5dad9e7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da80cfbb0 con 0x7f5da806d120 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5dad9e7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80cfe90 con 0x7f5da81578d0 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5da8157ca0 0x7f5da815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47642/0 (socket says 172.21.15.6:47642) 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da67fc700 1 -- 172.21.15.6:0/3123215891 learned_addr learned my addr 172.21.15.6:0/3123215891 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5da80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289550610 0 0) 0x7f5da80d07c0 con 0x7f5da8157ca0 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d94003570 con 0x7f5da8157ca0 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789560008 0 0) 0x7f5da80cfbb0 con 0x7f5da806d120 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da80d07c0 con 0x7f5da806d120 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630876188 0 0) 0x7f5d94003570 con 0x7f5da8157ca0 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 msgr2=0x7f5da80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5da80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 >> v1:172.21.15.118:6789/0 conn(0x7f5da806d120 legacy=0x7f5da815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80d0170 con 0x7f5da8157ca0 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f5d90001470 con 0x7f5da8157ca0 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 >> v1:172.21.15.6:6789/0 conn(0x7f5da8157ca0 legacy=0x7f5da815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5d94004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5d94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.354+0000 7f5da5ffb700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d94004d50 0x7f5d940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80cfe90 con 0x7f5d94003c20 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9400bb40 con 0x7f5d94004d50 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9400bd00 con 0x7f5da81578d0 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5d94004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da67fc700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5d94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da77fe700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d94004d50 0x7f5d940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 -- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 msgr2=0x7f5d94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5d94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 -- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d94004d50 msgr2=0x7f5d940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d94004d50 0x7f5d940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 -- 172.21.15.6:0/3123215891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d94003570 con 0x7f5d94003c20 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da77fe700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d94004d50 0x7f5d940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da67fc700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da81578d0 0x7f5d94004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5d94004010 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009c00 tx=0x7f5da00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe0494c345a7595 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000e710 con 0x7f5d94003c20 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000e870 con 0x7f5d94003c20 2023-10-09T11:37:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.355+0000 7f5da5ffb700 1 -- 172.21.15.6:0/3123215891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000ec30 con 0x7f5d94003c20 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 -- 172.21.15.6:0/3123215891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 msgr2=0x7f5d94004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/3123215891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5d94004010 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009c00 tx=0x7f5da00091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5da77fe700 1 -- 172.21.15.6:0/3123215891 reap_dead start 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 -- 172.21.15.6:0/3123215891 shutdown_connections 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 -- 172.21.15.6:0/3123215891 >> 172.21.15.6:0/3123215891 conn(0x7f5da806bb90 msgr2=0x7f5da806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 -- 172.21.15.6:0/3123215891 shutdown_connections 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.356+0000 7f5dad9e7700 1 -- 172.21.15.6:0/3123215891 wait complete. 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.357+0000 7f5dad9e7700 1 Processor -- start 2023-10-09T11:37:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.357+0000 7f5dad9e7700 1 -- start start 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5da816b630 0x7f5da814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 0x7f5da81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da816ba80 con 0x7f5d94003c20 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da814d280 con 0x7f5da816b630 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5dad9e7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da814d560 con 0x7f5da8151e10 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40692/0 (socket says 172.21.15.6:40692) 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 -- 172.21.15.6:0/723458918 learned_addr learned my addr 172.21.15.6:0/723458918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da67fc700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5da816b630 0x7f5da814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da77fe700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 0x7f5da81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 -- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 msgr2=0x7f5da81580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 0x7f5da81580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 -- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5da816b630 msgr2=0x7f5da814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5da816b630 0x7f5da814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 -- 172.21.15.6:0/723458918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da816ae30 con 0x7f5d94003c20 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da77fe700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 0x7f5da81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5da6ffd700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d94004790 tx=0x7f5da001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0022070 con 0x7f5d94003c20 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.358+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000ebf0 con 0x7f5d94003c20 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.359+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da816b110 con 0x7f5d94003c20 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.359+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da001c6a0 con 0x7f5d94003c20 2023-10-09T11:37:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.359+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8152290 con 0x7f5d94003c20 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.359+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da816ba00 con 0x7f5d94003c20 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.360+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5da001ca90 con 0x7f5d94003c20 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.360+0000 7f5d9effd700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 0x7f5d880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.360+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5da0085cd0 con 0x7f5d94003c20 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.360+0000 7f5da67fc700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 0x7f5d880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.361+0000 7f5da67fc700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 0x7f5d880693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d90000ff0 tx=0x7f5da815b610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.364+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5da0053000 con 0x7f5d94003c20 2023-10-09T11:37:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:13.560+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5da816b300 con 0x7f5d94003c20 2023-10-09T11:37:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.216+0000 7f5d9effd700 1 -- 172.21.15.6:0/723458918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5da002b0d0 con 0x7f5d94003c20 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 msgr2=0x7f5d880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 0x7f5d880693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5d90000ff0 tx=0x7f5da815b610 comp rx=0 tx=0).stop 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 msgr2=0x7f5da814cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d94004790 tx=0x7f5da001a000 comp rx=0 tx=0).stop 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 shutdown_connections 2023-10-09T11:37:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d88066f30 0x7f5d880693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5da8151e10 0x7f5da81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d94003c20 0x7f5da814cbc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 --2- 172.21.15.6:0/723458918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5da816b630 0x7f5da814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.218+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 >> 172.21.15.6:0/723458918 conn(0x7f5da806bb90 msgr2=0x7f5da8159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.219+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 shutdown_connections 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.219+0000 7f5dad9e7700 1 -- 172.21.15.6:0/723458918 wait complete. 2023-10-09T11:37:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:37:14.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:37:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.354+0000 7fbb9cb10700 1 Processor -- start 2023-10-09T11:37:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.354+0000 7fbb9cb10700 1 -- start start 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9cb10700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9cb10700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980d07c0 con 0x7fbb981578d0 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9cb10700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980cfbb0 con 0x7fbb9806d120 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9cb10700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cfe90 con 0x7fbb98157ca0 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb981578d0 0x7fbb9815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47648/0 (socket says 172.21.15.6:47648) 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.355+0000 7fbb9659c700 1 -- 172.21.15.6:0/1602383893 learned_addr learned my addr 172.21.15.6:0/1602383893 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb95d9b700 1 --2- 172.21.15.6:0/1602383893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878679422 0 0) 0x7fbb980d07c0 con 0x7fbb981578d0 2023-10-09T11:37:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003570 con 0x7fbb981578d0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473848472 0 0) 0x7fbb980cfbb0 con 0x7fbb9806d120 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb980d07c0 con 0x7fbb9806d120 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb95d9b700 1 -- 172.21.15.6:0/1602383893 >> v1:172.21.15.118:6789/0 conn(0x7fbb9806d120 legacy=0x7fbb9815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb95d9b700 1 -- 172.21.15.6:0/1602383893 >> v1:172.21.15.6:6789/0 conn(0x7fbb981578d0 legacy=0x7fbb9815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628096243 0 0) 0x7fbb84003570 con 0x7fbb981578d0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb95d9b700 1 -- 172.21.15.6:0/1602383893 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980d0170 con 0x7fbb98157ca0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb95d9b700 1 --2- 172.21.15.6:0/1602383893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980cf4f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009910 tx=0x7fbb800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d17d4715aa275 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880017f0 con 0x7fbb98157ca0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb80011420 con 0x7fbb98157ca0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.356+0000 7fbb9559a700 1 -- 172.21.15.6:0/1602383893 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800117a0 con 0x7fbb98157ca0 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 -- 172.21.15.6:0/1602383893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 msgr2=0x7fbb980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/1602383893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980cf4f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009910 tx=0x7fbb800091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 -- 172.21.15.6:0/1602383893 shutdown_connections 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/1602383893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980cf4f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 -- 172.21.15.6:0/1602383893 >> 172.21.15.6:0/1602383893 conn(0x7fbb9806bb90 msgr2=0x7fbb9806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 -- 172.21.15.6:0/1602383893 shutdown_connections 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.357+0000 7fbb9cb10700 1 -- 172.21.15.6:0/1602383893 wait complete. 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.358+0000 7fbb9cb10700 1 Processor -- start 2023-10-09T11:37:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.358+0000 7fbb9cb10700 1 -- start start 2023-10-09T11:37:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 0x7fbb980cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c8320 con 0x7fbb981578d0 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980cd9b0 con 0x7fbb9806d120 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9cb10700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c64b0 con 0x7fbb98157ca0 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40702/0 (socket says 172.21.15.6:40702) 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 -- 172.21.15.6:0/894033566 learned_addr learned my addr 172.21.15.6:0/894033566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9659c700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 0x7fbb980cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb96d9d700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 -- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 msgr2=0x7fbb980c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 -- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 msgr2=0x7fbb980cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 0x7fbb980cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 -- 172.21.15.6:0/894033566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009420 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb9659c700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 0x7fbb980cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.359+0000 7fbb95d9b700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb800091e0 tx=0x7fbb80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.360+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8001cc10 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.360+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8001cd70 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.360+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980c7710 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.360+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8001a6a0 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.360+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb980c7cd0 con 0x7fbb981578d0 2023-10-09T11:37:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.361+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98067ac0 con 0x7fbb981578d0 2023-10-09T11:37:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.361+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb8001aad0 con 0x7fbb981578d0 2023-10-09T11:37:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.361+0000 7fbb8e7fc700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 0x7fbb780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.362+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbb80085b80 con 0x7fbb981578d0 2023-10-09T11:37:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.362+0000 7fbb9659c700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 0x7fbb780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.362+0000 7fbb9659c700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 0x7fbb780693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb980b6d90 tx=0x7fbb88005bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.366+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb800530f0 con 0x7fbb981578d0 2023-10-09T11:37:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.558+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbb980c8460 con 0x7fbb981578d0 2023-10-09T11:37:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.562+0000 7fbb8e7fc700 1 -- 172.21.15.6:0/894033566 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb80056710 con 0x7fbb981578d0 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 msgr2=0x7fbb780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 0x7fbb780693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb980b6d90 tx=0x7fbb88005bc0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 msgr2=0x7fbb980c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb800091e0 tx=0x7fbb80016000 comp rx=0 tx=0).stop 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 shutdown_connections 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb78066f30 0x7fbb780693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb98157ca0 0x7fbb980c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9806d120 0x7fbb980cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 --2- 172.21.15.6:0/894033566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb981578d0 0x7fbb980c6ba0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 >> 172.21.15.6:0/894033566 conn(0x7fbb9806bb90 msgr2=0x7fbb98069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 shutdown_connections 2023-10-09T11:37:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.564+0000 7fbb9cb10700 1 -- 172.21.15.6:0/894033566 wait complete. 2023-10-09T11:37:14.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-09T11:37:14.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.695+0000 7f33f949f700 1 Processor -- start 2023-10-09T11:37:14.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.695+0000 7f33f949f700 1 -- start start 2023-10-09T11:37:14.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f949f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f33f406a700 0x7f33f406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f949f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40ccf60 con 0x7f33f40c8210 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f949f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40cb780 con 0x7f33f4159d40 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f949f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40cd190 con 0x7f33f406a700 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33f40c8210 0x7f33f40c8670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47654/0 (socket says 172.21.15.6:47654) 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.696+0000 7f33f37fe700 1 -- 172.21.15.6:0/4114396992 learned_addr learned my addr 172.21.15.6:0/4114396992 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f27fc700 1 --2- 172.21.15.6:0/4114396992 >> v2:172.21.15.118:3300/0 conn(0x7f33f406a700 0x7f33f406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374781594 0 0) 0x7f33f40ccf60 con 0x7f33f40c8210 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e0003570 con 0x7f33f40c8210 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916945433 0 0) 0x7f33f40cb780 con 0x7f33f4159d40 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f40ccf60 con 0x7f33f4159d40 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f27fc700 1 -- 172.21.15.6:0/4114396992 >> v1:172.21.15.118:6789/0 conn(0x7f33f4159d40 legacy=0x7f33f406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f27fc700 1 -- 172.21.15.6:0/4114396992 >> v1:172.21.15.6:6789/0 conn(0x7f33f40c8210 legacy=0x7f33f40c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f27fc700 1 -- 172.21.15.6:0/4114396992 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40cd470 con 0x7f33f406a700 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f27fc700 1 --2- 172.21.15.6:0/4114396992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f406a700 0x7f33f406c2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0098d0 tx=0x7f33dc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe67002f3ee23352 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc005c10 con 0x7f33f406a700 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc005d70 con 0x7f33f406a700 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.697+0000 7f33f1ffb700 1 -- 172.21.15.6:0/4114396992 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc006280 con 0x7f33f406a700 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 -- 172.21.15.6:0/4114396992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f406a700 msgr2=0x7f33f406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 --2- 172.21.15.6:0/4114396992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f406a700 0x7f33f406c2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0098d0 tx=0x7f33dc009120 comp rx=0 tx=0).stop 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 -- 172.21.15.6:0/4114396992 shutdown_connections 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 --2- 172.21.15.6:0/4114396992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f406a700 0x7f33f406c2a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 -- 172.21.15.6:0/4114396992 >> 172.21.15.6:0/4114396992 conn(0x7f33f406cca0 msgr2=0x7f33f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 -- 172.21.15.6:0/4114396992 shutdown_connections 2023-10-09T11:37:14.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.698+0000 7f33f949f700 1 -- 172.21.15.6:0/4114396992 wait complete. 2023-10-09T11:37:14.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.699+0000 7f33f949f700 1 Processor -- start 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.699+0000 7f33f949f700 1 -- start start 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33f406a700 0x7f33f40b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f40c8210 0x7f33f415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b0b80 con 0x7f33f4159d40 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b0e60 con 0x7f33f40c8210 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f949f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40c58b0 con 0x7f33f406a700 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40708/0 (socket says 172.21.15.6:40708) 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 -- 172.21.15.6:0/1050545338 learned_addr learned my addr 172.21.15.6:0/1050545338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f27fc700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f40c8210 0x7f33f415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 -- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33f406a700 msgr2=0x7f33f40b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f2ffd700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33f406a700 0x7f33f40b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33f406a700 0x7f33f40b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 -- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f40c8210 msgr2=0x7f33f415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f40c8210 0x7f33f415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 -- 172.21.15.6:0/1050545338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0093c0 con 0x7f33f4159d40 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.700+0000 7f33f37fe700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33e400cc80 tx=0x7f33e4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.701+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400ce90 con 0x7f33f4159d40 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.701+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400ab70 con 0x7f33f4159d40 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.701+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40c5b90 con 0x7f33f4159d40 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.701+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40070f0 con 0x7f33f4159d40 2023-10-09T11:37:14.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.701+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40b07a0 con 0x7f33f4159d40 2023-10-09T11:37:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.702+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f4068750 con 0x7f33f4159d40 2023-10-09T11:37:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.702+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33e40074a0 con 0x7f33f4159d40 2023-10-09T11:37:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.703+0000 7f33eaffd700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 0x7f33d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:14.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.703+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f33e4084700 con 0x7f33f4159d40 2023-10-09T11:37:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.703+0000 7f33f2ffd700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 0x7f33d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:14.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.703+0000 7f33f2ffd700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 0x7f33d40693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33ec002730 tx=0x7f33ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:14.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.707+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33e4051cf0 con 0x7f33f4159d40 2023-10-09T11:37:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:14.981+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f33f40cba60 con 0x7f33f4159d40 2023-10-09T11:37:15.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.216+0000 7f33eaffd700 1 -- 172.21.15.6:0/1050545338 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v85) v1 ==== 130+0+0 (secure 0 0 0) 0x7f33e4055310 con 0x7f33f4159d40 2023-10-09T11:37:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 msgr2=0x7f33d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 0x7f33d40693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33ec002730 tx=0x7f33ec009040 comp rx=0 tx=0).stop 2023-10-09T11:37:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 msgr2=0x7f33f416d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33e400cc80 tx=0x7f33e4001ae0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 shutdown_connections 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.218+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f33d4066f30 0x7f33d40693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f4159d40 0x7f33f416d920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33f406a700 0x7f33f40b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 --2- 172.21.15.6:0/1050545338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33f40c8210 0x7f33f415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 >> 172.21.15.6:0/1050545338 conn(0x7f33f406cca0 msgr2=0x7f33f40ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 shutdown_connections 2023-10-09T11:37:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.219+0000 7f33f949f700 1 -- 172.21.15.6:0/1050545338 wait complete. 2023-10-09T11:37:15.231 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-09T11:37:15.231 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T11:37:15.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-09T11:37:15.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.350+0000 7f2fdaa25700 1 Processor -- start 2023-10-09T11:37:15.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.350+0000 7f2fdaa25700 1 -- start start 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fdaa25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2fd415a2a0 0x7f2fd40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fdaa25700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd406dd60 0x7f2fd40cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fdaa25700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd40b0ca0 con 0x7f2fd40ceb30 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fdaa25700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd406e160 con 0x7f2fd406dd60 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fdaa25700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd406ea90 con 0x7f2fd415a2a0 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd406dd60 0x7f2fd40cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2fd40ceb30 0x7f2fd406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47670/0 (socket says 172.21.15.6:47670) 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd406dd60 0x7f2fd40cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40714/0 (socket says 172.21.15.6:40714) 2023-10-09T11:37:15.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd37fe700 1 -- 172.21.15.6:0/1429946177 learned_addr learned my addr 172.21.15.6:0/1429946177 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd3fff700 1 --2- 172.21.15.6:0/1429946177 >> v2:172.21.15.118:3300/0 conn(0x7f2fd415a2a0 0x7f2fd40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/1429946177 >> v2:172.21.15.118:3300/0 conn(0x7f2fd415a2a0 msgr2=0x7f2fd40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 --2- 172.21.15.6:0/1429946177 >> v2:172.21.15.118:3300/0 conn(0x7f2fd415a2a0 0x7f2fd40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/1429946177 >> v1:172.21.15.6:6789/0 conn(0x7f2fd40ceb30 legacy=0x7f2fd406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/1429946177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40b00d0 con 0x7f2fd406dd60 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd2ffd700 1 -- 172.21.15.6:0/1429946177 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497976134 0 0) 0x7f2fd40b0ca0 con 0x7f2fd40ceb30 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.351+0000 7f2fd8fc2700 1 --2- 172.21.15.6:0/1429946177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd406dd60 0x7f2fd40cefb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40637a0 tx=0x7f2fcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774b7fca1e391100 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fd2ffd700 1 -- 172.21.15.6:0/1429946177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00e070 con 0x7f2fd406dd60 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fd2ffd700 1 -- 172.21.15.6:0/1429946177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00bc30 con 0x7f2fd406dd60 2023-10-09T11:37:15.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fd2ffd700 1 -- 172.21.15.6:0/1429946177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc012430 con 0x7f2fd406dd60 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 -- 172.21.15.6:0/1429946177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd406dd60 msgr2=0x7f2fd40cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/1429946177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd406dd60 0x7f2fd40cefb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40637a0 tx=0x7f2fcc009780 comp rx=0 tx=0).stop 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 -- 172.21.15.6:0/1429946177 shutdown_connections 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/1429946177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd406dd60 0x7f2fd40cefb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/1429946177 >> v2:172.21.15.118:3300/0 conn(0x7f2fd415a2a0 0x7f2fd40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 -- 172.21.15.6:0/1429946177 >> 172.21.15.6:0/1429946177 conn(0x7f2fd4067640 msgr2=0x7f2fd4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 -- 172.21.15.6:0/1429946177 shutdown_connections 2023-10-09T11:37:15.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.352+0000 7f2fdaa25700 1 -- 172.21.15.6:0/1429946177 wait complete. 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.353+0000 7f2fdaa25700 1 Processor -- start 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.353+0000 7f2fdaa25700 1 -- start start 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 0x7f2fd415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 0x7f2fd415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd416e620 con 0x7f2fd415a2a0 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd416e8f0 con 0x7f2fd406dd60 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fdaa25700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd415ca50 con 0x7f2fd40ceb30 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fd8fc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fd8fc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40726/0 (socket says 172.21.15.6:40726) 2023-10-09T11:37:15.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.354+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/3278831820 learned_addr learned my addr 172.21.15.6:0/3278831820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd3fff700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 0x7f2fd415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd37fe700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 0x7f2fd415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 msgr2=0x7f2fd415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 0x7f2fd415c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 msgr2=0x7f2fd415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 0x7f2fd415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 -- 172.21.15.6:0/3278831820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009a20 con 0x7f2fd415a2a0 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd3fff700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 0x7f2fd415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:15.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd37fe700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 0x7f2fd415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fd8fc2700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009fd0 tx=0x7f2fcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc012ea0 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc01e630 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd415cce0 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc01e9f0 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.355+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd415d2a0 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.356+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd4069e40 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.356+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fcc024070 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.357+0000 7f2fbbfff700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 0x7f2fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.357+0000 7f2fd3fff700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 0x7f2fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.357+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2fcc086b00 con 0x7f2fd415a2a0 2023-10-09T11:37:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.357+0000 7f2fd3fff700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 0x7f2fc00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009990 tx=0x7f2fc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.361+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fcc054070 con 0x7f2fd415a2a0 2023-10-09T11:37:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:15.639+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f2fd416ea30 con 0x7f2fd415a2a0 2023-10-09T11:37:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.218+0000 7f2fbbfff700 1 -- 172.21.15.6:0/3278831820 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v86) v1 ==== 145+0+0 (secure 0 0 0) 0x7f2fcc057690 con 0x7f2fd415a2a0 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 msgr2=0x7f2fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 0x7f2fc00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009990 tx=0x7f2fc4008040 comp rx=0 tx=0).stop 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 msgr2=0x7f2fd4154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009fd0 tx=0x7f2fcc019000 comp rx=0 tx=0).stop 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 shutdown_connections 2023-10-09T11:37:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fc0066f30 0x7f2fc00693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd415a2a0 0x7f2fd4154a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fd406dd60 0x7f2fd415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 --2- 172.21.15.6:0/3278831820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fd40ceb30 0x7f2fd415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.220+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 >> 172.21.15.6:0/3278831820 conn(0x7f2fd4067640 msgr2=0x7f2fd40b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.221+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 shutdown_connections 2023-10-09T11:37:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.221+0000 7f2fdaa25700 1 -- 172.21.15.6:0/3278831820 wait complete. 2023-10-09T11:37:16.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T11:37:16.374 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_objectstore":"memstore"} 2023-10-09T11:37:16.374 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T11:37:16.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:37:16.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.496+0000 7f221759e700 1 Processor -- start 2023-10-09T11:37:16.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.496+0000 7f221759e700 1 -- start start 2023-10-09T11:37:16.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22180d0b80 0x7f22180cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221806d700 0x7f221815b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221759e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22180cf2d0 con 0x7f22180d02b0 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221815a690 con 0x7f221806d700 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221806dc00 con 0x7f22180d0b80 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f2216d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221806d700 0x7f221815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f2216d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f221806d700 0x7f221815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40734/0 (socket says 172.21.15.6:40734) 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f2216d9d700 1 -- 172.21.15.6:0/3438408767 learned_addr learned my addr 172.21.15.6:0/3438408767 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.497+0000 7f221659c700 1 --2- 172.21.15.6:0/3438408767 >> v2:172.21.15.118:3300/0 conn(0x7f22180d0b80 0x7f22180cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f2216d9d700 1 -- 172.21.15.6:0/3438408767 >> v2:172.21.15.118:3300/0 conn(0x7f22180d0b80 msgr2=0x7f22180cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f2216d9d700 1 --2- 172.21.15.6:0/3438408767 >> v2:172.21.15.118:3300/0 conn(0x7f22180d0b80 0x7f22180cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f2216d9d700 1 -- 172.21.15.6:0/3438408767 >> v1:172.21.15.118:6789/0 conn(0x7f22180d02b0 legacy=0x7f221806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f2216d9d700 1 -- 172.21.15.6:0/3438408767 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180cf570 con 0x7f221806d700 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f2216d9d700 1 --2- 172.21.15.6:0/3438408767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f221815b320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22100099b0 tx=0x7f2210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489dfb24d52f9722 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f221559a700 1 -- 172.21.15.6:0/3438408767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210009ea0 con 0x7f221806d700 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f221559a700 1 -- 172.21.15.6:0/3438408767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000b820 con 0x7f221806d700 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f221559a700 1 -- 172.21.15.6:0/3438408767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000bbc0 con 0x7f221806d700 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f221759e700 1 -- 172.21.15.6:0/3438408767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 msgr2=0x7f221815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.498+0000 7f221759e700 1 --2- 172.21.15.6:0/3438408767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f221815b320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22100099b0 tx=0x7f2210009250 comp rx=0 tx=0).stop 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 -- 172.21.15.6:0/3438408767 shutdown_connections 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 --2- 172.21.15.6:0/3438408767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f221815b320 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 --2- 172.21.15.6:0/3438408767 >> v2:172.21.15.118:3300/0 conn(0x7f22180d0b80 0x7f22180cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 -- 172.21.15.6:0/3438408767 >> 172.21.15.6:0/3438408767 conn(0x7f2218063230 msgr2=0x7f2218063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 -- 172.21.15.6:0/3438408767 shutdown_connections 2023-10-09T11:37:16.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.499+0000 7f221759e700 1 -- 172.21.15.6:0/3438408767 wait complete. 2023-10-09T11:37:16.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 Processor -- start 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 -- start start 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22180d02b0 0x7f2218156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22180d0b80 0x7f22181524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218156940 con 0x7f221806d700 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218155a50 con 0x7f22180d02b0 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2218155d30 con 0x7f22180d0b80 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.500+0000 7f221659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40750/0 (socket says 172.21.15.6:40750) 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 -- 172.21.15.6:0/391742591 learned_addr learned my addr 172.21.15.6:0/391742591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f2216d9d700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22180d0b80 0x7f22181524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f2215d9b700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22180d02b0 0x7f2218156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 -- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22180d0b80 msgr2=0x7f22181524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22180d0b80 0x7f22181524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 -- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22180d02b0 msgr2=0x7f2218156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22180d02b0 0x7f2218156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 -- 172.21.15.6:0/391742591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100094f0 con 0x7f221806d700 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221659c700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800caa0 con 0x7f221806d700 2023-10-09T11:37:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220800f040 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2218156010 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800ce30 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.501+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22181565d0 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.502+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2218156790 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.503+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2208014690 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.503+0000 7f220e7fc700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.503+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2208084d40 con 0x7f221806d700 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.503+0000 7f2215d9b700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.503+0000 7f2215d9b700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 0x7f21f80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f221814f5f0 tx=0x7f2200007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.507+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22080522b0 con 0x7f221806d700 2023-10-09T11:37:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.699+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2218156c20 con 0x7f221806d700 2023-10-09T11:37:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.703+0000 7f220e7fc700 1 -- 172.21.15.6:0/391742591 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22080558d0 con 0x7f221806d700 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 msgr2=0x7f21f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 0x7f21f80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f221814f5f0 tx=0x7f2200007ec0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 msgr2=0x7f22181550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2208009e50 tx=0x7f220800b040 comp rx=0 tx=0).stop 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 shutdown_connections 2023-10-09T11:37:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21f8066f30 0x7f21f80693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22180d0b80 0x7f22181524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f221806d700 0x7f22181550a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 --2- 172.21.15.6:0/391742591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22180d02b0 0x7f2218156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 >> 172.21.15.6:0/391742591 conn(0x7f2218063230 msgr2=0x7f2218151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 shutdown_connections 2023-10-09T11:37:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.705+0000 7f221759e700 1 -- 172.21.15.6:0/391742591 wait complete. 2023-10-09T11:37:16.718 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:37:16.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:16.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:16.809 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:37:16.809 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:37:16.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.928+0000 7f86ded25700 1 Processor -- start 2023-10-09T11:37:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.928+0000 7f86ded25700 1 -- start start 2023-10-09T11:37:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ded25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 0x7f86d80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ded25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ded25700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80cee10 con 0x7f86d8159f10 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ded25700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80cd040 con 0x7f86d8159b40 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ded25700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80cd320 con 0x7f86d8068e90 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86de524700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ddd23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 0x7f86d80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86dd522700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f86d8159f10 0x7f86d8068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:47282/0 (socket says 172.21.15.6:47282) 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86ddd23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 0x7f86d80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:34620/0 (socket says 172.21.15.6:34620) 2023-10-09T11:37:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86de524700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:60500/0 (socket says 172.21.15.6:60500) 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.929+0000 7f86dd522700 1 -- 172.21.15.6:0/2993210760 learned_addr learned my addr 172.21.15.6:0/2993210760 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86dcd21700 1 -- 172.21.15.6:0/2993210760 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268565734 0 0) 0x7f86d80cee10 con 0x7f86d8159f10 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86de524700 1 -- 172.21.15.6:0/2993210760 >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 msgr2=0x7f86d80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86de524700 1 --2- 172.21.15.6:0/2993210760 >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 0x7f86d80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86de524700 1 -- 172.21.15.6:0/2993210760 >> v1:172.21.15.118:6789/0 conn(0x7f86d8159f10 legacy=0x7f86d8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86de524700 1 -- 172.21.15.6:0/2993210760 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80ce7c0 con 0x7f86d8068e90 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86de524700 1 --2- 172.21.15.6:0/2993210760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86d00098e0 tx=0x7f86d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bfa84f808761882 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86dcd21700 1 -- 172.21.15.6:0/2993210760 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000b640 con 0x7f86d8068e90 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86dcd21700 1 -- 172.21.15.6:0/2993210760 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d000b7a0 con 0x7f86d8068e90 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.930+0000 7f86dcd21700 1 -- 172.21.15.6:0/2993210760 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000bb40 con 0x7f86d8068e90 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 -- 172.21.15.6:0/2993210760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 msgr2=0x7f86d80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 --2- 172.21.15.6:0/2993210760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86d00098e0 tx=0x7f86d00091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 -- 172.21.15.6:0/2993210760 shutdown_connections 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 --2- 172.21.15.6:0/2993210760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8068e90 0x7f86d80cf2a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 --2- 172.21.15.6:0/2993210760 >> v2:172.21.15.118:3300/0 conn(0x7f86d8159b40 0x7f86d80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 -- 172.21.15.6:0/2993210760 >> 172.21.15.6:0/2993210760 conn(0x7f86d80cd660 msgr2=0x7f86d80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 -- 172.21.15.6:0/2993210760 shutdown_connections 2023-10-09T11:37:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.931+0000 7f86ded25700 1 -- 172.21.15.6:0/2993210760 wait complete. 2023-10-09T11:37:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.932+0000 7f86ded25700 1 Processor -- start 2023-10-09T11:37:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.932+0000 7f86ded25700 1 -- start start 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86d8068e90 0x7f86d80b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8159b40 0x7f86d814b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80c7ca0 con 0x7f86d8159f10 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80b67f0 con 0x7f86d8068e90 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80c7ef0 con 0x7f86d8159b40 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40756/0 (socket says 172.21.15.6:40756) 2023-10-09T11:37:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 -- 172.21.15.6:0/421399923 learned_addr learned my addr 172.21.15.6:0/421399923 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86dd522700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8159b40 0x7f86d814b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ddd23700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86d8068e90 0x7f86d80b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 -- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8159b40 msgr2=0x7f86d814b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8159b40 0x7f86d814b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 -- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86d8068e90 msgr2=0x7f86d80b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86d8068e90 0x7f86d80b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 -- 172.21.15.6:0/421399923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009420 con 0x7f86d8159f10 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86de524700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86d0013000 tx=0x7f86d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000bb20 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0011420 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d80c81d0 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.933+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00117a0 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.934+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d80c8790 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.935+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d8063e90 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.935+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86d0011b10 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.935+0000 7f86d5ffb700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.936+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f86d0085cf0 con 0x7f86d8159f10 2023-10-09T11:37:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.936+0000 7f86ddd23700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.936+0000 7f86ddd23700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 0x7f86c40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009fd0 tx=0x7f86c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:16.940+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86d008a070 con 0x7f86d8159f10 2023-10-09T11:37:17.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.180+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d80ceaa0 con 0x7f86d8159f10 2023-10-09T11:37:17.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.180+0000 7f86d5ffb700 1 -- 172.21.15.6:0/421399923 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f86d0015de0 con 0x7f86d8159f10 2023-10-09T11:37:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:17.181 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3547984323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3547984323},{"type":"v1","addr":"172.21.15.6:6836","nonce":3547984323}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4849,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3195808068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3195808068},{"type":"v1","addr":"172.21.15.118:6835","nonce":3195808068}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2358758963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2358758963},{"type":"v1","addr":"172.21.15.118:6834","nonce":2358758963}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/3260345808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3260345808},{"type":"v1","addr":"172.21.15.6:6837","nonce":3260345808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 msgr2=0x7f86c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 0x7f86c40693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009fd0 tx=0x7f86c800b040 comp rx=0 tx=0).stop 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 msgr2=0x7f86d80c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86d0013000 tx=0x7f86d0017000 comp rx=0 tx=0).stop 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 shutdown_connections 2023-10-09T11:37:17.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f86c4066f30 0x7f86c40693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d8159f10 0x7f86d80c8f90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86d8068e90 0x7f86d80b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 --2- 172.21.15.6:0/421399923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f86d8159b40 0x7f86d814b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 >> 172.21.15.6:0/421399923 conn(0x7f86d80cd660 msgr2=0x7f86d80cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 shutdown_connections 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.182+0000 7f86ded25700 1 -- 172.21.15.6:0/421399923 wait complete. 2023-10-09T11:37:17.184 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2023-10-09T11:37:17.195 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:37:17.195 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:37:17.195 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:37:17.195 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:17.195 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:37:17.196 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:37:17.196 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:37:17.196 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:17.196 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:37:17.196 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:37:17.196 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:37:17.196 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:17.197 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:37:17.197 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:37:17.197 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:37:17.197 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:37:17.204 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:37:17.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:37:17.205 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:37:17.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:37:17.206 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:37:17.206 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:37:17.207 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:37:17.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:37:17.247 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:37:17.247 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:17.248 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:37:17.248 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:17.249 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:37:17.249 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:17.250 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:37:17.250 DEBUG:teuthology.parallel:result is None 2023-10-09T11:37:17.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:37:17.322 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:37:17.323 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:37:17.326 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:37:17.327 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:37:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.375+0000 7fc800561700 1 Processor -- start 2023-10-09T11:37:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.375+0000 7fc800561700 1 -- start start 2023-10-09T11:37:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc800561700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc7f815a2a0 0x7fc7f80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc800561700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7f806dd60 0x7fc7f80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc800561700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80b0ca0 con 0x7fc7f80ceb30 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc800561700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f806e160 con 0x7fc7f806dd60 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc800561700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f806ea90 con 0x7fc7f815a2a0 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.376+0000 7fc7feafe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7f806dd60 0x7fc7f80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7f806dd60 0x7fc7f80cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40784/0 (socket says 172.21.15.6:40784) 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 -- 172.21.15.6:0/1751576918 learned_addr learned my addr 172.21.15.6:0/1751576918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7fe2fd700 1 --2- 172.21.15.6:0/1751576918 >> v2:172.21.15.118:3300/0 conn(0x7fc7f815a2a0 0x7fc7f80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 -- 172.21.15.6:0/1751576918 >> v2:172.21.15.118:3300/0 conn(0x7fc7f815a2a0 msgr2=0x7fc7f80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 --2- 172.21.15.6:0/1751576918 >> v2:172.21.15.118:3300/0 conn(0x7fc7f815a2a0 0x7fc7f80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 -- 172.21.15.6:0/1751576918 >> v1:172.21.15.118:6789/0 conn(0x7fc7f80ceb30 legacy=0x7fc7f806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 -- 172.21.15.6:0/1751576918 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80b00d0 con 0x7fc7f806dd60 2023-10-09T11:37:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7feafe700 1 --2- 172.21.15.6:0/1751576918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f806dd60 0x7fc7f80cefb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80637a0 tx=0x7fc7f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ed145db5f9f48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7fd2fb700 1 -- 172.21.15.6:0/1751576918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000e070 con 0x7fc7f806dd60 2023-10-09T11:37:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7fd2fb700 1 -- 172.21.15.6:0/1751576918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000ba20 con 0x7fc7f806dd60 2023-10-09T11:37:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.377+0000 7fc7fd2fb700 1 -- 172.21.15.6:0/1751576918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00092e0 con 0x7fc7f806dd60 2023-10-09T11:37:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 -- 172.21.15.6:0/1751576918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f806dd60 msgr2=0x7fc7f80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 --2- 172.21.15.6:0/1751576918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f806dd60 0x7fc7f80cefb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80637a0 tx=0x7fc7f0009840 comp rx=0 tx=0).stop 2023-10-09T11:37:17.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 -- 172.21.15.6:0/1751576918 shutdown_connections 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 --2- 172.21.15.6:0/1751576918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f806dd60 0x7fc7f80cefb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 --2- 172.21.15.6:0/1751576918 >> v2:172.21.15.118:3300/0 conn(0x7fc7f815a2a0 0x7fc7f80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 -- 172.21.15.6:0/1751576918 >> 172.21.15.6:0/1751576918 conn(0x7fc7f8067640 msgr2=0x7fc7f8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 -- 172.21.15.6:0/1751576918 shutdown_connections 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.378+0000 7fc800561700 1 -- 172.21.15.6:0/1751576918 wait complete. 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.379+0000 7fc800561700 1 Processor -- start 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.379+0000 7fc800561700 1 -- start start 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.379+0000 7fc800561700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7f806dd60 0x7fc7f814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.379+0000 7fc800561700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7f815a2a0 0x7fc7f80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f815c700 con 0x7fc7f80ceb30 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f815cfa0 con 0x7fc7f806dd60 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cbab0 con 0x7fc7f815a2a0 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40788/0 (socket says 172.21.15.6:40788) 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 -- 172.21.15.6:0/302136911 learned_addr learned my addr 172.21.15.6:0/302136911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fe2fd700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7f806dd60 0x7fc7f814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7feafe700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7f815a2a0 0x7fc7f80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 -- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7f815a2a0 msgr2=0x7fc7f80c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7f815a2a0 0x7fc7f80c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 -- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7f806dd60 msgr2=0x7fc7f814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7f806dd60 0x7fc7f814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 -- 172.21.15.6:0/302136911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009ae0 con 0x7fc7f80ceb30 2023-10-09T11:37:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7fdafc700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c5c0 tx=0x7fc7f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4011590 con 0x7fc7f80ceb30 2023-10-09T11:37:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f4011710 con 0x7fc7f80ceb30 2023-10-09T11:37:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f815c950 con 0x7fc7f80ceb30 2023-10-09T11:37:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4011ad0 con 0x7fc7f80ceb30 2023-10-09T11:37:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.380+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f814ae40 con 0x7fc7f80ceb30 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.381+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8069e40 con 0x7fc7f80ceb30 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.382+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7f401b3b0 con 0x7fc7f80ceb30 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.382+0000 7fc7ee7fc700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.382+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc7f40836b0 con 0x7fc7f80ceb30 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.382+0000 7fc7fe2fd700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.383+0000 7fc7fe2fd700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 0x7fc7dc0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cbec0 tx=0x7fc7e80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.386+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7f4050c20 con 0x7fc7f80ceb30 2023-10-09T11:37:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:17.594+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc7f815d0e0 con 0x7fc7f80ceb30 2023-10-09T11:37:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.238+0000 7fc7ee7fc700 1 -- 172.21.15.6:0/302136911 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc7f4017020 con 0x7fc7f80ceb30 2023-10-09T11:37:18.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 msgr2=0x7fc7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 0x7fc7dc0693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cbec0 tx=0x7fc7e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 msgr2=0x7fc7f80cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c5c0 tx=0x7fc7f400c8d0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 shutdown_connections 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7f815a2a0 0x7fc7f80c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7f806dd60 0x7fc7f814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 --2- 172.21.15.6:0/302136911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7f80ceb30 0x7fc7f80cb1b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 >> 172.21.15.6:0/302136911 conn(0x7fc7f8067640 msgr2=0x7fc7f80cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 shutdown_connections 2023-10-09T11:37:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.241+0000 7fc800561700 1 -- 172.21.15.6:0/302136911 wait complete. 2023-10-09T11:37:18.243 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:37:18.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.375+0000 7f0d5304f700 1 Processor -- start 2023-10-09T11:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.375+0000 7f0d5304f700 1 -- start start 2023-10-09T11:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d5304f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d5304f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 0x7f0d4c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d5304f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c0d07c0 con 0x7f0d4c157ca0 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d5304f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c06da50 con 0x7f0d4c1578d0 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d5304f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c0cfbb0 con 0x7f0d4c06d120 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.376+0000 7f0d50deb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40802/0 (socket says 172.21.15.6:40802) 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 -- 172.21.15.6:0/2494989969 learned_addr learned my addr 172.21.15.6:0/2494989969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d515ec700 1 --2- 172.21.15.6:0/2494989969 >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 0x7f0d4c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 -- 172.21.15.6:0/2494989969 >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 msgr2=0x7f0d4c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 --2- 172.21.15.6:0/2494989969 >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 0x7f0d4c06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 -- 172.21.15.6:0/2494989969 >> v1:172.21.15.118:6789/0 conn(0x7f0d4c157ca0 legacy=0x7f0d4c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 -- 172.21.15.6:0/2494989969 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0cfe90 con 0x7f0d4c1578d0 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d515ec700 1 --2- 172.21.15.6:0/2494989969 >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 0x7f0d4c06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d50deb700 1 --2- 172.21.15.6:0/2494989969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c068300 tx=0x7f0d40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba2abbe1aeb404a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d4b7fe700 1 -- 172.21.15.6:0/2494989969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000b860 con 0x7f0d4c1578d0 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d4b7fe700 1 -- 172.21.15.6:0/2494989969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000b9c0 con 0x7f0d4c1578d0 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.377+0000 7f0d4b7fe700 1 -- 172.21.15.6:0/2494989969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000bd60 con 0x7f0d4c1578d0 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 -- 172.21.15.6:0/2494989969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c1578d0 msgr2=0x7f0d4c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 --2- 172.21.15.6:0/2494989969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c068300 tx=0x7f0d40009250 comp rx=0 tx=0).stop 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 -- 172.21.15.6:0/2494989969 shutdown_connections 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 --2- 172.21.15.6:0/2494989969 >> v2:172.21.15.118:3300/0 conn(0x7f0d4c06d120 0x7f0d4c06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 --2- 172.21.15.6:0/2494989969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c1578d0 0x7f0d4c0cf4f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 -- 172.21.15.6:0/2494989969 >> 172.21.15.6:0/2494989969 conn(0x7f0d4c06bb90 msgr2=0x7f0d4c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 -- 172.21.15.6:0/2494989969 shutdown_connections 2023-10-09T11:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.378+0000 7f0d5304f700 1 -- 172.21.15.6:0/2494989969 wait complete. 2023-10-09T11:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.379+0000 7f0d5304f700 1 Processor -- start 2023-10-09T11:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.379+0000 7f0d5304f700 1 -- start start 2023-10-09T11:37:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 0x7f0d4c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d4c157ca0 0x7f0d4c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0c7cf0 con 0x7f0d4c06d120 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c16b2f0 con 0x7f0d4c157ca0 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d5304f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c16b5d0 con 0x7f0d4c1578d0 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40806/0 (socket says 172.21.15.6:40806) 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 -- 172.21.15.6:0/3959031593 learned_addr learned my addr 172.21.15.6:0/3959031593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d515ec700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d4c157ca0 0x7f0d4c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d4bfff700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 0x7f0d4c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 -- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 msgr2=0x7f0d4c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 0x7f0d4c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 -- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d4c157ca0 msgr2=0x7f0d4c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d4c157ca0 0x7f0d4c15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 -- 172.21.15.6:0/3959031593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400094f0 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d4bfff700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 0x7f0d4c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.380+0000 7f0d50deb700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009290 tx=0x7f0d40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.381+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40026480 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.381+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4001f070 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.381+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40026850 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.381+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c0c7980 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.381+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c16ae40 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.382+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4c067ac0 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.382+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d4001a430 con 0x7f0d4c06d120 2023-10-09T11:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.382+0000 7f0d48ff9700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 0x7f0d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.382+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0d40021070 con 0x7f0d4c06d120 2023-10-09T11:37:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.382+0000 7f0d4bfff700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 0x7f0d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.383+0000 7f0d4bfff700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 0x7f0d300693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c1548c0 tx=0x7f0d38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.387+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d40053720 con 0x7f0d4c06d120 2023-10-09T11:37:18.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.657+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d4c16b030 con 0x7f0d4c06d120 2023-10-09T11:37:18.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.658+0000 7f0d48ff9700 1 -- 172.21.15.6:0/3959031593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0d40015090 con 0x7f0d4c06d120 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:37:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.661 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:37:18.665 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.666 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:37:18.668 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:37:18.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:37:18.673 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:18.674 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:18.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 msgr2=0x7f0d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 0x7f0d300693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c1548c0 tx=0x7f0d38009040 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 msgr2=0x7f0d4c16a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009290 tx=0x7f0d40017000 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 shutdown_connections 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0d30066f30 0x7f0d300693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d4c157ca0 0x7f0d4c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c06d120 0x7f0d4c16a900 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 --2- 172.21.15.6:0/3959031593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0d4c1578d0 0x7f0d4c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 >> 172.21.15.6:0/3959031593 conn(0x7f0d4c06bb90 msgr2=0x7f0d4c155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 shutdown_connections 2023-10-09T11:37:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.660+0000 7f0d5304f700 1 -- 172.21.15.6:0/3959031593 wait complete. 2023-10-09T11:37:18.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.795+0000 7f2f8b731700 1 Processor -- start 2023-10-09T11:37:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.795+0000 7f2f8b731700 1 -- start start 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.796+0000 7f2f8b731700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.796+0000 7f2f8b731700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f840cb270 0x7f2f84159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.796+0000 7f2f8b731700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8406d350 con 0x7f2f840cae00 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.796+0000 7f2f8b731700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840c9ac0 con 0x7f2f840cb270 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.796+0000 7f2f8b731700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415e3b0 con 0x7f2f8415daa0 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f894cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f840cb270 0x7f2f84159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f894cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:60572/0 (socket says 172.21.15.6:60572) 2023-10-09T11:37:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f894cd700 1 -- 172.21.15.6:0/2620931640 learned_addr learned my addr 172.21.15.6:0/2620931640 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 -- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 msgr2=0x7f2f8415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 -- 172.21.15.6:0/2620931640 >> v1:172.21.15.118:6789/0 conn(0x7f2f840cae00 legacy=0x7f2f84159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 -- 172.21.15.6:0/2620931640 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8406c740 con 0x7f2f840cb270 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f894cd700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f89cce700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cb270 0x7f2f84159c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098e0 tx=0x7f2f7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e28507758d4902f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f83fff700 1 -- 172.21.15.6:0/2620931640 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00b640 con 0x7f2f840cb270 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f83fff700 1 -- 172.21.15.6:0/2620931640 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00b7a0 con 0x7f2f840cb270 2023-10-09T11:37:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.797+0000 7f2f83fff700 1 -- 172.21.15.6:0/2620931640 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00bb40 con 0x7f2f840cb270 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 -- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cb270 msgr2=0x7f2f84159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cb270 0x7f2f84159c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098e0 tx=0x7f2f7c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 -- 172.21.15.6:0/2620931640 shutdown_connections 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cb270 0x7f2f84159c50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2620931640 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f8415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 -- 172.21.15.6:0/2620931640 >> 172.21.15.6:0/2620931640 conn(0x7f2f840c9ca0 msgr2=0x7f2f840ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 -- 172.21.15.6:0/2620931640 shutdown_connections 2023-10-09T11:37:18.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.798+0000 7f2f8b731700 1 -- 172.21.15.6:0/2620931640 wait complete. 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.799+0000 7f2f8b731700 1 Processor -- start 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.799+0000 7f2f8b731700 1 -- start start 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 0x7f2f8416aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f840b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840ad190 con 0x7f2f840cb270 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840c5260 con 0x7f2f840cae00 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f8b731700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8416af50 con 0x7f2f8415daa0 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f88ccc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f88ccc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40822/0 (socket says 172.21.15.6:40822) 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f88ccc700 1 -- 172.21.15.6:0/2627256317 learned_addr learned my addr 172.21.15.6:0/2627256317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f894cd700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 0x7f2f8416aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.800+0000 7f2f89cce700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f840b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 -- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 msgr2=0x7f2f840b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f840b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 -- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 msgr2=0x7f2f8416aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 0x7f2f8416aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 -- 172.21.15.6:0/2627256317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009ae0 con 0x7f2f840cb270 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f894cd700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 0x7f2f8416aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f88ccc700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c510 tx=0x7f2f7800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011590 con 0x7f2f840cb270 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78011710 con 0x7f2f840cb270 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c009420 con 0x7f2f840cb270 2023-10-09T11:37:18.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011ad0 con 0x7f2f840cb270 2023-10-09T11:37:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.801+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840c4930 con 0x7f2f840cb270 2023-10-09T11:37:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.802+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84068080 con 0x7f2f840cb270 2023-10-09T11:37:18.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.802+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f7801b3b0 con 0x7f2f840cb270 2023-10-09T11:37:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.803+0000 7f2f817fa700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 0x7f2f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.803+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f78083570 con 0x7f2f840cb270 2023-10-09T11:37:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.803+0000 7f2f894cd700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 0x7f2f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:18.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.803+0000 7f2f894cd700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 0x7f2f700693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009410 tx=0x7f2f7400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:18.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:18.807+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f78050b30 con 0x7f2f840cb270 2023-10-09T11:37:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.000+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f840cca90 con 0x7f2f840cb270 2023-10-09T11:37:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.001+0000 7f2f817fa700 1 -- 172.21.15.6:0/2627256317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f2f78017020 con 0x7f2f840cb270 2023-10-09T11:37:19.001 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:19.002 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:18.247587+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 msgr2=0x7f2f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 0x7f2f700693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009410 tx=0x7f2f7400b040 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 msgr2=0x7f2f8415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800c510 tx=0x7f2f7800c820 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 shutdown_connections 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f70066f30 0x7f2f700693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f8415daa0 0x7f2f840b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f840cae00 0x7f2f8416aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 --2- 172.21.15.6:0/2627256317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f840cb270 0x7f2f8415a7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 >> 172.21.15.6:0/2627256317 conn(0x7f2f840c9ca0 msgr2=0x7f2f84069020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 shutdown_connections 2023-10-09T11:37:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.003+0000 7f2f8b731700 1 -- 172.21.15.6:0/2627256317 wait complete. 2023-10-09T11:37:19.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:37:19.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:37:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.137+0000 7fb1089fe700 1 Processor -- start 2023-10-09T11:37:19.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb1089fe700 1 -- start start 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb1089fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb1040d0f50 0x7fb10406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb1089fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10406d990 con 0x7fb1040d0b80 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb1089fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040cf2d0 con 0x7fb10406d530 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb1089fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10415a690 con 0x7fb1040d0f50 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb10259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb1040d0f50 0x7fb10406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.138+0000 7fb102d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1040d0b80 0x7fb1040cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47702/0 (socket says 172.21.15.6:47702) 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb102d9d700 1 -- 172.21.15.6:0/1334392734 learned_addr learned my addr 172.21.15.6:0/1334392734 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb10259c700 1 -- 172.21.15.6:0/1334392734 >> v1:172.21.15.118:6789/0 conn(0x7fb10406d530 legacy=0x7fb10415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb10259c700 1 -- 172.21.15.6:0/1334392734 >> v1:172.21.15.6:6789/0 conn(0x7fb1040d0b80 legacy=0x7fb1040cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb10259c700 1 -- 172.21.15.6:0/1334392734 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040d0480 con 0x7fb1040d0f50 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb101d9b700 1 -- 172.21.15.6:0/1334392734 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196983804 0 0) 0x7fb10406d990 con 0x7fb1040d0b80 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb10259c700 1 --2- 172.21.15.6:0/1334392734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb10406cff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0098e0 tx=0x7fb0ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79fd13c9c47dea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb101d9b700 1 -- 172.21.15.6:0/1334392734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec009e80 con 0x7fb1040d0f50 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb101d9b700 1 -- 172.21.15.6:0/1334392734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00b820 con 0x7fb1040d0f50 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.139+0000 7fb101d9b700 1 -- 172.21.15.6:0/1334392734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00bba0 con 0x7fb1040d0f50 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 -- 172.21.15.6:0/1334392734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 msgr2=0x7fb10406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 --2- 172.21.15.6:0/1334392734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb10406cff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0098e0 tx=0x7fb0ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 -- 172.21.15.6:0/1334392734 shutdown_connections 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 --2- 172.21.15.6:0/1334392734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb10406cff0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 -- 172.21.15.6:0/1334392734 >> 172.21.15.6:0/1334392734 conn(0x7fb104063230 msgr2=0x7fb104063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 -- 172.21.15.6:0/1334392734 shutdown_connections 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.140+0000 7fb1089fe700 1 -- 172.21.15.6:0/1334392734 wait complete. 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.141+0000 7fb1089fe700 1 Processor -- start 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.141+0000 7fb1089fe700 1 -- start start 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb10406d530 0x7fb10413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1040d0b80 0x7fb10416a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10416bac0 con 0x7fb1040d0f50 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10416b3f0 con 0x7fb10406d530 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb1089fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10416ae30 con 0x7fb1040d0b80 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40836/0 (socket says 172.21.15.6:40836) 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 -- 172.21.15.6:0/852814564 learned_addr learned my addr 172.21.15.6:0/852814564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10259c700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1040d0b80 0x7fb10416a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb102d9d700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb10406d530 0x7fb10413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 -- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1040d0b80 msgr2=0x7fb10416a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1040d0b80 0x7fb10416a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 -- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb10406d530 msgr2=0x7fb10413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb10406d530 0x7fb10413dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 -- 172.21.15.6:0/852814564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009420 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.142+0000 7fb10359e700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c930 tx=0x7fb0f40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400ce70 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400a7e0 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400aba0 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10416b110 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10413e250 con 0x7fb1040d0f50 2023-10-09T11:37:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.143+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1040676e0 con 0x7fb1040d0f50 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.144+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0f4012420 con 0x7fb1040d0f50 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.144+0000 7fb0faffd700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 0x7fb0e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.144+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb0f4084640 con 0x7fb1040d0f50 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.144+0000 7fb102d9d700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 0x7fb0e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.145+0000 7fb102d9d700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 0x7fb0e40693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0011e0 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.149+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0f4051cb0 con 0x7fb1040d0f50 2023-10-09T11:37:19.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.344+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb10416bc00 con 0x7fb1040d0f50 2023-10-09T11:37:19.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.344+0000 7fb0faffd700 1 -- 172.21.15.6:0/852814564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0f40552d0 con 0x7fb1040d0f50 2023-10-09T11:37:19.347 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:37:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 msgr2=0x7fb0e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 0x7fb0e40693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0011e0 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2023-10-09T11:37:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 msgr2=0x7fb104156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c930 tx=0x7fb0f40026e0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 shutdown_connections 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb0e4066f30 0x7fb0e40693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040d0f50 0x7fb104156c00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb10406d530 0x7fb10413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 --2- 172.21.15.6:0/852814564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1040d0b80 0x7fb10416a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 >> 172.21.15.6:0/852814564 conn(0x7fb104063230 msgr2=0x7fb104151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 shutdown_connections 2023-10-09T11:37:19.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.346+0000 7fb1089fe700 1 -- 172.21.15.6:0/852814564 wait complete. 2023-10-09T11:37:19.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:37:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.477+0000 7ff22654a700 1 Processor -- start 2023-10-09T11:37:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.477+0000 7ff22654a700 1 -- start start 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff22654a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff220159b40 0x7ff2200cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff22654a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 0x7ff2200cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff22654a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200cee10 con 0x7ff220159f10 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff22654a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200cd040 con 0x7ff220159b40 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff22654a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200cd320 con 0x7ff220068e90 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff225548700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff220159b40 0x7ff2200cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff225d49700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 0x7ff2200cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff224d47700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff220159f10 0x7ff220068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:47342/0 (socket says 172.21.15.6:47342) 2023-10-09T11:37:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.478+0000 7ff224d47700 1 -- 172.21.15.6:0/3300492552 learned_addr learned my addr 172.21.15.6:0/3300492552 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225548700 1 -- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 msgr2=0x7ff2200cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225548700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 0x7ff2200cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225548700 1 -- 172.21.15.6:0/3300492552 >> v1:172.21.15.118:6789/0 conn(0x7ff220159f10 legacy=0x7ff220068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225548700 1 -- 172.21.15.6:0/3300492552 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200ce7c0 con 0x7ff220159b40 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225d49700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 0x7ff2200cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff225548700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220159b40 0x7ff2200cc600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2180098e0 tx=0x7ff2180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=297fadbd54d09d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff21ffff700 1 -- 172.21.15.6:0/3300492552 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800b640 con 0x7ff220159b40 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff21ffff700 1 -- 172.21.15.6:0/3300492552 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800b7a0 con 0x7ff220159b40 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff21ffff700 1 -- 172.21.15.6:0/3300492552 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800bb40 con 0x7ff220159b40 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.479+0000 7ff22654a700 1 -- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220159b40 msgr2=0x7ff2200cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220159b40 0x7ff2200cc600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff2180098e0 tx=0x7ff2180091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 -- 172.21.15.6:0/3300492552 shutdown_connections 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220068e90 0x7ff2200cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 --2- 172.21.15.6:0/3300492552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220159b40 0x7ff2200cc600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 -- 172.21.15.6:0/3300492552 >> 172.21.15.6:0/3300492552 conn(0x7ff2200cd660 msgr2=0x7ff2200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 -- 172.21.15.6:0/3300492552 shutdown_connections 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.480+0000 7ff22654a700 1 -- 172.21.15.6:0/3300492552 wait complete. 2023-10-09T11:37:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.481+0000 7ff22654a700 1 Processor -- start 2023-10-09T11:37:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.481+0000 7ff22654a700 1 -- start start 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220068e90 0x7ff220169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220159b40 0x7ff2200c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22016a870 con 0x7ff220159f10 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c9750 con 0x7ff220068e90 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c8b40 con 0x7ff220159b40 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40838/0 (socket says 172.21.15.6:40838) 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 -- 172.21.15.6:0/1765634486 learned_addr learned my addr 172.21.15.6:0/1765634486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff224d47700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220159b40 0x7ff2200c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225548700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220068e90 0x7ff220169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 -- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220159b40 msgr2=0x7ff2200c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220159b40 0x7ff2200c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 -- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220068e90 msgr2=0x7ff220169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220068e90 0x7ff220169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 -- 172.21.15.6:0/1765634486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210009a20 con 0x7ff220159f10 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff225d49700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff210009f60 tx=0x7ff21000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000cb70 con 0x7ff220159f10 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000f040 con 0x7ff220159f10 2023-10-09T11:37:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff218009420 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.482+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210014480 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.483+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2200c9100 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.483+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2200cb910 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.484+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2100147f0 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.484+0000 7ff21d7fa700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.484+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff210084eb0 con 0x7ff220159f10 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.484+0000 7ff225548700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.485+0000 7ff225548700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2180093f0 tx=0x7ff218017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.488+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff210052470 con 0x7ff220159f10 2023-10-09T11:37:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.682+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff220071b10 con 0x7ff220159f10 2023-10-09T11:37:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.683+0000 7ff21d7fa700 1 -- 172.21.15.6:0/1765634486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff210018090 con 0x7ff220159f10 2023-10-09T11:37:19.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:19.683 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:37:19.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:19.684 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:37:19.684 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:37:19.684 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:19.684 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 msgr2=0x7ff20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 0x7ff20c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2180093f0 tx=0x7ff218017000 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 msgr2=0x7ff2200c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff210009f60 tx=0x7ff21000b040 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 shutdown_connections 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff20c066f30 0x7ff20c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff220159f10 0x7ff2200c84a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff220068e90 0x7ff220169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 --2- 172.21.15.6:0/1765634486 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff220159b40 0x7ff2200c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 >> 172.21.15.6:0/1765634486 conn(0x7ff2200cd660 msgr2=0x7ff22006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 shutdown_connections 2023-10-09T11:37:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.685+0000 7ff22654a700 1 -- 172.21.15.6:0/1765634486 wait complete. 2023-10-09T11:37:19.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:37:19.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:37:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.819+0000 7f191061f700 1 Processor -- start 2023-10-09T11:37:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.819+0000 7f191061f700 1 -- start start 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f191061f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f191061f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19081583b0 0x7f19080cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f191061f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080b2890 con 0x7f1908157fe0 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f191061f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080b4070 con 0x7f19081583b0 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f191061f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080b4350 con 0x7f19080b3bd0 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f190dbba700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f190ebbc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19081583b0 0x7f19080cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.820+0000 7f190e3bb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1908157fe0 0x7f19080b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:47350/0 (socket says 172.21.15.6:47350) 2023-10-09T11:37:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190e3bb700 1 -- 172.21.15.6:0/3155733636 learned_addr learned my addr 172.21.15.6:0/3155733636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190ebbc700 1 -- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 msgr2=0x7f19080ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190ebbc700 1 --2- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190ebbc700 1 -- 172.21.15.6:0/3155733636 >> v1:172.21.15.118:6789/0 conn(0x7f1908157fe0 legacy=0x7f19080b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190ebbc700 1 -- 172.21.15.6:0/3155733636 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080b4630 con 0x7f19081583b0 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190ebbc700 1 --2- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19080cf070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f18f80098e0 tx=0x7f18f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e272630bfdc7dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190d3b9700 1 -- 172.21.15.6:0/3155733636 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800b640 con 0x7f19081583b0 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190d3b9700 1 -- 172.21.15.6:0/3155733636 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800b7a0 con 0x7f19081583b0 2023-10-09T11:37:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.821+0000 7f190d3b9700 1 -- 172.21.15.6:0/3155733636 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800bb40 con 0x7f19081583b0 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 -- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 msgr2=0x7f19080cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 --2- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19080cf070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f18f80098e0 tx=0x7f18f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 -- 172.21.15.6:0/3155733636 shutdown_connections 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 --2- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19080cf070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 --2- 172.21.15.6:0/3155733636 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 -- 172.21.15.6:0/3155733636 >> 172.21.15.6:0/3155733636 conn(0x7f1908067640 msgr2=0x7f1908067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 -- 172.21.15.6:0/3155733636 shutdown_connections 2023-10-09T11:37:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.822+0000 7f191061f700 1 -- 172.21.15.6:0/3155733636 wait complete. 2023-10-09T11:37:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.823+0000 7f191061f700 1 Processor -- start 2023-10-09T11:37:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.823+0000 7f191061f700 1 -- start start 2023-10-09T11:37:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19081685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908159370 con 0x7f1908157fe0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908159e80 con 0x7f19081583b0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f191061f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908159550 con 0x7f19080b3bd0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40842/0 (socket says 172.21.15.6:40842) 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 -- 172.21.15.6:0/2284442817 learned_addr learned my addr 172.21.15.6:0/2284442817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190ebbc700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19081685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190e3bb700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 -- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 msgr2=0x7f19080c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 -- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 msgr2=0x7f19081685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19081685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.824+0000 7f190dbba700 1 -- 172.21.15.6:0/2284442817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009420 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f190dbba700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00e900 tx=0x7f18fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc013990 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc013af0 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908159830 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc01b440 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.825+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1908151a80 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.826+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1908159ff0 con 0x7f1908157fe0 2023-10-09T11:37:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.826+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18fc01b7f0 con 0x7f1908157fe0 2023-10-09T11:37:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.827+0000 7f19067fc700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 0x7f18f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.827+0000 7f190e3bb700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 0x7f18f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.827+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f18fc088130 con 0x7f1908157fe0 2023-10-09T11:37:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.827+0000 7f190e3bb700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 0x7f18f40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19000020c0 tx=0x7f1900001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:19.831+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18fc0556f0 con 0x7f1908157fe0 2023-10-09T11:37:20.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.022+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19080cc6b0 con 0x7f1908157fe0 2023-10-09T11:37:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.237+0000 7f19067fc700 1 -- 172.21.15.6:0/2284442817 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f18fc058d10 con 0x7f1908157fe0 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 msgr2=0x7f18f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 0x7f18f40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f19000020c0 tx=0x7f1900001a10 comp rx=0 tx=0).stop 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 msgr2=0x7f1908151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00e900 tx=0x7f18fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 shutdown_connections 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18f4066f30 0x7f18f40693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19081583b0 0x7f19081685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19080b3bd0 0x7f19080c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 --2- 172.21.15.6:0/2284442817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1908157fe0 0x7f1908151540 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00e900 tx=0x7f18fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.240+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 >> 172.21.15.6:0/2284442817 conn(0x7f1908067640 msgr2=0x7f19080cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.241+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 shutdown_connections 2023-10-09T11:37:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.241+0000 7f191061f700 1 -- 172.21.15.6:0/2284442817 wait complete. 2023-10-09T11:37:20.243 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:37:20.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:37:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.380+0000 7f63b5cd7700 1 Processor -- start 2023-10-09T11:37:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.380+0000 7f63b5cd7700 1 -- start start 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b01577c0 0x7f63b0068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f63b0157b90 0x7f63b0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63b00cb790 0x7f63b00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00cca80 con 0x7f63b00cb790 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00cedd0 con 0x7f63b0157b90 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63b5cd7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00cc4c0 con 0x7f63b01577c0 2023-10-09T11:37:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63b00cb790 0x7f63b00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63b00cb790 0x7f63b00cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40846/0 (socket says 172.21.15.6:40846) 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 -- 172.21.15.6:0/1059654900 learned_addr learned my addr 172.21.15.6:0/1059654900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63aeffd700 1 --2- 172.21.15.6:0/1059654900 >> v2:172.21.15.118:3300/0 conn(0x7f63b0157b90 0x7f63b0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63af7fe700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b01577c0 0x7f63b0068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 -- 172.21.15.6:0/1059654900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b01577c0 msgr2=0x7f63b0068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b01577c0 0x7f63b0068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 -- 172.21.15.6:0/1059654900 >> v2:172.21.15.118:3300/0 conn(0x7f63b0157b90 msgr2=0x7f63b0068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 --2- 172.21.15.6:0/1059654900 >> v2:172.21.15.118:3300/0 conn(0x7f63b0157b90 0x7f63b0068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 -- 172.21.15.6:0/1059654900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00cc7a0 con 0x7f63b00cb790 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.381+0000 7f63affff700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b00cbc10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f63b0068500 tx=0x7f63a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb56acad816d8001 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63ae7fc700 1 -- 172.21.15.6:0/1059654900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800e070 con 0x7f63b00cb790 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63ae7fc700 1 -- 172.21.15.6:0/1059654900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800ba50 con 0x7f63b00cb790 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63ae7fc700 1 -- 172.21.15.6:0/1059654900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a80092e0 con 0x7f63b00cb790 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1059654900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 msgr2=0x7f63b00cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b00cbc10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f63b0068500 tx=0x7f63a8009840 comp rx=0 tx=0).stop 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1059654900 shutdown_connections 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b00cbc10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1059654900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b01577c0 0x7f63b0068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1059654900 >> v2:172.21.15.118:3300/0 conn(0x7f63b0157b90 0x7f63b0068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1059654900 >> 172.21.15.6:0/1059654900 conn(0x7f63b00d0df0 msgr2=0x7f63b00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1059654900 shutdown_connections 2023-10-09T11:37:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.382+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1059654900 wait complete. 2023-10-09T11:37:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.383+0000 7f63b5cd7700 1 Processor -- start 2023-10-09T11:37:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.383+0000 7f63b5cd7700 1 -- start start 2023-10-09T11:37:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 0x7f63b01599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b0157b90 0x7f63b0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00ca300 con 0x7f63b00cb790 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c99d0 con 0x7f63b01577c0 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63b5cd7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c9cb0 con 0x7f63b0157b90 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40862/0 (socket says 172.21.15.6:40862) 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63af7fe700 1 -- 172.21.15.6:0/1280788844 learned_addr learned my addr 172.21.15.6:0/1280788844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63affff700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b0157b90 0x7f63b0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.384+0000 7f63aeffd700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 0x7f63b01599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 -- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b0157b90 msgr2=0x7f63b0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b0157b90 0x7f63b0159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 -- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 msgr2=0x7f63b01599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 0x7f63b01599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 -- 172.21.15.6:0/1280788844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8009ae0 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63aeffd700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 0x7f63b01599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63af7fe700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63a000d890 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00125f0 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0012750 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b00c9f90 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0012ad0 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.385+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b00ca790 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.386+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b00ca9b0 con 0x7f63b00cb790 2023-10-09T11:37:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.387+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63a001e460 con 0x7f63b00cb790 2023-10-09T11:37:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.387+0000 7f63977fe700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 0x7f639c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.387+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f63a0084970 con 0x7f63b00cb790 2023-10-09T11:37:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.387+0000 7f63aeffd700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 0x7f639c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.388+0000 7f63aeffd700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 0x7f639c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63b016aee0 tx=0x7f63a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.392+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63a0051dc0 con 0x7f63b00cb790 2023-10-09T11:37:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:20.583+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f63b00ca5e0 con 0x7f63b00cb790 2023-10-09T11:37:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.243+0000 7f63977fe700 1 -- 172.21.15.6:0/1280788844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f63a00553e0 con 0x7f63b00cb790 2023-10-09T11:37:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.252+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 msgr2=0x7f639c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.252+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 0x7f639c0693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63b016aee0 tx=0x7f63a4008040 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.252+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 msgr2=0x7f63b0156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.252+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63a000d890 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 shutdown_connections 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f639c066f30 0x7f639c0693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63b0157b90 0x7f63b0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b00cb790 0x7f63b0156a00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 --2- 172.21.15.6:0/1280788844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63b01577c0 0x7f63b01599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 >> 172.21.15.6:0/1280788844 conn(0x7f63b00d0df0 msgr2=0x7f63b015c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 shutdown_connections 2023-10-09T11:37:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.253+0000 7f63b5cd7700 1 -- 172.21.15.6:0/1280788844 wait complete. 2023-10-09T11:37:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:37:21.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:37:21.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.393+0000 7fda80f1f700 1 Processor -- start 2023-10-09T11:37:21.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.393+0000 7fda80f1f700 1 -- start start 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda80f1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda80f1f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 0x7fda7c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda80f1f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c06dac0 con 0x7fda7c1578d0 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda80f1f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0d07c0 con 0x7fda7c06d120 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda80f1f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0cfbb0 con 0x7fda7c157ca0 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7ad9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 0x7fda7c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7a59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fda7c1578d0 0x7fda7c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:47362/0 (socket says 172.21.15.6:47362) 2023-10-09T11:37:21.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7a59c700 1 -- 172.21.15.6:0/2084109308 learned_addr learned my addr 172.21.15.6:0/2084109308 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:60662/0 (socket says 172.21.15.6:60662) 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7959a700 1 -- 172.21.15.6:0/2084109308 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139560979 0 0) 0x7fda6c001490 con 0x7fda7c1578d0 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7959a700 1 -- 172.21.15.6:0/2084109308 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003570 con 0x7fda7c1578d0 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 -- 172.21.15.6:0/2084109308 >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 msgr2=0x7fda7c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 --2- 172.21.15.6:0/2084109308 >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 0x7fda7c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 -- 172.21.15.6:0/2084109308 >> v1:172.21.15.118:6789/0 conn(0x7fda7c1578d0 legacy=0x7fda7c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda79d9b700 1 -- 172.21.15.6:0/2084109308 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0cfe90 con 0x7fda7c157ca0 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.394+0000 7fda7ad9d700 1 --2- 172.21.15.6:0/2084109308 >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 0x7fda7c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda79d9b700 1 --2- 172.21.15.6:0/2084109308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda640098e0 tx=0x7fda640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330e324a05d71f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda7959a700 1 -- 172.21.15.6:0/2084109308 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64011630 con 0x7fda7c157ca0 2023-10-09T11:37:21.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda7959a700 1 -- 172.21.15.6:0/2084109308 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda64011790 con 0x7fda7c157ca0 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda7959a700 1 -- 172.21.15.6:0/2084109308 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64011b30 con 0x7fda7c157ca0 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 -- 172.21.15.6:0/2084109308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 msgr2=0x7fda7c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 --2- 172.21.15.6:0/2084109308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda640098e0 tx=0x7fda640091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 -- 172.21.15.6:0/2084109308 shutdown_connections 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 --2- 172.21.15.6:0/2084109308 >> v2:172.21.15.118:3300/0 conn(0x7fda7c06d120 0x7fda7c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 --2- 172.21.15.6:0/2084109308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c157ca0 0x7fda7c0cf4f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 -- 172.21.15.6:0/2084109308 >> 172.21.15.6:0/2084109308 conn(0x7fda7c06bb90 msgr2=0x7fda7c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 -- 172.21.15.6:0/2084109308 shutdown_connections 2023-10-09T11:37:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.395+0000 7fda80f1f700 1 -- 172.21.15.6:0/2084109308 wait complete. 2023-10-09T11:37:21.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.396+0000 7fda80f1f700 1 Processor -- start 2023-10-09T11:37:21.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 -- start start 2023-10-09T11:37:21.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c06d120 0x7fda7c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda7c157ca0 0x7fda7c0b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1490f0 con 0x7fda7c1578d0 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c16be90 con 0x7fda7c157ca0 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda80f1f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b4ca0 con 0x7fda7c06d120 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda79d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40878/0 (socket says 172.21.15.6:40878) 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.397+0000 7fda79d9b700 1 -- 172.21.15.6:0/4067745874 learned_addr learned my addr 172.21.15.6:0/4067745874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda7a59c700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c06d120 0x7fda7c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda7ad9d700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda7c157ca0 0x7fda7c0b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 -- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c06d120 msgr2=0x7fda7c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c06d120 0x7fda7c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 -- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda7c157ca0 msgr2=0x7fda7c0b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda7c157ca0 0x7fda7c0b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 -- 172.21.15.6:0/4067745874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009420 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda79d9b700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda7c068330 tx=0x7fda64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64011b10 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda640253f0 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda64009420 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64025790 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.398+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c0b5260 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.399+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c06fc00 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.400+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda64025b80 con 0x7fda7c1578d0 2023-10-09T11:37:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.400+0000 7fda727fc700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 0x7fda5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.400+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fda64085ca0 con 0x7fda7c1578d0 2023-10-09T11:37:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.400+0000 7fda7a59c700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 0x7fda5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.400+0000 7fda7a59c700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 0x7fda5c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0af460 tx=0x7fda6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:21.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.405+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda64052f70 con 0x7fda7c1578d0 2023-10-09T11:37:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:21.644+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fda7c0d0170 con 0x7fda7c1578d0 2023-10-09T11:37:22.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.261+0000 7fda727fc700 1 -- 172.21.15.6:0/4067745874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7fda640150c0 con 0x7fda7c1578d0 2023-10-09T11:37:22.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.266+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 msgr2=0x7fda5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.266+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 0x7fda5c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0af460 tx=0x7fda6c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.266+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 msgr2=0x7fda7c16b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.266+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fda7c068330 tx=0x7fda64017000 comp rx=0 tx=0).stop 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 shutdown_connections 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fda5c066f30 0x7fda5c0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda7c157ca0 0x7fda7c0b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda7c06d120 0x7fda7c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 --2- 172.21.15.6:0/4067745874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda7c1578d0 0x7fda7c16b950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.267+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 >> 172.21.15.6:0/4067745874 conn(0x7fda7c06bb90 msgr2=0x7fda7c070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.268+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 shutdown_connections 2023-10-09T11:37:22.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.268+0000 7fda80f1f700 1 -- 172.21.15.6:0/4067745874 wait complete. 2023-10-09T11:37:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 6 and data pool 7 2023-10-09T11:37:22.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:22.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.402+0000 7f72e6f74700 1 Processor -- start 2023-10-09T11:37:22.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.402+0000 7f72e6f74700 1 -- start start 2023-10-09T11:37:22.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6f74700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 0x7f72e00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6f74700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00cee10 con 0x7f72e0068e90 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6f74700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00cd040 con 0x7f72e0159f10 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6f74700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00cd320 con 0x7f72e0159b40 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6773700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72e0068e90 0x7f72e00cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47716/0 (socket says 172.21.15.6:47716) 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e6773700 1 -- 172.21.15.6:0/459975062 learned_addr learned my addr 172.21.15.6:0/459975062 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e5f72700 1 --2- 172.21.15.6:0/459975062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 0x7f72e00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.403+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553752437 0 0) 0x7f72e00cee10 con 0x7f72e0068e90 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c8003570 con 0x7f72e0068e90 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913471786 0 0) 0x7f72e00cd040 con 0x7f72e0159f10 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e00cee10 con 0x7f72e0159f10 2023-10-09T11:37:22.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e5f72700 1 -- 172.21.15.6:0/459975062 >> v1:172.21.15.118:6789/0 conn(0x7f72e0159f10 legacy=0x7f72e0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e5f72700 1 -- 172.21.15.6:0/459975062 >> v1:172.21.15.6:6789/0 conn(0x7f72e0068e90 legacy=0x7f72e00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e5f72700 1 -- 172.21.15.6:0/459975062 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00ce7c0 con 0x7f72e0159b40 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e5f72700 1 --2- 172.21.15.6:0/459975062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 0x7f72e00cc600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009910 tx=0x7f72d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d172e25e5528121 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011630 con 0x7f72e0159b40 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8011790 con 0x7f72e0159b40 2023-10-09T11:37:22.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.404+0000 7f72e4f70700 1 -- 172.21.15.6:0/459975062 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011b30 con 0x7f72e0159b40 2023-10-09T11:37:22.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 -- 172.21.15.6:0/459975062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 msgr2=0x7f72e00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 --2- 172.21.15.6:0/459975062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 0x7f72e00cc600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009910 tx=0x7f72d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 -- 172.21.15.6:0/459975062 shutdown_connections 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 --2- 172.21.15.6:0/459975062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159b40 0x7f72e00cc600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 -- 172.21.15.6:0/459975062 >> 172.21.15.6:0/459975062 conn(0x7f72e00cd660 msgr2=0x7f72e00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 -- 172.21.15.6:0/459975062 shutdown_connections 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.405+0000 7f72e6f74700 1 -- 172.21.15.6:0/459975062 wait complete. 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 Processor -- start 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 -- start start 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e0068e90 0x7f72e01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159f10 0x7f72e015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c9660 con 0x7f72e0159b40 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0144140 con 0x7f72e0068e90 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.406+0000 7f72e6f74700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c7f30 con 0x7f72e0159f10 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40882/0 (socket says 172.21.15.6:40882) 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 -- 172.21.15.6:0/313884329 learned_addr learned my addr 172.21.15.6:0/313884329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5f72700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e0068e90 0x7f72e01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e6773700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159f10 0x7f72e015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 -- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159f10 msgr2=0x7f72e015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159f10 0x7f72e015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 -- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e0068e90 msgr2=0x7f72e01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e0068e90 0x7f72e01540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 -- 172.21.15.6:0/313884329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009420 con 0x7f72e0159b40 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e5771700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c580 tx=0x7f72d4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4010510 con 0x7f72e0159b40 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4010670 con 0x7f72e0159b40 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e015a7a0 con 0x7f72e0159b40 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.407+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4010a30 con 0x7f72e0159b40 2023-10-09T11:37:22.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.408+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e015b040 con 0x7f72e0159b40 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.408+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e015aba0 con 0x7f72e0159b40 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.409+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72d401b400 con 0x7f72e0159b40 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.409+0000 7f72ddffb700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 0x7f72cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.409+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72d40840d0 con 0x7f72e0159b40 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.409+0000 7f72e5f72700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 0x7f72cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.410+0000 7f72e5f72700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 0x7f72cc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009860 tx=0x7f72d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.414+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72d4051340 con 0x7f72e0159b40 2023-10-09T11:37:22.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.608+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72e00cb910 con 0x7f72e0159b40 2023-10-09T11:37:22.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.609+0000 7f72ddffb700 1 -- 172.21.15.6:0/313884329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f72d4054960 con 0x7f72e0159b40 2023-10-09T11:37:22.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:22.610 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:21.645405+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 msgr2=0x7f72cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 0x7f72cc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009860 tx=0x7f72d8017000 comp rx=0 tx=0).stop 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 msgr2=0x7f72e00c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c580 tx=0x7f72d4007e10 comp rx=0 tx=0).stop 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 shutdown_connections 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f72cc066f30 0x7f72cc0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0159f10 0x7f72e015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e0068e90 0x7f72e01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 --2- 172.21.15.6:0/313884329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e0159b40 0x7f72e00c8bc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 >> 172.21.15.6:0/313884329 conn(0x7f72e00cd660 msgr2=0x7f72e00c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 shutdown_connections 2023-10-09T11:37:22.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.611+0000 7f72e6f74700 1 -- 172.21.15.6:0/313884329 wait complete. 2023-10-09T11:37:22.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.741+0000 7feb28de5700 1 Processor -- start 2023-10-09T11:37:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.742+0000 7feb28de5700 1 -- start start 2023-10-09T11:37:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.742+0000 7feb28de5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb2415a2a0 0x7feb240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb28de5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb28de5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240b0ca0 con 0x7feb240ceb30 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb28de5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2406e160 con 0x7feb2415a2a0 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb28de5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2406ea90 con 0x7feb2406dd60 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb2415a2a0 0x7feb240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb2415a2a0 0x7feb240b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40884/0 (socket says 172.21.15.6:40884) 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 -- 172.21.15.6:0/3145858994 learned_addr learned my addr 172.21.15.6:0/3145858994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb22d9d700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 -- 172.21.15.6:0/3145858994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 msgr2=0x7feb240cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 -- 172.21.15.6:0/3145858994 >> v1:172.21.15.118:6789/0 conn(0x7feb240ceb30 legacy=0x7feb2406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 -- 172.21.15.6:0/3145858994 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240b00d0 con 0x7feb2415a2a0 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2259c700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb240b1130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099b0 tx=0x7feb1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bf9e5ded713b7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2159a700 1 -- 172.21.15.6:0/3145858994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00b820 con 0x7feb2415a2a0 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2159a700 1 -- 172.21.15.6:0/3145858994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00b980 con 0x7feb2415a2a0 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.743+0000 7feb2159a700 1 -- 172.21.15.6:0/3145858994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00bd20 con 0x7feb2415a2a0 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 -- 172.21.15.6:0/3145858994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 msgr2=0x7feb240b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb240b1130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099b0 tx=0x7feb1c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 -- 172.21.15.6:0/3145858994 shutdown_connections 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 --2- 172.21.15.6:0/3145858994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb240b1130 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 -- 172.21.15.6:0/3145858994 >> 172.21.15.6:0/3145858994 conn(0x7feb24067640 msgr2=0x7feb24067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 -- 172.21.15.6:0/3145858994 shutdown_connections 2023-10-09T11:37:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.744+0000 7feb28de5700 1 -- 172.21.15.6:0/3145858994 wait complete. 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.745+0000 7feb28de5700 1 Processor -- start 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.745+0000 7feb28de5700 1 -- start start 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb240ceb30 0x7feb2416b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241531e0 con 0x7feb2415a2a0 2023-10-09T11:37:22.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b4770 con 0x7feb240ceb30 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb28de5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2416bc10 con 0x7feb2406dd60 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40894/0 (socket says 172.21.15.6:40894) 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 -- 172.21.15.6:0/1019404346 learned_addr learned my addr 172.21.15.6:0/1019404346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb2259c700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb21d9b700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb240ceb30 0x7feb2416b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 -- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 msgr2=0x7feb240b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 -- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb240ceb30 msgr2=0x7feb2416b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb240ceb30 0x7feb2416b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 -- 172.21.15.6:0/1019404346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0094f0 con 0x7feb2415a2a0 2023-10-09T11:37:22.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.746+0000 7feb22d9d700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feb1400ceb0 tx=0x7feb14007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1400ae40 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14016430 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140167d0 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240cbea0 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2415d800 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.747+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb24069e40 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.748+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb14003020 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.748+0000 7feb1a7fc700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.749+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb14012070 con 0x7feb2415a2a0 2023-10-09T11:37:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.749+0000 7feb2259c700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.749+0000 7feb2259c700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 0x7feb040693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099b0 tx=0x7feb1c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.753+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb14056160 con 0x7feb2415a2a0 2023-10-09T11:37:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.948+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb2404bb80 con 0x7feb2415a2a0 2023-10-09T11:37:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.949+0000 7feb1a7fc700 1 -- 172.21.15.6:0/1019404346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15315 (secure 0 0 0) 0x7feb14055cf0 con 0x7feb2415a2a0 2023-10-09T11:37:22.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:22.950 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:21.645405+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 msgr2=0x7feb040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 0x7feb040693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099b0 tx=0x7feb1c016000 comp rx=0 tx=0).stop 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 msgr2=0x7feb2415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7feb1400ceb0 tx=0x7feb14007870 comp rx=0 tx=0).stop 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 shutdown_connections 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb04066f30 0x7feb040693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb2415a2a0 0x7feb2415f120 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb2406dd60 0x7feb240b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 --2- 172.21.15.6:0/1019404346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb240ceb30 0x7feb2416b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 >> 172.21.15.6:0/1019404346 conn(0x7feb24067640 msgr2=0x7feb240ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 shutdown_connections 2023-10-09T11:37:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:22.951+0000 7feb28de5700 1 -- 172.21.15.6:0/1019404346 wait complete. 2023-10-09T11:37:22.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:37:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.085+0000 7f624d345700 1 Processor -- start 2023-10-09T11:37:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.085+0000 7f624d345700 1 -- start start 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f624d345700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f62480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f624d345700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6248157ca0 0x7f624815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f624d345700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480d07c0 con 0x7f624806d120 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f624d345700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62480cfbb0 con 0x7f6248157ca0 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f624d345700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480cfe90 con 0x7f62481578d0 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f624806d120 0x7f624815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47720/0 (socket says 172.21.15.6:47720) 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62477fe700 1 -- 172.21.15.6:0/524003902 learned_addr learned my addr 172.21.15.6:0/524003902 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62467fc700 1 --2- 172.21.15.6:0/524003902 >> v2:172.21.15.118:3300/0 conn(0x7f6248157ca0 0x7f624815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f6246ffd700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f62480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f6245ffb700 1 -- 172.21.15.6:0/524003902 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853265182 0 0) 0x7f62480d07c0 con 0x7f624806d120 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f6245ffb700 1 -- 172.21.15.6:0/524003902 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6234003570 con 0x7f624806d120 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62467fc700 1 -- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 msgr2=0x7f62480cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62467fc700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f62480cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62467fc700 1 -- 172.21.15.6:0/524003902 >> v1:172.21.15.6:6789/0 conn(0x7f624806d120 legacy=0x7f624815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f62467fc700 1 -- 172.21.15.6:0/524003902 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480d0170 con 0x7f6248157ca0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.086+0000 7f6246ffd700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f62480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f62467fc700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624815af00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f62300098e0 tx=0x7f62300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35fa6bd03f8f9670 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f6245ffb700 1 -- 172.21.15.6:0/524003902 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011630 con 0x7f6248157ca0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f6245ffb700 1 -- 172.21.15.6:0/524003902 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230011790 con 0x7f6248157ca0 2023-10-09T11:37:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f6245ffb700 1 -- 172.21.15.6:0/524003902 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011b30 con 0x7f6248157ca0 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 -- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 msgr2=0x7f624815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624815af00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f62300098e0 tx=0x7f62300091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 -- 172.21.15.6:0/524003902 shutdown_connections 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f62480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 --2- 172.21.15.6:0/524003902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624815af00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 -- 172.21.15.6:0/524003902 >> 172.21.15.6:0/524003902 conn(0x7f624806bb90 msgr2=0x7f624806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 -- 172.21.15.6:0/524003902 shutdown_connections 2023-10-09T11:37:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.087+0000 7f624d345700 1 -- 172.21.15.6:0/524003902 wait complete. 2023-10-09T11:37:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 Processor -- start 2023-10-09T11:37:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 -- start start 2023-10-09T11:37:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f624816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624816aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b4910 con 0x7f624806d120 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b3d40 con 0x7f6248157ca0 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f624d345700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b3fe0 con 0x7f62481578d0 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f6246ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f6246ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40906/0 (socket says 172.21.15.6:40906) 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.089+0000 7f6246ffd700 1 -- 172.21.15.6:0/3486847953 learned_addr learned my addr 172.21.15.6:0/3486847953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 -- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 msgr2=0x7f624816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f624816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 -- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 msgr2=0x7f624816aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624816aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 -- 172.21.15.6:0/3486847953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238009420 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f6246ffd700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f623800ec80 tx=0x7f62380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800c9d0 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800cb30 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6230009420 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800ceb0 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.090+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62480b45a0 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.091+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6248067ac0 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.091+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6238013680 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.092+0000 7f623effd700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 0x7f62280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.092+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6238084990 con 0x7f624806d120 2023-10-09T11:37:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.092+0000 7f62467fc700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 0x7f62280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.092+0000 7f62467fc700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 0x7f62280693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f624806a960 tx=0x7f6230017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.096+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6238051c00 con 0x7f624806d120 2023-10-09T11:37:23.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:23.338+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62480d0450 con 0x7f624806d120 2023-10-09T11:37:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.272+0000 7f623effd700 1 -- 172.21.15.6:0/3486847953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6238055220 con 0x7f624806d120 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 msgr2=0x7f62280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 0x7f62280693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f624806a960 tx=0x7f6230017000 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 msgr2=0x7f62481547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f623800ec80 tx=0x7f62380091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 shutdown_connections 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6228066f30 0x7f62280693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6248157ca0 0x7f624816aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624806d120 0x7f62481547b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 --2- 172.21.15.6:0/3486847953 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62481578d0 0x7f624816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 >> 172.21.15.6:0/3486847953 conn(0x7f624806bb90 msgr2=0x7f62481566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 shutdown_connections 2023-10-09T11:37:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.275+0000 7f624d345700 1 -- 172.21.15.6:0/3486847953 wait complete. 2023-10-09T11:37:24.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:37:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.414+0000 7fbd45264700 1 Processor -- start 2023-10-09T11:37:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.414+0000 7fbd45264700 1 -- start start 2023-10-09T11:37:24.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd45264700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd4015a2a0 0x7fbd400b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd45264700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400b0ca0 con 0x7fbd4006dd60 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd45264700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400b00d0 con 0x7fbd400ceb30 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd45264700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4006e160 con 0x7fbd4015a2a0 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd4015a2a0 0x7fbd400b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbd4006dd60 0x7fbd400b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51426/0 (socket says 172.21.15.6:51426) 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3f7fe700 1 -- 172.21.15.6:0/2804624202 learned_addr learned my addr 172.21.15.6:0/2804624202 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3effd700 1 -- 172.21.15.6:0/2804624202 >> v1:172.21.15.118:6789/0 conn(0x7fbd400ceb30 legacy=0x7fbd4006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3effd700 1 -- 172.21.15.6:0/2804624202 >> v1:172.21.15.6:6789/0 conn(0x7fbd4006dd60 legacy=0x7fbd400b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3effd700 1 -- 172.21.15.6:0/2804624202 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400b0370 con 0x7fbd4015a2a0 2023-10-09T11:37:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3dffb700 1 -- 172.21.15.6:0/2804624202 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262282637 0 0) 0x7fbd400b0ca0 con 0x7fbd4006dd60 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3effd700 1 --2- 172.21.15.6:0/2804624202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4015a2a0 0x7fbd400b1130 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd300098e0 tx=0x7fbd300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdd61603ed452cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.415+0000 7fbd3dffb700 1 -- 172.21.15.6:0/2804624202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30009e80 con 0x7fbd4015a2a0 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd3dffb700 1 -- 172.21.15.6:0/2804624202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3000b860 con 0x7fbd4015a2a0 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd3dffb700 1 -- 172.21.15.6:0/2804624202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000bbe0 con 0x7fbd4015a2a0 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 -- 172.21.15.6:0/2804624202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4015a2a0 msgr2=0x7fbd400b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 --2- 172.21.15.6:0/2804624202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4015a2a0 0x7fbd400b1130 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd300098e0 tx=0x7fbd300091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 -- 172.21.15.6:0/2804624202 shutdown_connections 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 --2- 172.21.15.6:0/2804624202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4015a2a0 0x7fbd400b1130 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 -- 172.21.15.6:0/2804624202 >> 172.21.15.6:0/2804624202 conn(0x7fbd40067640 msgr2=0x7fbd40067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 -- 172.21.15.6:0/2804624202 shutdown_connections 2023-10-09T11:37:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.416+0000 7fbd45264700 1 -- 172.21.15.6:0/2804624202 wait complete. 2023-10-09T11:37:24.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.417+0000 7fbd45264700 1 Processor -- start 2023-10-09T11:37:24.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.417+0000 7fbd45264700 1 -- start start 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 0x7fbd400c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 0x7fbd400c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c9df0 con 0x7fbd4006dd60 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd40146e20 con 0x7fbd400ceb30 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd45264700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4015ba50 con 0x7fbd4015a2a0 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37638/0 (socket says 172.21.15.6:37638) 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3effd700 1 -- 172.21.15.6:0/2694160019 learned_addr learned my addr 172.21.15.6:0/2694160019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3effd700 1 -- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 msgr2=0x7fbd400c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3f7fe700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 0x7fbd400c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.418+0000 7fbd3e7fc700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 0x7fbd400c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3effd700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 0x7fbd400c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3effd700 1 -- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 msgr2=0x7fbd400c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3effd700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 0x7fbd400c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3effd700 1 -- 172.21.15.6:0/2694160019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009420 con 0x7fbd4006dd60 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3e7fc700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 0x7fbd400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3f7fe700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 0x7fbd400c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd3effd700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbd4006f990 tx=0x7fbd30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30011420 con 0x7fbd4006dd60 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30011580 con 0x7fbd4006dd60 2023-10-09T11:37:24.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4015bd30 con 0x7fbd4006dd60 2023-10-09T11:37:24.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30011920 con 0x7fbd4006dd60 2023-10-09T11:37:24.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.419+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4015c2f0 con 0x7fbd4006dd60 2023-10-09T11:37:24.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.420+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd400b0c70 con 0x7fbd4006dd60 2023-10-09T11:37:24.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.421+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd30011c90 con 0x7fbd4006dd60 2023-10-09T11:37:24.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.421+0000 7fbd26ffd700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:24.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.422+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd300865a0 con 0x7fbd4006dd60 2023-10-09T11:37:24.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.422+0000 7fbd3e7fc700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:24.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.422+0000 7fbd3e7fc700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 0x7fbd2c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c9be0 tx=0x7fbd34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:24.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.425+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd30053870 con 0x7fbd4006dd60 2023-10-09T11:37:24.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:24.662+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd400c9f30 con 0x7fbd4006dd60 2023-10-09T11:37:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.274+0000 7fbd26ffd700 1 -- 172.21.15.6:0/2694160019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd30056e90 con 0x7fbd4006dd60 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 msgr2=0x7fbd2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 0x7fbd2c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c9be0 tx=0x7fbd34009040 comp rx=0 tx=0).stop 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 msgr2=0x7fbd401468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbd4006f990 tx=0x7fbd30017000 comp rx=0 tx=0).stop 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 shutdown_connections 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd2c066f30 0x7fbd2c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd4015a2a0 0x7fbd400c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd4006dd60 0x7fbd401468e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 --2- 172.21.15.6:0/2694160019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400ceb30 0x7fbd400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 >> 172.21.15.6:0/2694160019 conn(0x7fbd40067640 msgr2=0x7fbd400cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 shutdown_connections 2023-10-09T11:37:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.276+0000 7fbd45264700 1 -- 172.21.15.6:0/2694160019 wait complete. 2023-10-09T11:37:25.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.414+0000 7f02119ca700 1 Processor -- start 2023-10-09T11:37:25.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.414+0000 7f02119ca700 1 -- start start 2023-10-09T11:37:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f02119ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 0x7f020c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f02119ca700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c06e280 con 0x7f020c159a90 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f02119ca700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c068d60 con 0x7f020c06d990 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f02119ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c069900 con 0x7f020c159e60 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f020affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f020c159a90 0x7f020c06a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51436/0 (socket says 172.21.15.6:51436) 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f020affd700 1 -- 172.21.15.6:0/3961442232 learned_addr learned my addr 172.21.15.6:0/3961442232 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f020b7fe700 1 --2- 172.21.15.6:0/3961442232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 0x7f020c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183327137 0 0) 0x7f020c06e280 con 0x7f020c159a90 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f8003570 con 0x7f020c159a90 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100995326 0 0) 0x7f020c068d60 con 0x7f020c06d990 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.415+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c06e280 con 0x7f020c06d990 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f020b7fe700 1 -- 172.21.15.6:0/3961442232 >> v1:172.21.15.118:6789/0 conn(0x7f020c06d990 legacy=0x7f020c0691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f020b7fe700 1 -- 172.21.15.6:0/3961442232 >> v1:172.21.15.6:6789/0 conn(0x7f020c159a90 legacy=0x7f020c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3328445431 0 0) 0x7f01f8003570 con 0x7f020c159a90 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f020b7fe700 1 -- 172.21.15.6:0/3961442232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c06dfa0 con 0x7f020c159e60 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f020b7fe700 1 --2- 172.21.15.6:0/3961442232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 0x7f020c0b2b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009910 tx=0x7f01fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29101f8a9ecdaaf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040017f0 con 0x7f020c159e60 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc011420 con 0x7f020c159e60 2023-10-09T11:37:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f0209ffb700 1 -- 172.21.15.6:0/3961442232 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0117c0 con 0x7f020c159e60 2023-10-09T11:37:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 -- 172.21.15.6:0/3961442232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 msgr2=0x7f020c0b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 --2- 172.21.15.6:0/3961442232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 0x7f020c0b2b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009910 tx=0x7f01fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 -- 172.21.15.6:0/3961442232 shutdown_connections 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 --2- 172.21.15.6:0/3961442232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c159e60 0x7f020c0b2b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 -- 172.21.15.6:0/3961442232 >> 172.21.15.6:0/3961442232 conn(0x7f020c06bb90 msgr2=0x7f020c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 -- 172.21.15.6:0/3961442232 shutdown_connections 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.416+0000 7f02119ca700 1 -- 172.21.15.6:0/3961442232 wait complete. 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 Processor -- start 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 -- start start 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 0x7f020c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f020c159a90 0x7f020c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c6450 con 0x7f020c159e60 2023-10-09T11:37:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c16b3c0 con 0x7f020c159a90 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.418+0000 7f02119ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c5b20 con 0x7f020c06d990 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37642/0 (socket says 172.21.15.6:37642) 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 -- 172.21.15.6:0/231295 learned_addr learned my addr 172.21.15.6:0/231295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020a7fc700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f020c159a90 0x7f020c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020affd700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 0x7f020c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 -- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 msgr2=0x7f020c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 0x7f020c1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 -- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f020c159a90 msgr2=0x7f020c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f020c159a90 0x7f020c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 -- 172.21.15.6:0/231295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009420 con 0x7f020c159e60 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020affd700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 0x7f020c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f020b7fe700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a010 tx=0x7f01fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc01cbe0 con 0x7f020c159e60 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc01cd40 con 0x7f020c159e60 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c0c5e00 con 0x7f020c159e60 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc01a6a0 con 0x7f020c159e60 2023-10-09T11:37:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.419+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c16b6d0 con 0x7f020c159e60 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.420+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c067640 con 0x7f020c159e60 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.421+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01fc01aa90 con 0x7f020c159e60 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.421+0000 7f0202ffd700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.421+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01fc085e20 con 0x7f020c159e60 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.421+0000 7f020affd700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.421+0000 7f020affd700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 0x7f01ec0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0204001560 tx=0x7f0204000f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.425+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01fc053090 con 0x7f020c159e60 2023-10-09T11:37:25.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.661+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f020c068710 con 0x7f020c159e60 2023-10-09T11:37:25.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.662+0000 7f0202ffd700 1 -- 172.21.15.6:0/231295 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f01fc029090 con 0x7f020c159e60 2023-10-09T11:37:25.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:25.663 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 msgr2=0x7f01ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 0x7f01ec0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0204001560 tx=0x7f0204000f40 comp rx=0 tx=0).stop 2023-10-09T11:37:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 msgr2=0x7f020c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a010 tx=0x7f01fc016000 comp rx=0 tx=0).stop 2023-10-09T11:37:25.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 shutdown_connections 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f020c159e60 0x7f020c15d200 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f020c06d990 0x7f020c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 --2- 172.21.15.6:0/231295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f020c159a90 0x7f020c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 >> 172.21.15.6:0/231295 conn(0x7f020c06bb90 msgr2=0x7f020c0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 shutdown_connections 2023-10-09T11:37:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.664+0000 7f02119ca700 1 -- 172.21.15.6:0/231295 wait complete. 2023-10-09T11:37:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:25.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:25.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.795+0000 7f515d962700 1 Processor -- start 2023-10-09T11:37:25.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.795+0000 7f515d962700 1 -- start start 2023-10-09T11:37:25.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f515d962700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5158157ca0 0x7f51580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f515d962700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f515806d120 0x7f515806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f515d962700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580d07c0 con 0x7f51581578d0 2023-10-09T11:37:25.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f515d962700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515806da50 con 0x7f515806d120 2023-10-09T11:37:25.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f515d962700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580cfbb0 con 0x7f5158157ca0 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f5156ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51581578d0 0x7f515815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51440/0 (socket says 172.21.15.6:51440) 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f51577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f515806d120 0x7f515806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f5156ffd700 1 -- 172.21.15.6:0/4276162889 learned_addr learned my addr 172.21.15.6:0/4276162889 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f51567fc700 1 --2- 172.21.15.6:0/4276162889 >> v2:172.21.15.118:3300/0 conn(0x7f5158157ca0 0x7f51580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f51577fe700 1 -- 172.21.15.6:0/4276162889 >> v2:172.21.15.118:3300/0 conn(0x7f5158157ca0 msgr2=0x7f51580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.796+0000 7f51577fe700 1 --2- 172.21.15.6:0/4276162889 >> v2:172.21.15.118:3300/0 conn(0x7f5158157ca0 0x7f51580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f51577fe700 1 -- 172.21.15.6:0/4276162889 >> v1:172.21.15.6:6789/0 conn(0x7f51581578d0 legacy=0x7f515815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f51577fe700 1 -- 172.21.15.6:0/4276162889 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580cfe90 con 0x7f515806d120 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f5155ffb700 1 -- 172.21.15.6:0/4276162889 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740708574 0 0) 0x7f51580d07c0 con 0x7f51581578d0 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f51577fe700 1 --2- 172.21.15.6:0/4276162889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f515806d510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5158068510 tx=0x7f5148009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a21d4581d95928 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f5155ffb700 1 -- 172.21.15.6:0/4276162889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800e070 con 0x7f515806d120 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f5155ffb700 1 -- 172.21.15.6:0/4276162889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800bb60 con 0x7f515806d120 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f5155ffb700 1 -- 172.21.15.6:0/4276162889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148012430 con 0x7f515806d120 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 -- 172.21.15.6:0/4276162889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 msgr2=0x7f515806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 --2- 172.21.15.6:0/4276162889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f515806d510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5158068510 tx=0x7f5148009780 comp rx=0 tx=0).stop 2023-10-09T11:37:25.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 -- 172.21.15.6:0/4276162889 shutdown_connections 2023-10-09T11:37:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 --2- 172.21.15.6:0/4276162889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f515806d510 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 --2- 172.21.15.6:0/4276162889 >> v2:172.21.15.118:3300/0 conn(0x7f5158157ca0 0x7f51580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 -- 172.21.15.6:0/4276162889 >> 172.21.15.6:0/4276162889 conn(0x7f515806bb90 msgr2=0x7f515806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.797+0000 7f515d962700 1 -- 172.21.15.6:0/4276162889 shutdown_connections 2023-10-09T11:37:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.798+0000 7f515d962700 1 -- 172.21.15.6:0/4276162889 wait complete. 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 Processor -- start 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 -- start start 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51581578d0 0x7f51580ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5158157ca0 0x7f51580ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580b5640 con 0x7f515806d120 2023-10-09T11:37:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580ae180 con 0x7f51581578d0 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.799+0000 7f515d962700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580b4d10 con 0x7f5158157ca0 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37656/0 (socket says 172.21.15.6:37656) 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 -- 172.21.15.6:0/359079186 learned_addr learned my addr 172.21.15.6:0/359079186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 -- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5158157ca0 msgr2=0x7f51580ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5158157ca0 0x7f51580ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 -- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51581578d0 msgr2=0x7f51580ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51581578d0 0x7f51580ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 -- 172.21.15.6:0/359079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009a20 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f5156ffd700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f515000c7e0 tx=0x7f5150007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150005b30 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150005c90 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150007300 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51580b4ff0 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.800+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51580adea0 con 0x7f515806d120 2023-10-09T11:37:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.801+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5158067ac0 con 0x7f515806d120 2023-10-09T11:37:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.801+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f515001b400 con 0x7f515806d120 2023-10-09T11:37:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.802+0000 7f514effd700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.802+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5150084080 con 0x7f515806d120 2023-10-09T11:37:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.802+0000 7f51567fc700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.802+0000 7f51567fc700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51580aaba0 tx=0x7f51400091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:25.806+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5150051370 con 0x7f515806d120 2023-10-09T11:37:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.000+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51580d0170 con 0x7f515806d120 2023-10-09T11:37:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.001+0000 7f514effd700 1 -- 172.21.15.6:0/359079186 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5150054990 con 0x7f515806d120 2023-10-09T11:37:26.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:26.002 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:23.242212+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 msgr2=0x7f51380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 0x7f51380693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51580aaba0 tx=0x7f51400091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 msgr2=0x7f51580af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f515000c7e0 tx=0x7f5150007df0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 shutdown_connections 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5138066f30 0x7f51380693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5158157ca0 0x7f51580ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515806d120 0x7f51580af5e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 --2- 172.21.15.6:0/359079186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51581578d0 0x7f51580ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 >> 172.21.15.6:0/359079186 conn(0x7f515806bb90 msgr2=0x7f5158069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 shutdown_connections 2023-10-09T11:37:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.003+0000 7f515d962700 1 -- 172.21.15.6:0/359079186 wait complete. 2023-10-09T11:37:26.016 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:37:26.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:26.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.135+0000 7febb2b4a700 1 Processor -- start 2023-10-09T11:37:26.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.135+0000 7febb2b4a700 1 -- start start 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb2b4a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7febac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb2b4a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0d07c0 con 0x7febac1578d0 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb2b4a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0cfbb0 con 0x7febac157ca0 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb2b4a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0cfe90 con 0x7febac06d830 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb08e6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7febac1578d0 0x7febac15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51442/0 (socket says 172.21.15.6:51442) 2023-10-09T11:37:26.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb08e6700 1 -- 172.21.15.6:0/2788204290 learned_addr learned my addr 172.21.15.6:0/2788204290 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febb10e7700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7febac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204092148 0 0) 0x7febac0d07c0 con 0x7febac1578d0 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb98003570 con 0x7febac1578d0 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3702416297 0 0) 0x7feb98003570 con 0x7febac1578d0 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 msgr2=0x7febac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7febac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 >> v1:172.21.15.118:6789/0 conn(0x7febac157ca0 legacy=0x7febac06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0d0170 con 0x7febac1578d0 2023-10-09T11:37:26.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7feba40017f0 con 0x7febac1578d0 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 >> v1:172.21.15.6:6789/0 conn(0x7febac1578d0 legacy=0x7febac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7feb98003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb98003fd0 0x7feb98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98004d50 0x7feb980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0cfe90 con 0x7feb98003fd0 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9800bb40 con 0x7feb98004d50 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9800bd00 con 0x7febac06d830 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.136+0000 7febabfff700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb98003fd0 0x7feb98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febb08e6700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7feb98003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febb10e7700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98004d50 0x7feb980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 -- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 msgr2=0x7feb98003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac06d830 0x7feb98003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 -- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98004d50 msgr2=0x7feb980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98004d50 0x7feb980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 -- 172.21.15.6:0/2788204290 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98003570 con 0x7feb98003fd0 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febabfff700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb98003fd0 0x7feb98004810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb94001930 tx=0x7feb94007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d8f6a258ed7bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400c5d0 con 0x7feb98003fd0 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400c750 con 0x7feb98003fd0 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.137+0000 7febab7fe700 1 -- 172.21.15.6:0/2788204290 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400cb10 con 0x7feb98003fd0 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 -- 172.21.15.6:0/2788204290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb98003fd0 msgr2=0x7feb98004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2788204290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb98003fd0 0x7feb98004810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb94001930 tx=0x7feb94007d10 comp rx=0 tx=0).stop 2023-10-09T11:37:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb10e7700 1 -- 172.21.15.6:0/2788204290 reap_dead start 2023-10-09T11:37:26.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 -- 172.21.15.6:0/2788204290 shutdown_connections 2023-10-09T11:37:26.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 -- 172.21.15.6:0/2788204290 >> 172.21.15.6:0/2788204290 conn(0x7febac06bb90 msgr2=0x7febac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 -- 172.21.15.6:0/2788204290 shutdown_connections 2023-10-09T11:37:26.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.138+0000 7febb2b4a700 1 -- 172.21.15.6:0/2788204290 wait complete. 2023-10-09T11:37:26.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.139+0000 7febb2b4a700 1 Processor -- start 2023-10-09T11:37:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.139+0000 7febb2b4a700 1 -- start start 2023-10-09T11:37:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98003fd0 0x7febac0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac0c5b20 0x7febac15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0cbeb0 con 0x7febac0c5f90 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c6530 con 0x7feb98003fd0 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c6810 con 0x7febac0c5b20 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37674/0 (socket says 172.21.15.6:37674) 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 -- 172.21.15.6:0/2818678281 learned_addr learned my addr 172.21.15.6:0/2818678281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb08e6700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98003fd0 0x7febac0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febabfff700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac0c5b20 0x7febac15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 -- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac0c5b20 msgr2=0x7febac15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac0c5b20 0x7febac15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 -- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98003fd0 msgr2=0x7febac0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98003fd0 0x7febac0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 -- 172.21.15.6:0/2818678281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0c6af0 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb10e7700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7febac06dc30 tx=0x7feb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c013750 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0138d0 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0cbb40 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c013c90 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.140+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0ca370 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.141+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0cb9a0 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.142+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb9c014650 con 0x7febac0c5f90 2023-10-09T11:37:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.142+0000 7feba8ff9700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.142+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb9c084ac0 con 0x7febac0c5f90 2023-10-09T11:37:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.142+0000 7febb08e6700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.143+0000 7febb08e6700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 0x7feb8c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feba4002250 tx=0x7feba4006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.146+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febac0cb9a0 con 0x7febac0c5f90 2023-10-09T11:37:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.333+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febac0cb9a0 con 0x7feb8c066f30 2023-10-09T11:37:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.342+0000 7feba8ff9700 1 -- 172.21.15.6:0/2818678281 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284391 (secure 0 0 0) 0x7febac0cb9a0 con 0x7feb8c066f30 2023-10-09T11:37:26.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 msgr2=0x7feb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 0x7feb8c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feba4002250 tx=0x7feba4006040 comp rx=0 tx=0).stop 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 msgr2=0x7febac15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7febac06dc30 tx=0x7feb9c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 shutdown_connections 2023-10-09T11:37:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb8c066f30 0x7feb8c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0c5f90 0x7febac15cbb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb98003fd0 0x7febac0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 --2- 172.21.15.6:0/2818678281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febac0c5b20 0x7febac15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 >> 172.21.15.6:0/2818678281 conn(0x7febac06bb90 msgr2=0x7febac1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 shutdown_connections 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.345+0000 7febb2b4a700 1 -- 172.21.15.6:0/2818678281 wait complete. 2023-10-09T11:37:26.349 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:37:26.357 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-09T11:37:26.161954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559764,"statfs":{"total":1600000000,"available":1597198703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924998"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254970+0000","last_change":"2023-10-09T11:37:22.254970+0000","last_active":"2023-10-09T11:37:22.254970+0000","last_peered":"2023-10-09T11:37:22.254970+0000","last_clean":"2023-10-09T11:37:22.254970+0000","last_became_active":"2023-10-09T11:37:22.254733+0000","last_became_peered":"2023-10-09T11:37:22.254733+0000","last_unstale":"2023-10-09T11:37:22.254970+0000","last_undegraded":"2023-10-09T11:37:22.254970+0000","last_fullsized":"2023-10-09T11:37:22.254970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:19.654041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253015+0000","last_change":"2023-10-09T11:37:22.253015+0000","last_active":"2023-10-09T11:37:22.253015+0000","last_peered":"2023-10-09T11:37:22.253015+0000","last_clean":"2023-10-09T11:37:22.253015+0000","last_became_active":"2023-10-09T11:37:22.252786+0000","last_became_peered":"2023-10-09T11:37:22.252786+0000","last_unstale":"2023-10-09T11:37:22.253015+0000","last_undegraded":"2023-10-09T11:37:22.253015+0000","last_fullsized":"2023-10-09T11:37:22.253015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:38.057619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254464+0000","last_change":"2023-10-09T11:37:22.254464+0000","last_active":"2023-10-09T11:37:22.254464+0000","last_peered":"2023-10-09T11:37:22.254464+0000","last_clean":"2023-10-09T11:37:22.254464+0000","last_became_active":"2023-10-09T11:37:22.254112+0000","last_became_peered":"2023-10-09T11:37:22.254112+0000","last_unstale":"2023-10-09T11:37:22.254464+0000","last_undegraded":"2023-10-09T11:37:22.254464+0000","last_fullsized":"2023-10-09T11:37:22.254464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:31.214727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258295+0000","last_change":"2023-10-09T11:37:22.258295+0000","last_active":"2023-10-09T11:37:22.258295+0000","last_peered":"2023-10-09T11:37:22.258295+0000","last_clean":"2023-10-09T11:37:22.258295+0000","last_became_active":"2023-10-09T11:37:22.257833+0000","last_became_peered":"2023-10-09T11:37:22.257833+0000","last_unstale":"2023-10-09T11:37:22.258295+0000","last_undegraded":"2023-10-09T11:37:22.258295+0000","last_fullsized":"2023-10-09T11:37:22.258295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:28.739147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.249755+0000","last_change":"2023-10-09T11:37:22.249755+0000","last_active":"2023-10-09T11:37:22.249755+0000","last_peered":"2023-10-09T11:37:22.249755+0000","last_clean":"2023-10-09T11:37:22.249755+0000","last_became_active":"2023-10-09T11:37:22.249498+0000","last_became_peered":"2023-10-09T11:37:22.249498+0000","last_unstale":"2023-10-09T11:37:22.249755+0000","last_undegraded":"2023-10-09T11:37:22.249755+0000","last_fullsized":"2023-10-09T11:37:22.249755+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.257449+0000","last_change":"2023-10-09T11:37:22.257449+0000","last_active":"2023-10-09T11:37:22.257449+0000","last_peered":"2023-10-09T11:37:22.257449+0000","last_clean":"2023-10-09T11:37:22.257449+0000","last_became_active":"2023-10-09T11:37:22.257243+0000","last_became_peered":"2023-10-09T11:37:22.257243+0000","last_unstale":"2023-10-09T11:37:22.257449+0000","last_undegraded":"2023-10-09T11:37:22.257449+0000","last_fullsized":"2023-10-09T11:37:22.257449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:46.719713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256149+0000","last_change":"2023-10-09T11:37:22.256149+0000","last_active":"2023-10-09T11:37:22.256149+0000","last_peered":"2023-10-09T11:37:22.256149+0000","last_clean":"2023-10-09T11:37:22.256149+0000","last_became_active":"2023-10-09T11:37:22.255717+0000","last_became_peered":"2023-10-09T11:37:22.255717+0000","last_unstale":"2023-10-09T11:37:22.256149+0000","last_undegraded":"2023-10-09T11:37:22.256149+0000","last_fullsized":"2023-10-09T11:37:22.256149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:27.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255837+0000","last_change":"2023-10-09T11:37:22.255837+0000","last_active":"2023-10-09T11:37:22.255837+0000","last_peered":"2023-10-09T11:37:22.255837+0000","last_clean":"2023-10-09T11:37:22.255837+0000","last_became_active":"2023-10-09T11:37:22.255591+0000","last_became_peered":"2023-10-09T11:37:22.255591+0000","last_unstale":"2023-10-09T11:37:22.255837+0000","last_undegraded":"2023-10-09T11:37:22.255837+0000","last_fullsized":"2023-10-09T11:37:22.255837+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254753+0000","last_change":"2023-10-09T11:37:22.254753+0000","last_active":"2023-10-09T11:37:22.254753+0000","last_peered":"2023-10-09T11:37:22.254753+0000","last_clean":"2023-10-09T11:37:22.254753+0000","last_became_active":"2023-10-09T11:37:22.254241+0000","last_became_peered":"2023-10-09T11:37:22.254241+0000","last_unstale":"2023-10-09T11:37:22.254753+0000","last_undegraded":"2023-10-09T11:37:22.254753+0000","last_fullsized":"2023-10-09T11:37:22.254753+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:20.262710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258189+0000","last_change":"2023-10-09T11:37:22.258189+0000","last_active":"2023-10-09T11:37:22.258189+0000","last_peered":"2023-10-09T11:37:22.258189+0000","last_clean":"2023-10-09T11:37:22.258189+0000","last_became_active":"2023-10-09T11:37:22.251773+0000","last_became_peered":"2023-10-09T11:37:22.251773+0000","last_unstale":"2023-10-09T11:37:22.258189+0000","last_undegraded":"2023-10-09T11:37:22.258189+0000","last_fullsized":"2023-10-09T11:37:22.258189+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:08.512662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253934+0000","last_change":"2023-10-09T11:37:22.253934+0000","last_active":"2023-10-09T11:37:22.253934+0000","last_peered":"2023-10-09T11:37:22.253934+0000","last_clean":"2023-10-09T11:37:22.253934+0000","last_became_active":"2023-10-09T11:37:22.253660+0000","last_became_peered":"2023-10-09T11:37:22.253660+0000","last_unstale":"2023-10-09T11:37:22.253934+0000","last_undegraded":"2023-10-09T11:37:22.253934+0000","last_fullsized":"2023-10-09T11:37:22.253934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:23.038084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.245849+0000","last_change":"2023-10-09T11:37:22.245849+0000","last_active":"2023-10-09T11:37:22.245849+0000","last_peered":"2023-10-09T11:37:22.245849+0000","last_clean":"2023-10-09T11:37:22.245849+0000","last_became_active":"2023-10-09T11:37:22.245624+0000","last_became_peered":"2023-10-09T11:37:22.245624+0000","last_unstale":"2023-10-09T11:37:22.245849+0000","last_undegraded":"2023-10-09T11:37:22.245849+0000","last_fullsized":"2023-10-09T11:37:22.245849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:28.739147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253212+0000","last_change":"2023-10-09T11:37:22.253212+0000","last_active":"2023-10-09T11:37:22.253212+0000","last_peered":"2023-10-09T11:37:22.253212+0000","last_clean":"2023-10-09T11:37:22.253212+0000","last_became_active":"2023-10-09T11:37:22.252702+0000","last_became_peered":"2023-10-09T11:37:22.252702+0000","last_unstale":"2023-10-09T11:37:22.253212+0000","last_undegraded":"2023-10-09T11:37:22.253212+0000","last_fullsized":"2023-10-09T11:37:22.253212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:39.606317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254890+0000","last_change":"2023-10-09T11:37:22.254890+0000","last_active":"2023-10-09T11:37:22.254890+0000","last_peered":"2023-10-09T11:37:22.254890+0000","last_clean":"2023-10-09T11:37:22.254890+0000","last_became_active":"2023-10-09T11:37:22.254533+0000","last_became_peered":"2023-10-09T11:37:22.254533+0000","last_unstale":"2023-10-09T11:37:22.254890+0000","last_undegraded":"2023-10-09T11:37:22.254890+0000","last_fullsized":"2023-10-09T11:37:22.254890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:10.605455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.249366+0000","last_change":"2023-10-09T11:37:22.249366+0000","last_active":"2023-10-09T11:37:22.249366+0000","last_peered":"2023-10-09T11:37:22.249366+0000","last_clean":"2023-10-09T11:37:22.249366+0000","last_became_active":"2023-10-09T11:37:22.249123+0000","last_became_peered":"2023-10-09T11:37:22.249123+0000","last_unstale":"2023-10-09T11:37:22.249366+0000","last_undegraded":"2023-10-09T11:37:22.249366+0000","last_fullsized":"2023-10-09T11:37:22.249366+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.414212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254818+0000","last_change":"2023-10-09T11:37:22.254818+0000","last_active":"2023-10-09T11:37:22.254818+0000","last_peered":"2023-10-09T11:37:22.254818+0000","last_clean":"2023-10-09T11:37:22.254818+0000","last_became_active":"2023-10-09T11:37:22.254297+0000","last_became_peered":"2023-10-09T11:37:22.254297+0000","last_unstale":"2023-10-09T11:37:22.254818+0000","last_undegraded":"2023-10-09T11:37:22.254818+0000","last_fullsized":"2023-10-09T11:37:22.254818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:38.605714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.247295+0000","last_change":"2023-10-09T11:37:22.247295+0000","last_active":"2023-10-09T11:37:22.247295+0000","last_peered":"2023-10-09T11:37:22.247295+0000","last_clean":"2023-10-09T11:37:22.247295+0000","last_became_active":"2023-10-09T11:37:22.247078+0000","last_became_peered":"2023-10-09T11:37:22.247078+0000","last_unstale":"2023-10-09T11:37:22.247295+0000","last_undegraded":"2023-10-09T11:37:22.247295+0000","last_fullsized":"2023-10-09T11:37:22.247295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:57.754277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251353+0000","last_change":"2023-10-09T11:37:22.251353+0000","last_active":"2023-10-09T11:37:22.251353+0000","last_peered":"2023-10-09T11:37:22.251353+0000","last_clean":"2023-10-09T11:37:22.251353+0000","last_became_active":"2023-10-09T11:37:22.250970+0000","last_became_peered":"2023-10-09T11:37:22.250970+0000","last_unstale":"2023-10-09T11:37:22.251353+0000","last_undegraded":"2023-10-09T11:37:22.251353+0000","last_fullsized":"2023-10-09T11:37:22.251353+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:46.693587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253901+0000","last_change":"2023-10-09T11:37:22.253901+0000","last_active":"2023-10-09T11:37:22.253901+0000","last_peered":"2023-10-09T11:37:22.253901+0000","last_clean":"2023-10-09T11:37:22.253901+0000","last_became_active":"2023-10-09T11:37:22.252345+0000","last_became_peered":"2023-10-09T11:37:22.252345+0000","last_unstale":"2023-10-09T11:37:22.253901+0000","last_undegraded":"2023-10-09T11:37:22.253901+0000","last_fullsized":"2023-10-09T11:37:22.253901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251654+0000","last_change":"2023-10-09T11:37:22.251654+0000","last_active":"2023-10-09T11:37:22.251654+0000","last_peered":"2023-10-09T11:37:22.251654+0000","last_clean":"2023-10-09T11:37:22.251654+0000","last_became_active":"2023-10-09T11:37:22.251384+0000","last_became_peered":"2023-10-09T11:37:22.251384+0000","last_unstale":"2023-10-09T11:37:22.251654+0000","last_undegraded":"2023-10-09T11:37:22.251654+0000","last_fullsized":"2023-10-09T11:37:22.251654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:07.992157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255182+0000","last_change":"2023-10-09T11:37:22.255182+0000","last_active":"2023-10-09T11:37:22.255182+0000","last_peered":"2023-10-09T11:37:22.255182+0000","last_clean":"2023-10-09T11:37:22.255182+0000","last_became_active":"2023-10-09T11:37:22.254462+0000","last_became_peered":"2023-10-09T11:37:22.254462+0000","last_unstale":"2023-10-09T11:37:22.255182+0000","last_undegraded":"2023-10-09T11:37:22.255182+0000","last_fullsized":"2023-10-09T11:37:22.255182+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:37.578726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256998+0000","last_change":"2023-10-09T11:37:22.256998+0000","last_active":"2023-10-09T11:37:22.256998+0000","last_peered":"2023-10-09T11:37:22.256998+0000","last_clean":"2023-10-09T11:37:22.256998+0000","last_became_active":"2023-10-09T11:37:22.256277+0000","last_became_peered":"2023-10-09T11:37:22.256277+0000","last_unstale":"2023-10-09T11:37:22.256998+0000","last_undegraded":"2023-10-09T11:37:22.256998+0000","last_fullsized":"2023-10-09T11:37:22.256998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:15.645024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252976+0000","last_change":"2023-10-09T11:37:22.252976+0000","last_active":"2023-10-09T11:37:22.252976+0000","last_peered":"2023-10-09T11:37:22.252976+0000","last_clean":"2023-10-09T11:37:22.252976+0000","last_became_active":"2023-10-09T11:37:22.252678+0000","last_became_peered":"2023-10-09T11:37:22.252678+0000","last_unstale":"2023-10-09T11:37:22.252976+0000","last_undegraded":"2023-10-09T11:37:22.252976+0000","last_fullsized":"2023-10-09T11:37:22.252976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252135+0000","last_change":"2023-10-09T11:37:22.252135+0000","last_active":"2023-10-09T11:37:22.252135+0000","last_peered":"2023-10-09T11:37:22.252135+0000","last_clean":"2023-10-09T11:37:22.252135+0000","last_became_active":"2023-10-09T11:37:22.251717+0000","last_became_peered":"2023-10-09T11:37:22.251717+0000","last_unstale":"2023-10-09T11:37:22.252135+0000","last_undegraded":"2023-10-09T11:37:22.252135+0000","last_fullsized":"2023-10-09T11:37:22.252135+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:23.764548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255762+0000","last_change":"2023-10-09T11:37:22.255762+0000","last_active":"2023-10-09T11:37:22.255762+0000","last_peered":"2023-10-09T11:37:22.255762+0000","last_clean":"2023-10-09T11:37:22.255762+0000","last_became_active":"2023-10-09T11:37:22.255533+0000","last_became_peered":"2023-10-09T11:37:22.255533+0000","last_unstale":"2023-10-09T11:37:22.255762+0000","last_undegraded":"2023-10-09T11:37:22.255762+0000","last_fullsized":"2023-10-09T11:37:22.255762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:24.624950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252610+0000","last_change":"2023-10-09T11:37:22.252610+0000","last_active":"2023-10-09T11:37:22.252610+0000","last_peered":"2023-10-09T11:37:22.252610+0000","last_clean":"2023-10-09T11:37:22.252610+0000","last_became_active":"2023-10-09T11:37:22.252382+0000","last_became_peered":"2023-10-09T11:37:22.252382+0000","last_unstale":"2023-10-09T11:37:22.252610+0000","last_undegraded":"2023-10-09T11:37:22.252610+0000","last_fullsized":"2023-10-09T11:37:22.252610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:15.931822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248700+0000","last_change":"2023-10-09T11:37:22.248700+0000","last_active":"2023-10-09T11:37:22.248700+0000","last_peered":"2023-10-09T11:37:22.248700+0000","last_clean":"2023-10-09T11:37:22.248700+0000","last_became_active":"2023-10-09T11:37:22.248461+0000","last_became_peered":"2023-10-09T11:37:22.248461+0000","last_unstale":"2023-10-09T11:37:22.248700+0000","last_undegraded":"2023-10-09T11:37:22.248700+0000","last_fullsized":"2023-10-09T11:37:22.248700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:45.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250676+0000","last_change":"2023-10-09T11:37:22.250676+0000","last_active":"2023-10-09T11:37:22.250676+0000","last_peered":"2023-10-09T11:37:22.250676+0000","last_clean":"2023-10-09T11:37:22.250676+0000","last_became_active":"2023-10-09T11:37:22.250238+0000","last_became_peered":"2023-10-09T11:37:22.250238+0000","last_unstale":"2023-10-09T11:37:22.250676+0000","last_undegraded":"2023-10-09T11:37:22.250676+0000","last_fullsized":"2023-10-09T11:37:22.250676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:56.410121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254383+0000","last_change":"2023-10-09T11:37:22.254383+0000","last_active":"2023-10-09T11:37:22.254383+0000","last_peered":"2023-10-09T11:37:22.254383+0000","last_clean":"2023-10-09T11:37:22.254383+0000","last_became_active":"2023-10-09T11:37:22.254146+0000","last_became_peered":"2023-10-09T11:37:22.254146+0000","last_unstale":"2023-10-09T11:37:22.254383+0000","last_undegraded":"2023-10-09T11:37:22.254383+0000","last_fullsized":"2023-10-09T11:37:22.254383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:44.480334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253508+0000","last_change":"2023-10-09T11:37:22.253508+0000","last_active":"2023-10-09T11:37:22.253508+0000","last_peered":"2023-10-09T11:37:22.253508+0000","last_clean":"2023-10-09T11:37:22.253508+0000","last_became_active":"2023-10-09T11:37:22.253283+0000","last_became_peered":"2023-10-09T11:37:22.253283+0000","last_unstale":"2023-10-09T11:37:22.253508+0000","last_undegraded":"2023-10-09T11:37:22.253508+0000","last_fullsized":"2023-10-09T11:37:22.253508+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:23.038084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253118+0000","last_change":"2023-10-09T11:37:22.253118+0000","last_active":"2023-10-09T11:37:22.253118+0000","last_peered":"2023-10-09T11:37:22.253118+0000","last_clean":"2023-10-09T11:37:22.253118+0000","last_became_active":"2023-10-09T11:37:22.252343+0000","last_became_peered":"2023-10-09T11:37:22.252343+0000","last_unstale":"2023-10-09T11:37:22.253118+0000","last_undegraded":"2023-10-09T11:37:22.253118+0000","last_fullsized":"2023-10-09T11:37:22.253118+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:37.065038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250378+0000","last_change":"2023-10-09T11:37:22.250378+0000","last_active":"2023-10-09T11:37:22.250378+0000","last_peered":"2023-10-09T11:37:22.250378+0000","last_clean":"2023-10-09T11:37:22.250378+0000","last_became_active":"2023-10-09T11:37:22.249743+0000","last_became_peered":"2023-10-09T11:37:22.249743+0000","last_unstale":"2023-10-09T11:37:22.250378+0000","last_undegraded":"2023-10-09T11:37:22.250378+0000","last_fullsized":"2023-10-09T11:37:22.250378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:15.677912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253551+0000","last_change":"2023-10-09T11:37:22.253551+0000","last_active":"2023-10-09T11:37:22.253551+0000","last_peered":"2023-10-09T11:37:22.253551+0000","last_clean":"2023-10-09T11:37:22.253551+0000","last_became_active":"2023-10-09T11:37:22.253307+0000","last_became_peered":"2023-10-09T11:37:22.253307+0000","last_unstale":"2023-10-09T11:37:22.253551+0000","last_undegraded":"2023-10-09T11:37:22.253551+0000","last_fullsized":"2023-10-09T11:37:22.253551+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:23.208448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266922+0000","last_change":"2023-10-09T11:37:21.252633+0000","last_active":"2023-10-09T11:37:22.266922+0000","last_peered":"2023-10-09T11:37:22.266922+0000","last_clean":"2023-10-09T11:37:22.266922+0000","last_became_active":"2023-10-09T11:37:21.252322+0000","last_became_peered":"2023-10-09T11:37:21.252322+0000","last_unstale":"2023-10-09T11:37:22.266922+0000","last_undegraded":"2023-10-09T11:37:22.266922+0000","last_fullsized":"2023-10-09T11:37:22.266922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:32.501850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253987+0000","last_change":"2023-10-09T11:37:22.253987+0000","last_active":"2023-10-09T11:37:22.253987+0000","last_peered":"2023-10-09T11:37:22.253987+0000","last_clean":"2023-10-09T11:37:22.253987+0000","last_became_active":"2023-10-09T11:37:22.253714+0000","last_became_peered":"2023-10-09T11:37:22.253714+0000","last_unstale":"2023-10-09T11:37:22.253987+0000","last_undegraded":"2023-10-09T11:37:22.253987+0000","last_fullsized":"2023-10-09T11:37:22.253987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:53.333923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.243951+0000","last_change":"2023-10-09T11:37:21.255454+0000","last_active":"2023-10-09T11:37:22.243951+0000","last_peered":"2023-10-09T11:37:22.243951+0000","last_clean":"2023-10-09T11:37:22.243951+0000","last_became_active":"2023-10-09T11:37:21.255087+0000","last_became_peered":"2023-10-09T11:37:21.255087+0000","last_unstale":"2023-10-09T11:37:22.243951+0000","last_undegraded":"2023-10-09T11:37:22.243951+0000","last_fullsized":"2023-10-09T11:37:22.243951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:00.996414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250282+0000","last_change":"2023-10-09T11:37:22.250282+0000","last_active":"2023-10-09T11:37:22.250282+0000","last_peered":"2023-10-09T11:37:22.250282+0000","last_clean":"2023-10-09T11:37:22.250282+0000","last_became_active":"2023-10-09T11:37:22.250000+0000","last_became_peered":"2023-10-09T11:37:22.250000+0000","last_unstale":"2023-10-09T11:37:22.250282+0000","last_undegraded":"2023-10-09T11:37:22.250282+0000","last_fullsized":"2023-10-09T11:37:22.250282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:08.512662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266154+0000","last_change":"2023-10-09T11:37:21.244995+0000","last_active":"2023-10-09T11:37:22.266154+0000","last_peered":"2023-10-09T11:37:22.266154+0000","last_clean":"2023-10-09T11:37:22.266154+0000","last_became_active":"2023-10-09T11:37:21.244756+0000","last_became_peered":"2023-10-09T11:37:21.244756+0000","last_unstale":"2023-10-09T11:37:22.266154+0000","last_undegraded":"2023-10-09T11:37:22.266154+0000","last_fullsized":"2023-10-09T11:37:22.266154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:34.334647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255565+0000","last_change":"2023-10-09T11:37:22.255565+0000","last_active":"2023-10-09T11:37:22.255565+0000","last_peered":"2023-10-09T11:37:22.255565+0000","last_clean":"2023-10-09T11:37:22.255565+0000","last_became_active":"2023-10-09T11:37:22.255297+0000","last_became_peered":"2023-10-09T11:37:22.255297+0000","last_unstale":"2023-10-09T11:37:22.255565+0000","last_undegraded":"2023-10-09T11:37:22.255565+0000","last_fullsized":"2023-10-09T11:37:22.255565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.265995+0000","last_change":"2023-10-09T11:37:21.250845+0000","last_active":"2023-10-09T11:37:22.265995+0000","last_peered":"2023-10-09T11:37:22.265995+0000","last_clean":"2023-10-09T11:37:22.265995+0000","last_became_active":"2023-10-09T11:37:21.250583+0000","last_became_peered":"2023-10-09T11:37:21.250583+0000","last_unstale":"2023-10-09T11:37:22.265995+0000","last_undegraded":"2023-10-09T11:37:22.265995+0000","last_fullsized":"2023-10-09T11:37:22.265995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:32.501850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251217+0000","last_change":"2023-10-09T11:37:22.251217+0000","last_active":"2023-10-09T11:37:22.251217+0000","last_peered":"2023-10-09T11:37:22.251217+0000","last_clean":"2023-10-09T11:37:22.251217+0000","last_became_active":"2023-10-09T11:37:22.250686+0000","last_became_peered":"2023-10-09T11:37:22.250686+0000","last_unstale":"2023-10-09T11:37:22.251217+0000","last_undegraded":"2023-10-09T11:37:22.251217+0000","last_fullsized":"2023-10-09T11:37:22.251217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:30.285630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248369+0000","last_change":"2023-10-09T11:37:21.257163+0000","last_active":"2023-10-09T11:37:22.248369+0000","last_peered":"2023-10-09T11:37:22.248369+0000","last_clean":"2023-10-09T11:37:22.248369+0000","last_became_active":"2023-10-09T11:37:21.256045+0000","last_became_peered":"2023-10-09T11:37:21.256045+0000","last_unstale":"2023-10-09T11:37:22.248369+0000","last_undegraded":"2023-10-09T11:37:22.248369+0000","last_fullsized":"2023-10-09T11:37:22.248369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:07.507564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.257146+0000","last_change":"2023-10-09T11:37:22.257146+0000","last_active":"2023-10-09T11:37:22.257146+0000","last_peered":"2023-10-09T11:37:22.257146+0000","last_clean":"2023-10-09T11:37:22.257146+0000","last_became_active":"2023-10-09T11:37:22.256775+0000","last_became_peered":"2023-10-09T11:37:22.256775+0000","last_unstale":"2023-10-09T11:37:22.257146+0000","last_undegraded":"2023-10-09T11:37:22.257146+0000","last_fullsized":"2023-10-09T11:37:22.257146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:57.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.244175+0000","last_change":"2023-10-09T11:37:21.251459+0000","last_active":"2023-10-09T11:37:22.244175+0000","last_peered":"2023-10-09T11:37:22.244175+0000","last_clean":"2023-10-09T11:37:22.244175+0000","last_became_active":"2023-10-09T11:37:21.251288+0000","last_became_peered":"2023-10-09T11:37:21.251288+0000","last_unstale":"2023-10-09T11:37:22.244175+0000","last_undegraded":"2023-10-09T11:37:22.244175+0000","last_fullsized":"2023-10-09T11:37:22.244175+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:34.334647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258832+0000","last_change":"2023-10-09T11:37:22.258832+0000","last_active":"2023-10-09T11:37:22.258832+0000","last_peered":"2023-10-09T11:37:22.258832+0000","last_clean":"2023-10-09T11:37:22.258832+0000","last_became_active":"2023-10-09T11:37:22.252045+0000","last_became_peered":"2023-10-09T11:37:22.252045+0000","last_unstale":"2023-10-09T11:37:22.258832+0000","last_undegraded":"2023-10-09T11:37:22.258832+0000","last_fullsized":"2023-10-09T11:37:22.258832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:57.754277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.244680+0000","last_change":"2023-10-09T11:37:21.244595+0000","last_active":"2023-10-09T11:37:21.244680+0000","last_peered":"2023-10-09T11:37:21.244680+0000","last_clean":"2023-10-09T11:37:21.244680+0000","last_became_active":"2023-10-09T11:37:21.244346+0000","last_became_peered":"2023-10-09T11:37:21.244346+0000","last_unstale":"2023-10-09T11:37:21.244680+0000","last_undegraded":"2023-10-09T11:37:21.244680+0000","last_fullsized":"2023-10-09T11:37:21.244680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:45.688490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251971+0000","last_change":"2023-10-09T11:37:22.251971+0000","last_active":"2023-10-09T11:37:22.251971+0000","last_peered":"2023-10-09T11:37:22.251971+0000","last_clean":"2023-10-09T11:37:22.251971+0000","last_became_active":"2023-10-09T11:37:22.251407+0000","last_became_peered":"2023-10-09T11:37:22.251407+0000","last_unstale":"2023-10-09T11:37:22.251971+0000","last_undegraded":"2023-10-09T11:37:22.251971+0000","last_fullsized":"2023-10-09T11:37:22.251971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:23.208448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251479+0000","last_change":"2023-10-09T11:37:21.251206+0000","last_active":"2023-10-09T11:37:21.251479+0000","last_peered":"2023-10-09T11:37:21.251479+0000","last_clean":"2023-10-09T11:37:21.251479+0000","last_became_active":"2023-10-09T11:37:21.250389+0000","last_became_peered":"2023-10-09T11:37:21.250389+0000","last_unstale":"2023-10-09T11:37:21.251479+0000","last_undegraded":"2023-10-09T11:37:21.251479+0000","last_fullsized":"2023-10-09T11:37:21.251479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:00.996414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251170+0000","last_change":"2023-10-09T11:37:22.251170+0000","last_active":"2023-10-09T11:37:22.251170+0000","last_peered":"2023-10-09T11:37:22.251170+0000","last_clean":"2023-10-09T11:37:22.251170+0000","last_became_active":"2023-10-09T11:37:22.250946+0000","last_became_peered":"2023-10-09T11:37:22.250946+0000","last_unstale":"2023-10-09T11:37:22.251170+0000","last_undegraded":"2023-10-09T11:37:22.251170+0000","last_fullsized":"2023-10-09T11:37:22.251170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:57.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251040+0000","last_change":"2023-10-09T11:37:21.249571+0000","last_active":"2023-10-09T11:37:21.251040+0000","last_peered":"2023-10-09T11:37:21.251040+0000","last_clean":"2023-10-09T11:37:21.251040+0000","last_became_active":"2023-10-09T11:37:21.249335+0000","last_became_peered":"2023-10-09T11:37:21.249335+0000","last_unstale":"2023-10-09T11:37:21.251040+0000","last_undegraded":"2023-10-09T11:37:21.251040+0000","last_fullsized":"2023-10-09T11:37:21.251040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:06.690517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254060+0000","last_change":"2023-10-09T11:37:22.254060+0000","last_active":"2023-10-09T11:37:22.254060+0000","last_peered":"2023-10-09T11:37:22.254060+0000","last_clean":"2023-10-09T11:37:22.254060+0000","last_became_active":"2023-10-09T11:37:22.253841+0000","last_became_peered":"2023-10-09T11:37:22.253841+0000","last_unstale":"2023-10-09T11:37:22.254060+0000","last_undegraded":"2023-10-09T11:37:22.254060+0000","last_fullsized":"2023-10-09T11:37:22.254060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:24.516840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251461+0000","last_change":"2023-10-09T11:37:21.250920+0000","last_active":"2023-10-09T11:37:21.251461+0000","last_peered":"2023-10-09T11:37:21.251461+0000","last_clean":"2023-10-09T11:37:21.251461+0000","last_became_active":"2023-10-09T11:37:21.249877+0000","last_became_peered":"2023-10-09T11:37:21.249877+0000","last_unstale":"2023-10-09T11:37:21.251461+0000","last_undegraded":"2023-10-09T11:37:21.251461+0000","last_fullsized":"2023-10-09T11:37:21.251461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:04.016830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258341+0000","last_change":"2023-10-09T11:37:22.258341+0000","last_active":"2023-10-09T11:37:22.258341+0000","last_peered":"2023-10-09T11:37:22.258341+0000","last_clean":"2023-10-09T11:37:22.258341+0000","last_became_active":"2023-10-09T11:37:22.256780+0000","last_became_peered":"2023-10-09T11:37:22.256780+0000","last_unstale":"2023-10-09T11:37:22.258341+0000","last_undegraded":"2023-10-09T11:37:22.258341+0000","last_fullsized":"2023-10-09T11:37:22.258341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:47.043372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267138+0000","last_change":"2023-10-09T11:37:21.253741+0000","last_active":"2023-10-09T11:37:22.267138+0000","last_peered":"2023-10-09T11:37:22.267138+0000","last_clean":"2023-10-09T11:37:22.267138+0000","last_became_active":"2023-10-09T11:37:21.253476+0000","last_became_peered":"2023-10-09T11:37:21.253476+0000","last_unstale":"2023-10-09T11:37:22.267138+0000","last_undegraded":"2023-10-09T11:37:22.267138+0000","last_fullsized":"2023-10-09T11:37:22.267138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:22.032987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255842+0000","last_change":"2023-10-09T11:37:22.255842+0000","last_active":"2023-10-09T11:37:22.255842+0000","last_peered":"2023-10-09T11:37:22.255842+0000","last_clean":"2023-10-09T11:37:22.255842+0000","last_became_active":"2023-10-09T11:37:22.255611+0000","last_became_peered":"2023-10-09T11:37:22.255611+0000","last_unstale":"2023-10-09T11:37:22.255842+0000","last_undegraded":"2023-10-09T11:37:22.255842+0000","last_fullsized":"2023-10-09T11:37:22.255842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.268162+0000","last_change":"2023-10-09T11:37:21.253596+0000","last_active":"2023-10-09T11:37:22.268162+0000","last_peered":"2023-10-09T11:37:22.268162+0000","last_clean":"2023-10-09T11:37:22.268162+0000","last_became_active":"2023-10-09T11:37:21.253350+0000","last_became_peered":"2023-10-09T11:37:21.253350+0000","last_unstale":"2023-10-09T11:37:22.268162+0000","last_undegraded":"2023-10-09T11:37:22.268162+0000","last_fullsized":"2023-10-09T11:37:22.268162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:24.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254530+0000","last_change":"2023-10-09T11:37:22.254530+0000","last_active":"2023-10-09T11:37:22.254530+0000","last_peered":"2023-10-09T11:37:22.254530+0000","last_clean":"2023-10-09T11:37:22.254530+0000","last_became_active":"2023-10-09T11:37:22.253691+0000","last_became_peered":"2023-10-09T11:37:22.253691+0000","last_unstale":"2023-10-09T11:37:22.254530+0000","last_undegraded":"2023-10-09T11:37:22.254530+0000","last_fullsized":"2023-10-09T11:37:22.254530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:28.189181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.268392+0000","last_change":"2023-10-09T11:37:21.249708+0000","last_active":"2023-10-09T11:37:22.268392+0000","last_peered":"2023-10-09T11:37:22.268392+0000","last_clean":"2023-10-09T11:37:22.268392+0000","last_became_active":"2023-10-09T11:37:21.249473+0000","last_became_peered":"2023-10-09T11:37:21.249473+0000","last_unstale":"2023-10-09T11:37:22.268392+0000","last_undegraded":"2023-10-09T11:37:22.268392+0000","last_fullsized":"2023-10-09T11:37:22.268392+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:19.257613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251565+0000","last_change":"2023-10-09T11:37:22.251565+0000","last_active":"2023-10-09T11:37:22.251565+0000","last_peered":"2023-10-09T11:37:22.251565+0000","last_clean":"2023-10-09T11:37:22.251565+0000","last_became_active":"2023-10-09T11:37:22.250991+0000","last_became_peered":"2023-10-09T11:37:22.250991+0000","last_unstale":"2023-10-09T11:37:22.251565+0000","last_undegraded":"2023-10-09T11:37:22.251565+0000","last_fullsized":"2023-10-09T11:37:22.251565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:30.285630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.252065+0000","last_change":"2023-10-09T11:37:21.251971+0000","last_active":"2023-10-09T11:37:21.252065+0000","last_peered":"2023-10-09T11:37:21.252065+0000","last_clean":"2023-10-09T11:37:21.252065+0000","last_became_active":"2023-10-09T11:37:21.251679+0000","last_became_peered":"2023-10-09T11:37:21.251679+0000","last_unstale":"2023-10-09T11:37:21.252065+0000","last_undegraded":"2023-10-09T11:37:21.252065+0000","last_fullsized":"2023-10-09T11:37:21.252065+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:23.722031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256709+0000","last_change":"2023-10-09T11:37:22.256709+0000","last_active":"2023-10-09T11:37:22.256709+0000","last_peered":"2023-10-09T11:37:22.256709+0000","last_clean":"2023-10-09T11:37:22.256709+0000","last_became_active":"2023-10-09T11:37:22.256279+0000","last_became_peered":"2023-10-09T11:37:22.256279+0000","last_unstale":"2023-10-09T11:37:22.256709+0000","last_undegraded":"2023-10-09T11:37:22.256709+0000","last_fullsized":"2023-10-09T11:37:22.256709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:19.654041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.250585+0000","last_change":"2023-10-09T11:37:21.250492+0000","last_active":"2023-10-09T11:37:21.250585+0000","last_peered":"2023-10-09T11:37:21.250585+0000","last_clean":"2023-10-09T11:37:21.250585+0000","last_became_active":"2023-10-09T11:37:21.250251+0000","last_became_peered":"2023-10-09T11:37:21.250251+0000","last_unstale":"2023-10-09T11:37:21.250585+0000","last_undegraded":"2023-10-09T11:37:21.250585+0000","last_fullsized":"2023-10-09T11:37:21.250585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:09.600358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255974+0000","last_change":"2023-10-09T11:37:22.255974+0000","last_active":"2023-10-09T11:37:22.255974+0000","last_peered":"2023-10-09T11:37:22.255974+0000","last_clean":"2023-10-09T11:37:22.255974+0000","last_became_active":"2023-10-09T11:37:22.255373+0000","last_became_peered":"2023-10-09T11:37:22.255373+0000","last_unstale":"2023-10-09T11:37:22.255974+0000","last_undegraded":"2023-10-09T11:37:22.255974+0000","last_fullsized":"2023-10-09T11:37:22.255974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:34.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.271603+0000","last_change":"2023-10-09T11:37:21.250771+0000","last_active":"2023-10-09T11:37:22.271603+0000","last_peered":"2023-10-09T11:37:22.271603+0000","last_clean":"2023-10-09T11:37:22.271603+0000","last_became_active":"2023-10-09T11:37:21.250518+0000","last_became_peered":"2023-10-09T11:37:21.250518+0000","last_unstale":"2023-10-09T11:37:22.271603+0000","last_undegraded":"2023-10-09T11:37:22.271603+0000","last_fullsized":"2023-10-09T11:37:22.271603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:04.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248751+0000","last_change":"2023-10-09T11:37:22.248751+0000","last_active":"2023-10-09T11:37:22.248751+0000","last_peered":"2023-10-09T11:37:22.248751+0000","last_clean":"2023-10-09T11:37:22.248751+0000","last_became_active":"2023-10-09T11:37:22.248516+0000","last_became_peered":"2023-10-09T11:37:22.248516+0000","last_unstale":"2023-10-09T11:37:22.248751+0000","last_undegraded":"2023-10-09T11:37:22.248751+0000","last_fullsized":"2023-10-09T11:37:22.248751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:31.705276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.243167+0000","last_change":"2023-10-09T11:37:21.248193+0000","last_active":"2023-10-09T11:37:22.243167+0000","last_peered":"2023-10-09T11:37:22.243167+0000","last_clean":"2023-10-09T11:37:22.243167+0000","last_became_active":"2023-10-09T11:37:21.247969+0000","last_became_peered":"2023-10-09T11:37:21.247969+0000","last_unstale":"2023-10-09T11:37:22.243167+0000","last_undegraded":"2023-10-09T11:37:22.243167+0000","last_fullsized":"2023-10-09T11:37:22.243167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:12.506980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252320+0000","last_change":"2023-10-09T11:37:22.252320+0000","last_active":"2023-10-09T11:37:22.252320+0000","last_peered":"2023-10-09T11:37:22.252320+0000","last_clean":"2023-10-09T11:37:22.252320+0000","last_became_active":"2023-10-09T11:37:22.252074+0000","last_became_peered":"2023-10-09T11:37:22.252074+0000","last_unstale":"2023-10-09T11:37:22.252320+0000","last_undegraded":"2023-10-09T11:37:22.252320+0000","last_fullsized":"2023-10-09T11:37:22.252320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:24.727128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266692+0000","last_change":"2023-10-09T11:37:21.252313+0000","last_active":"2023-10-09T11:37:22.266692+0000","last_peered":"2023-10-09T11:37:22.266692+0000","last_clean":"2023-10-09T11:37:22.266692+0000","last_became_active":"2023-10-09T11:37:21.252061+0000","last_became_peered":"2023-10-09T11:37:21.252061+0000","last_unstale":"2023-10-09T11:37:22.266692+0000","last_undegraded":"2023-10-09T11:37:22.266692+0000","last_fullsized":"2023-10-09T11:37:22.266692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:43.475237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252991+0000","last_change":"2023-10-09T11:37:22.252991+0000","last_active":"2023-10-09T11:37:22.252991+0000","last_peered":"2023-10-09T11:37:22.252991+0000","last_clean":"2023-10-09T11:37:22.252991+0000","last_became_active":"2023-10-09T11:37:22.252057+0000","last_became_peered":"2023-10-09T11:37:22.252057+0000","last_unstale":"2023-10-09T11:37:22.252991+0000","last_undegraded":"2023-10-09T11:37:22.252991+0000","last_fullsized":"2023-10-09T11:37:22.252991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:31.214727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.244068+0000","last_change":"2023-10-09T11:37:21.244663+0000","last_active":"2023-10-09T11:37:22.244068+0000","last_peered":"2023-10-09T11:37:22.244068+0000","last_clean":"2023-10-09T11:37:22.244068+0000","last_became_active":"2023-10-09T11:37:21.244371+0000","last_became_peered":"2023-10-09T11:37:21.244371+0000","last_unstale":"2023-10-09T11:37:22.244068+0000","last_undegraded":"2023-10-09T11:37:22.244068+0000","last_fullsized":"2023-10-09T11:37:22.244068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:44.921646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254682+0000","last_change":"2023-10-09T11:37:22.254682+0000","last_active":"2023-10-09T11:37:22.254682+0000","last_peered":"2023-10-09T11:37:22.254682+0000","last_clean":"2023-10-09T11:37:22.254682+0000","last_became_active":"2023-10-09T11:37:22.253992+0000","last_became_peered":"2023-10-09T11:37:22.253992+0000","last_unstale":"2023-10-09T11:37:22.254682+0000","last_undegraded":"2023-10-09T11:37:22.254682+0000","last_fullsized":"2023-10-09T11:37:22.254682+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:45.306477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.255839+0000","last_change":"2023-10-09T11:37:21.255776+0000","last_active":"2023-10-09T11:37:21.255839+0000","last_peered":"2023-10-09T11:37:21.255839+0000","last_clean":"2023-10-09T11:37:21.255839+0000","last_became_active":"2023-10-09T11:37:21.255293+0000","last_became_peered":"2023-10-09T11:37:21.255293+0000","last_unstale":"2023-10-09T11:37:21.255839+0000","last_undegraded":"2023-10-09T11:37:21.255839+0000","last_fullsized":"2023-10-09T11:37:21.255839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:23.722031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258624+0000","last_change":"2023-10-09T11:37:22.258624+0000","last_active":"2023-10-09T11:37:22.258624+0000","last_peered":"2023-10-09T11:37:22.258624+0000","last_clean":"2023-10-09T11:37:22.258624+0000","last_became_active":"2023-10-09T11:37:22.258051+0000","last_became_peered":"2023-10-09T11:37:22.258051+0000","last_unstale":"2023-10-09T11:37:22.258624+0000","last_undegraded":"2023-10-09T11:37:22.258624+0000","last_fullsized":"2023-10-09T11:37:22.258624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:21.942346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267123+0000","last_change":"2023-10-09T11:37:21.254982+0000","last_active":"2023-10-09T11:37:22.267123+0000","last_peered":"2023-10-09T11:37:22.267123+0000","last_clean":"2023-10-09T11:37:22.267123+0000","last_became_active":"2023-10-09T11:37:21.254396+0000","last_became_peered":"2023-10-09T11:37:21.254396+0000","last_unstale":"2023-10-09T11:37:22.267123+0000","last_undegraded":"2023-10-09T11:37:22.267123+0000","last_fullsized":"2023-10-09T11:37:22.267123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248907+0000","last_change":"2023-10-09T11:37:22.248907+0000","last_active":"2023-10-09T11:37:22.248907+0000","last_peered":"2023-10-09T11:37:22.248907+0000","last_clean":"2023-10-09T11:37:22.248907+0000","last_became_active":"2023-10-09T11:37:22.248687+0000","last_became_peered":"2023-10-09T11:37:22.248687+0000","last_unstale":"2023-10-09T11:37:22.248907+0000","last_undegraded":"2023-10-09T11:37:22.248907+0000","last_fullsized":"2023-10-09T11:37:22.248907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.248090+0000","last_change":"2023-10-09T11:37:21.247910+0000","last_active":"2023-10-09T11:37:21.248090+0000","last_peered":"2023-10-09T11:37:21.248090+0000","last_clean":"2023-10-09T11:37:21.248090+0000","last_became_active":"2023-10-09T11:37:21.247666+0000","last_became_peered":"2023-10-09T11:37:21.247666+0000","last_unstale":"2023-10-09T11:37:21.248090+0000","last_undegraded":"2023-10-09T11:37:21.248090+0000","last_fullsized":"2023-10-09T11:37:21.248090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255026+0000","last_change":"2023-10-09T11:37:22.255026+0000","last_active":"2023-10-09T11:37:22.255026+0000","last_peered":"2023-10-09T11:37:22.255026+0000","last_clean":"2023-10-09T11:37:22.255026+0000","last_became_active":"2023-10-09T11:37:22.254809+0000","last_became_peered":"2023-10-09T11:37:22.254809+0000","last_unstale":"2023-10-09T11:37:22.255026+0000","last_undegraded":"2023-10-09T11:37:22.255026+0000","last_fullsized":"2023-10-09T11:37:22.255026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:05.021927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.249310+0000","last_change":"2023-10-09T11:37:21.249117+0000","last_active":"2023-10-09T11:37:21.249310+0000","last_peered":"2023-10-09T11:37:21.249310+0000","last_clean":"2023-10-09T11:37:21.249310+0000","last_became_active":"2023-10-09T11:37:21.248616+0000","last_became_peered":"2023-10-09T11:37:21.248616+0000","last_unstale":"2023-10-09T11:37:21.249310+0000","last_undegraded":"2023-10-09T11:37:21.249310+0000","last_fullsized":"2023-10-09T11:37:21.249310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258946+0000","last_change":"2023-10-09T11:37:22.258946+0000","last_active":"2023-10-09T11:37:22.258946+0000","last_peered":"2023-10-09T11:37:22.258946+0000","last_clean":"2023-10-09T11:37:22.258946+0000","last_became_active":"2023-10-09T11:37:22.258635+0000","last_became_peered":"2023-10-09T11:37:22.258635+0000","last_unstale":"2023-10-09T11:37:22.258946+0000","last_undegraded":"2023-10-09T11:37:22.258946+0000","last_fullsized":"2023-10-09T11:37:22.258946+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:33.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253660+0000","last_change":"2023-10-09T11:37:21.252737+0000","last_active":"2023-10-09T11:37:21.253660+0000","last_peered":"2023-10-09T11:37:21.253660+0000","last_clean":"2023-10-09T11:37:21.253660+0000","last_became_active":"2023-10-09T11:37:21.252479+0000","last_became_peered":"2023-10-09T11:37:21.252479+0000","last_unstale":"2023-10-09T11:37:21.253660+0000","last_undegraded":"2023-10-09T11:37:21.253660+0000","last_fullsized":"2023-10-09T11:37:21.253660+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:14.904950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254877+0000","last_change":"2023-10-09T11:37:22.254877+0000","last_active":"2023-10-09T11:37:22.254877+0000","last_peered":"2023-10-09T11:37:22.254877+0000","last_clean":"2023-10-09T11:37:22.254877+0000","last_became_active":"2023-10-09T11:37:22.253604+0000","last_became_peered":"2023-10-09T11:37:22.253604+0000","last_unstale":"2023-10-09T11:37:22.254877+0000","last_undegraded":"2023-10-09T11:37:22.254877+0000","last_fullsized":"2023-10-09T11:37:22.254877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:30.932745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.255200+0000","last_change":"2023-10-09T11:37:21.255141+0000","last_active":"2023-10-09T11:37:21.255200+0000","last_peered":"2023-10-09T11:37:21.255200+0000","last_clean":"2023-10-09T11:37:21.255200+0000","last_became_active":"2023-10-09T11:37:21.254723+0000","last_became_peered":"2023-10-09T11:37:21.254723+0000","last_unstale":"2023-10-09T11:37:21.255200+0000","last_undegraded":"2023-10-09T11:37:21.255200+0000","last_fullsized":"2023-10-09T11:37:21.255200+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:14.904950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258048+0000","last_change":"2023-10-09T11:37:22.258048+0000","last_active":"2023-10-09T11:37:22.258048+0000","last_peered":"2023-10-09T11:37:22.258048+0000","last_clean":"2023-10-09T11:37:22.258048+0000","last_became_active":"2023-10-09T11:37:22.251290+0000","last_became_peered":"2023-10-09T11:37:22.251290+0000","last_unstale":"2023-10-09T11:37:22.258048+0000","last_undegraded":"2023-10-09T11:37:22.258048+0000","last_fullsized":"2023-10-09T11:37:22.258048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:38.057619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253769+0000","last_change":"2023-10-09T11:37:21.253719+0000","last_active":"2023-10-09T11:37:21.253769+0000","last_peered":"2023-10-09T11:37:21.253769+0000","last_clean":"2023-10-09T11:37:21.253769+0000","last_became_active":"2023-10-09T11:37:21.253467+0000","last_became_peered":"2023-10-09T11:37:21.253467+0000","last_unstale":"2023-10-09T11:37:21.253769+0000","last_undegraded":"2023-10-09T11:37:21.253769+0000","last_fullsized":"2023-10-09T11:37:21.253769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256347+0000","last_change":"2023-10-09T11:37:22.256347+0000","last_active":"2023-10-09T11:37:22.256347+0000","last_peered":"2023-10-09T11:37:22.256347+0000","last_clean":"2023-10-09T11:37:22.256347+0000","last_became_active":"2023-10-09T11:37:22.256143+0000","last_became_peered":"2023-10-09T11:37:22.256143+0000","last_unstale":"2023-10-09T11:37:22.256347+0000","last_undegraded":"2023-10-09T11:37:22.256347+0000","last_fullsized":"2023-10-09T11:37:22.256347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:48.586903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.247522+0000","last_change":"2023-10-09T11:37:21.247428+0000","last_active":"2023-10-09T11:37:21.247522+0000","last_peered":"2023-10-09T11:37:21.247522+0000","last_clean":"2023-10-09T11:37:21.247522+0000","last_became_active":"2023-10-09T11:37:21.246519+0000","last_became_peered":"2023-10-09T11:37:21.246519+0000","last_unstale":"2023-10-09T11:37:21.247522+0000","last_undegraded":"2023-10-09T11:37:21.247522+0000","last_fullsized":"2023-10-09T11:37:21.247522+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:06.690517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252009+0000","last_change":"2023-10-09T11:37:22.252009+0000","last_active":"2023-10-09T11:37:22.252009+0000","last_peered":"2023-10-09T11:37:22.252009+0000","last_clean":"2023-10-09T11:37:22.252009+0000","last_became_active":"2023-10-09T11:37:22.251777+0000","last_became_peered":"2023-10-09T11:37:22.251777+0000","last_unstale":"2023-10-09T11:37:22.252009+0000","last_undegraded":"2023-10-09T11:37:22.252009+0000","last_fullsized":"2023-10-09T11:37:22.252009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:20.684432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253803+0000","last_change":"2023-10-09T11:37:21.253737+0000","last_active":"2023-10-09T11:37:21.253803+0000","last_peered":"2023-10-09T11:37:21.253803+0000","last_clean":"2023-10-09T11:37:21.253803+0000","last_became_active":"2023-10-09T11:37:21.253450+0000","last_became_peered":"2023-10-09T11:37:21.253450+0000","last_unstale":"2023-10-09T11:37:21.253803+0000","last_undegraded":"2023-10-09T11:37:21.253803+0000","last_fullsized":"2023-10-09T11:37:21.253803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:29.280532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255310+0000","last_change":"2023-10-09T11:37:22.255310+0000","last_active":"2023-10-09T11:37:22.255310+0000","last_peered":"2023-10-09T11:37:22.255310+0000","last_clean":"2023-10-09T11:37:22.255310+0000","last_became_active":"2023-10-09T11:37:22.254923+0000","last_became_peered":"2023-10-09T11:37:22.254923+0000","last_unstale":"2023-10-09T11:37:22.255310+0000","last_undegraded":"2023-10-09T11:37:22.255310+0000","last_fullsized":"2023-10-09T11:37:22.255310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:34.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.254634+0000","last_change":"2023-10-09T11:37:21.254564+0000","last_active":"2023-10-09T11:37:21.254634+0000","last_peered":"2023-10-09T11:37:21.254634+0000","last_clean":"2023-10-09T11:37:21.254634+0000","last_became_active":"2023-10-09T11:37:21.254400+0000","last_became_peered":"2023-10-09T11:37:21.254400+0000","last_unstale":"2023-10-09T11:37:21.254634+0000","last_undegraded":"2023-10-09T11:37:21.254634+0000","last_fullsized":"2023-10-09T11:37:21.254634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:44.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248009+0000","last_change":"2023-10-09T11:37:22.248009+0000","last_active":"2023-10-09T11:37:22.248009+0000","last_peered":"2023-10-09T11:37:22.248009+0000","last_clean":"2023-10-09T11:37:22.248009+0000","last_became_active":"2023-10-09T11:37:22.247820+0000","last_became_peered":"2023-10-09T11:37:22.247820+0000","last_unstale":"2023-10-09T11:37:22.248009+0000","last_undegraded":"2023-10-09T11:37:22.248009+0000","last_fullsized":"2023-10-09T11:37:22.248009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:15.645024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.247628+0000","last_change":"2023-10-09T11:37:21.247557+0000","last_active":"2023-10-09T11:37:21.247628+0000","last_peered":"2023-10-09T11:37:21.247628+0000","last_clean":"2023-10-09T11:37:21.247628+0000","last_became_active":"2023-10-09T11:37:21.247241+0000","last_became_peered":"2023-10-09T11:37:21.247241+0000","last_unstale":"2023-10-09T11:37:21.247628+0000","last_undegraded":"2023-10-09T11:37:21.247628+0000","last_fullsized":"2023-10-09T11:37:21.247628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:44.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252648+0000","last_change":"2023-10-09T11:37:22.252648+0000","last_active":"2023-10-09T11:37:22.252648+0000","last_peered":"2023-10-09T11:37:22.252648+0000","last_clean":"2023-10-09T11:37:22.252648+0000","last_became_active":"2023-10-09T11:37:22.252419+0000","last_became_peered":"2023-10-09T11:37:22.252419+0000","last_unstale":"2023-10-09T11:37:22.252648+0000","last_undegraded":"2023-10-09T11:37:22.252648+0000","last_fullsized":"2023-10-09T11:37:22.252648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:15.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251496+0000","last_change":"2023-10-09T11:37:21.251308+0000","last_active":"2023-10-09T11:37:21.251496+0000","last_peered":"2023-10-09T11:37:21.251496+0000","last_clean":"2023-10-09T11:37:21.251496+0000","last_became_active":"2023-10-09T11:37:21.250469+0000","last_became_peered":"2023-10-09T11:37:21.250469+0000","last_unstale":"2023-10-09T11:37:21.251496+0000","last_undegraded":"2023-10-09T11:37:21.251496+0000","last_fullsized":"2023-10-09T11:37:21.251496+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:15.613631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251351+0000","last_change":"2023-10-09T11:37:22.251351+0000","last_active":"2023-10-09T11:37:22.251351+0000","last_peered":"2023-10-09T11:37:22.251351+0000","last_clean":"2023-10-09T11:37:22.251351+0000","last_became_active":"2023-10-09T11:37:22.251129+0000","last_became_peered":"2023-10-09T11:37:22.251129+0000","last_unstale":"2023-10-09T11:37:22.251351+0000","last_undegraded":"2023-10-09T11:37:22.251351+0000","last_fullsized":"2023-10-09T11:37:22.251351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:15.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267417+0000","last_change":"2023-10-09T11:37:21.246728+0000","last_active":"2023-10-09T11:37:22.267417+0000","last_peered":"2023-10-09T11:37:22.267417+0000","last_clean":"2023-10-09T11:37:22.267417+0000","last_became_active":"2023-10-09T11:37:21.246480+0000","last_became_peered":"2023-10-09T11:37:21.246480+0000","last_unstale":"2023-10-09T11:37:22.267417+0000","last_undegraded":"2023-10-09T11:37:22.267417+0000","last_fullsized":"2023-10-09T11:37:22.267417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:56.749180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.249378+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:37:21.249378+0000","last_peered":"2023-10-09T11:37:21.249378+0000","last_clean":"2023-10-09T11:37:21.249378+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:37:21.249378+0000","last_undegraded":"2023-10-09T11:37:21.249378+0000","last_fullsized":"2023-10-09T11:37:21.249378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194538,"statfs":{"total":200000000,"available":199207422,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71199999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7589999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.298,"5min":5.298,"15min":5.298},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.52100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3949999999999996,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199797810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.373},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208489,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.9340000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.69699999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199796322,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.246},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.315},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.378},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199796344,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":7.4210000000000003,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":7.4459999999999997,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.274,"5min":5.274,"15min":5.274},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":7.5679999999999996,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.495},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.5460000000000003,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.628}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199797810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.437}]},{"osd":6,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52700000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:37:26.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:37:26.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.516+0000 7fc10a22c700 1 Processor -- start 2023-10-09T11:37:26.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.516+0000 7fc10a22c700 1 -- start start 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc10a22c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc10a22c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040d07c0 con 0x7fc104157ca0 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc10a22c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1040cfbb0 con 0x7fc10406d120 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc10a22c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040cfe90 con 0x7fc1041578d0 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc102ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc104157ca0 0x7fc10415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51452/0 (socket says 172.21.15.6:51452) 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc102ffd700 1 -- 172.21.15.6:0/3905134714 learned_addr learned my addr 172.21.15.6:0/3905134714 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1037fe700 1 --2- 172.21.15.6:0/3905134714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543766017 0 0) 0x7fc1040d07c0 con 0x7fc104157ca0 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ec003570 con 0x7fc104157ca0 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229191571 0 0) 0x7fc1040cfbb0 con 0x7fc10406d120 2023-10-09T11:37:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1040d07c0 con 0x7fc10406d120 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256410061 0 0) 0x7fc0ec003570 con 0x7fc104157ca0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1037fe700 1 -- 172.21.15.6:0/3905134714 >> v1:172.21.15.118:6789/0 conn(0x7fc10406d120 legacy=0x7fc10415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1037fe700 1 -- 172.21.15.6:0/3905134714 >> v1:172.21.15.6:6789/0 conn(0x7fc104157ca0 legacy=0x7fc10415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.517+0000 7fc1037fe700 1 -- 172.21.15.6:0/3905134714 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040d0170 con 0x7fc1041578d0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc1037fe700 1 --2- 172.21.15.6:0/3905134714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009910 tx=0x7fc0f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0dec5f65fb5c37e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8001470 con 0x7fc1041578d0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4011420 con 0x7fc1041578d0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc1027fc700 1 -- 172.21.15.6:0/3905134714 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40117c0 con 0x7fc1041578d0 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 -- 172.21.15.6:0/3905134714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 msgr2=0x7fc1040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3905134714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040cf4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009910 tx=0x7fc0f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 -- 172.21.15.6:0/3905134714 shutdown_connections 2023-10-09T11:37:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3905134714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040cf4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 -- 172.21.15.6:0/3905134714 >> 172.21.15.6:0/3905134714 conn(0x7fc10406bb90 msgr2=0x7fc10406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 -- 172.21.15.6:0/3905134714 shutdown_connections 2023-10-09T11:37:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.518+0000 7fc10a22c700 1 -- 172.21.15.6:0/3905134714 wait complete. 2023-10-09T11:37:26.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 Processor -- start 2023-10-09T11:37:26.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 -- start start 2023-10-09T11:37:26.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 0x7fc1040b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040c66f0 con 0x7fc10406d120 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040c7530 con 0x7fc104157ca0 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc10a22c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040c6920 con 0x7fc1041578d0 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc1037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc1037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37690/0 (socket says 172.21.15.6:37690) 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.520+0000 7fc1037fe700 1 -- 172.21.15.6:0/3264525116 learned_addr learned my addr 172.21.15.6:0/3264525116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc102ffd700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc103fff700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 0x7fc1040b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 -- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 msgr2=0x7fc1040b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 -- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 msgr2=0x7fc1040b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 0x7fc1040b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 -- 172.21.15.6:0/3264525116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009420 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc103fff700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 0x7fc1040b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc1037fe700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40091e0 tx=0x7fc0f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f401cbe0 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f401cd40 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1040c6c00 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f401a6a0 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.521+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040c71c0 con 0x7fc10406d120 2023-10-09T11:37:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.522+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc104067ac0 con 0x7fc10406d120 2023-10-09T11:37:26.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.523+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0f401aa50 con 0x7fc10406d120 2023-10-09T11:37:26.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.523+0000 7fc0eb7fe700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 0x7fc0f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.523+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0f40863a0 con 0x7fc10406d120 2023-10-09T11:37:26.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.523+0000 7fc102ffd700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 0x7fc0f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.524+0000 7fc102ffd700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 0x7fc0f00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc10406a8a0 tx=0x7fc0f8000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.527+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0f4053610 con 0x7fc10406d120 2023-10-09T11:37:26.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.714+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc10404bb80 con 0x7fc0f0066f30 2023-10-09T11:37:26.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.722+0000 7fc0eb7fe700 1 -- 172.21.15.6:0/3264525116 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284391 (secure 0 0 0) 0x7fc10404bb80 con 0x7fc0f0066f30 2023-10-09T11:37:26.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 msgr2=0x7fc0f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 0x7fc0f00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc10406a8a0 tx=0x7fc0f8000bc0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 msgr2=0x7fc1040b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40091e0 tx=0x7fc0f4016000 comp rx=0 tx=0).stop 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 shutdown_connections 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc0f0066f30 0x7fc0f00693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104157ca0 0x7fc1040b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc10406d120 0x7fc1040b4c90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 --2- 172.21.15.6:0/3264525116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1041578d0 0x7fc1040b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 >> 172.21.15.6:0/3264525116 conn(0x7fc10406bb90 msgr2=0x7fc104155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 shutdown_connections 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.725+0000 7fc10a22c700 1 -- 172.21.15.6:0/3264525116 wait complete. 2023-10-09T11:37:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:37:26.738 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-09T11:37:26.161954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559764,"statfs":{"total":1600000000,"available":1597198703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.924998"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254970+0000","last_change":"2023-10-09T11:37:22.254970+0000","last_active":"2023-10-09T11:37:22.254970+0000","last_peered":"2023-10-09T11:37:22.254970+0000","last_clean":"2023-10-09T11:37:22.254970+0000","last_became_active":"2023-10-09T11:37:22.254733+0000","last_became_peered":"2023-10-09T11:37:22.254733+0000","last_unstale":"2023-10-09T11:37:22.254970+0000","last_undegraded":"2023-10-09T11:37:22.254970+0000","last_fullsized":"2023-10-09T11:37:22.254970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:19.654041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253015+0000","last_change":"2023-10-09T11:37:22.253015+0000","last_active":"2023-10-09T11:37:22.253015+0000","last_peered":"2023-10-09T11:37:22.253015+0000","last_clean":"2023-10-09T11:37:22.253015+0000","last_became_active":"2023-10-09T11:37:22.252786+0000","last_became_peered":"2023-10-09T11:37:22.252786+0000","last_unstale":"2023-10-09T11:37:22.253015+0000","last_undegraded":"2023-10-09T11:37:22.253015+0000","last_fullsized":"2023-10-09T11:37:22.253015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:38.057619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254464+0000","last_change":"2023-10-09T11:37:22.254464+0000","last_active":"2023-10-09T11:37:22.254464+0000","last_peered":"2023-10-09T11:37:22.254464+0000","last_clean":"2023-10-09T11:37:22.254464+0000","last_became_active":"2023-10-09T11:37:22.254112+0000","last_became_peered":"2023-10-09T11:37:22.254112+0000","last_unstale":"2023-10-09T11:37:22.254464+0000","last_undegraded":"2023-10-09T11:37:22.254464+0000","last_fullsized":"2023-10-09T11:37:22.254464+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:31.214727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258295+0000","last_change":"2023-10-09T11:37:22.258295+0000","last_active":"2023-10-09T11:37:22.258295+0000","last_peered":"2023-10-09T11:37:22.258295+0000","last_clean":"2023-10-09T11:37:22.258295+0000","last_became_active":"2023-10-09T11:37:22.257833+0000","last_became_peered":"2023-10-09T11:37:22.257833+0000","last_unstale":"2023-10-09T11:37:22.258295+0000","last_undegraded":"2023-10-09T11:37:22.258295+0000","last_fullsized":"2023-10-09T11:37:22.258295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:28.739147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.249755+0000","last_change":"2023-10-09T11:37:22.249755+0000","last_active":"2023-10-09T11:37:22.249755+0000","last_peered":"2023-10-09T11:37:22.249755+0000","last_clean":"2023-10-09T11:37:22.249755+0000","last_became_active":"2023-10-09T11:37:22.249498+0000","last_became_peered":"2023-10-09T11:37:22.249498+0000","last_unstale":"2023-10-09T11:37:22.249755+0000","last_undegraded":"2023-10-09T11:37:22.249755+0000","last_fullsized":"2023-10-09T11:37:22.249755+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.257449+0000","last_change":"2023-10-09T11:37:22.257449+0000","last_active":"2023-10-09T11:37:22.257449+0000","last_peered":"2023-10-09T11:37:22.257449+0000","last_clean":"2023-10-09T11:37:22.257449+0000","last_became_active":"2023-10-09T11:37:22.257243+0000","last_became_peered":"2023-10-09T11:37:22.257243+0000","last_unstale":"2023-10-09T11:37:22.257449+0000","last_undegraded":"2023-10-09T11:37:22.257449+0000","last_fullsized":"2023-10-09T11:37:22.257449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:46.719713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256149+0000","last_change":"2023-10-09T11:37:22.256149+0000","last_active":"2023-10-09T11:37:22.256149+0000","last_peered":"2023-10-09T11:37:22.256149+0000","last_clean":"2023-10-09T11:37:22.256149+0000","last_became_active":"2023-10-09T11:37:22.255717+0000","last_became_peered":"2023-10-09T11:37:22.255717+0000","last_unstale":"2023-10-09T11:37:22.256149+0000","last_undegraded":"2023-10-09T11:37:22.256149+0000","last_fullsized":"2023-10-09T11:37:22.256149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:23:27.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255837+0000","last_change":"2023-10-09T11:37:22.255837+0000","last_active":"2023-10-09T11:37:22.255837+0000","last_peered":"2023-10-09T11:37:22.255837+0000","last_clean":"2023-10-09T11:37:22.255837+0000","last_became_active":"2023-10-09T11:37:22.255591+0000","last_became_peered":"2023-10-09T11:37:22.255591+0000","last_unstale":"2023-10-09T11:37:22.255837+0000","last_undegraded":"2023-10-09T11:37:22.255837+0000","last_fullsized":"2023-10-09T11:37:22.255837+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254753+0000","last_change":"2023-10-09T11:37:22.254753+0000","last_active":"2023-10-09T11:37:22.254753+0000","last_peered":"2023-10-09T11:37:22.254753+0000","last_clean":"2023-10-09T11:37:22.254753+0000","last_became_active":"2023-10-09T11:37:22.254241+0000","last_became_peered":"2023-10-09T11:37:22.254241+0000","last_unstale":"2023-10-09T11:37:22.254753+0000","last_undegraded":"2023-10-09T11:37:22.254753+0000","last_fullsized":"2023-10-09T11:37:22.254753+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:20.262710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258189+0000","last_change":"2023-10-09T11:37:22.258189+0000","last_active":"2023-10-09T11:37:22.258189+0000","last_peered":"2023-10-09T11:37:22.258189+0000","last_clean":"2023-10-09T11:37:22.258189+0000","last_became_active":"2023-10-09T11:37:22.251773+0000","last_became_peered":"2023-10-09T11:37:22.251773+0000","last_unstale":"2023-10-09T11:37:22.258189+0000","last_undegraded":"2023-10-09T11:37:22.258189+0000","last_fullsized":"2023-10-09T11:37:22.258189+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:08.512662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253934+0000","last_change":"2023-10-09T11:37:22.253934+0000","last_active":"2023-10-09T11:37:22.253934+0000","last_peered":"2023-10-09T11:37:22.253934+0000","last_clean":"2023-10-09T11:37:22.253934+0000","last_became_active":"2023-10-09T11:37:22.253660+0000","last_became_peered":"2023-10-09T11:37:22.253660+0000","last_unstale":"2023-10-09T11:37:22.253934+0000","last_undegraded":"2023-10-09T11:37:22.253934+0000","last_fullsized":"2023-10-09T11:37:22.253934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:23.038084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.245849+0000","last_change":"2023-10-09T11:37:22.245849+0000","last_active":"2023-10-09T11:37:22.245849+0000","last_peered":"2023-10-09T11:37:22.245849+0000","last_clean":"2023-10-09T11:37:22.245849+0000","last_became_active":"2023-10-09T11:37:22.245624+0000","last_became_peered":"2023-10-09T11:37:22.245624+0000","last_unstale":"2023-10-09T11:37:22.245849+0000","last_undegraded":"2023-10-09T11:37:22.245849+0000","last_fullsized":"2023-10-09T11:37:22.245849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:28.739147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253212+0000","last_change":"2023-10-09T11:37:22.253212+0000","last_active":"2023-10-09T11:37:22.253212+0000","last_peered":"2023-10-09T11:37:22.253212+0000","last_clean":"2023-10-09T11:37:22.253212+0000","last_became_active":"2023-10-09T11:37:22.252702+0000","last_became_peered":"2023-10-09T11:37:22.252702+0000","last_unstale":"2023-10-09T11:37:22.253212+0000","last_undegraded":"2023-10-09T11:37:22.253212+0000","last_fullsized":"2023-10-09T11:37:22.253212+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:39.606317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254890+0000","last_change":"2023-10-09T11:37:22.254890+0000","last_active":"2023-10-09T11:37:22.254890+0000","last_peered":"2023-10-09T11:37:22.254890+0000","last_clean":"2023-10-09T11:37:22.254890+0000","last_became_active":"2023-10-09T11:37:22.254533+0000","last_became_peered":"2023-10-09T11:37:22.254533+0000","last_unstale":"2023-10-09T11:37:22.254890+0000","last_undegraded":"2023-10-09T11:37:22.254890+0000","last_fullsized":"2023-10-09T11:37:22.254890+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:10.605455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.249366+0000","last_change":"2023-10-09T11:37:22.249366+0000","last_active":"2023-10-09T11:37:22.249366+0000","last_peered":"2023-10-09T11:37:22.249366+0000","last_clean":"2023-10-09T11:37:22.249366+0000","last_became_active":"2023-10-09T11:37:22.249123+0000","last_became_peered":"2023-10-09T11:37:22.249123+0000","last_unstale":"2023-10-09T11:37:22.249366+0000","last_undegraded":"2023-10-09T11:37:22.249366+0000","last_fullsized":"2023-10-09T11:37:22.249366+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:19.414212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254818+0000","last_change":"2023-10-09T11:37:22.254818+0000","last_active":"2023-10-09T11:37:22.254818+0000","last_peered":"2023-10-09T11:37:22.254818+0000","last_clean":"2023-10-09T11:37:22.254818+0000","last_became_active":"2023-10-09T11:37:22.254297+0000","last_became_peered":"2023-10-09T11:37:22.254297+0000","last_unstale":"2023-10-09T11:37:22.254818+0000","last_undegraded":"2023-10-09T11:37:22.254818+0000","last_fullsized":"2023-10-09T11:37:22.254818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:38.605714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.247295+0000","last_change":"2023-10-09T11:37:22.247295+0000","last_active":"2023-10-09T11:37:22.247295+0000","last_peered":"2023-10-09T11:37:22.247295+0000","last_clean":"2023-10-09T11:37:22.247295+0000","last_became_active":"2023-10-09T11:37:22.247078+0000","last_became_peered":"2023-10-09T11:37:22.247078+0000","last_unstale":"2023-10-09T11:37:22.247295+0000","last_undegraded":"2023-10-09T11:37:22.247295+0000","last_fullsized":"2023-10-09T11:37:22.247295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:57.754277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251353+0000","last_change":"2023-10-09T11:37:22.251353+0000","last_active":"2023-10-09T11:37:22.251353+0000","last_peered":"2023-10-09T11:37:22.251353+0000","last_clean":"2023-10-09T11:37:22.251353+0000","last_became_active":"2023-10-09T11:37:22.250970+0000","last_became_peered":"2023-10-09T11:37:22.250970+0000","last_unstale":"2023-10-09T11:37:22.251353+0000","last_undegraded":"2023-10-09T11:37:22.251353+0000","last_fullsized":"2023-10-09T11:37:22.251353+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:46.693587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253901+0000","last_change":"2023-10-09T11:37:22.253901+0000","last_active":"2023-10-09T11:37:22.253901+0000","last_peered":"2023-10-09T11:37:22.253901+0000","last_clean":"2023-10-09T11:37:22.253901+0000","last_became_active":"2023-10-09T11:37:22.252345+0000","last_became_peered":"2023-10-09T11:37:22.252345+0000","last_unstale":"2023-10-09T11:37:22.253901+0000","last_undegraded":"2023-10-09T11:37:22.253901+0000","last_fullsized":"2023-10-09T11:37:22.253901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251654+0000","last_change":"2023-10-09T11:37:22.251654+0000","last_active":"2023-10-09T11:37:22.251654+0000","last_peered":"2023-10-09T11:37:22.251654+0000","last_clean":"2023-10-09T11:37:22.251654+0000","last_became_active":"2023-10-09T11:37:22.251384+0000","last_became_peered":"2023-10-09T11:37:22.251384+0000","last_unstale":"2023-10-09T11:37:22.251654+0000","last_undegraded":"2023-10-09T11:37:22.251654+0000","last_fullsized":"2023-10-09T11:37:22.251654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:56:07.992157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255182+0000","last_change":"2023-10-09T11:37:22.255182+0000","last_active":"2023-10-09T11:37:22.255182+0000","last_peered":"2023-10-09T11:37:22.255182+0000","last_clean":"2023-10-09T11:37:22.255182+0000","last_became_active":"2023-10-09T11:37:22.254462+0000","last_became_peered":"2023-10-09T11:37:22.254462+0000","last_unstale":"2023-10-09T11:37:22.255182+0000","last_undegraded":"2023-10-09T11:37:22.255182+0000","last_fullsized":"2023-10-09T11:37:22.255182+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:37.578726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256998+0000","last_change":"2023-10-09T11:37:22.256998+0000","last_active":"2023-10-09T11:37:22.256998+0000","last_peered":"2023-10-09T11:37:22.256998+0000","last_clean":"2023-10-09T11:37:22.256998+0000","last_became_active":"2023-10-09T11:37:22.256277+0000","last_became_peered":"2023-10-09T11:37:22.256277+0000","last_unstale":"2023-10-09T11:37:22.256998+0000","last_undegraded":"2023-10-09T11:37:22.256998+0000","last_fullsized":"2023-10-09T11:37:22.256998+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:15.645024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252976+0000","last_change":"2023-10-09T11:37:22.252976+0000","last_active":"2023-10-09T11:37:22.252976+0000","last_peered":"2023-10-09T11:37:22.252976+0000","last_clean":"2023-10-09T11:37:22.252976+0000","last_became_active":"2023-10-09T11:37:22.252678+0000","last_became_peered":"2023-10-09T11:37:22.252678+0000","last_unstale":"2023-10-09T11:37:22.252976+0000","last_undegraded":"2023-10-09T11:37:22.252976+0000","last_fullsized":"2023-10-09T11:37:22.252976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252135+0000","last_change":"2023-10-09T11:37:22.252135+0000","last_active":"2023-10-09T11:37:22.252135+0000","last_peered":"2023-10-09T11:37:22.252135+0000","last_clean":"2023-10-09T11:37:22.252135+0000","last_became_active":"2023-10-09T11:37:22.251717+0000","last_became_peered":"2023-10-09T11:37:22.251717+0000","last_unstale":"2023-10-09T11:37:22.252135+0000","last_undegraded":"2023-10-09T11:37:22.252135+0000","last_fullsized":"2023-10-09T11:37:22.252135+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:23.764548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255762+0000","last_change":"2023-10-09T11:37:22.255762+0000","last_active":"2023-10-09T11:37:22.255762+0000","last_peered":"2023-10-09T11:37:22.255762+0000","last_clean":"2023-10-09T11:37:22.255762+0000","last_became_active":"2023-10-09T11:37:22.255533+0000","last_became_peered":"2023-10-09T11:37:22.255533+0000","last_unstale":"2023-10-09T11:37:22.255762+0000","last_undegraded":"2023-10-09T11:37:22.255762+0000","last_fullsized":"2023-10-09T11:37:22.255762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:24.624950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252610+0000","last_change":"2023-10-09T11:37:22.252610+0000","last_active":"2023-10-09T11:37:22.252610+0000","last_peered":"2023-10-09T11:37:22.252610+0000","last_clean":"2023-10-09T11:37:22.252610+0000","last_became_active":"2023-10-09T11:37:22.252382+0000","last_became_peered":"2023-10-09T11:37:22.252382+0000","last_unstale":"2023-10-09T11:37:22.252610+0000","last_undegraded":"2023-10-09T11:37:22.252610+0000","last_fullsized":"2023-10-09T11:37:22.252610+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:15.931822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248700+0000","last_change":"2023-10-09T11:37:22.248700+0000","last_active":"2023-10-09T11:37:22.248700+0000","last_peered":"2023-10-09T11:37:22.248700+0000","last_clean":"2023-10-09T11:37:22.248700+0000","last_became_active":"2023-10-09T11:37:22.248461+0000","last_became_peered":"2023-10-09T11:37:22.248461+0000","last_unstale":"2023-10-09T11:37:22.248700+0000","last_undegraded":"2023-10-09T11:37:22.248700+0000","last_fullsized":"2023-10-09T11:37:22.248700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:45.926743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250676+0000","last_change":"2023-10-09T11:37:22.250676+0000","last_active":"2023-10-09T11:37:22.250676+0000","last_peered":"2023-10-09T11:37:22.250676+0000","last_clean":"2023-10-09T11:37:22.250676+0000","last_became_active":"2023-10-09T11:37:22.250238+0000","last_became_peered":"2023-10-09T11:37:22.250238+0000","last_unstale":"2023-10-09T11:37:22.250676+0000","last_undegraded":"2023-10-09T11:37:22.250676+0000","last_fullsized":"2023-10-09T11:37:22.250676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:56.410121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254383+0000","last_change":"2023-10-09T11:37:22.254383+0000","last_active":"2023-10-09T11:37:22.254383+0000","last_peered":"2023-10-09T11:37:22.254383+0000","last_clean":"2023-10-09T11:37:22.254383+0000","last_became_active":"2023-10-09T11:37:22.254146+0000","last_became_peered":"2023-10-09T11:37:22.254146+0000","last_unstale":"2023-10-09T11:37:22.254383+0000","last_undegraded":"2023-10-09T11:37:22.254383+0000","last_fullsized":"2023-10-09T11:37:22.254383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:44.480334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253508+0000","last_change":"2023-10-09T11:37:22.253508+0000","last_active":"2023-10-09T11:37:22.253508+0000","last_peered":"2023-10-09T11:37:22.253508+0000","last_clean":"2023-10-09T11:37:22.253508+0000","last_became_active":"2023-10-09T11:37:22.253283+0000","last_became_peered":"2023-10-09T11:37:22.253283+0000","last_unstale":"2023-10-09T11:37:22.253508+0000","last_undegraded":"2023-10-09T11:37:22.253508+0000","last_fullsized":"2023-10-09T11:37:22.253508+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:23.038084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253118+0000","last_change":"2023-10-09T11:37:22.253118+0000","last_active":"2023-10-09T11:37:22.253118+0000","last_peered":"2023-10-09T11:37:22.253118+0000","last_clean":"2023-10-09T11:37:22.253118+0000","last_became_active":"2023-10-09T11:37:22.252343+0000","last_became_peered":"2023-10-09T11:37:22.252343+0000","last_unstale":"2023-10-09T11:37:22.253118+0000","last_undegraded":"2023-10-09T11:37:22.253118+0000","last_fullsized":"2023-10-09T11:37:22.253118+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:51:37.065038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250378+0000","last_change":"2023-10-09T11:37:22.250378+0000","last_active":"2023-10-09T11:37:22.250378+0000","last_peered":"2023-10-09T11:37:22.250378+0000","last_clean":"2023-10-09T11:37:22.250378+0000","last_became_active":"2023-10-09T11:37:22.249743+0000","last_became_peered":"2023-10-09T11:37:22.249743+0000","last_unstale":"2023-10-09T11:37:22.250378+0000","last_undegraded":"2023-10-09T11:37:22.250378+0000","last_fullsized":"2023-10-09T11:37:22.250378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:15.677912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253551+0000","last_change":"2023-10-09T11:37:22.253551+0000","last_active":"2023-10-09T11:37:22.253551+0000","last_peered":"2023-10-09T11:37:22.253551+0000","last_clean":"2023-10-09T11:37:22.253551+0000","last_became_active":"2023-10-09T11:37:22.253307+0000","last_became_peered":"2023-10-09T11:37:22.253307+0000","last_unstale":"2023-10-09T11:37:22.253551+0000","last_undegraded":"2023-10-09T11:37:22.253551+0000","last_fullsized":"2023-10-09T11:37:22.253551+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:23.208448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266922+0000","last_change":"2023-10-09T11:37:21.252633+0000","last_active":"2023-10-09T11:37:22.266922+0000","last_peered":"2023-10-09T11:37:22.266922+0000","last_clean":"2023-10-09T11:37:22.266922+0000","last_became_active":"2023-10-09T11:37:21.252322+0000","last_became_peered":"2023-10-09T11:37:21.252322+0000","last_unstale":"2023-10-09T11:37:22.266922+0000","last_undegraded":"2023-10-09T11:37:22.266922+0000","last_fullsized":"2023-10-09T11:37:22.266922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:32.501850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.253987+0000","last_change":"2023-10-09T11:37:22.253987+0000","last_active":"2023-10-09T11:37:22.253987+0000","last_peered":"2023-10-09T11:37:22.253987+0000","last_clean":"2023-10-09T11:37:22.253987+0000","last_became_active":"2023-10-09T11:37:22.253714+0000","last_became_peered":"2023-10-09T11:37:22.253714+0000","last_unstale":"2023-10-09T11:37:22.253987+0000","last_undegraded":"2023-10-09T11:37:22.253987+0000","last_fullsized":"2023-10-09T11:37:22.253987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:53.333923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.243951+0000","last_change":"2023-10-09T11:37:21.255454+0000","last_active":"2023-10-09T11:37:22.243951+0000","last_peered":"2023-10-09T11:37:22.243951+0000","last_clean":"2023-10-09T11:37:22.243951+0000","last_became_active":"2023-10-09T11:37:21.255087+0000","last_became_peered":"2023-10-09T11:37:21.255087+0000","last_unstale":"2023-10-09T11:37:22.243951+0000","last_undegraded":"2023-10-09T11:37:22.243951+0000","last_fullsized":"2023-10-09T11:37:22.243951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:00.996414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.250282+0000","last_change":"2023-10-09T11:37:22.250282+0000","last_active":"2023-10-09T11:37:22.250282+0000","last_peered":"2023-10-09T11:37:22.250282+0000","last_clean":"2023-10-09T11:37:22.250282+0000","last_became_active":"2023-10-09T11:37:22.250000+0000","last_became_peered":"2023-10-09T11:37:22.250000+0000","last_unstale":"2023-10-09T11:37:22.250282+0000","last_undegraded":"2023-10-09T11:37:22.250282+0000","last_fullsized":"2023-10-09T11:37:22.250282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:08.512662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266154+0000","last_change":"2023-10-09T11:37:21.244995+0000","last_active":"2023-10-09T11:37:22.266154+0000","last_peered":"2023-10-09T11:37:22.266154+0000","last_clean":"2023-10-09T11:37:22.266154+0000","last_became_active":"2023-10-09T11:37:21.244756+0000","last_became_peered":"2023-10-09T11:37:21.244756+0000","last_unstale":"2023-10-09T11:37:22.266154+0000","last_undegraded":"2023-10-09T11:37:22.266154+0000","last_fullsized":"2023-10-09T11:37:22.266154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:34.334647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255565+0000","last_change":"2023-10-09T11:37:22.255565+0000","last_active":"2023-10-09T11:37:22.255565+0000","last_peered":"2023-10-09T11:37:22.255565+0000","last_clean":"2023-10-09T11:37:22.255565+0000","last_became_active":"2023-10-09T11:37:22.255297+0000","last_became_peered":"2023-10-09T11:37:22.255297+0000","last_unstale":"2023-10-09T11:37:22.255565+0000","last_undegraded":"2023-10-09T11:37:22.255565+0000","last_fullsized":"2023-10-09T11:37:22.255565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:20.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.265995+0000","last_change":"2023-10-09T11:37:21.250845+0000","last_active":"2023-10-09T11:37:22.265995+0000","last_peered":"2023-10-09T11:37:22.265995+0000","last_clean":"2023-10-09T11:37:22.265995+0000","last_became_active":"2023-10-09T11:37:21.250583+0000","last_became_peered":"2023-10-09T11:37:21.250583+0000","last_unstale":"2023-10-09T11:37:22.265995+0000","last_undegraded":"2023-10-09T11:37:22.265995+0000","last_fullsized":"2023-10-09T11:37:22.265995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:32.501850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251217+0000","last_change":"2023-10-09T11:37:22.251217+0000","last_active":"2023-10-09T11:37:22.251217+0000","last_peered":"2023-10-09T11:37:22.251217+0000","last_clean":"2023-10-09T11:37:22.251217+0000","last_became_active":"2023-10-09T11:37:22.250686+0000","last_became_peered":"2023-10-09T11:37:22.250686+0000","last_unstale":"2023-10-09T11:37:22.251217+0000","last_undegraded":"2023-10-09T11:37:22.251217+0000","last_fullsized":"2023-10-09T11:37:22.251217+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:30.285630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248369+0000","last_change":"2023-10-09T11:37:21.257163+0000","last_active":"2023-10-09T11:37:22.248369+0000","last_peered":"2023-10-09T11:37:22.248369+0000","last_clean":"2023-10-09T11:37:22.248369+0000","last_became_active":"2023-10-09T11:37:21.256045+0000","last_became_peered":"2023-10-09T11:37:21.256045+0000","last_unstale":"2023-10-09T11:37:22.248369+0000","last_undegraded":"2023-10-09T11:37:22.248369+0000","last_fullsized":"2023-10-09T11:37:22.248369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:07.507564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.257146+0000","last_change":"2023-10-09T11:37:22.257146+0000","last_active":"2023-10-09T11:37:22.257146+0000","last_peered":"2023-10-09T11:37:22.257146+0000","last_clean":"2023-10-09T11:37:22.257146+0000","last_became_active":"2023-10-09T11:37:22.256775+0000","last_became_peered":"2023-10-09T11:37:22.256775+0000","last_unstale":"2023-10-09T11:37:22.257146+0000","last_undegraded":"2023-10-09T11:37:22.257146+0000","last_fullsized":"2023-10-09T11:37:22.257146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:57.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.244175+0000","last_change":"2023-10-09T11:37:21.251459+0000","last_active":"2023-10-09T11:37:22.244175+0000","last_peered":"2023-10-09T11:37:22.244175+0000","last_clean":"2023-10-09T11:37:22.244175+0000","last_became_active":"2023-10-09T11:37:21.251288+0000","last_became_peered":"2023-10-09T11:37:21.251288+0000","last_unstale":"2023-10-09T11:37:22.244175+0000","last_undegraded":"2023-10-09T11:37:22.244175+0000","last_fullsized":"2023-10-09T11:37:22.244175+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:34.334647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258832+0000","last_change":"2023-10-09T11:37:22.258832+0000","last_active":"2023-10-09T11:37:22.258832+0000","last_peered":"2023-10-09T11:37:22.258832+0000","last_clean":"2023-10-09T11:37:22.258832+0000","last_became_active":"2023-10-09T11:37:22.252045+0000","last_became_peered":"2023-10-09T11:37:22.252045+0000","last_unstale":"2023-10-09T11:37:22.258832+0000","last_undegraded":"2023-10-09T11:37:22.258832+0000","last_fullsized":"2023-10-09T11:37:22.258832+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:57.754277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.244680+0000","last_change":"2023-10-09T11:37:21.244595+0000","last_active":"2023-10-09T11:37:21.244680+0000","last_peered":"2023-10-09T11:37:21.244680+0000","last_clean":"2023-10-09T11:37:21.244680+0000","last_became_active":"2023-10-09T11:37:21.244346+0000","last_became_peered":"2023-10-09T11:37:21.244346+0000","last_unstale":"2023-10-09T11:37:21.244680+0000","last_undegraded":"2023-10-09T11:37:21.244680+0000","last_fullsized":"2023-10-09T11:37:21.244680+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:51:45.688490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251971+0000","last_change":"2023-10-09T11:37:22.251971+0000","last_active":"2023-10-09T11:37:22.251971+0000","last_peered":"2023-10-09T11:37:22.251971+0000","last_clean":"2023-10-09T11:37:22.251971+0000","last_became_active":"2023-10-09T11:37:22.251407+0000","last_became_peered":"2023-10-09T11:37:22.251407+0000","last_unstale":"2023-10-09T11:37:22.251971+0000","last_undegraded":"2023-10-09T11:37:22.251971+0000","last_fullsized":"2023-10-09T11:37:22.251971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:23.208448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251479+0000","last_change":"2023-10-09T11:37:21.251206+0000","last_active":"2023-10-09T11:37:21.251479+0000","last_peered":"2023-10-09T11:37:21.251479+0000","last_clean":"2023-10-09T11:37:21.251479+0000","last_became_active":"2023-10-09T11:37:21.250389+0000","last_became_peered":"2023-10-09T11:37:21.250389+0000","last_unstale":"2023-10-09T11:37:21.251479+0000","last_undegraded":"2023-10-09T11:37:21.251479+0000","last_fullsized":"2023-10-09T11:37:21.251479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:00.996414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251170+0000","last_change":"2023-10-09T11:37:22.251170+0000","last_active":"2023-10-09T11:37:22.251170+0000","last_peered":"2023-10-09T11:37:22.251170+0000","last_clean":"2023-10-09T11:37:22.251170+0000","last_became_active":"2023-10-09T11:37:22.250946+0000","last_became_peered":"2023-10-09T11:37:22.250946+0000","last_unstale":"2023-10-09T11:37:22.251170+0000","last_undegraded":"2023-10-09T11:37:22.251170+0000","last_fullsized":"2023-10-09T11:37:22.251170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:57.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251040+0000","last_change":"2023-10-09T11:37:21.249571+0000","last_active":"2023-10-09T11:37:21.251040+0000","last_peered":"2023-10-09T11:37:21.251040+0000","last_clean":"2023-10-09T11:37:21.251040+0000","last_became_active":"2023-10-09T11:37:21.249335+0000","last_became_peered":"2023-10-09T11:37:21.249335+0000","last_unstale":"2023-10-09T11:37:21.251040+0000","last_undegraded":"2023-10-09T11:37:21.251040+0000","last_fullsized":"2023-10-09T11:37:21.251040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:06.690517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254060+0000","last_change":"2023-10-09T11:37:22.254060+0000","last_active":"2023-10-09T11:37:22.254060+0000","last_peered":"2023-10-09T11:37:22.254060+0000","last_clean":"2023-10-09T11:37:22.254060+0000","last_became_active":"2023-10-09T11:37:22.253841+0000","last_became_peered":"2023-10-09T11:37:22.253841+0000","last_unstale":"2023-10-09T11:37:22.254060+0000","last_undegraded":"2023-10-09T11:37:22.254060+0000","last_fullsized":"2023-10-09T11:37:22.254060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:35:24.516840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251461+0000","last_change":"2023-10-09T11:37:21.250920+0000","last_active":"2023-10-09T11:37:21.251461+0000","last_peered":"2023-10-09T11:37:21.251461+0000","last_clean":"2023-10-09T11:37:21.251461+0000","last_became_active":"2023-10-09T11:37:21.249877+0000","last_became_peered":"2023-10-09T11:37:21.249877+0000","last_unstale":"2023-10-09T11:37:21.251461+0000","last_undegraded":"2023-10-09T11:37:21.251461+0000","last_fullsized":"2023-10-09T11:37:21.251461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:04.016830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258341+0000","last_change":"2023-10-09T11:37:22.258341+0000","last_active":"2023-10-09T11:37:22.258341+0000","last_peered":"2023-10-09T11:37:22.258341+0000","last_clean":"2023-10-09T11:37:22.258341+0000","last_became_active":"2023-10-09T11:37:22.256780+0000","last_became_peered":"2023-10-09T11:37:22.256780+0000","last_unstale":"2023-10-09T11:37:22.258341+0000","last_undegraded":"2023-10-09T11:37:22.258341+0000","last_fullsized":"2023-10-09T11:37:22.258341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:47.043372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267138+0000","last_change":"2023-10-09T11:37:21.253741+0000","last_active":"2023-10-09T11:37:22.267138+0000","last_peered":"2023-10-09T11:37:22.267138+0000","last_clean":"2023-10-09T11:37:22.267138+0000","last_became_active":"2023-10-09T11:37:21.253476+0000","last_became_peered":"2023-10-09T11:37:21.253476+0000","last_unstale":"2023-10-09T11:37:22.267138+0000","last_undegraded":"2023-10-09T11:37:22.267138+0000","last_fullsized":"2023-10-09T11:37:22.267138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:22.032987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255842+0000","last_change":"2023-10-09T11:37:22.255842+0000","last_active":"2023-10-09T11:37:22.255842+0000","last_peered":"2023-10-09T11:37:22.255842+0000","last_clean":"2023-10-09T11:37:22.255842+0000","last_became_active":"2023-10-09T11:37:22.255611+0000","last_became_peered":"2023-10-09T11:37:22.255611+0000","last_unstale":"2023-10-09T11:37:22.255842+0000","last_undegraded":"2023-10-09T11:37:22.255842+0000","last_fullsized":"2023-10-09T11:37:22.255842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:13.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.268162+0000","last_change":"2023-10-09T11:37:21.253596+0000","last_active":"2023-10-09T11:37:22.268162+0000","last_peered":"2023-10-09T11:37:22.268162+0000","last_clean":"2023-10-09T11:37:22.268162+0000","last_became_active":"2023-10-09T11:37:21.253350+0000","last_became_peered":"2023-10-09T11:37:21.253350+0000","last_unstale":"2023-10-09T11:37:22.268162+0000","last_undegraded":"2023-10-09T11:37:22.268162+0000","last_fullsized":"2023-10-09T11:37:22.268162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:24.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254530+0000","last_change":"2023-10-09T11:37:22.254530+0000","last_active":"2023-10-09T11:37:22.254530+0000","last_peered":"2023-10-09T11:37:22.254530+0000","last_clean":"2023-10-09T11:37:22.254530+0000","last_became_active":"2023-10-09T11:37:22.253691+0000","last_became_peered":"2023-10-09T11:37:22.253691+0000","last_unstale":"2023-10-09T11:37:22.254530+0000","last_undegraded":"2023-10-09T11:37:22.254530+0000","last_fullsized":"2023-10-09T11:37:22.254530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:28.189181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.268392+0000","last_change":"2023-10-09T11:37:21.249708+0000","last_active":"2023-10-09T11:37:22.268392+0000","last_peered":"2023-10-09T11:37:22.268392+0000","last_clean":"2023-10-09T11:37:22.268392+0000","last_became_active":"2023-10-09T11:37:21.249473+0000","last_became_peered":"2023-10-09T11:37:21.249473+0000","last_unstale":"2023-10-09T11:37:22.268392+0000","last_undegraded":"2023-10-09T11:37:22.268392+0000","last_fullsized":"2023-10-09T11:37:22.268392+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:19.257613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251565+0000","last_change":"2023-10-09T11:37:22.251565+0000","last_active":"2023-10-09T11:37:22.251565+0000","last_peered":"2023-10-09T11:37:22.251565+0000","last_clean":"2023-10-09T11:37:22.251565+0000","last_became_active":"2023-10-09T11:37:22.250991+0000","last_became_peered":"2023-10-09T11:37:22.250991+0000","last_unstale":"2023-10-09T11:37:22.251565+0000","last_undegraded":"2023-10-09T11:37:22.251565+0000","last_fullsized":"2023-10-09T11:37:22.251565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:30.285630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.252065+0000","last_change":"2023-10-09T11:37:21.251971+0000","last_active":"2023-10-09T11:37:21.252065+0000","last_peered":"2023-10-09T11:37:21.252065+0000","last_clean":"2023-10-09T11:37:21.252065+0000","last_became_active":"2023-10-09T11:37:21.251679+0000","last_became_peered":"2023-10-09T11:37:21.251679+0000","last_unstale":"2023-10-09T11:37:21.252065+0000","last_undegraded":"2023-10-09T11:37:21.252065+0000","last_fullsized":"2023-10-09T11:37:21.252065+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:23.722031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256709+0000","last_change":"2023-10-09T11:37:22.256709+0000","last_active":"2023-10-09T11:37:22.256709+0000","last_peered":"2023-10-09T11:37:22.256709+0000","last_clean":"2023-10-09T11:37:22.256709+0000","last_became_active":"2023-10-09T11:37:22.256279+0000","last_became_peered":"2023-10-09T11:37:22.256279+0000","last_unstale":"2023-10-09T11:37:22.256709+0000","last_undegraded":"2023-10-09T11:37:22.256709+0000","last_fullsized":"2023-10-09T11:37:22.256709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:19.654041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.250585+0000","last_change":"2023-10-09T11:37:21.250492+0000","last_active":"2023-10-09T11:37:21.250585+0000","last_peered":"2023-10-09T11:37:21.250585+0000","last_clean":"2023-10-09T11:37:21.250585+0000","last_became_active":"2023-10-09T11:37:21.250251+0000","last_became_peered":"2023-10-09T11:37:21.250251+0000","last_unstale":"2023-10-09T11:37:21.250585+0000","last_undegraded":"2023-10-09T11:37:21.250585+0000","last_fullsized":"2023-10-09T11:37:21.250585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:09.600358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255974+0000","last_change":"2023-10-09T11:37:22.255974+0000","last_active":"2023-10-09T11:37:22.255974+0000","last_peered":"2023-10-09T11:37:22.255974+0000","last_clean":"2023-10-09T11:37:22.255974+0000","last_became_active":"2023-10-09T11:37:22.255373+0000","last_became_peered":"2023-10-09T11:37:22.255373+0000","last_unstale":"2023-10-09T11:37:22.255974+0000","last_undegraded":"2023-10-09T11:37:22.255974+0000","last_fullsized":"2023-10-09T11:37:22.255974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:34.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.271603+0000","last_change":"2023-10-09T11:37:21.250771+0000","last_active":"2023-10-09T11:37:22.271603+0000","last_peered":"2023-10-09T11:37:22.271603+0000","last_clean":"2023-10-09T11:37:22.271603+0000","last_became_active":"2023-10-09T11:37:21.250518+0000","last_became_peered":"2023-10-09T11:37:21.250518+0000","last_unstale":"2023-10-09T11:37:22.271603+0000","last_undegraded":"2023-10-09T11:37:22.271603+0000","last_fullsized":"2023-10-09T11:37:22.271603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:47:04.626203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248751+0000","last_change":"2023-10-09T11:37:22.248751+0000","last_active":"2023-10-09T11:37:22.248751+0000","last_peered":"2023-10-09T11:37:22.248751+0000","last_clean":"2023-10-09T11:37:22.248751+0000","last_became_active":"2023-10-09T11:37:22.248516+0000","last_became_peered":"2023-10-09T11:37:22.248516+0000","last_unstale":"2023-10-09T11:37:22.248751+0000","last_undegraded":"2023-10-09T11:37:22.248751+0000","last_fullsized":"2023-10-09T11:37:22.248751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:31.705276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.243167+0000","last_change":"2023-10-09T11:37:21.248193+0000","last_active":"2023-10-09T11:37:22.243167+0000","last_peered":"2023-10-09T11:37:22.243167+0000","last_clean":"2023-10-09T11:37:22.243167+0000","last_became_active":"2023-10-09T11:37:21.247969+0000","last_became_peered":"2023-10-09T11:37:21.247969+0000","last_unstale":"2023-10-09T11:37:22.243167+0000","last_undegraded":"2023-10-09T11:37:22.243167+0000","last_fullsized":"2023-10-09T11:37:22.243167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:59:12.506980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252320+0000","last_change":"2023-10-09T11:37:22.252320+0000","last_active":"2023-10-09T11:37:22.252320+0000","last_peered":"2023-10-09T11:37:22.252320+0000","last_clean":"2023-10-09T11:37:22.252320+0000","last_became_active":"2023-10-09T11:37:22.252074+0000","last_became_peered":"2023-10-09T11:37:22.252074+0000","last_unstale":"2023-10-09T11:37:22.252320+0000","last_undegraded":"2023-10-09T11:37:22.252320+0000","last_fullsized":"2023-10-09T11:37:22.252320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:24.727128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.266692+0000","last_change":"2023-10-09T11:37:21.252313+0000","last_active":"2023-10-09T11:37:22.266692+0000","last_peered":"2023-10-09T11:37:22.266692+0000","last_clean":"2023-10-09T11:37:22.266692+0000","last_became_active":"2023-10-09T11:37:21.252061+0000","last_became_peered":"2023-10-09T11:37:21.252061+0000","last_unstale":"2023-10-09T11:37:22.266692+0000","last_undegraded":"2023-10-09T11:37:22.266692+0000","last_fullsized":"2023-10-09T11:37:22.266692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:43.475237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252991+0000","last_change":"2023-10-09T11:37:22.252991+0000","last_active":"2023-10-09T11:37:22.252991+0000","last_peered":"2023-10-09T11:37:22.252991+0000","last_clean":"2023-10-09T11:37:22.252991+0000","last_became_active":"2023-10-09T11:37:22.252057+0000","last_became_peered":"2023-10-09T11:37:22.252057+0000","last_unstale":"2023-10-09T11:37:22.252991+0000","last_undegraded":"2023-10-09T11:37:22.252991+0000","last_fullsized":"2023-10-09T11:37:22.252991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:31.214727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.244068+0000","last_change":"2023-10-09T11:37:21.244663+0000","last_active":"2023-10-09T11:37:22.244068+0000","last_peered":"2023-10-09T11:37:22.244068+0000","last_clean":"2023-10-09T11:37:22.244068+0000","last_became_active":"2023-10-09T11:37:21.244371+0000","last_became_peered":"2023-10-09T11:37:21.244371+0000","last_unstale":"2023-10-09T11:37:22.244068+0000","last_undegraded":"2023-10-09T11:37:22.244068+0000","last_fullsized":"2023-10-09T11:37:22.244068+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:44.921646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254682+0000","last_change":"2023-10-09T11:37:22.254682+0000","last_active":"2023-10-09T11:37:22.254682+0000","last_peered":"2023-10-09T11:37:22.254682+0000","last_clean":"2023-10-09T11:37:22.254682+0000","last_became_active":"2023-10-09T11:37:22.253992+0000","last_became_peered":"2023-10-09T11:37:22.253992+0000","last_unstale":"2023-10-09T11:37:22.254682+0000","last_undegraded":"2023-10-09T11:37:22.254682+0000","last_fullsized":"2023-10-09T11:37:22.254682+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:45.306477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.255839+0000","last_change":"2023-10-09T11:37:21.255776+0000","last_active":"2023-10-09T11:37:21.255839+0000","last_peered":"2023-10-09T11:37:21.255839+0000","last_clean":"2023-10-09T11:37:21.255839+0000","last_became_active":"2023-10-09T11:37:21.255293+0000","last_became_peered":"2023-10-09T11:37:21.255293+0000","last_unstale":"2023-10-09T11:37:21.255839+0000","last_undegraded":"2023-10-09T11:37:21.255839+0000","last_fullsized":"2023-10-09T11:37:21.255839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:23.722031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258624+0000","last_change":"2023-10-09T11:37:22.258624+0000","last_active":"2023-10-09T11:37:22.258624+0000","last_peered":"2023-10-09T11:37:22.258624+0000","last_clean":"2023-10-09T11:37:22.258624+0000","last_became_active":"2023-10-09T11:37:22.258051+0000","last_became_peered":"2023-10-09T11:37:22.258051+0000","last_unstale":"2023-10-09T11:37:22.258624+0000","last_undegraded":"2023-10-09T11:37:22.258624+0000","last_fullsized":"2023-10-09T11:37:22.258624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:12:21.942346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267123+0000","last_change":"2023-10-09T11:37:21.254982+0000","last_active":"2023-10-09T11:37:22.267123+0000","last_peered":"2023-10-09T11:37:22.267123+0000","last_clean":"2023-10-09T11:37:22.267123+0000","last_became_active":"2023-10-09T11:37:21.254396+0000","last_became_peered":"2023-10-09T11:37:21.254396+0000","last_unstale":"2023-10-09T11:37:22.267123+0000","last_undegraded":"2023-10-09T11:37:22.267123+0000","last_fullsized":"2023-10-09T11:37:22.267123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248907+0000","last_change":"2023-10-09T11:37:22.248907+0000","last_active":"2023-10-09T11:37:22.248907+0000","last_peered":"2023-10-09T11:37:22.248907+0000","last_clean":"2023-10-09T11:37:22.248907+0000","last_became_active":"2023-10-09T11:37:22.248687+0000","last_became_peered":"2023-10-09T11:37:22.248687+0000","last_unstale":"2023-10-09T11:37:22.248907+0000","last_undegraded":"2023-10-09T11:37:22.248907+0000","last_fullsized":"2023-10-09T11:37:22.248907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:19.966173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.248090+0000","last_change":"2023-10-09T11:37:21.247910+0000","last_active":"2023-10-09T11:37:21.248090+0000","last_peered":"2023-10-09T11:37:21.248090+0000","last_clean":"2023-10-09T11:37:21.248090+0000","last_became_active":"2023-10-09T11:37:21.247666+0000","last_became_peered":"2023-10-09T11:37:21.247666+0000","last_unstale":"2023-10-09T11:37:21.248090+0000","last_undegraded":"2023-10-09T11:37:21.248090+0000","last_fullsized":"2023-10-09T11:37:21.248090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255026+0000","last_change":"2023-10-09T11:37:22.255026+0000","last_active":"2023-10-09T11:37:22.255026+0000","last_peered":"2023-10-09T11:37:22.255026+0000","last_clean":"2023-10-09T11:37:22.255026+0000","last_became_active":"2023-10-09T11:37:22.254809+0000","last_became_peered":"2023-10-09T11:37:22.254809+0000","last_unstale":"2023-10-09T11:37:22.255026+0000","last_undegraded":"2023-10-09T11:37:22.255026+0000","last_fullsized":"2023-10-09T11:37:22.255026+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:05.021927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.249310+0000","last_change":"2023-10-09T11:37:21.249117+0000","last_active":"2023-10-09T11:37:21.249310+0000","last_peered":"2023-10-09T11:37:21.249310+0000","last_clean":"2023-10-09T11:37:21.249310+0000","last_became_active":"2023-10-09T11:37:21.248616+0000","last_became_peered":"2023-10-09T11:37:21.248616+0000","last_unstale":"2023-10-09T11:37:21.249310+0000","last_undegraded":"2023-10-09T11:37:21.249310+0000","last_fullsized":"2023-10-09T11:37:21.249310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258946+0000","last_change":"2023-10-09T11:37:22.258946+0000","last_active":"2023-10-09T11:37:22.258946+0000","last_peered":"2023-10-09T11:37:22.258946+0000","last_clean":"2023-10-09T11:37:22.258946+0000","last_became_active":"2023-10-09T11:37:22.258635+0000","last_became_peered":"2023-10-09T11:37:22.258635+0000","last_unstale":"2023-10-09T11:37:22.258946+0000","last_undegraded":"2023-10-09T11:37:22.258946+0000","last_fullsized":"2023-10-09T11:37:22.258946+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:33.506947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253660+0000","last_change":"2023-10-09T11:37:21.252737+0000","last_active":"2023-10-09T11:37:21.253660+0000","last_peered":"2023-10-09T11:37:21.253660+0000","last_clean":"2023-10-09T11:37:21.253660+0000","last_became_active":"2023-10-09T11:37:21.252479+0000","last_became_peered":"2023-10-09T11:37:21.252479+0000","last_unstale":"2023-10-09T11:37:21.253660+0000","last_undegraded":"2023-10-09T11:37:21.253660+0000","last_fullsized":"2023-10-09T11:37:21.253660+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:14.904950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.254877+0000","last_change":"2023-10-09T11:37:22.254877+0000","last_active":"2023-10-09T11:37:22.254877+0000","last_peered":"2023-10-09T11:37:22.254877+0000","last_clean":"2023-10-09T11:37:22.254877+0000","last_became_active":"2023-10-09T11:37:22.253604+0000","last_became_peered":"2023-10-09T11:37:22.253604+0000","last_unstale":"2023-10-09T11:37:22.254877+0000","last_undegraded":"2023-10-09T11:37:22.254877+0000","last_fullsized":"2023-10-09T11:37:22.254877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:30.932745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.255200+0000","last_change":"2023-10-09T11:37:21.255141+0000","last_active":"2023-10-09T11:37:21.255200+0000","last_peered":"2023-10-09T11:37:21.255200+0000","last_clean":"2023-10-09T11:37:21.255200+0000","last_became_active":"2023-10-09T11:37:21.254723+0000","last_became_peered":"2023-10-09T11:37:21.254723+0000","last_unstale":"2023-10-09T11:37:21.255200+0000","last_undegraded":"2023-10-09T11:37:21.255200+0000","last_fullsized":"2023-10-09T11:37:21.255200+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:14.904950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.258048+0000","last_change":"2023-10-09T11:37:22.258048+0000","last_active":"2023-10-09T11:37:22.258048+0000","last_peered":"2023-10-09T11:37:22.258048+0000","last_clean":"2023-10-09T11:37:22.258048+0000","last_became_active":"2023-10-09T11:37:22.251290+0000","last_became_peered":"2023-10-09T11:37:22.251290+0000","last_unstale":"2023-10-09T11:37:22.258048+0000","last_undegraded":"2023-10-09T11:37:22.258048+0000","last_fullsized":"2023-10-09T11:37:22.258048+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:38.057619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253769+0000","last_change":"2023-10-09T11:37:21.253719+0000","last_active":"2023-10-09T11:37:21.253769+0000","last_peered":"2023-10-09T11:37:21.253769+0000","last_clean":"2023-10-09T11:37:21.253769+0000","last_became_active":"2023-10-09T11:37:21.253467+0000","last_became_peered":"2023-10-09T11:37:21.253467+0000","last_unstale":"2023-10-09T11:37:21.253769+0000","last_undegraded":"2023-10-09T11:37:21.253769+0000","last_fullsized":"2023-10-09T11:37:21.253769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:56.535006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.256347+0000","last_change":"2023-10-09T11:37:22.256347+0000","last_active":"2023-10-09T11:37:22.256347+0000","last_peered":"2023-10-09T11:37:22.256347+0000","last_clean":"2023-10-09T11:37:22.256347+0000","last_became_active":"2023-10-09T11:37:22.256143+0000","last_became_peered":"2023-10-09T11:37:22.256143+0000","last_unstale":"2023-10-09T11:37:22.256347+0000","last_undegraded":"2023-10-09T11:37:22.256347+0000","last_fullsized":"2023-10-09T11:37:22.256347+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:35:48.586903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.247522+0000","last_change":"2023-10-09T11:37:21.247428+0000","last_active":"2023-10-09T11:37:21.247522+0000","last_peered":"2023-10-09T11:37:21.247522+0000","last_clean":"2023-10-09T11:37:21.247522+0000","last_became_active":"2023-10-09T11:37:21.246519+0000","last_became_peered":"2023-10-09T11:37:21.246519+0000","last_unstale":"2023-10-09T11:37:21.247522+0000","last_undegraded":"2023-10-09T11:37:21.247522+0000","last_fullsized":"2023-10-09T11:37:21.247522+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:06.690517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252009+0000","last_change":"2023-10-09T11:37:22.252009+0000","last_active":"2023-10-09T11:37:22.252009+0000","last_peered":"2023-10-09T11:37:22.252009+0000","last_clean":"2023-10-09T11:37:22.252009+0000","last_became_active":"2023-10-09T11:37:22.251777+0000","last_became_peered":"2023-10-09T11:37:22.251777+0000","last_unstale":"2023-10-09T11:37:22.252009+0000","last_undegraded":"2023-10-09T11:37:22.252009+0000","last_fullsized":"2023-10-09T11:37:22.252009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:20.684432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.253803+0000","last_change":"2023-10-09T11:37:21.253737+0000","last_active":"2023-10-09T11:37:21.253803+0000","last_peered":"2023-10-09T11:37:21.253803+0000","last_clean":"2023-10-09T11:37:21.253803+0000","last_became_active":"2023-10-09T11:37:21.253450+0000","last_became_peered":"2023-10-09T11:37:21.253450+0000","last_unstale":"2023-10-09T11:37:21.253803+0000","last_undegraded":"2023-10-09T11:37:21.253803+0000","last_fullsized":"2023-10-09T11:37:21.253803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:29.280532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.255310+0000","last_change":"2023-10-09T11:37:22.255310+0000","last_active":"2023-10-09T11:37:22.255310+0000","last_peered":"2023-10-09T11:37:22.255310+0000","last_clean":"2023-10-09T11:37:22.255310+0000","last_became_active":"2023-10-09T11:37:22.254923+0000","last_became_peered":"2023-10-09T11:37:22.254923+0000","last_unstale":"2023-10-09T11:37:22.255310+0000","last_undegraded":"2023-10-09T11:37:22.255310+0000","last_fullsized":"2023-10-09T11:37:22.255310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:34.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.254634+0000","last_change":"2023-10-09T11:37:21.254564+0000","last_active":"2023-10-09T11:37:21.254634+0000","last_peered":"2023-10-09T11:37:21.254634+0000","last_clean":"2023-10-09T11:37:21.254634+0000","last_became_active":"2023-10-09T11:37:21.254400+0000","last_became_peered":"2023-10-09T11:37:21.254400+0000","last_unstale":"2023-10-09T11:37:21.254634+0000","last_undegraded":"2023-10-09T11:37:21.254634+0000","last_fullsized":"2023-10-09T11:37:21.254634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:44.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.248009+0000","last_change":"2023-10-09T11:37:22.248009+0000","last_active":"2023-10-09T11:37:22.248009+0000","last_peered":"2023-10-09T11:37:22.248009+0000","last_clean":"2023-10-09T11:37:22.248009+0000","last_became_active":"2023-10-09T11:37:22.247820+0000","last_became_peered":"2023-10-09T11:37:22.247820+0000","last_unstale":"2023-10-09T11:37:22.248009+0000","last_undegraded":"2023-10-09T11:37:22.248009+0000","last_fullsized":"2023-10-09T11:37:22.248009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:15.645024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.247628+0000","last_change":"2023-10-09T11:37:21.247557+0000","last_active":"2023-10-09T11:37:21.247628+0000","last_peered":"2023-10-09T11:37:21.247628+0000","last_clean":"2023-10-09T11:37:21.247628+0000","last_became_active":"2023-10-09T11:37:21.247241+0000","last_became_peered":"2023-10-09T11:37:21.247241+0000","last_unstale":"2023-10-09T11:37:21.247628+0000","last_undegraded":"2023-10-09T11:37:21.247628+0000","last_fullsized":"2023-10-09T11:37:21.247628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:44.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.252648+0000","last_change":"2023-10-09T11:37:22.252648+0000","last_active":"2023-10-09T11:37:22.252648+0000","last_peered":"2023-10-09T11:37:22.252648+0000","last_clean":"2023-10-09T11:37:22.252648+0000","last_became_active":"2023-10-09T11:37:22.252419+0000","last_became_peered":"2023-10-09T11:37:22.252419+0000","last_unstale":"2023-10-09T11:37:22.252648+0000","last_undegraded":"2023-10-09T11:37:22.252648+0000","last_fullsized":"2023-10-09T11:37:22.252648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:15.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.251496+0000","last_change":"2023-10-09T11:37:21.251308+0000","last_active":"2023-10-09T11:37:21.251496+0000","last_peered":"2023-10-09T11:37:21.251496+0000","last_clean":"2023-10-09T11:37:21.251496+0000","last_became_active":"2023-10-09T11:37:21.250469+0000","last_became_peered":"2023-10-09T11:37:21.250469+0000","last_unstale":"2023-10-09T11:37:21.251496+0000","last_undegraded":"2023-10-09T11:37:21.251496+0000","last_fullsized":"2023-10-09T11:37:21.251496+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:15.613631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.251351+0000","last_change":"2023-10-09T11:37:22.251351+0000","last_active":"2023-10-09T11:37:22.251351+0000","last_peered":"2023-10-09T11:37:22.251351+0000","last_clean":"2023-10-09T11:37:22.251351+0000","last_became_active":"2023-10-09T11:37:22.251129+0000","last_became_peered":"2023-10-09T11:37:22.251129+0000","last_unstale":"2023-10-09T11:37:22.251351+0000","last_undegraded":"2023-10-09T11:37:22.251351+0000","last_fullsized":"2023-10-09T11:37:22.251351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:21.236394+0000","last_clean_scrub_stamp":"2023-10-09T11:37:21.236394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:08:15.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-09T11:37:22.267417+0000","last_change":"2023-10-09T11:37:21.246728+0000","last_active":"2023-10-09T11:37:22.267417+0000","last_peered":"2023-10-09T11:37:22.267417+0000","last_clean":"2023-10-09T11:37:22.267417+0000","last_became_active":"2023-10-09T11:37:21.246480+0000","last_became_peered":"2023-10-09T11:37:21.246480+0000","last_unstale":"2023-10-09T11:37:22.267417+0000","last_undegraded":"2023-10-09T11:37:22.267417+0000","last_fullsized":"2023-10-09T11:37:22.267417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:37:20.231297+0000","last_clean_scrub_stamp":"2023-10-09T11:37:20.231297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:38:56.749180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-09T11:37:21.249378+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:37:21.249378+0000","last_peered":"2023-10-09T11:37:21.249378+0000","last_clean":"2023-10-09T11:37:21.249378+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:37:21.249378+0000","last_undegraded":"2023-10-09T11:37:21.249378+0000","last_fullsized":"2023-10-09T11:37:21.249378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194538,"statfs":{"total":200000000,"available":199207422,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.68200000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.71199999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:36:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.7589999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.298,"5min":5.298,"15min":5.298},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.52100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":5.46,"5min":5.46,"15min":5.46},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":5.3949999999999996,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199797810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.373},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208489,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":3.9340000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.69699999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.0060000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199796322,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.246},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:36:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.315},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.378},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":198,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195113,"statfs":{"total":200000000,"available":199796344,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":7.4210000000000003,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":7.4459999999999997,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.274,"5min":5.274,"15min":5.274},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":7.5679999999999996,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.495},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.5460000000000003,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.628}]},{"osd":7,"last update":"Mon Oct 9 11:36:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199797810,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.437}]},{"osd":6,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52700000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:37:26.743 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:37:26.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:37:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.904+0000 7fca7908b700 1 Processor -- start 2023-10-09T11:37:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.904+0000 7fca7908b700 1 -- start start 2023-10-09T11:37:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7908b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca7415abc0 0x7fca740b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7908b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca740b3dd0 con 0x7fca7406ea40 2023-10-09T11:37:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7908b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7406da50 con 0x7fca740cf440 2023-10-09T11:37:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7908b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca740b3780 con 0x7fca7415abc0 2023-10-09T11:37:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca7415abc0 0x7fca740b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca7406ea40 0x7fca7415a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51464/0 (socket says 172.21.15.6:51464) 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.905+0000 7fca7259c700 1 -- 172.21.15.6:0/4228750124 learned_addr learned my addr 172.21.15.6:0/4228750124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca7359e700 1 -- 172.21.15.6:0/4228750124 >> v1:172.21.15.118:6789/0 conn(0x7fca740cf440 legacy=0x7fca740b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca7359e700 1 -- 172.21.15.6:0/4228750124 >> v1:172.21.15.6:6789/0 conn(0x7fca7406ea40 legacy=0x7fca7415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca7359e700 1 -- 172.21.15.6:0/4228750124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740b3a60 con 0x7fca7415abc0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca7359e700 1 --2- 172.21.15.6:0/4228750124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7415abc0 0x7fca740b0590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fca64009e60 tx=0x7fca64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3391582a48bc13 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca71d9b700 1 -- 172.21.15.6:0/4228750124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400e070 con 0x7fca7415abc0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca71d9b700 1 -- 172.21.15.6:0/4228750124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400bc30 con 0x7fca7415abc0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.906+0000 7fca71d9b700 1 -- 172.21.15.6:0/4228750124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64012430 con 0x7fca7415abc0 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 -- 172.21.15.6:0/4228750124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7415abc0 msgr2=0x7fca740b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 --2- 172.21.15.6:0/4228750124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7415abc0 0x7fca740b0590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fca64009e60 tx=0x7fca64009780 comp rx=0 tx=0).stop 2023-10-09T11:37:26.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 -- 172.21.15.6:0/4228750124 shutdown_connections 2023-10-09T11:37:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 --2- 172.21.15.6:0/4228750124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7415abc0 0x7fca740b0590 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 -- 172.21.15.6:0/4228750124 >> 172.21.15.6:0/4228750124 conn(0x7fca7406b530 msgr2=0x7fca74067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 -- 172.21.15.6:0/4228750124 shutdown_connections 2023-10-09T11:37:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.907+0000 7fca7908b700 1 -- 172.21.15.6:0/4228750124 wait complete. 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.908+0000 7fca7908b700 1 Processor -- start 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.908+0000 7fca7908b700 1 -- start start 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca740cf440 0x7fca740cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7415abc0 0x7fca740cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ce0a0 con 0x7fca7406ea40 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c9150 con 0x7fca7415abc0 2023-10-09T11:37:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ce2f0 con 0x7fca740cf440 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37722/0 (socket says 172.21.15.6:37722) 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 -- 172.21.15.6:0/1322094375 learned_addr learned my addr 172.21.15.6:0/1322094375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7359e700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7415abc0 0x7fca740cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7259c700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca740cf440 0x7fca740cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 -- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca740cf440 msgr2=0x7fca740cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca740cf440 0x7fca740cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 -- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7415abc0 msgr2=0x7fca740cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7415abc0 0x7fca740cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 -- 172.21.15.6:0/1322094375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009a20 con 0x7fca7406ea40 2023-10-09T11:37:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca72d9d700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c790 tx=0x7fca6c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011590 con 0x7fca7406ea40 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c011710 con 0x7fca7406ea40 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca740ce5d0 con 0x7fca7406ea40 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011ad0 con 0x7fca7406ea40 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.909+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7415f290 con 0x7fca7406ea40 2023-10-09T11:37:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.910+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca740ceaf0 con 0x7fca7406ea40 2023-10-09T11:37:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.911+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6c01a360 con 0x7fca7406ea40 2023-10-09T11:37:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.911+0000 7fca6affd700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 0x7fca540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.911+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca6c083900 con 0x7fca7406ea40 2023-10-09T11:37:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.911+0000 7fca7259c700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 0x7fca540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.912+0000 7fca7259c700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 0x7fca540693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca74160ea0 tx=0x7fca5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:26.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:26.916+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca740ceaf0 con 0x7fca7406ea40 2023-10-09T11:37:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.186+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fca7415f0f0 con 0x7fca7406ea40 2023-10-09T11:37:27.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.190+0000 7fca6affd700 1 -- 172.21.15.6:0/1322094375 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fca7415f0f0 con 0x7fca7406ea40 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 msgr2=0x7fca540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 0x7fca540693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca74160ea0 tx=0x7fca5c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 msgr2=0x7fca740c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c790 tx=0x7fca6c007f40 comp rx=0 tx=0).stop 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 shutdown_connections 2023-10-09T11:37:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca54066f30 0x7fca540693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca7415abc0 0x7fca740cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7406ea40 0x7fca740c8c10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 --2- 172.21.15.6:0/1322094375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca740cf440 0x7fca740cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 >> 172.21.15.6:0/1322094375 conn(0x7fca7406b530 msgr2=0x7fca740b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 shutdown_connections 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.192+0000 7fca7908b700 1 -- 172.21.15.6:0/1322094375 wait complete. 2023-10-09T11:37:27.194 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:37:27.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.323+0000 7fea6483a700 1 Processor -- start 2023-10-09T11:37:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.323+0000 7fea6483a700 1 -- start start 2023-10-09T11:37:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea6483a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea6015a2a0 0x7fea600b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea6483a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600b0ca0 con 0x7fea600ceb30 2023-10-09T11:37:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea6483a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600b00d0 con 0x7fea6006dd60 2023-10-09T11:37:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea6483a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6006e160 con 0x7fea6015a2a0 2023-10-09T11:37:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fea600ceb30 0x7fea6006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51480/0 (socket says 172.21.15.6:51480) 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5dd9b700 1 -- 172.21.15.6:0/2823456576 learned_addr learned my addr 172.21.15.6:0/2823456576 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5e59c700 1 --2- 172.21.15.6:0/2823456576 >> v2:172.21.15.118:3300/0 conn(0x7fea6015a2a0 0x7fea600b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5d59a700 1 -- 172.21.15.6:0/2823456576 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201504716 0 0) 0x7fea600b0ca0 con 0x7fea600ceb30 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5d59a700 1 -- 172.21.15.6:0/2823456576 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea48003570 con 0x7fea600ceb30 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5e59c700 1 -- 172.21.15.6:0/2823456576 >> v1:172.21.15.118:6789/0 conn(0x7fea6006dd60 legacy=0x7fea600b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5e59c700 1 -- 172.21.15.6:0/2823456576 >> v1:172.21.15.6:6789/0 conn(0x7fea600ceb30 legacy=0x7fea6006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.324+0000 7fea5e59c700 1 -- 172.21.15.6:0/2823456576 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600b0370 con 0x7fea6015a2a0 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea5e59c700 1 --2- 172.21.15.6:0/2823456576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea600b1130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea500098e0 tx=0x7fea500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9bc87dfaa43656 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea5d59a700 1 -- 172.21.15.6:0/2823456576 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000b640 con 0x7fea6015a2a0 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea5d59a700 1 -- 172.21.15.6:0/2823456576 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5000b7a0 con 0x7fea6015a2a0 2023-10-09T11:37:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea5d59a700 1 -- 172.21.15.6:0/2823456576 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5000bb40 con 0x7fea6015a2a0 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 -- 172.21.15.6:0/2823456576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 msgr2=0x7fea600b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 --2- 172.21.15.6:0/2823456576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea600b1130 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fea500098e0 tx=0x7fea500091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 -- 172.21.15.6:0/2823456576 shutdown_connections 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 --2- 172.21.15.6:0/2823456576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea600b1130 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 -- 172.21.15.6:0/2823456576 >> 172.21.15.6:0/2823456576 conn(0x7fea60067640 msgr2=0x7fea60067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 -- 172.21.15.6:0/2823456576 shutdown_connections 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.325+0000 7fea6483a700 1 -- 172.21.15.6:0/2823456576 wait complete. 2023-10-09T11:37:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.326+0000 7fea6483a700 1 Processor -- start 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.326+0000 7fea6483a700 1 -- start start 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea6006dd60 0x7fea601509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea6016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60152d60 con 0x7fea600ceb30 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60153040 con 0x7fea6015a2a0 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea6483a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60153320 con 0x7fea6006dd60 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea5dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea5dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37738/0 (socket says 172.21.15.6:37738) 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea5dd9b700 1 -- 172.21.15.6:0/3795296700 learned_addr learned my addr 172.21.15.6:0/3795296700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea5e59c700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea6006dd60 0x7fea601509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.327+0000 7fea5ed9d700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea6016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 -- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea6006dd60 msgr2=0x7fea601509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea6006dd60 0x7fea601509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 -- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 msgr2=0x7fea6016ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea6016ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 -- 172.21.15.6:0/3795296700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009420 con 0x7fea600ceb30 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea5dd9b700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c7c0 tx=0x7fea54007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54005cd0 con 0x7fea600ceb30 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54005e30 con 0x7fea600ceb30 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54007320 con 0x7fea600ceb30 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea60153600 con 0x7fea600ceb30 2023-10-09T11:37:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.328+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6015d4c0 con 0x7fea600ceb30 2023-10-09T11:37:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.329+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea60153b20 con 0x7fea600ceb30 2023-10-09T11:37:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.329+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea5401b3b0 con 0x7fea600ceb30 2023-10-09T11:37:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.330+0000 7fea4e7fc700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 0x7fea400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.330+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea54083be0 con 0x7fea600ceb30 2023-10-09T11:37:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.330+0000 7fea5e59c700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 0x7fea400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.330+0000 7fea5e59c700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 0x7fea400693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.334+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea60153b20 con 0x7fea600ceb30 2023-10-09T11:37:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.569+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea60153b20 con 0x7fea600ceb30 2023-10-09T11:37:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.570+0000 7fea4e7fc700 1 -- 172.21.15.6:0/3795296700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fea60153b20 con 0x7fea600ceb30 2023-10-09T11:37:27.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:27.570 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 msgr2=0x7fea400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 0x7fea400693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea500093f0 tx=0x7fea50017000 comp rx=0 tx=0).stop 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 msgr2=0x7fea60150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c7c0 tx=0x7fea54007e00 comp rx=0 tx=0).stop 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 shutdown_connections 2023-10-09T11:37:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea40066f30 0x7fea400693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea6015a2a0 0x7fea6016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea6006dd60 0x7fea601509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 --2- 172.21.15.6:0/3795296700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600ceb30 0x7fea60150f10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.571+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 >> 172.21.15.6:0/3795296700 conn(0x7fea60067640 msgr2=0x7fea601582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.572+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 shutdown_connections 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:27.572+0000 7fea6483a700 1 -- 172.21.15.6:0/3795296700 wait complete. 2023-10-09T11:37:27.573 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:27.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:37:21.645715+0000', 'modified': '2023-10-09T11:37:25.271891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5349': {'gid': 5349, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/2630156228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6835', 'nonce': 2630156228}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 2630156228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:37:27.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:37:27.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:37:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.108+0000 7ff705ca9700 1 Processor -- start 2023-10-09T11:37:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.108+0000 7ff705ca9700 1 -- start start 2023-10-09T11:37:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff705ca9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff7000b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff705ca9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff700067640 con 0x7ff7000cf060 2023-10-09T11:37:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff705ca9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000b1e50 con 0x7ff700159bc0 2023-10-09T11:37:28.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff705ca9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff700067890 con 0x7ff700159f90 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff6fffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7000cf060 0x7ff700161920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51488/0 (socket says 172.21.15.6:51488) 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff6fffff700 1 -- 172.21.15.6:0/1272783020 learned_addr learned my addr 172.21.15.6:0/1272783020 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff7054a8700 1 --2- 172.21.15.6:0/1272783020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff7000b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.109+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451511995 0 0) 0x7ff700067640 con 0x7ff7000cf060 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e8003570 con 0x7ff7000cf060 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238090795 0 0) 0x7ff7000b1e50 con 0x7ff700159bc0 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700067640 con 0x7ff700159bc0 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff7054a8700 1 -- 172.21.15.6:0/1272783020 >> v1:172.21.15.118:6789/0 conn(0x7ff700159bc0 legacy=0x7ff7000ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff7054a8700 1 -- 172.21.15.6:0/1272783020 >> v1:172.21.15.6:6789/0 conn(0x7ff7000cf060 legacy=0x7ff700161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff7054a8700 1 -- 172.21.15.6:0/1272783020 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700067b70 con 0x7ff700159f90 2023-10-09T11:37:28.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff7054a8700 1 --2- 172.21.15.6:0/1272783020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff7000b17c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009910 tx=0x7ff6f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c153c5f9c33d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011630 con 0x7ff700159f90 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0011790 con 0x7ff700159f90 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.110+0000 7ff6ff7fe700 1 -- 172.21.15.6:0/1272783020 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011b30 con 0x7ff700159f90 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 -- 172.21.15.6:0/1272783020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 msgr2=0x7ff7000b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 --2- 172.21.15.6:0/1272783020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff7000b17c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009910 tx=0x7ff6f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 -- 172.21.15.6:0/1272783020 shutdown_connections 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 --2- 172.21.15.6:0/1272783020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff7000b17c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 -- 172.21.15.6:0/1272783020 >> 172.21.15.6:0/1272783020 conn(0x7ff70006c620 msgr2=0x7ff70006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 -- 172.21.15.6:0/1272783020 shutdown_connections 2023-10-09T11:37:28.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.111+0000 7ff705ca9700 1 -- 172.21.15.6:0/1272783020 wait complete. 2023-10-09T11:37:28.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.112+0000 7ff705ca9700 1 Processor -- start 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.112+0000 7ff705ca9700 1 -- start start 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff700159bc0 0x7ff700151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff70015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70016b090 con 0x7ff7000cf060 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff700151dc0 con 0x7ff700159bc0 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015cdc0 con 0x7ff700159f90 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37744/0 (socket says 172.21.15.6:37744) 2023-10-09T11:37:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 -- 172.21.15.6:0/2862580477 learned_addr learned my addr 172.21.15.6:0/2862580477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff700159bc0 0x7ff700151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff7054a8700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff70015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 -- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 msgr2=0x7ff70015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff70015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 -- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff700159bc0 msgr2=0x7ff700151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff700159bc0 0x7ff700151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 -- 172.21.15.6:0/2862580477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009420 con 0x7ff7000cf060 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800cb40 tx=0x7ff6f8002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff6fcff9700 1 -- 172.21.15.6:0/2862580477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800ce50 con 0x7ff7000cf060 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff6fcff9700 1 -- 172.21.15.6:0/2862580477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f800a7a0 con 0x7ff7000cf060 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.113+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7000afcc0 con 0x7ff7000cf060 2023-10-09T11:37:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.114+0000 7ff6fcff9700 1 -- 172.21.15.6:0/2862580477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800ab60 con 0x7ff7000cf060 2023-10-09T11:37:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.114+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70015cae0 con 0x7ff7000cf060 2023-10-09T11:37:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.115+0000 7ff6fcff9700 1 -- 172.21.15.6:0/2862580477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6f8012420 con 0x7ff7000cf060 2023-10-09T11:37:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.115+0000 7ff6fcff9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 0x7ff6ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.115+0000 7ff6fcff9700 1 -- 172.21.15.6:0/2862580477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6f80847e0 con 0x7ff7000cf060 2023-10-09T11:37:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.115+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 0x7ff6ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.116+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 0x7ff6ec0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ce250 tx=0x7ff6f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.117+0000 7ff710203b80 1 Processor -- start 2023-10-09T11:37:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.117+0000 7ff710203b80 1 -- start start 2023-10-09T11:37:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d318a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d313fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d3096a70 con 0x5595d318a480 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d3094270 con 0x5595d313d5f0 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595d3090060 con 0x5595d313fb80 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37756/0 (socket says 172.21.15.6:37756) 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 -- 172.21.15.6:0/2570332405 learned_addr learned my addr 172.21.15.6:0/2570332405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d318a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff7054a8700 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d313fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 -- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 msgr2=0x5595d313fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d313fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 -- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 msgr2=0x5595d318a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d318a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 -- 172.21.15.6:0/2570332405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595d2f2a270 con 0x5595d318a480 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.118+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8082c60 tx=0x7ff6f8082bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24fd042e2a74076 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff6e5ffb700 1 -- 172.21.15.6:0/2570332405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8055670 con 0x5595d318a480 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff6e5ffb700 1 -- 172.21.15.6:0/2570332405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80588c0 con 0x5595d318a480 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff6e5ffb700 1 -- 172.21.15.6:0/2570332405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f805c610 con 0x5595d318a480 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 -- 172.21.15.6:0/2570332405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 msgr2=0x5595d31697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8082c60 tx=0x7ff6f8082bc0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 -- 172.21.15.6:0/2570332405 shutdown_connections 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d313fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d31697d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 --2- 172.21.15.6:0/2570332405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d318a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 -- 172.21.15.6:0/2570332405 >> 172.21.15.6:0/2570332405 conn(0x5595d31410c0 msgr2=0x5595d31418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 -- 172.21.15.6:0/2570332405 shutdown_connections 2023-10-09T11:37:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.119+0000 7ff710203b80 1 -- 172.21.15.6:0/2570332405 wait complete. 2023-10-09T11:37:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.120+0000 7ff710203b80 1 -- start start 2023-10-09T11:37:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.120+0000 7ff710203b80 1 Processor -- start 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3186270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d303b890 con 0x5595d313fb80 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d3056ea0 con 0x5595d313d5f0 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595d2f12e30 con 0x5595d318a480 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff710203b80 10 client.0 _ll_register_callbacks cb 0x5595d31032c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37760/0 (socket says 172.21.15.6:37760) 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 -- 172.21.15.6:0/3546179120 learned_addr learned my addr 172.21.15.6:0/3546179120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff704ca7700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3186270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff7054a8700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 -- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 msgr2=0x5595d31877e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31877e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 -- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 msgr2=0x5595d3186270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3186270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.121+0000 7ff6fffff700 1 -- 172.21.15.6:0/3546179120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70015cae0 con 0x5595d313fb80 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6fffff700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4014750 tx=0x7ff6f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c89d0fa2600db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400fec0 con 0x5595d313fb80 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6f401c040 con 0x5595d313fb80 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595d3134cd0 con 0x5595d313fb80 2023-10-09T11:37:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f4021610 con 0x5595d313fb80 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 10 client.5475 fetch_fsmap learned FSMap version 26 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5595d2eccfe0 con 0x5595d313fb80 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595d3134cd0 con 0x5595d313fb80 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff6f4021770 con 0x5595d313fb80 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 10 client.5475 fetch_fsmap finished waiting for FSMap version 26 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 10 client.5475 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 20 client.5475 populate_metadata read hostname 'smithi006' 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d3169bf0 0x5595d3169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 4 client.5475 mds_command: new command op to 5349 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 --> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595d3111aa0 con 0x5595d3169bf0 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.122+0000 7ff704ca7700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d3169bf0 0x5595d3169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff6deffd700 10 client.5475 ms_handle_connect on v2:172.21.15.6:6835/2630156228 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff704ca7700 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d3169bf0 0x5595d3169fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26c2f85af9a756b server_cookie=f81e744e4e559ad6 in_seq=0 out_seq=0 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff6deffd700 1 -- 172.21.15.6:0/3546179120 <== mds.0 v2:172.21.15.6:6835/2630156228 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5595d3111aa0 con 0x5595d3169bf0 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff6deffd700 10 client.5475 handle_command_reply: tid=0 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 client.5475 shutdown 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 msgr2=0x5595d31872a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4014750 tx=0x7ff6f4015000 comp rx=0 tx=0).stop 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 shutdown_connections 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d3169bf0 0x5595d3169fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3186270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff6deffd700 0 client.5475 ms_handle_reset on v2:172.21.15.6:6835/2630156228 2023-10-09T11:37:28.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.123+0000 7ff710203b80 1 --2- 172.21.15.6:0/3546179120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313fb80 0x5595d31872a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.124+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 >> 172.21.15.6:0/3546179120 conn(0x5595d31410c0 msgr2=0x5595d313fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.124+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 shutdown_connections 2023-10-09T11:37:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.124+0000 7ff710203b80 1 -- 172.21.15.6:0/3546179120 wait complete. 2023-10-09T11:37:28.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.124+0000 7ff710203b80 20 client.5475 trim_cache size 0 max 16384 2023-10-09T11:37:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.140+0000 7ff710203b80 1 Processor -- start 2023-10-09T11:37:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.140+0000 7ff710203b80 1 -- start start 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313fb80 0x5595d313cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d313ed50 con 0x5595d313d5f0 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d31374e0 con 0x5595d313fb80 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595d3189ea0 con 0x5595d318a480 2023-10-09T11:37:28.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37772/0 (socket says 172.21.15.6:37772) 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 -- 172.21.15.6:0/2447291197 learned_addr learned my addr 172.21.15.6:0/2447291197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 -- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 msgr2=0x5595d31872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313fb80 0x5595d313cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 -- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313fb80 msgr2=0x5595d313cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.141+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313fb80 0x5595d313cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff704ca7700 1 -- 172.21.15.6:0/2447291197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595d305e780 con 0x5595d313d5f0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8055290 tx=0x7ff6f806d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365304542f3738f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff6e67fc700 1 -- 172.21.15.6:0/2447291197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80519b0 con 0x5595d313d5f0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff6e67fc700 1 -- 172.21.15.6:0/2447291197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f805c610 con 0x5595d313d5f0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff6e67fc700 1 -- 172.21.15.6:0/2447291197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8071270 con 0x5595d313d5f0 2023-10-09T11:37:28.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 -- 172.21.15.6:0/2447291197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 msgr2=0x5595d3141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8055290 tx=0x7ff6f806d000 comp rx=0 tx=0).stop 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 -- 172.21.15.6:0/2447291197 shutdown_connections 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d318a480 0x5595d31872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d313d5f0 0x5595d3141490 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 --2- 172.21.15.6:0/2447291197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313fb80 0x5595d313cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 -- 172.21.15.6:0/2447291197 >> 172.21.15.6:0/2447291197 conn(0x5595d31410c0 msgr2=0x5595d318a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 -- 172.21.15.6:0/2447291197 shutdown_connections 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.142+0000 7ff710203b80 1 -- 172.21.15.6:0/2447291197 wait complete. 2023-10-09T11:37:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.143+0000 7ff710203b80 1 -- start start 2023-10-09T11:37:28.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.143+0000 7ff710203b80 1 Processor -- start 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3164d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d3165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d31ec6b0 con 0x5595d318a480 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595d31a2c60 con 0x5595d313d5f0 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595d31a3500 con 0x5595d313fb80 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff710203b80 10 client.0 _ll_register_callbacks cb 0x5595d31032c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37776/0 (socket says 172.21.15.6:37776) 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 -- 172.21.15.6:0/2319655369 learned_addr learned my addr 172.21.15.6:0/2319655369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff6fffff700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d3165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 -- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 msgr2=0x5595d3165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d3165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 -- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 msgr2=0x5595d3164d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3164d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 -- 172.21.15.6:0/2319655369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595d2f2a270 con 0x5595d318a480 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff7054a8700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009f00 tx=0x7ff6f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ea5d57cb841435 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.144+0000 7ff6deffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f001f040 con 0x5595d318a480 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6f80588c0 con 0x5595d318a480 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6f001a800 con 0x5595d318a480 2023-10-09T11:37:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f001abd0 con 0x5595d318a480 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 10 client.5481 fetch_fsmap learned FSMap version 26 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5595d3045470 con 0x5595d318a480 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80588c0 con 0x5595d318a480 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff6f0009940 con 0x5595d318a480 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 10 client.5481 fetch_fsmap finished waiting for FSMap version 26 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 10 client.5481 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 20 client.5481 populate_metadata read hostname 'smithi006' 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d319ffa0 0x5595d31eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 4 client.5481 mds_command: new command op to 5349 tid=0[{"prefix": "status"}] 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 --> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5595d3032e00 con 0x5595d319ffa0 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d319ffa0 0x5595d31eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff704ca7700 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d319ffa0 0x5595d31eaf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e572d5be9696020f server_cookie=ab7fed070947d621 in_seq=0 out_seq=0 2023-10-09T11:37:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.145+0000 7ff6deffd700 10 client.5481 ms_handle_connect on v2:172.21.15.6:6835/2630156228 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff6deffd700 1 -- 172.21.15.6:0/2319655369 <== mds.0 v2:172.21.15.6:6835/2630156228 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5595d3032e00 con 0x5595d319ffa0 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff6deffd700 10 client.5481 handle_command_reply: tid=0 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 client.5481 shutdown 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 msgr2=0x5595d319f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009f00 tx=0x7ff6f0017000 comp rx=0 tx=0).stop 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 shutdown_connections 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5595d318a480 0x5595d319f5a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5595d313d5f0 0x5595d3164d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.6:6835/2630156228,v1:172.21.15.6:6837/2630156228] conn(0x5595d319ffa0 0x5595d31eaf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 --2- 172.21.15.6:0/2319655369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5595d313fb80 0x5595d3165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 >> 172.21.15.6:0/2319655369 conn(0x5595d31410c0 msgr2=0x5595d3141490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff6deffd700 0 client.5481 ms_handle_reset on v2:172.21.15.6:6835/2630156228 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 shutdown_connections 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 1 -- 172.21.15.6:0/2319655369 wait complete. 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff710203b80 20 client.5481 trim_cache size 0 max 16384 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:37:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5349, 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8863746990000001, 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 44, 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 44, 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.821402454999999 2023-10-09T11:37:28.154 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 msgr2=0x7ff6ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 0x7ff6ec0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ce250 tx=0x7ff6f4009040 comp rx=0 tx=0).stop 2023-10-09T11:37:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 msgr2=0x7ff700151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800cb40 tx=0x7ff6f8002820 comp rx=0 tx=0).stop 2023-10-09T11:37:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 shutdown_connections 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ec066f30 0x7ff6ec0693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff700159f90 0x7ff70015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7000cf060 0x7ff700151f30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 --2- 172.21.15.6:0/2862580477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff700159bc0 0x7ff700151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.146+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 >> 172.21.15.6:0/2862580477 conn(0x7ff70006c620 msgr2=0x7ff7001571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.147+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 shutdown_connections 2023-10-09T11:37:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.147+0000 7ff705ca9700 1 -- 172.21.15.6:0/2862580477 wait complete. 2023-10-09T11:37:28.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:28.235 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-09T11:37:28.235+0000 7f8891961700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:37:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.277+0000 7f1d3bea8700 1 Processor -- start 2023-10-09T11:37:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.277+0000 7f1d3bea8700 1 -- start start 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d3bea8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d341578d0 0x7f1d340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d3bea8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340d07c0 con 0x7f1d34157ca0 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d3bea8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340cfbb0 con 0x7f1d3406d120 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d3bea8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340cfe90 con 0x7f1d341578d0 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d39443700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d34157ca0 0x7f1d3415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51494/0 (socket says 172.21.15.6:51494) 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.278+0000 7f1d39443700 1 -- 172.21.15.6:0/2399326093 learned_addr learned my addr 172.21.15.6:0/2399326093 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d39c44700 1 --2- 172.21.15.6:0/2399326093 >> v2:172.21.15.118:3300/0 conn(0x7f1d341578d0 0x7f1d340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645886114 0 0) 0x7f1d340d07c0 con 0x7f1d34157ca0 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1c003570 con 0x7f1d34157ca0 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d39c44700 1 -- 172.21.15.6:0/2399326093 >> v1:172.21.15.118:6789/0 conn(0x7f1d3406d120 legacy=0x7f1d3406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d39c44700 1 -- 172.21.15.6:0/2399326093 >> v1:172.21.15.6:6789/0 conn(0x7f1d34157ca0 legacy=0x7f1d3415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914021511 0 0) 0x7f1d340cfbb0 con 0x7f1d3406d120 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d39c44700 1 -- 172.21.15.6:0/2399326093 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340d0170 con 0x7f1d341578d0 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d39c44700 1 --2- 172.21.15.6:0/2399326093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d341578d0 0x7f1d340cf4f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009e60 tx=0x7f1d24009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a075ca9aa8f689 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400e070 con 0x7f1d341578d0 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2400bb60 con 0x7f1d341578d0 2023-10-09T11:37:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.279+0000 7f1d38c42700 1 -- 172.21.15.6:0/2399326093 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24012430 con 0x7f1d341578d0 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 -- 172.21.15.6:0/2399326093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d341578d0 msgr2=0x7f1d340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/2399326093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d341578d0 0x7f1d340cf4f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009e60 tx=0x7f1d24009780 comp rx=0 tx=0).stop 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 -- 172.21.15.6:0/2399326093 shutdown_connections 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/2399326093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d341578d0 0x7f1d340cf4f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 -- 172.21.15.6:0/2399326093 >> 172.21.15.6:0/2399326093 conn(0x7f1d3406bb90 msgr2=0x7f1d3406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 -- 172.21.15.6:0/2399326093 shutdown_connections 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.280+0000 7f1d3bea8700 1 -- 172.21.15.6:0/2399326093 wait complete. 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.281+0000 7f1d3bea8700 1 Processor -- start 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.281+0000 7f1d3bea8700 1 -- start start 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 0x7f1d34154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d34157ca0 0x7f1d340ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340ae420 con 0x7f1d341578d0 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341553f0 con 0x7f1d34157ca0 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340b4dc0 con 0x7f1d3406d120 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37786/0 (socket says 172.21.15.6:37786) 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 -- 172.21.15.6:0/3197974129 learned_addr learned my addr 172.21.15.6:0/3197974129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3a445700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d34157ca0 0x7f1d340ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39c44700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 0x7f1d34154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 -- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 msgr2=0x7f1d34154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 0x7f1d34154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 -- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d34157ca0 msgr2=0x7f1d340ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d34157ca0 0x7f1d340ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 -- 172.21.15.6:0/3197974129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d24009a20 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39c44700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 0x7f1d34154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d39443700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c590 tx=0x7f1d28007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28005c00 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28005d60 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d340b50a0 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.282+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28007300 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.283+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d340b5660 con 0x7f1d341578d0 2023-10-09T11:37:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.283+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34067ac0 con 0x7f1d341578d0 2023-10-09T11:37:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.284+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d2801b3b0 con 0x7f1d341578d0 2023-10-09T11:37:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.284+0000 7f1d31ffb700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.284+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d28083910 con 0x7f1d341578d0 2023-10-09T11:37:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.284+0000 7f1d39c44700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.285+0000 7f1d39c44700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d240099f0 tx=0x7f1d24019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.289+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d28050b80 con 0x7f1d341578d0 2023-10-09T11:37:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.528+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d340d0450 con 0x7f1d341578d0 2023-10-09T11:37:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.528+0000 7f1d31ffb700 1 -- 172.21.15.6:0/3197974129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d28017020 con 0x7f1d341578d0 2023-10-09T11:37:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 msgr2=0x7f1d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d240099f0 tx=0x7f1d24019000 comp rx=0 tx=0).stop 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 msgr2=0x7f1d340b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c590 tx=0x7f1d28007d90 comp rx=0 tx=0).stop 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 shutdown_connections 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d34157ca0 0x7f1d340ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3406d120 0x7f1d34154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 --2- 172.21.15.6:0/3197974129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d341578d0 0x7f1d340b5e60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 >> 172.21.15.6:0/3197974129 conn(0x7f1d3406bb90 msgr2=0x7f1d34155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 shutdown_connections 2023-10-09T11:37:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:28.530+0000 7f1d3bea8700 1 -- 172.21.15.6:0/3197974129 wait complete. 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:28.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:28.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:28.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:28.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:28.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.544 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:37:28.562 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:28.562 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:28.563 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:28.564 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:37:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:28.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.566 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:28.626 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:37:28.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.628 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:37:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:37:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:37:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:37:28.685 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:28.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:37:28.685 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:37:28.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.787 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:37:28.801 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:37:28.801 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:37:28.802 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:28.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:28.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:37:28.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:28.867 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:37:28.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:28.923 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:28.978 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:37:28.978 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:28.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:29.059 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:29.059 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:29.079 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:29.079 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:29.079 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:29.100 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:29.101 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:37:29.101 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:37:29.101 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:37:29.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:29.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:29.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:37:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.328+0000 7f44c669d700 1 Processor -- start 2023-10-09T11:37:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.328+0000 7f44c669d700 1 -- start start 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c669d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c0159b40 0x7f44c00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c669d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159f10 0x7f44c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c669d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c00cee10 con 0x7f44c00ccb40 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c669d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c00cd040 con 0x7f44c0159b40 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c669d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00cd320 con 0x7f44c0159f10 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c0159b40 0x7f44c00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44c0159b40 0x7f44c00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37796/0 (socket says 172.21.15.6:37796) 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 -- 172.21.15.6:0/2597663253 learned_addr learned my addr 172.21.15.6:0/2597663253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c5e9c700 1 --1- 172.21.15.6:0/2597663253 >> v1:172.21.15.118:6789/0 conn(0x7f44c00ccb40 0x7f44c015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:51776/0 (socket says 172.21.15.6:51776) 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c4e9a700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159f10 0x7f44c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 -- 172.21.15.6:0/2597663253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159f10 msgr2=0x7f44c0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159f10 0x7f44c0068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 -- 172.21.15.6:0/2597663253 >> v1:172.21.15.118:6789/0 conn(0x7f44c00ccb40 legacy=0x7f44c015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.329+0000 7f44c569b700 1 -- 172.21.15.6:0/2597663253 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00ce7c0 con 0x7f44c0159b40 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c569b700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159b40 0x7f44c00cc600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305219097a8bce1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44b7fff700 1 -- 172.21.15.6:0/2597663253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc009ea0 con 0x7f44c0159b40 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44b7fff700 1 -- 172.21.15.6:0/2597663253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00b860 con 0x7f44c0159b40 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44b7fff700 1 -- 172.21.15.6:0/2597663253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00bc00 con 0x7f44c0159b40 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 -- 172.21.15.6:0/2597663253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159b40 msgr2=0x7f44c00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159b40 0x7f44c00cc600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc009250 comp rx=0 tx=0).stop 2023-10-09T11:37:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 -- 172.21.15.6:0/2597663253 shutdown_connections 2023-10-09T11:37:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159b40 0x7f44c00cc600 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 --2- 172.21.15.6:0/2597663253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159f10 0x7f44c0068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 -- 172.21.15.6:0/2597663253 >> 172.21.15.6:0/2597663253 conn(0x7f44c00cd660 msgr2=0x7f44c00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 -- 172.21.15.6:0/2597663253 shutdown_connections 2023-10-09T11:37:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.330+0000 7f44c669d700 1 -- 172.21.15.6:0/2597663253 wait complete. 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.331+0000 7f44c669d700 1 Processor -- start 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 -- start start 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 0x7f44c00ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159b40 0x7f44c0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0158c90 con 0x7f44c0159f10 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c01583f0 con 0x7f44c00ccb40 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c669d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c01586d0 con 0x7f44c0159b40 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.332+0000 7f44c5e9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37800/0 (socket says 172.21.15.6:37800) 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 -- 172.21.15.6:0/1462887104 learned_addr learned my addr 172.21.15.6:0/1462887104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c4e9a700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159b40 0x7f44c0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c569b700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 0x7f44c00ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 -- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159b40 msgr2=0x7f44c0157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159b40 0x7f44c0157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 -- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 msgr2=0x7f44c00ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 0x7f44c00ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 -- 172.21.15.6:0/1462887104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0094f0 con 0x7f44c0159f10 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c569b700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 0x7f44c00ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c5e9c700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cd00 tx=0x7f44b8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8005df0 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800a960 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c01589b0 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800ad00 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.333+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0158100 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.334+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c015a9d0 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.335+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44b8007300 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.335+0000 7f44b57fa700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 0x7f44a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.335+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44b8084650 con 0x7f44c0159f10 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.335+0000 7f44c569b700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 0x7f44a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.335+0000 7f44c569b700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 0x7f44a40693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.339+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44c015a9d0 con 0x7f44c0159f10 2023-10-09T11:37:29.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.578+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44c015a9a0 con 0x7f44c0159f10 2023-10-09T11:37:29.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.578+0000 7f44b57fa700 1 -- 172.21.15.6:0/1462887104 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f44b8051940 con 0x7f44c0159f10 2023-10-09T11:37:29.581 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:37:29.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 msgr2=0x7f44a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 0x7f44a40693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0099b0 tx=0x7f44bc017000 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 msgr2=0x7f44c00c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cd00 tx=0x7f44b8001b10 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 shutdown_connections 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f44a4066f30 0x7f44a40693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c0159f10 0x7f44c00c8e20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00ccb40 0x7f44c00ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 --2- 172.21.15.6:0/1462887104 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c0159b40 0x7f44c0157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 >> 172.21.15.6:0/1462887104 conn(0x7f44c00cd660 msgr2=0x7f44c00c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 shutdown_connections 2023-10-09T11:37:29.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:29.580+0000 7f44c669d700 1 -- 172.21.15.6:0/1462887104 wait complete. 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:37:29.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:29.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.594 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:37:29.612 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:37:29.612 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:37:29.612 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:37:29.612 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.612 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:37:29.613 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42425sec preferred_lft 42425sec 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:37:29.614 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:37:29.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.615 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:37:29.680 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:37:29.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.681 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:37:29.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:37:29.740 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:37:29.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.844 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:37:29.859 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:37:29.859 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:37:29.860 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:29.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:37:29.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:29.924 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:29.979 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:37:29.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:37:29.979 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:30.033 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:37:30.033 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:37:30.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:30.112 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:30.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:30.131 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:30.131 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:30.131 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:30.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:30.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:30.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:30.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:30.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:30.153 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:37:30.153 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:37:30.153 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:37:30.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:37:30.156 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:37:30.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:30.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:30.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.343+0000 7f599cf8f700 1 Processor -- start 2023-10-09T11:37:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.343+0000 7f599cf8f700 1 -- start start 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59981578d0 0x7f59980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5998157ca0 0x7f599815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f599806d120 0x7f599806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599806dac0 con 0x7f59981578d0 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980d07c0 con 0x7f599806d120 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599cf8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cfbb0 con 0x7f5998157ca0 2023-10-09T11:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59981578d0 0x7f59980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59981578d0 0x7f59980cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37816/0 (socket says 172.21.15.6:37816) 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f599659c700 1 -- 172.21.15.6:0/1693576069 learned_addr learned my addr 172.21.15.6:0/1693576069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f5995d9b700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5998157ca0 0x7f599815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.344+0000 7f5996d9d700 1 --2- 172.21.15.6:0/1693576069 >> v2:172.21.15.118:3300/0 conn(0x7f599806d120 0x7f599806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 -- 172.21.15.6:0/1693576069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5998157ca0 msgr2=0x7f599815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5998157ca0 0x7f599815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 -- 172.21.15.6:0/1693576069 >> v2:172.21.15.118:3300/0 conn(0x7f599806d120 msgr2=0x7f599806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 --2- 172.21.15.6:0/1693576069 >> v2:172.21.15.118:3300/0 conn(0x7f599806d120 0x7f599806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 -- 172.21.15.6:0/1693576069 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980cfe90 con 0x7f59981578d0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599659c700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59981578d0 0x7f59980cf4f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f59980b3940 tx=0x7f5988009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baed5200f9930438 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599559a700 1 -- 172.21.15.6:0/1693576069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800e070 con 0x7f59981578d0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599559a700 1 -- 172.21.15.6:0/1693576069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800b970 con 0x7f59981578d0 2023-10-09T11:37:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599559a700 1 -- 172.21.15.6:0/1693576069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880092e0 con 0x7f59981578d0 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 -- 172.21.15.6:0/1693576069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59981578d0 msgr2=0x7f59980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59981578d0 0x7f59980cf4f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f59980b3940 tx=0x7f5988009840 comp rx=0 tx=0).stop 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 -- 172.21.15.6:0/1693576069 shutdown_connections 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 --2- 172.21.15.6:0/1693576069 >> v2:172.21.15.118:3300/0 conn(0x7f599806d120 0x7f599806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59981578d0 0x7f59980cf4f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.345+0000 7f599cf8f700 1 --2- 172.21.15.6:0/1693576069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5998157ca0 0x7f599815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.346+0000 7f599cf8f700 1 -- 172.21.15.6:0/1693576069 >> 172.21.15.6:0/1693576069 conn(0x7f599806bb90 msgr2=0x7f599806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.346+0000 7f599cf8f700 1 -- 172.21.15.6:0/1693576069 shutdown_connections 2023-10-09T11:37:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.346+0000 7f599cf8f700 1 -- 172.21.15.6:0/1693576069 wait complete. 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 Processor -- start 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 -- start start 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 0x7f599816a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 0x7f5998068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980ca790 con 0x7f599806d120 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980b3470 con 0x7f5998157ca0 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.347+0000 7f599cf8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980c5b20 con 0x7f59981578d0 2023-10-09T11:37:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37832/0 (socket says 172.21.15.6:37832) 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 -- 172.21.15.6:0/3699018265 learned_addr learned my addr 172.21.15.6:0/3699018265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f5995d9b700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 0x7f599816a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 -- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 msgr2=0x7f599816a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f5996d9d700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 0x7f5998068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 0x7f599816a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 -- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 msgr2=0x7f5998068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 0x7f5998068ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 -- 172.21.15.6:0/3699018265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009ae0 con 0x7f599806d120 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f5995d9b700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 0x7f599816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f5996d9d700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 0x7f5998068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599659c700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f598800b610 tx=0x7f5988018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988008950 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988008ad0 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980c60e0 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988008e90 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.348+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599816b1c0 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.349+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998067ac0 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.350+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5988003040 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.350+0000 7f598e7fc700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.350+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59880861e0 con 0x7f599806d120 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.350+0000 7f5995d9b700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.350+0000 7f5995d9b700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5980006f00 tx=0x7f5980008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.354+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5988053450 con 0x7f599806d120 2023-10-09T11:37:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.594+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59980d0170 con 0x7f599806d120 2023-10-09T11:37:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.595+0000 7f598e7fc700 1 -- 172.21.15.6:0/3699018265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5988056a70 con 0x7f599806d120 2023-10-09T11:37:30.596 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:30.596 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 msgr2=0x7f59780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5980006f00 tx=0x7f5980008040 comp rx=0 tx=0).stop 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 msgr2=0x7f59980c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f598800b610 tx=0x7f5988018000 comp rx=0 tx=0).stop 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 shutdown_connections 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5998157ca0 0x7f5998068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599806d120 0x7f59980c6570 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 --2- 172.21.15.6:0/3699018265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59981578d0 0x7f599816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 >> 172.21.15.6:0/3699018265 conn(0x7f599806bb90 msgr2=0x7f599815a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 shutdown_connections 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:30.597+0000 7f599cf8f700 1 -- 172.21.15.6:0/3699018265 wait complete. 2023-10-09T11:37:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:30.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:37:30.748 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":5349,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4783391659999996,"mdsmap_epoch":26,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":13.413369439} 2023-10-09T11:37:30.748 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 5349, "mdsmap_epoch": 26, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 8.478339166, "state": "up:active", "uptime": 13.413369439, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:37:30.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:37:30.883 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:37:30.883 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:37:30.884 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-09T11:37:30.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:30.884 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-09T11:37:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:265+0 records in 2023-10-09T11:37:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:265+0 records out 2023-10-09T11:37:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.38736 s, 200 MB/s 2023-10-09T11:37:32.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:32.290 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-09T11:37:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:292+0 records in 2023-10-09T11:37:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:292+0 records out 2023-10-09T11:37:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.52925 s, 200 MB/s 2023-10-09T11:37:33.837 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T11:37:33.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:33.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:33.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:37:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.955+0000 7fbe29ff0700 1 Processor -- start 2023-10-09T11:37:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.955+0000 7fbe29ff0700 1 -- start start 2023-10-09T11:37:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe29ff0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe2406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe29ff0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe2406e770 0x7fbe240cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe29ff0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe240b2290 con 0x7fbe241569e0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe29ff0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2406ebf0 con 0x7fbe2406e770 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe29ff0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24157c00 con 0x7fbe24156db0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe237fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe241569e0 0x7fbe240b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59960/0 (socket says 172.21.15.6:59960) 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe237fe700 1 -- 172.21.15.6:0/50035264 learned_addr learned my addr 172.21.15.6:0/50035264 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe1bfff700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe2406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe23fff700 1 --2- 172.21.15.6:0/50035264 >> v2:172.21.15.118:3300/0 conn(0x7fbe2406e770 0x7fbe240cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe22ffd700 1 -- 172.21.15.6:0/50035264 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948817202 0 0) 0x7fbe240b2290 con 0x7fbe241569e0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.956+0000 7fbe22ffd700 1 -- 172.21.15.6:0/50035264 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe10003570 con 0x7fbe241569e0 2023-10-09T11:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe23fff700 1 -- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 msgr2=0x7fbe2406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe23fff700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe2406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe23fff700 1 -- 172.21.15.6:0/50035264 >> v1:172.21.15.6:6789/0 conn(0x7fbe241569e0 legacy=0x7fbe240b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe23fff700 1 -- 172.21.15.6:0/50035264 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe241572d0 con 0x7fbe2406e770 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe23fff700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe240cd920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009e60 tx=0x7fbe1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7aa8cec9d925ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe22ffd700 1 -- 172.21.15.6:0/50035264 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00e070 con 0x7fbe2406e770 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe22ffd700 1 -- 172.21.15.6:0/50035264 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00bab0 con 0x7fbe2406e770 2023-10-09T11:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.957+0000 7fbe22ffd700 1 -- 172.21.15.6:0/50035264 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00be70 con 0x7fbe2406e770 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 -- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 msgr2=0x7fbe240cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe240cd920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009e60 tx=0x7fbe1c009780 comp rx=0 tx=0).stop 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 -- 172.21.15.6:0/50035264 shutdown_connections 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe240cd920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/50035264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe2406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 -- 172.21.15.6:0/50035264 >> 172.21.15.6:0/50035264 conn(0x7fbe2406cca0 msgr2=0x7fbe2406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 -- 172.21.15.6:0/50035264 shutdown_connections 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.958+0000 7fbe29ff0700 1 -- 172.21.15.6:0/50035264 wait complete. 2023-10-09T11:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 Processor -- start 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 -- start start 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe24152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe241585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24159810 con 0x7fbe241569e0 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2415cfa0 con 0x7fbe2406e770 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.959+0000 7fbe29ff0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe24158c00 con 0x7fbe24156db0 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58964/0 (socket says 172.21.15.6:58964) 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 -- 172.21.15.6:0/2715757009 learned_addr learned my addr 172.21.15.6:0/2715757009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe237fe700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe24152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe23fff700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe241585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 -- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 msgr2=0x7fbe241585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe241585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 -- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 msgr2=0x7fbe24152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe24152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 -- 172.21.15.6:0/2715757009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009a20 con 0x7fbe241569e0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe237fe700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe24152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1bfff700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00e930 tx=0x7fbe0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00eed0 con 0x7fbe241569e0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00c850 con 0x7fbe241569e0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00cc10 con 0x7fbe241569e0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24158ee0 con 0x7fbe241569e0 2023-10-09T11:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.960+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe241594a0 con 0x7fbe241569e0 2023-10-09T11:37:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.961+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe24068900 con 0x7fbe241569e0 2023-10-09T11:37:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.962+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe0c013470 con 0x7fbe241569e0 2023-10-09T11:37:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.962+0000 7fbe1b7fe700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.962+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe0c0846f0 con 0x7fbe241569e0 2023-10-09T11:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.962+0000 7fbe237fe700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.962+0000 7fbe237fe700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 0x7fbe040693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbe140058d0 tx=0x7fbe14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:33.966+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe0c051960 con 0x7fbe241569e0 2023-10-09T11:37:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.159+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbe241575b0 con 0x7fbe241569e0 2023-10-09T11:37:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.160+0000 7fbe1b7fe700 1 -- 172.21.15.6:0/2715757009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) v1 ==== 81+0+32212 (secure 0 0 0) 0x7fbe0c054f80 con 0x7fbe241569e0 2023-10-09T11:37:34.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 44, 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:23.242212+0000", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:34.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:34.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:34.165 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:34.166 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "16", 2023-10-09T11:37:34.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:34.171 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:34.172 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:34.173 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "43", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:34.174 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:34.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:34.176 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:34.177 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:34.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:34.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "44", 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:34.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:34.181 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:34.182 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:34.183 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.184 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.185 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:34.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.192 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:34.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:34.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.198 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.204 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.210 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.211 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.213 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.217 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.224 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:34.228 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.230 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:34.231 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:34.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:34.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.238 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.239 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.240 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.242 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:34.243 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:34.244 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:34.245 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:34.246 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 msgr2=0x7fbe040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 0x7fbe040693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbe140058d0 tx=0x7fbe14009040 comp rx=0 tx=0).stop 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 msgr2=0x7fbe24158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00e930 tx=0x7fbe0c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 shutdown_connections 2023-10-09T11:37:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe24156db0 0x7fbe241585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe2406e770 0x7fbe24152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 --2- 172.21.15.6:0/2715757009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe241569e0 0x7fbe24158090 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 >> 172.21.15.6:0/2715757009 conn(0x7fbe2406cca0 msgr2=0x7fbe240afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 shutdown_connections 2023-10-09T11:37:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:34.163+0000 7fbe29ff0700 1 -- 172.21.15.6:0/2715757009 wait complete. 2023-10-09T11:37:34.249 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:37:36.901 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:37:36.899+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check failed: 3 full osd(s) (OSD_FULL) 2023-10-09T11:37:39.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.382+0000 7f14bc5fc700 1 Processor -- start 2023-10-09T11:37:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.382+0000 7f14bc5fc700 1 -- start start 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14b40ce1f0 0x7f14b40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14b40ce5c0 0x7f14b415e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b415dfb0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40acec0 con 0x7f14b40ce5c0 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bc5fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40ad1a0 con 0x7f14b40ac570 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14b40ce1f0 0x7f14b40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14b40ce1f0 0x7f14b40aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58970/0 (socket says 172.21.15.6:58970) 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 -- 172.21.15.6:0/3713189164 learned_addr learned my addr 172.21.15.6:0/3713189164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14b9b97700 1 --2- 172.21.15.6:0/3713189164 >> v2:172.21.15.118:3300/0 conn(0x7f14b40ce5c0 0x7f14b415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14bab99700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 -- 172.21.15.6:0/3713189164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 msgr2=0x7f14b406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 -- 172.21.15.6:0/3713189164 >> v2:172.21.15.118:3300/0 conn(0x7f14b40ce5c0 msgr2=0x7f14b415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 --2- 172.21.15.6:0/3713189164 >> v2:172.21.15.118:3300/0 conn(0x7f14b40ce5c0 0x7f14b415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 -- 172.21.15.6:0/3713189164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b415dc40 con 0x7f14b40ce1f0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.383+0000 7f14ba398700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40aacf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f14b406f590 tx=0x7f14b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e305393c4bcffa58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14b9396700 1 -- 172.21.15.6:0/3713189164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000e070 con 0x7f14b40ce1f0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14b9396700 1 -- 172.21.15.6:0/3713189164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000ba50 con 0x7f14b40ce1f0 2023-10-09T11:37:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14b9396700 1 -- 172.21.15.6:0/3713189164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00092e0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 -- 172.21.15.6:0/3713189164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 msgr2=0x7f14b40aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40aacf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f14b406f590 tx=0x7f14b0009840 comp rx=0 tx=0).stop 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 -- 172.21.15.6:0/3713189164 shutdown_connections 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/3713189164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40aacf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/3713189164 >> v2:172.21.15.118:3300/0 conn(0x7f14b40ce5c0 0x7f14b415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 -- 172.21.15.6:0/3713189164 >> 172.21.15.6:0/3713189164 conn(0x7f14b406cca0 msgr2=0x7f14b406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 -- 172.21.15.6:0/3713189164 shutdown_connections 2023-10-09T11:37:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.384+0000 7f14bc5fc700 1 -- 172.21.15.6:0/3713189164 wait complete. 2023-10-09T11:37:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.385+0000 7f14bc5fc700 1 Processor -- start 2023-10-09T11:37:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.385+0000 7f14bc5fc700 1 -- start start 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b40ce5c0 0x7f14b416dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415a330 con 0x7f14b40ce1f0 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415a8f0 con 0x7f14b40ce5c0 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bc5fc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b416e6a0 con 0x7f14b40ac570 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14b9b97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14b9b97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58984/0 (socket says 172.21.15.6:58984) 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14b9b97700 1 -- 172.21.15.6:0/646921391 learned_addr learned my addr 172.21.15.6:0/646921391 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14ba398700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.386+0000 7f14bab99700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b40ce5c0 0x7f14b416dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 -- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 msgr2=0x7f14b415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 -- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b40ce5c0 msgr2=0x7f14b416dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b40ce5c0 0x7f14b416dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0009ae0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14b9b97700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14a400d890 tx=0x7f14a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40125f0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4012750 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b416e980 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4012af0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.387+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b415b2c0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.388+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b415aa60 con 0x7f14b40ce1f0 2023-10-09T11:37:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.388+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a401e460 con 0x7f14b40ce1f0 2023-10-09T11:37:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.389+0000 7f14aa7fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.389+0000 7f14ba398700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.389+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a4084ad0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.389+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=46}) v3 -- 0x7f149806ea50 con 0x7f14b40ce1f0 2023-10-09T11:37:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.389+0000 7f14ba398700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 0x7f14980693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009880 tx=0x7f14b0018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:39.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.393+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a4051ca0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.587+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f14b40abf50 con 0x7f14b40ce1f0 2023-10-09T11:37:39.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.588+0000 7f14aa7fc700 1 -- 172.21.15.6:0/646921391 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+32331 (secure 0 0 0) 0x7f14a40552c0 con 0x7f14b40ce1f0 2023-10-09T11:37:39.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 45, 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:36.900768+0000", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:39.591 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:39.592 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:39.593 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:39.594 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:39.595 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:39.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:39.598 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:39.600 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:39.601 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:39.602 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:39.603 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:39.604 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:39.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:39.607 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:39.608 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:39.609 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:39.610 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:39.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:39.612 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:39.612 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:39.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:39.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.615 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.617 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:39.620 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.621 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.623 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:39.625 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:39.627 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.628 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:39.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.634 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.635 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:39.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:39.638 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.640 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:39.641 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:39.641 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:39.642 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.644 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:39.645 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:39.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.651 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.652 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.657 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.658 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:39.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.671 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:39.673 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.674 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.678 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:39.679 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:39.681 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:39.681 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:39.681 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:39.681 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 msgr2=0x7f14980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 0x7f14980693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009880 tx=0x7f14b0018000 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 msgr2=0x7f14b40b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14a400d890 tx=0x7f14a4008040 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 shutdown_connections 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1498066f30 0x7f14980693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b40ce5c0 0x7f14b416dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14b40ac570 0x7f14b415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 --2- 172.21.15.6:0/646921391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40ce1f0 0x7f14b40b1400 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 >> 172.21.15.6:0/646921391 conn(0x7f14b406cca0 msgr2=0x7f14b4156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 shutdown_connections 2023-10-09T11:37:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:39.591+0000 7f14bc5fc700 1 -- 172.21.15.6:0/646921391 wait complete. 2023-10-09T11:37:39.684 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T11:37:39.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:39.684 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-09T11:37:39.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:37:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T11:37:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:37:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:37:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.23725 s, 221 MB/s 2023-10-09T11:37:39.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:40.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.063+0000 7f320a0f2700 1 Processor -- start 2023-10-09T11:37:40.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.063+0000 7f320a0f2700 1 -- start start 2023-10-09T11:37:40.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f320a0f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f32040b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f320a0f2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f320406d650 0x7f320406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f320a0f2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040b0ca0 con 0x7f320415a2a0 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f320a0f2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f320406ea90 con 0x7f320406d650 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f320a0f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040b00d0 con 0x7f32040cf240 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f32037fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f320415a2a0 0x7f32040ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59962/0 (socket says 172.21.15.6:59962) 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f32037fe700 1 -- 172.21.15.6:0/232322553 learned_addr learned my addr 172.21.15.6:0/232322553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f3202ffd700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f32040b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f3203fff700 1 --2- 172.21.15.6:0/232322553 >> v2:172.21.15.118:3300/0 conn(0x7f320406d650 0x7f320406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537336707 0 0) 0x7f32040b0ca0 con 0x7f320415a2a0 2023-10-09T11:37:40.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.064+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec003570 con 0x7f320415a2a0 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393822120 0 0) 0x7f31ec003570 con 0x7f320415a2a0 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 msgr2=0x7f32040b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f32040b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 >> v2:172.21.15.118:3300/0 conn(0x7f320406d650 msgr2=0x7f320406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 --2- 172.21.15.6:0/232322553 >> v2:172.21.15.118:3300/0 conn(0x7f320406d650 0x7f320406da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040b0370 con 0x7f320415a2a0 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f31f4001470 con 0x7f320415a2a0 2023-10-09T11:37:40.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 >> v1:172.21.15.6:6789/0 conn(0x7f320415a2a0 legacy=0x7f32040ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec003a60 0x7f31ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f31ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31ec004d50 0x7f31ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320406ea90 con 0x7f31ec004d50 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040b00d0 con 0x7f31ec003a60 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec00ba60 con 0x7f32040cf240 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31ec004d50 0x7f31ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3202ffd700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f31ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32037fe700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec003a60 0x7f31ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 -- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 msgr2=0x7f31ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32040cf240 0x7f31ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 -- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec003a60 msgr2=0x7f31ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec003a60 0x7f31ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 -- 172.21.15.6:0/232322553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec003570 con 0x7f31ec004d50 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f3203fff700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31ec004d50 0x7f31ec0051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00e210 tx=0x7f31fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cad51e99b38e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.065+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00ea60 con 0x7f31ec004d50 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00f040 con 0x7f31ec004d50 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f32027fc700 1 -- 172.21.15.6:0/232322553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00ee10 con 0x7f31ec004d50 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 -- 172.21.15.6:0/232322553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31ec004d50 msgr2=0x7f31ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 --2- 172.21.15.6:0/232322553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31ec004d50 0x7f31ec0051c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00e210 tx=0x7f31fc00b040 comp rx=0 tx=0).stop 2023-10-09T11:37:40.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f3203fff700 1 -- 172.21.15.6:0/232322553 reap_dead start 2023-10-09T11:37:40.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 -- 172.21.15.6:0/232322553 shutdown_connections 2023-10-09T11:37:40.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 -- 172.21.15.6:0/232322553 >> 172.21.15.6:0/232322553 conn(0x7f3204067640 msgr2=0x7f3204067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:40.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 -- 172.21.15.6:0/232322553 shutdown_connections 2023-10-09T11:37:40.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.066+0000 7f320a0f2700 1 -- 172.21.15.6:0/232322553 wait complete. 2023-10-09T11:37:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.067+0000 7f320a0f2700 1 Processor -- start 2023-10-09T11:37:40.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.067+0000 7f320a0f2700 1 -- start start 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3204154610 0x7f32040b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 0x7f32040b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040b3dd0 con 0x7f3204156670 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204157020 con 0x7f320416a050 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f320a0f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320415d090 con 0x7f3204154610 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f3203fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f3203fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58998/0 (socket says 172.21.15.6:58998) 2023-10-09T11:37:40.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f3203fff700 1 -- 172.21.15.6:0/4153798544 learned_addr learned my addr 172.21.15.6:0/4153798544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f3202ffd700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 0x7f32040b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.068+0000 7f32037fe700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3204154610 0x7f32040b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 -- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3204154610 msgr2=0x7f32040b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3204154610 0x7f32040b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 -- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 msgr2=0x7f32040b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 0x7f32040b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320415c7a0 con 0x7f3204156670 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3202ffd700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 0x7f32040b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f3203fff700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f31fc016000 tx=0x7f31fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00eee0 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc01d630 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320415ca40 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc01da30 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.069+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040b4000 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.070+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320415fa10 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.070+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31fc003040 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.071+0000 7f31eb7fe700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.071+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31fc085390 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.071+0000 7f32037fe700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.071+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=47}) v3 -- 0x7f31f006ea50 con 0x7f3204156670 2023-10-09T11:37:40.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.071+0000 7f32037fe700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 0x7f31f00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31f4001d20 tx=0x7f31f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.075+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31fc052600 con 0x7f3204156670 2023-10-09T11:37:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.269+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f320404bb80 con 0x7f3204156670 2023-10-09T11:37:40.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.271+0000 7f31eb7fe700 1 -- 172.21.15.6:0/4153798544 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f31fc018070 con 0x7f3204156670 2023-10-09T11:37:40.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 46, 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:39.955418+0000", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:40.273 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:40.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:40.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:40.278 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:40.279 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:40.280 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:40.282 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:40.283 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:40.284 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:40.285 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:40.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:40.287 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:40.289 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:40.290 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:40.291 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:40.293 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:40.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.296 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:40.304 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.307 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:40.309 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.316 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:40.318 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.323 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:40.326 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:40.328 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.329 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.332 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:40.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.336 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:40.342 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:40.344 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:40.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.350 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.352 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.353 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:40.354 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:40.356 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:40.357 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:40.358 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:40.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:40.358 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 msgr2=0x7f31f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 0x7f31f00693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31f4001d20 tx=0x7f31f4009040 comp rx=0 tx=0).stop 2023-10-09T11:37:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 msgr2=0x7f3204156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f31fc016000 tx=0x7f31fc01a000 comp rx=0 tx=0).stop 2023-10-09T11:37:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 shutdown_connections 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f31f0066f30 0x7f31f00693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204156670 0x7f3204156ae0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3204154610 0x7f32040b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 --2- 172.21.15.6:0/4153798544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320416a050 0x7f32040b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 >> 172.21.15.6:0/4153798544 conn(0x7f3204067640 msgr2=0x7f320406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 shutdown_connections 2023-10-09T11:37:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.273+0000 7f320a0f2700 1 -- 172.21.15.6:0/4153798544 wait complete. 2023-10-09T11:37:40.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.478+0000 7fd8471e5700 1 Processor -- start 2023-10-09T11:37:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.478+0000 7fd8471e5700 1 -- start start 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.478+0000 7fd8471e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd8400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd8471e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400d07c0 con 0x7fd84006d120 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd8471e5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400cfbb0 con 0x7fd840157ca0 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd8471e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400cfe90 con 0x7fd8401578d0 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd845782700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd84006d120 0x7fd84015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59978/0 (socket says 172.21.15.6:59978) 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd845782700 1 -- 172.21.15.6:0/2288558004 learned_addr learned my addr 172.21.15.6:0/2288558004 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd844f81700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd8400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496482566 0 0) 0x7fd8400d07c0 con 0x7fd84006d120 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd82c003570 con 0x7fd84006d120 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145390994 0 0) 0x7fd82c003570 con 0x7fd84006d120 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 msgr2=0x7fd8400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd8400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 >> v1:172.21.15.118:6789/0 conn(0x7fd840157ca0 legacy=0x7fd84015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400d0170 con 0x7fd84006d120 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fd828001470 con 0x7fd84006d120 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 >> v1:172.21.15.6:6789/0 conn(0x7fd84006d120 legacy=0x7fd84015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd82c003a90 0x7fd82c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd82c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400cfe90 con 0x7fd82c004810 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00bb10 con 0x7fd82c003a90 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.479+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00bcd0 con 0x7fd8401578d0 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd844f81700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd82c003a90 0x7fd82c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd845782700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd82c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 -- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 msgr2=0x7fd82c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8401578d0 0x7fd82c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 -- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd82c003a90 msgr2=0x7fd82c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd82c003a90 0x7fd82c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 -- 172.21.15.6:0/2288558004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c003570 con 0x7fd82c004810 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83ffff700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd82c004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd8300019a0 tx=0x7fd830007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb89943a1ca29c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000c5d0 con 0x7fd82c004810 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000c750 con 0x7fd82c004810 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd83f7fe700 1 -- 172.21.15.6:0/2288558004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000cb10 con 0x7fd82c004810 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd8471e5700 1 -- 172.21.15.6:0/2288558004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 msgr2=0x7fd82c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.480+0000 7fd8471e5700 1 --2- 172.21.15.6:0/2288558004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd82c004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd8300019a0 tx=0x7fd830007d10 comp rx=0 tx=0).stop 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.481+0000 7fd845782700 1 -- 172.21.15.6:0/2288558004 reap_dead start 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.481+0000 7fd8471e5700 1 -- 172.21.15.6:0/2288558004 shutdown_connections 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.481+0000 7fd8471e5700 1 -- 172.21.15.6:0/2288558004 >> 172.21.15.6:0/2288558004 conn(0x7fd84006bb90 msgr2=0x7fd84006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.481+0000 7fd8471e5700 1 -- 172.21.15.6:0/2288558004 shutdown_connections 2023-10-09T11:37:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.481+0000 7fd8471e5700 1 -- 172.21.15.6:0/2288558004 wait complete. 2023-10-09T11:37:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.482+0000 7fd8471e5700 1 Processor -- start 2023-10-09T11:37:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.482+0000 7fd8471e5700 1 -- start start 2023-10-09T11:37:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.482+0000 7fd8471e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 0x7fd840069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 0x7fd840069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400c5ec0 con 0x7fd82c004810 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400c61a0 con 0x7fd8400c7390 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400c6480 con 0x7fd8400c77e0 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59024/0 (socket says 172.21.15.6:59024) 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 -- 172.21.15.6:0/3667099293 learned_addr learned my addr 172.21.15.6:0/3667099293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd83ffff700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 0x7fd840069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd845782700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 0x7fd840069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 -- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 msgr2=0x7fd840069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 0x7fd840069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 -- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 msgr2=0x7fd840069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 0x7fd840069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400c6760 con 0x7fd82c004810 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd83ffff700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 0x7fd840069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd845782700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 0x7fd840069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd844f81700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd838011f80 tx=0x7fd83800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800e040 con 0x7fd82c004810 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800f040 con 0x7fd82c004810 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8400c6a40 con 0x7fd82c004810 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838015430 con 0x7fd82c004810 2023-10-09T11:37:40.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.483+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8400b6340 con 0x7fd82c004810 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.484+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8400c6c60 con 0x7fd82c004810 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.485+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8380157e0 con 0x7fd82c004810 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.485+0000 7fd83cff9700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 0x7fd8200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.485+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8380852e0 con 0x7fd82c004810 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.485+0000 7fd83ffff700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 0x7fd8200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.485+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=47}) v3 -- 0x7fd82006ea50 con 0x7fd82c004810 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.486+0000 7fd83ffff700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 0x7fd8200693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd830008fd0 tx=0x7fd830015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.489+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd838052550 con 0x7fd82c004810 2023-10-09T11:37:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.729+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8400d0450 con 0x7fd82c004810 2023-10-09T11:37:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.730+0000 7fd83cff9700 1 -- 172.21.15.6:0/3667099293 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fd838055b70 con 0x7fd82c004810 2023-10-09T11:37:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:40.731 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 msgr2=0x7fd8200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 0x7fd8200693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd830008fd0 tx=0x7fd830015000 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 msgr2=0x7fd8400b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd838011f80 tx=0x7fd83800b040 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 shutdown_connections 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd820066f30 0x7fd8200693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd8400c77e0 0x7fd840069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd82c004810 0x7fd8400b5e00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 --2- 172.21.15.6:0/3667099293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8400c7390 0x7fd840069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 >> 172.21.15.6:0/3667099293 conn(0x7fd84006bb90 msgr2=0x7fd84015cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 shutdown_connections 2023-10-09T11:37:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:40.732+0000 7fd8471e5700 1 -- 172.21.15.6:0/3667099293 wait complete. 2023-10-09T11:37:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:40.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:37:40.883 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":5349,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.613090809999999,"mdsmap_epoch":26,"osdmap_epoch":46,"osdmap_epoch_barrier":45,"uptime":23.548122061000001} 2023-10-09T11:37:40.883 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 5349, "mdsmap_epoch": 26, "osdmap_epoch": 46, "osdmap_epoch_barrier": 45, "rank_uptime": 18.61309081, "state": "up:active", "uptime": 23.548122061, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:37:40.884 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:37:40.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.884 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:37:40.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:37:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-09T11:37:40.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.900 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T11:37:40.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:40.955 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T11:37:41.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.171+0000 7f42063fe700 1 Processor -- start 2023-10-09T11:37:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.171+0000 7f42063fe700 1 -- start start 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f42063fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42001578d0 0x7f42000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f42063fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000d07c0 con 0x7f4200157ca0 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f42063fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000cfbb0 con 0x7f420006d120 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f42063fe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42000cfe90 con 0x7f42001578d0 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f41ff7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4200157ca0 0x7f420015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59986/0 (socket says 172.21.15.6:59986) 2023-10-09T11:37:41.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.172+0000 7f41ff7fe700 1 -- 172.21.15.6:0/2777589829 learned_addr learned my addr 172.21.15.6:0/2777589829 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41fffff700 1 --2- 172.21.15.6:0/2777589829 >> v2:172.21.15.118:3300/0 conn(0x7f42001578d0 0x7f42000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973497700 0 0) 0x7f42000d07c0 con 0x7f4200157ca0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ec003570 con 0x7f4200157ca0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543534181 0 0) 0x7f41ec003570 con 0x7f4200157ca0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 >> v2:172.21.15.118:3300/0 conn(0x7f42001578d0 msgr2=0x7f42000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 --2- 172.21.15.6:0/2777589829 >> v2:172.21.15.118:3300/0 conn(0x7f42001578d0 0x7f42000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 >> v1:172.21.15.118:6789/0 conn(0x7f420006d120 legacy=0x7f420006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000d0170 con 0x7f4200157ca0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f41e8001470 con 0x7f4200157ca0 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 >> v1:172.21.15.6:6789/0 conn(0x7f4200157ca0 legacy=0x7f420015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41ec003a60 0x7f41ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 0x7f41ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec0051c0 0x7f41ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000cfe90 con 0x7f41ec004810 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec00c0d0 con 0x7f41ec0051c0 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec00c290 con 0x7f41ec003a60 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 0x7f41ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41fffff700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41ec003a60 0x7f41ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f420499b700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec0051c0 0x7f41ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 -- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41ec003a60 msgr2=0x7f41ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41ec003a60 0x7f41ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 -- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec0051c0 msgr2=0x7f41ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec0051c0 0x7f41ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f41ff7fe700 1 -- 172.21.15.6:0/2777589829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec003570 con 0x7f41ec004810 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f420499b700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec0051c0 0x7f41ec00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.173+0000 7f420499b700 1 -- 172.21.15.6:0/2777589829 reap_dead start 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f41ff7fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 0x7f41ec004c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f41e800c390 tx=0x7f41e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f0dfe3ee34272e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800cc60 con 0x7f41ec004810 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e800cdc0 con 0x7f41ec004810 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f41feffd700 1 -- 172.21.15.6:0/2777589829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8005b50 con 0x7f41ec004810 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 -- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 msgr2=0x7f41ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 0x7f41ec004c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f41e800c390 tx=0x7f41e8001e50 comp rx=0 tx=0).stop 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 -- 172.21.15.6:0/2777589829 shutdown_connections 2023-10-09T11:37:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 --2- 172.21.15.6:0/2777589829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41ec004810 0x7f41ec004c80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 -- 172.21.15.6:0/2777589829 >> 172.21.15.6:0/2777589829 conn(0x7f420006bb90 msgr2=0x7f420006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 -- 172.21.15.6:0/2777589829 shutdown_connections 2023-10-09T11:37:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.174+0000 7f42063fe700 1 -- 172.21.15.6:0/2777589829 wait complete. 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.175+0000 7f42063fe700 1 Processor -- start 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 -- start start 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec004810 0x7f4200142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4200068880 0x7f4200068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420016cae0 con 0x7f42000c82c0 2023-10-09T11:37:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4200069210 con 0x7f41ec004810 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f42063fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420016bed0 con 0x7f4200068880 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f420499b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f420499b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59038/0 (socket says 172.21.15.6:59038) 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.176+0000 7f420499b700 1 -- 172.21.15.6:0/763502822 learned_addr learned my addr 172.21.15.6:0/763502822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f41fffff700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec004810 0x7f4200142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 -- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4200068880 msgr2=0x7f4200068cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4200068880 0x7f4200068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 -- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec004810 msgr2=0x7f4200142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec004810 0x7f4200142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420016c1b0 con 0x7f42000c82c0 2023-10-09T11:37:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f420499b700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f420015b610 tx=0x7f41f8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8013630 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8013790 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8013b10 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420016c490 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.177+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000c8c60 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.178+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420016cc90 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.178+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41f8003030 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.179+0000 7f41f7fff700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 0x7f41e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.179+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41f80842d0 con 0x7f42000c82c0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.179+0000 7f41fffff700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 0x7f41e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.179+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=47}) v3 -- 0x7f41e006ea80 con 0x7f42000c82c0 2023-10-09T11:37:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.179+0000 7f41fffff700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 0x7f41e0069410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41f00093f0 tx=0x7f41f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.183+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f420016cc90 con 0x7f42000c82c0 2023-10-09T11:37:41.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.380+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f420016cc90 con 0x7f42000c82c0 2023-10-09T11:37:41.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.381+0000 7f41f7fff700 1 -- 172.21.15.6:0/763502822 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f420016cc90 con 0x7f42000c82c0 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 46, 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:39.955418+0000", 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:41.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:41.384 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:41.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:41.386 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:41.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:41.388 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:41.389 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:41.390 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:41.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:41.392 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:41.393 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:41.394 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:41.395 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:41.396 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:41.397 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:41.399 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:41.401 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:41.403 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.406 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.407 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:41.408 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.409 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:41.411 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.413 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.414 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.415 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:41.416 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.418 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.419 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:41.421 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.423 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.424 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.426 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:41.427 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:41.430 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.432 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:41.433 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.435 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:41.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.439 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.440 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.441 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.442 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.444 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.448 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:41.450 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.452 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.453 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.454 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.455 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:41.457 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:41.458 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.459 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.460 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:41.461 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:41.463 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.464 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:41.465 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:41.466 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:41.467 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:41.468 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 msgr2=0x7f41e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 0x7f41e0069410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41f00093f0 tx=0x7f41f0008040 comp rx=0 tx=0).stop 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 msgr2=0x7f42000c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f420015b610 tx=0x7f41f8009040 comp rx=0 tx=0).stop 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 shutdown_connections 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f41e0066f60 0x7f41e0069410 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42000c82c0 0x7f42000c8720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41ec004810 0x7f4200142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 --2- 172.21.15.6:0/763502822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4200068880 0x7f4200068cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 >> 172.21.15.6:0/763502822 conn(0x7f420006bb90 msgr2=0x7f4200156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 shutdown_connections 2023-10-09T11:37:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:41.383+0000 7f42063fe700 1 -- 172.21.15.6:0/763502822 wait complete. 2023-10-09T11:37:41.471 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:37:45.876 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:37:45.875+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T11:37:46.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.604+0000 7f55517a4700 1 Processor -- start 2023-10-09T11:37:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.604+0000 7f55517a4700 1 -- start start 2023-10-09T11:37:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f55517a4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f554c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f55517a4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0cee10 con 0x7f554c159f10 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f55517a4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0cd040 con 0x7f554c068e90 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f55517a4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0cd320 con 0x7f554c159b40 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f554b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f554c159f10 0x7f554c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32870/0 (socket says 172.21.15.6:32870) 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.605+0000 7f554b7fe700 1 -- 172.21.15.6:0/763214023 learned_addr learned my addr 172.21.15.6:0/763214023 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554bfff700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f554c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817005727 0 0) 0x7f554c0cee10 con 0x7f554c159f10 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538003570 con 0x7f554c159f10 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773790986 0 0) 0x7f5538003570 con 0x7f554c159f10 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 msgr2=0x7f554c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f554c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 >> v1:172.21.15.118:6789/0 conn(0x7f554c068e90 legacy=0x7f554c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0ce7c0 con 0x7f554c159f10 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f553c001470 con 0x7f554c159f10 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 >> v1:172.21.15.6:6789/0 conn(0x7f554c159f10 legacy=0x7f554c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5538003a90 0x7f5538003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f5538004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5538004d50 0x7f55380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0cd320 con 0x7f5538004d50 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553800bb10 con 0x7f5538003a90 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553800bcd0 con 0x7f554c159b40 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5538004d50 0x7f55380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554bfff700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5538003a90 0x7f5538003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f554b7fe700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f5538004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 -- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 msgr2=0x7f5538004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c159b40 0x7f5538004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 -- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5538003a90 msgr2=0x7f5538003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5538003a90 0x7f5538003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.606+0000 7f5550fa3700 1 -- 172.21.15.6:0/763214023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538003570 con 0x7f5538004d50 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f5550fa3700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5538004d50 0x7f55380051c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5544002070 tx=0x7f55440016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46934380c21d93a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440019e0 con 0x7f5538004d50 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400c8b0 con 0x7f5538004d50 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f554affd700 1 -- 172.21.15.6:0/763214023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400cc50 con 0x7f5538004d50 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 -- 172.21.15.6:0/763214023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5538004d50 msgr2=0x7f55380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 --2- 172.21.15.6:0/763214023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5538004d50 0x7f55380051c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5544002070 tx=0x7f55440016d0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f5550fa3700 1 -- 172.21.15.6:0/763214023 reap_dead start 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 -- 172.21.15.6:0/763214023 shutdown_connections 2023-10-09T11:37:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 -- 172.21.15.6:0/763214023 >> 172.21.15.6:0/763214023 conn(0x7f554c0cd660 msgr2=0x7f554c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 -- 172.21.15.6:0/763214023 shutdown_connections 2023-10-09T11:37:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.607+0000 7f55517a4700 1 -- 172.21.15.6:0/763214023 wait complete. 2023-10-09T11:37:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.608+0000 7f55517a4700 1 Processor -- start 2023-10-09T11:37:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 -- start start 2023-10-09T11:37:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c141d50 0x7f554c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554c0caa40 0x7f554c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1559e0 con 0x7f554c0c81e0 2023-10-09T11:37:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c8650 con 0x7f554c0caa40 2023-10-09T11:37:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.609+0000 7f55517a4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c15e8d0 con 0x7f554c141d50 2023-10-09T11:37:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52640/0 (socket says 172.21.15.6:52640) 2023-10-09T11:37:46.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 -- 172.21.15.6:0/2521592471 learned_addr learned my addr 172.21.15.6:0/2521592471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:46.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f554bfff700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c141d50 0x7f554c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f554b7fe700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554c0caa40 0x7f554c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 -- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c141d50 msgr2=0x7f554c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c141d50 0x7f554c15ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 -- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554c0caa40 msgr2=0x7f554c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554c0caa40 0x7f554c0c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c15dcc0 con 0x7f554c0c81e0 2023-10-09T11:37:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5550fa3700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f554400c6a0 tx=0x7f5544015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440019e0 con 0x7f554c0c81e0 2023-10-09T11:37:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544012d30 con 0x7f554c0c81e0 2023-10-09T11:37:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544012ea0 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c15dfa0 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.610+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c15e560 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.611+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c15ea80 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.612+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5544019070 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.612+0000 7f5543fff700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 0x7f552c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.612+0000 7f554bfff700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 0x7f552c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.612+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5544085eb0 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.612+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=47}) v3 -- 0x7f552c06ea50 con 0x7f554c0c81e0 2023-10-09T11:37:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.613+0000 7f554bfff700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 0x7f552c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5534006f00 tx=0x7f5534008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.617+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5544017030 con 0x7f554c0c81e0 2023-10-09T11:37:46.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.811+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f554c063e90 con 0x7f554c0c81e0 2023-10-09T11:37:46.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.812+0000 7f5543fff700 1 -- 172.21.15.6:0/2521592471 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f5544017090 con 0x7f554c0c81e0 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 46, 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:39.955418+0000", 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:37:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "45", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:46.898 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 msgr2=0x7f552c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 0x7f552c0693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5534006f00 tx=0x7f5534008040 comp rx=0 tx=0).stop 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 msgr2=0x7f554c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f554400c6a0 tx=0x7f5544015000 comp rx=0 tx=0).stop 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 shutdown_connections 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f552c066f30 0x7f552c0693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554c0c81e0 0x7f554c0b3990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f554c141d50 0x7f554c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 --2- 172.21.15.6:0/2521592471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f554c0caa40 0x7f554c0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 >> 172.21.15.6:0/2521592471 conn(0x7f554c0cd660 msgr2=0x7f554c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 shutdown_connections 2023-10-09T11:37:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:46.814+0000 7f55517a4700 1 -- 172.21.15.6:0/2521592471 wait complete. 2023-10-09T11:37:46.901 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:37:50.877 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:37:50.876+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-10-09T11:37:51.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:52.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.034+0000 7fbe5a692700 1 Processor -- start 2023-10-09T11:37:52.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.034+0000 7fbe5a692700 1 -- start start 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe5a692700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe540c3030 0x7fbe540c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe5a692700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5406aae0 con 0x7fbe540af270 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe5a692700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54069ed0 con 0x7fbe540aeea0 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe5a692700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5406a1b0 con 0x7fbe540c3030 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe540c3030 0x7fbe540c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe537fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe540af270 0x7fbe540c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32872/0 (socket says 172.21.15.6:32872) 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe540c3030 0x7fbe540c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52642/0 (socket says 172.21.15.6:52642) 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe537fe700 1 -- 172.21.15.6:0/314622942 learned_addr learned my addr 172.21.15.6:0/314622942 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 -- 172.21.15.6:0/314622942 >> v1:172.21.15.118:6789/0 conn(0x7fbe540aeea0 legacy=0x7fbe540c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 -- 172.21.15.6:0/314622942 >> v1:172.21.15.6:6789/0 conn(0x7fbe540af270 legacy=0x7fbe540c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 -- 172.21.15.6:0/314622942 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5406a490 con 0x7fbe540c3030 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.035+0000 7fbe58c2f700 1 --2- 172.21.15.6:0/314622942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540c3030 0x7fbe540c8410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009e60 tx=0x7fbe4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14a15276840bb16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe52ffd700 1 -- 172.21.15.6:0/314622942 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00e070 con 0x7fbe540c3030 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe52ffd700 1 -- 172.21.15.6:0/314622942 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00bcc0 con 0x7fbe540c3030 2023-10-09T11:37:52.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe52ffd700 1 -- 172.21.15.6:0/314622942 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c012680 con 0x7fbe540c3030 2023-10-09T11:37:52.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 -- 172.21.15.6:0/314622942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540c3030 msgr2=0x7fbe540c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 --2- 172.21.15.6:0/314622942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540c3030 0x7fbe540c8410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009e60 tx=0x7fbe4c009780 comp rx=0 tx=0).stop 2023-10-09T11:37:52.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 -- 172.21.15.6:0/314622942 shutdown_connections 2023-10-09T11:37:52.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 --2- 172.21.15.6:0/314622942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540c3030 0x7fbe540c8410 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 -- 172.21.15.6:0/314622942 >> 172.21.15.6:0/314622942 conn(0x7fbe5406c660 msgr2=0x7fbe540cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 -- 172.21.15.6:0/314622942 shutdown_connections 2023-10-09T11:37:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.036+0000 7fbe5a692700 1 -- 172.21.15.6:0/314622942 wait complete. 2023-10-09T11:37:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.037+0000 7fbe5a692700 1 Processor -- start 2023-10-09T11:37:52.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 -- start start 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe540aeea0 0x7fbe54144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe540c3030 0x7fbe54156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5416e7b0 con 0x7fbe540af270 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5416a2b0 con 0x7fbe540aeea0 2023-10-09T11:37:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.038+0000 7fbe5a692700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5416a570 con 0x7fbe540c3030 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52644/0 (socket says 172.21.15.6:52644) 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 -- 172.21.15.6:0/2562040956 learned_addr learned my addr 172.21.15.6:0/2562040956 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe58c2f700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe540c3030 0x7fbe54156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe53fff700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe540aeea0 0x7fbe54144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 -- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe540c3030 msgr2=0x7fbe54156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe540c3030 0x7fbe54156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 -- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe540aeea0 msgr2=0x7fbe54144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe540aeea0 0x7fbe54144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 -- 172.21.15.6:0/2562040956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009a20 con 0x7fbe540af270 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe537fe700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c7c0 tx=0x7fbe3c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c005b30 con 0x7fbe540af270 2023-10-09T11:37:52.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c005c90 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c004a80 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5416a850 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.039+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5416ae10 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.040+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe54067bc0 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.041+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe3c0070d0 con 0x7fbe540af270 2023-10-09T11:37:52.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.041+0000 7fbe4bfff700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 0x7fbe340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.041+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe3c0838e0 con 0x7fbe540af270 2023-10-09T11:37:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.041+0000 7fbe53fff700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 0x7fbe340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.042+0000 7fbe53fff700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 0x7fbe340693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe5415a2b0 tx=0x7fbe44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.046+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe3c050b50 con 0x7fbe540af270 2023-10-09T11:37:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.240+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbe5406a770 con 0x7fbe540af270 2023-10-09T11:37:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.241+0000 7fbe4bfff700 1 -- 172.21.15.6:0/2562040956 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32212 (secure 0 0 0) 0x7fbe3c054170 con 0x7fbe540af270 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 49, 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:51.040044+0000", 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:52.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:52.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:52.246 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.247 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.249 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.250 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:52.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.252 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.254 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.255 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.260 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.261 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:52.263 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:52.266 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:52.269 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.274 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.276 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.279 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.281 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.282 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.283 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.284 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:52.285 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:52.287 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:52.288 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.289 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:52.294 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.296 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:52.297 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:52.301 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.302 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:52.303 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.305 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.306 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:52.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.309 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:52.310 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:52.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:52.314 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.315 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.318 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.319 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:52.321 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:52.323 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.324 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.325 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 msgr2=0x7fbe340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 0x7fbe340693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe5415a2b0 tx=0x7fbe44009040 comp rx=0 tx=0).stop 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 msgr2=0x7fbe5416e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c7c0 tx=0x7fbe3c007f70 comp rx=0 tx=0).stop 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 shutdown_connections 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbe34066f30 0x7fbe340693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe540c3030 0x7fbe54156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe540aeea0 0x7fbe54144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 --2- 172.21.15.6:0/2562040956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe540af270 0x7fbe5416e270 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 >> 172.21.15.6:0/2562040956 conn(0x7fbe5406c660 msgr2=0x7fbe540b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 shutdown_connections 2023-10-09T11:37:52.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.243+0000 7fbe5a692700 1 -- 172.21.15.6:0/2562040956 wait complete. 2023-10-09T11:37:52.328 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T11:37:52.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:37:52.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.447+0000 7f10993a3700 1 Processor -- start 2023-10-09T11:37:52.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.447+0000 7f10993a3700 1 -- start start 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10993a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10993a3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f109406d120 0x7f109406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10993a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109406dac0 con 0x7f1094157ca0 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10993a3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10940d07c0 con 0x7f109406d120 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10993a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10940cfbb0 con 0x7f10941578d0 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10927fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1094157ca0 0x7f109415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32874/0 (socket says 172.21.15.6:32874) 2023-10-09T11:37:52.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10927fc700 1 -- 172.21.15.6:0/2336523553 learned_addr learned my addr 172.21.15.6:0/2336523553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f10937fe700 1 --2- 172.21.15.6:0/2336523553 >> v2:172.21.15.118:3300/0 conn(0x7f109406d120 0x7f109406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517344426 0 0) 0x7f107c001110 con 0x7f1094157ca0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080003570 con 0x7f1094157ca0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198487357 0 0) 0x7f1080003570 con 0x7f1094157ca0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 msgr2=0x7f10940cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10940cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 >> v2:172.21.15.118:3300/0 conn(0x7f109406d120 msgr2=0x7f109406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 --2- 172.21.15.6:0/2336523553 >> v2:172.21.15.118:3300/0 conn(0x7f109406d120 0x7f109406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940cfe90 con 0x7f1094157ca0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f107c001600 con 0x7f1094157ca0 2023-10-09T11:37:52.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.448+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10940cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 >> v1:172.21.15.6:6789/0 conn(0x7f1094157ca0 legacy=0x7f109415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1080003a60 0x7f1080003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080004810 0x7f1080004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940d07c0 con 0x7f1080003a60 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940cfbb0 con 0x7f1080004810 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108000ba60 con 0x7f10941578d0 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1080003a60 0x7f1080003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f10937fe700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f10927fc700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080004810 0x7f1080004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 -- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 msgr2=0x7f10800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10941578d0 0x7f10800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 -- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080004810 msgr2=0x7f1080004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080004810 0x7f1080004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 -- 172.21.15.6:0/2336523553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c009420 con 0x7f1080003a60 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1092ffd700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1080003a60 0x7f1080003e70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f108c009df0 tx=0x7f108c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b871d0380e75a292 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c009740 con 0x7f1080003a60 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00e920 con 0x7f1080003a60 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.449+0000 7f1091ffb700 1 -- 172.21.15.6:0/2336523553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00ece0 con 0x7f1080003a60 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 -- 172.21.15.6:0/2336523553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1080003a60 msgr2=0x7f1080003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 --2- 172.21.15.6:0/2336523553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1080003a60 0x7f1080003e70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f108c009df0 tx=0x7f108c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10937fe700 1 -- 172.21.15.6:0/2336523553 reap_dead start 2023-10-09T11:37:52.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 -- 172.21.15.6:0/2336523553 shutdown_connections 2023-10-09T11:37:52.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 -- 172.21.15.6:0/2336523553 >> 172.21.15.6:0/2336523553 conn(0x7f109406bb90 msgr2=0x7f109406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:52.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 -- 172.21.15.6:0/2336523553 shutdown_connections 2023-10-09T11:37:52.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.450+0000 7f10993a3700 1 -- 172.21.15.6:0/2336523553 wait complete. 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.451+0000 7f10993a3700 1 Processor -- start 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.451+0000 7f10993a3700 1 -- start start 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080003a60 0x7f10940ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10940b4990 0x7f10940b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940b4500 con 0x7f10940aa890 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940b3c40 con 0x7f1080003a60 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10993a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10940b3eb0 con 0x7f10940b4990 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52660/0 (socket says 172.21.15.6:52660) 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 -- 172.21.15.6:0/3322622924 learned_addr learned my addr 172.21.15.6:0/3322622924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f1092ffd700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080003a60 0x7f10940ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10937fe700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10940b4990 0x7f10940b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 -- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10940b4990 msgr2=0x7f10940b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10940b4990 0x7f10940b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 -- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080003a60 msgr2=0x7f10940ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080003a60 0x7f10940ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 -- 172.21.15.6:0/3322622924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940b4190 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f10927fc700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f107c0073c0 tx=0x7f10940d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.452+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c018030 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.453+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00f850 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.453+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00fc10 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.453+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10940abcc0 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.453+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940ad220 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.454+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10940ad440 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.454+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f107c01b070 con 0x7f10940aa890 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.454+0000 7f108affd700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 0x7f10740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.455+0000 7f1092ffd700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 0x7f10740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.455+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f107c019070 con 0x7f10940aa890 2023-10-09T11:37:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.455+0000 7f1092ffd700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 0x7f10740693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f108c0093f0 tx=0x7f108c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.459+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f107c0514f0 con 0x7f10940aa890 2023-10-09T11:37:52.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.653+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f109406dac0 con 0x7f10940aa890 2023-10-09T11:37:52.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.654+0000 7f108affd700 1 -- 172.21.15.6:0/3322622924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32212 (secure 0 0 0) 0x7f109406dac0 con 0x7f10940aa890 2023-10-09T11:37:52.656 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:52.656 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:37:52.656 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 49, 2023-10-09T11:37:52.656 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:37:51.040044+0000", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:37:52.657 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 7, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:37:52.658 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.659 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.660 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.661 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.662 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.663 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 6, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.052658+0000", 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.665 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.666 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.667 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.668 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:37:52.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 7, 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:37:20.612907+0000", 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:37:52.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:37:52.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "49", 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:37:52.673 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:37:52.674 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:37:52.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:37:52.676 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:37:52.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.678 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.680 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:37:52.682 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:37:52.683 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:37:52.686 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:37:52.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.690 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.691 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.694 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:37:52.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.697 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.699 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:37:52.702 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:37:52.705 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.710 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.713 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.716 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:37:52.720 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:37:52.721 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:37:52.722 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 42, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:37:52.723 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.726 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:37:52.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.728 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.729 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.730 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.732 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:37:52.734 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:37:52.735 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:37:52.736 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:37:52.737 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 msgr2=0x7f10740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 0x7f10740693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f108c0093f0 tx=0x7f108c01a000 comp rx=0 tx=0).stop 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 msgr2=0x7f10940acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f107c0073c0 tx=0x7f10940d0730 comp rx=0 tx=0).stop 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 shutdown_connections 2023-10-09T11:37:52.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1074066f30 0x7f10740693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10940b4990 0x7f10940b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1080003a60 0x7f10940ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 --2- 172.21.15.6:0/3322622924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10940aa890 0x7f10940acce0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 >> 172.21.15.6:0/3322622924 conn(0x7f109406bb90 msgr2=0x7f1094068bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 shutdown_connections 2023-10-09T11:37:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.657+0000 7f10993a3700 1 -- 172.21.15.6:0/3322622924 wait complete. 2023-10-09T11:37:52.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:52.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.858+0000 7f276e802700 1 Processor -- start 2023-10-09T11:37:52.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 -- start start 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2768154350 0x7f27680cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f276806f200 0x7f276815a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2768154720 0x7f27680cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2768157010 con 0x7f2768154350 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27680b2c20 con 0x7f2768154720 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.859+0000 7f276e802700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27680b2f00 con 0x7f276806f200 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2768154350 0x7f27680cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2768154350 0x7f27680cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52668/0 (socket says 172.21.15.6:52668) 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 -- 172.21.15.6:0/1005958919 learned_addr learned my addr 172.21.15.6:0/1005958919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276cfff700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f276806f200 0x7f276815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276e001700 1 --2- 172.21.15.6:0/1005958919 >> v2:172.21.15.118:3300/0 conn(0x7f2768154720 0x7f27680cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 -- 172.21.15.6:0/1005958919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f276806f200 msgr2=0x7f276815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f276806f200 0x7f276815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 -- 172.21.15.6:0/1005958919 >> v2:172.21.15.118:3300/0 conn(0x7f2768154720 msgr2=0x7f27680cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 --2- 172.21.15.6:0/1005958919 >> v2:172.21.15.118:3300/0 conn(0x7f2768154720 0x7f27680cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 -- 172.21.15.6:0/1005958919 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680b31e0 con 0x7f2768154350 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f276d800700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f27680cd040 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f27680c98b0 tx=0x7f2764009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f3598add2bb714 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f275ffff700 1 -- 172.21.15.6:0/1005958919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400b860 con 0x7f2768154350 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f275ffff700 1 -- 172.21.15.6:0/1005958919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276400b9c0 con 0x7f2768154350 2023-10-09T11:37:52.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.860+0000 7f275ffff700 1 -- 172.21.15.6:0/1005958919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400bd60 con 0x7f2768154350 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 -- 172.21.15.6:0/1005958919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 msgr2=0x7f27680cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f27680cd040 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f27680c98b0 tx=0x7f2764009250 comp rx=0 tx=0).stop 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 -- 172.21.15.6:0/1005958919 shutdown_connections 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 --2- 172.21.15.6:0/1005958919 >> v2:172.21.15.118:3300/0 conn(0x7f2768154720 0x7f27680cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f27680cd040 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 --2- 172.21.15.6:0/1005958919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f276806f200 0x7f276815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 -- 172.21.15.6:0/1005958919 >> 172.21.15.6:0/1005958919 conn(0x7f2768063230 msgr2=0x7f2768063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 -- 172.21.15.6:0/1005958919 shutdown_connections 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.861+0000 7f276e802700 1 -- 172.21.15.6:0/1005958919 wait complete. 2023-10-09T11:37:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.862+0000 7f276e802700 1 Processor -- start 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.862+0000 7f276e802700 1 -- start start 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f276806f200 0x7f2768168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2768154720 0x7f276806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768152af0 con 0x7f2768154350 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680c4ed0 con 0x7f276806f200 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e802700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27680c51b0 con 0x7f2768154720 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276cfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276cfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52682/0 (socket says 172.21.15.6:52682) 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276cfff700 1 -- 172.21.15.6:0/2210101455 learned_addr learned my addr 172.21.15.6:0/2210101455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276e001700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2768154720 0x7f276806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.863+0000 7f276d800700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f276806f200 0x7f2768168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 -- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2768154720 msgr2=0x7f276806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2768154720 0x7f276806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 -- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f276806f200 msgr2=0x7f2768168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f276806f200 0x7f2768168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 -- 172.21.15.6:0/2210101455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640094f0 con 0x7f2768154350 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276cfff700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f275800d860 tx=0x7f2758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758018070 con 0x7f2768154350 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27580125f0 con 0x7f2768154350 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27680c5490 con 0x7f2768154350 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580129b0 con 0x7f2768154350 2023-10-09T11:37:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.864+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27680c5a50 con 0x7f2768154350 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.865+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27680690d0 con 0x7f2768154350 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.865+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2758012d20 con 0x7f2768154350 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.866+0000 7f275d7fa700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 0x7f274c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.866+0000 7f276d800700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 0x7f274c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.866+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2758084800 con 0x7f2768154350 2023-10-09T11:37:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.866+0000 7f276d800700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 0x7f274c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27680c98b0 tx=0x7f2764017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:52.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:52.870+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2758055500 con 0x7f2768154350 2023-10-09T11:37:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.109+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27680b34c0 con 0x7f2768154350 2023-10-09T11:37:53.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.110+0000 7f275d7fa700 1 -- 172.21.15.6:0/2210101455 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f2758055090 con 0x7f2768154350 2023-10-09T11:37:53.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:53.112 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 msgr2=0x7f274c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 0x7f274c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27680c98b0 tx=0x7f2764017000 comp rx=0 tx=0).stop 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 msgr2=0x7f276816af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f275800d860 tx=0x7f2758008040 comp rx=0 tx=0).stop 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 shutdown_connections 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f274c066f30 0x7f274c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2768154720 0x7f276806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f276806f200 0x7f2768168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 --2- 172.21.15.6:0/2210101455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2768154350 0x7f276816af80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 >> 172.21.15.6:0/2210101455 conn(0x7f2768063230 msgr2=0x7f2768159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 shutdown_connections 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.112+0000 7f276e802700 1 -- 172.21.15.6:0/2210101455 wait complete. 2023-10-09T11:37:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:53.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:37:53.265 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":5349,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.994733933999999,"mdsmap_epoch":26,"osdmap_epoch":50,"osdmap_epoch_barrier":45,"uptime":35.929764425000002} 2023-10-09T11:37:53.265 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 5349, "mdsmap_epoch": 26, "osdmap_epoch": 50, "osdmap_epoch_barrier": 45, "rank_uptime": 30.994733934, "state": "up:active", "uptime": 35.929764425, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:37:53.265 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:37:53.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.266 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T11:37:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:37:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:37:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.281324 s, 186 MB/s 2023-10-09T11:37:53.564 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:37:53.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:53.607 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:37:53.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:37:53.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:37:53.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:37:53.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:37:53.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:53.713 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:37:53.728 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:37:53.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:37:53.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:37:53.778 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:37:53.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:37:53.779 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:37:53.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.909+0000 7effe82e3700 1 Processor -- start 2023-10-09T11:37:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.910+0000 7effe82e3700 1 -- start start 2023-10-09T11:37:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.910+0000 7effe82e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effe0157ca0 0x7effe00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.910+0000 7effe82e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe006d120 0x7effe006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.910+0000 7effe82e3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00d07c0 con 0x7effe01578d0 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.910+0000 7effe82e3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe006daa0 con 0x7effe0157ca0 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe82e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00cfbb0 con 0x7effe006d120 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effe0157ca0 0x7effe00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe607f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7effe01578d0 0x7effe015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53518/0 (socket says 172.21.15.6:53518) 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effe0157ca0 0x7effe00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60968/0 (socket says 172.21.15.6:60968) 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe607f700 1 -- 172.21.15.6:0/938897543 learned_addr learned my addr 172.21.15.6:0/938897543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe6880700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe006d120 0x7effe006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 -- 172.21.15.6:0/938897543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe006d120 msgr2=0x7effe006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe006d120 0x7effe006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 -- 172.21.15.6:0/938897543 >> v1:172.21.15.6:6789/0 conn(0x7effe01578d0 legacy=0x7effe015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 -- 172.21.15.6:0/938897543 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00cfe90 con 0x7effe0157ca0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe507d700 1 -- 172.21.15.6:0/938897543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867093978 0 0) 0x7effe00d07c0 con 0x7effe01578d0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe587e700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe00cf4f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7effd40098e0 tx=0x7effd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32310b1d9adecad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe507d700 1 -- 172.21.15.6:0/938897543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4009e80 con 0x7effe0157ca0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe507d700 1 -- 172.21.15.6:0/938897543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd400b860 con 0x7effe0157ca0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.911+0000 7effe507d700 1 -- 172.21.15.6:0/938897543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd400bbe0 con 0x7effe0157ca0 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 -- 172.21.15.6:0/938897543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 msgr2=0x7effe00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe00cf4f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7effd40098e0 tx=0x7effd40091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 -- 172.21.15.6:0/938897543 shutdown_connections 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe006d120 0x7effe006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 --2- 172.21.15.6:0/938897543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe00cf4f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 -- 172.21.15.6:0/938897543 >> 172.21.15.6:0/938897543 conn(0x7effe006bb90 msgr2=0x7effe006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:53.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 -- 172.21.15.6:0/938897543 shutdown_connections 2023-10-09T11:37:53.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.912+0000 7effe82e3700 1 -- 172.21.15.6:0/938897543 wait complete. 2023-10-09T11:37:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.913+0000 7effe82e3700 1 Processor -- start 2023-10-09T11:37:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.913+0000 7effe82e3700 1 -- start start 2023-10-09T11:37:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe006d120 0x7effe00b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe01578d0 0x7effe00ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe016b480 con 0x7effe0157ca0 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00abdd0 con 0x7effe006d120 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe82e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00b3cd0 con 0x7effe01578d0 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60978/0 (socket says 172.21.15.6:60978) 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 -- 172.21.15.6:0/3621070112 learned_addr learned my addr 172.21.15.6:0/3621070112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe587e700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe01578d0 0x7effe00ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe607f700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe006d120 0x7effe00b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 -- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe01578d0 msgr2=0x7effe00ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe01578d0 0x7effe00ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 -- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe006d120 msgr2=0x7effe00b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe006d120 0x7effe00b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 -- 172.21.15.6:0/3621070112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4009420 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.914+0000 7effe6880700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effd800d890 tx=0x7effd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd80125f0 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8012770 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe00abaf0 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd8012b30 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe00b4250 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.915+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0067ac0 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.916+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effd801e460 con 0x7effe0157ca0 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.916+0000 7effde7fc700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 0x7effcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:53.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.916+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5763+0+0 (secure 0 0 0) 0x7effd8084c20 con 0x7effe0157ca0 2023-10-09T11:37:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.916+0000 7effe607f700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 0x7effcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.917+0000 7effe607f700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 0x7effcc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7effd0001560 tx=0x7effd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:53.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:53.921+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effd8051e50 con 0x7effe0157ca0 2023-10-09T11:37:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.161+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effe00d0170 con 0x7effe0157ca0 2023-10-09T11:37:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.162+0000 7effde7fc700 1 -- 172.21.15.6:0/3621070112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7effd8055470 con 0x7effe0157ca0 2023-10-09T11:37:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:54.164 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 msgr2=0x7effcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 0x7effcc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7effd0001560 tx=0x7effd0009040 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 msgr2=0x7effe0148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effd800d890 tx=0x7effd8008040 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 shutdown_connections 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7effcc066f30 0x7effcc0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0157ca0 0x7effe0148720 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effe006d120 0x7effe00b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 --2- 172.21.15.6:0/3621070112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effe01578d0 0x7effe00ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 >> 172.21.15.6:0/3621070112 conn(0x7effe006bb90 msgr2=0x7effe0155680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 shutdown_connections 2023-10-09T11:37:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.164+0000 7effe82e3700 1 -- 172.21.15.6:0/3621070112 wait complete. 2023-10-09T11:37:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:54.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:54.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.297+0000 7ff95b237700 1 Processor -- start 2023-10-09T11:37:54.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.297+0000 7ff95b237700 1 -- start start 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff95b237700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 0x7ff9540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff95b237700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540d07c0 con 0x7ff954157ca0 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff95b237700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540cfbb0 con 0x7ff95406d120 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff95b237700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cfe90 con 0x7ff9541578d0 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff953fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff954157ca0 0x7ff95415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53522/0 (socket says 172.21.15.6:53522) 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff953fff700 1 -- 172.21.15.6:0/1572361135 learned_addr learned my addr 172.21.15.6:0/1572361135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff958fd3700 1 --2- 172.21.15.6:0/1572361135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 0x7ff9540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909371670 0 0) 0x7ff9540d07c0 con 0x7ff954157ca0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff944003570 con 0x7ff954157ca0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348136 0 0) 0x7ff9540cfbb0 con 0x7ff95406d120 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9540d07c0 con 0x7ff95406d120 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff958fd3700 1 -- 172.21.15.6:0/1572361135 >> v1:172.21.15.118:6789/0 conn(0x7ff95406d120 legacy=0x7ff95415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff958fd3700 1 -- 172.21.15.6:0/1572361135 >> v1:172.21.15.6:6789/0 conn(0x7ff954157ca0 legacy=0x7ff95415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff958fd3700 1 -- 172.21.15.6:0/1572361135 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540d0170 con 0x7ff9541578d0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.298+0000 7ff958fd3700 1 --2- 172.21.15.6:0/1572361135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 0x7ff9540cf4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff948009910 tx=0x7ff9480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=770dff9693db3e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011630 con 0x7ff9541578d0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948011790 con 0x7ff9541578d0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff9537fe700 1 -- 172.21.15.6:0/1572361135 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011b30 con 0x7ff9541578d0 2023-10-09T11:37:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 -- 172.21.15.6:0/1572361135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 msgr2=0x7ff9540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 --2- 172.21.15.6:0/1572361135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 0x7ff9540cf4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff948009910 tx=0x7ff9480091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 -- 172.21.15.6:0/1572361135 shutdown_connections 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 --2- 172.21.15.6:0/1572361135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9541578d0 0x7ff9540cf4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 -- 172.21.15.6:0/1572361135 >> 172.21.15.6:0/1572361135 conn(0x7ff95406bb90 msgr2=0x7ff95406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 -- 172.21.15.6:0/1572361135 shutdown_connections 2023-10-09T11:37:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.299+0000 7ff95b237700 1 -- 172.21.15.6:0/1572361135 wait complete. 2023-10-09T11:37:54.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.300+0000 7ff95b237700 1 Processor -- start 2023-10-09T11:37:54.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 -- start start 2023-10-09T11:37:54.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 0x7ff9540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff954157ca0 0x7ff9541550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540ccf70 con 0x7ff9541578d0 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95416ab40 con 0x7ff95406d120 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff95b237700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95416ade0 con 0x7ff954157ca0 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff953fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff953fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60992/0 (socket says 172.21.15.6:60992) 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.301+0000 7ff953fff700 1 -- 172.21.15.6:0/3140844980 learned_addr learned my addr 172.21.15.6:0/3140844980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff9597d4700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff954157ca0 0x7ff9541550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff958fd3700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 0x7ff9540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 -- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff954157ca0 msgr2=0x7ff9541550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff954157ca0 0x7ff9541550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 -- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 msgr2=0x7ff9540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 0x7ff9540b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 -- 172.21.15.6:0/3140844980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009420 con 0x7ff9541578d0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff958fd3700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 0x7ff9540b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff953fff700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c790 tx=0x7ff940007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940005b30 con 0x7ff9541578d0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940005c90 con 0x7ff9541578d0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9540cc6d0 con 0x7ff9541578d0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940007300 con 0x7ff9541578d0 2023-10-09T11:37:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.302+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540ccd10 con 0x7ff9541578d0 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.303+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95416af90 con 0x7ff9541578d0 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.303+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff94001b3b0 con 0x7ff9541578d0 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.304+0000 7ff950ff9700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.304+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff940083a60 con 0x7ff9541578d0 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.304+0000 7ff958fd3700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.304+0000 7ff958fd3700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 0x7ff9380693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff948009860 tx=0x7ff948017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.308+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff95416af90 con 0x7ff9541578d0 2023-10-09T11:37:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.501+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff95416af50 con 0x7ff9541578d0 2023-10-09T11:37:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.502+0000 7ff950ff9700 1 -- 172.21.15.6:0/3140844980 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15397 (secure 0 0 0) 0x7ff940017020 con 0x7ff9541578d0 2023-10-09T11:37:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:54.503 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":51,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:54.052126+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 msgr2=0x7ff9380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 0x7ff9380693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff948009860 tx=0x7ff948017000 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 msgr2=0x7ff954154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c790 tx=0x7ff940007ea0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 shutdown_connections 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff954157ca0 0x7ff9541550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff95406d120 0x7ff9540b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 --2- 172.21.15.6:0/3140844980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9541578d0 0x7ff954154b60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 >> 172.21.15.6:0/3140844980 conn(0x7ff95406bb90 msgr2=0x7ff954155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 shutdown_connections 2023-10-09T11:37:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.504+0000 7ff95b237700 1 -- 172.21.15.6:0/3140844980 wait complete. 2023-10-09T11:37:54.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:37:20.052658+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:37:20.612907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:37:54.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:37:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.637+0000 7f072a8e6700 1 Processor -- start 2023-10-09T11:37:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.637+0000 7f072a8e6700 1 -- start start 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0724157ca0 0x7f072415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f072406d120 0x7f072406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072406dac0 con 0x7f072406d120 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240d07c0 con 0x7f0724157ca0 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f072a8e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cfbb0 con 0x7f07241578d0 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f0728e83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f072406d120 0x7f072406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f0728e83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f072406d120 0x7f072406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32770/0 (socket says 172.21.15.6:32770) 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.638+0000 7f0728e83700 1 -- 172.21.15.6:0/3759364108 learned_addr learned my addr 172.21.15.6:0/3759364108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f07237fe700 1 --2- 172.21.15.6:0/3759364108 >> v2:172.21.15.118:3300/0 conn(0x7f0724157ca0 0x7f072415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0723fff700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 -- 172.21.15.6:0/3759364108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 msgr2=0x7f07240cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 -- 172.21.15.6:0/3759364108 >> v2:172.21.15.118:3300/0 conn(0x7f0724157ca0 msgr2=0x7f072415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 --2- 172.21.15.6:0/3759364108 >> v2:172.21.15.118:3300/0 conn(0x7f0724157ca0 0x7f072415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 -- 172.21.15.6:0/3759364108 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240cfe90 con 0x7f072406d120 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0728e83700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f072406d580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f072406cb70 tx=0x7f071c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770d5638bcfbd9d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0722ffd700 1 -- 172.21.15.6:0/3759364108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c00e070 con 0x7f072406d120 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0722ffd700 1 -- 172.21.15.6:0/3759364108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c00b970 con 0x7f072406d120 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.639+0000 7f0722ffd700 1 -- 172.21.15.6:0/3759364108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0092e0 con 0x7f072406d120 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 -- 172.21.15.6:0/3759364108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 msgr2=0x7f072406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f072406d580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f072406cb70 tx=0x7f071c009840 comp rx=0 tx=0).stop 2023-10-09T11:37:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 -- 172.21.15.6:0/3759364108 shutdown_connections 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f072406d580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3759364108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3759364108 >> v2:172.21.15.118:3300/0 conn(0x7f0724157ca0 0x7f072415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 -- 172.21.15.6:0/3759364108 >> 172.21.15.6:0/3759364108 conn(0x7f072406bb90 msgr2=0x7f072406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 -- 172.21.15.6:0/3759364108 shutdown_connections 2023-10-09T11:37:54.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.640+0000 7f072a8e6700 1 -- 172.21.15.6:0/3759364108 wait complete. 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.641+0000 7f072a8e6700 1 Processor -- start 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.641+0000 7f072a8e6700 1 -- start start 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724157ca0 0x7f07240aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240b6af0 con 0x7f072406d120 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240b6120 con 0x7f0724157ca0 2023-10-09T11:37:54.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240b5510 con 0x7f07241578d0 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32784/0 (socket says 172.21.15.6:32784) 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 -- 172.21.15.6:0/3537597185 learned_addr learned my addr 172.21.15.6:0/3537597185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f07237fe700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0728e83700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724157ca0 0x7f07240aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 -- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 msgr2=0x7f07240b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 -- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724157ca0 msgr2=0x7f07240aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724157ca0 0x7f07240aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 -- 172.21.15.6:0/3537597185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009ae0 con 0x7f072406d120 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f0723fff700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f071400ec80 tx=0x7f07140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400c850 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071400c9b0 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07240b57f0 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.642+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400cd50 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.643+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240b5db0 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.643+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724067ac0 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.644+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0714013680 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.644+0000 7f070bfff700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.644+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f07140847a0 con 0x7f072406d120 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.644+0000 7f07237fe700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.645+0000 7f07237fe700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 0x7f07100693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07241572f0 tx=0x7f07180091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.649+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07140519d0 con 0x7f072406d120 2023-10-09T11:37:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.840+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07240aaff0 con 0x7f072406d120 2023-10-09T11:37:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.841+0000 7f070bfff700 1 -- 172.21.15.6:0/3537597185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0714054ff0 con 0x7f072406d120 2023-10-09T11:37:54.842 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:37:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 msgr2=0x7f07100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 0x7f07100693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07241572f0 tx=0x7f07180091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 msgr2=0x7f07240b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f071400ec80 tx=0x7f07140091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 shutdown_connections 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0710066f30 0x7f07100693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0724157ca0 0x7f07240aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072406d120 0x7f07240b4f30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 --2- 172.21.15.6:0/3537597185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07241578d0 0x7f07240b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.842+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 >> 172.21.15.6:0/3537597185 conn(0x7f072406bb90 msgr2=0x7f072415cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.843+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 shutdown_connections 2023-10-09T11:37:54.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.843+0000 7f072a8e6700 1 -- 172.21.15.6:0/3537597185 wait complete. 2023-10-09T11:37:54.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:37:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.976+0000 7f342f895700 1 Processor -- start 2023-10-09T11:37:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.976+0000 7f342f895700 1 -- start start 2023-10-09T11:37:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342f895700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3428157ca0 0x7f34280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342f895700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280d07c0 con 0x7f342806d120 2023-10-09T11:37:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342f895700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34280cfbb0 con 0x7f34281578d0 2023-10-09T11:37:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342f895700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280cfe90 con 0x7f3428157ca0 2023-10-09T11:37:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342de32700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f342806d120 0x7f342806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53528/0 (socket says 172.21.15.6:53528) 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342de32700 1 -- 172.21.15.6:0/2224470355 learned_addr learned my addr 172.21.15.6:0/2224470355 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342ce30700 1 --2- 172.21.15.6:0/2224470355 >> v2:172.21.15.118:3300/0 conn(0x7f3428157ca0 0x7f34280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874979380 0 0) 0x7f34280d07c0 con 0x7f342806d120 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3410003570 con 0x7f342806d120 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342ce30700 1 -- 172.21.15.6:0/2224470355 >> v1:172.21.15.118:6789/0 conn(0x7f34281578d0 legacy=0x7f342815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2028056559 0 0) 0x7f3410003570 con 0x7f342806d120 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342ce30700 1 -- 172.21.15.6:0/2224470355 >> v1:172.21.15.6:6789/0 conn(0x7f342806d120 legacy=0x7f342806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.977+0000 7f342ce30700 1 -- 172.21.15.6:0/2224470355 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280d0170 con 0x7f3428157ca0 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342ce30700 1 --2- 172.21.15.6:0/2224470355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3428157ca0 0x7f34280cf4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f341c0098e0 tx=0x7f341c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775753162ec44aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420001470 con 0x7f3428157ca0 2023-10-09T11:37:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c011420 con 0x7f3428157ca0 2023-10-09T11:37:54.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f3427fff700 1 -- 172.21.15.6:0/2224470355 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0117a0 con 0x7f3428157ca0 2023-10-09T11:37:54.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 -- 172.21.15.6:0/2224470355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3428157ca0 msgr2=0x7f34280cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 --2- 172.21.15.6:0/2224470355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3428157ca0 0x7f34280cf4f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f341c0098e0 tx=0x7f341c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 -- 172.21.15.6:0/2224470355 shutdown_connections 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 --2- 172.21.15.6:0/2224470355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3428157ca0 0x7f34280cf4f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 -- 172.21.15.6:0/2224470355 >> 172.21.15.6:0/2224470355 conn(0x7f342806bb90 msgr2=0x7f342806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 -- 172.21.15.6:0/2224470355 shutdown_connections 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.978+0000 7f342f895700 1 -- 172.21.15.6:0/2224470355 wait complete. 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 Processor -- start 2023-10-09T11:37:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 -- start start 2023-10-09T11:37:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f342806d120 0x7f3428153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34281578d0 0x7f3428158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428154240 con 0x7f3428157ca0 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280ac7d0 con 0x7f342806d120 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.980+0000 7f342f895700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280acab0 con 0x7f34281578d0 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32790/0 (socket says 172.21.15.6:32790) 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 -- 172.21.15.6:0/2225349206 learned_addr learned my addr 172.21.15.6:0/2225349206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342d631700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f342806d120 0x7f3428153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342ce30700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34281578d0 0x7f3428158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 -- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34281578d0 msgr2=0x7f3428158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34281578d0 0x7f3428158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 -- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f342806d120 msgr2=0x7f3428153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f342806d120 0x7f3428153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 -- 172.21.15.6:0/2225349206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009420 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342de32700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f342000cb90 tx=0x7f3420001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420007150 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200072d0 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280acd90 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420007690 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.981+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3428159040 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.982+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342806dc20 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.983+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3420004a40 con 0x7f3428157ca0 2023-10-09T11:37:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.983+0000 7f34257fa700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 0x7f34140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.983+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3420083b60 con 0x7f3428157ca0 2023-10-09T11:37:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.983+0000 7f342d631700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 0x7f34140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.984+0000 7f342d631700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 0x7f34140693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f341800e1b0 tx=0x7f3418001770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:54.987+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3420050e10 con 0x7f3428157ca0 2023-10-09T11:37:55.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.178+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34280d0450 con 0x7f3428157ca0 2023-10-09T11:37:55.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.178+0000 7f34257fa700 1 -- 172.21.15.6:0/2225349206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34200180a0 con 0x7f3428157ca0 2023-10-09T11:37:55.180 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:37:55.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.180+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 msgr2=0x7f34140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.180+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 0x7f34140693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f341800e1b0 tx=0x7f3418001770 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.180+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 msgr2=0x7f3428069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.180+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f342000cb90 tx=0x7f3420001aa0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 shutdown_connections 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3414066f30 0x7f34140693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ca0 0x7f3428069c00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f342806d120 0x7f3428153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 --2- 172.21.15.6:0/2225349206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34281578d0 0x7f3428158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 >> 172.21.15.6:0/2225349206 conn(0x7f342806bb90 msgr2=0x7f342806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 shutdown_connections 2023-10-09T11:37:55.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.181+0000 7f342f895700 1 -- 172.21.15.6:0/2225349206 wait complete. 2023-10-09T11:37:55.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:37:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.314+0000 7fa02037a700 1 Processor -- start 2023-10-09T11:37:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.314+0000 7fa02037a700 1 -- start start 2023-10-09T11:37:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa02037a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa018157ca0 0x7fa0180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa02037a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa01806d120 0x7fa01806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa02037a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180d07c0 con 0x7fa0181578d0 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa02037a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01806da50 con 0x7fa018157ca0 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa02037a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180cfbb0 con 0x7fa01806d120 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa01d915700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa018157ca0 0x7fa0180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.315+0000 7fa01d915700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa018157ca0 0x7fa0180cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32806/0 (socket says 172.21.15.6:32806) 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 -- 172.21.15.6:0/2579954871 learned_addr learned my addr 172.21.15.6:0/2579954871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01e917700 1 --2- 172.21.15.6:0/2579954871 >> v2:172.21.15.118:3300/0 conn(0x7fa01806d120 0x7fa01806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 -- 172.21.15.6:0/2579954871 >> v2:172.21.15.118:3300/0 conn(0x7fa01806d120 msgr2=0x7fa01806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 --2- 172.21.15.6:0/2579954871 >> v2:172.21.15.118:3300/0 conn(0x7fa01806d120 0x7fa01806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 -- 172.21.15.6:0/2579954871 >> v1:172.21.15.118:6789/0 conn(0x7fa0181578d0 legacy=0x7fa01815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 -- 172.21.15.6:0/2579954871 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180cfe90 con 0x7fa018157ca0 2023-10-09T11:37:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d915700 1 --2- 172.21.15.6:0/2579954871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018157ca0 0x7fa0180cf4f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa018068300 tx=0x7fa00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0432d0893ad4f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d114700 1 -- 172.21.15.6:0/2579954871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c009e70 con 0x7fa018157ca0 2023-10-09T11:37:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d114700 1 -- 172.21.15.6:0/2579954871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00b860 con 0x7fa018157ca0 2023-10-09T11:37:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.316+0000 7fa01d114700 1 -- 172.21.15.6:0/2579954871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00bc00 con 0x7fa018157ca0 2023-10-09T11:37:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 -- 172.21.15.6:0/2579954871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018157ca0 msgr2=0x7fa0180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 --2- 172.21.15.6:0/2579954871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018157ca0 0x7fa0180cf4f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa018068300 tx=0x7fa00c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 -- 172.21.15.6:0/2579954871 shutdown_connections 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 --2- 172.21.15.6:0/2579954871 >> v2:172.21.15.118:3300/0 conn(0x7fa01806d120 0x7fa01806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 --2- 172.21.15.6:0/2579954871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa018157ca0 0x7fa0180cf4f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 -- 172.21.15.6:0/2579954871 >> 172.21.15.6:0/2579954871 conn(0x7fa01806bb90 msgr2=0x7fa01806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 -- 172.21.15.6:0/2579954871 shutdown_connections 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.317+0000 7fa02037a700 1 -- 172.21.15.6:0/2579954871 wait complete. 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.318+0000 7fa02037a700 1 Processor -- start 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.318+0000 7fa02037a700 1 -- start start 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0181578d0 0x7fa0180b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa018157ca0 0x7fa0180acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180ac390 con 0x7fa01806d120 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018154260 con 0x7fa0181578d0 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01816e650 con 0x7fa018157ca0 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32810/0 (socket says 172.21.15.6:32810) 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 -- 172.21.15.6:0/609422402 learned_addr learned my addr 172.21.15.6:0/609422402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01d915700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0181578d0 0x7fa0180b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e917700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa018157ca0 0x7fa0180acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 -- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa018157ca0 msgr2=0x7fa0180acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa018157ca0 0x7fa0180acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 -- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0181578d0 msgr2=0x7fa0180b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0181578d0 0x7fa0180b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 -- 172.21.15.6:0/609422402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0094f0 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa01e116700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c590 tx=0x7fa01000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010011590 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa010011710 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010011ad0 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01816e8f0 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.319+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180ac8c0 con 0x7fa01806d120 2023-10-09T11:37:55.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.320+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180acab0 con 0x7fa01806d120 2023-10-09T11:37:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.321+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa01001b3b0 con 0x7fa01806d120 2023-10-09T11:37:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.321+0000 7fa0167fc700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 0x7fa0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.321+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa010083aa0 con 0x7fa01806d120 2023-10-09T11:37:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.321+0000 7fa01d915700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 0x7fa0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.322+0000 7fa01d915700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 0x7fa0040693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa018068300 tx=0x7fa00c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.325+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa010050cd0 con 0x7fa01806d120 2023-10-09T11:37:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.515+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0180d0170 con 0x7fa01806d120 2023-10-09T11:37:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.516+0000 7fa0167fc700 1 -- 172.21.15.6:0/609422402 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa010017070 con 0x7fa01806d120 2023-10-09T11:37:55.518 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 msgr2=0x7fa0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 0x7fa0040693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa018068300 tx=0x7fa00c017000 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 msgr2=0x7fa0181556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa01000c590 tx=0x7fa01000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 shutdown_connections 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa004066f30 0x7fa0040693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa018157ca0 0x7fa0180acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa01806d120 0x7fa0181556d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 --2- 172.21.15.6:0/609422402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0181578d0 0x7fa0180b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 >> 172.21.15.6:0/609422402 conn(0x7fa01806bb90 msgr2=0x7fa018068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 shutdown_connections 2023-10-09T11:37:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.518+0000 7fa02037a700 1 -- 172.21.15.6:0/609422402 wait complete. 2023-10-09T11:37:55.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 Processor -- start 2023-10-09T11:37:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 -- start start 2023-10-09T11:37:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a00cf240 0x7f11a00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11a006d650 0x7f11a006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00b0ca0 con 0x7f11a015a2a0 2023-10-09T11:37:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a006ea90 con 0x7f11a006d650 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.648+0000 7f11a679a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00b00d0 con 0x7f11a00cf240 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11a006d650 0x7f11a006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11a006d650 0x7f11a006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32818/0 (socket says 172.21.15.6:32818) 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 -- 172.21.15.6:0/1936022119 learned_addr learned my addr 172.21.15.6:0/1936022119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f119f7fe700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a00cf240 0x7f11a00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 -- 172.21.15.6:0/1936022119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a00cf240 msgr2=0x7f11a00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a00cf240 0x7f11a00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 -- 172.21.15.6:0/1936022119 >> v1:172.21.15.118:6789/0 conn(0x7f11a015a2a0 legacy=0x7f11a00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 -- 172.21.15.6:0/1936022119 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a00b0370 con 0x7f11a006d650 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f11a4d37700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a006da90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1198009f20 tx=0x7f1198009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf2c1aa6d75973 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f119effd700 1 -- 172.21.15.6:0/1936022119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119800e070 con 0x7f11a006d650 2023-10-09T11:37:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f119effd700 1 -- 172.21.15.6:0/1936022119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119800ba80 con 0x7f11a006d650 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.649+0000 7f119effd700 1 -- 172.21.15.6:0/1936022119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980092e0 con 0x7f11a006d650 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 -- 172.21.15.6:0/1936022119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 msgr2=0x7f11a006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a006da90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1198009f20 tx=0x7f1198009840 comp rx=0 tx=0).stop 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 -- 172.21.15.6:0/1936022119 shutdown_connections 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a006da90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 --2- 172.21.15.6:0/1936022119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a00cf240 0x7f11a00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 -- 172.21.15.6:0/1936022119 >> 172.21.15.6:0/1936022119 conn(0x7f11a0067640 msgr2=0x7f11a0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 -- 172.21.15.6:0/1936022119 shutdown_connections 2023-10-09T11:37:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.650+0000 7f11a679a700 1 -- 172.21.15.6:0/1936022119 wait complete. 2023-10-09T11:37:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.651+0000 7f11a679a700 1 Processor -- start 2023-10-09T11:37:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.651+0000 7f11a679a700 1 -- start start 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 0x7f11a0142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a015a2a0 0x7f11a015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a015e1d0 con 0x7f11a006d650 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0142a20 con 0x7f11a00cf240 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a679a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a015d5c0 con 0x7f11a015a2a0 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32820/0 (socket says 172.21.15.6:32820) 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 -- 172.21.15.6:0/1582459224 learned_addr learned my addr 172.21.15.6:0/1582459224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119f7fe700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 0x7f11a0142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f11a4d37700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a015a2a0 0x7f11a015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 -- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a015a2a0 msgr2=0x7f11a015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a015a2a0 0x7f11a015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 -- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 msgr2=0x7f11a0142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 0x7f11a0142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 -- 172.21.15.6:0/1582459224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198009ae0 con 0x7f11a006d650 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119f7fe700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 0x7f11a0142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.652+0000 7f119ffff700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f119000c4e0 tx=0x7f119000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.653+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011590 con 0x7f11a006d650 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.653+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190011710 con 0x7f11a006d650 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.653+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a015d8a0 con 0x7f11a006d650 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.653+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011ad0 con 0x7f11a006d650 2023-10-09T11:37:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.653+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a015de60 con 0x7f11a006d650 2023-10-09T11:37:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.654+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a0064650 con 0x7f11a006d650 2023-10-09T11:37:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.654+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f119001b3b0 con 0x7f11a006d650 2023-10-09T11:37:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.655+0000 7f1187fff700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.655+0000 7f119f7fe700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.655+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1190083980 con 0x7f11a006d650 2023-10-09T11:37:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.655+0000 7f119f7fe700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1194006fd0 tx=0x7f1194008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.659+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1190050bb0 con 0x7f11a006d650 2023-10-09T11:37:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.899+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11a004bb80 con 0x7f11a006d650 2023-10-09T11:37:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.899+0000 7f1187fff700 1 -- 172.21.15.6:0/1582459224 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1190017070 con 0x7f11a006d650 2023-10-09T11:37:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:55.901 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 msgr2=0x7f118c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1194006fd0 tx=0x7f1194008040 comp rx=0 tx=0).stop 2023-10-09T11:37:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 msgr2=0x7f11a01424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f119000c4e0 tx=0x7f119000c7f0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 shutdown_connections 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11a015a2a0 0x7f11a015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a006d650 0x7f11a01424e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 --2- 172.21.15.6:0/1582459224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11a00cf240 0x7f11a0142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 >> 172.21.15.6:0/1582459224 conn(0x7f11a0067640 msgr2=0x7f11a0157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 shutdown_connections 2023-10-09T11:37:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:55.902+0000 7f11a679a700 1 -- 172.21.15.6:0/1582459224 wait complete. 2023-10-09T11:37:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:55.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.032+0000 7fb27359e700 1 Processor -- start 2023-10-09T11:37:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.032+0000 7fb27359e700 1 -- start start 2023-10-09T11:37:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2740cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740cee10 con 0x7fb274068e90 2023-10-09T11:37:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27359e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740cd040 con 0x7fb274159f10 2023-10-09T11:37:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740cd320 con 0x7fb274159b40 2023-10-09T11:37:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb272d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb274068e90 0x7fb2740cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53542/0 (socket says 172.21.15.6:53542) 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb272d9d700 1 -- 172.21.15.6:0/4115730207 learned_addr learned my addr 172.21.15.6:0/4115730207 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27259c700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2740cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.033+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328091791 0 0) 0x7fb2740cee10 con 0x7fb274068e90 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb260003570 con 0x7fb274068e90 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2609454309 0 0) 0x7fb260003570 con 0x7fb274068e90 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 msgr2=0x7fb2740cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2740cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 >> v1:172.21.15.118:6789/0 conn(0x7fb274159f10 legacy=0x7fb274068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740ce7c0 con 0x7fb274068e90 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fb2640017f0 con 0x7fb274068e90 2023-10-09T11:37:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 >> v1:172.21.15.6:6789/0 conn(0x7fb274068e90 legacy=0x7fb2740cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb260003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb260004810 0x7fb260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740cd320 con 0x7fb260003a90 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26000bb10 con 0x7fb260004810 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26000bcd0 con 0x7fb274159b40 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb260003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb271d9b700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb260004810 0x7fb260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb272d9d700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 -- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 msgr2=0x7fb2600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb274159b40 0x7fb2600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 -- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb260004810 msgr2=0x7fb260004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb260004810 0x7fb260004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 -- 172.21.15.6:0/4115730207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260003570 con 0x7fb260003a90 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.034+0000 7fb27259c700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb260003e60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009c00 tx=0x7fb26c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86996574e744886e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00e710 con 0x7fb260003a90 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00e870 con 0x7fb260003a90 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27159a700 1 -- 172.21.15.6:0/4115730207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00ec30 con 0x7fb260003a90 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 -- 172.21.15.6:0/4115730207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 msgr2=0x7fb260003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 --2- 172.21.15.6:0/4115730207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb260003e60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009c00 tx=0x7fb26c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb272d9d700 1 -- 172.21.15.6:0/4115730207 reap_dead start 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 -- 172.21.15.6:0/4115730207 shutdown_connections 2023-10-09T11:37:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 -- 172.21.15.6:0/4115730207 >> 172.21.15.6:0/4115730207 conn(0x7fb2740cd660 msgr2=0x7fb2740cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 -- 172.21.15.6:0/4115730207 shutdown_connections 2023-10-09T11:37:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.035+0000 7fb27359e700 1 -- 172.21.15.6:0/4115730207 wait complete. 2023-10-09T11:37:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.036+0000 7fb27359e700 1 Processor -- start 2023-10-09T11:37:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.036+0000 7fb27359e700 1 -- start start 2023-10-09T11:37:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 0x7fb27415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb27415e090 0x7fb27416a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27416b680 con 0x7fb260003a90 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27415e530 con 0x7fb27415e090 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740b4180 con 0x7fb2740b4610 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32846/0 (socket says 172.21.15.6:32846) 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb27259c700 1 -- 172.21.15.6:0/1849519933 learned_addr learned my addr 172.21.15.6:0/1849519933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.037+0000 7fb272d9d700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb27415e090 0x7fb27416a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb271d9b700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 0x7fb27415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 -- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 msgr2=0x7fb27415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 0x7fb27415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 -- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb27415e090 msgr2=0x7fb27416a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb27415e090 0x7fb27416a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 -- 172.21.15.6:0/1849519933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740c94b0 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb271d9b700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 0x7fb27415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27259c700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb260004770 tx=0x7fb26c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c022070 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00ebf0 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27416b3a0 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0276c0 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.038+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2740b3e10 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.039+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2740b3990 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.039+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb26c01c450 con 0x7fb260003a90 2023-10-09T11:37:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.040+0000 7fb26a7fc700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.040+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb26c086080 con 0x7fb260003a90 2023-10-09T11:37:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.040+0000 7fb271d9b700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.040+0000 7fb271d9b700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 0x7fb2540693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007ba0 tx=0x7fb25c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.044+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2740b3990 con 0x7fb260003a90 2023-10-09T11:37:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.242+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2740b3990 con 0x7fb260003a90 2023-10-09T11:37:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.243+0000 7fb26a7fc700 1 -- 172.21.15.6:0/1849519933 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15397 (secure 0 0 0) 0x7fb2740b3990 con 0x7fb260003a90 2023-10-09T11:37:56.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:56.245 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":51,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:54.052126+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 msgr2=0x7fb2540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 0x7fb2540693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007ba0 tx=0x7fb25c009040 comp rx=0 tx=0).stop 2023-10-09T11:37:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 msgr2=0x7fb2740c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb260004770 tx=0x7fb26c01a000 comp rx=0 tx=0).stop 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 shutdown_connections 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb27415e090 0x7fb27416a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb260003a90 0x7fb2740c8f70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 --2- 172.21.15.6:0/1849519933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2740b4610 0x7fb27415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 >> 172.21.15.6:0/1849519933 conn(0x7fb2740cd660 msgr2=0x7fb2740b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 shutdown_connections 2023-10-09T11:37:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.245+0000 7fb27359e700 1 -- 172.21.15.6:0/1849519933 wait complete. 2023-10-09T11:37:56.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:37:56.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.376+0000 7f3924b93700 1 Processor -- start 2023-10-09T11:37:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.376+0000 7f3924b93700 1 -- start start 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f3924b93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39200ce1f0 0x7f39200aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f3924b93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f392015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f3924b93700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392015dfb0 con 0x7f39200ac570 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f3924b93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39200acec0 con 0x7f39200ce1f0 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f3924b93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200ad1a0 con 0x7f39200ce5c0 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f391ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39200ac570 0x7f392006e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53558/0 (socket says 172.21.15.6:53558) 2023-10-09T11:37:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.377+0000 7f391ed9d700 1 -- 172.21.15.6:0/1363284185 learned_addr learned my addr 172.21.15.6:0/1363284185 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391e59c700 1 --2- 172.21.15.6:0/1363284185 >> v2:172.21.15.118:3300/0 conn(0x7f39200ce1f0 0x7f39200aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f392015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844992756 0 0) 0x7f392015dfb0 con 0x7f39200ac570 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f390c003570 con 0x7f39200ac570 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205250216 0 0) 0x7f390c003570 con 0x7f39200ac570 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 msgr2=0x7f392015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f392015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 >> v2:172.21.15.118:3300/0 conn(0x7f39200ce1f0 msgr2=0x7f39200aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 --2- 172.21.15.6:0/1363284185 >> v2:172.21.15.118:3300/0 conn(0x7f39200ce1f0 0x7f39200aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392015dc40 con 0x7f39200ac570 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f39100017f0 con 0x7f39200ac570 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 >> v1:172.21.15.6:6789/0 conn(0x7f39200ac570 legacy=0x7f392006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c003a60 0x7f390c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f390c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f390c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200acec0 con 0x7f390c004810 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200ad1a0 con 0x7f390c003a60 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c00ba60 con 0x7f39200ce5c0 2023-10-09T11:37:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f390c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391e59c700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c003a60 0x7f390c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391ed9d700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f390c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 -- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 msgr2=0x7f390c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39200ce5c0 0x7f390c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 -- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c003a60 msgr2=0x7f390c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c003a60 0x7f390c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.378+0000 7f391dd9b700 1 -- 172.21.15.6:0/1363284185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c003570 con 0x7f390c004810 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f391dd9b700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f390c004c80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3908009c30 tx=0x7f39080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d655492b9cbadd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800e710 con 0x7f390c004810 2023-10-09T11:37:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800e870 con 0x7f390c004810 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f391d59a700 1 -- 172.21.15.6:0/1363284185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800ec30 con 0x7f390c004810 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 -- 172.21.15.6:0/1363284185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 msgr2=0x7f390c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 --2- 172.21.15.6:0/1363284185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f390c004c80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3908009c30 tx=0x7f39080091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f391ed9d700 1 -- 172.21.15.6:0/1363284185 reap_dead start 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 -- 172.21.15.6:0/1363284185 shutdown_connections 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 -- 172.21.15.6:0/1363284185 >> 172.21.15.6:0/1363284185 conn(0x7f392006cca0 msgr2=0x7f392006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 -- 172.21.15.6:0/1363284185 shutdown_connections 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.379+0000 7f3924b93700 1 -- 172.21.15.6:0/1363284185 wait complete. 2023-10-09T11:37:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.380+0000 7f3924b93700 1 Processor -- start 2023-10-09T11:37:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.380+0000 7f3924b93700 1 -- start start 2023-10-09T11:37:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 0x7f392015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392015bb50 0x7f392015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392015fc00 con 0x7f390c004810 2023-10-09T11:37:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392015c510 con 0x7f392015d2c0 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f3924b93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392015eff0 con 0x7f392015bb50 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32866/0 (socket says 172.21.15.6:32866) 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 -- 172.21.15.6:0/680078762 learned_addr learned my addr 172.21.15.6:0/680078762 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391dd9b700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 0x7f392015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391ed9d700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392015bb50 0x7f392015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 -- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392015bb50 msgr2=0x7f392015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392015bb50 0x7f392015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 -- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 msgr2=0x7f392015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.381+0000 7f391e59c700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 0x7f392015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f391e59c700 1 -- 172.21.15.6:0/680078762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392015f2d0 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f391dd9b700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 0x7f392015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f391e59c700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3918011d40 tx=0x7f39180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800fac0 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800fc20 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392015f5b0 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918014440 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.382+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392015eca0 con 0x7f390c004810 2023-10-09T11:37:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.383+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3920068900 con 0x7f390c004810 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.384+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3918014a80 con 0x7f390c004810 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.384+0000 7f39167fc700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 0x7f3900069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.384+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3918018030 con 0x7f390c004810 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.384+0000 7f391dd9b700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 0x7f3900069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.385+0000 7f391dd9b700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 0x7f3900069460 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39080091e0 tx=0x7f390801a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.387+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3918052aa0 con 0x7f390c004810 2023-10-09T11:37:56.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.623+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39200aca10 con 0x7f390c004810 2023-10-09T11:37:56.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.623+0000 7f39167fc700 1 -- 172.21.15.6:0/680078762 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f39180560c0 con 0x7f390c004810 2023-10-09T11:37:56.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:56.625 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:56.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.625+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 msgr2=0x7f3900069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.625+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 0x7f3900069460 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39080091e0 tx=0x7f390801a000 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.625+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 msgr2=0x7f392014f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.625+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3918011d40 tx=0x7f39180091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 shutdown_connections 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3900066fb0 0x7f3900069460 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f392015bb50 0x7f392015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f390c004810 0x7f392014f690 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 --2- 172.21.15.6:0/680078762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f392015d2c0 0x7f392015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 >> 172.21.15.6:0/680078762 conn(0x7f392006cca0 msgr2=0x7f3920157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 shutdown_connections 2023-10-09T11:37:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.626+0000 7f3924b93700 1 -- 172.21.15.6:0/680078762 wait complete. 2023-10-09T11:37:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:56.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:37:56.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.756+0000 7f6768c49700 1 Processor -- start 2023-10-09T11:37:56.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.756+0000 7f6768c49700 1 -- start start 2023-10-09T11:37:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6768c49700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f676415daa0 0x7f676415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6768c49700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f67640cae00 0x7f6764159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6768c49700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676406d350 con 0x7f67640cb2a0 2023-10-09T11:37:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6768c49700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640c9ac0 con 0x7f676415daa0 2023-10-09T11:37:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6768c49700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676415e3b0 con 0x7f67640cae00 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f676259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f676415daa0 0x7f676415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f676259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f676415daa0 0x7f676415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32874/0 (socket says 172.21.15.6:32874) 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f676259c700 1 -- 172.21.15.6:0/714767687 learned_addr learned my addr 172.21.15.6:0/714767687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.757+0000 7f6761d9b700 1 --2- 172.21.15.6:0/714767687 >> v2:172.21.15.118:3300/0 conn(0x7f67640cae00 0x7f6764159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676259c700 1 -- 172.21.15.6:0/714767687 >> v2:172.21.15.118:3300/0 conn(0x7f67640cae00 msgr2=0x7f6764159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676259c700 1 --2- 172.21.15.6:0/714767687 >> v2:172.21.15.118:3300/0 conn(0x7f67640cae00 0x7f6764159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676259c700 1 -- 172.21.15.6:0/714767687 >> v1:172.21.15.118:6789/0 conn(0x7f67640cb2a0 legacy=0x7f6764159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676259c700 1 -- 172.21.15.6:0/714767687 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676406c740 con 0x7f676415daa0 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676259c700 1 --2- 172.21.15.6:0/714767687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f676415daa0 0x7f676415de70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6764067cb0 tx=0x7f675c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed3dca6b34eca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676159a700 1 -- 172.21.15.6:0/714767687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00b820 con 0x7f676415daa0 2023-10-09T11:37:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676159a700 1 -- 172.21.15.6:0/714767687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00b980 con 0x7f676415daa0 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f676159a700 1 -- 172.21.15.6:0/714767687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00bd20 con 0x7f676415daa0 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 -- 172.21.15.6:0/714767687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f676415daa0 msgr2=0x7f676415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 --2- 172.21.15.6:0/714767687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f676415daa0 0x7f676415de70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6764067cb0 tx=0x7f675c009250 comp rx=0 tx=0).stop 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 -- 172.21.15.6:0/714767687 shutdown_connections 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 --2- 172.21.15.6:0/714767687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f676415daa0 0x7f676415de70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 --2- 172.21.15.6:0/714767687 >> v2:172.21.15.118:3300/0 conn(0x7f67640cae00 0x7f6764159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.758+0000 7f6768c49700 1 -- 172.21.15.6:0/714767687 >> 172.21.15.6:0/714767687 conn(0x7f67640c9ca0 msgr2=0x7f67640ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.759+0000 7f6768c49700 1 -- 172.21.15.6:0/714767687 shutdown_connections 2023-10-09T11:37:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.759+0000 7f6768c49700 1 -- 172.21.15.6:0/714767687 wait complete. 2023-10-09T11:37:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 Processor -- start 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 -- start start 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67640cb2a0 0x7f67640c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f676415daa0 0x7f676416d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676416e5c0 con 0x7f67640cae00 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640c4780 con 0x7f67640cb2a0 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f6768c49700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676416e000 con 0x7f676415daa0 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f676259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f676259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32882/0 (socket says 172.21.15.6:32882) 2023-10-09T11:37:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.760+0000 7f676259c700 1 -- 172.21.15.6:0/4142370512 learned_addr learned my addr 172.21.15.6:0/4142370512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 -- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f676415daa0 msgr2=0x7f676416d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f676415daa0 0x7f676416d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 -- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67640cb2a0 msgr2=0x7f67640c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67640cb2a0 0x7f67640c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 -- 172.21.15.6:0/4142370512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0094f0 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f676259c700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f675c009290 tx=0x7f675c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c011e20 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c020070 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676416e2e0 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c01b6a0 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.761+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676415ab80 con 0x7f67640cae00 2023-10-09T11:37:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.762+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764068080 con 0x7f67640cae00 2023-10-09T11:37:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.762+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f675c022030 con 0x7f67640cae00 2023-10-09T11:37:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.763+0000 7f675a7fc700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 0x7f67440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.763+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f675c0863d0 con 0x7f67640cae00 2023-10-09T11:37:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.763+0000 7f6761d9b700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 0x7f67440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.763+0000 7f6761d9b700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 0x7f67440693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67640c3100 tx=0x7f674c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:56.767+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f675c053600 con 0x7f67640cae00 2023-10-09T11:37:57.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.006+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f676404bb80 con 0x7f67640cae00 2023-10-09T11:37:57.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.007+0000 7f675a7fc700 1 -- 172.21.15.6:0/4142370512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f675c056c20 con 0x7f67640cae00 2023-10-09T11:37:57.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:57.008 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:37:21.645715+0000","modified":"2023-10-09T11:37:25.271891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2630156228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2630156228},{"type":"v1","addr":"172.21.15.6:6837","nonce":2630156228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 msgr2=0x7f67440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 0x7f67440693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67640c3100 tx=0x7f674c008040 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 msgr2=0x7f676415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f675c009290 tx=0x7f675c016000 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 shutdown_connections 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6744066f30 0x7f67440693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f676415daa0 0x7f676416d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67640cae00 0x7f676415a640 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 --2- 172.21.15.6:0/4142370512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67640cb2a0 0x7f67640c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 >> 172.21.15.6:0/4142370512 conn(0x7f67640c9ca0 msgr2=0x7f67640cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 shutdown_connections 2023-10-09T11:37:57.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.009+0000 7f6768c49700 1 -- 172.21.15.6:0/4142370512 wait complete. 2023-10-09T11:37:57.012 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-10-09T11:37:57.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:37:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.140+0000 7fb438546700 1 Processor -- start 2023-10-09T11:37:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.140+0000 7fb438546700 1 -- start start 2023-10-09T11:37:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb438546700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb4300c78e0 0x7fb4300698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb438546700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4300cb880 con 0x7fb430069440 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb438546700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4300cac70 con 0x7fb430156420 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb438546700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43006aa10 con 0x7fb4300c78e0 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb435ae1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb430069440 0x7fb4300c71d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53570/0 (socket says 172.21.15.6:53570) 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.141+0000 7fb435ae1700 1 -- 172.21.15.6:0/1314266259 learned_addr learned my addr 172.21.15.6:0/1314266259 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb436ae3700 1 --2- 172.21.15.6:0/1314266259 >> v2:172.21.15.118:3300/0 conn(0x7fb4300c78e0 0x7fb4300698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818769431 0 0) 0x7fb4300cb880 con 0x7fb430069440 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb418003570 con 0x7fb430069440 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566885600 0 0) 0x7fb4300cac70 con 0x7fb430156420 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4300cb880 con 0x7fb430156420 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 696132872 0 0) 0x7fb418003570 con 0x7fb430069440 2023-10-09T11:37:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb436ae3700 1 -- 172.21.15.6:0/1314266259 >> v1:172.21.15.118:6789/0 conn(0x7fb430156420 legacy=0x7fb4300cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb436ae3700 1 -- 172.21.15.6:0/1314266259 >> v1:172.21.15.6:6789/0 conn(0x7fb430069440 legacy=0x7fb4300c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb436ae3700 1 -- 172.21.15.6:0/1314266259 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300caf50 con 0x7fb4300c78e0 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb436ae3700 1 --2- 172.21.15.6:0/1314266259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4300c78e0 0x7fb4300698b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb4280098e0 tx=0x7fb4280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df453f24f960e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424001470 con 0x7fb4300c78e0 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb428011420 con 0x7fb4300c78e0 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.142+0000 7fb4352e0700 1 -- 172.21.15.6:0/1314266259 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280117c0 con 0x7fb4300c78e0 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 -- 172.21.15.6:0/1314266259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4300c78e0 msgr2=0x7fb4300698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 --2- 172.21.15.6:0/1314266259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4300c78e0 0x7fb4300698b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb4280098e0 tx=0x7fb4280091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 -- 172.21.15.6:0/1314266259 shutdown_connections 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 --2- 172.21.15.6:0/1314266259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4300c78e0 0x7fb4300698b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 -- 172.21.15.6:0/1314266259 >> 172.21.15.6:0/1314266259 conn(0x7fb43006c660 msgr2=0x7fb4300cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 -- 172.21.15.6:0/1314266259 shutdown_connections 2023-10-09T11:37:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.143+0000 7fb438546700 1 -- 172.21.15.6:0/1314266259 wait complete. 2023-10-09T11:37:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.144+0000 7fb438546700 1 Processor -- start 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.144+0000 7fb438546700 1 -- start start 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb430069440 0x7fb430166a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4300c78e0 0x7fb430159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430167340 con 0x7fb430156420 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430167620 con 0x7fb430069440 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb438546700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb430158880 con 0x7fb4300c78e0 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32888/0 (socket says 172.21.15.6:32888) 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 -- 172.21.15.6:0/1128938098 learned_addr learned my addr 172.21.15.6:0/1128938098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb435ae1700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4300c78e0 0x7fb430159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb4362e2700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb430069440 0x7fb430166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 -- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4300c78e0 msgr2=0x7fb430159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4300c78e0 0x7fb430159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 -- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb430069440 msgr2=0x7fb430166a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb430069440 0x7fb430166a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.145+0000 7fb436ae3700 1 -- 172.21.15.6:0/1128938098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009420 con 0x7fb430156420 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb436ae3700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb4280093f0 tx=0x7fb428016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42801cca0 con 0x7fb430156420 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42801ce00 con 0x7fb430156420 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb430158b60 con 0x7fb430156420 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42801a6a0 con 0x7fb430156420 2023-10-09T11:37:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.146+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb430167110 con 0x7fb430156420 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.147+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430158d80 con 0x7fb430156420 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.147+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb42801aa10 con 0x7fb430156420 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.147+0000 7fb42e7fc700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 0x7fb41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.148+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb428086240 con 0x7fb430156420 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.148+0000 7fb4362e2700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 0x7fb41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.148+0000 7fb4362e2700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 0x7fb41c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4200040a0 tx=0x7fb420007f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.152+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb428053470 con 0x7fb430156420 2023-10-09T11:37:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.347+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb43004bb80 con 0x7fb430156420 2023-10-09T11:37:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.348+0000 7fb42e7fc700 1 -- 172.21.15.6:0/1128938098 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15397 (secure 0 0 0) 0x7fb428056a90 con 0x7fb430156420 2023-10-09T11:37:57.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:37:57.350 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":51,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:37:54.052126+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:37:20.052658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-09T11:37:20.612907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 msgr2=0x7fb41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 0x7fb41c0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4200040a0 tx=0x7fb420007f90 comp rx=0 tx=0).stop 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 msgr2=0x7fb430154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb4280093f0 tx=0x7fb428016000 comp rx=0 tx=0).stop 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 shutdown_connections 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb41c066f30 0x7fb41c0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb430156420 0x7fb430154430 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb430069440 0x7fb430166a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 --2- 172.21.15.6:0/1128938098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4300c78e0 0x7fb430159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 >> 172.21.15.6:0/1128938098 conn(0x7fb43006c660 msgr2=0x7fb4301552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 shutdown_connections 2023-10-09T11:37:57.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.350+0000 7fb438546700 1 -- 172.21.15.6:0/1128938098 wait complete. 2023-10-09T11:37:57.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:37:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.482+0000 7fcdf324e700 1 Processor -- start 2023-10-09T11:37:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.482+0000 7fcdf324e700 1 -- start start 2023-10-09T11:37:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdf324e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcdec06d830 0x7fcdec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdf324e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0d07c0 con 0x7fcdec157ca0 2023-10-09T11:37:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdf324e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0cfbb0 con 0x7fcdec1578d0 2023-10-09T11:37:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdf324e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdec0cfe90 con 0x7fcdec06d830 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdebfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcdec157ca0 0x7fcdec06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53576/0 (socket says 172.21.15.6:53576) 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdebfff700 1 -- 172.21.15.6:0/1937582890 learned_addr learned my addr 172.21.15.6:0/1937582890 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdf17eb700 1 --2- 172.21.15.6:0/1937582890 >> v2:172.21.15.118:3300/0 conn(0x7fcdec06d830 0x7fcdec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098666135 0 0) 0x7fcdec0d07c0 con 0x7fcdec157ca0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.483+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd4003570 con 0x7fcdec157ca0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714697301 0 0) 0x7fcdec0cfbb0 con 0x7fcdec1578d0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdec0d07c0 con 0x7fcdec1578d0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2416671463 0 0) 0x7fcdd4003570 con 0x7fcdec157ca0 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdf17eb700 1 -- 172.21.15.6:0/1937582890 >> v1:172.21.15.118:6789/0 conn(0x7fcdec1578d0 legacy=0x7fcdec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdf17eb700 1 -- 172.21.15.6:0/1937582890 >> v1:172.21.15.6:6789/0 conn(0x7fcdec157ca0 legacy=0x7fcdec06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdf17eb700 1 -- 172.21.15.6:0/1937582890 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0d0170 con 0x7fcdec06d830 2023-10-09T11:37:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdf17eb700 1 --2- 172.21.15.6:0/1937582890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec06d830 0x7fcdec0cf4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009e60 tx=0x7fcde4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2376d5ca0ff5a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde400e070 con 0x7fcdec06d830 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde400b7a0 con 0x7fcdec06d830 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.484+0000 7fcdeb7fe700 1 -- 172.21.15.6:0/1937582890 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0001470 con 0x7fcdec06d830 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 -- 172.21.15.6:0/1937582890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec06d830 msgr2=0x7fcdec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 --2- 172.21.15.6:0/1937582890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec06d830 0x7fcdec0cf4f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009e60 tx=0x7fcde4009780 comp rx=0 tx=0).stop 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 -- 172.21.15.6:0/1937582890 shutdown_connections 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 --2- 172.21.15.6:0/1937582890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec06d830 0x7fcdec0cf4f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 -- 172.21.15.6:0/1937582890 >> 172.21.15.6:0/1937582890 conn(0x7fcdec06bb90 msgr2=0x7fcdec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 -- 172.21.15.6:0/1937582890 shutdown_connections 2023-10-09T11:37:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.485+0000 7fcdf324e700 1 -- 172.21.15.6:0/1937582890 wait complete. 2023-10-09T11:37:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.486+0000 7fcdf324e700 1 Processor -- start 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.486+0000 7fcdf324e700 1 -- start start 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdec1578d0 0x7fcdec16bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec157ca0 0x7fcdec155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec16ba80 con 0x7fcdec06d830 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0c62a0 con 0x7fcdec157ca0 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec16b7a0 con 0x7fcdec1578d0 2023-10-09T11:37:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32898/0 (socket says 172.21.15.6:32898) 2023-10-09T11:37:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 -- 172.21.15.6:0/3315615525 learned_addr learned my addr 172.21.15.6:0/3315615525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdebfff700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdec1578d0 0x7fcdec16bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf17eb700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec157ca0 0x7fcdec155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 -- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdec1578d0 msgr2=0x7fcdec16bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdec1578d0 0x7fcdec16bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 -- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec157ca0 msgr2=0x7fcdec155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec157ca0 0x7fcdec155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 -- 172.21.15.6:0/3315615525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009a20 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf0fea700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00c7c0 tx=0x7fcddc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc010510 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc010670 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec0c5c50 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.487+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc010a10 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.488+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec16c1c0 con 0x7fcdec06d830 2023-10-09T11:37:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.488+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec067ac0 con 0x7fcdec06d830 2023-10-09T11:37:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.489+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcddc01b3b0 con 0x7fcdec06d830 2023-10-09T11:37:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.489+0000 7fcde8ff9700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 0x7fcdd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.489+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcddc083da0 con 0x7fcdec06d830 2023-10-09T11:37:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.489+0000 7fcdebfff700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 0x7fcdd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.490+0000 7fcdebfff700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 0x7fcdd80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0b62e0 tx=0x7fcde00011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.494+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcddc050fd0 con 0x7fcdec06d830 2023-10-09T11:37:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.735+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcdec0d0450 con 0x7fcdec06d830 2023-10-09T11:37:57.737 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:37:57.736+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:37:57.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.742+0000 7fcde8ff9700 1 -- 172.21.15.6:0/3315615525 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcddc017020 con 0x7fcdec06d830 2023-10-09T11:37:57.744 INFO:tasks.ceph.mds.a.smithi006.stderr: -8996> 2023-10-09T11:37:28.235+0000 7f8891961700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 msgr2=0x7fcdd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 0x7fcdd80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0b62e0 tx=0x7fcde00011a0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 msgr2=0x7fcdec0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00c7c0 tx=0x7fcddc007e10 comp rx=0 tx=0).stop 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 shutdown_connections 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcdd8066f30 0x7fcdd80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec157ca0 0x7fcdec155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdec06d830 0x7fcdec0c86a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 --2- 172.21.15.6:0/3315615525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdec1578d0 0x7fcdec16bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 >> 172.21.15.6:0/3315615525 conn(0x7fcdec06bb90 msgr2=0x7fcdec069970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 shutdown_connections 2023-10-09T11:37:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.744+0000 7fcdf324e700 1 -- 172.21.15.6:0/3315615525 wait complete. 2023-10-09T11:37:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:37:57.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:37:57.775 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:37:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.878+0000 7fc002592700 1 Processor -- start 2023-10-09T11:37:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 -- start start 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 0x7fbffc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbffc06d650 0x7fbffc06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc06ea90 con 0x7fbffc06d650 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0b0ca0 con 0x7fbffc15a2a0 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc002592700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0cf4c0 con 0x7fbffc0ceb30 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.879+0000 7fc000b2f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbffc06d650 0x7fbffc06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbffc06d650 0x7fbffc06da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32922/0 (socket says 172.21.15.6:32922) 2023-10-09T11:37:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 -- 172.21.15.6:0/3637601326 learned_addr learned my addr 172.21.15.6:0/3637601326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffb7fe700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffbfff700 1 --2- 172.21.15.6:0/3637601326 >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 0x7fbffc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 -- 172.21.15.6:0/3637601326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 msgr2=0x7fbffc0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 -- 172.21.15.6:0/3637601326 >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 msgr2=0x7fbffc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 --2- 172.21.15.6:0/3637601326 >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 0x7fbffc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 -- 172.21.15.6:0/3637601326 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc0b00d0 con 0x7fbffc06d650 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffbfff700 1 --2- 172.21.15.6:0/3637601326 >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 0x7fbffc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fc000b2f700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc06da70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0637a0 tx=0x7fbff4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af0ff93bc730a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffaffd700 1 -- 172.21.15.6:0/3637601326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400e070 con 0x7fbffc06d650 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffaffd700 1 -- 172.21.15.6:0/3637601326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff400ba20 con 0x7fbffc06d650 2023-10-09T11:37:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.880+0000 7fbffaffd700 1 -- 172.21.15.6:0/3637601326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff40092e0 con 0x7fbffc06d650 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 -- 172.21.15.6:0/3637601326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 msgr2=0x7fbffc06da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc06da70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0637a0 tx=0x7fbff4009840 comp rx=0 tx=0).stop 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 -- 172.21.15.6:0/3637601326 shutdown_connections 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc06da70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 --2- 172.21.15.6:0/3637601326 >> v2:172.21.15.118:3300/0 conn(0x7fbffc15a2a0 0x7fbffc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 --2- 172.21.15.6:0/3637601326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 -- 172.21.15.6:0/3637601326 >> 172.21.15.6:0/3637601326 conn(0x7fbffc067640 msgr2=0x7fbffc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 -- 172.21.15.6:0/3637601326 shutdown_connections 2023-10-09T11:37:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.881+0000 7fc002592700 1 -- 172.21.15.6:0/3637601326 wait complete. 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.882+0000 7fc002592700 1 Processor -- start 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.882+0000 7fc002592700 1 -- start start 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbffc15a2a0 0x7fbffc0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc156ef0 con 0x7fbffc06d650 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc15b240 con 0x7fbffc15a2a0 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc002592700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0cbc30 con 0x7fbffc0ceb30 2023-10-09T11:37:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32936/0 (socket says 172.21.15.6:32936) 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 -- 172.21.15.6:0/3993514161 learned_addr learned my addr 172.21.15.6:0/3993514161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffb7fe700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fc000b2f700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbffc15a2a0 0x7fbffc0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 -- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 msgr2=0x7fbffc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 -- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbffc15a2a0 msgr2=0x7fbffc0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbffc15a2a0 0x7fbffc0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 -- 172.21.15.6:0/3993514161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4009ae0 con 0x7fbffc06d650 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.883+0000 7fbffbfff700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400e8d0 tx=0x7fbfe4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.884+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4013410 con 0x7fbffc06d650 2023-10-09T11:37:57.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.884+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4013570 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.884+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc15a910 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.884+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4013910 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.884+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc15aed0 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.885+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc06b6d0 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.885+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfe4013d40 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.885+0000 7fbff3fff700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.886+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fbfe40842c0 con 0x7fbffc06d650 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.886+0000 7fbffb7fe700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:57.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.886+0000 7fbffb7fe700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 0x7fbfdc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbffc15c930 tx=0x7fbfec0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:57.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:57.890+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfe40514a0 con 0x7fbffc06d650 2023-10-09T11:37:58.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.130+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbffc14aea0 con 0x7fbffc06d650 2023-10-09T11:37:58.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.740+0000 7fbff3fff700 1 -- 172.21.15.6:0/3993514161 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbfe4054ac0 con 0x7fbffc06d650 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 msgr2=0x7fbfdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 0x7fbfdc0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbffc15c930 tx=0x7fbfec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 msgr2=0x7fbffc14a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfe400e8d0 tx=0x7fbfe4008040 comp rx=0 tx=0).stop 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 shutdown_connections 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbffc15a2a0 0x7fbffc0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbffc06d650 0x7fbffc14a900 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 --2- 172.21.15.6:0/3993514161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbffc0ceb30 0x7fbffc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 >> 172.21.15.6:0/3993514161 conn(0x7fbffc067640 msgr2=0x7fbffc0cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 shutdown_connections 2023-10-09T11:37:58.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.743+0000 7fc002592700 1 -- 172.21.15.6:0/3993514161 wait complete. 2023-10-09T11:37:58.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:37:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.922+0000 7f755b280700 1 Processor -- start 2023-10-09T11:37:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.922+0000 7f755b280700 1 -- start start 2023-10-09T11:37:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755b280700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75540d0b80 0x7f75540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755b280700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f755415b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755b280700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540cf2d0 con 0x7f75540d02b0 2023-10-09T11:37:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755b280700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755415a690 con 0x7f75540d0b80 2023-10-09T11:37:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755b280700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755406dc00 con 0x7f755406d700 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75540d0b80 0x7f75540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75540d0b80 0x7f75540cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32942/0 (socket says 172.21.15.6:32942) 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 -- 172.21.15.6:0/1839750326 learned_addr learned my addr 172.21.15.6:0/1839750326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 -- 172.21.15.6:0/1839750326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 msgr2=0x7f755415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755aa7f700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f755415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f755415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 -- 172.21.15.6:0/1839750326 >> v1:172.21.15.118:6789/0 conn(0x7f75540d02b0 legacy=0x7f755406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755a27e700 1 -- 172.21.15.6:0/1839750326 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540cf570 con 0x7f75540d0b80 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.923+0000 7f755aa7f700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f755415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:37:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755a27e700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f75540cfd70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7544009f20 tx=0x7f7544009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b988332455dad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755927c700 1 -- 172.21.15.6:0/1839750326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400e070 con 0x7f75540d0b80 2023-10-09T11:37:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755927c700 1 -- 172.21.15.6:0/1839750326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400ba40 con 0x7f75540d0b80 2023-10-09T11:37:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755927c700 1 -- 172.21.15.6:0/1839750326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440092e0 con 0x7f75540d0b80 2023-10-09T11:37:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 -- 172.21.15.6:0/1839750326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 msgr2=0x7f75540cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f75540cfd70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7544009f20 tx=0x7f7544009840 comp rx=0 tx=0).stop 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 -- 172.21.15.6:0/1839750326 shutdown_connections 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f755415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 --2- 172.21.15.6:0/1839750326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f75540cfd70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 -- 172.21.15.6:0/1839750326 >> 172.21.15.6:0/1839750326 conn(0x7f7554063230 msgr2=0x7f7554063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 -- 172.21.15.6:0/1839750326 shutdown_connections 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.924+0000 7f755b280700 1 -- 172.21.15.6:0/1839750326 wait complete. 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.925+0000 7f755b280700 1 Processor -- start 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.925+0000 7f755b280700 1 -- start start 2023-10-09T11:37:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f75540b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75540d02b0 0x7f75540ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540afe60 con 0x7f75540d0b80 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540af250 con 0x7f75540d02b0 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755b280700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540af530 con 0x7f755406d700 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755aa7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755aa7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32952/0 (socket says 172.21.15.6:32952) 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755aa7f700 1 -- 172.21.15.6:0/600423968 learned_addr learned my addr 172.21.15.6:0/600423968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f7559a7d700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75540d02b0 0x7f75540ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.926+0000 7f755a27e700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f75540b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 -- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 msgr2=0x7f75540b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f75540b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 -- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75540d02b0 msgr2=0x7f75540ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75540d02b0 0x7f75540ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 -- 172.21.15.6:0/600423968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009ae0 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755aa7f700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c880 tx=0x7f754c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c011600 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c011760 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75540af810 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c011b20 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.927+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540aee20 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.928+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540affd0 con 0x7f75540d0b80 2023-10-09T11:37:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.928+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f754c0223a0 con 0x7f75540d0b80 2023-10-09T11:37:58.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.929+0000 7f75527fc700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 0x7f75400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:37:58.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.929+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f754c084580 con 0x7f75540d0b80 2023-10-09T11:37:58.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.929+0000 7f755a27e700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 0x7f75400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:37:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.929+0000 7f755a27e700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 0x7f75400693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7544009880 tx=0x7f7544017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:37:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:58.933+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f754c051760 con 0x7f75540d0b80 2023-10-09T11:37:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:37:59.124+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75540676e0 con 0x7f75540d0b80 2023-10-09T11:38:00.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.084+0000 7f75527fc700 1 -- 172.21.15.6:0/600423968 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f754c054d80 con 0x7f75540d0b80 2023-10-09T11:38:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 msgr2=0x7f75400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 0x7f75400693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7544009880 tx=0x7f7544017000 comp rx=0 tx=0).stop 2023-10-09T11:38:00.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 msgr2=0x7f755406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c880 tx=0x7f754c008040 comp rx=0 tx=0).stop 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 shutdown_connections 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7540066f30 0x7f75400693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75540d0b80 0x7f755406bb90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755406d700 0x7f75540b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 --2- 172.21.15.6:0/600423968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75540d02b0 0x7f75540ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 >> 172.21.15.6:0/600423968 conn(0x7f7554063230 msgr2=0x7f755415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 shutdown_connections 2023-10-09T11:38:00.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.088+0000 7f755b280700 1 -- 172.21.15.6:0/600423968 wait complete. 2023-10-09T11:38:00.091 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:38:00.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:38:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.231+0000 7fbb88b93700 1 Processor -- start 2023-10-09T11:38:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.231+0000 7fbb88b93700 1 -- start start 2023-10-09T11:38:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.232+0000 7fbb88b93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 0x7fbb840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.232+0000 7fbb88b93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 0x7fbb8415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.232+0000 7fbb88b93700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840d07c0 con 0x7fbb8406d120 2023-10-09T11:38:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.232+0000 7fbb88b93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840cfbb0 con 0x7fbb84157ca0 2023-10-09T11:38:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.232+0000 7fbb88b93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840cfe90 con 0x7fbb841578d0 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 0x7fbb840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb81d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 0x7fbb8415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb82d9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbb8406d120 0x7fbb8415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:53322/0 (socket says 172.21.15.6:53322) 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb82d9d700 1 -- 172.21.15.6:0/1864835829 learned_addr learned my addr 172.21.15.6:0/1864835829 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 -- 172.21.15.6:0/1864835829 >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 msgr2=0x7fbb8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 --2- 172.21.15.6:0/1864835829 >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 0x7fbb8415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 -- 172.21.15.6:0/1864835829 >> v1:172.21.15.118:6789/0 conn(0x7fbb8406d120 legacy=0x7fbb8415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 -- 172.21.15.6:0/1864835829 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840d0170 con 0x7fbb841578d0 2023-10-09T11:38:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb81d9b700 1 --2- 172.21.15.6:0/1864835829 >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 0x7fbb8415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8259c700 1 --2- 172.21.15.6:0/1864835829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 0x7fbb840cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb740098e0 tx=0x7fbb740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5ea998da29c2bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8159a700 1 -- 172.21.15.6:0/1864835829 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400b640 con 0x7fbb841578d0 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8159a700 1 -- 172.21.15.6:0/1864835829 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400b7a0 con 0x7fbb841578d0 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.233+0000 7fbb8159a700 1 -- 172.21.15.6:0/1864835829 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400bb40 con 0x7fbb841578d0 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 -- 172.21.15.6:0/1864835829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 msgr2=0x7fbb840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 --2- 172.21.15.6:0/1864835829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 0x7fbb840cf4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb740098e0 tx=0x7fbb740091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 -- 172.21.15.6:0/1864835829 shutdown_connections 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 --2- 172.21.15.6:0/1864835829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb841578d0 0x7fbb840cf4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 --2- 172.21.15.6:0/1864835829 >> v2:172.21.15.118:3300/0 conn(0x7fbb84157ca0 0x7fbb8415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 -- 172.21.15.6:0/1864835829 >> 172.21.15.6:0/1864835829 conn(0x7fbb8406bb90 msgr2=0x7fbb8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 -- 172.21.15.6:0/1864835829 shutdown_connections 2023-10-09T11:38:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.234+0000 7fbb88b93700 1 -- 172.21.15.6:0/1864835829 wait complete. 2023-10-09T11:38:00.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.235+0000 7fbb88b93700 1 Processor -- start 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.235+0000 7fbb88b93700 1 -- start start 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 0x7fbb8414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb84157ca0 0x7fbb8415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8414f6b0 con 0x7fbb841578d0 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8415c850 con 0x7fbb8406d120 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb88b93700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8415cb30 con 0x7fbb84157ca0 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32964/0 (socket says 172.21.15.6:32964) 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 -- 172.21.15.6:0/4034595550 learned_addr learned my addr 172.21.15.6:0/4034595550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:00.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb8259c700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 0x7fbb8414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb82d9d700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb84157ca0 0x7fbb8415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 -- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb84157ca0 msgr2=0x7fbb8415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb84157ca0 0x7fbb8415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 -- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 msgr2=0x7fbb8414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 0x7fbb8414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb81d9b700 1 -- 172.21.15.6:0/4034595550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c009420 con 0x7fbb841578d0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.236+0000 7fbb8259c700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 0x7fbb8414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb81d9b700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00ec80 tx=0x7fbb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00c9d0 con 0x7fbb841578d0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00cb30 con 0x7fbb841578d0 2023-10-09T11:38:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb74009420 con 0x7fbb841578d0 2023-10-09T11:38:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00ceb0 con 0x7fbb841578d0 2023-10-09T11:38:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.237+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8414f340 con 0x7fbb841578d0 2023-10-09T11:38:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.238+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8414f1a0 con 0x7fbb841578d0 2023-10-09T11:38:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.238+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb6c013680 con 0x7fbb841578d0 2023-10-09T11:38:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.239+0000 7fbb7a7fc700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 0x7fbb640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.239+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fbb6c0847b0 con 0x7fbb841578d0 2023-10-09T11:38:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.239+0000 7fbb8259c700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 0x7fbb640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:00.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.239+0000 7fbb8259c700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 0x7fbb640693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbb84156520 tx=0x7fbb74017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:00.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.245+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb8414f1a0 con 0x7fbb841578d0 2023-10-09T11:38:00.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:00.439+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb8414f1a0 con 0x7fbb841578d0 2023-10-09T11:38:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.088+0000 7fbb7a7fc700 1 -- 172.21.15.6:0/4034595550 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbb8414f1a0 con 0x7fbb841578d0 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 msgr2=0x7fbb640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 0x7fbb640693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbb84156520 tx=0x7fbb74017000 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 msgr2=0x7fbb8414d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00ec80 tx=0x7fbb6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 shutdown_connections 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbb64066f30 0x7fbb640693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb84157ca0 0x7fbb8415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb8406d120 0x7fbb8414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 --2- 172.21.15.6:0/4034595550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb841578d0 0x7fbb8414d720 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 >> 172.21.15.6:0/4034595550 conn(0x7fbb8406bb90 msgr2=0x7fbb84156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 shutdown_connections 2023-10-09T11:38:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.091+0000 7fbb88b93700 1 -- 172.21.15.6:0/4034595550 wait complete. 2023-10-09T11:38:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:38:01.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:38:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.226+0000 7f62ce938700 1 Processor -- start 2023-10-09T11:38:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.226+0000 7f62ce938700 1 -- start start 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62ce938700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f62c8157fe0 0x7f62c80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62ce938700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80b2890 con 0x7f62c81583b0 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62ce938700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80b4070 con 0x7f62c80cf240 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62ce938700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c80b4350 con 0x7f62c8157fe0 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62c77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f62c81583b0 0x7f62c80ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53588/0 (socket says 172.21.15.6:53588) 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.227+0000 7f62c77fe700 1 -- 172.21.15.6:0/2417070358 learned_addr learned my addr 172.21.15.6:0/2417070358 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c7fff700 1 --2- 172.21.15.6:0/2417070358 >> v2:172.21.15.118:3300/0 conn(0x7f62c8157fe0 0x7f62c80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90477037 0 0) 0x7f62c80b2890 con 0x7f62c81583b0 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b0003570 con 0x7f62c81583b0 2023-10-09T11:38:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242734175 0 0) 0x7f62c80b4070 con 0x7f62c80cf240 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c80b2890 con 0x7f62c80cf240 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329320015 0 0) 0x7f62b0003570 con 0x7f62c81583b0 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 >> v2:172.21.15.118:3300/0 conn(0x7f62c8157fe0 msgr2=0x7f62c80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 --2- 172.21.15.6:0/2417070358 >> v2:172.21.15.118:3300/0 conn(0x7f62c8157fe0 0x7f62c80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 >> v1:172.21.15.118:6789/0 conn(0x7f62c80cf240 legacy=0x7f62c8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80b4630 con 0x7f62c81583b0 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f62bc001470 con 0x7f62c81583b0 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c7fff700 1 --2- 172.21.15.6:0/2417070358 >> v2:172.21.15.118:3300/0 conn(0x7f62c8157fe0 0x7f62c80b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 >> v1:172.21.15.6:6789/0 conn(0x7f62c81583b0 legacy=0x7f62c80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b0003bf0 0x7f62b0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62b0004810 0x7f62b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 0x7f62b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80b4350 con 0x7f62b00051c0 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b000c160 con 0x7f62b0003bf0 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b000c320 con 0x7f62b0004810 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62cced5700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 0x7f62b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c7fff700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b0003bf0 0x7f62b0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.228+0000 7f62c77fe700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62b0004810 0x7f62b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 -- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62b0004810 msgr2=0x7f62b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62b0004810 0x7f62b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 -- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b0003bf0 msgr2=0x7f62b0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b0003bf0 0x7f62b0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 -- 172.21.15.6:0/2417070358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0003570 con 0x7f62b00051c0 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 -- 172.21.15.6:0/2417070358 reap_dead start 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62cced5700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 0x7f62b000ba60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f62c80cf640 tx=0x7f62c00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2273ef974d2a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0001ab0 con 0x7f62b00051c0 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0006ba0 con 0x7f62b00051c0 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62c6ffd700 1 -- 172.21.15.6:0/2417070358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000c8b0 con 0x7f62b00051c0 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62ce938700 1 -- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 msgr2=0x7f62b000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62ce938700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 0x7f62b000ba60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f62c80cf640 tx=0x7f62c00017a0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62ce938700 1 -- 172.21.15.6:0/2417070358 shutdown_connections 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62ce938700 1 --2- 172.21.15.6:0/2417070358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b00051c0 0x7f62b000ba60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.229+0000 7f62ce938700 1 -- 172.21.15.6:0/2417070358 >> 172.21.15.6:0/2417070358 conn(0x7f62c8067640 msgr2=0x7f62c8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.230+0000 7f62ce938700 1 -- 172.21.15.6:0/2417070358 shutdown_connections 2023-10-09T11:38:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.230+0000 7f62ce938700 1 -- 172.21.15.6:0/2417070358 wait complete. 2023-10-09T11:38:01.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 Processor -- start 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 -- start start 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 0x7f62c80cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62c80c8a20 0x7f62c80c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80cb230 con 0x7f62c80c65b0 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c9400 con 0x7f62b00051c0 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.231+0000 7f62ce938700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c7730 con 0x7f62c80c8a20 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32972/0 (socket says 172.21.15.6:32972) 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 -- 172.21.15.6:0/720302637 learned_addr learned my addr 172.21.15.6:0/720302637 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c7fff700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 0x7f62c80cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 -- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62c80c8a20 msgr2=0x7f62c80c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62c80c8a20 0x7f62c80c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 -- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 msgr2=0x7f62c80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 0x7f62c80cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 -- 172.21.15.6:0/720302637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80cc280 con 0x7f62c80c65b0 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c7fff700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 0x7f62c80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62c77fe700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0073c0 tx=0x7f62bc001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc018030 con 0x7f62c80c65b0 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc007830 con 0x7f62c80c65b0 2023-10-09T11:38:01.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c80c6b20 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00fb40 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.232+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c80c70e0 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.233+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8069e40 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.234+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62bc01b070 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.234+0000 7f62affff700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 0x7f62b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.234+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f62bc019070 con 0x7f62c80c65b0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.234+0000 7f62c7fff700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 0x7f62b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.234+0000 7f62c7fff700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 0x7f62b40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006f00 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.238+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62bc0515b0 con 0x7f62c80c65b0 2023-10-09T11:38:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.440+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f62c80c7870 con 0x7f62c80c65b0 2023-10-09T11:38:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.444+0000 7f62affff700 1 -- 172.21.15.6:0/720302637 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62bc054bd0 con 0x7f62c80c65b0 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 msgr2=0x7f62b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 0x7f62b40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006f00 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 msgr2=0x7f62c81683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0073c0 tx=0x7f62bc001df0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 shutdown_connections 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f62b4066f30 0x7f62b40693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62c80c8a20 0x7f62c80c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62b00051c0 0x7f62c80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 --2- 172.21.15.6:0/720302637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62c80c65b0 0x7f62c81683d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 >> 172.21.15.6:0/720302637 conn(0x7f62c8067640 msgr2=0x7f62c80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 shutdown_connections 2023-10-09T11:38:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.446+0000 7f62ce938700 1 -- 172.21.15.6:0/720302637 wait complete. 2023-10-09T11:38:01.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-09T11:38:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.576+0000 7f69a9c2d700 1 Processor -- start 2023-10-09T11:38:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.576+0000 7f69a9c2d700 1 -- start start 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a9c2d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69a41578d0 0x7f69a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a9c2d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40d07c0 con 0x7f69a4157ca0 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a9c2d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40cfbb0 con 0x7f69a406d120 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a9c2d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40cfe90 con 0x7f69a41578d0 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69a4157ca0 0x7f69a415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53592/0 (socket says 172.21.15.6:53592) 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.577+0000 7f69a2ffd700 1 -- 172.21.15.6:0/2007799863 learned_addr learned my addr 172.21.15.6:0/2007799863 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a37fe700 1 --2- 172.21.15.6:0/2007799863 >> v2:172.21.15.118:3300/0 conn(0x7f69a41578d0 0x7f69a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402919602 0 0) 0x7f69a40d07c0 con 0x7f69a4157ca0 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c003570 con 0x7f69a4157ca0 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173589323 0 0) 0x7f69a40cfbb0 con 0x7f69a406d120 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a40d07c0 con 0x7f69a406d120 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2341747512 0 0) 0x7f698c003570 con 0x7f69a4157ca0 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 >> v2:172.21.15.118:3300/0 conn(0x7f69a41578d0 msgr2=0x7f69a40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 --2- 172.21.15.6:0/2007799863 >> v2:172.21.15.118:3300/0 conn(0x7f69a41578d0 0x7f69a40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 >> v1:172.21.15.118:6789/0 conn(0x7f69a406d120 legacy=0x7f69a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40d0170 con 0x7f69a4157ca0 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f69980013f0 con 0x7f69a4157ca0 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 >> v1:172.21.15.6:6789/0 conn(0x7f69a4157ca0 legacy=0x7f69a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698c003c40 0x7f698c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c004810 0x7f698c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 0x7f698c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40cfe90 con 0x7f698c005210 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c00c130 con 0x7f698c003c40 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c00c2c0 con 0x7f698c004810 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a3fff700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 0x7f698c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a37fe700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698c003c40 0x7f698c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.578+0000 7f69a2ffd700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c004810 0x7f698c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 -- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c004810 msgr2=0x7f698c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c004810 0x7f698c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 -- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698c003c40 msgr2=0x7f698c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f698c003c40 0x7f698c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 -- 172.21.15.6:0/2007799863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c003570 con 0x7f698c005210 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 -- 172.21.15.6:0/2007799863 reap_dead start 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a3fff700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 0x7f698c00ba60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f699c002150 tx=0x7f699c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54163523abd68ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00c940 con 0x7f698c005210 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00caa0 con 0x7f698c005210 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a27fc700 1 -- 172.21.15.6:0/2007799863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00cc10 con 0x7f698c005210 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 -- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 msgr2=0x7f698c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 0x7f698c00ba60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f699c002150 tx=0x7f699c0017a0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 -- 172.21.15.6:0/2007799863 shutdown_connections 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/2007799863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f698c005210 0x7f698c00ba60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 -- 172.21.15.6:0/2007799863 >> 172.21.15.6:0/2007799863 conn(0x7f69a406bb90 msgr2=0x7f69a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 -- 172.21.15.6:0/2007799863 shutdown_connections 2023-10-09T11:38:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.579+0000 7f69a9c2d700 1 -- 172.21.15.6:0/2007799863 wait complete. 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 Processor -- start 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 -- start start 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c005210 0x7f69a40b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69a40cd300 0x7f69a41544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40b63a0 con 0x7f69a4152790 2023-10-09T11:38:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a416ae50 con 0x7f69a40cd300 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.581+0000 7f69a9c2d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a40b5de0 con 0x7f698c005210 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32992/0 (socket says 172.21.15.6:32992) 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 -- 172.21.15.6:0/1732555582 learned_addr learned my addr 172.21.15.6:0/1732555582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a37fe700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c005210 0x7f69a40b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a3fff700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69a40cd300 0x7f69a41544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 -- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c005210 msgr2=0x7f69a40b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c005210 0x7f69a40b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 -- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69a40cd300 msgr2=0x7f69a41544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69a40cd300 0x7f69a41544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 -- 172.21.15.6:0/1732555582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40b60c0 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a2ffd700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6998007fd0 tx=0x7f6998001ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998000cb0 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6998011590 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998011950 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a416aae0 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.582+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a40cd780 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.583+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a40cd9a0 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.584+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6998011d40 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.584+0000 7f698b7fe700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 0x7f69900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.584+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6998084250 con 0x7f69a4152790 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.584+0000 7f69a37fe700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 0x7f69900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.585+0000 7f69a37fe700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 0x7f69900693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69a40cce00 tx=0x7f69940091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.588+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69980517c0 con 0x7f69a4152790 2023-10-09T11:38:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:01.863+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f69a416af90 con 0x7f69a4152790 2023-10-09T11:38:02.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.088+0000 7f698b7fe700 1 -- 172.21.15.6:0/1732555582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v127) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6998054de0 con 0x7f69a4152790 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 msgr2=0x7f69900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 0x7f69900693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69a40cce00 tx=0x7f69940091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 msgr2=0x7f69a416b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6998007fd0 tx=0x7f6998001ca0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 shutdown_connections 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6990066f30 0x7f69900693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69a40cd300 0x7f69a41544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f698c005210 0x7f69a40b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 --2- 172.21.15.6:0/1732555582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69a4152790 0x7f69a416b2e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 >> 172.21.15.6:0/1732555582 conn(0x7f69a406bb90 msgr2=0x7f69a4156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 shutdown_connections 2023-10-09T11:38:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.091+0000 7f69a9c2d700 1 -- 172.21.15.6:0/1732555582 wait complete. 2023-10-09T11:38:02.106 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T11:38:02.106 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T11:38:02.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-09T11:38:02.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.224+0000 7fcacedbf700 1 Processor -- start 2023-10-09T11:38:02.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcacedbf700 1 -- start start 2023-10-09T11:38:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcacedbf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcac8157620 0x7fcac8157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcacedbf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac806ebf0 con 0x7fcac80b2e00 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcacedbf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac806eed0 con 0x7fcac80b31d0 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcacedbf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac815ba10 con 0x7fcac8157620 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.225+0000 7fcaccb5b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcac80b2e00 0x7fcac815c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53600/0 (socket says 172.21.15.6:53600) 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcaccb5b700 1 -- 172.21.15.6:0/210234026 learned_addr learned my addr 172.21.15.6:0/210234026 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcacd35c700 1 --2- 172.21.15.6:0/210234026 >> v2:172.21.15.118:3300/0 conn(0x7fcac8157620 0x7fcac8157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072494026 0 0) 0x7fcac806ebf0 con 0x7fcac80b2e00 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab4003570 con 0x7fcac80b2e00 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3650880628 0 0) 0x7fcab4003570 con 0x7fcac80b2e00 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 >> v2:172.21.15.118:3300/0 conn(0x7fcac8157620 msgr2=0x7fcac8157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 --2- 172.21.15.6:0/210234026 >> v2:172.21.15.118:3300/0 conn(0x7fcac8157620 0x7fcac8157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 >> v1:172.21.15.118:6789/0 conn(0x7fcac80b31d0 legacy=0x7fcac806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac815bcf0 con 0x7fcac80b2e00 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fcab0001470 con 0x7fcac80b2e00 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 >> v1:172.21.15.6:6789/0 conn(0x7fcac80b2e00 legacy=0x7fcac815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcab4003a60 0x7fcab4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 0x7fcab4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab40051c0 0x7fcab400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac815ba10 con 0x7fcab4004810 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400c160 con 0x7fcab40051c0 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400c320 con 0x7fcab4003a60 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcacd35c700 1 --2- 172.21.15.6:0/210234026 >> v2:172.21.15.118:3300/0 conn(0x7fcac8157620 0x7fcac8157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcac7fff700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 0x7fcab4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcaccb5b700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcab4003a60 0x7fcab4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.226+0000 7fcacd35c700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab40051c0 0x7fcab400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 -- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcab4003a60 msgr2=0x7fcab4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcab4003a60 0x7fcab4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 -- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab40051c0 msgr2=0x7fcab400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab40051c0 0x7fcab400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 -- 172.21.15.6:0/210234026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4003570 con 0x7fcab4004810 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacd35c700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab40051c0 0x7fcab400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacd35c700 1 -- 172.21.15.6:0/210234026 reap_dead start 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac7fff700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 0x7fcab4004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcab80018b0 tx=0x7fcab8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92849cb1b686c34a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8012420 con 0x7fcab4004810 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80125a0 con 0x7fcab4004810 2023-10-09T11:38:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcac77fe700 1 -- 172.21.15.6:0/210234026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8012960 con 0x7fcab4004810 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 -- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 msgr2=0x7fcab4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 0x7fcab4004c80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcab80018b0 tx=0x7fcab8007d30 comp rx=0 tx=0).stop 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 -- 172.21.15.6:0/210234026 shutdown_connections 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 --2- 172.21.15.6:0/210234026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab4004810 0x7fcab4004c80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 -- 172.21.15.6:0/210234026 >> 172.21.15.6:0/210234026 conn(0x7fcac806cca0 msgr2=0x7fcac806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 -- 172.21.15.6:0/210234026 shutdown_connections 2023-10-09T11:38:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.227+0000 7fcacedbf700 1 -- 172.21.15.6:0/210234026 wait complete. 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.228+0000 7fcacedbf700 1 Processor -- start 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 -- start start 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab4004810 0x7fcac81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcac815a170 0x7fcac80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac813fdb0 con 0x7fcac814fda0 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80b0510 con 0x7fcab4004810 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacedbf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81590d0 con 0x7fcac815a170 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.229+0000 7fcacd35c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33000/0 (socket says 172.21.15.6:33000) 2023-10-09T11:38:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 -- 172.21.15.6:0/946779058 learned_addr learned my addr 172.21.15.6:0/946779058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcac7fff700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcac815a170 0x7fcac80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcaccb5b700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab4004810 0x7fcac81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 -- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcac815a170 msgr2=0x7fcac80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcac815a170 0x7fcac80affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 -- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab4004810 msgr2=0x7fcac81589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab4004810 0x7fcac81589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 -- 172.21.15.6:0/946779058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac81593b0 con 0x7fcac814fda0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacd35c700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcac806ae20 tx=0x7fcac000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e070 con 0x7fcac814fda0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0011c50 con 0x7fcac814fda0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8159690 con 0x7fcac814fda0 2023-10-09T11:38:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0016470 con 0x7fcac814fda0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.230+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac8159c50 con 0x7fcac814fda0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.231+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac8068b70 con 0x7fcac814fda0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.232+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcac0016820 con 0x7fcac814fda0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.232+0000 7fcac4ff9700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 0x7fcaa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.232+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcac0084e30 con 0x7fcac814fda0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.232+0000 7fcaccb5b700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 0x7fcaa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.232+0000 7fcaccb5b700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 0x7fcaa80693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcac815c850 tx=0x7fcab0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.236+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcac00523a0 con 0x7fcac814fda0 2023-10-09T11:38:02.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:02.508+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fcac80ce330 con 0x7fcac814fda0 2023-10-09T11:38:03.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.094+0000 7fcac4ff9700 1 -- 172.21.15.6:0/946779058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v128) v1 ==== 137+0+0 (secure 0 0 0) 0x7fcac00559c0 con 0x7fcac814fda0 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 msgr2=0x7fcaa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 0x7fcaa80693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcac815c850 tx=0x7fcab0007040 comp rx=0 tx=0).stop 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 msgr2=0x7fcac80ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcac806ae20 tx=0x7fcac000b040 comp rx=0 tx=0).stop 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 shutdown_connections 2023-10-09T11:38:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcaa8066f30 0x7fcaa80693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac814fda0 0x7fcac80ad3e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcab4004810 0x7fcac81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 --2- 172.21.15.6:0/946779058 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcac815a170 0x7fcac80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 >> 172.21.15.6:0/946779058 conn(0x7fcac806cca0 msgr2=0x7fcac80aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 shutdown_connections 2023-10-09T11:38:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.096+0000 7fcacedbf700 1 -- 172.21.15.6:0/946779058 wait complete. 2023-10-09T11:38:03.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T11:38:03.248 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_objectstore":"memstore"} 2023-10-09T11:38:03.248 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T11:38:03.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:38:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.368+0000 7f369c7ad700 1 Processor -- start 2023-10-09T11:38:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.368+0000 7f369c7ad700 1 -- start start 2023-10-09T11:38:03.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369c7ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f36940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369c7ad700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f369406d120 0x7f369406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369c7ad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369406dac0 con 0x7f3694157ca0 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369c7ad700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940d07c0 con 0x7f369406d120 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369c7ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940cfbb0 con 0x7f36941578d0 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369ad4a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f369406d120 0x7f369406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369ad4a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f369406d120 0x7f369406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42476/0 (socket says 172.21.15.6:42476) 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369ad4a700 1 -- 172.21.15.6:0/2236015478 learned_addr learned my addr 172.21.15.6:0/2236015478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.369+0000 7f369a549700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f36940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369ad4a700 1 -- 172.21.15.6:0/2236015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 msgr2=0x7f36940cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369ad4a700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f36940cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369ad4a700 1 -- 172.21.15.6:0/2236015478 >> v1:172.21.15.118:6789/0 conn(0x7f3694157ca0 legacy=0x7f369415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369ad4a700 1 -- 172.21.15.6:0/2236015478 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940cfe90 con 0x7f369406d120 2023-10-09T11:38:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369ad4a700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369406d580 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f368c0099b0 tx=0x7f368c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5b2374cb80f2c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f3699547700 1 -- 172.21.15.6:0/2236015478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c009ea0 con 0x7f369406d120 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f3699547700 1 -- 172.21.15.6:0/2236015478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00b860 con 0x7f369406d120 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f3699547700 1 -- 172.21.15.6:0/2236015478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00bc00 con 0x7f369406d120 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369c7ad700 1 -- 172.21.15.6:0/2236015478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 msgr2=0x7f369406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.370+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369406d580 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f368c0099b0 tx=0x7f368c009250 comp rx=0 tx=0).stop 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 -- 172.21.15.6:0/2236015478 shutdown_connections 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369406d580 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2236015478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f36940cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 -- 172.21.15.6:0/2236015478 >> 172.21.15.6:0/2236015478 conn(0x7f369406bb90 msgr2=0x7f369406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 -- 172.21.15.6:0/2236015478 shutdown_connections 2023-10-09T11:38:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.371+0000 7f369c7ad700 1 -- 172.21.15.6:0/2236015478 wait complete. 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.372+0000 7f369c7ad700 1 Processor -- start 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.372+0000 7f369c7ad700 1 -- start start 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.372+0000 7f369c7ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f369416a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3694157ca0 0x7f36940c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940b3ba0 con 0x7f369406d120 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940b3df0 con 0x7f3694157ca0 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940b40d0 con 0x7f36941578d0 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42480/0 (socket says 172.21.15.6:42480) 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 -- 172.21.15.6:0/2905956401 learned_addr learned my addr 172.21.15.6:0/2905956401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369ad4a700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3694157ca0 0x7f36940c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f3699d48700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f369416a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 -- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 msgr2=0x7f369416a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f369416a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 -- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3694157ca0 msgr2=0x7f36940c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3694157ca0 0x7f36940c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 -- 172.21.15.6:0/2905956401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0094f0 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369a549700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3684009ef0 tx=0x7f368400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400cc50 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400f040 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940b43b0 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684014480 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.373+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36940b6580 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.374+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694067ac0 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.375+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36840147f0 con 0x7f369406d120 2023-10-09T11:38:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.375+0000 7f36927fc700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 0x7f36800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.375+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3684084ce0 con 0x7f369406d120 2023-10-09T11:38:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.375+0000 7f3699d48700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 0x7f36800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.376+0000 7f3699d48700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 0x7f36800693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f369415cce0 tx=0x7f3688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.379+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3684052250 con 0x7f369406d120 2023-10-09T11:38:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.572+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36940d0170 con 0x7f369406d120 2023-10-09T11:38:03.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.577+0000 7f36927fc700 1 -- 172.21.15.6:0/2905956401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3684055870 con 0x7f369406d120 2023-10-09T11:38:03.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 msgr2=0x7f36800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 0x7f36800693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f369415cce0 tx=0x7f3688009040 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 msgr2=0x7f369416d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3684009ef0 tx=0x7f368400b040 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 shutdown_connections 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3680066f30 0x7f36800693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3694157ca0 0x7f36940c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f369406d120 0x7f369416d2e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 --2- 172.21.15.6:0/2905956401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f36941578d0 0x7f369416a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 >> 172.21.15.6:0/2905956401 conn(0x7f369406bb90 msgr2=0x7f36940699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 shutdown_connections 2023-10-09T11:38:03.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.580+0000 7f369c7ad700 1 -- 172.21.15.6:0/2905956401 wait complete. 2023-10-09T11:38:03.593 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:38:03.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:38:03.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:38:03.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:38:03.677 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:38:03.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:38:03.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.794+0000 7fce9f610700 1 Processor -- start 2023-10-09T11:38:03.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.794+0000 7fce9f610700 1 -- start start 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce981569e0 0x7fce980b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce98156db0 0x7fce9806e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 0x7fce9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980b2290 con 0x7fce981569e0 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce98157c00 con 0x7fce980b1d10 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9f610700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce981572d0 con 0x7fce98156db0 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9d3ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce981569e0 0x7fce980b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9d3ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce981569e0 0x7fce980b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42496/0 (socket says 172.21.15.6:42496) 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.795+0000 7fce9d3ac700 1 -- 172.21.15.6:0/2313917849 learned_addr learned my addr 172.21.15.6:0/2313917849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9dbad700 1 --2- 172.21.15.6:0/2313917849 >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 0x7fce9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9cbab700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce98156db0 0x7fce9806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 -- 172.21.15.6:0/2313917849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce98156db0 msgr2=0x7fce9806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce98156db0 0x7fce9806e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 -- 172.21.15.6:0/2313917849 >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 msgr2=0x7fce9806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2313917849 >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 0x7fce9806e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 -- 172.21.15.6:0/2313917849 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce981575b0 con 0x7fce981569e0 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9dbad700 1 --2- 172.21.15.6:0/2313917849 >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 0x7fce9806e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce981569e0 0x7fce980b17d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce980b2190 tx=0x7fce90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a468360add3158 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce97fff700 1 -- 172.21.15.6:0/2313917849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000b860 con 0x7fce981569e0 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce97fff700 1 -- 172.21.15.6:0/2313917849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9000b9c0 con 0x7fce981569e0 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.796+0000 7fce97fff700 1 -- 172.21.15.6:0/2313917849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000bd60 con 0x7fce981569e0 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 -- 172.21.15.6:0/2313917849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce981569e0 msgr2=0x7fce980b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce981569e0 0x7fce980b17d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce980b2190 tx=0x7fce90009250 comp rx=0 tx=0).stop 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 -- 172.21.15.6:0/2313917849 shutdown_connections 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 --2- 172.21.15.6:0/2313917849 >> v2:172.21.15.118:3300/0 conn(0x7fce980b1d10 0x7fce9806e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce981569e0 0x7fce980b17d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 --2- 172.21.15.6:0/2313917849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce98156db0 0x7fce9806e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 -- 172.21.15.6:0/2313917849 >> 172.21.15.6:0/2313917849 conn(0x7fce9806cca0 msgr2=0x7fce9806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 -- 172.21.15.6:0/2313917849 shutdown_connections 2023-10-09T11:38:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.797+0000 7fce9f610700 1 -- 172.21.15.6:0/2313917849 wait complete. 2023-10-09T11:38:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.798+0000 7fce9f610700 1 Processor -- start 2023-10-09T11:38:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.798+0000 7fce9f610700 1 -- start start 2023-10-09T11:38:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce980b1d10 0x7fce98148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce981569e0 0x7fce981460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98146630 con 0x7fce98156db0 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98146b10 con 0x7fce980b1d10 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9f610700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98149440 con 0x7fce981569e0 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42512/0 (socket says 172.21.15.6:42512) 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 -- 172.21.15.6:0/2824526406 learned_addr learned my addr 172.21.15.6:0/2824526406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce980b1d10 0x7fce98148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9cbab700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce981569e0 0x7fce981460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 -- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce981569e0 msgr2=0x7fce981460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce981569e0 0x7fce981460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 -- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce980b1d10 msgr2=0x7fce98148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce980b1d10 0x7fce98148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 -- 172.21.15.6:0/2824526406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900094f0 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce9dbad700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fce8800a380 tx=0x7fce88007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.799+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88015440 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.800+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880155a0 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.800+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88015960 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.800+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce98149720 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.800+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce981467a0 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.801+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce98068900 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.801+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce8800d440 con 0x7fce98156db0 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.801+0000 7fce957fa700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 0x7fce840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.802+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fce88084d10 con 0x7fce98156db0 2023-10-09T11:38:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.802+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 0x7fce840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.802+0000 7fce9d3ac700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 0x7fce840693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fce980b2190 tx=0x7fce90017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:03.806+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce88052280 con 0x7fce98156db0 2023-10-09T11:38:04.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:04.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.041+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce98157890 con 0x7fce98156db0 2023-10-09T11:38:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.042+0000 7fce957fa700 1 -- 172.21.15.6:0/2824526406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fce8801a090 con 0x7fce98156db0 2023-10-09T11:38:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:04.044 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3627365614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3627365614},{"type":"v1","addr":"172.21.15.6:6836","nonce":3627365614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4943,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3001367740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3001367740},{"type":"v1","addr":"172.21.15.118:6834","nonce":3001367740}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1655648676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1655648676},{"type":"v1","addr":"172.21.15.118:6835","nonce":1655648676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1906322050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1906322050},{"type":"v1","addr":"172.21.15.6:6837","nonce":1906322050}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 msgr2=0x7fce840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 0x7fce840693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fce980b2190 tx=0x7fce90017000 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 msgr2=0x7fce9814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fce8800a380 tx=0x7fce88007900 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 shutdown_connections 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce84066f30 0x7fce840693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce98156db0 0x7fce9814acc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce980b1d10 0x7fce98148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 --2- 172.21.15.6:0/2824526406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce981569e0 0x7fce981460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 >> 172.21.15.6:0/2824526406 conn(0x7fce9806cca0 msgr2=0x7fce9806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 shutdown_connections 2023-10-09T11:38:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.044+0000 7fce9f610700 1 -- 172.21.15.6:0/2824526406 wait complete. 2023-10-09T11:38:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2023-10-09T11:38:04.058 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:38:04.058 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:38:04.058 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:38:04.058 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:38:04.058 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:38:04.058 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:38:04.059 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:38:04.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:38:04.059 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:38:04.059 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:38:04.059 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:38:04.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:38:04.060 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:38:04.060 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:38:04.060 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:38:04.060 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:38:04.069 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:38:04.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:38:04.070 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:38:04.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:38:04.072 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:38:04.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:38:04.073 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:38:04.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:38:04.112 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:38:04.112 DEBUG:teuthology.parallel:result is None 2023-10-09T11:38:04.113 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:38:04.114 DEBUG:teuthology.parallel:result is None 2023-10-09T11:38:04.114 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:38:04.115 DEBUG:teuthology.parallel:result is None 2023-10-09T11:38:04.115 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:38:04.115 DEBUG:teuthology.parallel:result is None 2023-10-09T11:38:04.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:38:04.190 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:38:04.191 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:38:04.191 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:38:04.191 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:38:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.239+0000 7eff4f4b8700 1 Processor -- start 2023-10-09T11:38:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.239+0000 7eff4f4b8700 1 -- start start 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4f4b8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff48069440 0x7eff480698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4f4b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff480c71d0 0x7eff480c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4f4b8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff480cb880 con 0x7eff48156420 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4f4b8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4806aa10 con 0x7eff48069440 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4f4b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c7b90 con 0x7eff480c71d0 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff48069440 0x7eff480698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff48069440 0x7eff480698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42566/0 (socket says 172.21.15.6:42566) 2023-10-09T11:38:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 -- 172.21.15.6:0/306803711 learned_addr learned my addr 172.21.15.6:0/306803711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4da55700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff480c71d0 0x7eff480c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 -- 172.21.15.6:0/306803711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff480c71d0 msgr2=0x7eff480c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff480c71d0 0x7eff480c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 -- 172.21.15.6:0/306803711 >> v1:172.21.15.118:6789/0 conn(0x7eff48156420 legacy=0x7eff480cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 -- 172.21.15.6:0/306803711 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480cac70 con 0x7eff48069440 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff4ca53700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48069440 0x7eff480698b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7eff380099b0 tx=0x7eff38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336bbc047e5b5ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff3ffff700 1 -- 172.21.15.6:0/306803711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800b860 con 0x7eff48069440 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff3ffff700 1 -- 172.21.15.6:0/306803711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800b9c0 con 0x7eff48069440 2023-10-09T11:38:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.240+0000 7eff3ffff700 1 -- 172.21.15.6:0/306803711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800bd60 con 0x7eff48069440 2023-10-09T11:38:04.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 -- 172.21.15.6:0/306803711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48069440 msgr2=0x7eff480698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48069440 0x7eff480698b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7eff380099b0 tx=0x7eff38009250 comp rx=0 tx=0).stop 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 -- 172.21.15.6:0/306803711 shutdown_connections 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff480c71d0 0x7eff480c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/306803711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48069440 0x7eff480698b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 -- 172.21.15.6:0/306803711 >> 172.21.15.6:0/306803711 conn(0x7eff4806c660 msgr2=0x7eff480cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 -- 172.21.15.6:0/306803711 shutdown_connections 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.241+0000 7eff4f4b8700 1 -- 172.21.15.6:0/306803711 wait complete. 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.242+0000 7eff4f4b8700 1 Processor -- start 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.242+0000 7eff4f4b8700 1 -- start start 2023-10-09T11:38:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff48069440 0x7eff48143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff480c71d0 0x7eff48152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480af890 con 0x7eff48156420 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b0130 con 0x7eff480c71d0 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4f4b8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b21a0 con 0x7eff48069440 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4da55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4da55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42572/0 (socket says 172.21.15.6:42572) 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4da55700 1 -- 172.21.15.6:0/692160504 learned_addr learned my addr 172.21.15.6:0/692160504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4ca53700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff480c71d0 0x7eff48152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.243+0000 7eff4d254700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff48069440 0x7eff48143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 -- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff48069440 msgr2=0x7eff48143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff48069440 0x7eff48143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 -- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff480c71d0 msgr2=0x7eff48152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff480c71d0 0x7eff48152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 -- 172.21.15.6:0/692160504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380094f0 con 0x7eff48156420 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4da55700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7eff40009fd0 tx=0x7eff40009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000ebf0 con 0x7eff48156420 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4000ed50 con 0x7eff48156420 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff481538a0 con 0x7eff48156420 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40014670 con 0x7eff48156420 2023-10-09T11:38:04.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.244+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff480afdc0 con 0x7eff48156420 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.245+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff480b02c0 con 0x7eff48156420 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.245+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff400149e0 con 0x7eff48156420 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.246+0000 7eff3d7fa700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 0x7eff2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.246+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7eff400848a0 con 0x7eff48156420 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.246+0000 7eff4d254700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 0x7eff2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:04.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.246+0000 7eff4d254700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 0x7eff2c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff440039e0 tx=0x7eff44007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:04.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.250+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff40051e10 con 0x7eff48156420 2023-10-09T11:38:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:04.458+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7eff480caf50 con 0x7eff48156420 2023-10-09T11:38:05.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.114+0000 7eff3d7fa700 1 -- 172.21.15.6:0/692160504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff40055430 con 0x7eff48156420 2023-10-09T11:38:05.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 msgr2=0x7eff2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 0x7eff2c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff440039e0 tx=0x7eff44007ec0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 msgr2=0x7eff48153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7eff40009fd0 tx=0x7eff40009900 comp rx=0 tx=0).stop 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 shutdown_connections 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff2c066f30 0x7eff2c0693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff48156420 0x7eff48153210 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff48069440 0x7eff48143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 --2- 172.21.15.6:0/692160504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff480c71d0 0x7eff48152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 >> 172.21.15.6:0/692160504 conn(0x7eff4806c660 msgr2=0x7eff48151770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 shutdown_connections 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.116+0000 7eff4f4b8700 1 -- 172.21.15.6:0/692160504 wait complete. 2023-10-09T11:38:05.119 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:38:05.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:38:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.252+0000 7f8d366ae700 1 Processor -- start 2023-10-09T11:38:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.252+0000 7f8d366ae700 1 -- start start 2023-10-09T11:38:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d366ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d3015a2a0 0x7f8d300b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d366ae700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d300ceb30 0x7f8d300cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d366ae700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300b0ca0 con 0x7f8d3006d650 2023-10-09T11:38:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d366ae700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3006e160 con 0x7f8d3015a2a0 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d366ae700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3006ea90 con 0x7f8d300ceb30 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d2ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d3015a2a0 0x7f8d300b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d2ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d3015a2a0 0x7f8d300b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42576/0 (socket says 172.21.15.6:42576) 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.253+0000 7f8d2ffff700 1 -- 172.21.15.6:0/328589393 learned_addr learned my addr 172.21.15.6:0/328589393 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2f7fe700 1 --2- 172.21.15.6:0/328589393 >> v2:172.21.15.118:3300/0 conn(0x7f8d300ceb30 0x7f8d300cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2ffff700 1 -- 172.21.15.6:0/328589393 >> v2:172.21.15.118:3300/0 conn(0x7f8d300ceb30 msgr2=0x7f8d300cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2ffff700 1 --2- 172.21.15.6:0/328589393 >> v2:172.21.15.118:3300/0 conn(0x7f8d300ceb30 0x7f8d300cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2ffff700 1 -- 172.21.15.6:0/328589393 >> v1:172.21.15.118:6789/0 conn(0x7f8d3006d650 legacy=0x7f8d3006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2ffff700 1 -- 172.21.15.6:0/328589393 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d300b00d0 con 0x7f8d3015a2a0 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2ffff700 1 --2- 172.21.15.6:0/328589393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3015a2a0 0x7f8d300b1130 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006ab90 tx=0x7f8d20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551dd7c5600bcd7f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2effd700 1 -- 172.21.15.6:0/328589393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000b860 con 0x7f8d3015a2a0 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2effd700 1 -- 172.21.15.6:0/328589393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2000b9c0 con 0x7f8d3015a2a0 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d2effd700 1 -- 172.21.15.6:0/328589393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000bd60 con 0x7f8d3015a2a0 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d366ae700 1 -- 172.21.15.6:0/328589393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3015a2a0 msgr2=0x7f8d300b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d366ae700 1 --2- 172.21.15.6:0/328589393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3015a2a0 0x7f8d300b1130 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006ab90 tx=0x7f8d20009250 comp rx=0 tx=0).stop 2023-10-09T11:38:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.254+0000 7f8d366ae700 1 -- 172.21.15.6:0/328589393 shutdown_connections 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.255+0000 7f8d366ae700 1 --2- 172.21.15.6:0/328589393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3015a2a0 0x7f8d300b1130 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.255+0000 7f8d366ae700 1 --2- 172.21.15.6:0/328589393 >> v2:172.21.15.118:3300/0 conn(0x7f8d300ceb30 0x7f8d300cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.255+0000 7f8d366ae700 1 -- 172.21.15.6:0/328589393 >> 172.21.15.6:0/328589393 conn(0x7f8d30067640 msgr2=0x7f8d30067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.255+0000 7f8d366ae700 1 -- 172.21.15.6:0/328589393 shutdown_connections 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.255+0000 7f8d366ae700 1 -- 172.21.15.6:0/328589393 wait complete. 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.256+0000 7f8d366ae700 1 Processor -- start 2023-10-09T11:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.256+0000 7f8d366ae700 1 -- start start 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.256+0000 7f8d366ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.256+0000 7f8d366ae700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d300ceb30 0x7f8d3015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3015a2a0 0x7f8d3015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3016af10 con 0x7f8d3006d650 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300b2790 con 0x7f8d3015a2a0 2023-10-09T11:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3016a5e0 con 0x7f8d300ceb30 2023-10-09T11:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42580/0 (socket says 172.21.15.6:42580) 2023-10-09T11:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 -- 172.21.15.6:0/184720329 learned_addr learned my addr 172.21.15.6:0/184720329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d34c4b700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3015a2a0 0x7f8d3015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2f7fe700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d300ceb30 0x7f8d3015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 -- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d300ceb30 msgr2=0x7f8d3015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d300ceb30 0x7f8d3015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 -- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3015a2a0 msgr2=0x7f8d3015df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3015a2a0 0x7f8d3015df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 -- 172.21.15.6:0/184720329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200094f0 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d2ffff700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006f990 tx=0x7f8d20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011e60 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2001a630 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3016a8c0 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2001a9f0 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.257+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3016b3a0 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.258+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d30063d90 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.259+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d2002d440 con 0x7f8d3006d650 2023-10-09T11:38:05.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.259+0000 7f8d27fff700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 0x7f8d100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.259+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8d20085d10 con 0x7f8d3006d650 2023-10-09T11:38:05.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.259+0000 7f8d2f7fe700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 0x7f8d100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.260+0000 7f8d2f7fe700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 0x7f8d100693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8d300b2a40 tx=0x7f8d18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.263+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d200532d0 con 0x7f8d3006d650 2023-10-09T11:38:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.537+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8d3016b1f0 con 0x7f8d3006d650 2023-10-09T11:38:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.538+0000 7f8d27fff700 1 -- 172.21.15.6:0/184720329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8d200568f0 con 0x7f8d3006d650 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.540 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.541 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:38:05.542 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:38:05.543 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.544 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:38:05.547 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.548 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.550 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:38:05.552 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.554 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:38:05.555 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:38:05.556 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:38:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 msgr2=0x7f8d100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 0x7f8d100693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8d300b2a40 tx=0x7f8d18008040 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 msgr2=0x7f8d30147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006f990 tx=0x7f8d20017000 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 shutdown_connections 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8d10066f30 0x7f8d100693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d3015a2a0 0x7f8d3015df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3006d650 0x7f8d30147960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 --2- 172.21.15.6:0/184720329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d300ceb30 0x7f8d3015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 >> 172.21.15.6:0/184720329 conn(0x7f8d30067640 msgr2=0x7f8d300ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 shutdown_connections 2023-10-09T11:38:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.540+0000 7f8d366ae700 1 -- 172.21.15.6:0/184720329 wait complete. 2023-10-09T11:38:05.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:38:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.677+0000 7f67f1a7a700 1 Processor -- start 2023-10-09T11:38:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.677+0000 7f67f1a7a700 1 -- start start 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67f1a7a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 0x7f67ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67f1a7a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec157ca0 0x7f67ec15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67f1a7a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ec0d07c0 con 0x7f67ec06d120 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67f1a7a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0cfbb0 con 0x7f67ec157ca0 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67f1a7a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0cfe90 con 0x7f67ec1578d0 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec157ca0 0x7f67ec15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67ec157ca0 0x7f67ec15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42594/0 (socket says 172.21.15.6:42594) 2023-10-09T11:38:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 -- 172.21.15.6:0/2418102086 learned_addr learned my addr 172.21.15.6:0/2418102086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/2418102086 >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 0x7f67ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 -- 172.21.15.6:0/2418102086 >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 msgr2=0x7f67ec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 --2- 172.21.15.6:0/2418102086 >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 0x7f67ec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 -- 172.21.15.6:0/2418102086 >> v1:172.21.15.118:6789/0 conn(0x7f67ec06d120 legacy=0x7f67ec06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 -- 172.21.15.6:0/2418102086 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0d0170 con 0x7f67ec157ca0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/2418102086 >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 0x7f67ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67eaffd700 1 --2- 172.21.15.6:0/2418102086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec157ca0 0x7f67ec15af00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0646b0 tx=0x7f67e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42afb7adb1ca2ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67ea7fc700 1 -- 172.21.15.6:0/2418102086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000b820 con 0x7f67ec157ca0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.678+0000 7f67ea7fc700 1 -- 172.21.15.6:0/2418102086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e000b980 con 0x7f67ec157ca0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67ea7fc700 1 -- 172.21.15.6:0/2418102086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000bd20 con 0x7f67ec157ca0 2023-10-09T11:38:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 -- 172.21.15.6:0/2418102086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec157ca0 msgr2=0x7f67ec15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/2418102086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec157ca0 0x7f67ec15af00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0646b0 tx=0x7f67e0009250 comp rx=0 tx=0).stop 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 -- 172.21.15.6:0/2418102086 shutdown_connections 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/2418102086 >> v2:172.21.15.118:3300/0 conn(0x7f67ec1578d0 0x7f67ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/2418102086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec157ca0 0x7f67ec15af00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 -- 172.21.15.6:0/2418102086 >> 172.21.15.6:0/2418102086 conn(0x7f67ec06bb90 msgr2=0x7f67ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 -- 172.21.15.6:0/2418102086 shutdown_connections 2023-10-09T11:38:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.679+0000 7f67f1a7a700 1 -- 172.21.15.6:0/2418102086 wait complete. 2023-10-09T11:38:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.680+0000 7f67f1a7a700 1 Processor -- start 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.680+0000 7f67f1a7a700 1 -- start start 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67ec06d120 0x7f67ec0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ec157ca0 0x7f67ec0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0ac9a0 con 0x7f67ec1578d0 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec154250 con 0x7f67ec157ca0 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67f1a7a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0abab0 con 0x7f67ec06d120 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42610/0 (socket says 172.21.15.6:42610) 2023-10-09T11:38:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 -- 172.21.15.6:0/1080774173 learned_addr learned my addr 172.21.15.6:0/1080774173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67ec06d120 0x7f67ec0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67ebfff700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ec157ca0 0x7f67ec0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 -- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67ec06d120 msgr2=0x7f67ec0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67ec06d120 0x7f67ec0ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 -- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ec157ca0 msgr2=0x7f67ec0b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ec157ca0 0x7f67ec0b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.681+0000 7f67eaffd700 1 -- 172.21.15.6:0/1080774173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00094f0 con 0x7f67ec1578d0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67eaffd700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f67e00030c0 tx=0x7f67e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000bbc0 con 0x7f67ec1578d0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0020070 con 0x7f67ec1578d0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec0abd90 con 0x7f67ec1578d0 2023-10-09T11:38:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e001b6a0 con 0x7f67ec1578d0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.682+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec0ac350 con 0x7f67ec1578d0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.683+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec0acb10 con 0x7f67ec1578d0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.683+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67e0022030 con 0x7f67ec1578d0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.684+0000 7f67d37fe700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.684+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f67e00860c0 con 0x7f67ec1578d0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.684+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.684+0000 7f67eb7fe700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 0x7f67d80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00ad30 tx=0x7f67dc006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.688+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67e00535e0 con 0x7f67ec1578d0 2023-10-09T11:38:05.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.881+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67ec0acae0 con 0x7f67ec1578d0 2023-10-09T11:38:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.881+0000 7f67d37fe700 1 -- 172.21.15.6:0/1080774173 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f67e0056c00 con 0x7f67ec1578d0 2023-10-09T11:38:05.883 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:05.883 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:38:05.121960+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:38:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 msgr2=0x7f67d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 0x7f67d80693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00ad30 tx=0x7f67dc006f90 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 msgr2=0x7f67ec153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f67e00030c0 tx=0x7f67e0016000 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 shutdown_connections 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f67d8066f30 0x7f67d80693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67ec157ca0 0x7f67ec0b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67ec06d120 0x7f67ec0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 --2- 172.21.15.6:0/1080774173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67ec1578d0 0x7f67ec153d10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 >> 172.21.15.6:0/1080774173 conn(0x7f67ec06bb90 msgr2=0x7f67ec1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 shutdown_connections 2023-10-09T11:38:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:05.884+0000 7f67f1a7a700 1 -- 172.21.15.6:0/1080774173 wait complete. 2023-10-09T11:38:05.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:38:05.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:38:06.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.019+0000 7f4e35706700 1 Processor -- start 2023-10-09T11:38:06.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.019+0000 7f4e35706700 1 -- start start 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e35706700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4e300d0b80 0x7f4e300cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e35706700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e300cf2d0 con 0x7f4e300d02b0 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e35706700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3006dc00 con 0x7f4e3006d700 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e35706700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3015a690 con 0x7f4e300d0b80 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e300d02b0 0x7f4e3006cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60112/0 (socket says 172.21.15.6:60112) 2023-10-09T11:38:06.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2f7fe700 1 -- 172.21.15.6:0/260289157 learned_addr learned my addr 172.21.15.6:0/260289157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/260289157 >> v2:172.21.15.118:3300/0 conn(0x7f4e300d0b80 0x7f4e300cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059644226 0 0) 0x7f4e300cf2d0 con 0x7f4e300d02b0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e1c003570 con 0x7f4e300d02b0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438742886 0 0) 0x7f4e1c003570 con 0x7f4e300d02b0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 >> v2:172.21.15.118:3300/0 conn(0x7f4e300d0b80 msgr2=0x7f4e300cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 --2- 172.21.15.6:0/260289157 >> v2:172.21.15.118:3300/0 conn(0x7f4e300d0b80 0x7f4e300cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 >> v1:172.21.15.118:6789/0 conn(0x7f4e3006d700 legacy=0x7f4e3015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300cf570 con 0x7f4e300d02b0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.020+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f4e18001470 con 0x7f4e300d02b0 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 >> v1:172.21.15.6:6789/0 conn(0x7f4e300d02b0 legacy=0x7f4e3006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 0x7f4e1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c004810 0x7f4e1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1c0051c0 0x7f4e1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3015a690 con 0x7f4e1c003a60 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c00c160 con 0x7f4e1c004810 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c00c320 con 0x7f4e1c0051c0 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 0x7f4e1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2f7fe700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c004810 0x7f4e1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e34f05700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1c0051c0 0x7f4e1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 -- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1c0051c0 msgr2=0x7f4e1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1c0051c0 0x7f4e1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 -- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c004810 msgr2=0x7f4e1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c004810 0x7f4e1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 -- 172.21.15.6:0/260289157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c003570 con 0x7f4e1c003a60 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e34f05700 1 -- 172.21.15.6:0/260289157 reap_dead start 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 0x7f4e1c003e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009c00 tx=0x7f4e200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa237dc2d79fdf14 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000e710 con 0x7f4e1c003a60 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000e870 con 0x7f4e1c003a60 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.021+0000 7f4e2effd700 1 -- 172.21.15.6:0/260289157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000ec30 con 0x7f4e1c003a60 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 -- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 msgr2=0x7f4e1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 0x7f4e1c003e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009c00 tx=0x7f4e200091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 -- 172.21.15.6:0/260289157 shutdown_connections 2023-10-09T11:38:06.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 --2- 172.21.15.6:0/260289157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e1c003a60 0x7f4e1c003e70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 -- 172.21.15.6:0/260289157 >> 172.21.15.6:0/260289157 conn(0x7f4e30063230 msgr2=0x7f4e30063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:06.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 -- 172.21.15.6:0/260289157 shutdown_connections 2023-10-09T11:38:06.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.022+0000 7f4e35706700 1 -- 172.21.15.6:0/260289157 wait complete. 2023-10-09T11:38:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.023+0000 7f4e35706700 1 Processor -- start 2023-10-09T11:38:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.023+0000 7f4e35706700 1 -- start start 2023-10-09T11:38:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 0x7f4e300c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 0x7f4e300cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300cc880 con 0x7f4e3016a1e0 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30157430 con 0x7f4e1c003a60 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e35706700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300c7170 con 0x7f4e300cbef0 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42632/0 (socket says 172.21.15.6:42632) 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 -- 172.21.15.6:0/2157745948 learned_addr learned my addr 172.21.15.6:0/2157745948 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 0x7f4e300c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e34f05700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 0x7f4e300cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 -- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 msgr2=0x7f4e300cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 0x7f4e300cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 -- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 msgr2=0x7f4e300c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 0x7f4e300c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2f7fe700 1 -- 172.21.15.6:0/2157745948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300c6b90 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 0x7f4e300c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.024+0000 7f4e34f05700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 0x7f4e300cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e2f7fe700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e180073c0 tx=0x7f4e300cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18018030 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800f8d0 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e300cac10 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800fc70 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.025+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e30156910 con 0x7f4e3016a1e0 2023-10-09T11:38:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.026+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e300c7300 con 0x7f4e3016a1e0 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.026+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e1801b070 con 0x7f4e3016a1e0 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.027+0000 7f4e27fff700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 0x7f4e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.027+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e18019070 con 0x7f4e3016a1e0 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.027+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 0x7f4e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.027+0000 7f4e2ffff700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 0x7f4e100693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e200091e0 tx=0x7f4e2001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.031+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e18051830 con 0x7f4e3016a1e0 2023-10-09T11:38:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.228+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e300676e0 con 0x7f4e3016a1e0 2023-10-09T11:38:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.228+0000 7f4e27fff700 1 -- 172.21.15.6:0/2157745948 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e18054e50 con 0x7f4e3016a1e0 2023-10-09T11:38:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:38:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 msgr2=0x7f4e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 0x7f4e100693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4e200091e0 tx=0x7f4e2001a000 comp rx=0 tx=0).stop 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 msgr2=0x7f4e300cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4e180073c0 tx=0x7f4e300cf460 comp rx=0 tx=0).stop 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 shutdown_connections 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4e10066f30 0x7f4e100693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e300cbef0 0x7f4e300cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e1c003a60 0x7f4e300c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 --2- 172.21.15.6:0/2157745948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e3016a1e0 0x7f4e300cb9b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 >> 172.21.15.6:0/2157745948 conn(0x7f4e30063230 msgr2=0x7f4e300b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 shutdown_connections 2023-10-09T11:38:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.230+0000 7f4e35706700 1 -- 172.21.15.6:0/2157745948 wait complete. 2023-10-09T11:38:06.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:38:06.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 Processor -- start 2023-10-09T11:38:06.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 -- start start 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46ec0c8980 0x7f46ec0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec06d350 con 0x7f46ec0cae00 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec0c9ac0 con 0x7f46ec15daa0 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.361+0000 7f46f2b45700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec06c740 con 0x7f46ec0c8980 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46ebfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f46ec0cae00 0x7f46ec0aa890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60124/0 (socket says 172.21.15.6:60124) 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46ebfff700 1 -- 172.21.15.6:0/2521660571 learned_addr learned my addr 172.21.15.6:0/2521660571 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> v2:172.21.15.118:3300/0 conn(0x7f46ec0c8980 0x7f46ec0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786199397 0 0) 0x7f46ec06d350 con 0x7f46ec0cae00 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d4003570 con 0x7f46ec0cae00 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789233757 0 0) 0x7f46d4003570 con 0x7f46ec0cae00 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 >> v2:172.21.15.118:3300/0 conn(0x7f46ec0c8980 msgr2=0x7f46ec0aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 --2- 172.21.15.6:0/2521660571 >> v2:172.21.15.118:3300/0 conn(0x7f46ec0c8980 0x7f46ec0aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 >> v1:172.21.15.118:6789/0 conn(0x7f46ec15daa0 legacy=0x7f46ec15de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec06ca20 con 0x7f46ec0cae00 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f46e0001470 con 0x7f46ec0cae00 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> v2:172.21.15.118:3300/0 conn(0x7f46ec0c8980 0x7f46ec0aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 >> v1:172.21.15.6:6789/0 conn(0x7f46ec0cae00 legacy=0x7f46ec0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4003a60 0x7f46d4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4004810 0x7f46d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec06c740 con 0x7f46d40051c0 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400c050 con 0x7f46d4003a60 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d400c210 con 0x7f46d4004810 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46f08e1700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4003a60 0x7f46d4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.362+0000 7f46ebfff700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4004810 0x7f46d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 -- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4004810 msgr2=0x7f46d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46d4004810 0x7f46d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 -- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4003a60 msgr2=0x7f46d4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4003a60 0x7f46d4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 -- 172.21.15.6:0/2521660571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4003570 con 0x7f46d40051c0 2023-10-09T11:38:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f08e1700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46d4003a60 0x7f46d4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 -- 172.21.15.6:0/2521660571 reap_dead start 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f10e2700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46d400ba60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009df0 tx=0x7f46dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377c9d8f4ea6b632 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc009740 con 0x7f46d40051c0 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00e920 con 0x7f46d40051c0 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46eb7fe700 1 -- 172.21.15.6:0/2521660571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00ece0 con 0x7f46d40051c0 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 -- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 msgr2=0x7f46d400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46d400ba60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009df0 tx=0x7f46dc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 -- 172.21.15.6:0/2521660571 shutdown_connections 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2521660571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46d400ba60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 -- 172.21.15.6:0/2521660571 >> 172.21.15.6:0/2521660571 conn(0x7f46ec0c9ca0 msgr2=0x7f46ec0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 -- 172.21.15.6:0/2521660571 shutdown_connections 2023-10-09T11:38:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.363+0000 7f46f2b45700 1 -- 172.21.15.6:0/2521660571 wait complete. 2023-10-09T11:38:06.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 Processor -- start 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 -- start start 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ec0af1d0 0x7f46ec0ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ec0ab920 0x7f46ec169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0abdc0 con 0x7f46d40051c0 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0aaf50 con 0x7f46ec0ab920 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.365+0000 7f46f2b45700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0ae720 con 0x7f46ec0af1d0 2023-10-09T11:38:06.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42654/0 (socket says 172.21.15.6:42654) 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 -- 172.21.15.6:0/2040432655 learned_addr learned my addr 172.21.15.6:0/2040432655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 -- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ec0af1d0 msgr2=0x7f46ec0ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ec0af1d0 0x7f46ec0ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 -- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ec0ab920 msgr2=0x7f46ec169e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ec0ab920 0x7f46ec169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 -- 172.21.15.6:0/2040432655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0c74c0 con 0x7f46d40051c0 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f08e1700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f46e400fe70 tx=0x7f46e4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400dba0 con 0x7f46d40051c0 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400dd00 con 0x7f46d40051c0 2023-10-09T11:38:06.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec0aac70 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4013620 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.366+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec0ae3b0 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.367+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec0adf40 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.367+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e4003030 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.368+0000 7f46e8ff9700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 0x7f46d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.368+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f46e4084a80 con 0x7f46d40051c0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.368+0000 7f46ebfff700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 0x7f46d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.368+0000 7f46ebfff700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 0x7f46d80693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0b3040 tx=0x7f46e0001e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.372+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46e4052040 con 0x7f46d40051c0 2023-10-09T11:38:06.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.570+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f46ec04bb80 con 0x7f46d40051c0 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.570+0000 7f46e8ff9700 1 -- 172.21.15.6:0/2040432655 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7f46e4055660 con 0x7f46d40051c0 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:38:06.572 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:38:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 msgr2=0x7f46d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 0x7f46d80693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0b3040 tx=0x7f46e0001e70 comp rx=0 tx=0).stop 2023-10-09T11:38:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 msgr2=0x7f46ec15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f46e400fe70 tx=0x7f46e4009040 comp rx=0 tx=0).stop 2023-10-09T11:38:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 shutdown_connections 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f46d8066f30 0x7f46d80693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46ec0ab920 0x7f46ec169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46d40051c0 0x7f46ec15a7a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 --2- 172.21.15.6:0/2040432655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46ec0af1d0 0x7f46ec0ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 >> 172.21.15.6:0/2040432655 conn(0x7f46ec0c9ca0 msgr2=0x7f46ec0c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 shutdown_connections 2023-10-09T11:38:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.572+0000 7f46f2b45700 1 -- 172.21.15.6:0/2040432655 wait complete. 2023-10-09T11:38:06.586 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:38:06.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:38:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.707+0000 7f42bac32700 1 Processor -- start 2023-10-09T11:38:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.707+0000 7f42bac32700 1 -- start start 2023-10-09T11:38:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42bac32700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42b40b3340 0x7f42b406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42bac32700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b4069d10 con 0x7f42b406c190 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42bac32700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b415c130 con 0x7f42b4157a60 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42bac32700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b415c410 con 0x7f42b40b3340 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42b3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f42b406c190 0x7f42b40b2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60126/0 (socket says 172.21.15.6:60126) 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42b3fff700 1 -- 172.21.15.6:0/2130327091 learned_addr learned my addr 172.21.15.6:0/2130327091 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.708+0000 7f42b91cf700 1 --2- 172.21.15.6:0/2130327091 >> v2:172.21.15.118:3300/0 conn(0x7f42b40b3340 0x7f42b406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b37fe700 1 -- 172.21.15.6:0/2130327091 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296537546 0 0) 0x7f42b4069d10 con 0x7f42b406c190 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b37fe700 1 -- 172.21.15.6:0/2130327091 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f429c003570 con 0x7f42b406c190 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b91cf700 1 -- 172.21.15.6:0/2130327091 >> v1:172.21.15.118:6789/0 conn(0x7f42b4157a60 legacy=0x7f42b415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b91cf700 1 -- 172.21.15.6:0/2130327091 >> v1:172.21.15.6:6789/0 conn(0x7f42b406c190 legacy=0x7f42b40b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b91cf700 1 -- 172.21.15.6:0/2130327091 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b415c6f0 con 0x7f42b40b3340 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b91cf700 1 --2- 172.21.15.6:0/2130327091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b40b3340 0x7f42b406a1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009e60 tx=0x7f42ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f22b869e46946e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b37fe700 1 -- 172.21.15.6:0/2130327091 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00e070 con 0x7f42b40b3340 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b37fe700 1 -- 172.21.15.6:0/2130327091 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00bb60 con 0x7f42b40b3340 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.709+0000 7f42b37fe700 1 -- 172.21.15.6:0/2130327091 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac012430 con 0x7f42b40b3340 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 -- 172.21.15.6:0/2130327091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b40b3340 msgr2=0x7f42b406a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 --2- 172.21.15.6:0/2130327091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b40b3340 0x7f42b406a1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009e60 tx=0x7f42ac009780 comp rx=0 tx=0).stop 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 -- 172.21.15.6:0/2130327091 shutdown_connections 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 --2- 172.21.15.6:0/2130327091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b40b3340 0x7f42b406a1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 -- 172.21.15.6:0/2130327091 >> 172.21.15.6:0/2130327091 conn(0x7f42b406cca0 msgr2=0x7f42b406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 -- 172.21.15.6:0/2130327091 shutdown_connections 2023-10-09T11:38:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.710+0000 7f42bac32700 1 -- 172.21.15.6:0/2130327091 wait complete. 2023-10-09T11:38:06.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.711+0000 7f42bac32700 1 Processor -- start 2023-10-09T11:38:06.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.711+0000 7f42bac32700 1 -- start start 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42b40b3340 0x7f42b4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 0x7f42b40ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40cd9f0 con 0x7f42b406c190 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40ad510 con 0x7f42b4157a60 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42bac32700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40adad0 con 0x7f42b40b3340 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42660/0 (socket says 172.21.15.6:42660) 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 -- 172.21.15.6:0/3049018007 learned_addr learned my addr 172.21.15.6:0/3049018007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b91cf700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 0x7f42b40ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b3fff700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42b40b3340 0x7f42b4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 -- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42b40b3340 msgr2=0x7f42b4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42b40b3340 0x7f42b4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 -- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 msgr2=0x7f42b40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 0x7f42b40ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 -- 172.21.15.6:0/3049018007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009a20 con 0x7f42b406c190 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b91cf700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 0x7f42b40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.712+0000 7f42b89ce700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c4e0 tx=0x7f42a400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.713+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011590 con 0x7f42b406c190 2023-10-09T11:38:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.713+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4011710 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.713+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011ad0 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.713+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40cd430 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.713+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40ad760 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.714+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b4068900 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.714+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42a401b3b0 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.714+0000 7f42b0ff9700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.714+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f42a4083710 con 0x7f42b406c190 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.715+0000 7f42b3fff700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.715+0000 7f42b3fff700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42b41547b0 tx=0x7f42a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.719+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42a4050cd0 con 0x7f42b406c190 2023-10-09T11:38:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:06.911+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f42b40addb0 con 0x7f42b406c190 2023-10-09T11:38:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.112+0000 7f42b0ff9700 1 -- 172.21.15.6:0/3049018007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f42a4017020 con 0x7f42b406c190 2023-10-09T11:38:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.115+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 msgr2=0x7f42a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.115+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 0x7f42a00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42b41547b0 tx=0x7f42a8009040 comp rx=0 tx=0).stop 2023-10-09T11:38:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.115+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 msgr2=0x7f42b40adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.115+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f42a400c4e0 tx=0x7f42a400c8a0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 shutdown_connections 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42a0066f30 0x7f42a00693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42b4157a60 0x7f42b40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42b406c190 0x7f42b40adf60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 --2- 172.21.15.6:0/3049018007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42b40b3340 0x7f42b4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 >> 172.21.15.6:0/3049018007 conn(0x7f42b406cca0 msgr2=0x7f42b414b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 shutdown_connections 2023-10-09T11:38:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.116+0000 7f42bac32700 1 -- 172.21.15.6:0/3049018007 wait complete. 2023-10-09T11:38:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:38:07.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:38:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.254+0000 7f74f0330700 1 Processor -- start 2023-10-09T11:38:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.254+0000 7f74f0330700 1 -- start start 2023-10-09T11:38:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.255+0000 7f74f0330700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74e815a790 0x7f74e815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.255+0000 7f74f0330700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e815b0a0 0x7f74e806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.255+0000 7f74f0330700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e815e900 con 0x7f74e806c0d0 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.255+0000 7f74f0330700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e806c550 con 0x7f74e815a790 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.255+0000 7f74f0330700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e815da10 con 0x7f74e815b0a0 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74e815a790 0x7f74e815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee8cd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74e806c0d0 0x7f74e80ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60136/0 (socket says 172.21.15.6:60136) 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee8cd700 1 -- 172.21.15.6:0/867333285 learned_addr learned my addr 172.21.15.6:0/867333285 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ed8cb700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e815b0a0 0x7f74e806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 -- 172.21.15.6:0/867333285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e815b0a0 msgr2=0x7f74e806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e815b0a0 0x7f74e806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 -- 172.21.15.6:0/867333285 >> v1:172.21.15.6:6789/0 conn(0x7f74e806c0d0 legacy=0x7f74e80ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 -- 172.21.15.6:0/867333285 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e815dcf0 con 0x7f74e815a790 2023-10-09T11:38:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ed0ca700 1 -- 172.21.15.6:0/867333285 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954372173 0 0) 0x7f74e815e900 con 0x7f74e806c0d0 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ee0cc700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815a790 0x7f74e815ab60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f74e00098e0 tx=0x7f74e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3da40edec56892 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ed0ca700 1 -- 172.21.15.6:0/867333285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0009e80 con 0x7f74e815a790 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ed0ca700 1 -- 172.21.15.6:0/867333285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000b860 con 0x7f74e815a790 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.256+0000 7f74ed0ca700 1 -- 172.21.15.6:0/867333285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000bbe0 con 0x7f74e815a790 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 -- 172.21.15.6:0/867333285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815a790 msgr2=0x7f74e815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815a790 0x7f74e815ab60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f74e00098e0 tx=0x7f74e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 -- 172.21.15.6:0/867333285 shutdown_connections 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815a790 0x7f74e815ab60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 --2- 172.21.15.6:0/867333285 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e815b0a0 0x7f74e806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 -- 172.21.15.6:0/867333285 >> 172.21.15.6:0/867333285 conn(0x7f74e806cca0 msgr2=0x7f74e806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 -- 172.21.15.6:0/867333285 shutdown_connections 2023-10-09T11:38:07.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.257+0000 7f74f0330700 1 -- 172.21.15.6:0/867333285 wait complete. 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.258+0000 7f74f0330700 1 Processor -- start 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.258+0000 7f74f0330700 1 -- start start 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e806c0d0 0x7f74e8148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e815a790 0x7f74e816a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80b0b50 con 0x7f74e815b0a0 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8148ba0 con 0x7f74e815a790 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e816ace0 con 0x7f74e806c0d0 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42666/0 (socket says 172.21.15.6:42666) 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 -- 172.21.15.6:0/4227253286 learned_addr learned my addr 172.21.15.6:0/4227253286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee0cc700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e806c0d0 0x7f74e8148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ed8cb700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e815a790 0x7f74e816a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 -- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e806c0d0 msgr2=0x7f74e8148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e806c0d0 0x7f74e8148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 -- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e815a790 msgr2=0x7f74e816a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e815a790 0x7f74e816a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:07.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 -- 172.21.15.6:0/4227253286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009420 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74ee8cd700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f74d800ccc0 tx=0x7f74d8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800a950 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800aab0 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.259+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e816afc0 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.260+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800ae70 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.260+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e816aa00 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.261+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80b0920 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.261+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74d8007300 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.261+0000 7f74e67fc700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 0x7f74d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.261+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f74d80847d0 con 0x7f74e815b0a0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.261+0000 7f74ee0cc700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 0x7f74d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:07.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.262+0000 7f74ee0cc700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 0x7f74d40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74e00091e0 tx=0x7f74e0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.266+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74e80b0920 con 0x7f74e815b0a0 2023-10-09T11:38:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:07.459+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f74e816b4f0 con 0x7f74e815b0a0 2023-10-09T11:38:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.117+0000 7f74e67fc700 1 -- 172.21.15.6:0/4227253286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7f74d8055690 con 0x7f74e815b0a0 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 msgr2=0x7f74d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 0x7f74d40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74e00091e0 tx=0x7f74e0017000 comp rx=0 tx=0).stop 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 msgr2=0x7f74e8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f74d800ccc0 tx=0x7f74d8001a80 comp rx=0 tx=0).stop 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 shutdown_connections 2023-10-09T11:38:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f74d4066f30 0x7f74d40693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74e815b0a0 0x7f74e8159000 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74e806c0d0 0x7f74e8148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 --2- 172.21.15.6:0/4227253286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74e815a790 0x7f74e816a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.124+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 >> 172.21.15.6:0/4227253286 conn(0x7f74e806cca0 msgr2=0x7f74e80ad300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.128+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 shutdown_connections 2023-10-09T11:38:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.128+0000 7f74f0330700 1 -- 172.21.15.6:0/4227253286 wait complete. 2023-10-09T11:38:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:38:08.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:38:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.269+0000 7fa189c5f700 1 Processor -- start 2023-10-09T11:38:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.269+0000 7fa189c5f700 1 -- start start 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa189c5f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa18406d830 0x7fa1840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa189c5f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840d07c0 con 0x7fa1841578d0 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa189c5f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840cfbb0 con 0x7fa184157ca0 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa189c5f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1840cfe90 con 0x7fa18406d830 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa1837fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1841578d0 0x7fa18415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60146/0 (socket says 172.21.15.6:60146) 2023-10-09T11:38:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa1837fe700 1 -- 172.21.15.6:0/2617598457 learned_addr learned my addr 172.21.15.6:0/2617598457 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa183fff700 1 --2- 172.21.15.6:0/2617598457 >> v2:172.21.15.118:3300/0 conn(0x7fa18406d830 0x7fa1840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498123566 0 0) 0x7fa1840d07c0 con 0x7fa1841578d0 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa170003570 con 0x7fa1841578d0 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa183fff700 1 -- 172.21.15.6:0/2617598457 >> v1:172.21.15.118:6789/0 conn(0x7fa184157ca0 legacy=0x7fa18406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285487526 0 0) 0x7fa1840cfbb0 con 0x7fa184157ca0 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa183fff700 1 -- 172.21.15.6:0/2617598457 >> v1:172.21.15.6:6789/0 conn(0x7fa1841578d0 legacy=0x7fa18415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa183fff700 1 -- 172.21.15.6:0/2617598457 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840d0170 con 0x7fa18406d830 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.270+0000 7fa183fff700 1 --2- 172.21.15.6:0/2617598457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840cf4f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098e0 tx=0x7fa17c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85de5f4ffd0fd1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00b640 con 0x7fa18406d830 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00b7a0 con 0x7fa18406d830 2023-10-09T11:38:08.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa1827fc700 1 -- 172.21.15.6:0/2617598457 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00bb40 con 0x7fa18406d830 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 -- 172.21.15.6:0/2617598457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 msgr2=0x7fa1840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 --2- 172.21.15.6:0/2617598457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840cf4f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098e0 tx=0x7fa17c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 -- 172.21.15.6:0/2617598457 shutdown_connections 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 --2- 172.21.15.6:0/2617598457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840cf4f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 -- 172.21.15.6:0/2617598457 >> 172.21.15.6:0/2617598457 conn(0x7fa18406bb90 msgr2=0x7fa18406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 -- 172.21.15.6:0/2617598457 shutdown_connections 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.271+0000 7fa189c5f700 1 -- 172.21.15.6:0/2617598457 wait complete. 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.272+0000 7fa189c5f700 1 Processor -- start 2023-10-09T11:38:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.272+0000 7fa189c5f700 1 -- start start 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa184157ca0 0x7fa184159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18416dac0 con 0x7fa1841578d0 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18416dda0 con 0x7fa18406d830 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa189c5f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18416e080 con 0x7fa184157ca0 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa182ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa182ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42680/0 (socket says 172.21.15.6:42680) 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.273+0000 7fa182ffd700 1 -- 172.21.15.6:0/3714732714 learned_addr learned my addr 172.21.15.6:0/3714732714 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa1837fe700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa183fff700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa184157ca0 0x7fa184159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 -- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa184157ca0 msgr2=0x7fa184159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa184157ca0 0x7fa184159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 -- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 msgr2=0x7fa1840b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 -- 172.21.15.6:0/3714732714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009420 con 0x7fa1841578d0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa1837fe700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa182ffd700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c560 tx=0x7fa16c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c011590 con 0x7fa1841578d0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c011710 con 0x7fa1841578d0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18416e360 con 0x7fa1841578d0 2023-10-09T11:38:08.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c011ad0 con 0x7fa1841578d0 2023-10-09T11:38:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.274+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1840b6930 con 0x7fa1841578d0 2023-10-09T11:38:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.275+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa184067ac0 con 0x7fa1841578d0 2023-10-09T11:38:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.275+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa16c01b3b0 con 0x7fa1841578d0 2023-10-09T11:38:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.276+0000 7fa17b7fe700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 0x7fa1640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:08.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.276+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa16c083a20 con 0x7fa1841578d0 2023-10-09T11:38:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.276+0000 7fa1837fe700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 0x7fa1640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.276+0000 7fa1837fe700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 0x7fa1640693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa174005c50 tx=0x7fa174009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:08.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.281+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa16c050cf0 con 0x7fa1841578d0 2023-10-09T11:38:08.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:08.520+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa1840d0450 con 0x7fa1841578d0 2023-10-09T11:38:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.146+0000 7fa17b7fe700 1 -- 172.21.15.6:0/3714732714 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa16c017070 con 0x7fa1841578d0 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 msgr2=0x7fa1640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 0x7fa1640693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa174005c50 tx=0x7fa174009040 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 msgr2=0x7fa184154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c560 tx=0x7fa16c007f50 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 shutdown_connections 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa164066f30 0x7fa1640693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa184157ca0 0x7fa184159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa18406d830 0x7fa1840b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 --2- 172.21.15.6:0/3714732714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1841578d0 0x7fa184154500 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.151+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 >> 172.21.15.6:0/3714732714 conn(0x7fa18406bb90 msgr2=0x7fa184155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.152+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 shutdown_connections 2023-10-09T11:38:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.152+0000 7fa189c5f700 1 -- 172.21.15.6:0/3714732714 wait complete. 2023-10-09T11:38:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T11:38:09.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:38:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.288+0000 7f391d60e700 1 Processor -- start 2023-10-09T11:38:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.288+0000 7f391d60e700 1 -- start start 2023-10-09T11:38:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f391d60e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39180cf240 0x7f39180b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f391d60e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180b0ca0 con 0x7f391815a2a0 2023-10-09T11:38:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f391d60e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180b00d0 con 0x7f391806d650 2023-10-09T11:38:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f391d60e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391806ea90 con 0x7f39180cf240 2023-10-09T11:38:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3916ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f391815a2a0 0x7f39180ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60150/0 (socket says 172.21.15.6:60150) 2023-10-09T11:38:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3916ffd700 1 -- 172.21.15.6:0/167620725 learned_addr learned my addr 172.21.15.6:0/167620725 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f39167fc700 1 --2- 172.21.15.6:0/167620725 >> v2:172.21.15.118:3300/0 conn(0x7f39180cf240 0x7f39180b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175319514 0 0) 0x7f39180b0ca0 con 0x7f391815a2a0 2023-10-09T11:38:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3900003570 con 0x7f391815a2a0 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130155776 0 0) 0x7f3900003570 con 0x7f391815a2a0 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 >> v2:172.21.15.118:3300/0 conn(0x7f39180cf240 msgr2=0x7f39180b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 --2- 172.21.15.6:0/167620725 >> v2:172.21.15.118:3300/0 conn(0x7f39180cf240 0x7f39180b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 >> v1:172.21.15.118:6789/0 conn(0x7f391806d650 legacy=0x7f391806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180b0370 con 0x7f391815a2a0 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.289+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f3908001470 con 0x7f391815a2a0 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 >> v1:172.21.15.6:6789/0 conn(0x7f391815a2a0 legacy=0x7f39180ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f3900003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3900004810 0x7f3900004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39000051c0 0x7f390000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391806ea90 con 0x7f3900003a60 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390000c0d0 con 0x7f39000051c0 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390000c290 con 0x7f3900004810 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f3900003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f39177fe700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39000051c0 0x7f390000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f39167fc700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3900004810 0x7f3900004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 -- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3900004810 msgr2=0x7f3900004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3900004810 0x7f3900004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 -- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39000051c0 msgr2=0x7f390000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39000051c0 0x7f390000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 -- 172.21.15.6:0/167620725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900003570 con 0x7f3900003a60 2023-10-09T11:38:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f39177fe700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39000051c0 0x7f390000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f39177fe700 1 -- 172.21.15.6:0/167620725 reap_dead start 2023-10-09T11:38:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3916ffd700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f3900003e70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f390800c390 tx=0x7f39180b0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7287534a5afcffb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800cc60 con 0x7f3900003a60 2023-10-09T11:38:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800cdc0 con 0x7f3900003a60 2023-10-09T11:38:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.290+0000 7f3915ffb700 1 -- 172.21.15.6:0/167620725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908005b70 con 0x7f3900003a60 2023-10-09T11:38:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 -- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 msgr2=0x7f3900003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f3900003e70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f390800c390 tx=0x7f39180b0260 comp rx=0 tx=0).stop 2023-10-09T11:38:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 -- 172.21.15.6:0/167620725 shutdown_connections 2023-10-09T11:38:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 --2- 172.21.15.6:0/167620725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f3900003e70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 -- 172.21.15.6:0/167620725 >> 172.21.15.6:0/167620725 conn(0x7f3918067640 msgr2=0x7f3918067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 -- 172.21.15.6:0/167620725 shutdown_connections 2023-10-09T11:38:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.291+0000 7f391d60e700 1 -- 172.21.15.6:0/167620725 wait complete. 2023-10-09T11:38:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.292+0000 7f391d60e700 1 Processor -- start 2023-10-09T11:38:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.292+0000 7f391d60e700 1 -- start start 2023-10-09T11:38:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39180ade00 0x7f39180b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39180ae270 0x7f39180b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180b27b0 con 0x7f3900003a60 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391815e5d0 con 0x7f39180ade00 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f391d60e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391815ee40 con 0x7f39180ae270 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42706/0 (socket says 172.21.15.6:42706) 2023-10-09T11:38:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 -- 172.21.15.6:0/2452777342 learned_addr learned my addr 172.21.15.6:0/2452777342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f39177fe700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39180ae270 0x7f39180b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f39167fc700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39180ade00 0x7f39180b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 -- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39180ae270 msgr2=0x7f39180b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39180ae270 0x7f39180b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 -- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39180ade00 msgr2=0x7f39180b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39180ade00 0x7f39180b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.293+0000 7f3916ffd700 1 -- 172.21.15.6:0/2452777342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391815dd70 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f3916ffd700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f390000c0a0 tx=0x7f3908015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908022070 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908000bc0 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391815ca10 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908007300 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.294+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391815cfd0 con 0x7f3900003a60 2023-10-09T11:38:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.295+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3918069e40 con 0x7f3900003a60 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.295+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39080076f0 con 0x7f3900003a60 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.296+0000 7f38feffd700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 0x7f39040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.296+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3908085080 con 0x7f3900003a60 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.296+0000 7f39167fc700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 0x7f39040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.296+0000 7f39167fc700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 0x7f39040693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39180ce510 tx=0x7f390c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.300+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39080523b0 con 0x7f3900003a60 2023-10-09T11:38:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.496+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f391804bb80 con 0x7f3900003a60 2023-10-09T11:38:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.497+0000 7f38feffd700 1 -- 172.21.15.6:0/2452777342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f39080559d0 con 0x7f3900003a60 2023-10-09T11:38:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":61,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:38:08.522553+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.499+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 msgr2=0x7f39040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 0x7f39040693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39180ce510 tx=0x7f390c008040 comp rx=0 tx=0).stop 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 msgr2=0x7f391815e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f390000c0a0 tx=0x7f3908015000 comp rx=0 tx=0).stop 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 shutdown_connections 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3904066f30 0x7f39040693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39180ae270 0x7f39180b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3900003a60 0x7f391815e900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 --2- 172.21.15.6:0/2452777342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39180ade00 0x7f39180b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 >> 172.21.15.6:0/2452777342 conn(0x7f3918067640 msgr2=0x7f39180cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 shutdown_connections 2023-10-09T11:38:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.500+0000 7f391d60e700 1 -- 172.21.15.6:0/2452777342 wait complete. 2023-10-09T11:38:09.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:38:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.631+0000 7f588bc9b700 1 Processor -- start 2023-10-09T11:38:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.631+0000 7f588bc9b700 1 -- start start 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588bc9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f58841578d0 0x7f58840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588bc9b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58840d07c0 con 0x7f588406d120 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588bc9b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58840cfbb0 con 0x7f5884157ca0 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588bc9b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58840cfe90 con 0x7f58841578d0 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588a238700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f588406d120 0x7f588406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60166/0 (socket says 172.21.15.6:60166) 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f588a238700 1 -- 172.21.15.6:0/3611976900 learned_addr learned my addr 172.21.15.6:0/3611976900 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5889a37700 1 --2- 172.21.15.6:0/3611976900 >> v2:172.21.15.118:3300/0 conn(0x7f58841578d0 0x7f58840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304305012 0 0) 0x7f58840d07c0 con 0x7f588406d120 2023-10-09T11:38:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003570 con 0x7f588406d120 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2365152450 0 0) 0x7f586c003570 con 0x7f588406d120 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 >> v2:172.21.15.118:3300/0 conn(0x7f58841578d0 msgr2=0x7f58840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 --2- 172.21.15.6:0/3611976900 >> v2:172.21.15.118:3300/0 conn(0x7f58841578d0 0x7f58840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 >> v1:172.21.15.118:6789/0 conn(0x7f5884157ca0 legacy=0x7f588415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840d0170 con 0x7f588406d120 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f587c0017f0 con 0x7f588406d120 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 >> v1:172.21.15.6:6789/0 conn(0x7f588406d120 legacy=0x7f588406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c003a60 0x7f586c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f586c004810 0x7f586c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 0x7f586c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840cfe90 con 0x7f586c0051c0 2023-10-09T11:38:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c00c050 con 0x7f586c004810 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.632+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c00c210 con 0x7f586c003a60 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 0x7f586c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f5889a37700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c003a60 0x7f586c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f5889236700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f586c004810 0x7f586c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 -- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c003a60 msgr2=0x7f586c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c003a60 0x7f586c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 -- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f586c004810 msgr2=0x7f586c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f586c004810 0x7f586c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 -- 172.21.15.6:0/3611976900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c003570 con 0x7f586c0051c0 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 -- 172.21.15.6:0/3611976900 reap_dead start 2023-10-09T11:38:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f588a238700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 0x7f586c00ba60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f587c00a950 tx=0x7f587c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daf87a26727c9c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0070d0 con 0x7f586c0051c0 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c007270 con 0x7f586c0051c0 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.633+0000 7f5888a35700 1 -- 172.21.15.6:0/3611976900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c007630 con 0x7f586c0051c0 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 -- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 msgr2=0x7f586c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 0x7f586c00ba60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f587c00a950 tx=0x7f587c0021f0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 -- 172.21.15.6:0/3611976900 shutdown_connections 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 --2- 172.21.15.6:0/3611976900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586c0051c0 0x7f586c00ba60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 -- 172.21.15.6:0/3611976900 >> 172.21.15.6:0/3611976900 conn(0x7f588406bb90 msgr2=0x7f588406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 -- 172.21.15.6:0/3611976900 shutdown_connections 2023-10-09T11:38:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.634+0000 7f588bc9b700 1 -- 172.21.15.6:0/3611976900 wait complete. 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.635+0000 7f588bc9b700 1 Processor -- start 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.635+0000 7f588bc9b700 1 -- start start 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c0051c0 0x7f5884153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 0x7f58840ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840b6050 con 0x7f58840b56a0 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840adc40 con 0x7f58840ac540 2023-10-09T11:38:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58840ad030 con 0x7f586c0051c0 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42738/0 (socket says 172.21.15.6:42738) 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 -- 172.21.15.6:0/2091345780 learned_addr learned my addr 172.21.15.6:0/2091345780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5889a37700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c0051c0 0x7f5884153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5889236700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 0x7f58840ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 -- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c0051c0 msgr2=0x7f5884153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c0051c0 0x7f5884153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 -- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 msgr2=0x7f58840ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 0x7f58840ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 -- 172.21.15.6:0/2091345780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840ad310 con 0x7f58840b56a0 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5889236700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 0x7f58840ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588a238700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5884063f70 tx=0x7f587c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c001250 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c0017b0 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840ad5f0 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.636+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c007630 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.637+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5884153a50 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.638+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884067ac0 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.638+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f587c01a040 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.638+0000 7f5881ffb700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 0x7f58700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.638+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f587c086830 con 0x7f58840b56a0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.638+0000 7f5889a37700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 0x7f58700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.639+0000 7f5889a37700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 0x7f58700693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5874006f00 tx=0x7f58740091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.643+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f587c053aa0 con 0x7f58840b56a0 2023-10-09T11:38:09.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.838+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58840d0450 con 0x7f58840b56a0 2023-10-09T11:38:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.839+0000 7f5881ffb700 1 -- 172.21.15.6:0/2091345780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f587c016090 con 0x7f58840b56a0 2023-10-09T11:38:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":61,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:38:08.522553+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 msgr2=0x7f58700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 0x7f58700693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5874006f00 tx=0x7f58740091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 msgr2=0x7f58840b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5884063f70 tx=0x7f587c015000 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 shutdown_connections 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5870066f30 0x7f58700693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58840b56a0 0x7f58840b5b10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f586c0051c0 0x7f5884153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 --2- 172.21.15.6:0/2091345780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58840ac540 0x7f58840ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 >> 172.21.15.6:0/2091345780 conn(0x7f588406bb90 msgr2=0x7f588415a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 shutdown_connections 2023-10-09T11:38:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.841+0000 7f588bc9b700 1 -- 172.21.15.6:0/2091345780 wait complete. 2023-10-09T11:38:09.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:38:09.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.975+0000 7f03a5f28700 1 Processor -- start 2023-10-09T11:38:09.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.975+0000 7f03a5f28700 1 -- start start 2023-10-09T11:38:09.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a5f28700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03a006d700 0x7f03a015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a5f28700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a00cf2d0 con 0x7f03a00d0b80 2023-10-09T11:38:09.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a5f28700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a00d0480 con 0x7f03a00d0f50 2023-10-09T11:38:09.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a5f28700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a015a690 con 0x7f03a006d700 2023-10-09T11:38:09.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a4f26700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03a00d0b80 0x7f03a00cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60182/0 (socket says 172.21.15.6:60182) 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a4f26700 1 -- 172.21.15.6:0/2602963696 learned_addr learned my addr 172.21.15.6:0/2602963696 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f03a5727700 1 --2- 172.21.15.6:0/2602963696 >> v2:172.21.15.118:3300/0 conn(0x7f03a006d700 0x7f03a015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858466073 0 0) 0x7f03a00cf2d0 con 0x7f03a00d0b80 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.976+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0388003570 con 0x7f03a00d0b80 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704922508 0 0) 0x7f03a00d0480 con 0x7f03a00d0f50 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a00cf2d0 con 0x7f03a00d0f50 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2610871941 0 0) 0x7f0388003570 con 0x7f03a00d0b80 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f03a5727700 1 -- 172.21.15.6:0/2602963696 >> v1:172.21.15.118:6789/0 conn(0x7f03a00d0f50 legacy=0x7f03a006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f03a5727700 1 -- 172.21.15.6:0/2602963696 >> v1:172.21.15.6:6789/0 conn(0x7f03a00d0b80 legacy=0x7f03a00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f03a5727700 1 -- 172.21.15.6:0/2602963696 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a006dc00 con 0x7f03a006d700 2023-10-09T11:38:09.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f03a5727700 1 --2- 172.21.15.6:0/2602963696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a006d700 0x7f03a015b320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0398009e60 tx=0x7f0398009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c4243aa13e14f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039800e070 con 0x7f03a006d700 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039800b7a0 con 0x7f03a006d700 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.977+0000 7f039f7fe700 1 -- 172.21.15.6:0/2602963696 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0390001470 con 0x7f03a006d700 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 -- 172.21.15.6:0/2602963696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a006d700 msgr2=0x7f03a015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 --2- 172.21.15.6:0/2602963696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a006d700 0x7f03a015b320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0398009e60 tx=0x7f0398009780 comp rx=0 tx=0).stop 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 -- 172.21.15.6:0/2602963696 shutdown_connections 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 --2- 172.21.15.6:0/2602963696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a006d700 0x7f03a015b320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 -- 172.21.15.6:0/2602963696 >> 172.21.15.6:0/2602963696 conn(0x7f03a0063230 msgr2=0x7f03a0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 -- 172.21.15.6:0/2602963696 shutdown_connections 2023-10-09T11:38:09.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.978+0000 7f03a5f28700 1 -- 172.21.15.6:0/2602963696 wait complete. 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.979+0000 7f03a5f28700 1 Processor -- start 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.979+0000 7f03a5f28700 1 -- start start 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03a006d700 0x7f03a016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a00d0b80 0x7f03a01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00abf50 con 0x7f03a00d0f50 2023-10-09T11:38:09.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00ab2d0 con 0x7f03a00d0b80 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00ab5b0 con 0x7f03a006d700 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42746/0 (socket says 172.21.15.6:42746) 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 -- 172.21.15.6:0/4056204195 learned_addr learned my addr 172.21.15.6:0/4056204195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f039ffff700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a00d0b80 0x7f03a01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a4f26700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03a006d700 0x7f03a016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 -- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03a006d700 msgr2=0x7f03a016ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03a006d700 0x7f03a016ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 -- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a00d0b80 msgr2=0x7f03a01567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a00d0b80 0x7f03a01567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 -- 172.21.15.6:0/4056204195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398009a20 con 0x7f03a00d0f50 2023-10-09T11:38:09.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5727700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f03980099f0 tx=0x7f0398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398012c00 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398012d80 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00ab890 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039801e6a0 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.980+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a00aaa50 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.981+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a00676e0 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.982+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f039801ea90 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.982+0000 7f039cff9700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.982+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03980868a0 con 0x7f03a00d0f50 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.982+0000 7f03a4f26700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:09.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.983+0000 7f03a4f26700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 0x7f038c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0390001ed0 tx=0x7f0390000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:09.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:09.986+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0398053b10 con 0x7f03a00d0f50 2023-10-09T11:38:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:10.231+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f03a00cf570 con 0x7f03a00d0f50 2023-10-09T11:38:11.113 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-09T11:38:11.112+0000 7f36e88ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:38:11.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.158+0000 7f039cff9700 1 -- 172.21.15.6:0/4056204195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0398057130 con 0x7f03a00d0f50 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 msgr2=0x7f038c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 0x7f038c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0390001ed0 tx=0x7f0390000bc0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 msgr2=0x7f03a0156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f03980099f0 tx=0x7f0398017000 comp rx=0 tx=0).stop 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 shutdown_connections 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f038c066f30 0x7f038c0693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03a00d0f50 0x7f03a0156d10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f03a006d700 0x7f03a016ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 --2- 172.21.15.6:0/4056204195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03a00d0b80 0x7f03a01567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 >> 172.21.15.6:0/4056204195 conn(0x7f03a0063230 msgr2=0x7f03a01575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 shutdown_connections 2023-10-09T11:38:11.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.161+0000 7f03a5f28700 1 -- 172.21.15.6:0/4056204195 wait complete. 2023-10-09T11:38:11.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:38:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.305+0000 7fc843dea700 1 Processor -- start 2023-10-09T11:38:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 -- start start 2023-10-09T11:38:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc83c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc83c06d650 0x7fc83c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0b0ca0 con 0x7fc83c15a2a0 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c06ea90 con 0x7fc83c06d650 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.306+0000 7fc843dea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0b00d0 con 0x7fc83c0cf240 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc841b86700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc83c15a2a0 0x7fc83c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60198/0 (socket says 172.21.15.6:60198) 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc841b86700 1 -- 172.21.15.6:0/2035870296 learned_addr learned my addr 172.21.15.6:0/2035870296 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc842387700 1 --2- 172.21.15.6:0/2035870296 >> v2:172.21.15.118:3300/0 conn(0x7fc83c06d650 0x7fc83c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc841385700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc83c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111536092 0 0) 0x7fc83c0b0ca0 con 0x7fc83c15a2a0 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003570 con 0x7fc83c15a2a0 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288152713 0 0) 0x7fc824003570 con 0x7fc83c15a2a0 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 msgr2=0x7fc83c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc83c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 >> v2:172.21.15.118:3300/0 conn(0x7fc83c06d650 msgr2=0x7fc83c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 --2- 172.21.15.6:0/2035870296 >> v2:172.21.15.118:3300/0 conn(0x7fc83c06d650 0x7fc83c06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0b0370 con 0x7fc83c15a2a0 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fc834001470 con 0x7fc83c15a2a0 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 >> v1:172.21.15.6:6789/0 conn(0x7fc83c15a2a0 legacy=0x7fc83c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc824004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c06ea90 con 0x7fc824004d50 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0b00d0 con 0x7fc824003a60 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400ba60 con 0x7fc83c0cf240 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc842387700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc841b86700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.307+0000 7fc841385700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc824004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 -- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 msgr2=0x7fc824004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c0cf240 0x7fc824004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 -- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc824003a60 msgr2=0x7fc824003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 -- 172.21.15.6:0/2035870296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824003570 con 0x7fc824004d50 2023-10-09T11:38:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e210 tx=0x7fc82c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc534e9dd1530629 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ea60 con 0x7fc824004d50 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00f040 con 0x7fc824004d50 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc840b84700 1 -- 172.21.15.6:0/2035870296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ee10 con 0x7fc824004d50 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc843dea700 1 -- 172.21.15.6:0/2035870296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc824004d50 msgr2=0x7fc8240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc843dea700 1 --2- 172.21.15.6:0/2035870296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc824004d50 0x7fc8240051c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e210 tx=0x7fc82c00b040 comp rx=0 tx=0).stop 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc842387700 1 -- 172.21.15.6:0/2035870296 reap_dead start 2023-10-09T11:38:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc843dea700 1 -- 172.21.15.6:0/2035870296 shutdown_connections 2023-10-09T11:38:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.308+0000 7fc843dea700 1 -- 172.21.15.6:0/2035870296 >> 172.21.15.6:0/2035870296 conn(0x7fc83c067640 msgr2=0x7fc83c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.309+0000 7fc843dea700 1 -- 172.21.15.6:0/2035870296 shutdown_connections 2023-10-09T11:38:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.309+0000 7fc843dea700 1 -- 172.21.15.6:0/2035870296 wait complete. 2023-10-09T11:38:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 Processor -- start 2023-10-09T11:38:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 -- start start 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c16d330 0x7fc83c16a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c16d700 0x7fc83c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15cee0 con 0x7fc83c16b710 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c16ab90 con 0x7fc83c16d700 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.310+0000 7fc843dea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c16ae70 con 0x7fc83c16d330 2023-10-09T11:38:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42774/0 (socket says 172.21.15.6:42774) 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 -- 172.21.15.6:0/2434190930 learned_addr learned my addr 172.21.15.6:0/2434190930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc841b86700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c16d330 0x7fc83c16a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc841385700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c16d700 0x7fc83c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 -- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c16d330 msgr2=0x7fc83c16a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c16d330 0x7fc83c16a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 -- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c16d700 msgr2=0x7fc83c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c16d700 0x7fc83c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 -- 172.21.15.6:0/2434190930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c16b150 con 0x7fc83c16b710 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc842387700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00afd0 tx=0x7fc82c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00eee0 con 0x7fc83c16b710 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c01d630 con 0x7fc83c16b710 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c01d9f0 con 0x7fc83c16b710 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.311+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c16b430 con 0x7fc83c16b710 2023-10-09T11:38:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.312+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0b43f0 con 0x7fc83c16b710 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.312+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c15d090 con 0x7fc83c16b710 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.313+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc82c003040 con 0x7fc83c16b710 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.313+0000 7fc839ffb700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.313+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc82c085810 con 0x7fc83c16b710 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.313+0000 7fc841b86700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.314+0000 7fc841b86700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc8340015a0 tx=0x7fc834001e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.318+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc83c15d090 con 0x7fc83c16b710 2023-10-09T11:38:11.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:11.555+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc83c15d020 con 0x7fc83c16b710 2023-10-09T11:38:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.159+0000 7fc839ffb700 1 -- 172.21.15.6:0/2434190930 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc82c052b40 con 0x7fc83c16b710 2023-10-09T11:38:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 msgr2=0x7fc8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 0x7fc8280693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc8340015a0 tx=0x7fc834001e90 comp rx=0 tx=0).stop 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 msgr2=0x7fc83c156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00afd0 tx=0x7fc82c01a000 comp rx=0 tx=0).stop 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 shutdown_connections 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc828066f30 0x7fc8280693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc83c16b710 0x7fc83c156f00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc83c16d330 0x7fc83c16a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 --2- 172.21.15.6:0/2434190930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c16d700 0x7fc83c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 >> 172.21.15.6:0/2434190930 conn(0x7fc83c067640 msgr2=0x7fc83c0cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 shutdown_connections 2023-10-09T11:38:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.161+0000 7fc843dea700 1 -- 172.21.15.6:0/2434190930 wait complete. 2023-10-09T11:38:12.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:38:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.298+0000 7fbd694c2700 1 Processor -- start 2023-10-09T11:38:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.298+0000 7fbd694c2700 1 -- start start 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd694c2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd64159f10 0x7fbd64068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd694c2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd64069120 con 0x7fbd64159b40 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd694c2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640cee10 con 0x7fbd64068cc0 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd694c2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd640cd040 con 0x7fbd64159f10 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd63fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbd64159b40 0x7fbd640cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60212/0 (socket says 172.21.15.6:60212) 2023-10-09T11:38:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd63fff700 1 -- 172.21.15.6:0/1639908561 learned_addr learned my addr 172.21.15.6:0/1639908561 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd637fe700 1 --2- 172.21.15.6:0/1639908561 >> v2:172.21.15.118:3300/0 conn(0x7fbd64159f10 0x7fbd64068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920089768 0 0) 0x7fbd54001110 con 0x7fbd64159b40 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd50003570 con 0x7fbd64159b40 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.299+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298912078 0 0) 0x7fbd50003570 con 0x7fbd64159b40 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 >> v2:172.21.15.118:3300/0 conn(0x7fbd64159f10 msgr2=0x7fbd64068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 --2- 172.21.15.6:0/1639908561 >> v2:172.21.15.118:3300/0 conn(0x7fbd64159f10 0x7fbd64068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 >> v1:172.21.15.118:6789/0 conn(0x7fbd64068cc0 legacy=0x7fbd640cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640cd320 con 0x7fbd64159b40 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fbd54001600 con 0x7fbd64159b40 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 >> v1:172.21.15.6:6789/0 conn(0x7fbd64159b40 legacy=0x7fbd640cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd50003a60 0x7fbd50003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd50004810 0x7fbd50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640cd040 con 0x7fbd500051c0 2023-10-09T11:38:12.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5000c0b0 con 0x7fbd50003a60 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5000c270 con 0x7fbd50004810 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd63fff700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd50003a60 0x7fbd50003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd637fe700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd50004810 0x7fbd50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 -- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd50004810 msgr2=0x7fbd50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd50004810 0x7fbd50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 -- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd50003a60 msgr2=0x7fbd50003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd50003a60 0x7fbd50003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 -- 172.21.15.6:0/1639908561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50003570 con 0x7fbd500051c0 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd637fe700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd50004810 0x7fbd50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 -- 172.21.15.6:0/1639908561 reap_dead start 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd68cc1700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd5000ba60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0020a0 tx=0x7fbd5c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d46f1e3044add5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0019e0 con 0x7fbd500051c0 2023-10-09T11:38:12.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00c8b0 con 0x7fbd500051c0 2023-10-09T11:38:12.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.300+0000 7fbd62ffd700 1 -- 172.21.15.6:0/1639908561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00cc50 con 0x7fbd500051c0 2023-10-09T11:38:12.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 -- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 msgr2=0x7fbd5000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd5000ba60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0020a0 tx=0x7fbd5c0016d0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 -- 172.21.15.6:0/1639908561 shutdown_connections 2023-10-09T11:38:12.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 --2- 172.21.15.6:0/1639908561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd5000ba60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 -- 172.21.15.6:0/1639908561 >> 172.21.15.6:0/1639908561 conn(0x7fbd640cd660 msgr2=0x7fbd640cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:12.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 -- 172.21.15.6:0/1639908561 shutdown_connections 2023-10-09T11:38:12.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.301+0000 7fbd694c2700 1 -- 172.21.15.6:0/1639908561 wait complete. 2023-10-09T11:38:12.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.302+0000 7fbd694c2700 1 Processor -- start 2023-10-09T11:38:12.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.302+0000 7fbd694c2700 1 -- start start 2023-10-09T11:38:12.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd640c8d20 0x7fbd6415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd6415d330 0x7fbd6415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640c9ea0 con 0x7fbd500051c0 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640c9290 con 0x7fbd6415d330 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd694c2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640c9570 con 0x7fbd640c8d20 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42788/0 (socket says 172.21.15.6:42788) 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 -- 172.21.15.6:0/697638888 learned_addr learned my addr 172.21.15.6:0/697638888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd637fe700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd640c8d20 0x7fbd6415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd68cc1700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd6415d330 0x7fbd6415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 -- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd640c8d20 msgr2=0x7fbd6415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd640c8d20 0x7fbd6415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 -- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd6415d330 msgr2=0x7fbd6415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd6415d330 0x7fbd6415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 -- 172.21.15.6:0/697638888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640c9850 con 0x7fbd500051c0 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.303+0000 7fbd63fff700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007ae0 tx=0x7fbd540079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.304+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54018030 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.304+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54004e00 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.304+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400fac0 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.304+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd640c9b30 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.304+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd64158df0 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.305+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd640cb890 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.305+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd5401b070 con 0x7fbd500051c0 2023-10-09T11:38:12.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.306+0000 7fbd5bfff700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 0x7fbd440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.306+0000 7fbd637fe700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 0x7fbd440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.306+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd54019070 con 0x7fbd500051c0 2023-10-09T11:38:12.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.306+0000 7fbd637fe700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 0x7fbd440693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c006c80 tx=0x7fbd4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.310+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd54054ec0 con 0x7fbd500051c0 2023-10-09T11:38:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.544+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd64069120 con 0x7fbd500051c0 2023-10-09T11:38:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.545+0000 7fbd5bfff700 1 -- 172.21.15.6:0/697638888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fbd64069120 con 0x7fbd500051c0 2023-10-09T11:38:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:12.547 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 msgr2=0x7fbd440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 0x7fbd440693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c006c80 tx=0x7fbd4c008040 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 msgr2=0x7fbd640ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007ae0 tx=0x7fbd540079d0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 shutdown_connections 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd44066f30 0x7fbd440693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd6415d330 0x7fbd6415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd500051c0 0x7fbd640ca330 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 --2- 172.21.15.6:0/697638888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd640c8d20 0x7fbd6415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 >> 172.21.15.6:0/697638888 conn(0x7fbd640cd660 msgr2=0x7fbd640cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 shutdown_connections 2023-10-09T11:38:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.547+0000 7fbd694c2700 1 -- 172.21.15.6:0/697638888 wait complete. 2023-10-09T11:38:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:38:12.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:38:12.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.677+0000 7f4ca71eb700 1 Processor -- start 2023-10-09T11:38:12.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.677+0000 7f4ca71eb700 1 -- start start 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.678+0000 7f4ca71eb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ca0157ca0 0x7f4ca00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.678+0000 7f4ca71eb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.678+0000 7f4ca71eb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00d07c0 con 0x7f4ca01578d0 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.678+0000 7f4ca71eb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca006daa0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.678+0000 7f4ca71eb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00cfbb0 con 0x7f4ca006d120 2023-10-09T11:38:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ca0157ca0 0x7f4ca00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4ca5788700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4ca4f87700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4ca01578d0 0x7f4ca015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:39378/0 (socket says 172.21.15.6:39378) 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4ca4f87700 1 -- 172.21.15.6:0/2606530100 learned_addr learned my addr 172.21.15.6:0/2606530100 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 -- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 msgr2=0x7f4ca006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 --2- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 -- 172.21.15.6:0/2606530100 >> v1:172.21.15.118:6789/0 conn(0x7f4ca01578d0 legacy=0x7f4ca015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9f7fe700 1 -- 172.21.15.6:0/2606530100 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219715274 0 0) 0x7f4ca00d07c0 con 0x7f4ca01578d0 2023-10-09T11:38:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 -- 172.21.15.6:0/2606530100 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00cfe90 con 0x7f4ca0157ca0 2023-10-09T11:38:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9ffff700 1 --2- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00cf4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098e0 tx=0x7f4c900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc3e0e096b5fa7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9f7fe700 1 -- 172.21.15.6:0/2606530100 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000b640 con 0x7f4ca0157ca0 2023-10-09T11:38:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9f7fe700 1 -- 172.21.15.6:0/2606530100 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000b7a0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.679+0000 7f4c9f7fe700 1 -- 172.21.15.6:0/2606530100 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000bb40 con 0x7f4ca0157ca0 2023-10-09T11:38:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 -- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca0157ca0 msgr2=0x7f4ca00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00cf4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c900098e0 tx=0x7f4c900091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 -- 172.21.15.6:0/2606530100 shutdown_connections 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/2606530100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00cf4f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 -- 172.21.15.6:0/2606530100 >> 172.21.15.6:0/2606530100 conn(0x7f4ca006bb90 msgr2=0x7f4ca006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 -- 172.21.15.6:0/2606530100 shutdown_connections 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.680+0000 7f4ca71eb700 1 -- 172.21.15.6:0/2606530100 wait complete. 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.681+0000 7f4ca71eb700 1 Processor -- start 2023-10-09T11:38:12.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.681+0000 7f4ca71eb700 1 -- start start 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca01578d0 0x7f4ca016daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca016eac0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00aada0 con 0x7f4ca01578d0 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca71eb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca016e500 con 0x7f4ca006d120 2023-10-09T11:38:12.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca5788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca5788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42798/0 (socket says 172.21.15.6:42798) 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca5788700 1 -- 172.21.15.6:0/3623819267 learned_addr learned my addr 172.21.15.6:0/3623819267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4ca4f87700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.682+0000 7f4c9ffff700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca01578d0 0x7f4ca016daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 -- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 msgr2=0x7f4ca0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca0153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 -- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca01578d0 msgr2=0x7f4ca016daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca01578d0 0x7f4ca016daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 -- 172.21.15.6:0/3623819267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90009420 con 0x7f4ca0157ca0 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca5788700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009ec0 tx=0x7f4c9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800cb70 con 0x7f4ca0157ca0 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800f040 con 0x7f4ca0157ca0 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca016e7e0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98014480 con 0x7f4ca0157ca0 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.683+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca01540d0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.684+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca00aa890 con 0x7f4ca0157ca0 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.684+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c98014830 con 0x7f4ca0157ca0 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.685+0000 7f4c9cff9700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.685+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c98084dd0 con 0x7f4ca0157ca0 2023-10-09T11:38:12.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.685+0000 7f4ca4f87700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.685+0000 7f4ca4f87700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 0x7f4c800693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c88007fd0 tx=0x7f4c88007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:12.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.689+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ca00aa890 con 0x7f4ca0157ca0 2023-10-09T11:38:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.882+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca00aa890 con 0x7f4ca0157ca0 2023-10-09T11:38:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.883+0000 7f4c9cff9700 1 -- 172.21.15.6:0/3623819267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4ca00aa890 con 0x7f4ca0157ca0 2023-10-09T11:38:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:12.885 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:38:10.127842+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 msgr2=0x7f4c800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 0x7f4c800693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c88007fd0 tx=0x7f4c88007d30 comp rx=0 tx=0).stop 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 msgr2=0x7f4ca00b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009ec0 tx=0x7f4c9800b040 comp rx=0 tx=0).stop 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 shutdown_connections 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c80066f30 0x7f4c800693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca0157ca0 0x7f4ca00b2340 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca006d120 0x7f4ca0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 --2- 172.21.15.6:0/3623819267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca01578d0 0x7f4ca016daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 >> 172.21.15.6:0/3623819267 conn(0x7f4ca006bb90 msgr2=0x7f4ca015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 shutdown_connections 2023-10-09T11:38:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:12.885+0000 7f4ca71eb700 1 -- 172.21.15.6:0/3623819267 wait complete. 2023-10-09T11:38:12.899 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:38:12.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:38:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.017+0000 7f9b8f2f0700 1 Processor -- start 2023-10-09T11:38:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.017+0000 7f9b8f2f0700 1 -- start start 2023-10-09T11:38:13.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 0x7f9b880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b88157ca0 0x7f9b8815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 0x7f9b8806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880d07c0 con 0x7f9b88157ca0 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8806daa0 con 0x7f9b881578d0 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8f2f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880cfbb0 con 0x7f9b8806d120 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b88157ca0 0x7f9b8815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b88157ca0 0x7f9b8815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42800/0 (socket says 172.21.15.6:42800) 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 -- 172.21.15.6:0/1898664769 learned_addr learned my addr 172.21.15.6:0/1898664769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8d08c700 1 --2- 172.21.15.6:0/1898664769 >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 0x7f9b880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8d88d700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 0x7f9b8806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 -- 172.21.15.6:0/1898664769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 msgr2=0x7f9b8806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 0x7f9b8806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 -- 172.21.15.6:0/1898664769 >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 msgr2=0x7f9b880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 --2- 172.21.15.6:0/1898664769 >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 0x7f9b880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 -- 172.21.15.6:0/1898664769 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880cfe90 con 0x7f9b88157ca0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8d08c700 1 --2- 172.21.15.6:0/1898664769 >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 0x7f9b880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8d88d700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 0x7f9b8806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b8c88b700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b8815af00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9b880646b0 tx=0x7f9b7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecec856984a7d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b87fff700 1 -- 172.21.15.6:0/1898664769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00b860 con 0x7f9b88157ca0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.018+0000 7f9b87fff700 1 -- 172.21.15.6:0/1898664769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00b9c0 con 0x7f9b88157ca0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b87fff700 1 -- 172.21.15.6:0/1898664769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00bd60 con 0x7f9b88157ca0 2023-10-09T11:38:13.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/1898664769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 msgr2=0x7f9b8815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b8815af00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9b880646b0 tx=0x7f9b7c009250 comp rx=0 tx=0).stop 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/1898664769 shutdown_connections 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b8806d120 0x7f9b8806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/1898664769 >> v2:172.21.15.118:3300/0 conn(0x7f9b881578d0 0x7f9b880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/1898664769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b8815af00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/1898664769 >> 172.21.15.6:0/1898664769 conn(0x7f9b8806bb90 msgr2=0x7f9b8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/1898664769 shutdown_connections 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.019+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/1898664769 wait complete. 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.020+0000 7f9b8f2f0700 1 Processor -- start 2023-10-09T11:38:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.020+0000 7f9b8f2f0700 1 -- start start 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b8806d120 0x7f9b880ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b881578d0 0x7f9b88153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880abaf0 con 0x7f9b88157ca0 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880abdd0 con 0x7f9b8806d120 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8f2f0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ac0b0 con 0x7f9b881578d0 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8d88d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8d88d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42816/0 (socket says 172.21.15.6:42816) 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.021+0000 7f9b8d88d700 1 -- 172.21.15.6:0/608772368 learned_addr learned my addr 172.21.15.6:0/608772368 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8c88b700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b881578d0 0x7f9b88153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d08c700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b8806d120 0x7f9b880ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 -- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b881578d0 msgr2=0x7f9b88153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b881578d0 0x7f9b88153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 -- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b8806d120 msgr2=0x7f9b880ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b8806d120 0x7f9b880ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 -- 172.21.15.6:0/608772368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c0094f0 con 0x7f9b88157ca0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8d88d700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d180 tx=0x7f9b80009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000dcc0 con 0x7f9b88157ca0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000f040 con 0x7f9b88157ca0 2023-10-09T11:38:13.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880ac390 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80015690 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.022+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b880ab790 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.023+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88068fe0 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.024+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b8001e3b0 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.024+0000 7f9b857fa700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.024+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b80084930 con 0x7f9b88157ca0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.024+0000 7f9b8d08c700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.024+0000 7f9b8d08c700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 0x7f9b740693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006fd0 tx=0x7f9b78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.028+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b80051ba0 con 0x7f9b88157ca0 2023-10-09T11:38:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.221+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b880d0170 con 0x7f9b74066f30 2023-10-09T11:38:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.229+0000 7f9b857fa700 1 -- 172.21.15.6:0/608772368 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281787 (secure 0 0 0) 0x7f9b880d0170 con 0x7f9b74066f30 2023-10-09T11:38:13.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 msgr2=0x7f9b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 0x7f9b740693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b78006fd0 tx=0x7f9b78008040 comp rx=0 tx=0).stop 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 msgr2=0x7f9b88069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000d180 tx=0x7f9b80009a50 comp rx=0 tx=0).stop 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 shutdown_connections 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b88157ca0 0x7f9b88069a50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b8806d120 0x7f9b880ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 --2- 172.21.15.6:0/608772368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b881578d0 0x7f9b88153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 >> 172.21.15.6:0/608772368 conn(0x7f9b8806bb90 msgr2=0x7f9b880688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 shutdown_connections 2023-10-09T11:38:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.232+0000 7f9b8f2f0700 1 -- 172.21.15.6:0/608772368 wait complete. 2023-10-09T11:38:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:38:13.245 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-09T11:38:12.171584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559033,"statfs":{"total":1600000000,"available":1596450699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.059751"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122392+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:27.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127512+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:54.659045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122886+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118398+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122569+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:20.770994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124447+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117070+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:39.206922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125685+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117357+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:46.305342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118495+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118175+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117005+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119404+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:51.402654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116916+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:54.069635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116787+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124060+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127095+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121493+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123344+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:16.188788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124520+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120861+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.126687+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121880+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120717+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122180+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:41.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118558+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124082+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122013+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:28.873334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127525+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:13.293026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119177+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121990+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:10.252708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122911+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122701+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121558+0000","last_change":"2023-10-09T11:38:08.121558+0000","last_active":"2023-10-09T11:38:08.121558+0000","last_peered":"2023-10-09T11:38:08.121558+0000","last_clean":"2023-10-09T11:38:08.121558+0000","last_became_active":"2023-10-09T11:38:08.121326+0000","last_became_peered":"2023-10-09T11:38:08.121326+0000","last_unstale":"2023-10-09T11:38:08.121558+0000","last_undegraded":"2023-10-09T11:38:08.121558+0000","last_fullsized":"2023-10-09T11:38:08.121558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:13.687452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119276+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:43.371472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123551+0000","last_change":"2023-10-09T11:38:08.123551+0000","last_active":"2023-10-09T11:38:08.123551+0000","last_peered":"2023-10-09T11:38:08.123551+0000","last_clean":"2023-10-09T11:38:08.123551+0000","last_became_active":"2023-10-09T11:38:08.123280+0000","last_became_peered":"2023-10-09T11:38:08.123280+0000","last_unstale":"2023-10-09T11:38:08.123551+0000","last_undegraded":"2023-10-09T11:38:08.123551+0000","last_fullsized":"2023-10-09T11:38:08.123551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:16.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122638+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120970+0000","last_change":"2023-10-09T11:38:08.120970+0000","last_active":"2023-10-09T11:38:08.120970+0000","last_peered":"2023-10-09T11:38:08.120970+0000","last_clean":"2023-10-09T11:38:08.120970+0000","last_became_active":"2023-10-09T11:38:08.120732+0000","last_became_peered":"2023-10-09T11:38:08.120732+0000","last_unstale":"2023-10-09T11:38:08.120970+0000","last_undegraded":"2023-10-09T11:38:08.120970+0000","last_fullsized":"2023-10-09T11:38:08.120970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:48.609903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123477+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126143+0000","last_change":"2023-10-09T11:38:08.126143+0000","last_active":"2023-10-09T11:38:08.126143+0000","last_peered":"2023-10-09T11:38:08.126143+0000","last_clean":"2023-10-09T11:38:08.126143+0000","last_became_active":"2023-10-09T11:38:08.125591+0000","last_became_peered":"2023-10-09T11:38:08.125591+0000","last_unstale":"2023-10-09T11:38:08.126143+0000","last_undegraded":"2023-10-09T11:38:08.126143+0000","last_fullsized":"2023-10-09T11:38:08.126143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124758+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120519+0000","last_change":"2023-10-09T11:38:08.120519+0000","last_active":"2023-10-09T11:38:08.120519+0000","last_peered":"2023-10-09T11:38:08.120519+0000","last_clean":"2023-10-09T11:38:08.120519+0000","last_became_active":"2023-10-09T11:38:08.119222+0000","last_became_peered":"2023-10-09T11:38:08.119222+0000","last_unstale":"2023-10-09T11:38:08.120519+0000","last_undegraded":"2023-10-09T11:38:08.120519+0000","last_fullsized":"2023-10-09T11:38:08.120519+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:42.367733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125542+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130013+0000","last_change":"2023-10-09T11:38:08.130013+0000","last_active":"2023-10-09T11:38:08.130013+0000","last_peered":"2023-10-09T11:38:08.130013+0000","last_clean":"2023-10-09T11:38:08.130013+0000","last_became_active":"2023-10-09T11:38:08.127795+0000","last_became_peered":"2023-10-09T11:38:08.127795+0000","last_unstale":"2023-10-09T11:38:08.130013+0000","last_undegraded":"2023-10-09T11:38:08.130013+0000","last_fullsized":"2023-10-09T11:38:08.130013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:38.203183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119600+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.350773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124333+0000","last_change":"2023-10-09T11:38:08.124333+0000","last_active":"2023-10-09T11:38:08.124333+0000","last_peered":"2023-10-09T11:38:08.124333+0000","last_clean":"2023-10-09T11:38:08.124333+0000","last_became_active":"2023-10-09T11:38:08.123845+0000","last_became_peered":"2023-10-09T11:38:08.123845+0000","last_unstale":"2023-10-09T11:38:08.124333+0000","last_undegraded":"2023-10-09T11:38:08.124333+0000","last_fullsized":"2023-10-09T11:38:08.124333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:06.635221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127101+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:20.750507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120586+0000","last_change":"2023-10-09T11:38:08.120586+0000","last_active":"2023-10-09T11:38:08.120586+0000","last_peered":"2023-10-09T11:38:08.120586+0000","last_clean":"2023-10-09T11:38:08.120586+0000","last_became_active":"2023-10-09T11:38:08.118863+0000","last_became_peered":"2023-10-09T11:38:08.118863+0000","last_unstale":"2023-10-09T11:38:08.120586+0000","last_undegraded":"2023-10-09T11:38:08.120586+0000","last_fullsized":"2023-10-09T11:38:08.120586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:26.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116649+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128371+0000","last_change":"2023-10-09T11:38:08.128371+0000","last_active":"2023-10-09T11:38:08.128371+0000","last_peered":"2023-10-09T11:38:08.128371+0000","last_clean":"2023-10-09T11:38:08.128371+0000","last_became_active":"2023-10-09T11:38:08.128200+0000","last_became_peered":"2023-10-09T11:38:08.128200+0000","last_unstale":"2023-10-09T11:38:08.128371+0000","last_undegraded":"2023-10-09T11:38:08.128371+0000","last_fullsized":"2023-10-09T11:38:08.128371+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:03.112765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120502+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.119440+0000","last_change":"2023-10-09T11:38:08.119440+0000","last_active":"2023-10-09T11:38:08.119440+0000","last_peered":"2023-10-09T11:38:08.119440+0000","last_clean":"2023-10-09T11:38:08.119440+0000","last_became_active":"2023-10-09T11:38:08.118785+0000","last_became_peered":"2023-10-09T11:38:08.118785+0000","last_unstale":"2023-10-09T11:38:08.119440+0000","last_undegraded":"2023-10-09T11:38:08.119440+0000","last_fullsized":"2023-10-09T11:38:08.119440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:19.999091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118900+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:08.408586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125842+0000","last_change":"2023-10-09T11:38:08.125842+0000","last_active":"2023-10-09T11:38:08.125842+0000","last_peered":"2023-10-09T11:38:08.125842+0000","last_clean":"2023-10-09T11:38:08.125842+0000","last_became_active":"2023-10-09T11:38:08.125625+0000","last_became_peered":"2023-10-09T11:38:08.125625+0000","last_unstale":"2023-10-09T11:38:08.125842+0000","last_undegraded":"2023-10-09T11:38:08.125842+0000","last_fullsized":"2023-10-09T11:38:08.125842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:14.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122266+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122307+0000","last_change":"2023-10-09T11:38:08.122307+0000","last_active":"2023-10-09T11:38:08.122307+0000","last_peered":"2023-10-09T11:38:08.122307+0000","last_clean":"2023-10-09T11:38:08.122307+0000","last_became_active":"2023-10-09T11:38:08.121878+0000","last_became_peered":"2023-10-09T11:38:08.121878+0000","last_unstale":"2023-10-09T11:38:08.122307+0000","last_undegraded":"2023-10-09T11:38:08.122307+0000","last_fullsized":"2023-10-09T11:38:08.122307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:38.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121642+0000","last_change":"2023-10-09T11:38:08.121642+0000","last_active":"2023-10-09T11:38:08.121642+0000","last_peered":"2023-10-09T11:38:08.121642+0000","last_clean":"2023-10-09T11:38:08.121642+0000","last_became_active":"2023-10-09T11:38:08.121191+0000","last_became_peered":"2023-10-09T11:38:08.121191+0000","last_unstale":"2023-10-09T11:38:08.121642+0000","last_undegraded":"2023-10-09T11:38:08.121642+0000","last_fullsized":"2023-10-09T11:38:08.121642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118792+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124204+0000","last_change":"2023-10-09T11:38:08.124204+0000","last_active":"2023-10-09T11:38:08.124204+0000","last_peered":"2023-10-09T11:38:08.124204+0000","last_clean":"2023-10-09T11:38:08.124204+0000","last_became_active":"2023-10-09T11:38:08.123982+0000","last_became_peered":"2023-10-09T11:38:08.123982+0000","last_unstale":"2023-10-09T11:38:08.124204+0000","last_undegraded":"2023-10-09T11:38:08.124204+0000","last_fullsized":"2023-10-09T11:38:08.124204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.429221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116497+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122905+0000","last_change":"2023-10-09T11:38:08.122905+0000","last_active":"2023-10-09T11:38:08.122905+0000","last_peered":"2023-10-09T11:38:08.122905+0000","last_clean":"2023-10-09T11:38:08.122905+0000","last_became_active":"2023-10-09T11:38:08.122688+0000","last_became_peered":"2023-10-09T11:38:08.122688+0000","last_unstale":"2023-10-09T11:38:08.122905+0000","last_undegraded":"2023-10-09T11:38:08.122905+0000","last_fullsized":"2023-10-09T11:38:08.122905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:26.466209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120854+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126492+0000","last_change":"2023-10-09T11:38:08.126492+0000","last_active":"2023-10-09T11:38:08.126492+0000","last_peered":"2023-10-09T11:38:08.126492+0000","last_clean":"2023-10-09T11:38:08.126492+0000","last_became_active":"2023-10-09T11:38:08.126269+0000","last_became_peered":"2023-10-09T11:38:08.126269+0000","last_unstale":"2023-10-09T11:38:08.126492+0000","last_undegraded":"2023-10-09T11:38:08.126492+0000","last_fullsized":"2023-10-09T11:38:08.126492+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:33.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118390+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121124+0000","last_change":"2023-10-09T11:38:08.121124+0000","last_active":"2023-10-09T11:38:08.121124+0000","last_peered":"2023-10-09T11:38:08.121124+0000","last_clean":"2023-10-09T11:38:08.121124+0000","last_became_active":"2023-10-09T11:38:08.120736+0000","last_became_peered":"2023-10-09T11:38:08.120736+0000","last_unstale":"2023-10-09T11:38:08.121124+0000","last_undegraded":"2023-10-09T11:38:08.121124+0000","last_fullsized":"2023-10-09T11:38:08.121124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:21.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117991+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.127739+0000","last_change":"2023-10-09T11:38:08.127739+0000","last_active":"2023-10-09T11:38:08.127739+0000","last_peered":"2023-10-09T11:38:08.127739+0000","last_clean":"2023-10-09T11:38:08.127739+0000","last_became_active":"2023-10-09T11:38:08.125352+0000","last_became_peered":"2023-10-09T11:38:08.125352+0000","last_unstale":"2023-10-09T11:38:08.127739+0000","last_undegraded":"2023-10-09T11:38:08.127739+0000","last_fullsized":"2023-10-09T11:38:08.127739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:46.571090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126009+0000","last_change":"2023-10-09T11:38:08.126009+0000","last_active":"2023-10-09T11:38:08.126009+0000","last_peered":"2023-10-09T11:38:08.126009+0000","last_clean":"2023-10-09T11:38:08.126009+0000","last_became_active":"2023-10-09T11:38:08.125269+0000","last_became_peered":"2023-10-09T11:38:08.125269+0000","last_unstale":"2023-10-09T11:38:08.126009+0000","last_undegraded":"2023-10-09T11:38:08.126009+0000","last_fullsized":"2023-10-09T11:38:08.126009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:38.552189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120120+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128582+0000","last_change":"2023-10-09T11:38:08.128582+0000","last_active":"2023-10-09T11:38:08.128582+0000","last_peered":"2023-10-09T11:38:08.128582+0000","last_clean":"2023-10-09T11:38:08.128582+0000","last_became_active":"2023-10-09T11:38:08.128317+0000","last_became_peered":"2023-10-09T11:38:08.128317+0000","last_unstale":"2023-10-09T11:38:08.128582+0000","last_undegraded":"2023-10-09T11:38:08.128582+0000","last_fullsized":"2023-10-09T11:38:08.128582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:45.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117550+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.118845+0000","last_change":"2023-10-09T11:38:08.118845+0000","last_active":"2023-10-09T11:38:08.118845+0000","last_peered":"2023-10-09T11:38:08.118845+0000","last_clean":"2023-10-09T11:38:08.118845+0000","last_became_active":"2023-10-09T11:38:08.118600+0000","last_became_peered":"2023-10-09T11:38:08.118600+0000","last_unstale":"2023-10-09T11:38:08.118845+0000","last_undegraded":"2023-10-09T11:38:08.118845+0000","last_fullsized":"2023-10-09T11:38:08.118845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123324+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124894+0000","last_change":"2023-10-09T11:38:08.124894+0000","last_active":"2023-10-09T11:38:08.124894+0000","last_peered":"2023-10-09T11:38:08.124894+0000","last_clean":"2023-10-09T11:38:08.124894+0000","last_became_active":"2023-10-09T11:38:08.124696+0000","last_became_peered":"2023-10-09T11:38:08.124696+0000","last_unstale":"2023-10-09T11:38:08.124894+0000","last_undegraded":"2023-10-09T11:38:08.124894+0000","last_fullsized":"2023-10-09T11:38:08.124894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:44.457144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123111+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125827+0000","last_change":"2023-10-09T11:38:08.125827+0000","last_active":"2023-10-09T11:38:08.125827+0000","last_peered":"2023-10-09T11:38:08.125827+0000","last_clean":"2023-10-09T11:38:08.125827+0000","last_became_active":"2023-10-09T11:38:08.124960+0000","last_became_peered":"2023-10-09T11:38:08.124960+0000","last_unstale":"2023-10-09T11:38:08.125827+0000","last_undegraded":"2023-10-09T11:38:08.125827+0000","last_fullsized":"2023-10-09T11:38:08.125827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.709978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121768+0000","last_change":"2023-10-09T11:38:08.121768+0000","last_active":"2023-10-09T11:38:08.121768+0000","last_peered":"2023-10-09T11:38:08.121768+0000","last_clean":"2023-10-09T11:38:08.121768+0000","last_became_active":"2023-10-09T11:38:08.121548+0000","last_became_peered":"2023-10-09T11:38:08.121548+0000","last_unstale":"2023-10-09T11:38:08.121768+0000","last_undegraded":"2023-10-09T11:38:08.121768+0000","last_fullsized":"2023-10-09T11:38:08.121768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:47.627153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130156+0000","last_change":"2023-10-09T11:38:08.130156+0000","last_active":"2023-10-09T11:38:08.130156+0000","last_peered":"2023-10-09T11:38:08.130156+0000","last_clean":"2023-10-09T11:38:08.130156+0000","last_became_active":"2023-10-09T11:38:08.129294+0000","last_became_peered":"2023-10-09T11:38:08.129294+0000","last_unstale":"2023-10-09T11:38:08.130156+0000","last_undegraded":"2023-10-09T11:38:08.130156+0000","last_fullsized":"2023-10-09T11:38:08.130156+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:53.065896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118021+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125926+0000","last_change":"2023-10-09T11:38:08.125926+0000","last_active":"2023-10-09T11:38:08.125926+0000","last_peered":"2023-10-09T11:38:08.125926+0000","last_clean":"2023-10-09T11:38:08.125926+0000","last_became_active":"2023-10-09T11:38:08.125450+0000","last_became_peered":"2023-10-09T11:38:08.125450+0000","last_unstale":"2023-10-09T11:38:08.125926+0000","last_undegraded":"2023-10-09T11:38:08.125926+0000","last_fullsized":"2023-10-09T11:38:08.125926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:15.240866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122281+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124884+0000","last_change":"2023-10-09T11:38:08.124884+0000","last_active":"2023-10-09T11:38:08.124884+0000","last_peered":"2023-10-09T11:38:08.124884+0000","last_clean":"2023-10-09T11:38:08.124884+0000","last_became_active":"2023-10-09T11:38:08.124634+0000","last_became_peered":"2023-10-09T11:38:08.124634+0000","last_unstale":"2023-10-09T11:38:08.124884+0000","last_undegraded":"2023-10-09T11:38:08.124884+0000","last_fullsized":"2023-10-09T11:38:08.124884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124789+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121275+0000","last_change":"2023-10-09T11:38:08.121275+0000","last_active":"2023-10-09T11:38:08.121275+0000","last_peered":"2023-10-09T11:38:08.121275+0000","last_clean":"2023-10-09T11:38:08.121275+0000","last_became_active":"2023-10-09T11:38:08.121054+0000","last_became_peered":"2023-10-09T11:38:08.121054+0000","last_unstale":"2023-10-09T11:38:08.121275+0000","last_undegraded":"2023-10-09T11:38:08.121275+0000","last_fullsized":"2023-10-09T11:38:08.121275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.398915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119748+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121672+0000","last_change":"2023-10-09T11:38:08.121672+0000","last_active":"2023-10-09T11:38:08.121672+0000","last_peered":"2023-10-09T11:38:08.121672+0000","last_clean":"2023-10-09T11:38:08.121672+0000","last_became_active":"2023-10-09T11:38:08.121445+0000","last_became_peered":"2023-10-09T11:38:08.121445+0000","last_unstale":"2023-10-09T11:38:08.121672+0000","last_undegraded":"2023-10-09T11:38:08.121672+0000","last_fullsized":"2023-10-09T11:38:08.121672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:05.590480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118527+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122691+0000","last_change":"2023-10-09T11:38:08.122691+0000","last_active":"2023-10-09T11:38:08.122691+0000","last_peered":"2023-10-09T11:38:08.122691+0000","last_clean":"2023-10-09T11:38:08.122691+0000","last_became_active":"2023-10-09T11:38:08.122469+0000","last_became_peered":"2023-10-09T11:38:08.122469+0000","last_unstale":"2023-10-09T11:38:08.122691+0000","last_undegraded":"2023-10-09T11:38:08.122691+0000","last_fullsized":"2023-10-09T11:38:08.122691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123118+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120979+0000","last_change":"2023-10-09T11:38:08.120979+0000","last_active":"2023-10-09T11:38:08.120979+0000","last_peered":"2023-10-09T11:38:08.120979+0000","last_clean":"2023-10-09T11:38:08.120979+0000","last_became_active":"2023-10-09T11:38:08.120404+0000","last_became_peered":"2023-10-09T11:38:08.120404+0000","last_unstale":"2023-10-09T11:38:08.120979+0000","last_undegraded":"2023-10-09T11:38:08.120979+0000","last_fullsized":"2023-10-09T11:38:08.120979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124360+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123342+0000","last_change":"2023-10-09T11:38:08.123342+0000","last_active":"2023-10-09T11:38:08.123342+0000","last_peered":"2023-10-09T11:38:08.123342+0000","last_clean":"2023-10-09T11:38:08.123342+0000","last_became_active":"2023-10-09T11:38:08.123106+0000","last_became_peered":"2023-10-09T11:38:08.123106+0000","last_unstale":"2023-10-09T11:38:08.123342+0000","last_undegraded":"2023-10-09T11:38:08.123342+0000","last_fullsized":"2023-10-09T11:38:08.123342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:38:07.115226+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:38:07.115226+0000","last_peered":"2023-10-09T11:38:07.115226+0000","last_clean":"2023-10-09T11:38:07.115226+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:38:07.115226+0000","last_undegraded":"2023-10-09T11:38:07.115226+0000","last_fullsized":"2023-10-09T11:38:07.115226+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.048,"15min":1.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76400000000000001,"5min":1.079,"15min":1.079},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.87},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73599999999999999,"5min":5.298,"15min":5.298},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77000000000000002,"5min":1.617,"15min":1.617},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":5.46,"15min":5.46},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.60099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39900000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51100000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.215},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.51700000000000002,"5min":2.004,"15min":2.004},"last":0.36799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.49099999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40500000000000003,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56299999999999994,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.61099999999999999,"5min":1.909,"15min":1.909},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.311}]},{"osd":4,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":1.869,"15min":1.869},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":1.952,"15min":1.952},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":1.782,"15min":1.782},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78100000000000003,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194447,"statfs":{"total":200000000,"available":199114446,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46999999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57599999999999996,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.309},{"interface":"front","average":{"1min":0.378,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54500000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.502,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64800000000000002,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":1.282,"15min":1.282},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.47399999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.71899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86699999999999999,"5min":3.976,"15min":3.976},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82099999999999995,"5min":1.524,"15min":1.524},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.254,"15min":1.254},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":1.22,"15min":1.22},"last":0.496},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.311,"15min":0.307},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.439},{"interface":"front","average":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54300000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45300000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.85399999999999998,"15min":0.93100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58399999999999996,"5min":11.055,"15min":11.055},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.379},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.626,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.44400000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47899999999999998,"5min":1.034,"15min":1.034},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":1.335,"15min":1.335},"last":0.5}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.26500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58399999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.311},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":1.405,"15min":1.405},"last":0.436}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.167,"15min":1.167},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73299999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.77400000000000002,"15min":0.81299999999999994},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.82599999999999996,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70399999999999996,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":5.274,"15min":5.274},"last":0.72099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.82799999999999996,"15min":0.87},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.84099999999999997,"15min":0.89000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71999999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.75600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83399999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.629,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58399999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.76200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.83799999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T11:38:13.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:38:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.402+0000 7f3de5c1c700 1 Processor -- start 2023-10-09T11:38:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3de5c1c700 1 -- start start 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3de5c1c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de01578d0 0x7f3de00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3de5c1c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00d07c0 con 0x7f3de006d120 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3de5c1c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00cfbb0 con 0x7f3de0157ca0 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3de5c1c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00cfe90 con 0x7f3de01578d0 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.403+0000 7f3ddf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de01578d0 0x7f3de00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3de006d120 0x7f3de006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60096/0 (socket says 172.21.15.6:60096) 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddffff700 1 -- 172.21.15.6:0/2373507691 learned_addr learned my addr 172.21.15.6:0/2373507691 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddf7fe700 1 -- 172.21.15.6:0/2373507691 >> v1:172.21.15.118:6789/0 conn(0x7f3de0157ca0 legacy=0x7f3de015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddf7fe700 1 -- 172.21.15.6:0/2373507691 >> v1:172.21.15.6:6789/0 conn(0x7f3de006d120 legacy=0x7f3de006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddf7fe700 1 -- 172.21.15.6:0/2373507691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00d0170 con 0x7f3de01578d0 2023-10-09T11:38:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3dde7fc700 1 -- 172.21.15.6:0/2373507691 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589500013 0 0) 0x7f3de00d07c0 con 0x7f3de006d120 2023-10-09T11:38:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3ddf7fe700 1 --2- 172.21.15.6:0/2373507691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de00cf4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00098e0 tx=0x7f3dd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef74de7e05c9b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3dde7fc700 1 -- 172.21.15.6:0/2373507691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0009e80 con 0x7f3de01578d0 2023-10-09T11:38:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3dde7fc700 1 -- 172.21.15.6:0/2373507691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000b860 con 0x7f3de01578d0 2023-10-09T11:38:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.404+0000 7f3dde7fc700 1 -- 172.21.15.6:0/2373507691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000bbe0 con 0x7f3de01578d0 2023-10-09T11:38:13.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2373507691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 msgr2=0x7f3de00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2373507691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de00cf4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00098e0 tx=0x7f3dd00091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2373507691 shutdown_connections 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2373507691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de00cf4f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2373507691 >> 172.21.15.6:0/2373507691 conn(0x7f3de006bb90 msgr2=0x7f3de006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2373507691 shutdown_connections 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.405+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2373507691 wait complete. 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.406+0000 7f3de5c1c700 1 Processor -- start 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.406+0000 7f3de5c1c700 1 -- start start 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de006d120 0x7f3de00cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3de0157ca0 0x7f3de0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00b5360 con 0x7f3de01578d0 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de016ea20 con 0x7f3de006d120 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3de5c1c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00cdc40 con 0x7f3de0157ca0 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37186/0 (socket says 172.21.15.6:37186) 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 -- 172.21.15.6:0/2794321007 learned_addr learned my addr 172.21.15.6:0/2794321007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddffff700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3de0157ca0 0x7f3de0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddf7fe700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de006d120 0x7f3de00cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 -- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3de0157ca0 msgr2=0x7f3de0152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3de0157ca0 0x7f3de0152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 -- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de006d120 msgr2=0x7f3de00cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de006d120 0x7f3de00cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 -- 172.21.15.6:0/2794321007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009420 con 0x7f3de01578d0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3ddeffd700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c590 tx=0x7f3dd4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.407+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011590 con 0x7f3de01578d0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.408+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4011710 con 0x7f3de01578d0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.408+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00b4d10 con 0x7f3de01578d0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.408+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011ad0 con 0x7f3de01578d0 2023-10-09T11:38:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.408+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0152fa0 con 0x7f3de01578d0 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.409+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de00b4b70 con 0x7f3de01578d0 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.409+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3dd401a360 con 0x7f3de01578d0 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.410+0000 7f3dc77fe700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.410+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3dd4083490 con 0x7f3de01578d0 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.410+0000 7f3ddf7fe700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.410+0000 7f3ddf7fe700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 0x7f3dcc0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00093f0 tx=0x7f3dd0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.414+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de00b4b70 con 0x7f3de01578d0 2023-10-09T11:38:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.607+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3de00b4b70 con 0x7f3dcc066f30 2023-10-09T11:38:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.615+0000 7f3dc77fe700 1 -- 172.21.15.6:0/2794321007 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281787 (secure 0 0 0) 0x7f3de00b4b70 con 0x7f3dcc066f30 2023-10-09T11:38:13.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 msgr2=0x7f3dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 0x7f3dcc0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00093f0 tx=0x7f3dd0017000 comp rx=0 tx=0).stop 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 msgr2=0x7f3de016e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c590 tx=0x7f3dd4007f50 comp rx=0 tx=0).stop 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 shutdown_connections 2023-10-09T11:38:13.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3de0157ca0 0x7f3de0152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de006d120 0x7f3de00cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 --2- 172.21.15.6:0/2794321007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de01578d0 0x7f3de016e4e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 >> 172.21.15.6:0/2794321007 conn(0x7f3de006bb90 msgr2=0x7f3de015a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 shutdown_connections 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.619+0000 7f3de5c1c700 1 -- 172.21.15.6:0/2794321007 wait complete. 2023-10-09T11:38:13.625 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:38:13.632 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-09T11:38:12.171584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559033,"statfs":{"total":1600000000,"available":1596450699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.059751"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122392+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:27.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127512+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:54.659045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122886+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118398+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122569+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:20.770994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124447+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117070+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:39.206922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125685+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117357+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:46.305342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118495+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118175+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117005+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119404+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:51.402654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116916+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:54.069635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116787+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124060+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127095+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121493+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123344+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:16.188788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124520+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120861+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.126687+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121880+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120717+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122180+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:41.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118558+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124082+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122013+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:28.873334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127525+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:13.293026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119177+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121990+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:10.252708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122911+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122701+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121558+0000","last_change":"2023-10-09T11:38:08.121558+0000","last_active":"2023-10-09T11:38:08.121558+0000","last_peered":"2023-10-09T11:38:08.121558+0000","last_clean":"2023-10-09T11:38:08.121558+0000","last_became_active":"2023-10-09T11:38:08.121326+0000","last_became_peered":"2023-10-09T11:38:08.121326+0000","last_unstale":"2023-10-09T11:38:08.121558+0000","last_undegraded":"2023-10-09T11:38:08.121558+0000","last_fullsized":"2023-10-09T11:38:08.121558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:13.687452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119276+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:43.371472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123551+0000","last_change":"2023-10-09T11:38:08.123551+0000","last_active":"2023-10-09T11:38:08.123551+0000","last_peered":"2023-10-09T11:38:08.123551+0000","last_clean":"2023-10-09T11:38:08.123551+0000","last_became_active":"2023-10-09T11:38:08.123280+0000","last_became_peered":"2023-10-09T11:38:08.123280+0000","last_unstale":"2023-10-09T11:38:08.123551+0000","last_undegraded":"2023-10-09T11:38:08.123551+0000","last_fullsized":"2023-10-09T11:38:08.123551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:16.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122638+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120970+0000","last_change":"2023-10-09T11:38:08.120970+0000","last_active":"2023-10-09T11:38:08.120970+0000","last_peered":"2023-10-09T11:38:08.120970+0000","last_clean":"2023-10-09T11:38:08.120970+0000","last_became_active":"2023-10-09T11:38:08.120732+0000","last_became_peered":"2023-10-09T11:38:08.120732+0000","last_unstale":"2023-10-09T11:38:08.120970+0000","last_undegraded":"2023-10-09T11:38:08.120970+0000","last_fullsized":"2023-10-09T11:38:08.120970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:48.609903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123477+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126143+0000","last_change":"2023-10-09T11:38:08.126143+0000","last_active":"2023-10-09T11:38:08.126143+0000","last_peered":"2023-10-09T11:38:08.126143+0000","last_clean":"2023-10-09T11:38:08.126143+0000","last_became_active":"2023-10-09T11:38:08.125591+0000","last_became_peered":"2023-10-09T11:38:08.125591+0000","last_unstale":"2023-10-09T11:38:08.126143+0000","last_undegraded":"2023-10-09T11:38:08.126143+0000","last_fullsized":"2023-10-09T11:38:08.126143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124758+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120519+0000","last_change":"2023-10-09T11:38:08.120519+0000","last_active":"2023-10-09T11:38:08.120519+0000","last_peered":"2023-10-09T11:38:08.120519+0000","last_clean":"2023-10-09T11:38:08.120519+0000","last_became_active":"2023-10-09T11:38:08.119222+0000","last_became_peered":"2023-10-09T11:38:08.119222+0000","last_unstale":"2023-10-09T11:38:08.120519+0000","last_undegraded":"2023-10-09T11:38:08.120519+0000","last_fullsized":"2023-10-09T11:38:08.120519+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:42.367733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125542+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130013+0000","last_change":"2023-10-09T11:38:08.130013+0000","last_active":"2023-10-09T11:38:08.130013+0000","last_peered":"2023-10-09T11:38:08.130013+0000","last_clean":"2023-10-09T11:38:08.130013+0000","last_became_active":"2023-10-09T11:38:08.127795+0000","last_became_peered":"2023-10-09T11:38:08.127795+0000","last_unstale":"2023-10-09T11:38:08.130013+0000","last_undegraded":"2023-10-09T11:38:08.130013+0000","last_fullsized":"2023-10-09T11:38:08.130013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:38.203183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119600+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.350773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124333+0000","last_change":"2023-10-09T11:38:08.124333+0000","last_active":"2023-10-09T11:38:08.124333+0000","last_peered":"2023-10-09T11:38:08.124333+0000","last_clean":"2023-10-09T11:38:08.124333+0000","last_became_active":"2023-10-09T11:38:08.123845+0000","last_became_peered":"2023-10-09T11:38:08.123845+0000","last_unstale":"2023-10-09T11:38:08.124333+0000","last_undegraded":"2023-10-09T11:38:08.124333+0000","last_fullsized":"2023-10-09T11:38:08.124333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:06.635221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127101+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:20.750507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120586+0000","last_change":"2023-10-09T11:38:08.120586+0000","last_active":"2023-10-09T11:38:08.120586+0000","last_peered":"2023-10-09T11:38:08.120586+0000","last_clean":"2023-10-09T11:38:08.120586+0000","last_became_active":"2023-10-09T11:38:08.118863+0000","last_became_peered":"2023-10-09T11:38:08.118863+0000","last_unstale":"2023-10-09T11:38:08.120586+0000","last_undegraded":"2023-10-09T11:38:08.120586+0000","last_fullsized":"2023-10-09T11:38:08.120586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:26.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116649+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128371+0000","last_change":"2023-10-09T11:38:08.128371+0000","last_active":"2023-10-09T11:38:08.128371+0000","last_peered":"2023-10-09T11:38:08.128371+0000","last_clean":"2023-10-09T11:38:08.128371+0000","last_became_active":"2023-10-09T11:38:08.128200+0000","last_became_peered":"2023-10-09T11:38:08.128200+0000","last_unstale":"2023-10-09T11:38:08.128371+0000","last_undegraded":"2023-10-09T11:38:08.128371+0000","last_fullsized":"2023-10-09T11:38:08.128371+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:03.112765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120502+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.119440+0000","last_change":"2023-10-09T11:38:08.119440+0000","last_active":"2023-10-09T11:38:08.119440+0000","last_peered":"2023-10-09T11:38:08.119440+0000","last_clean":"2023-10-09T11:38:08.119440+0000","last_became_active":"2023-10-09T11:38:08.118785+0000","last_became_peered":"2023-10-09T11:38:08.118785+0000","last_unstale":"2023-10-09T11:38:08.119440+0000","last_undegraded":"2023-10-09T11:38:08.119440+0000","last_fullsized":"2023-10-09T11:38:08.119440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:19.999091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118900+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:08.408586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125842+0000","last_change":"2023-10-09T11:38:08.125842+0000","last_active":"2023-10-09T11:38:08.125842+0000","last_peered":"2023-10-09T11:38:08.125842+0000","last_clean":"2023-10-09T11:38:08.125842+0000","last_became_active":"2023-10-09T11:38:08.125625+0000","last_became_peered":"2023-10-09T11:38:08.125625+0000","last_unstale":"2023-10-09T11:38:08.125842+0000","last_undegraded":"2023-10-09T11:38:08.125842+0000","last_fullsized":"2023-10-09T11:38:08.125842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:14.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122266+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122307+0000","last_change":"2023-10-09T11:38:08.122307+0000","last_active":"2023-10-09T11:38:08.122307+0000","last_peered":"2023-10-09T11:38:08.122307+0000","last_clean":"2023-10-09T11:38:08.122307+0000","last_became_active":"2023-10-09T11:38:08.121878+0000","last_became_peered":"2023-10-09T11:38:08.121878+0000","last_unstale":"2023-10-09T11:38:08.122307+0000","last_undegraded":"2023-10-09T11:38:08.122307+0000","last_fullsized":"2023-10-09T11:38:08.122307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:38.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121642+0000","last_change":"2023-10-09T11:38:08.121642+0000","last_active":"2023-10-09T11:38:08.121642+0000","last_peered":"2023-10-09T11:38:08.121642+0000","last_clean":"2023-10-09T11:38:08.121642+0000","last_became_active":"2023-10-09T11:38:08.121191+0000","last_became_peered":"2023-10-09T11:38:08.121191+0000","last_unstale":"2023-10-09T11:38:08.121642+0000","last_undegraded":"2023-10-09T11:38:08.121642+0000","last_fullsized":"2023-10-09T11:38:08.121642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118792+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124204+0000","last_change":"2023-10-09T11:38:08.124204+0000","last_active":"2023-10-09T11:38:08.124204+0000","last_peered":"2023-10-09T11:38:08.124204+0000","last_clean":"2023-10-09T11:38:08.124204+0000","last_became_active":"2023-10-09T11:38:08.123982+0000","last_became_peered":"2023-10-09T11:38:08.123982+0000","last_unstale":"2023-10-09T11:38:08.124204+0000","last_undegraded":"2023-10-09T11:38:08.124204+0000","last_fullsized":"2023-10-09T11:38:08.124204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.429221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116497+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122905+0000","last_change":"2023-10-09T11:38:08.122905+0000","last_active":"2023-10-09T11:38:08.122905+0000","last_peered":"2023-10-09T11:38:08.122905+0000","last_clean":"2023-10-09T11:38:08.122905+0000","last_became_active":"2023-10-09T11:38:08.122688+0000","last_became_peered":"2023-10-09T11:38:08.122688+0000","last_unstale":"2023-10-09T11:38:08.122905+0000","last_undegraded":"2023-10-09T11:38:08.122905+0000","last_fullsized":"2023-10-09T11:38:08.122905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:26.466209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120854+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126492+0000","last_change":"2023-10-09T11:38:08.126492+0000","last_active":"2023-10-09T11:38:08.126492+0000","last_peered":"2023-10-09T11:38:08.126492+0000","last_clean":"2023-10-09T11:38:08.126492+0000","last_became_active":"2023-10-09T11:38:08.126269+0000","last_became_peered":"2023-10-09T11:38:08.126269+0000","last_unstale":"2023-10-09T11:38:08.126492+0000","last_undegraded":"2023-10-09T11:38:08.126492+0000","last_fullsized":"2023-10-09T11:38:08.126492+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:33.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118390+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121124+0000","last_change":"2023-10-09T11:38:08.121124+0000","last_active":"2023-10-09T11:38:08.121124+0000","last_peered":"2023-10-09T11:38:08.121124+0000","last_clean":"2023-10-09T11:38:08.121124+0000","last_became_active":"2023-10-09T11:38:08.120736+0000","last_became_peered":"2023-10-09T11:38:08.120736+0000","last_unstale":"2023-10-09T11:38:08.121124+0000","last_undegraded":"2023-10-09T11:38:08.121124+0000","last_fullsized":"2023-10-09T11:38:08.121124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:21.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117991+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.127739+0000","last_change":"2023-10-09T11:38:08.127739+0000","last_active":"2023-10-09T11:38:08.127739+0000","last_peered":"2023-10-09T11:38:08.127739+0000","last_clean":"2023-10-09T11:38:08.127739+0000","last_became_active":"2023-10-09T11:38:08.125352+0000","last_became_peered":"2023-10-09T11:38:08.125352+0000","last_unstale":"2023-10-09T11:38:08.127739+0000","last_undegraded":"2023-10-09T11:38:08.127739+0000","last_fullsized":"2023-10-09T11:38:08.127739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:46.571090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126009+0000","last_change":"2023-10-09T11:38:08.126009+0000","last_active":"2023-10-09T11:38:08.126009+0000","last_peered":"2023-10-09T11:38:08.126009+0000","last_clean":"2023-10-09T11:38:08.126009+0000","last_became_active":"2023-10-09T11:38:08.125269+0000","last_became_peered":"2023-10-09T11:38:08.125269+0000","last_unstale":"2023-10-09T11:38:08.126009+0000","last_undegraded":"2023-10-09T11:38:08.126009+0000","last_fullsized":"2023-10-09T11:38:08.126009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:38.552189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120120+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128582+0000","last_change":"2023-10-09T11:38:08.128582+0000","last_active":"2023-10-09T11:38:08.128582+0000","last_peered":"2023-10-09T11:38:08.128582+0000","last_clean":"2023-10-09T11:38:08.128582+0000","last_became_active":"2023-10-09T11:38:08.128317+0000","last_became_peered":"2023-10-09T11:38:08.128317+0000","last_unstale":"2023-10-09T11:38:08.128582+0000","last_undegraded":"2023-10-09T11:38:08.128582+0000","last_fullsized":"2023-10-09T11:38:08.128582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:45.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117550+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.118845+0000","last_change":"2023-10-09T11:38:08.118845+0000","last_active":"2023-10-09T11:38:08.118845+0000","last_peered":"2023-10-09T11:38:08.118845+0000","last_clean":"2023-10-09T11:38:08.118845+0000","last_became_active":"2023-10-09T11:38:08.118600+0000","last_became_peered":"2023-10-09T11:38:08.118600+0000","last_unstale":"2023-10-09T11:38:08.118845+0000","last_undegraded":"2023-10-09T11:38:08.118845+0000","last_fullsized":"2023-10-09T11:38:08.118845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123324+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124894+0000","last_change":"2023-10-09T11:38:08.124894+0000","last_active":"2023-10-09T11:38:08.124894+0000","last_peered":"2023-10-09T11:38:08.124894+0000","last_clean":"2023-10-09T11:38:08.124894+0000","last_became_active":"2023-10-09T11:38:08.124696+0000","last_became_peered":"2023-10-09T11:38:08.124696+0000","last_unstale":"2023-10-09T11:38:08.124894+0000","last_undegraded":"2023-10-09T11:38:08.124894+0000","last_fullsized":"2023-10-09T11:38:08.124894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:44.457144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123111+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125827+0000","last_change":"2023-10-09T11:38:08.125827+0000","last_active":"2023-10-09T11:38:08.125827+0000","last_peered":"2023-10-09T11:38:08.125827+0000","last_clean":"2023-10-09T11:38:08.125827+0000","last_became_active":"2023-10-09T11:38:08.124960+0000","last_became_peered":"2023-10-09T11:38:08.124960+0000","last_unstale":"2023-10-09T11:38:08.125827+0000","last_undegraded":"2023-10-09T11:38:08.125827+0000","last_fullsized":"2023-10-09T11:38:08.125827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.709978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121768+0000","last_change":"2023-10-09T11:38:08.121768+0000","last_active":"2023-10-09T11:38:08.121768+0000","last_peered":"2023-10-09T11:38:08.121768+0000","last_clean":"2023-10-09T11:38:08.121768+0000","last_became_active":"2023-10-09T11:38:08.121548+0000","last_became_peered":"2023-10-09T11:38:08.121548+0000","last_unstale":"2023-10-09T11:38:08.121768+0000","last_undegraded":"2023-10-09T11:38:08.121768+0000","last_fullsized":"2023-10-09T11:38:08.121768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:47.627153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130156+0000","last_change":"2023-10-09T11:38:08.130156+0000","last_active":"2023-10-09T11:38:08.130156+0000","last_peered":"2023-10-09T11:38:08.130156+0000","last_clean":"2023-10-09T11:38:08.130156+0000","last_became_active":"2023-10-09T11:38:08.129294+0000","last_became_peered":"2023-10-09T11:38:08.129294+0000","last_unstale":"2023-10-09T11:38:08.130156+0000","last_undegraded":"2023-10-09T11:38:08.130156+0000","last_fullsized":"2023-10-09T11:38:08.130156+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:53.065896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118021+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125926+0000","last_change":"2023-10-09T11:38:08.125926+0000","last_active":"2023-10-09T11:38:08.125926+0000","last_peered":"2023-10-09T11:38:08.125926+0000","last_clean":"2023-10-09T11:38:08.125926+0000","last_became_active":"2023-10-09T11:38:08.125450+0000","last_became_peered":"2023-10-09T11:38:08.125450+0000","last_unstale":"2023-10-09T11:38:08.125926+0000","last_undegraded":"2023-10-09T11:38:08.125926+0000","last_fullsized":"2023-10-09T11:38:08.125926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:15.240866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122281+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124884+0000","last_change":"2023-10-09T11:38:08.124884+0000","last_active":"2023-10-09T11:38:08.124884+0000","last_peered":"2023-10-09T11:38:08.124884+0000","last_clean":"2023-10-09T11:38:08.124884+0000","last_became_active":"2023-10-09T11:38:08.124634+0000","last_became_peered":"2023-10-09T11:38:08.124634+0000","last_unstale":"2023-10-09T11:38:08.124884+0000","last_undegraded":"2023-10-09T11:38:08.124884+0000","last_fullsized":"2023-10-09T11:38:08.124884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124789+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121275+0000","last_change":"2023-10-09T11:38:08.121275+0000","last_active":"2023-10-09T11:38:08.121275+0000","last_peered":"2023-10-09T11:38:08.121275+0000","last_clean":"2023-10-09T11:38:08.121275+0000","last_became_active":"2023-10-09T11:38:08.121054+0000","last_became_peered":"2023-10-09T11:38:08.121054+0000","last_unstale":"2023-10-09T11:38:08.121275+0000","last_undegraded":"2023-10-09T11:38:08.121275+0000","last_fullsized":"2023-10-09T11:38:08.121275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.398915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119748+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121672+0000","last_change":"2023-10-09T11:38:08.121672+0000","last_active":"2023-10-09T11:38:08.121672+0000","last_peered":"2023-10-09T11:38:08.121672+0000","last_clean":"2023-10-09T11:38:08.121672+0000","last_became_active":"2023-10-09T11:38:08.121445+0000","last_became_peered":"2023-10-09T11:38:08.121445+0000","last_unstale":"2023-10-09T11:38:08.121672+0000","last_undegraded":"2023-10-09T11:38:08.121672+0000","last_fullsized":"2023-10-09T11:38:08.121672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:05.590480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118527+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122691+0000","last_change":"2023-10-09T11:38:08.122691+0000","last_active":"2023-10-09T11:38:08.122691+0000","last_peered":"2023-10-09T11:38:08.122691+0000","last_clean":"2023-10-09T11:38:08.122691+0000","last_became_active":"2023-10-09T11:38:08.122469+0000","last_became_peered":"2023-10-09T11:38:08.122469+0000","last_unstale":"2023-10-09T11:38:08.122691+0000","last_undegraded":"2023-10-09T11:38:08.122691+0000","last_fullsized":"2023-10-09T11:38:08.122691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123118+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120979+0000","last_change":"2023-10-09T11:38:08.120979+0000","last_active":"2023-10-09T11:38:08.120979+0000","last_peered":"2023-10-09T11:38:08.120979+0000","last_clean":"2023-10-09T11:38:08.120979+0000","last_became_active":"2023-10-09T11:38:08.120404+0000","last_became_peered":"2023-10-09T11:38:08.120404+0000","last_unstale":"2023-10-09T11:38:08.120979+0000","last_undegraded":"2023-10-09T11:38:08.120979+0000","last_fullsized":"2023-10-09T11:38:08.120979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124360+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123342+0000","last_change":"2023-10-09T11:38:08.123342+0000","last_active":"2023-10-09T11:38:08.123342+0000","last_peered":"2023-10-09T11:38:08.123342+0000","last_clean":"2023-10-09T11:38:08.123342+0000","last_became_active":"2023-10-09T11:38:08.123106+0000","last_became_peered":"2023-10-09T11:38:08.123106+0000","last_unstale":"2023-10-09T11:38:08.123342+0000","last_undegraded":"2023-10-09T11:38:08.123342+0000","last_fullsized":"2023-10-09T11:38:08.123342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:38:07.115226+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:38:07.115226+0000","last_peered":"2023-10-09T11:38:07.115226+0000","last_clean":"2023-10-09T11:38:07.115226+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:38:07.115226+0000","last_undegraded":"2023-10-09T11:38:07.115226+0000","last_fullsized":"2023-10-09T11:38:07.115226+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.048,"15min":1.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76400000000000001,"5min":1.079,"15min":1.079},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.87},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73599999999999999,"5min":5.298,"15min":5.298},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77000000000000002,"5min":1.617,"15min":1.617},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":5.46,"15min":5.46},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.60099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39900000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51100000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.215},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.51700000000000002,"5min":2.004,"15min":2.004},"last":0.36799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.49099999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40500000000000003,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56299999999999994,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.61099999999999999,"5min":1.909,"15min":1.909},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.311}]},{"osd":4,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":1.869,"15min":1.869},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":1.952,"15min":1.952},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":1.782,"15min":1.782},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78100000000000003,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194447,"statfs":{"total":200000000,"available":199114446,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46999999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57599999999999996,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.309},{"interface":"front","average":{"1min":0.378,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54500000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.502,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64800000000000002,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":1.282,"15min":1.282},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.47399999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.71899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86699999999999999,"5min":3.976,"15min":3.976},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82099999999999995,"5min":1.524,"15min":1.524},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.254,"15min":1.254},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":1.22,"15min":1.22},"last":0.496},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.311,"15min":0.307},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.439},{"interface":"front","average":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54300000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45300000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.85399999999999998,"15min":0.93100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58399999999999996,"5min":11.055,"15min":11.055},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.379},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.626,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.44400000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47899999999999998,"5min":1.034,"15min":1.034},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":1.335,"15min":1.335},"last":0.5}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.26500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58399999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.311},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":1.405,"15min":1.405},"last":0.436}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.167,"15min":1.167},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73299999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.77400000000000002,"15min":0.81299999999999994},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.82599999999999996,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70399999999999996,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":5.274,"15min":5.274},"last":0.72099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.82799999999999996,"15min":0.87},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.84099999999999997,"15min":0.89000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71999999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.75600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83399999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.629,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58399999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.76200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.83799999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T11:38:13.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:38:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.790+0000 7f113112b700 1 Processor -- start 2023-10-09T11:38:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.790+0000 7f113112b700 1 -- start start 2023-10-09T11:38:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159b40 0x7f112c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f112c159f10 0x7f112c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f112c0ccb40 0x7f112c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0cee10 con 0x7f112c0ccb40 2023-10-09T11:38:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0cd040 con 0x7f112c159f10 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113112b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0cd320 con 0x7f112c159b40 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f112c0ccb40 0x7f112c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f112c0ccb40 0x7f112c068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37188/0 (socket says 172.21.15.6:37188) 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 -- 172.21.15.6:0/4039890760 learned_addr learned my addr 172.21.15.6:0/4039890760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f112bfff700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159b40 0x7f112c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f112b7fe700 1 --2- 172.21.15.6:0/4039890760 >> v2:172.21.15.118:3300/0 conn(0x7f112c159f10 0x7f112c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 -- 172.21.15.6:0/4039890760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159b40 msgr2=0x7f112c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159b40 0x7f112c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 -- 172.21.15.6:0/4039890760 >> v2:172.21.15.118:3300/0 conn(0x7f112c159f10 msgr2=0x7f112c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 --2- 172.21.15.6:0/4039890760 >> v2:172.21.15.118:3300/0 conn(0x7f112c159f10 0x7f112c068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 -- 172.21.15.6:0/4039890760 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0ce7c0 con 0x7f112c0ccb40 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.791+0000 7f113092a700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c0ccb40 0x7f112c068cc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f112c068190 tx=0x7f1124009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9d737c239f362a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f112affd700 1 -- 172.21.15.6:0/4039890760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400e070 con 0x7f112c0ccb40 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f112affd700 1 -- 172.21.15.6:0/4039890760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400b970 con 0x7f112c0ccb40 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f112affd700 1 -- 172.21.15.6:0/4039890760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11240092e0 con 0x7f112c0ccb40 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 -- 172.21.15.6:0/4039890760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c0ccb40 msgr2=0x7f112c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c0ccb40 0x7f112c068cc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f112c068190 tx=0x7f1124009840 comp rx=0 tx=0).stop 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 -- 172.21.15.6:0/4039890760 shutdown_connections 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c0ccb40 0x7f112c068cc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 --2- 172.21.15.6:0/4039890760 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159b40 0x7f112c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 --2- 172.21.15.6:0/4039890760 >> v2:172.21.15.118:3300/0 conn(0x7f112c159f10 0x7f112c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 -- 172.21.15.6:0/4039890760 >> 172.21.15.6:0/4039890760 conn(0x7f112c0cd660 msgr2=0x7f112c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 -- 172.21.15.6:0/4039890760 shutdown_connections 2023-10-09T11:38:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.792+0000 7f113112b700 1 -- 172.21.15.6:0/4039890760 wait complete. 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.793+0000 7f113112b700 1 Processor -- start 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.793+0000 7f113112b700 1 -- start start 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f112c0ccb40 0x7f112c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 0x7f112c15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c157c40 con 0x7f112c159b40 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c16b590 con 0x7f112c0ccb40 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f113112b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c156b60 con 0x7f112c159f10 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f112b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f112b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37196/0 (socket says 172.21.15.6:37196) 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f112b7fe700 1 -- 172.21.15.6:0/18163042 learned_addr learned my addr 172.21.15.6:0/18163042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.794+0000 7f112bfff700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f112c0ccb40 0x7f112c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f113092a700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 0x7f112c15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 -- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 msgr2=0x7f112c15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 0x7f112c15c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 -- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f112c0ccb40 msgr2=0x7f112c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f112c0ccb40 0x7f112c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 -- 172.21.15.6:0/18163042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124009ae0 con 0x7f112c159b40 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f113092a700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 0x7f112c15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f112b7fe700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f111400e930 tx=0x7f11140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400eed0 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400c850 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c16a980 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400cbf0 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.795+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c16af40 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.796+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c15b3a0 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.796+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1114013470 con 0x7f112c159b40 2023-10-09T11:38:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.797+0000 7f1123fff700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 0x7f110c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.797+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1114084760 con 0x7f112c159b40 2023-10-09T11:38:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.797+0000 7f112bfff700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 0x7f110c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.797+0000 7f112bfff700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 0x7f110c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f111c009d40 tx=0x7f111c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.801+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f112c15b3a0 con 0x7f112c159b40 2023-10-09T11:38:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.991+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f112c063f00 con 0x7f110c066f30 2023-10-09T11:38:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:13.999+0000 7f1123fff700 1 -- 172.21.15.6:0/18163042 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281787 (secure 0 0 0) 0x7f112c063f00 con 0x7f110c066f30 2023-10-09T11:38:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 msgr2=0x7f110c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 0x7f110c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f111c009d40 tx=0x7f111c008040 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 msgr2=0x7f112c156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f111400e930 tx=0x7f11140091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 shutdown_connections 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f110c066f30 0x7f110c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f112c159f10 0x7f112c15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f112c0ccb40 0x7f112c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 --2- 172.21.15.6:0/18163042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f112c159b40 0x7f112c156620 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 >> 172.21.15.6:0/18163042 conn(0x7f112c0cd660 msgr2=0x7f112c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 shutdown_connections 2023-10-09T11:38:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.002+0000 7f113112b700 1 -- 172.21.15.6:0/18163042 wait complete. 2023-10-09T11:38:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:38:14.016 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2023-10-09T11:38:12.171584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559033,"statfs":{"total":1600000000,"available":1596450699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.059751"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122392+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:27.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127512+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:54.659045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122886+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118398+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122569+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:20.770994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124447+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117070+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:39.206922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125685+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117357+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:46.305342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118495+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118175+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117005+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119404+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:51.402654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116916+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:54.069635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116787+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124060+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127095+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121493+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123344+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:16.188788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124520+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120861+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.126687+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121880+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120717+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122180+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:41.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118558+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124082+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122013+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:28.873334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127525+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:46:13.293026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119177+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.121990+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:40:10.252708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122911+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122701+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121558+0000","last_change":"2023-10-09T11:38:08.121558+0000","last_active":"2023-10-09T11:38:08.121558+0000","last_peered":"2023-10-09T11:38:08.121558+0000","last_clean":"2023-10-09T11:38:08.121558+0000","last_became_active":"2023-10-09T11:38:08.121326+0000","last_became_peered":"2023-10-09T11:38:08.121326+0000","last_unstale":"2023-10-09T11:38:08.121558+0000","last_undegraded":"2023-10-09T11:38:08.121558+0000","last_fullsized":"2023-10-09T11:38:08.121558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:13.687452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119276+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:43.371472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123551+0000","last_change":"2023-10-09T11:38:08.123551+0000","last_active":"2023-10-09T11:38:08.123551+0000","last_peered":"2023-10-09T11:38:08.123551+0000","last_clean":"2023-10-09T11:38:08.123551+0000","last_became_active":"2023-10-09T11:38:08.123280+0000","last_became_peered":"2023-10-09T11:38:08.123280+0000","last_unstale":"2023-10-09T11:38:08.123551+0000","last_undegraded":"2023-10-09T11:38:08.123551+0000","last_fullsized":"2023-10-09T11:38:08.123551+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:16.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122638+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120970+0000","last_change":"2023-10-09T11:38:08.120970+0000","last_active":"2023-10-09T11:38:08.120970+0000","last_peered":"2023-10-09T11:38:08.120970+0000","last_clean":"2023-10-09T11:38:08.120970+0000","last_became_active":"2023-10-09T11:38:08.120732+0000","last_became_peered":"2023-10-09T11:38:08.120732+0000","last_unstale":"2023-10-09T11:38:08.120970+0000","last_undegraded":"2023-10-09T11:38:08.120970+0000","last_fullsized":"2023-10-09T11:38:08.120970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:48.609903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123477+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126143+0000","last_change":"2023-10-09T11:38:08.126143+0000","last_active":"2023-10-09T11:38:08.126143+0000","last_peered":"2023-10-09T11:38:08.126143+0000","last_clean":"2023-10-09T11:38:08.126143+0000","last_became_active":"2023-10-09T11:38:08.125591+0000","last_became_peered":"2023-10-09T11:38:08.125591+0000","last_unstale":"2023-10-09T11:38:08.126143+0000","last_undegraded":"2023-10-09T11:38:08.126143+0000","last_fullsized":"2023-10-09T11:38:08.126143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124758+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120519+0000","last_change":"2023-10-09T11:38:08.120519+0000","last_active":"2023-10-09T11:38:08.120519+0000","last_peered":"2023-10-09T11:38:08.120519+0000","last_clean":"2023-10-09T11:38:08.120519+0000","last_became_active":"2023-10-09T11:38:08.119222+0000","last_became_peered":"2023-10-09T11:38:08.119222+0000","last_unstale":"2023-10-09T11:38:08.120519+0000","last_undegraded":"2023-10-09T11:38:08.120519+0000","last_fullsized":"2023-10-09T11:38:08.120519+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:42.367733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125542+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130013+0000","last_change":"2023-10-09T11:38:08.130013+0000","last_active":"2023-10-09T11:38:08.130013+0000","last_peered":"2023-10-09T11:38:08.130013+0000","last_clean":"2023-10-09T11:38:08.130013+0000","last_became_active":"2023-10-09T11:38:08.127795+0000","last_became_peered":"2023-10-09T11:38:08.127795+0000","last_unstale":"2023-10-09T11:38:08.130013+0000","last_undegraded":"2023-10-09T11:38:08.130013+0000","last_fullsized":"2023-10-09T11:38:08.130013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:38.203183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119600+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:09.350773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124333+0000","last_change":"2023-10-09T11:38:08.124333+0000","last_active":"2023-10-09T11:38:08.124333+0000","last_peered":"2023-10-09T11:38:08.124333+0000","last_clean":"2023-10-09T11:38:08.124333+0000","last_became_active":"2023-10-09T11:38:08.123845+0000","last_became_peered":"2023-10-09T11:38:08.123845+0000","last_unstale":"2023-10-09T11:38:08.124333+0000","last_undegraded":"2023-10-09T11:38:08.124333+0000","last_fullsized":"2023-10-09T11:38:08.124333+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:06.635221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.127101+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:49:20.750507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120586+0000","last_change":"2023-10-09T11:38:08.120586+0000","last_active":"2023-10-09T11:38:08.120586+0000","last_peered":"2023-10-09T11:38:08.120586+0000","last_clean":"2023-10-09T11:38:08.120586+0000","last_became_active":"2023-10-09T11:38:08.118863+0000","last_became_peered":"2023-10-09T11:38:08.118863+0000","last_unstale":"2023-10-09T11:38:08.120586+0000","last_undegraded":"2023-10-09T11:38:08.120586+0000","last_fullsized":"2023-10-09T11:38:08.120586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:26.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116649+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128371+0000","last_change":"2023-10-09T11:38:08.128371+0000","last_active":"2023-10-09T11:38:08.128371+0000","last_peered":"2023-10-09T11:38:08.128371+0000","last_clean":"2023-10-09T11:38:08.128371+0000","last_became_active":"2023-10-09T11:38:08.128200+0000","last_became_peered":"2023-10-09T11:38:08.128200+0000","last_unstale":"2023-10-09T11:38:08.128371+0000","last_undegraded":"2023-10-09T11:38:08.128371+0000","last_fullsized":"2023-10-09T11:38:08.128371+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:03.112765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120502+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.119440+0000","last_change":"2023-10-09T11:38:08.119440+0000","last_active":"2023-10-09T11:38:08.119440+0000","last_peered":"2023-10-09T11:38:08.119440+0000","last_clean":"2023-10-09T11:38:08.119440+0000","last_became_active":"2023-10-09T11:38:08.118785+0000","last_became_peered":"2023-10-09T11:38:08.118785+0000","last_unstale":"2023-10-09T11:38:08.119440+0000","last_undegraded":"2023-10-09T11:38:08.119440+0000","last_fullsized":"2023-10-09T11:38:08.119440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:19.999091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118900+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:08.408586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125842+0000","last_change":"2023-10-09T11:38:08.125842+0000","last_active":"2023-10-09T11:38:08.125842+0000","last_peered":"2023-10-09T11:38:08.125842+0000","last_clean":"2023-10-09T11:38:08.125842+0000","last_became_active":"2023-10-09T11:38:08.125625+0000","last_became_peered":"2023-10-09T11:38:08.125625+0000","last_unstale":"2023-10-09T11:38:08.125842+0000","last_undegraded":"2023-10-09T11:38:08.125842+0000","last_fullsized":"2023-10-09T11:38:08.125842+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:14.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122266+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122307+0000","last_change":"2023-10-09T11:38:08.122307+0000","last_active":"2023-10-09T11:38:08.122307+0000","last_peered":"2023-10-09T11:38:08.122307+0000","last_clean":"2023-10-09T11:38:08.122307+0000","last_became_active":"2023-10-09T11:38:08.121878+0000","last_became_peered":"2023-10-09T11:38:08.121878+0000","last_unstale":"2023-10-09T11:38:08.122307+0000","last_undegraded":"2023-10-09T11:38:08.122307+0000","last_fullsized":"2023-10-09T11:38:08.122307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:38.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121642+0000","last_change":"2023-10-09T11:38:08.121642+0000","last_active":"2023-10-09T11:38:08.121642+0000","last_peered":"2023-10-09T11:38:08.121642+0000","last_clean":"2023-10-09T11:38:08.121642+0000","last_became_active":"2023-10-09T11:38:08.121191+0000","last_became_peered":"2023-10-09T11:38:08.121191+0000","last_unstale":"2023-10-09T11:38:08.121642+0000","last_undegraded":"2023-10-09T11:38:08.121642+0000","last_fullsized":"2023-10-09T11:38:08.121642+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118792+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124204+0000","last_change":"2023-10-09T11:38:08.124204+0000","last_active":"2023-10-09T11:38:08.124204+0000","last_peered":"2023-10-09T11:38:08.124204+0000","last_clean":"2023-10-09T11:38:08.124204+0000","last_became_active":"2023-10-09T11:38:08.123982+0000","last_became_peered":"2023-10-09T11:38:08.123982+0000","last_unstale":"2023-10-09T11:38:08.124204+0000","last_undegraded":"2023-10-09T11:38:08.124204+0000","last_fullsized":"2023-10-09T11:38:08.124204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.429221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116497+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122905+0000","last_change":"2023-10-09T11:38:08.122905+0000","last_active":"2023-10-09T11:38:08.122905+0000","last_peered":"2023-10-09T11:38:08.122905+0000","last_clean":"2023-10-09T11:38:08.122905+0000","last_became_active":"2023-10-09T11:38:08.122688+0000","last_became_peered":"2023-10-09T11:38:08.122688+0000","last_unstale":"2023-10-09T11:38:08.122905+0000","last_undegraded":"2023-10-09T11:38:08.122905+0000","last_fullsized":"2023-10-09T11:38:08.122905+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:26.466209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120854+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126492+0000","last_change":"2023-10-09T11:38:08.126492+0000","last_active":"2023-10-09T11:38:08.126492+0000","last_peered":"2023-10-09T11:38:08.126492+0000","last_clean":"2023-10-09T11:38:08.126492+0000","last_became_active":"2023-10-09T11:38:08.126269+0000","last_became_peered":"2023-10-09T11:38:08.126269+0000","last_unstale":"2023-10-09T11:38:08.126492+0000","last_undegraded":"2023-10-09T11:38:08.126492+0000","last_fullsized":"2023-10-09T11:38:08.126492+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:33.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118390+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121124+0000","last_change":"2023-10-09T11:38:08.121124+0000","last_active":"2023-10-09T11:38:08.121124+0000","last_peered":"2023-10-09T11:38:08.121124+0000","last_clean":"2023-10-09T11:38:08.121124+0000","last_became_active":"2023-10-09T11:38:08.120736+0000","last_became_peered":"2023-10-09T11:38:08.120736+0000","last_unstale":"2023-10-09T11:38:08.121124+0000","last_undegraded":"2023-10-09T11:38:08.121124+0000","last_fullsized":"2023-10-09T11:38:08.121124+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:21.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117991+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.127739+0000","last_change":"2023-10-09T11:38:08.127739+0000","last_active":"2023-10-09T11:38:08.127739+0000","last_peered":"2023-10-09T11:38:08.127739+0000","last_clean":"2023-10-09T11:38:08.127739+0000","last_became_active":"2023-10-09T11:38:08.125352+0000","last_became_peered":"2023-10-09T11:38:08.125352+0000","last_unstale":"2023-10-09T11:38:08.127739+0000","last_undegraded":"2023-10-09T11:38:08.127739+0000","last_fullsized":"2023-10-09T11:38:08.127739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:46.571090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.125194+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.126009+0000","last_change":"2023-10-09T11:38:08.126009+0000","last_active":"2023-10-09T11:38:08.126009+0000","last_peered":"2023-10-09T11:38:08.126009+0000","last_clean":"2023-10-09T11:38:08.126009+0000","last_became_active":"2023-10-09T11:38:08.125269+0000","last_became_peered":"2023-10-09T11:38:08.125269+0000","last_unstale":"2023-10-09T11:38:08.126009+0000","last_undegraded":"2023-10-09T11:38:08.126009+0000","last_fullsized":"2023-10-09T11:38:08.126009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:38.552189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.120120+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.128582+0000","last_change":"2023-10-09T11:38:08.128582+0000","last_active":"2023-10-09T11:38:08.128582+0000","last_peered":"2023-10-09T11:38:08.128582+0000","last_clean":"2023-10-09T11:38:08.128582+0000","last_became_active":"2023-10-09T11:38:08.128317+0000","last_became_peered":"2023-10-09T11:38:08.128317+0000","last_unstale":"2023-10-09T11:38:08.128582+0000","last_undegraded":"2023-10-09T11:38:08.128582+0000","last_fullsized":"2023-10-09T11:38:08.128582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:45.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.117550+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.118845+0000","last_change":"2023-10-09T11:38:08.118845+0000","last_active":"2023-10-09T11:38:08.118845+0000","last_peered":"2023-10-09T11:38:08.118845+0000","last_clean":"2023-10-09T11:38:08.118845+0000","last_became_active":"2023-10-09T11:38:08.118600+0000","last_became_peered":"2023-10-09T11:38:08.118600+0000","last_unstale":"2023-10-09T11:38:08.118845+0000","last_undegraded":"2023-10-09T11:38:08.118845+0000","last_fullsized":"2023-10-09T11:38:08.118845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123324+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124894+0000","last_change":"2023-10-09T11:38:08.124894+0000","last_active":"2023-10-09T11:38:08.124894+0000","last_peered":"2023-10-09T11:38:08.124894+0000","last_clean":"2023-10-09T11:38:08.124894+0000","last_became_active":"2023-10-09T11:38:08.124696+0000","last_became_peered":"2023-10-09T11:38:08.124696+0000","last_unstale":"2023-10-09T11:38:08.124894+0000","last_undegraded":"2023-10-09T11:38:08.124894+0000","last_fullsized":"2023-10-09T11:38:08.124894+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:44.457144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123111+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125827+0000","last_change":"2023-10-09T11:38:08.125827+0000","last_active":"2023-10-09T11:38:08.125827+0000","last_peered":"2023-10-09T11:38:08.125827+0000","last_clean":"2023-10-09T11:38:08.125827+0000","last_became_active":"2023-10-09T11:38:08.124960+0000","last_became_peered":"2023-10-09T11:38:08.124960+0000","last_unstale":"2023-10-09T11:38:08.125827+0000","last_undegraded":"2023-10-09T11:38:08.125827+0000","last_fullsized":"2023-10-09T11:38:08.125827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.709978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121768+0000","last_change":"2023-10-09T11:38:08.121768+0000","last_active":"2023-10-09T11:38:08.121768+0000","last_peered":"2023-10-09T11:38:08.121768+0000","last_clean":"2023-10-09T11:38:08.121768+0000","last_became_active":"2023-10-09T11:38:08.121548+0000","last_became_peered":"2023-10-09T11:38:08.121548+0000","last_unstale":"2023-10-09T11:38:08.121768+0000","last_undegraded":"2023-10-09T11:38:08.121768+0000","last_fullsized":"2023-10-09T11:38:08.121768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:47.627153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.116353+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.130156+0000","last_change":"2023-10-09T11:38:08.130156+0000","last_active":"2023-10-09T11:38:08.130156+0000","last_peered":"2023-10-09T11:38:08.130156+0000","last_clean":"2023-10-09T11:38:08.130156+0000","last_became_active":"2023-10-09T11:38:08.129294+0000","last_became_peered":"2023-10-09T11:38:08.129294+0000","last_unstale":"2023-10-09T11:38:08.130156+0000","last_undegraded":"2023-10-09T11:38:08.130156+0000","last_fullsized":"2023-10-09T11:38:08.130156+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:53.065896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118021+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.125926+0000","last_change":"2023-10-09T11:38:08.125926+0000","last_active":"2023-10-09T11:38:08.125926+0000","last_peered":"2023-10-09T11:38:08.125926+0000","last_clean":"2023-10-09T11:38:08.125926+0000","last_became_active":"2023-10-09T11:38:08.125450+0000","last_became_peered":"2023-10-09T11:38:08.125450+0000","last_unstale":"2023-10-09T11:38:08.125926+0000","last_undegraded":"2023-10-09T11:38:08.125926+0000","last_fullsized":"2023-10-09T11:38:08.125926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:15.240866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.122281+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.124884+0000","last_change":"2023-10-09T11:38:08.124884+0000","last_active":"2023-10-09T11:38:08.124884+0000","last_peered":"2023-10-09T11:38:08.124884+0000","last_clean":"2023-10-09T11:38:08.124884+0000","last_became_active":"2023-10-09T11:38:08.124634+0000","last_became_peered":"2023-10-09T11:38:08.124634+0000","last_unstale":"2023-10-09T11:38:08.124884+0000","last_undegraded":"2023-10-09T11:38:08.124884+0000","last_fullsized":"2023-10-09T11:38:08.124884+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124789+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121275+0000","last_change":"2023-10-09T11:38:08.121275+0000","last_active":"2023-10-09T11:38:08.121275+0000","last_peered":"2023-10-09T11:38:08.121275+0000","last_clean":"2023-10-09T11:38:08.121275+0000","last_became_active":"2023-10-09T11:38:08.121054+0000","last_became_peered":"2023-10-09T11:38:08.121054+0000","last_unstale":"2023-10-09T11:38:08.121275+0000","last_undegraded":"2023-10-09T11:38:08.121275+0000","last_fullsized":"2023-10-09T11:38:08.121275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.398915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.119748+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.121672+0000","last_change":"2023-10-09T11:38:08.121672+0000","last_active":"2023-10-09T11:38:08.121672+0000","last_peered":"2023-10-09T11:38:08.121672+0000","last_clean":"2023-10-09T11:38:08.121672+0000","last_became_active":"2023-10-09T11:38:08.121445+0000","last_became_peered":"2023-10-09T11:38:08.121445+0000","last_unstale":"2023-10-09T11:38:08.121672+0000","last_undegraded":"2023-10-09T11:38:08.121672+0000","last_fullsized":"2023-10-09T11:38:08.121672+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:05.590480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.118527+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.122691+0000","last_change":"2023-10-09T11:38:08.122691+0000","last_active":"2023-10-09T11:38:08.122691+0000","last_peered":"2023-10-09T11:38:08.122691+0000","last_clean":"2023-10-09T11:38:08.122691+0000","last_became_active":"2023-10-09T11:38:08.122469+0000","last_became_peered":"2023-10-09T11:38:08.122469+0000","last_unstale":"2023-10-09T11:38:08.122691+0000","last_undegraded":"2023-10-09T11:38:08.122691+0000","last_fullsized":"2023-10-09T11:38:08.122691+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.123118+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.120979+0000","last_change":"2023-10-09T11:38:08.120979+0000","last_active":"2023-10-09T11:38:08.120979+0000","last_peered":"2023-10-09T11:38:08.120979+0000","last_clean":"2023-10-09T11:38:08.120979+0000","last_became_active":"2023-10-09T11:38:08.120404+0000","last_became_peered":"2023-10-09T11:38:08.120404+0000","last_unstale":"2023-10-09T11:38:08.120979+0000","last_undegraded":"2023-10-09T11:38:08.120979+0000","last_fullsized":"2023-10-09T11:38:08.120979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:38:08.111609+0000","last_change":"2023-10-09T11:38:08.124360+0000","last_active":"2023-10-09T11:38:08.111609+0000","last_peered":"2023-10-09T11:38:08.111609+0000","last_clean":"2023-10-09T11:38:08.111609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:38:08.111609+0000","last_undegraded":"2023-10-09T11:38:08.111609+0000","last_fullsized":"2023-10-09T11:38:08.111609+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-09T11:38:08.123342+0000","last_change":"2023-10-09T11:38:08.123342+0000","last_active":"2023-10-09T11:38:08.123342+0000","last_peered":"2023-10-09T11:38:08.123342+0000","last_clean":"2023-10-09T11:38:08.123342+0000","last_became_active":"2023-10-09T11:38:08.123106+0000","last_became_peered":"2023-10-09T11:38:08.123106+0000","last_unstale":"2023-10-09T11:38:08.123342+0000","last_undegraded":"2023-10-09T11:38:08.123342+0000","last_fullsized":"2023-10-09T11:38:08.123342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T11:38:07.115226+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:38:07.115226+0000","last_peered":"2023-10-09T11:38:07.115226+0000","last_clean":"2023-10-09T11:38:07.115226+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:38:07.115226+0000","last_undegraded":"2023-10-09T11:38:07.115226+0000","last_fullsized":"2023-10-09T11:38:07.115226+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.048,"15min":1.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76400000000000001,"5min":1.079,"15min":1.079},"last":0.71499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.81000000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.87},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73599999999999999,"5min":5.298,"15min":5.298},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77000000000000002,"5min":1.617,"15min":1.617},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":5.46,"15min":5.46},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.67400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.60099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39900000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51100000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.215},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.51700000000000002,"5min":2.004,"15min":2.004},"last":0.36799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.49099999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40500000000000003,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56299999999999994,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.61099999999999999,"5min":1.909,"15min":1.909},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.311}]},{"osd":4,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":1.869,"15min":1.869},"last":0.56499999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":1.952,"15min":1.952},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":1.782,"15min":1.782},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78100000000000003,"5min":1.819,"15min":1.819},"last":0.57499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194447,"statfs":{"total":200000000,"available":199114446,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46999999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57599999999999996,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.309},{"interface":"front","average":{"1min":0.378,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54500000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.502,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64800000000000002,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":1.282,"15min":1.282},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.47399999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.71899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86699999999999999,"5min":3.976,"15min":3.976},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82099999999999995,"5min":1.524,"15min":1.524},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.254,"15min":1.254},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":1.22,"15min":1.22},"last":0.496},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.55600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.311,"15min":0.307},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.439},{"interface":"front","average":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54300000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.36899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45300000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.85399999999999998,"15min":0.93100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58399999999999996,"5min":11.055,"15min":11.055},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.379},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.626,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.44400000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47899999999999998,"5min":1.034,"15min":1.034},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":1.335,"15min":1.335},"last":0.5}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.26500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58399999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.311},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":1.405,"15min":1.405},"last":0.436}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.167,"15min":1.167},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73299999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.77400000000000002,"15min":0.81299999999999994},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.82599999999999996,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70399999999999996,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":5.274,"15min":5.274},"last":0.72099999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.82799999999999996,"15min":0.87},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.84099999999999997,"15min":0.89000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71999999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.77100000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.75600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195023,"statfs":{"total":200000000,"available":199703803,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83399999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.629,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58399999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.628},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.76200000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.83799999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122392+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:00:27.073934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.127512+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:55:54.659045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122886+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-09T11:38:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118398+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122569+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:10:20.770994+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124447+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.117070+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:41:39.206922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.125685+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-09T11:38:14.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.117357+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:28:46.305342+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118495+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118175+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.117005+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.119404+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:34:51.402654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:38:14.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116916+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:15:54.069635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116787+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124060+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.127095+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.121493+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.123344+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:13:16.188788+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124520+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.120861+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-09T11:38:14.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.126687+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.121880+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.120717+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-09T11:38:14.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122180+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:09:41.015060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118558+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124082+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122013+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:48:28.873334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-09T11:38:14.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.127525+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:46:13.293026+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.119177+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.121990+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:40:10.252708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-09T11:38:14.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122911+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-09T11:38:14.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122701+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-09T11:38:14.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.119276+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:34:43.371472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-09T11:38:14.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122638+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-09T11:38:14.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.123477+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:58:07.638959+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-09T11:38:14.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124758+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.125542+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.119600+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:26:09.350773+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-09T11:38:14.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.127101+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:49:20.750507+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116649+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.120502+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:06:39.555927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-09T11:38:14.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118900+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:40:08.408586+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122266+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118194+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-09T11:38:14.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118792+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116497+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.120854+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-09T11:38:14.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118390+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.117991+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.125194+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-09T11:38:14.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.120120+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:44:16.713717+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-09T11:38:14.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.117550+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-09T11:38:14.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.123324+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:55:03.392386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.123111+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:38:19.336952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116353+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.116353+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-09T11:38:14.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118021+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:36:28.099417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.122281+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124789+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.119748+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:20:27.469948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.118527+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-09T11:38:14.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.123118+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-09T11:38:14.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:38:08.111609+0000', 'last_change': '2023-10-09T11:38:08.124360+0000', 'last_active': '2023-10-09T11:38:08.111609+0000', 'last_peered': '2023-10-09T11:38:08.111609+0000', 'last_clean': '2023-10-09T11:38:08.111609+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:38:08.111609+0000', 'last_undegraded': '2023-10-09T11:38:08.111609+0000', 'last_fullsized': '2023-10-09T11:38:08.111609+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'last_clean_scrub_stamp': '2023-10-09T11:38:08.111609+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:38:14.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:38:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.173+0000 7f83d759e700 1 Processor -- start 2023-10-09T11:38:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.173+0000 7f83d759e700 1 -- start start 2023-10-09T11:38:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83d8069110 0x7f83d80cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d80cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d759e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80cb2e0 con 0x7f83d81434d0 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80d0230 con 0x7f83d8069110 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80cb5c0 con 0x7f83d81438a0 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d6d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d80cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d5d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83d8069110 0x7f83d80cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d5d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83d8069110 0x7f83d80cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:44946/0 (socket says 172.21.15.6:44946) 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.174+0000 7f83d5d9b700 1 -- 172.21.15.6:0/556291029 learned_addr learned my addr 172.21.15.6:0/556291029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d5d9b700 1 -- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 msgr2=0x7f83d80cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d5d9b700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d80cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d5d9b700 1 -- 172.21.15.6:0/556291029 >> v1:172.21.15.118:6789/0 conn(0x7f83d81434d0 legacy=0x7f83d8068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d5d9b700 1 -- 172.21.15.6:0/556291029 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80cb8a0 con 0x7f83d8069110 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d6d9d700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d80cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d5d9b700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8069110 0x7f83d80cf7b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83c00099b0 tx=0x7f83c0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1b81705b301cf49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d559a700 1 -- 172.21.15.6:0/556291029 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0009ea0 con 0x7f83d8069110 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d559a700 1 -- 172.21.15.6:0/556291029 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000b860 con 0x7f83d8069110 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.175+0000 7f83d559a700 1 -- 172.21.15.6:0/556291029 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000bc00 con 0x7f83d8069110 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 -- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8069110 msgr2=0x7f83d80cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8069110 0x7f83d80cf7b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83c00099b0 tx=0x7f83c0009250 comp rx=0 tx=0).stop 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 -- 172.21.15.6:0/556291029 shutdown_connections 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d80cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 --2- 172.21.15.6:0/556291029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d8069110 0x7f83d80cf7b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 -- 172.21.15.6:0/556291029 >> 172.21.15.6:0/556291029 conn(0x7f83d80cd610 msgr2=0x7f83d80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 -- 172.21.15.6:0/556291029 shutdown_connections 2023-10-09T11:38:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.176+0000 7f83d759e700 1 -- 172.21.15.6:0/556291029 wait complete. 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 Processor -- start 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 -- start start 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d81434d0 0x7f83d8140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d8139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8140680 con 0x7f83d8069110 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80c7c50 con 0x7f83d81434d0 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.177+0000 7f83d759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8142700 con 0x7f83d81438a0 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37208/0 (socket says 172.21.15.6:37208) 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 -- 172.21.15.6:0/1911460225 learned_addr learned my addr 172.21.15.6:0/1911460225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d5d9b700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d81434d0 0x7f83d8140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d6d9d700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d8139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 -- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 msgr2=0x7f83d8139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d8139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 -- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d81434d0 msgr2=0x7f83d8140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d81434d0 0x7f83d8140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 -- 172.21.15.6:0/1911460225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009a20 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d6d9d700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d8139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d659c700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c590 tx=0x7f83d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0011590 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00094f0 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0011710 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0011ad0 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.178+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d80c7ef0 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.179+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d80c80e0 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.180+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83d001b3b0 con 0x7f83d8069110 2023-10-09T11:38:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.180+0000 7f83ce7fc700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.180+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83d0083a30 con 0x7f83d8069110 2023-10-09T11:38:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.180+0000 7f83d5d9b700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.181+0000 7f83d5d9b700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 0x7f83b80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f83c00099b0 tx=0x7f83c0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.184+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83d0050ca0 con 0x7f83d8069110 2023-10-09T11:38:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.455+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f83d80cbb80 con 0x7f83d8069110 2023-10-09T11:38:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.456+0000 7f83ce7fc700 1 -- 172.21.15.6:0/1911460225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1448 (secure 0 0 0) 0x7f83d0017020 con 0x7f83d8069110 2023-10-09T11:38:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:14.458 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":148,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851351,"num_in_osds":8,"osd_in_since":1696851348,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":3549301,"bytes_avail":1596450699,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5697}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-09T11:37:58.169399+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 msgr2=0x7f83b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 0x7f83b80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f83c00099b0 tx=0x7f83c0017000 comp rx=0 tx=0).stop 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 msgr2=0x7f83d80caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83d000c590 tx=0x7f83d000c8a0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 shutdown_connections 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83b8066f30 0x7f83b80693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f83d81438a0 0x7f83d8139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d8069110 0x7f83d80caab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 --2- 172.21.15.6:0/1911460225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d81434d0 0x7f83d8140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 >> 172.21.15.6:0/1911460225 conn(0x7f83d80cd610 msgr2=0x7f83d80b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 shutdown_connections 2023-10-09T11:38:14.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.458+0000 7f83d759e700 1 -- 172.21.15.6:0/1911460225 wait complete. 2023-10-09T11:38:14.472 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:38:14.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:38:14.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.589+0000 7f59a135f700 1 Processor -- start 2023-10-09T11:38:14.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.589+0000 7f59a135f700 1 -- start start 2023-10-09T11:38:14.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f59a135f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f59a135f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f59a135f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c0cee10 con 0x7f599c0ccb40 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f59a135f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c0cd040 con 0x7f599c159f10 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f59a135f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c0cd320 con 0x7f599c159b40 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f599bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.590+0000 7f599b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 -- 172.21.15.6:0/2662057199 learned_addr learned my addr 172.21.15.6:0/2662057199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f59a0b5e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f599c0ccb40 0x7f599c15d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52658/0 (socket says 172.21.15.6:52658) 2023-10-09T11:38:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:44964/0 (socket says 172.21.15.6:44964) 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 -- 172.21.15.6:0/2662057199 >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 msgr2=0x7f599c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 --2- 172.21.15.6:0/2662057199 >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 -- 172.21.15.6:0/2662057199 >> v1:172.21.15.118:6789/0 conn(0x7f599c0ccb40 legacy=0x7f599c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 -- 172.21.15.6:0/2662057199 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0ce7c0 con 0x7f599c159b40 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599b7fe700 1 --2- 172.21.15.6:0/2662057199 >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599bfff700 1 --2- 172.21.15.6:0/2662057199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59840099b0 tx=0x7f5984009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6626e9ab70d3ff1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599affd700 1 -- 172.21.15.6:0/2662057199 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984009ea0 con 0x7f599c159b40 2023-10-09T11:38:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599affd700 1 -- 172.21.15.6:0/2662057199 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400b860 con 0x7f599c159b40 2023-10-09T11:38:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.591+0000 7f599affd700 1 -- 172.21.15.6:0/2662057199 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400bc00 con 0x7f599c159b40 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 -- 172.21.15.6:0/2662057199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 msgr2=0x7f599c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 --2- 172.21.15.6:0/2662057199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59840099b0 tx=0x7f5984009250 comp rx=0 tx=0).stop 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 -- 172.21.15.6:0/2662057199 shutdown_connections 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 --2- 172.21.15.6:0/2662057199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159b40 0x7f599c0cc600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 --2- 172.21.15.6:0/2662057199 >> v2:172.21.15.118:3300/0 conn(0x7f599c159f10 0x7f599c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 -- 172.21.15.6:0/2662057199 >> 172.21.15.6:0/2662057199 conn(0x7f599c0cd660 msgr2=0x7f599c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 -- 172.21.15.6:0/2662057199 shutdown_connections 2023-10-09T11:38:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.592+0000 7f59a135f700 1 -- 172.21.15.6:0/2662057199 wait complete. 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.593+0000 7f59a135f700 1 Processor -- start 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.593+0000 7f59a135f700 1 -- start start 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 0x7f599c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159f10 0x7f599c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c0c9940 con 0x7f599c159b40 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15b2f0 con 0x7f599c0ccb40 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a135f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15b5d0 con 0x7f599c159f10 2023-10-09T11:38:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37214/0 (socket says 172.21.15.6:37214) 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 -- 172.21.15.6:0/3605351745 learned_addr learned my addr 172.21.15.6:0/3605351745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599bfff700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 0x7f599c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f59a0b5e700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159f10 0x7f599c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 -- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159f10 msgr2=0x7f599c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159f10 0x7f599c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 -- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 msgr2=0x7f599c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 0x7f599c154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599b7fe700 1 -- 172.21.15.6:0/3605351745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009420 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.594+0000 7f599bfff700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 0x7f599c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f599b7fe700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f598c00ec80 tx=0x7f598c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00c9d0 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c00cb30 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840094f0 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00ceb0 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.595+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c15bb90 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.596+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c0cb910 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.596+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f598c013680 con 0x7f599c159b40 2023-10-09T11:38:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.597+0000 7f5993fff700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 0x7f597c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:14.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.597+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f598c084970 con 0x7f599c159b40 2023-10-09T11:38:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.597+0000 7f599bfff700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 0x7f597c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.597+0000 7f599bfff700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 0x7f597c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f59840099b0 tx=0x7f5984017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.601+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f598c051b40 con 0x7f599c159b40 2023-10-09T11:38:14.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.789+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f599c0ceaa0 con 0x7f597c066f30 2023-10-09T11:38:14.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.797+0000 7f5993fff700 1 -- 172.21.15.6:0/3605351745 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284658 (secure 0 0 0) 0x7f599c0ceaa0 con 0x7f597c066f30 2023-10-09T11:38:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 msgr2=0x7f597c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 0x7f597c0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f59840099b0 tx=0x7f5984017000 comp rx=0 tx=0).stop 2023-10-09T11:38:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 msgr2=0x7f599c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f598c00ec80 tx=0x7f598c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 shutdown_connections 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f597c066f30 0x7f597c0693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f599c159f10 0x7f599c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599c0ccb40 0x7f599c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 --2- 172.21.15.6:0/3605351745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f599c159b40 0x7f599c157000 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.800+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 >> 172.21.15.6:0/3605351745 conn(0x7f599c0cd660 msgr2=0x7f599c06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.801+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 shutdown_connections 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:14.801+0000 7f59a135f700 1 -- 172.21.15.6:0/3605351745 wait complete. 2023-10-09T11:38:14.805 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:38:14.814 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-10-09T11:38:14.171890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558878,"statfs":{"total":1600000000,"available":1596291639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.057552"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143326+0000","last_change":"2023-10-09T11:38:09.143265+0000","last_active":"2023-10-09T11:38:09.143326+0000","last_peered":"2023-10-09T11:38:09.143326+0000","last_clean":"2023-10-09T11:38:09.143326+0000","last_became_active":"2023-10-09T11:38:09.142867+0000","last_became_peered":"2023-10-09T11:38:09.142867+0000","last_unstale":"2023-10-09T11:38:09.143326+0000","last_undegraded":"2023-10-09T11:38:09.143326+0000","last_fullsized":"2023-10-09T11:38:09.143326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:57.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.146037+0000","last_change":"2023-10-09T11:38:09.145978+0000","last_active":"2023-10-09T11:38:09.146037+0000","last_peered":"2023-10-09T11:38:09.146037+0000","last_clean":"2023-10-09T11:38:09.146037+0000","last_became_active":"2023-10-09T11:38:09.144730+0000","last_became_peered":"2023-10-09T11:38:09.144730+0000","last_unstale":"2023-10-09T11:38:09.146037+0000","last_undegraded":"2023-10-09T11:38:09.146037+0000","last_fullsized":"2023-10-09T11:38:09.146037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:47.339105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139166+0000","last_change":"2023-10-09T11:38:09.139099+0000","last_active":"2023-10-09T11:38:09.139166+0000","last_peered":"2023-10-09T11:38:09.139166+0000","last_clean":"2023-10-09T11:38:09.139166+0000","last_became_active":"2023-10-09T11:38:09.138383+0000","last_became_peered":"2023-10-09T11:38:09.138383+0000","last_unstale":"2023-10-09T11:38:09.139166+0000","last_undegraded":"2023-10-09T11:38:09.139166+0000","last_fullsized":"2023-10-09T11:38:09.139166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154154+0000","last_change":"2023-10-09T11:38:09.152995+0000","last_active":"2023-10-09T11:38:09.154154+0000","last_peered":"2023-10-09T11:38:09.154154+0000","last_clean":"2023-10-09T11:38:09.154154+0000","last_became_active":"2023-10-09T11:38:09.152020+0000","last_became_peered":"2023-10-09T11:38:09.152020+0000","last_unstale":"2023-10-09T11:38:09.154154+0000","last_undegraded":"2023-10-09T11:38:09.154154+0000","last_fullsized":"2023-10-09T11:38:09.154154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155505+0000","last_change":"2023-10-09T11:38:09.155443+0000","last_active":"2023-10-09T11:38:09.155505+0000","last_peered":"2023-10-09T11:38:09.155505+0000","last_clean":"2023-10-09T11:38:09.155505+0000","last_became_active":"2023-10-09T11:38:09.155199+0000","last_became_peered":"2023-10-09T11:38:09.155199+0000","last_unstale":"2023-10-09T11:38:09.155505+0000","last_undegraded":"2023-10-09T11:38:09.155505+0000","last_fullsized":"2023-10-09T11:38:09.155505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:30.354359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.142997+0000","last_change":"2023-10-09T11:38:09.142932+0000","last_active":"2023-10-09T11:38:09.142997+0000","last_peered":"2023-10-09T11:38:09.142997+0000","last_clean":"2023-10-09T11:38:09.142997+0000","last_became_active":"2023-10-09T11:38:09.142239+0000","last_became_peered":"2023-10-09T11:38:09.142239+0000","last_unstale":"2023-10-09T11:38:09.142997+0000","last_undegraded":"2023-10-09T11:38:09.142997+0000","last_fullsized":"2023-10-09T11:38:09.142997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152939+0000","last_change":"2023-10-09T11:38:09.152635+0000","last_active":"2023-10-09T11:38:09.152939+0000","last_peered":"2023-10-09T11:38:09.152939+0000","last_clean":"2023-10-09T11:38:09.152939+0000","last_became_active":"2023-10-09T11:38:09.152421+0000","last_became_peered":"2023-10-09T11:38:09.152421+0000","last_unstale":"2023-10-09T11:38:09.152939+0000","last_undegraded":"2023-10-09T11:38:09.152939+0000","last_fullsized":"2023-10-09T11:38:09.152939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143972+0000","last_change":"2023-10-09T11:38:09.143898+0000","last_active":"2023-10-09T11:38:09.143972+0000","last_peered":"2023-10-09T11:38:09.143972+0000","last_clean":"2023-10-09T11:38:09.143972+0000","last_became_active":"2023-10-09T11:38:09.143410+0000","last_became_peered":"2023-10-09T11:38:09.143410+0000","last_unstale":"2023-10-09T11:38:09.143972+0000","last_undegraded":"2023-10-09T11:38:09.143972+0000","last_fullsized":"2023-10-09T11:38:09.143972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:16.755402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138774+0000","last_change":"2023-10-09T11:38:09.138084+0000","last_active":"2023-10-09T11:38:09.138774+0000","last_peered":"2023-10-09T11:38:09.138774+0000","last_clean":"2023-10-09T11:38:09.138774+0000","last_became_active":"2023-10-09T11:38:09.137850+0000","last_became_peered":"2023-10-09T11:38:09.137850+0000","last_unstale":"2023-10-09T11:38:09.138774+0000","last_undegraded":"2023-10-09T11:38:09.138774+0000","last_fullsized":"2023-10-09T11:38:09.138774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139234+0000","last_change":"2023-10-09T11:38:09.138060+0000","last_active":"2023-10-09T11:38:09.139234+0000","last_peered":"2023-10-09T11:38:09.139234+0000","last_clean":"2023-10-09T11:38:09.139234+0000","last_became_active":"2023-10-09T11:38:09.137829+0000","last_became_peered":"2023-10-09T11:38:09.137829+0000","last_unstale":"2023-10-09T11:38:09.139234+0000","last_undegraded":"2023-10-09T11:38:09.139234+0000","last_fullsized":"2023-10-09T11:38:09.139234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.144550+0000","last_change":"2023-10-09T11:38:09.144485+0000","last_active":"2023-10-09T11:38:09.144550+0000","last_peered":"2023-10-09T11:38:09.144550+0000","last_clean":"2023-10-09T11:38:09.144550+0000","last_became_active":"2023-10-09T11:38:09.144078+0000","last_became_peered":"2023-10-09T11:38:09.144078+0000","last_unstale":"2023-10-09T11:38:09.144550+0000","last_undegraded":"2023-10-09T11:38:09.144550+0000","last_fullsized":"2023-10-09T11:38:09.144550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:39.497670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154049+0000","last_change":"2023-10-09T11:38:09.151392+0000","last_active":"2023-10-09T11:38:09.154049+0000","last_peered":"2023-10-09T11:38:09.154049+0000","last_clean":"2023-10-09T11:38:09.154049+0000","last_became_active":"2023-10-09T11:38:09.150373+0000","last_became_peered":"2023-10-09T11:38:09.150373+0000","last_unstale":"2023-10-09T11:38:09.154049+0000","last_undegraded":"2023-10-09T11:38:09.154049+0000","last_fullsized":"2023-10-09T11:38:09.154049+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141659+0000","last_change":"2023-10-09T11:38:09.141599+0000","last_active":"2023-10-09T11:38:09.141659+0000","last_peered":"2023-10-09T11:38:09.141659+0000","last_clean":"2023-10-09T11:38:09.141659+0000","last_became_active":"2023-10-09T11:38:09.141332+0000","last_became_peered":"2023-10-09T11:38:09.141332+0000","last_unstale":"2023-10-09T11:38:09.141659+0000","last_undegraded":"2023-10-09T11:38:09.141659+0000","last_fullsized":"2023-10-09T11:38:09.141659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.132926+0000","last_change":"2023-10-09T11:38:09.132806+0000","last_active":"2023-10-09T11:38:09.132926+0000","last_peered":"2023-10-09T11:38:09.132926+0000","last_clean":"2023-10-09T11:38:09.132926+0000","last_became_active":"2023-10-09T11:38:09.132547+0000","last_became_peered":"2023-10-09T11:38:09.132547+0000","last_unstale":"2023-10-09T11:38:09.132926+0000","last_undegraded":"2023-10-09T11:38:09.132926+0000","last_fullsized":"2023-10-09T11:38:09.132926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140181+0000","last_change":"2023-10-09T11:38:09.140119+0000","last_active":"2023-10-09T11:38:09.140181+0000","last_peered":"2023-10-09T11:38:09.140181+0000","last_clean":"2023-10-09T11:38:09.140181+0000","last_became_active":"2023-10-09T11:38:09.139800+0000","last_became_peered":"2023-10-09T11:38:09.139800+0000","last_unstale":"2023-10-09T11:38:09.140181+0000","last_undegraded":"2023-10-09T11:38:09.140181+0000","last_fullsized":"2023-10-09T11:38:09.140181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:28.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140850+0000","last_change":"2023-10-09T11:38:09.140598+0000","last_active":"2023-10-09T11:38:09.140850+0000","last_peered":"2023-10-09T11:38:09.140850+0000","last_clean":"2023-10-09T11:38:09.140850+0000","last_became_active":"2023-10-09T11:38:09.140315+0000","last_became_peered":"2023-10-09T11:38:09.140315+0000","last_unstale":"2023-10-09T11:38:09.140850+0000","last_undegraded":"2023-10-09T11:38:09.140850+0000","last_fullsized":"2023-10-09T11:38:09.140850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145219+0000","last_change":"2023-10-09T11:38:09.145157+0000","last_active":"2023-10-09T11:38:09.145219+0000","last_peered":"2023-10-09T11:38:09.145219+0000","last_clean":"2023-10-09T11:38:09.145219+0000","last_became_active":"2023-10-09T11:38:09.143480+0000","last_became_peered":"2023-10-09T11:38:09.143480+0000","last_unstale":"2023-10-09T11:38:09.145219+0000","last_undegraded":"2023-10-09T11:38:09.145219+0000","last_fullsized":"2023-10-09T11:38:09.145219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:36:24.121679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143001+0000","last_change":"2023-10-09T11:38:09.142939+0000","last_active":"2023-10-09T11:38:09.143001+0000","last_peered":"2023-10-09T11:38:09.143001+0000","last_clean":"2023-10-09T11:38:09.143001+0000","last_became_active":"2023-10-09T11:38:09.142688+0000","last_became_peered":"2023-10-09T11:38:09.142688+0000","last_unstale":"2023-10-09T11:38:09.143001+0000","last_undegraded":"2023-10-09T11:38:09.143001+0000","last_fullsized":"2023-10-09T11:38:09.143001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139148+0000","last_change":"2023-10-09T11:38:09.139078+0000","last_active":"2023-10-09T11:38:09.139148+0000","last_peered":"2023-10-09T11:38:09.139148+0000","last_clean":"2023-10-09T11:38:09.139148+0000","last_became_active":"2023-10-09T11:38:09.138833+0000","last_became_peered":"2023-10-09T11:38:09.138833+0000","last_unstale":"2023-10-09T11:38:09.139148+0000","last_undegraded":"2023-10-09T11:38:09.139148+0000","last_fullsized":"2023-10-09T11:38:09.139148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:30.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141638+0000","last_change":"2023-10-09T11:38:09.141573+0000","last_active":"2023-10-09T11:38:09.141638+0000","last_peered":"2023-10-09T11:38:09.141638+0000","last_clean":"2023-10-09T11:38:09.141638+0000","last_became_active":"2023-10-09T11:38:09.141344+0000","last_became_peered":"2023-10-09T11:38:09.141344+0000","last_unstale":"2023-10-09T11:38:09.141638+0000","last_undegraded":"2023-10-09T11:38:09.141638+0000","last_fullsized":"2023-10-09T11:38:09.141638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:44.046697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155337+0000","last_change":"2023-10-09T11:38:09.155267+0000","last_active":"2023-10-09T11:38:09.155337+0000","last_peered":"2023-10-09T11:38:09.155337+0000","last_clean":"2023-10-09T11:38:09.155337+0000","last_became_active":"2023-10-09T11:38:09.155037+0000","last_became_peered":"2023-10-09T11:38:09.155037+0000","last_unstale":"2023-10-09T11:38:09.155337+0000","last_undegraded":"2023-10-09T11:38:09.155337+0000","last_fullsized":"2023-10-09T11:38:09.155337+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145349+0000","last_change":"2023-10-09T11:38:09.145297+0000","last_active":"2023-10-09T11:38:09.145349+0000","last_peered":"2023-10-09T11:38:09.145349+0000","last_clean":"2023-10-09T11:38:09.145349+0000","last_became_active":"2023-10-09T11:38:09.143816+0000","last_became_peered":"2023-10-09T11:38:09.143816+0000","last_unstale":"2023-10-09T11:38:09.145349+0000","last_undegraded":"2023-10-09T11:38:09.145349+0000","last_fullsized":"2023-10-09T11:38:09.145349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:24.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139353+0000","last_change":"2023-10-09T11:38:09.139252+0000","last_active":"2023-10-09T11:38:09.139353+0000","last_peered":"2023-10-09T11:38:09.139353+0000","last_clean":"2023-10-09T11:38:09.139353+0000","last_became_active":"2023-10-09T11:38:09.138738+0000","last_became_peered":"2023-10-09T11:38:09.138738+0000","last_unstale":"2023-10-09T11:38:09.139353+0000","last_undegraded":"2023-10-09T11:38:09.139353+0000","last_fullsized":"2023-10-09T11:38:09.139353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141382+0000","last_change":"2023-10-09T11:38:09.141286+0000","last_active":"2023-10-09T11:38:09.141382+0000","last_peered":"2023-10-09T11:38:09.141382+0000","last_clean":"2023-10-09T11:38:09.141382+0000","last_became_active":"2023-10-09T11:38:09.141113+0000","last_became_peered":"2023-10-09T11:38:09.141113+0000","last_unstale":"2023-10-09T11:38:09.141382+0000","last_undegraded":"2023-10-09T11:38:09.141382+0000","last_fullsized":"2023-10-09T11:38:09.141382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140988+0000","last_change":"2023-10-09T11:38:09.140923+0000","last_active":"2023-10-09T11:38:09.140988+0000","last_peered":"2023-10-09T11:38:09.140988+0000","last_clean":"2023-10-09T11:38:09.140988+0000","last_became_active":"2023-10-09T11:38:09.140676+0000","last_became_peered":"2023-10-09T11:38:09.140676+0000","last_unstale":"2023-10-09T11:38:09.140988+0000","last_undegraded":"2023-10-09T11:38:09.140988+0000","last_fullsized":"2023-10-09T11:38:09.140988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:26.771963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157301+0000","last_change":"2023-10-09T11:38:09.155745+0000","last_active":"2023-10-09T11:38:09.157301+0000","last_peered":"2023-10-09T11:38:09.157301+0000","last_clean":"2023-10-09T11:38:09.157301+0000","last_became_active":"2023-10-09T11:38:09.154170+0000","last_became_peered":"2023-10-09T11:38:09.154170+0000","last_unstale":"2023-10-09T11:38:09.157301+0000","last_undegraded":"2023-10-09T11:38:09.157301+0000","last_fullsized":"2023-10-09T11:38:09.157301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141398+0000","last_change":"2023-10-09T11:38:09.141331+0000","last_active":"2023-10-09T11:38:09.141398+0000","last_peered":"2023-10-09T11:38:09.141398+0000","last_clean":"2023-10-09T11:38:09.141398+0000","last_became_active":"2023-10-09T11:38:09.141092+0000","last_became_peered":"2023-10-09T11:38:09.141092+0000","last_unstale":"2023-10-09T11:38:09.141398+0000","last_undegraded":"2023-10-09T11:38:09.141398+0000","last_fullsized":"2023-10-09T11:38:09.141398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:22.846973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155535+0000","last_change":"2023-10-09T11:38:09.155482+0000","last_active":"2023-10-09T11:38:09.155535+0000","last_peered":"2023-10-09T11:38:09.155535+0000","last_clean":"2023-10-09T11:38:09.155535+0000","last_became_active":"2023-10-09T11:38:09.155262+0000","last_became_peered":"2023-10-09T11:38:09.155262+0000","last_unstale":"2023-10-09T11:38:09.155535+0000","last_undegraded":"2023-10-09T11:38:09.155535+0000","last_fullsized":"2023-10-09T11:38:09.155535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:14.606435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156266+0000","last_change":"2023-10-09T11:38:09.156219+0000","last_active":"2023-10-09T11:38:09.156266+0000","last_peered":"2023-10-09T11:38:09.156266+0000","last_clean":"2023-10-09T11:38:09.156266+0000","last_became_active":"2023-10-09T11:38:09.156023+0000","last_became_peered":"2023-10-09T11:38:09.156023+0000","last_unstale":"2023-10-09T11:38:09.156266+0000","last_undegraded":"2023-10-09T11:38:09.156266+0000","last_fullsized":"2023-10-09T11:38:09.156266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:15.929492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138967+0000","last_change":"2023-10-09T11:38:09.138890+0000","last_active":"2023-10-09T11:38:09.138967+0000","last_peered":"2023-10-09T11:38:09.138967+0000","last_clean":"2023-10-09T11:38:09.138967+0000","last_became_active":"2023-10-09T11:38:09.138543+0000","last_became_peered":"2023-10-09T11:38:09.138543+0000","last_unstale":"2023-10-09T11:38:09.138967+0000","last_undegraded":"2023-10-09T11:38:09.138967+0000","last_fullsized":"2023-10-09T11:38:09.138967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140043+0000","last_change":"2023-10-09T11:38:09.139971+0000","last_active":"2023-10-09T11:38:09.140043+0000","last_peered":"2023-10-09T11:38:09.140043+0000","last_clean":"2023-10-09T11:38:09.140043+0000","last_became_active":"2023-10-09T11:38:09.139690+0000","last_became_peered":"2023-10-09T11:38:09.139690+0000","last_unstale":"2023-10-09T11:38:09.140043+0000","last_undegraded":"2023-10-09T11:38:09.140043+0000","last_fullsized":"2023-10-09T11:38:09.140043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:39.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143479+0000","last_change":"2023-10-09T11:38:09.143417+0000","last_active":"2023-10-09T11:38:09.143479+0000","last_peered":"2023-10-09T11:38:09.143479+0000","last_clean":"2023-10-09T11:38:09.143479+0000","last_became_active":"2023-10-09T11:38:09.143222+0000","last_became_peered":"2023-10-09T11:38:09.143222+0000","last_unstale":"2023-10-09T11:38:09.143479+0000","last_undegraded":"2023-10-09T11:38:09.143479+0000","last_fullsized":"2023-10-09T11:38:09.143479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140870+0000","last_change":"2023-10-09T11:38:09.140810+0000","last_active":"2023-10-09T11:38:09.140870+0000","last_peered":"2023-10-09T11:38:09.140870+0000","last_clean":"2023-10-09T11:38:09.140870+0000","last_became_active":"2023-10-09T11:38:09.140518+0000","last_became_peered":"2023-10-09T11:38:09.140518+0000","last_unstale":"2023-10-09T11:38:09.140870+0000","last_undegraded":"2023-10-09T11:38:09.140870+0000","last_fullsized":"2023-10-09T11:38:09.140870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156320+0000","last_change":"2023-10-09T11:38:08.121558+0000","last_active":"2023-10-09T11:38:09.156320+0000","last_peered":"2023-10-09T11:38:09.156320+0000","last_clean":"2023-10-09T11:38:09.156320+0000","last_became_active":"2023-10-09T11:38:08.121326+0000","last_became_peered":"2023-10-09T11:38:08.121326+0000","last_unstale":"2023-10-09T11:38:09.156320+0000","last_undegraded":"2023-10-09T11:38:09.156320+0000","last_fullsized":"2023-10-09T11:38:09.156320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:13.687452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139213+0000","last_change":"2023-10-09T11:38:09.137856+0000","last_active":"2023-10-09T11:38:09.139213+0000","last_peered":"2023-10-09T11:38:09.139213+0000","last_clean":"2023-10-09T11:38:09.139213+0000","last_became_active":"2023-10-09T11:38:09.137619+0000","last_became_peered":"2023-10-09T11:38:09.137619+0000","last_unstale":"2023-10-09T11:38:09.139213+0000","last_undegraded":"2023-10-09T11:38:09.139213+0000","last_fullsized":"2023-10-09T11:38:09.139213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155694+0000","last_change":"2023-10-09T11:38:08.123551+0000","last_active":"2023-10-09T11:38:09.155694+0000","last_peered":"2023-10-09T11:38:09.155694+0000","last_clean":"2023-10-09T11:38:09.155694+0000","last_became_active":"2023-10-09T11:38:08.123280+0000","last_became_peered":"2023-10-09T11:38:08.123280+0000","last_unstale":"2023-10-09T11:38:09.155694+0000","last_undegraded":"2023-10-09T11:38:09.155694+0000","last_fullsized":"2023-10-09T11:38:09.155694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:16.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143274+0000","last_change":"2023-10-09T11:38:09.143157+0000","last_active":"2023-10-09T11:38:09.143274+0000","last_peered":"2023-10-09T11:38:09.143274+0000","last_clean":"2023-10-09T11:38:09.143274+0000","last_became_active":"2023-10-09T11:38:09.142710+0000","last_became_peered":"2023-10-09T11:38:09.142710+0000","last_unstale":"2023-10-09T11:38:09.143274+0000","last_undegraded":"2023-10-09T11:38:09.143274+0000","last_fullsized":"2023-10-09T11:38:09.143274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.151928+0000","last_change":"2023-10-09T11:38:08.120970+0000","last_active":"2023-10-09T11:38:09.151928+0000","last_peered":"2023-10-09T11:38:09.151928+0000","last_clean":"2023-10-09T11:38:09.151928+0000","last_became_active":"2023-10-09T11:38:08.120732+0000","last_became_peered":"2023-10-09T11:38:08.120732+0000","last_unstale":"2023-10-09T11:38:09.151928+0000","last_undegraded":"2023-10-09T11:38:09.151928+0000","last_fullsized":"2023-10-09T11:38:09.151928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:48.609903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155360+0000","last_change":"2023-10-09T11:38:09.154796+0000","last_active":"2023-10-09T11:38:09.155360+0000","last_peered":"2023-10-09T11:38:09.155360+0000","last_clean":"2023-10-09T11:38:09.155360+0000","last_became_active":"2023-10-09T11:38:09.154565+0000","last_became_peered":"2023-10-09T11:38:09.154565+0000","last_unstale":"2023-10-09T11:38:09.155360+0000","last_undegraded":"2023-10-09T11:38:09.155360+0000","last_fullsized":"2023-10-09T11:38:09.155360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157426+0000","last_change":"2023-10-09T11:38:08.126143+0000","last_active":"2023-10-09T11:38:09.157426+0000","last_peered":"2023-10-09T11:38:09.157426+0000","last_clean":"2023-10-09T11:38:09.157426+0000","last_became_active":"2023-10-09T11:38:08.125591+0000","last_became_peered":"2023-10-09T11:38:08.125591+0000","last_unstale":"2023-10-09T11:38:09.157426+0000","last_undegraded":"2023-10-09T11:38:09.157426+0000","last_fullsized":"2023-10-09T11:38:09.157426+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143955+0000","last_change":"2023-10-09T11:38:09.143746+0000","last_active":"2023-10-09T11:38:09.143955+0000","last_peered":"2023-10-09T11:38:09.143955+0000","last_clean":"2023-10-09T11:38:09.143955+0000","last_became_active":"2023-10-09T11:38:09.143078+0000","last_became_peered":"2023-10-09T11:38:09.143078+0000","last_unstale":"2023-10-09T11:38:09.143955+0000","last_undegraded":"2023-10-09T11:38:09.143955+0000","last_fullsized":"2023-10-09T11:38:09.143955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152028+0000","last_change":"2023-10-09T11:38:08.120519+0000","last_active":"2023-10-09T11:38:09.152028+0000","last_peered":"2023-10-09T11:38:09.152028+0000","last_clean":"2023-10-09T11:38:09.152028+0000","last_became_active":"2023-10-09T11:38:08.119222+0000","last_became_peered":"2023-10-09T11:38:08.119222+0000","last_unstale":"2023-10-09T11:38:09.152028+0000","last_undegraded":"2023-10-09T11:38:09.152028+0000","last_fullsized":"2023-10-09T11:38:09.152028+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:42.367733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145064+0000","last_change":"2023-10-09T11:38:09.144993+0000","last_active":"2023-10-09T11:38:09.145064+0000","last_peered":"2023-10-09T11:38:09.145064+0000","last_clean":"2023-10-09T11:38:09.145064+0000","last_became_active":"2023-10-09T11:38:09.143156+0000","last_became_peered":"2023-10-09T11:38:09.143156+0000","last_unstale":"2023-10-09T11:38:09.145064+0000","last_undegraded":"2023-10-09T11:38:09.145064+0000","last_fullsized":"2023-10-09T11:38:09.145064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:13.652971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154058+0000","last_change":"2023-10-09T11:38:08.130013+0000","last_active":"2023-10-09T11:38:09.154058+0000","last_peered":"2023-10-09T11:38:09.154058+0000","last_clean":"2023-10-09T11:38:09.154058+0000","last_became_active":"2023-10-09T11:38:08.127795+0000","last_became_peered":"2023-10-09T11:38:08.127795+0000","last_unstale":"2023-10-09T11:38:09.154058+0000","last_undegraded":"2023-10-09T11:38:09.154058+0000","last_fullsized":"2023-10-09T11:38:09.154058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:38.203183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.136657+0000","last_change":"2023-10-09T11:38:09.136519+0000","last_active":"2023-10-09T11:38:09.136657+0000","last_peered":"2023-10-09T11:38:09.136657+0000","last_clean":"2023-10-09T11:38:09.136657+0000","last_became_active":"2023-10-09T11:38:09.135870+0000","last_became_peered":"2023-10-09T11:38:09.135870+0000","last_unstale":"2023-10-09T11:38:09.136657+0000","last_undegraded":"2023-10-09T11:38:09.136657+0000","last_fullsized":"2023-10-09T11:38:09.136657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130702+0000","last_change":"2023-10-09T11:38:08.124333+0000","last_active":"2023-10-09T11:38:09.130702+0000","last_peered":"2023-10-09T11:38:09.130702+0000","last_clean":"2023-10-09T11:38:09.130702+0000","last_became_active":"2023-10-09T11:38:08.123845+0000","last_became_peered":"2023-10-09T11:38:08.123845+0000","last_unstale":"2023-10-09T11:38:09.130702+0000","last_undegraded":"2023-10-09T11:38:09.130702+0000","last_fullsized":"2023-10-09T11:38:09.130702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:06.635221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138507+0000","last_change":"2023-10-09T11:38:09.138439+0000","last_active":"2023-10-09T11:38:09.138507+0000","last_peered":"2023-10-09T11:38:09.138507+0000","last_clean":"2023-10-09T11:38:09.138507+0000","last_became_active":"2023-10-09T11:38:09.138191+0000","last_became_peered":"2023-10-09T11:38:09.138191+0000","last_unstale":"2023-10-09T11:38:09.138507+0000","last_undegraded":"2023-10-09T11:38:09.138507+0000","last_fullsized":"2023-10-09T11:38:09.138507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:20.648735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130806+0000","last_change":"2023-10-09T11:38:08.120586+0000","last_active":"2023-10-09T11:38:09.130806+0000","last_peered":"2023-10-09T11:38:09.130806+0000","last_clean":"2023-10-09T11:38:09.130806+0000","last_became_active":"2023-10-09T11:38:08.118863+0000","last_became_peered":"2023-10-09T11:38:08.118863+0000","last_unstale":"2023-10-09T11:38:09.130806+0000","last_undegraded":"2023-10-09T11:38:09.130806+0000","last_fullsized":"2023-10-09T11:38:09.130806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:26.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138736+0000","last_change":"2023-10-09T11:38:09.136870+0000","last_active":"2023-10-09T11:38:09.138736+0000","last_peered":"2023-10-09T11:38:09.138736+0000","last_clean":"2023-10-09T11:38:09.138736+0000","last_became_active":"2023-10-09T11:38:09.136654+0000","last_became_peered":"2023-10-09T11:38:09.136654+0000","last_unstale":"2023-10-09T11:38:09.138736+0000","last_undegraded":"2023-10-09T11:38:09.138736+0000","last_fullsized":"2023-10-09T11:38:09.138736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:16.351410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135676+0000","last_change":"2023-10-09T11:38:08.128371+0000","last_active":"2023-10-09T11:38:09.135676+0000","last_peered":"2023-10-09T11:38:09.135676+0000","last_clean":"2023-10-09T11:38:09.135676+0000","last_became_active":"2023-10-09T11:38:08.128200+0000","last_became_peered":"2023-10-09T11:38:08.128200+0000","last_unstale":"2023-10-09T11:38:09.135676+0000","last_undegraded":"2023-10-09T11:38:09.135676+0000","last_fullsized":"2023-10-09T11:38:09.135676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:03.112765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141065+0000","last_change":"2023-10-09T11:38:09.140992+0000","last_active":"2023-10-09T11:38:09.141065+0000","last_peered":"2023-10-09T11:38:09.141065+0000","last_clean":"2023-10-09T11:38:09.141065+0000","last_became_active":"2023-10-09T11:38:09.140544+0000","last_became_peered":"2023-10-09T11:38:09.140544+0000","last_unstale":"2023-10-09T11:38:09.141065+0000","last_undegraded":"2023-10-09T11:38:09.141065+0000","last_fullsized":"2023-10-09T11:38:09.141065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140712+0000","last_change":"2023-10-09T11:38:08.119440+0000","last_active":"2023-10-09T11:38:09.140712+0000","last_peered":"2023-10-09T11:38:09.140712+0000","last_clean":"2023-10-09T11:38:09.140712+0000","last_became_active":"2023-10-09T11:38:08.118785+0000","last_became_peered":"2023-10-09T11:38:08.118785+0000","last_unstale":"2023-10-09T11:38:09.140712+0000","last_undegraded":"2023-10-09T11:38:09.140712+0000","last_fullsized":"2023-10-09T11:38:09.140712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:19.999091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141946+0000","last_change":"2023-10-09T11:38:09.141883+0000","last_active":"2023-10-09T11:38:09.141946+0000","last_peered":"2023-10-09T11:38:09.141946+0000","last_clean":"2023-10-09T11:38:09.141946+0000","last_became_active":"2023-10-09T11:38:09.141609+0000","last_became_peered":"2023-10-09T11:38:09.141609+0000","last_unstale":"2023-10-09T11:38:09.141946+0000","last_undegraded":"2023-10-09T11:38:09.141946+0000","last_fullsized":"2023-10-09T11:38:09.141946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:27.370911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156633+0000","last_change":"2023-10-09T11:38:08.125842+0000","last_active":"2023-10-09T11:38:09.156633+0000","last_peered":"2023-10-09T11:38:09.156633+0000","last_clean":"2023-10-09T11:38:09.156633+0000","last_became_active":"2023-10-09T11:38:08.125625+0000","last_became_peered":"2023-10-09T11:38:08.125625+0000","last_unstale":"2023-10-09T11:38:09.156633+0000","last_undegraded":"2023-10-09T11:38:09.156633+0000","last_fullsized":"2023-10-09T11:38:09.156633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:14.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.136724+0000","last_change":"2023-10-09T11:38:09.136505+0000","last_active":"2023-10-09T11:38:09.136724+0000","last_peered":"2023-10-09T11:38:09.136724+0000","last_clean":"2023-10-09T11:38:09.136724+0000","last_became_active":"2023-10-09T11:38:09.136294+0000","last_became_peered":"2023-10-09T11:38:09.136294+0000","last_unstale":"2023-10-09T11:38:09.136724+0000","last_undegraded":"2023-10-09T11:38:09.136724+0000","last_fullsized":"2023-10-09T11:38:09.136724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156197+0000","last_change":"2023-10-09T11:38:08.122307+0000","last_active":"2023-10-09T11:38:09.156197+0000","last_peered":"2023-10-09T11:38:09.156197+0000","last_clean":"2023-10-09T11:38:09.156197+0000","last_became_active":"2023-10-09T11:38:08.121878+0000","last_became_peered":"2023-10-09T11:38:08.121878+0000","last_unstale":"2023-10-09T11:38:09.156197+0000","last_undegraded":"2023-10-09T11:38:09.156197+0000","last_fullsized":"2023-10-09T11:38:09.156197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:38.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157311+0000","last_change":"2023-10-09T11:38:09.155895+0000","last_active":"2023-10-09T11:38:09.157311+0000","last_peered":"2023-10-09T11:38:09.157311+0000","last_clean":"2023-10-09T11:38:09.157311+0000","last_became_active":"2023-10-09T11:38:09.154463+0000","last_became_peered":"2023-10-09T11:38:09.154463+0000","last_unstale":"2023-10-09T11:38:09.157311+0000","last_undegraded":"2023-10-09T11:38:09.157311+0000","last_fullsized":"2023-10-09T11:38:09.157311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153666+0000","last_change":"2023-10-09T11:38:08.121642+0000","last_active":"2023-10-09T11:38:09.153666+0000","last_peered":"2023-10-09T11:38:09.153666+0000","last_clean":"2023-10-09T11:38:09.153666+0000","last_became_active":"2023-10-09T11:38:08.121191+0000","last_became_peered":"2023-10-09T11:38:08.121191+0000","last_unstale":"2023-10-09T11:38:09.153666+0000","last_undegraded":"2023-10-09T11:38:09.153666+0000","last_fullsized":"2023-10-09T11:38:09.153666+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138867+0000","last_change":"2023-10-09T11:38:09.138753+0000","last_active":"2023-10-09T11:38:09.138867+0000","last_peered":"2023-10-09T11:38:09.138867+0000","last_clean":"2023-10-09T11:38:09.138867+0000","last_became_active":"2023-10-09T11:38:09.138188+0000","last_became_peered":"2023-10-09T11:38:09.138188+0000","last_unstale":"2023-10-09T11:38:09.138867+0000","last_undegraded":"2023-10-09T11:38:09.138867+0000","last_fullsized":"2023-10-09T11:38:09.138867+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:22.846973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.133826+0000","last_change":"2023-10-09T11:38:08.124204+0000","last_active":"2023-10-09T11:38:09.133826+0000","last_peered":"2023-10-09T11:38:09.133826+0000","last_clean":"2023-10-09T11:38:09.133826+0000","last_became_active":"2023-10-09T11:38:08.123982+0000","last_became_peered":"2023-10-09T11:38:08.123982+0000","last_unstale":"2023-10-09T11:38:09.133826+0000","last_undegraded":"2023-10-09T11:38:09.133826+0000","last_fullsized":"2023-10-09T11:38:09.133826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.429221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138715+0000","last_change":"2023-10-09T11:38:09.136653+0000","last_active":"2023-10-09T11:38:09.138715+0000","last_peered":"2023-10-09T11:38:09.138715+0000","last_clean":"2023-10-09T11:38:09.138715+0000","last_became_active":"2023-10-09T11:38:09.136406+0000","last_became_peered":"2023-10-09T11:38:09.136406+0000","last_unstale":"2023-10-09T11:38:09.138715+0000","last_undegraded":"2023-10-09T11:38:09.138715+0000","last_fullsized":"2023-10-09T11:38:09.138715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130397+0000","last_change":"2023-10-09T11:38:08.122905+0000","last_active":"2023-10-09T11:38:09.130397+0000","last_peered":"2023-10-09T11:38:09.130397+0000","last_clean":"2023-10-09T11:38:09.130397+0000","last_became_active":"2023-10-09T11:38:08.122688+0000","last_became_peered":"2023-10-09T11:38:08.122688+0000","last_unstale":"2023-10-09T11:38:09.130397+0000","last_undegraded":"2023-10-09T11:38:09.130397+0000","last_fullsized":"2023-10-09T11:38:09.130397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:26.466209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145129+0000","last_change":"2023-10-09T11:38:09.145081+0000","last_active":"2023-10-09T11:38:09.145129+0000","last_peered":"2023-10-09T11:38:09.145129+0000","last_clean":"2023-10-09T11:38:09.145129+0000","last_became_active":"2023-10-09T11:38:09.144900+0000","last_became_peered":"2023-10-09T11:38:09.144900+0000","last_unstale":"2023-10-09T11:38:09.145129+0000","last_undegraded":"2023-10-09T11:38:09.145129+0000","last_fullsized":"2023-10-09T11:38:09.145129+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157350+0000","last_change":"2023-10-09T11:38:08.126492+0000","last_active":"2023-10-09T11:38:09.157350+0000","last_peered":"2023-10-09T11:38:09.157350+0000","last_clean":"2023-10-09T11:38:09.157350+0000","last_became_active":"2023-10-09T11:38:08.126269+0000","last_became_peered":"2023-10-09T11:38:08.126269+0000","last_unstale":"2023-10-09T11:38:09.157350+0000","last_undegraded":"2023-10-09T11:38:09.157350+0000","last_fullsized":"2023-10-09T11:38:09.157350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:33.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140280+0000","last_change":"2023-10-09T11:38:09.140216+0000","last_active":"2023-10-09T11:38:09.140280+0000","last_peered":"2023-10-09T11:38:09.140280+0000","last_clean":"2023-10-09T11:38:09.140280+0000","last_became_active":"2023-10-09T11:38:09.140011+0000","last_became_peered":"2023-10-09T11:38:09.140011+0000","last_unstale":"2023-10-09T11:38:09.140280+0000","last_undegraded":"2023-10-09T11:38:09.140280+0000","last_fullsized":"2023-10-09T11:38:09.140280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153483+0000","last_change":"2023-10-09T11:38:08.121124+0000","last_active":"2023-10-09T11:38:09.153483+0000","last_peered":"2023-10-09T11:38:09.153483+0000","last_clean":"2023-10-09T11:38:09.153483+0000","last_became_active":"2023-10-09T11:38:08.120736+0000","last_became_peered":"2023-10-09T11:38:08.120736+0000","last_unstale":"2023-10-09T11:38:09.153483+0000","last_undegraded":"2023-10-09T11:38:09.153483+0000","last_fullsized":"2023-10-09T11:38:09.153483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:21.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154131+0000","last_change":"2023-10-09T11:38:09.152824+0000","last_active":"2023-10-09T11:38:09.154131+0000","last_peered":"2023-10-09T11:38:09.154131+0000","last_clean":"2023-10-09T11:38:09.154131+0000","last_became_active":"2023-10-09T11:38:09.150064+0000","last_became_peered":"2023-10-09T11:38:09.150064+0000","last_unstale":"2023-10-09T11:38:09.154131+0000","last_undegraded":"2023-10-09T11:38:09.154131+0000","last_fullsized":"2023-10-09T11:38:09.154131+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152142+0000","last_change":"2023-10-09T11:38:08.127739+0000","last_active":"2023-10-09T11:38:09.152142+0000","last_peered":"2023-10-09T11:38:09.152142+0000","last_clean":"2023-10-09T11:38:09.152142+0000","last_became_active":"2023-10-09T11:38:08.125352+0000","last_became_peered":"2023-10-09T11:38:08.125352+0000","last_unstale":"2023-10-09T11:38:09.152142+0000","last_undegraded":"2023-10-09T11:38:09.152142+0000","last_fullsized":"2023-10-09T11:38:09.152142+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:46.571090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145533+0000","last_change":"2023-10-09T11:38:09.145473+0000","last_active":"2023-10-09T11:38:09.145533+0000","last_peered":"2023-10-09T11:38:09.145533+0000","last_clean":"2023-10-09T11:38:09.145533+0000","last_became_active":"2023-10-09T11:38:09.144119+0000","last_became_peered":"2023-10-09T11:38:09.144119+0000","last_unstale":"2023-10-09T11:38:09.145533+0000","last_undegraded":"2023-10-09T11:38:09.145533+0000","last_fullsized":"2023-10-09T11:38:09.145533+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:27.980745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157571+0000","last_change":"2023-10-09T11:38:08.126009+0000","last_active":"2023-10-09T11:38:09.157571+0000","last_peered":"2023-10-09T11:38:09.157571+0000","last_clean":"2023-10-09T11:38:09.157571+0000","last_became_active":"2023-10-09T11:38:08.125269+0000","last_became_peered":"2023-10-09T11:38:08.125269+0000","last_unstale":"2023-10-09T11:38:09.157571+0000","last_undegraded":"2023-10-09T11:38:09.157571+0000","last_fullsized":"2023-10-09T11:38:09.157571+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:38.552189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141230+0000","last_change":"2023-10-09T11:38:09.141147+0000","last_active":"2023-10-09T11:38:09.141230+0000","last_peered":"2023-10-09T11:38:09.141230+0000","last_clean":"2023-10-09T11:38:09.141230+0000","last_became_active":"2023-10-09T11:38:09.140791+0000","last_became_peered":"2023-10-09T11:38:09.140791+0000","last_unstale":"2023-10-09T11:38:09.141230+0000","last_undegraded":"2023-10-09T11:38:09.141230+0000","last_fullsized":"2023-10-09T11:38:09.141230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135053+0000","last_change":"2023-10-09T11:38:08.128582+0000","last_active":"2023-10-09T11:38:09.135053+0000","last_peered":"2023-10-09T11:38:09.135053+0000","last_clean":"2023-10-09T11:38:09.135053+0000","last_became_active":"2023-10-09T11:38:08.128317+0000","last_became_peered":"2023-10-09T11:38:08.128317+0000","last_unstale":"2023-10-09T11:38:09.135053+0000","last_undegraded":"2023-10-09T11:38:09.135053+0000","last_fullsized":"2023-10-09T11:38:09.135053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:45.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154110+0000","last_change":"2023-10-09T11:38:09.152649+0000","last_active":"2023-10-09T11:38:09.154110+0000","last_peered":"2023-10-09T11:38:09.154110+0000","last_clean":"2023-10-09T11:38:09.154110+0000","last_became_active":"2023-10-09T11:38:09.149758+0000","last_became_peered":"2023-10-09T11:38:09.149758+0000","last_unstale":"2023-10-09T11:38:09.154110+0000","last_undegraded":"2023-10-09T11:38:09.154110+0000","last_fullsized":"2023-10-09T11:38:09.154110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153652+0000","last_change":"2023-10-09T11:38:08.118845+0000","last_active":"2023-10-09T11:38:09.153652+0000","last_peered":"2023-10-09T11:38:09.153652+0000","last_clean":"2023-10-09T11:38:09.153652+0000","last_became_active":"2023-10-09T11:38:08.118600+0000","last_became_peered":"2023-10-09T11:38:08.118600+0000","last_unstale":"2023-10-09T11:38:09.153652+0000","last_undegraded":"2023-10-09T11:38:09.153652+0000","last_fullsized":"2023-10-09T11:38:09.153652+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141487+0000","last_change":"2023-10-09T11:38:09.141426+0000","last_active":"2023-10-09T11:38:09.141487+0000","last_peered":"2023-10-09T11:38:09.141487+0000","last_clean":"2023-10-09T11:38:09.141487+0000","last_became_active":"2023-10-09T11:38:09.141196+0000","last_became_peered":"2023-10-09T11:38:09.141196+0000","last_unstale":"2023-10-09T11:38:09.141487+0000","last_undegraded":"2023-10-09T11:38:09.141487+0000","last_fullsized":"2023-10-09T11:38:09.141487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135789+0000","last_change":"2023-10-09T11:38:08.124894+0000","last_active":"2023-10-09T11:38:09.135789+0000","last_peered":"2023-10-09T11:38:09.135789+0000","last_clean":"2023-10-09T11:38:09.135789+0000","last_became_active":"2023-10-09T11:38:08.124696+0000","last_became_peered":"2023-10-09T11:38:08.124696+0000","last_unstale":"2023-10-09T11:38:09.135789+0000","last_undegraded":"2023-10-09T11:38:09.135789+0000","last_fullsized":"2023-10-09T11:38:09.135789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:44.457144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140331+0000","last_change":"2023-10-09T11:38:09.139276+0000","last_active":"2023-10-09T11:38:09.140331+0000","last_peered":"2023-10-09T11:38:09.140331+0000","last_clean":"2023-10-09T11:38:09.140331+0000","last_became_active":"2023-10-09T11:38:09.139063+0000","last_became_peered":"2023-10-09T11:38:09.139063+0000","last_unstale":"2023-10-09T11:38:09.140331+0000","last_undegraded":"2023-10-09T11:38:09.140331+0000","last_fullsized":"2023-10-09T11:38:09.140331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.131036+0000","last_change":"2023-10-09T11:38:08.125827+0000","last_active":"2023-10-09T11:38:09.131036+0000","last_peered":"2023-10-09T11:38:09.131036+0000","last_clean":"2023-10-09T11:38:09.131036+0000","last_became_active":"2023-10-09T11:38:08.124960+0000","last_became_peered":"2023-10-09T11:38:08.124960+0000","last_unstale":"2023-10-09T11:38:09.131036+0000","last_undegraded":"2023-10-09T11:38:09.131036+0000","last_fullsized":"2023-10-09T11:38:09.131036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.709978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154009+0000","last_change":"2023-10-09T11:38:09.150414+0000","last_active":"2023-10-09T11:38:09.154009+0000","last_peered":"2023-10-09T11:38:09.154009+0000","last_clean":"2023-10-09T11:38:09.154009+0000","last_became_active":"2023-10-09T11:38:09.150211+0000","last_became_peered":"2023-10-09T11:38:09.150211+0000","last_unstale":"2023-10-09T11:38:09.154009+0000","last_undegraded":"2023-10-09T11:38:09.154009+0000","last_fullsized":"2023-10-09T11:38:09.154009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.151469+0000","last_change":"2023-10-09T11:38:08.121768+0000","last_active":"2023-10-09T11:38:09.151469+0000","last_peered":"2023-10-09T11:38:09.151469+0000","last_clean":"2023-10-09T11:38:09.151469+0000","last_became_active":"2023-10-09T11:38:08.121548+0000","last_became_peered":"2023-10-09T11:38:08.121548+0000","last_unstale":"2023-10-09T11:38:09.151469+0000","last_undegraded":"2023-10-09T11:38:09.151469+0000","last_fullsized":"2023-10-09T11:38:09.151469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:47.627153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154031+0000","last_change":"2023-10-09T11:38:09.151273+0000","last_active":"2023-10-09T11:38:09.154031+0000","last_peered":"2023-10-09T11:38:09.154031+0000","last_clean":"2023-10-09T11:38:09.154031+0000","last_became_active":"2023-10-09T11:38:09.149922+0000","last_became_peered":"2023-10-09T11:38:09.149922+0000","last_unstale":"2023-10-09T11:38:09.154031+0000","last_undegraded":"2023-10-09T11:38:09.154031+0000","last_fullsized":"2023-10-09T11:38:09.154031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134230+0000","last_change":"2023-10-09T11:38:08.130156+0000","last_active":"2023-10-09T11:38:09.134230+0000","last_peered":"2023-10-09T11:38:09.134230+0000","last_clean":"2023-10-09T11:38:09.134230+0000","last_became_active":"2023-10-09T11:38:08.129294+0000","last_became_peered":"2023-10-09T11:38:08.129294+0000","last_unstale":"2023-10-09T11:38:09.134230+0000","last_undegraded":"2023-10-09T11:38:09.134230+0000","last_fullsized":"2023-10-09T11:38:09.134230+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:53.065896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140348+0000","last_change":"2023-10-09T11:38:09.140231+0000","last_active":"2023-10-09T11:38:09.140348+0000","last_peered":"2023-10-09T11:38:09.140348+0000","last_clean":"2023-10-09T11:38:09.140348+0000","last_became_active":"2023-10-09T11:38:09.140018+0000","last_became_peered":"2023-10-09T11:38:09.140018+0000","last_unstale":"2023-10-09T11:38:09.140348+0000","last_undegraded":"2023-10-09T11:38:09.140348+0000","last_fullsized":"2023-10-09T11:38:09.140348+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134110+0000","last_change":"2023-10-09T11:38:08.125926+0000","last_active":"2023-10-09T11:38:09.134110+0000","last_peered":"2023-10-09T11:38:09.134110+0000","last_clean":"2023-10-09T11:38:09.134110+0000","last_became_active":"2023-10-09T11:38:08.125450+0000","last_became_peered":"2023-10-09T11:38:08.125450+0000","last_unstale":"2023-10-09T11:38:09.134110+0000","last_undegraded":"2023-10-09T11:38:09.134110+0000","last_fullsized":"2023-10-09T11:38:09.134110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:15.240866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155381+0000","last_change":"2023-10-09T11:38:09.155269+0000","last_active":"2023-10-09T11:38:09.155381+0000","last_peered":"2023-10-09T11:38:09.155381+0000","last_clean":"2023-10-09T11:38:09.155381+0000","last_became_active":"2023-10-09T11:38:09.155043+0000","last_became_peered":"2023-10-09T11:38:09.155043+0000","last_unstale":"2023-10-09T11:38:09.155381+0000","last_undegraded":"2023-10-09T11:38:09.155381+0000","last_fullsized":"2023-10-09T11:38:09.155381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.129660+0000","last_change":"2023-10-09T11:38:08.124884+0000","last_active":"2023-10-09T11:38:09.129660+0000","last_peered":"2023-10-09T11:38:09.129660+0000","last_clean":"2023-10-09T11:38:09.129660+0000","last_became_active":"2023-10-09T11:38:08.124634+0000","last_became_peered":"2023-10-09T11:38:08.124634+0000","last_unstale":"2023-10-09T11:38:09.129660+0000","last_undegraded":"2023-10-09T11:38:09.129660+0000","last_fullsized":"2023-10-09T11:38:09.129660+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145672+0000","last_change":"2023-10-09T11:38:09.145614+0000","last_active":"2023-10-09T11:38:09.145672+0000","last_peered":"2023-10-09T11:38:09.145672+0000","last_clean":"2023-10-09T11:38:09.145672+0000","last_became_active":"2023-10-09T11:38:09.144400+0000","last_became_peered":"2023-10-09T11:38:09.144400+0000","last_unstale":"2023-10-09T11:38:09.145672+0000","last_undegraded":"2023-10-09T11:38:09.145672+0000","last_fullsized":"2023-10-09T11:38:09.145672+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:24.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.137990+0000","last_change":"2023-10-09T11:38:08.121275+0000","last_active":"2023-10-09T11:38:09.137990+0000","last_peered":"2023-10-09T11:38:09.137990+0000","last_clean":"2023-10-09T11:38:09.137990+0000","last_became_active":"2023-10-09T11:38:08.121054+0000","last_became_peered":"2023-10-09T11:38:08.121054+0000","last_unstale":"2023-10-09T11:38:09.137990+0000","last_undegraded":"2023-10-09T11:38:09.137990+0000","last_fullsized":"2023-10-09T11:38:09.137990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.398915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143197+0000","last_change":"2023-10-09T11:38:09.143155+0000","last_active":"2023-10-09T11:38:09.143197+0000","last_peered":"2023-10-09T11:38:09.143197+0000","last_clean":"2023-10-09T11:38:09.143197+0000","last_became_active":"2023-10-09T11:38:09.143010+0000","last_became_peered":"2023-10-09T11:38:09.143010+0000","last_unstale":"2023-10-09T11:38:09.143197+0000","last_undegraded":"2023-10-09T11:38:09.143197+0000","last_fullsized":"2023-10-09T11:38:09.143197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.131141+0000","last_change":"2023-10-09T11:38:08.121672+0000","last_active":"2023-10-09T11:38:09.131141+0000","last_peered":"2023-10-09T11:38:09.131141+0000","last_clean":"2023-10-09T11:38:09.131141+0000","last_became_active":"2023-10-09T11:38:08.121445+0000","last_became_peered":"2023-10-09T11:38:08.121445+0000","last_unstale":"2023-10-09T11:38:09.131141+0000","last_undegraded":"2023-10-09T11:38:09.131141+0000","last_fullsized":"2023-10-09T11:38:09.131141+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:05.590480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139190+0000","last_change":"2023-10-09T11:38:09.137576+0000","last_active":"2023-10-09T11:38:09.139190+0000","last_peered":"2023-10-09T11:38:09.139190+0000","last_clean":"2023-10-09T11:38:09.139190+0000","last_became_active":"2023-10-09T11:38:09.137354+0000","last_became_peered":"2023-10-09T11:38:09.137354+0000","last_unstale":"2023-10-09T11:38:09.139190+0000","last_undegraded":"2023-10-09T11:38:09.139190+0000","last_fullsized":"2023-10-09T11:38:09.139190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:56.030836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134485+0000","last_change":"2023-10-09T11:38:08.122691+0000","last_active":"2023-10-09T11:38:09.134485+0000","last_peered":"2023-10-09T11:38:09.134485+0000","last_clean":"2023-10-09T11:38:09.134485+0000","last_became_active":"2023-10-09T11:38:08.122469+0000","last_became_peered":"2023-10-09T11:38:08.122469+0000","last_unstale":"2023-10-09T11:38:09.134485+0000","last_undegraded":"2023-10-09T11:38:09.134485+0000","last_fullsized":"2023-10-09T11:38:09.134485+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140837+0000","last_change":"2023-10-09T11:38:09.139759+0000","last_active":"2023-10-09T11:38:09.140837+0000","last_peered":"2023-10-09T11:38:09.140837+0000","last_clean":"2023-10-09T11:38:09.140837+0000","last_became_active":"2023-10-09T11:38:09.139574+0000","last_became_peered":"2023-10-09T11:38:09.139574+0000","last_unstale":"2023-10-09T11:38:09.140837+0000","last_undegraded":"2023-10-09T11:38:09.140837+0000","last_fullsized":"2023-10-09T11:38:09.140837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134819+0000","last_change":"2023-10-09T11:38:08.120979+0000","last_active":"2023-10-09T11:38:09.134819+0000","last_peered":"2023-10-09T11:38:09.134819+0000","last_clean":"2023-10-09T11:38:09.134819+0000","last_became_active":"2023-10-09T11:38:08.120404+0000","last_became_peered":"2023-10-09T11:38:08.120404+0000","last_unstale":"2023-10-09T11:38:09.134819+0000","last_undegraded":"2023-10-09T11:38:09.134819+0000","last_fullsized":"2023-10-09T11:38:09.134819+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143245+0000","last_change":"2023-10-09T11:38:09.142409+0000","last_active":"2023-10-09T11:38:09.143245+0000","last_peered":"2023-10-09T11:38:09.143245+0000","last_clean":"2023-10-09T11:38:09.143245+0000","last_became_active":"2023-10-09T11:38:09.142115+0000","last_became_peered":"2023-10-09T11:38:09.142115+0000","last_unstale":"2023-10-09T11:38:09.143245+0000","last_undegraded":"2023-10-09T11:38:09.143245+0000","last_fullsized":"2023-10-09T11:38:09.143245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.565978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134142+0000","last_change":"2023-10-09T11:38:08.123342+0000","last_active":"2023-10-09T11:38:09.134142+0000","last_peered":"2023-10-09T11:38:09.134142+0000","last_clean":"2023-10-09T11:38:09.134142+0000","last_became_active":"2023-10-09T11:38:08.123106+0000","last_became_peered":"2023-10-09T11:38:08.123106+0000","last_unstale":"2023-10-09T11:38:09.134142+0000","last_undegraded":"2023-10-09T11:38:09.134142+0000","last_fullsized":"2023-10-09T11:38:09.134142+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134430+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:38:09.134430+0000","last_peered":"2023-10-09T11:38:09.134430+0000","last_clean":"2023-10-09T11:38:09.134430+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:38:09.134430+0000","last_undegraded":"2023-10-09T11:38:09.134430+0000","last_fullsized":"2023-10-09T11:38:09.134430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":884,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194427,"statfs":{"total":200000000,"available":199093969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.048,"15min":1.048},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76400000000000001,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73599999999999999,"5min":5.298,"15min":5.298},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77000000000000002,"5min":1.617,"15min":1.617},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":5.46,"15min":5.46},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.60099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684407,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39900000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51100000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.315},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.51700000000000002,"5min":2.004,"15min":2.004},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.49099999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40500000000000003,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56299999999999994,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.61099999999999999,"5min":1.909,"15min":1.909},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":1.869,"15min":1.869},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":1.952,"15min":1.952},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":1.782,"15min":1.782},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78100000000000003,"5min":1.819,"15min":1.819},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":885,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194426,"statfs":{"total":200000000,"available":199093050,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46999999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.25}]},{"osd":2,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57599999999999996,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54500000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.502,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64800000000000002,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":1.282,"15min":1.282},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.71899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86699999999999999,"5min":3.976,"15min":3.976},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82099999999999995,"5min":1.524,"15min":1.524},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.254,"15min":1.254},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":1.22,"15min":1.22},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.499}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.311,"15min":0.307},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54300000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45300000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.85399999999999998,"15min":0.93100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58399999999999996,"5min":11.055,"15min":11.055},"last":0.307}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.32800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.626,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.44400000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.42499999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47899999999999998,"5min":1.034,"15min":1.034},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":1.335,"15min":1.335},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.26500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58399999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":1.405,"15min":1.405},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.167,"15min":1.167},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.624}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73299999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195002,"statfs":{"total":200000000,"available":199682961,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.77400000000000002,"15min":0.81299999999999994},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.82599999999999996,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70399999999999996,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":5.274,"15min":5.274},"last":0.626}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.82799999999999996,"15min":0.87},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.84099999999999997,"15min":0.89000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71999999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.499},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83399999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.629,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58399999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40999999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.435},{"interface":"front","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39800000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:38:17.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:38:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.955+0000 7f5c81656700 1 Processor -- start 2023-10-09T11:38:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.955+0000 7f5c81656700 1 -- start start 2023-10-09T11:38:17.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c81656700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5c7c0c3020 0x7f5c7c0ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c81656700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0c8e20 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c81656700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0c9100 con 0x7f5c7c068980 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c81656700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c1810 con 0x7f5c7c0c3020 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c7affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c7c0c6fc0 0x7f5c7c0c7390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60114/0 (socket says 172.21.15.6:60114) 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c7affd700 1 -- 172.21.15.6:0/1551923395 learned_addr learned my addr 172.21.15.6:0/1551923395 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c7b7fe700 1 --2- 172.21.15.6:0/1551923395 >> v2:172.21.15.118:3300/0 conn(0x7f5c7c0c3020 0x7f5c7c0ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997374070 0 0) 0x7f5c7c0c8e20 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c68003570 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677390025 0 0) 0x7f5c68003570 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 >> v2:172.21.15.118:3300/0 conn(0x7f5c7c0c3020 msgr2=0x7f5c7c0ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 --2- 172.21.15.6:0/1551923395 >> v2:172.21.15.118:3300/0 conn(0x7f5c7c0c3020 0x7f5c7c0ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 >> v1:172.21.15.118:6789/0 conn(0x7f5c7c068980 legacy=0x7f5c7c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0c1af0 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f5c6c0017f0 con 0x7f5c7c0c6fc0 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 >> v1:172.21.15.6:6789/0 conn(0x7f5c7c0c6fc0 legacy=0x7f5c7c0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c68003a60 0x7f5c68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c680051c0 0x7f5c6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c1810 con 0x7f5c68004810 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800c130 con 0x7f5c68003a60 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.956+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800c2f0 con 0x7f5c680051c0 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7affd700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c68003a60 0x7f5c68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7b7fe700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c680051c0 0x7f5c6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 -- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c680051c0 msgr2=0x7f5c6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c680051c0 0x7f5c6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 -- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c68003a60 msgr2=0x7f5c68003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c68003a60 0x7f5c68003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 -- 172.21.15.6:0/1551923395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68003570 con 0x7f5c68004810 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7b7fe700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c680051c0 0x7f5c6800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7b7fe700 1 -- 172.21.15.6:0/1551923395 reap_dead start 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c68004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c64001970 tx=0x7f5c64007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d27b880e12e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400c5d0 con 0x7f5c68004810 2023-10-09T11:38:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6400c730 con 0x7f5c68004810 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.957+0000 7f5c79ffb700 1 -- 172.21.15.6:0/1551923395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400cad0 con 0x7f5c68004810 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 -- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 msgr2=0x7f5c68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c68004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c64001970 tx=0x7f5c64007d10 comp rx=0 tx=0).stop 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 -- 172.21.15.6:0/1551923395 shutdown_connections 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 --2- 172.21.15.6:0/1551923395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c68004c80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 -- 172.21.15.6:0/1551923395 >> 172.21.15.6:0/1551923395 conn(0x7f5c7c06c660 msgr2=0x7f5c7c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 -- 172.21.15.6:0/1551923395 shutdown_connections 2023-10-09T11:38:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.958+0000 7f5c81656700 1 -- 172.21.15.6:0/1551923395 wait complete. 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.959+0000 7f5c81656700 1 Processor -- start 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.959+0000 7f5c81656700 1 -- start start 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 0x7f5c7c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 0x7f5c7c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c155030 con 0x7f5c68004810 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c5ad0 con 0x7f5c7c154680 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c81656700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c5d70 con 0x7f5c7c15acb0 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37228/0 (socket says 172.21.15.6:37228) 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 -- 172.21.15.6:0/1359059179 learned_addr learned my addr 172.21.15.6:0/1359059179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7b7fe700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 0x7f5c7c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 0x7f5c7c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 -- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 msgr2=0x7f5c7c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 0x7f5c7c0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 -- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 msgr2=0x7f5c7c154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 0x7f5c7c154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 -- 172.21.15.6:0/1359059179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0c6050 con 0x7f5c68004810 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7b7fe700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 0x7f5c7c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 0x7f5c7c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.960+0000 7f5c7affd700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c007a90 tx=0x7f5c6c002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.961+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00acc0 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.961+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c00ae20 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.961+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c013600 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.961+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c0c6330 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.961+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c0aefb0 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.962+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c0c6850 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.962+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c6c013a30 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.963+0000 7f5c72ffd700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.963+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c6c085290 con 0x7f5c68004810 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.963+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.963+0000 7f5c7a7fc700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 0x7f5c5c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c155540 tx=0x7f5c64015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:17.967+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c7c0c6850 con 0x7f5c68004810 2023-10-09T11:38:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.156+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c7c0c6850 con 0x7f5c5c066f30 2023-10-09T11:38:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.164+0000 7f5c72ffd700 1 -- 172.21.15.6:0/1359059179 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284658 (secure 0 0 0) 0x7f5c7c0c6850 con 0x7f5c5c066f30 2023-10-09T11:38:18.169 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 msgr2=0x7f5c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 0x7f5c5c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c155540 tx=0x7f5c64015000 comp rx=0 tx=0).stop 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 msgr2=0x7f5c7c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c007a90 tx=0x7f5c6c002120 comp rx=0 tx=0).stop 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 shutdown_connections 2023-10-09T11:38:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7c154680 0x7f5c7c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c68004810 0x7f5c7c1585f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 --2- 172.21.15.6:0/1359059179 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c7c15acb0 0x7f5c7c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.167+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 >> 172.21.15.6:0/1359059179 conn(0x7f5c7c06c660 msgr2=0x7f5c7c06ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.168+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 shutdown_connections 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.168+0000 7f5c81656700 1 -- 172.21.15.6:0/1359059179 wait complete. 2023-10-09T11:38:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:38:18.181 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2023-10-09T11:38:16.172391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558878,"statfs":{"total":1600000000,"available":1596291639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001537"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143326+0000","last_change":"2023-10-09T11:38:09.143265+0000","last_active":"2023-10-09T11:38:09.143326+0000","last_peered":"2023-10-09T11:38:09.143326+0000","last_clean":"2023-10-09T11:38:09.143326+0000","last_became_active":"2023-10-09T11:38:09.142867+0000","last_became_peered":"2023-10-09T11:38:09.142867+0000","last_unstale":"2023-10-09T11:38:09.143326+0000","last_undegraded":"2023-10-09T11:38:09.143326+0000","last_fullsized":"2023-10-09T11:38:09.143326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:56:57.704869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.146037+0000","last_change":"2023-10-09T11:38:09.145978+0000","last_active":"2023-10-09T11:38:09.146037+0000","last_peered":"2023-10-09T11:38:09.146037+0000","last_clean":"2023-10-09T11:38:09.146037+0000","last_became_active":"2023-10-09T11:38:09.144730+0000","last_became_peered":"2023-10-09T11:38:09.144730+0000","last_unstale":"2023-10-09T11:38:09.146037+0000","last_undegraded":"2023-10-09T11:38:09.146037+0000","last_fullsized":"2023-10-09T11:38:09.146037+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:47.339105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139166+0000","last_change":"2023-10-09T11:38:09.139099+0000","last_active":"2023-10-09T11:38:09.139166+0000","last_peered":"2023-10-09T11:38:09.139166+0000","last_clean":"2023-10-09T11:38:09.139166+0000","last_became_active":"2023-10-09T11:38:09.138383+0000","last_became_peered":"2023-10-09T11:38:09.138383+0000","last_unstale":"2023-10-09T11:38:09.139166+0000","last_undegraded":"2023-10-09T11:38:09.139166+0000","last_fullsized":"2023-10-09T11:38:09.139166+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154154+0000","last_change":"2023-10-09T11:38:09.152995+0000","last_active":"2023-10-09T11:38:09.154154+0000","last_peered":"2023-10-09T11:38:09.154154+0000","last_clean":"2023-10-09T11:38:09.154154+0000","last_became_active":"2023-10-09T11:38:09.152020+0000","last_became_peered":"2023-10-09T11:38:09.152020+0000","last_unstale":"2023-10-09T11:38:09.154154+0000","last_undegraded":"2023-10-09T11:38:09.154154+0000","last_fullsized":"2023-10-09T11:38:09.154154+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155505+0000","last_change":"2023-10-09T11:38:09.155443+0000","last_active":"2023-10-09T11:38:09.155505+0000","last_peered":"2023-10-09T11:38:09.155505+0000","last_clean":"2023-10-09T11:38:09.155505+0000","last_became_active":"2023-10-09T11:38:09.155199+0000","last_became_peered":"2023-10-09T11:38:09.155199+0000","last_unstale":"2023-10-09T11:38:09.155505+0000","last_undegraded":"2023-10-09T11:38:09.155505+0000","last_fullsized":"2023-10-09T11:38:09.155505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:30.354359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.142997+0000","last_change":"2023-10-09T11:38:09.142932+0000","last_active":"2023-10-09T11:38:09.142997+0000","last_peered":"2023-10-09T11:38:09.142997+0000","last_clean":"2023-10-09T11:38:09.142997+0000","last_became_active":"2023-10-09T11:38:09.142239+0000","last_became_peered":"2023-10-09T11:38:09.142239+0000","last_unstale":"2023-10-09T11:38:09.142997+0000","last_undegraded":"2023-10-09T11:38:09.142997+0000","last_fullsized":"2023-10-09T11:38:09.142997+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:06.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152939+0000","last_change":"2023-10-09T11:38:09.152635+0000","last_active":"2023-10-09T11:38:09.152939+0000","last_peered":"2023-10-09T11:38:09.152939+0000","last_clean":"2023-10-09T11:38:09.152939+0000","last_became_active":"2023-10-09T11:38:09.152421+0000","last_became_peered":"2023-10-09T11:38:09.152421+0000","last_unstale":"2023-10-09T11:38:09.152939+0000","last_undegraded":"2023-10-09T11:38:09.152939+0000","last_fullsized":"2023-10-09T11:38:09.152939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:34.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143972+0000","last_change":"2023-10-09T11:38:09.143898+0000","last_active":"2023-10-09T11:38:09.143972+0000","last_peered":"2023-10-09T11:38:09.143972+0000","last_clean":"2023-10-09T11:38:09.143972+0000","last_became_active":"2023-10-09T11:38:09.143410+0000","last_became_peered":"2023-10-09T11:38:09.143410+0000","last_unstale":"2023-10-09T11:38:09.143972+0000","last_undegraded":"2023-10-09T11:38:09.143972+0000","last_fullsized":"2023-10-09T11:38:09.143972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:16.755402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138774+0000","last_change":"2023-10-09T11:38:09.138084+0000","last_active":"2023-10-09T11:38:09.138774+0000","last_peered":"2023-10-09T11:38:09.138774+0000","last_clean":"2023-10-09T11:38:09.138774+0000","last_became_active":"2023-10-09T11:38:09.137850+0000","last_became_peered":"2023-10-09T11:38:09.137850+0000","last_unstale":"2023-10-09T11:38:09.138774+0000","last_undegraded":"2023-10-09T11:38:09.138774+0000","last_fullsized":"2023-10-09T11:38:09.138774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:15.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139234+0000","last_change":"2023-10-09T11:38:09.138060+0000","last_active":"2023-10-09T11:38:09.139234+0000","last_peered":"2023-10-09T11:38:09.139234+0000","last_clean":"2023-10-09T11:38:09.139234+0000","last_became_active":"2023-10-09T11:38:09.137829+0000","last_became_peered":"2023-10-09T11:38:09.137829+0000","last_unstale":"2023-10-09T11:38:09.139234+0000","last_undegraded":"2023-10-09T11:38:09.139234+0000","last_fullsized":"2023-10-09T11:38:09.139234+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:14.691191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.144550+0000","last_change":"2023-10-09T11:38:09.144485+0000","last_active":"2023-10-09T11:38:09.144550+0000","last_peered":"2023-10-09T11:38:09.144550+0000","last_clean":"2023-10-09T11:38:09.144550+0000","last_became_active":"2023-10-09T11:38:09.144078+0000","last_became_peered":"2023-10-09T11:38:09.144078+0000","last_unstale":"2023-10-09T11:38:09.144550+0000","last_undegraded":"2023-10-09T11:38:09.144550+0000","last_fullsized":"2023-10-09T11:38:09.144550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:39.497670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154049+0000","last_change":"2023-10-09T11:38:09.151392+0000","last_active":"2023-10-09T11:38:09.154049+0000","last_peered":"2023-10-09T11:38:09.154049+0000","last_clean":"2023-10-09T11:38:09.154049+0000","last_became_active":"2023-10-09T11:38:09.150373+0000","last_became_peered":"2023-10-09T11:38:09.150373+0000","last_unstale":"2023-10-09T11:38:09.154049+0000","last_undegraded":"2023-10-09T11:38:09.154049+0000","last_fullsized":"2023-10-09T11:38:09.154049+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141659+0000","last_change":"2023-10-09T11:38:09.141599+0000","last_active":"2023-10-09T11:38:09.141659+0000","last_peered":"2023-10-09T11:38:09.141659+0000","last_clean":"2023-10-09T11:38:09.141659+0000","last_became_active":"2023-10-09T11:38:09.141332+0000","last_became_peered":"2023-10-09T11:38:09.141332+0000","last_unstale":"2023-10-09T11:38:09.141659+0000","last_undegraded":"2023-10-09T11:38:09.141659+0000","last_fullsized":"2023-10-09T11:38:09.141659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:06.594219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.132926+0000","last_change":"2023-10-09T11:38:09.132806+0000","last_active":"2023-10-09T11:38:09.132926+0000","last_peered":"2023-10-09T11:38:09.132926+0000","last_clean":"2023-10-09T11:38:09.132926+0000","last_became_active":"2023-10-09T11:38:09.132547+0000","last_became_peered":"2023-10-09T11:38:09.132547+0000","last_unstale":"2023-10-09T11:38:09.132926+0000","last_undegraded":"2023-10-09T11:38:09.132926+0000","last_fullsized":"2023-10-09T11:38:09.132926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:04.116504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140181+0000","last_change":"2023-10-09T11:38:09.140119+0000","last_active":"2023-10-09T11:38:09.140181+0000","last_peered":"2023-10-09T11:38:09.140181+0000","last_clean":"2023-10-09T11:38:09.140181+0000","last_became_active":"2023-10-09T11:38:09.139800+0000","last_became_peered":"2023-10-09T11:38:09.139800+0000","last_unstale":"2023-10-09T11:38:09.140181+0000","last_undegraded":"2023-10-09T11:38:09.140181+0000","last_fullsized":"2023-10-09T11:38:09.140181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:06:28.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140850+0000","last_change":"2023-10-09T11:38:09.140598+0000","last_active":"2023-10-09T11:38:09.140850+0000","last_peered":"2023-10-09T11:38:09.140850+0000","last_clean":"2023-10-09T11:38:09.140850+0000","last_became_active":"2023-10-09T11:38:09.140315+0000","last_became_peered":"2023-10-09T11:38:09.140315+0000","last_unstale":"2023-10-09T11:38:09.140850+0000","last_undegraded":"2023-10-09T11:38:09.140850+0000","last_fullsized":"2023-10-09T11:38:09.140850+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:57.232980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145219+0000","last_change":"2023-10-09T11:38:09.145157+0000","last_active":"2023-10-09T11:38:09.145219+0000","last_peered":"2023-10-09T11:38:09.145219+0000","last_clean":"2023-10-09T11:38:09.145219+0000","last_became_active":"2023-10-09T11:38:09.143480+0000","last_became_peered":"2023-10-09T11:38:09.143480+0000","last_unstale":"2023-10-09T11:38:09.145219+0000","last_undegraded":"2023-10-09T11:38:09.145219+0000","last_fullsized":"2023-10-09T11:38:09.145219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:36:24.121679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143001+0000","last_change":"2023-10-09T11:38:09.142939+0000","last_active":"2023-10-09T11:38:09.143001+0000","last_peered":"2023-10-09T11:38:09.143001+0000","last_clean":"2023-10-09T11:38:09.143001+0000","last_became_active":"2023-10-09T11:38:09.142688+0000","last_became_peered":"2023-10-09T11:38:09.142688+0000","last_unstale":"2023-10-09T11:38:09.143001+0000","last_undegraded":"2023-10-09T11:38:09.143001+0000","last_fullsized":"2023-10-09T11:38:09.143001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139148+0000","last_change":"2023-10-09T11:38:09.139078+0000","last_active":"2023-10-09T11:38:09.139148+0000","last_peered":"2023-10-09T11:38:09.139148+0000","last_clean":"2023-10-09T11:38:09.139148+0000","last_became_active":"2023-10-09T11:38:09.138833+0000","last_became_peered":"2023-10-09T11:38:09.138833+0000","last_unstale":"2023-10-09T11:38:09.139148+0000","last_undegraded":"2023-10-09T11:38:09.139148+0000","last_fullsized":"2023-10-09T11:38:09.139148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:30.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141638+0000","last_change":"2023-10-09T11:38:09.141573+0000","last_active":"2023-10-09T11:38:09.141638+0000","last_peered":"2023-10-09T11:38:09.141638+0000","last_clean":"2023-10-09T11:38:09.141638+0000","last_became_active":"2023-10-09T11:38:09.141344+0000","last_became_peered":"2023-10-09T11:38:09.141344+0000","last_unstale":"2023-10-09T11:38:09.141638+0000","last_undegraded":"2023-10-09T11:38:09.141638+0000","last_fullsized":"2023-10-09T11:38:09.141638+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:44.046697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155337+0000","last_change":"2023-10-09T11:38:09.155267+0000","last_active":"2023-10-09T11:38:09.155337+0000","last_peered":"2023-10-09T11:38:09.155337+0000","last_clean":"2023-10-09T11:38:09.155337+0000","last_became_active":"2023-10-09T11:38:09.155037+0000","last_became_peered":"2023-10-09T11:38:09.155037+0000","last_unstale":"2023-10-09T11:38:09.155337+0000","last_undegraded":"2023-10-09T11:38:09.155337+0000","last_fullsized":"2023-10-09T11:38:09.155337+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145349+0000","last_change":"2023-10-09T11:38:09.145297+0000","last_active":"2023-10-09T11:38:09.145349+0000","last_peered":"2023-10-09T11:38:09.145349+0000","last_clean":"2023-10-09T11:38:09.145349+0000","last_became_active":"2023-10-09T11:38:09.143816+0000","last_became_peered":"2023-10-09T11:38:09.143816+0000","last_unstale":"2023-10-09T11:38:09.145349+0000","last_undegraded":"2023-10-09T11:38:09.145349+0000","last_fullsized":"2023-10-09T11:38:09.145349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:44:24.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139353+0000","last_change":"2023-10-09T11:38:09.139252+0000","last_active":"2023-10-09T11:38:09.139353+0000","last_peered":"2023-10-09T11:38:09.139353+0000","last_clean":"2023-10-09T11:38:09.139353+0000","last_became_active":"2023-10-09T11:38:09.138738+0000","last_became_peered":"2023-10-09T11:38:09.138738+0000","last_unstale":"2023-10-09T11:38:09.139353+0000","last_undegraded":"2023-10-09T11:38:09.139353+0000","last_fullsized":"2023-10-09T11:38:09.139353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141382+0000","last_change":"2023-10-09T11:38:09.141286+0000","last_active":"2023-10-09T11:38:09.141382+0000","last_peered":"2023-10-09T11:38:09.141382+0000","last_clean":"2023-10-09T11:38:09.141382+0000","last_became_active":"2023-10-09T11:38:09.141113+0000","last_became_peered":"2023-10-09T11:38:09.141113+0000","last_unstale":"2023-10-09T11:38:09.141382+0000","last_undegraded":"2023-10-09T11:38:09.141382+0000","last_fullsized":"2023-10-09T11:38:09.141382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:24:22.609726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140988+0000","last_change":"2023-10-09T11:38:09.140923+0000","last_active":"2023-10-09T11:38:09.140988+0000","last_peered":"2023-10-09T11:38:09.140988+0000","last_clean":"2023-10-09T11:38:09.140988+0000","last_became_active":"2023-10-09T11:38:09.140676+0000","last_became_peered":"2023-10-09T11:38:09.140676+0000","last_unstale":"2023-10-09T11:38:09.140988+0000","last_undegraded":"2023-10-09T11:38:09.140988+0000","last_fullsized":"2023-10-09T11:38:09.140988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:26.771963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157301+0000","last_change":"2023-10-09T11:38:09.155745+0000","last_active":"2023-10-09T11:38:09.157301+0000","last_peered":"2023-10-09T11:38:09.157301+0000","last_clean":"2023-10-09T11:38:09.157301+0000","last_became_active":"2023-10-09T11:38:09.154170+0000","last_became_peered":"2023-10-09T11:38:09.154170+0000","last_unstale":"2023-10-09T11:38:09.157301+0000","last_undegraded":"2023-10-09T11:38:09.157301+0000","last_fullsized":"2023-10-09T11:38:09.157301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:28.508868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141398+0000","last_change":"2023-10-09T11:38:09.141331+0000","last_active":"2023-10-09T11:38:09.141398+0000","last_peered":"2023-10-09T11:38:09.141398+0000","last_clean":"2023-10-09T11:38:09.141398+0000","last_became_active":"2023-10-09T11:38:09.141092+0000","last_became_peered":"2023-10-09T11:38:09.141092+0000","last_unstale":"2023-10-09T11:38:09.141398+0000","last_undegraded":"2023-10-09T11:38:09.141398+0000","last_fullsized":"2023-10-09T11:38:09.141398+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:22.846973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155535+0000","last_change":"2023-10-09T11:38:09.155482+0000","last_active":"2023-10-09T11:38:09.155535+0000","last_peered":"2023-10-09T11:38:09.155535+0000","last_clean":"2023-10-09T11:38:09.155535+0000","last_became_active":"2023-10-09T11:38:09.155262+0000","last_became_peered":"2023-10-09T11:38:09.155262+0000","last_unstale":"2023-10-09T11:38:09.155535+0000","last_undegraded":"2023-10-09T11:38:09.155535+0000","last_fullsized":"2023-10-09T11:38:09.155535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:14.606435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156266+0000","last_change":"2023-10-09T11:38:09.156219+0000","last_active":"2023-10-09T11:38:09.156266+0000","last_peered":"2023-10-09T11:38:09.156266+0000","last_clean":"2023-10-09T11:38:09.156266+0000","last_became_active":"2023-10-09T11:38:09.156023+0000","last_became_peered":"2023-10-09T11:38:09.156023+0000","last_unstale":"2023-10-09T11:38:09.156266+0000","last_undegraded":"2023-10-09T11:38:09.156266+0000","last_fullsized":"2023-10-09T11:38:09.156266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:15.929492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138967+0000","last_change":"2023-10-09T11:38:09.138890+0000","last_active":"2023-10-09T11:38:09.138967+0000","last_peered":"2023-10-09T11:38:09.138967+0000","last_clean":"2023-10-09T11:38:09.138967+0000","last_became_active":"2023-10-09T11:38:09.138543+0000","last_became_peered":"2023-10-09T11:38:09.138543+0000","last_unstale":"2023-10-09T11:38:09.138967+0000","last_undegraded":"2023-10-09T11:38:09.138967+0000","last_fullsized":"2023-10-09T11:38:09.138967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140043+0000","last_change":"2023-10-09T11:38:09.139971+0000","last_active":"2023-10-09T11:38:09.140043+0000","last_peered":"2023-10-09T11:38:09.140043+0000","last_clean":"2023-10-09T11:38:09.140043+0000","last_became_active":"2023-10-09T11:38:09.139690+0000","last_became_peered":"2023-10-09T11:38:09.139690+0000","last_unstale":"2023-10-09T11:38:09.140043+0000","last_undegraded":"2023-10-09T11:38:09.140043+0000","last_fullsized":"2023-10-09T11:38:09.140043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:39.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143479+0000","last_change":"2023-10-09T11:38:09.143417+0000","last_active":"2023-10-09T11:38:09.143479+0000","last_peered":"2023-10-09T11:38:09.143479+0000","last_clean":"2023-10-09T11:38:09.143479+0000","last_became_active":"2023-10-09T11:38:09.143222+0000","last_became_peered":"2023-10-09T11:38:09.143222+0000","last_unstale":"2023-10-09T11:38:09.143479+0000","last_undegraded":"2023-10-09T11:38:09.143479+0000","last_fullsized":"2023-10-09T11:38:09.143479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140870+0000","last_change":"2023-10-09T11:38:09.140810+0000","last_active":"2023-10-09T11:38:09.140870+0000","last_peered":"2023-10-09T11:38:09.140870+0000","last_clean":"2023-10-09T11:38:09.140870+0000","last_became_active":"2023-10-09T11:38:09.140518+0000","last_became_peered":"2023-10-09T11:38:09.140518+0000","last_unstale":"2023-10-09T11:38:09.140870+0000","last_undegraded":"2023-10-09T11:38:09.140870+0000","last_fullsized":"2023-10-09T11:38:09.140870+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:17.220788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156320+0000","last_change":"2023-10-09T11:38:08.121558+0000","last_active":"2023-10-09T11:38:09.156320+0000","last_peered":"2023-10-09T11:38:09.156320+0000","last_clean":"2023-10-09T11:38:09.156320+0000","last_became_active":"2023-10-09T11:38:08.121326+0000","last_became_peered":"2023-10-09T11:38:08.121326+0000","last_unstale":"2023-10-09T11:38:09.156320+0000","last_undegraded":"2023-10-09T11:38:09.156320+0000","last_fullsized":"2023-10-09T11:38:09.156320+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:13.687452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139213+0000","last_change":"2023-10-09T11:38:09.137856+0000","last_active":"2023-10-09T11:38:09.139213+0000","last_peered":"2023-10-09T11:38:09.139213+0000","last_clean":"2023-10-09T11:38:09.139213+0000","last_became_active":"2023-10-09T11:38:09.137619+0000","last_became_peered":"2023-10-09T11:38:09.137619+0000","last_unstale":"2023-10-09T11:38:09.139213+0000","last_undegraded":"2023-10-09T11:38:09.139213+0000","last_fullsized":"2023-10-09T11:38:09.139213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:49.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155694+0000","last_change":"2023-10-09T11:38:08.123551+0000","last_active":"2023-10-09T11:38:09.155694+0000","last_peered":"2023-10-09T11:38:09.155694+0000","last_clean":"2023-10-09T11:38:09.155694+0000","last_became_active":"2023-10-09T11:38:08.123280+0000","last_became_peered":"2023-10-09T11:38:08.123280+0000","last_unstale":"2023-10-09T11:38:09.155694+0000","last_undegraded":"2023-10-09T11:38:09.155694+0000","last_fullsized":"2023-10-09T11:38:09.155694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:45:16.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143274+0000","last_change":"2023-10-09T11:38:09.143157+0000","last_active":"2023-10-09T11:38:09.143274+0000","last_peered":"2023-10-09T11:38:09.143274+0000","last_clean":"2023-10-09T11:38:09.143274+0000","last_became_active":"2023-10-09T11:38:09.142710+0000","last_became_peered":"2023-10-09T11:38:09.142710+0000","last_unstale":"2023-10-09T11:38:09.143274+0000","last_undegraded":"2023-10-09T11:38:09.143274+0000","last_fullsized":"2023-10-09T11:38:09.143274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.151928+0000","last_change":"2023-10-09T11:38:08.120970+0000","last_active":"2023-10-09T11:38:09.151928+0000","last_peered":"2023-10-09T11:38:09.151928+0000","last_clean":"2023-10-09T11:38:09.151928+0000","last_became_active":"2023-10-09T11:38:08.120732+0000","last_became_peered":"2023-10-09T11:38:08.120732+0000","last_unstale":"2023-10-09T11:38:09.151928+0000","last_undegraded":"2023-10-09T11:38:09.151928+0000","last_fullsized":"2023-10-09T11:38:09.151928+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:48.609903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155360+0000","last_change":"2023-10-09T11:38:09.154796+0000","last_active":"2023-10-09T11:38:09.155360+0000","last_peered":"2023-10-09T11:38:09.155360+0000","last_clean":"2023-10-09T11:38:09.155360+0000","last_became_active":"2023-10-09T11:38:09.154565+0000","last_became_peered":"2023-10-09T11:38:09.154565+0000","last_unstale":"2023-10-09T11:38:09.155360+0000","last_undegraded":"2023-10-09T11:38:09.155360+0000","last_fullsized":"2023-10-09T11:38:09.155360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:15.703398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157426+0000","last_change":"2023-10-09T11:38:08.126143+0000","last_active":"2023-10-09T11:38:09.157426+0000","last_peered":"2023-10-09T11:38:09.157426+0000","last_clean":"2023-10-09T11:38:09.157426+0000","last_became_active":"2023-10-09T11:38:08.125591+0000","last_became_peered":"2023-10-09T11:38:08.125591+0000","last_unstale":"2023-10-09T11:38:09.157426+0000","last_undegraded":"2023-10-09T11:38:09.157426+0000","last_fullsized":"2023-10-09T11:38:09.157426+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143955+0000","last_change":"2023-10-09T11:38:09.143746+0000","last_active":"2023-10-09T11:38:09.143955+0000","last_peered":"2023-10-09T11:38:09.143955+0000","last_clean":"2023-10-09T11:38:09.143955+0000","last_became_active":"2023-10-09T11:38:09.143078+0000","last_became_peered":"2023-10-09T11:38:09.143078+0000","last_unstale":"2023-10-09T11:38:09.143955+0000","last_undegraded":"2023-10-09T11:38:09.143955+0000","last_fullsized":"2023-10-09T11:38:09.143955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152028+0000","last_change":"2023-10-09T11:38:08.120519+0000","last_active":"2023-10-09T11:38:09.152028+0000","last_peered":"2023-10-09T11:38:09.152028+0000","last_clean":"2023-10-09T11:38:09.152028+0000","last_became_active":"2023-10-09T11:38:08.119222+0000","last_became_peered":"2023-10-09T11:38:08.119222+0000","last_unstale":"2023-10-09T11:38:09.152028+0000","last_undegraded":"2023-10-09T11:38:09.152028+0000","last_fullsized":"2023-10-09T11:38:09.152028+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:42.367733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145064+0000","last_change":"2023-10-09T11:38:09.144993+0000","last_active":"2023-10-09T11:38:09.145064+0000","last_peered":"2023-10-09T11:38:09.145064+0000","last_clean":"2023-10-09T11:38:09.145064+0000","last_became_active":"2023-10-09T11:38:09.143156+0000","last_became_peered":"2023-10-09T11:38:09.143156+0000","last_unstale":"2023-10-09T11:38:09.145064+0000","last_undegraded":"2023-10-09T11:38:09.145064+0000","last_fullsized":"2023-10-09T11:38:09.145064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:53:13.652971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154058+0000","last_change":"2023-10-09T11:38:08.130013+0000","last_active":"2023-10-09T11:38:09.154058+0000","last_peered":"2023-10-09T11:38:09.154058+0000","last_clean":"2023-10-09T11:38:09.154058+0000","last_became_active":"2023-10-09T11:38:08.127795+0000","last_became_peered":"2023-10-09T11:38:08.127795+0000","last_unstale":"2023-10-09T11:38:09.154058+0000","last_undegraded":"2023-10-09T11:38:09.154058+0000","last_fullsized":"2023-10-09T11:38:09.154058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:41:38.203183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.136657+0000","last_change":"2023-10-09T11:38:09.136519+0000","last_active":"2023-10-09T11:38:09.136657+0000","last_peered":"2023-10-09T11:38:09.136657+0000","last_clean":"2023-10-09T11:38:09.136657+0000","last_became_active":"2023-10-09T11:38:09.135870+0000","last_became_peered":"2023-10-09T11:38:09.135870+0000","last_unstale":"2023-10-09T11:38:09.136657+0000","last_undegraded":"2023-10-09T11:38:09.136657+0000","last_fullsized":"2023-10-09T11:38:09.136657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:06.267486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130702+0000","last_change":"2023-10-09T11:38:08.124333+0000","last_active":"2023-10-09T11:38:09.130702+0000","last_peered":"2023-10-09T11:38:09.130702+0000","last_clean":"2023-10-09T11:38:09.130702+0000","last_became_active":"2023-10-09T11:38:08.123845+0000","last_became_peered":"2023-10-09T11:38:08.123845+0000","last_unstale":"2023-10-09T11:38:09.130702+0000","last_undegraded":"2023-10-09T11:38:09.130702+0000","last_fullsized":"2023-10-09T11:38:09.130702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:58:06.635221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138507+0000","last_change":"2023-10-09T11:38:09.138439+0000","last_active":"2023-10-09T11:38:09.138507+0000","last_peered":"2023-10-09T11:38:09.138507+0000","last_clean":"2023-10-09T11:38:09.138507+0000","last_became_active":"2023-10-09T11:38:09.138191+0000","last_became_peered":"2023-10-09T11:38:09.138191+0000","last_unstale":"2023-10-09T11:38:09.138507+0000","last_undegraded":"2023-10-09T11:38:09.138507+0000","last_fullsized":"2023-10-09T11:38:09.138507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:20.648735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130806+0000","last_change":"2023-10-09T11:38:08.120586+0000","last_active":"2023-10-09T11:38:09.130806+0000","last_peered":"2023-10-09T11:38:09.130806+0000","last_clean":"2023-10-09T11:38:09.130806+0000","last_became_active":"2023-10-09T11:38:08.118863+0000","last_became_peered":"2023-10-09T11:38:08.118863+0000","last_unstale":"2023-10-09T11:38:09.130806+0000","last_undegraded":"2023-10-09T11:38:09.130806+0000","last_fullsized":"2023-10-09T11:38:09.130806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:26.367172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138736+0000","last_change":"2023-10-09T11:38:09.136870+0000","last_active":"2023-10-09T11:38:09.138736+0000","last_peered":"2023-10-09T11:38:09.138736+0000","last_clean":"2023-10-09T11:38:09.138736+0000","last_became_active":"2023-10-09T11:38:09.136654+0000","last_became_peered":"2023-10-09T11:38:09.136654+0000","last_unstale":"2023-10-09T11:38:09.138736+0000","last_undegraded":"2023-10-09T11:38:09.138736+0000","last_fullsized":"2023-10-09T11:38:09.138736+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:41:16.351410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135676+0000","last_change":"2023-10-09T11:38:08.128371+0000","last_active":"2023-10-09T11:38:09.135676+0000","last_peered":"2023-10-09T11:38:09.135676+0000","last_clean":"2023-10-09T11:38:09.135676+0000","last_became_active":"2023-10-09T11:38:08.128200+0000","last_became_peered":"2023-10-09T11:38:08.128200+0000","last_unstale":"2023-10-09T11:38:09.135676+0000","last_undegraded":"2023-10-09T11:38:09.135676+0000","last_fullsized":"2023-10-09T11:38:09.135676+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:03.112765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141065+0000","last_change":"2023-10-09T11:38:09.140992+0000","last_active":"2023-10-09T11:38:09.141065+0000","last_peered":"2023-10-09T11:38:09.141065+0000","last_clean":"2023-10-09T11:38:09.141065+0000","last_became_active":"2023-10-09T11:38:09.140544+0000","last_became_peered":"2023-10-09T11:38:09.140544+0000","last_unstale":"2023-10-09T11:38:09.141065+0000","last_undegraded":"2023-10-09T11:38:09.141065+0000","last_fullsized":"2023-10-09T11:38:09.141065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:47.089460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140712+0000","last_change":"2023-10-09T11:38:08.119440+0000","last_active":"2023-10-09T11:38:09.140712+0000","last_peered":"2023-10-09T11:38:09.140712+0000","last_clean":"2023-10-09T11:38:09.140712+0000","last_became_active":"2023-10-09T11:38:08.118785+0000","last_became_peered":"2023-10-09T11:38:08.118785+0000","last_unstale":"2023-10-09T11:38:09.140712+0000","last_undegraded":"2023-10-09T11:38:09.140712+0000","last_fullsized":"2023-10-09T11:38:09.140712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:19.999091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141946+0000","last_change":"2023-10-09T11:38:09.141883+0000","last_active":"2023-10-09T11:38:09.141946+0000","last_peered":"2023-10-09T11:38:09.141946+0000","last_clean":"2023-10-09T11:38:09.141946+0000","last_became_active":"2023-10-09T11:38:09.141609+0000","last_became_peered":"2023-10-09T11:38:09.141609+0000","last_unstale":"2023-10-09T11:38:09.141946+0000","last_undegraded":"2023-10-09T11:38:09.141946+0000","last_fullsized":"2023-10-09T11:38:09.141946+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:27.370911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156633+0000","last_change":"2023-10-09T11:38:08.125842+0000","last_active":"2023-10-09T11:38:09.156633+0000","last_peered":"2023-10-09T11:38:09.156633+0000","last_clean":"2023-10-09T11:38:09.156633+0000","last_became_active":"2023-10-09T11:38:08.125625+0000","last_became_peered":"2023-10-09T11:38:08.125625+0000","last_unstale":"2023-10-09T11:38:09.156633+0000","last_undegraded":"2023-10-09T11:38:09.156633+0000","last_fullsized":"2023-10-09T11:38:09.156633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:14.463578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.136724+0000","last_change":"2023-10-09T11:38:09.136505+0000","last_active":"2023-10-09T11:38:09.136724+0000","last_peered":"2023-10-09T11:38:09.136724+0000","last_clean":"2023-10-09T11:38:09.136724+0000","last_became_active":"2023-10-09T11:38:09.136294+0000","last_became_peered":"2023-10-09T11:38:09.136294+0000","last_unstale":"2023-10-09T11:38:09.136724+0000","last_undegraded":"2023-10-09T11:38:09.136724+0000","last_fullsized":"2023-10-09T11:38:09.136724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.156197+0000","last_change":"2023-10-09T11:38:08.122307+0000","last_active":"2023-10-09T11:38:09.156197+0000","last_peered":"2023-10-09T11:38:09.156197+0000","last_clean":"2023-10-09T11:38:09.156197+0000","last_became_active":"2023-10-09T11:38:08.121878+0000","last_became_peered":"2023-10-09T11:38:08.121878+0000","last_unstale":"2023-10-09T11:38:09.156197+0000","last_undegraded":"2023-10-09T11:38:09.156197+0000","last_fullsized":"2023-10-09T11:38:09.156197+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:04:38.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157311+0000","last_change":"2023-10-09T11:38:09.155895+0000","last_active":"2023-10-09T11:38:09.157311+0000","last_peered":"2023-10-09T11:38:09.157311+0000","last_clean":"2023-10-09T11:38:09.157311+0000","last_became_active":"2023-10-09T11:38:09.154463+0000","last_became_peered":"2023-10-09T11:38:09.154463+0000","last_unstale":"2023-10-09T11:38:09.157311+0000","last_undegraded":"2023-10-09T11:38:09.157311+0000","last_fullsized":"2023-10-09T11:38:09.157311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:43.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153666+0000","last_change":"2023-10-09T11:38:08.121642+0000","last_active":"2023-10-09T11:38:09.153666+0000","last_peered":"2023-10-09T11:38:09.153666+0000","last_clean":"2023-10-09T11:38:09.153666+0000","last_became_active":"2023-10-09T11:38:08.121191+0000","last_became_peered":"2023-10-09T11:38:08.121191+0000","last_unstale":"2023-10-09T11:38:09.153666+0000","last_undegraded":"2023-10-09T11:38:09.153666+0000","last_fullsized":"2023-10-09T11:38:09.153666+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138867+0000","last_change":"2023-10-09T11:38:09.138753+0000","last_active":"2023-10-09T11:38:09.138867+0000","last_peered":"2023-10-09T11:38:09.138867+0000","last_clean":"2023-10-09T11:38:09.138867+0000","last_became_active":"2023-10-09T11:38:09.138188+0000","last_became_peered":"2023-10-09T11:38:09.138188+0000","last_unstale":"2023-10-09T11:38:09.138867+0000","last_undegraded":"2023-10-09T11:38:09.138867+0000","last_fullsized":"2023-10-09T11:38:09.138867+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:22.846973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.133826+0000","last_change":"2023-10-09T11:38:08.124204+0000","last_active":"2023-10-09T11:38:09.133826+0000","last_peered":"2023-10-09T11:38:09.133826+0000","last_clean":"2023-10-09T11:38:09.133826+0000","last_became_active":"2023-10-09T11:38:08.123982+0000","last_became_peered":"2023-10-09T11:38:08.123982+0000","last_unstale":"2023-10-09T11:38:09.133826+0000","last_undegraded":"2023-10-09T11:38:09.133826+0000","last_fullsized":"2023-10-09T11:38:09.133826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:20.429221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.138715+0000","last_change":"2023-10-09T11:38:09.136653+0000","last_active":"2023-10-09T11:38:09.138715+0000","last_peered":"2023-10-09T11:38:09.138715+0000","last_clean":"2023-10-09T11:38:09.138715+0000","last_became_active":"2023-10-09T11:38:09.136406+0000","last_became_peered":"2023-10-09T11:38:09.136406+0000","last_unstale":"2023-10-09T11:38:09.138715+0000","last_undegraded":"2023-10-09T11:38:09.138715+0000","last_fullsized":"2023-10-09T11:38:09.138715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:38.046893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.130397+0000","last_change":"2023-10-09T11:38:08.122905+0000","last_active":"2023-10-09T11:38:09.130397+0000","last_peered":"2023-10-09T11:38:09.130397+0000","last_clean":"2023-10-09T11:38:09.130397+0000","last_became_active":"2023-10-09T11:38:08.122688+0000","last_became_peered":"2023-10-09T11:38:08.122688+0000","last_unstale":"2023-10-09T11:38:09.130397+0000","last_undegraded":"2023-10-09T11:38:09.130397+0000","last_fullsized":"2023-10-09T11:38:09.130397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:26.466209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145129+0000","last_change":"2023-10-09T11:38:09.145081+0000","last_active":"2023-10-09T11:38:09.145129+0000","last_peered":"2023-10-09T11:38:09.145129+0000","last_clean":"2023-10-09T11:38:09.145129+0000","last_became_active":"2023-10-09T11:38:09.144900+0000","last_became_peered":"2023-10-09T11:38:09.144900+0000","last_unstale":"2023-10-09T11:38:09.145129+0000","last_undegraded":"2023-10-09T11:38:09.145129+0000","last_fullsized":"2023-10-09T11:38:09.145129+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157350+0000","last_change":"2023-10-09T11:38:08.126492+0000","last_active":"2023-10-09T11:38:09.157350+0000","last_peered":"2023-10-09T11:38:09.157350+0000","last_clean":"2023-10-09T11:38:09.157350+0000","last_became_active":"2023-10-09T11:38:08.126269+0000","last_became_peered":"2023-10-09T11:38:08.126269+0000","last_unstale":"2023-10-09T11:38:09.157350+0000","last_undegraded":"2023-10-09T11:38:09.157350+0000","last_fullsized":"2023-10-09T11:38:09.157350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:33.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140280+0000","last_change":"2023-10-09T11:38:09.140216+0000","last_active":"2023-10-09T11:38:09.140280+0000","last_peered":"2023-10-09T11:38:09.140280+0000","last_clean":"2023-10-09T11:38:09.140280+0000","last_became_active":"2023-10-09T11:38:09.140011+0000","last_became_peered":"2023-10-09T11:38:09.140011+0000","last_unstale":"2023-10-09T11:38:09.140280+0000","last_undegraded":"2023-10-09T11:38:09.140280+0000","last_fullsized":"2023-10-09T11:38:09.140280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:14:22.061122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153483+0000","last_change":"2023-10-09T11:38:08.121124+0000","last_active":"2023-10-09T11:38:09.153483+0000","last_peered":"2023-10-09T11:38:09.153483+0000","last_clean":"2023-10-09T11:38:09.153483+0000","last_became_active":"2023-10-09T11:38:08.120736+0000","last_became_peered":"2023-10-09T11:38:08.120736+0000","last_unstale":"2023-10-09T11:38:09.153483+0000","last_undegraded":"2023-10-09T11:38:09.153483+0000","last_fullsized":"2023-10-09T11:38:09.153483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:21.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154131+0000","last_change":"2023-10-09T11:38:09.152824+0000","last_active":"2023-10-09T11:38:09.154131+0000","last_peered":"2023-10-09T11:38:09.154131+0000","last_clean":"2023-10-09T11:38:09.154131+0000","last_became_active":"2023-10-09T11:38:09.150064+0000","last_became_peered":"2023-10-09T11:38:09.150064+0000","last_unstale":"2023-10-09T11:38:09.154131+0000","last_undegraded":"2023-10-09T11:38:09.154131+0000","last_fullsized":"2023-10-09T11:38:09.154131+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:53.156435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.152142+0000","last_change":"2023-10-09T11:38:08.127739+0000","last_active":"2023-10-09T11:38:09.152142+0000","last_peered":"2023-10-09T11:38:09.152142+0000","last_clean":"2023-10-09T11:38:09.152142+0000","last_became_active":"2023-10-09T11:38:08.125352+0000","last_became_peered":"2023-10-09T11:38:08.125352+0000","last_unstale":"2023-10-09T11:38:09.152142+0000","last_undegraded":"2023-10-09T11:38:09.152142+0000","last_fullsized":"2023-10-09T11:38:09.152142+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:46.571090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145533+0000","last_change":"2023-10-09T11:38:09.145473+0000","last_active":"2023-10-09T11:38:09.145533+0000","last_peered":"2023-10-09T11:38:09.145533+0000","last_clean":"2023-10-09T11:38:09.145533+0000","last_became_active":"2023-10-09T11:38:09.144119+0000","last_became_peered":"2023-10-09T11:38:09.144119+0000","last_unstale":"2023-10-09T11:38:09.145533+0000","last_undegraded":"2023-10-09T11:38:09.145533+0000","last_fullsized":"2023-10-09T11:38:09.145533+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:27.980745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.157571+0000","last_change":"2023-10-09T11:38:08.126009+0000","last_active":"2023-10-09T11:38:09.157571+0000","last_peered":"2023-10-09T11:38:09.157571+0000","last_clean":"2023-10-09T11:38:09.157571+0000","last_became_active":"2023-10-09T11:38:08.125269+0000","last_became_peered":"2023-10-09T11:38:08.125269+0000","last_unstale":"2023-10-09T11:38:09.157571+0000","last_undegraded":"2023-10-09T11:38:09.157571+0000","last_fullsized":"2023-10-09T11:38:09.157571+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:38.552189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141230+0000","last_change":"2023-10-09T11:38:09.141147+0000","last_active":"2023-10-09T11:38:09.141230+0000","last_peered":"2023-10-09T11:38:09.141230+0000","last_clean":"2023-10-09T11:38:09.141230+0000","last_became_active":"2023-10-09T11:38:09.140791+0000","last_became_peered":"2023-10-09T11:38:09.140791+0000","last_unstale":"2023-10-09T11:38:09.141230+0000","last_undegraded":"2023-10-09T11:38:09.141230+0000","last_fullsized":"2023-10-09T11:38:09.141230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:05:21.299807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135053+0000","last_change":"2023-10-09T11:38:08.128582+0000","last_active":"2023-10-09T11:38:09.135053+0000","last_peered":"2023-10-09T11:38:09.135053+0000","last_clean":"2023-10-09T11:38:09.135053+0000","last_became_active":"2023-10-09T11:38:08.128317+0000","last_became_peered":"2023-10-09T11:38:08.128317+0000","last_unstale":"2023-10-09T11:38:09.135053+0000","last_undegraded":"2023-10-09T11:38:09.135053+0000","last_fullsized":"2023-10-09T11:38:09.135053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:45.301603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154110+0000","last_change":"2023-10-09T11:38:09.152649+0000","last_active":"2023-10-09T11:38:09.154110+0000","last_peered":"2023-10-09T11:38:09.154110+0000","last_clean":"2023-10-09T11:38:09.154110+0000","last_became_active":"2023-10-09T11:38:09.149758+0000","last_became_peered":"2023-10-09T11:38:09.149758+0000","last_unstale":"2023-10-09T11:38:09.154110+0000","last_undegraded":"2023-10-09T11:38:09.154110+0000","last_fullsized":"2023-10-09T11:38:09.154110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:50.315155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.153652+0000","last_change":"2023-10-09T11:38:08.118845+0000","last_active":"2023-10-09T11:38:09.153652+0000","last_peered":"2023-10-09T11:38:09.153652+0000","last_clean":"2023-10-09T11:38:09.153652+0000","last_became_active":"2023-10-09T11:38:08.118600+0000","last_became_peered":"2023-10-09T11:38:08.118600+0000","last_unstale":"2023-10-09T11:38:09.153652+0000","last_undegraded":"2023-10-09T11:38:09.153652+0000","last_fullsized":"2023-10-09T11:38:09.153652+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:46:56.229241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.141487+0000","last_change":"2023-10-09T11:38:09.141426+0000","last_active":"2023-10-09T11:38:09.141487+0000","last_peered":"2023-10-09T11:38:09.141487+0000","last_clean":"2023-10-09T11:38:09.141487+0000","last_became_active":"2023-10-09T11:38:09.141196+0000","last_became_peered":"2023-10-09T11:38:09.141196+0000","last_unstale":"2023-10-09T11:38:09.141487+0000","last_undegraded":"2023-10-09T11:38:09.141487+0000","last_fullsized":"2023-10-09T11:38:09.141487+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:55.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.135789+0000","last_change":"2023-10-09T11:38:08.124894+0000","last_active":"2023-10-09T11:38:09.135789+0000","last_peered":"2023-10-09T11:38:09.135789+0000","last_clean":"2023-10-09T11:38:09.135789+0000","last_became_active":"2023-10-09T11:38:08.124696+0000","last_became_peered":"2023-10-09T11:38:08.124696+0000","last_unstale":"2023-10-09T11:38:09.135789+0000","last_undegraded":"2023-10-09T11:38:09.135789+0000","last_fullsized":"2023-10-09T11:38:09.135789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:44.457144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140331+0000","last_change":"2023-10-09T11:38:09.139276+0000","last_active":"2023-10-09T11:38:09.140331+0000","last_peered":"2023-10-09T11:38:09.140331+0000","last_clean":"2023-10-09T11:38:09.140331+0000","last_became_active":"2023-10-09T11:38:09.139063+0000","last_became_peered":"2023-10-09T11:38:09.139063+0000","last_unstale":"2023-10-09T11:38:09.140331+0000","last_undegraded":"2023-10-09T11:38:09.140331+0000","last_fullsized":"2023-10-09T11:38:09.140331+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:04.819222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.131036+0000","last_change":"2023-10-09T11:38:08.125827+0000","last_active":"2023-10-09T11:38:09.131036+0000","last_peered":"2023-10-09T11:38:09.131036+0000","last_clean":"2023-10-09T11:38:09.131036+0000","last_became_active":"2023-10-09T11:38:08.124960+0000","last_became_peered":"2023-10-09T11:38:08.124960+0000","last_unstale":"2023-10-09T11:38:09.131036+0000","last_undegraded":"2023-10-09T11:38:09.131036+0000","last_fullsized":"2023-10-09T11:38:09.131036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:15.709978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154009+0000","last_change":"2023-10-09T11:38:09.150414+0000","last_active":"2023-10-09T11:38:09.154009+0000","last_peered":"2023-10-09T11:38:09.154009+0000","last_clean":"2023-10-09T11:38:09.154009+0000","last_became_active":"2023-10-09T11:38:09.150211+0000","last_became_peered":"2023-10-09T11:38:09.150211+0000","last_unstale":"2023-10-09T11:38:09.154009+0000","last_undegraded":"2023-10-09T11:38:09.154009+0000","last_fullsized":"2023-10-09T11:38:09.154009+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:20.556523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.151469+0000","last_change":"2023-10-09T11:38:08.121768+0000","last_active":"2023-10-09T11:38:09.151469+0000","last_peered":"2023-10-09T11:38:09.151469+0000","last_clean":"2023-10-09T11:38:09.151469+0000","last_became_active":"2023-10-09T11:38:08.121548+0000","last_became_peered":"2023-10-09T11:38:08.121548+0000","last_unstale":"2023-10-09T11:38:09.151469+0000","last_undegraded":"2023-10-09T11:38:09.151469+0000","last_fullsized":"2023-10-09T11:38:09.151469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:40:47.627153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.154031+0000","last_change":"2023-10-09T11:38:09.151273+0000","last_active":"2023-10-09T11:38:09.154031+0000","last_peered":"2023-10-09T11:38:09.154031+0000","last_clean":"2023-10-09T11:38:09.154031+0000","last_became_active":"2023-10-09T11:38:09.149922+0000","last_became_peered":"2023-10-09T11:38:09.149922+0000","last_unstale":"2023-10-09T11:38:09.154031+0000","last_undegraded":"2023-10-09T11:38:09.154031+0000","last_fullsized":"2023-10-09T11:38:09.154031+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:26.552680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134230+0000","last_change":"2023-10-09T11:38:08.130156+0000","last_active":"2023-10-09T11:38:09.134230+0000","last_peered":"2023-10-09T11:38:09.134230+0000","last_clean":"2023-10-09T11:38:09.134230+0000","last_became_active":"2023-10-09T11:38:08.129294+0000","last_became_peered":"2023-10-09T11:38:08.129294+0000","last_unstale":"2023-10-09T11:38:09.134230+0000","last_undegraded":"2023-10-09T11:38:09.134230+0000","last_fullsized":"2023-10-09T11:38:09.134230+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:53.065896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140348+0000","last_change":"2023-10-09T11:38:09.140231+0000","last_active":"2023-10-09T11:38:09.140348+0000","last_peered":"2023-10-09T11:38:09.140348+0000","last_clean":"2023-10-09T11:38:09.140348+0000","last_became_active":"2023-10-09T11:38:09.140018+0000","last_became_peered":"2023-10-09T11:38:09.140018+0000","last_unstale":"2023-10-09T11:38:09.140348+0000","last_undegraded":"2023-10-09T11:38:09.140348+0000","last_fullsized":"2023-10-09T11:38:09.140348+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:47.574829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134110+0000","last_change":"2023-10-09T11:38:08.125926+0000","last_active":"2023-10-09T11:38:09.134110+0000","last_peered":"2023-10-09T11:38:09.134110+0000","last_clean":"2023-10-09T11:38:09.134110+0000","last_became_active":"2023-10-09T11:38:08.125450+0000","last_became_peered":"2023-10-09T11:38:08.125450+0000","last_unstale":"2023-10-09T11:38:09.134110+0000","last_undegraded":"2023-10-09T11:38:09.134110+0000","last_fullsized":"2023-10-09T11:38:09.134110+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:15.240866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.155381+0000","last_change":"2023-10-09T11:38:09.155269+0000","last_active":"2023-10-09T11:38:09.155381+0000","last_peered":"2023-10-09T11:38:09.155381+0000","last_clean":"2023-10-09T11:38:09.155381+0000","last_became_active":"2023-10-09T11:38:09.155043+0000","last_became_peered":"2023-10-09T11:38:09.155043+0000","last_unstale":"2023-10-09T11:38:09.155381+0000","last_undegraded":"2023-10-09T11:38:09.155381+0000","last_fullsized":"2023-10-09T11:38:09.155381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:21.002830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.129660+0000","last_change":"2023-10-09T11:38:08.124884+0000","last_active":"2023-10-09T11:38:09.129660+0000","last_peered":"2023-10-09T11:38:09.129660+0000","last_clean":"2023-10-09T11:38:09.129660+0000","last_became_active":"2023-10-09T11:38:08.124634+0000","last_became_peered":"2023-10-09T11:38:08.124634+0000","last_unstale":"2023-10-09T11:38:09.129660+0000","last_undegraded":"2023-10-09T11:38:09.129660+0000","last_fullsized":"2023-10-09T11:38:09.129660+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:03.815483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.145672+0000","last_change":"2023-10-09T11:38:09.145614+0000","last_active":"2023-10-09T11:38:09.145672+0000","last_peered":"2023-10-09T11:38:09.145672+0000","last_clean":"2023-10-09T11:38:09.145672+0000","last_became_active":"2023-10-09T11:38:09.144400+0000","last_became_peered":"2023-10-09T11:38:09.144400+0000","last_unstale":"2023-10-09T11:38:09.145672+0000","last_undegraded":"2023-10-09T11:38:09.145672+0000","last_fullsized":"2023-10-09T11:38:09.145672+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:24.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.137990+0000","last_change":"2023-10-09T11:38:08.121275+0000","last_active":"2023-10-09T11:38:09.137990+0000","last_peered":"2023-10-09T11:38:09.137990+0000","last_clean":"2023-10-09T11:38:09.137990+0000","last_became_active":"2023-10-09T11:38:08.121054+0000","last_became_peered":"2023-10-09T11:38:08.121054+0000","last_unstale":"2023-10-09T11:38:09.137990+0000","last_undegraded":"2023-10-09T11:38:09.137990+0000","last_fullsized":"2023-10-09T11:38:09.137990+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:50.398915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143197+0000","last_change":"2023-10-09T11:38:09.143155+0000","last_active":"2023-10-09T11:38:09.143197+0000","last_peered":"2023-10-09T11:38:09.143197+0000","last_clean":"2023-10-09T11:38:09.143197+0000","last_became_active":"2023-10-09T11:38:09.143010+0000","last_became_peered":"2023-10-09T11:38:09.143010+0000","last_unstale":"2023-10-09T11:38:09.143197+0000","last_undegraded":"2023-10-09T11:38:09.143197+0000","last_fullsized":"2023-10-09T11:38:09.143197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:40.559089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.131141+0000","last_change":"2023-10-09T11:38:08.121672+0000","last_active":"2023-10-09T11:38:09.131141+0000","last_peered":"2023-10-09T11:38:09.131141+0000","last_clean":"2023-10-09T11:38:09.131141+0000","last_became_active":"2023-10-09T11:38:08.121445+0000","last_became_peered":"2023-10-09T11:38:08.121445+0000","last_unstale":"2023-10-09T11:38:09.131141+0000","last_undegraded":"2023-10-09T11:38:09.131141+0000","last_fullsized":"2023-10-09T11:38:09.131141+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:33:05.590480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.139190+0000","last_change":"2023-10-09T11:38:09.137576+0000","last_active":"2023-10-09T11:38:09.139190+0000","last_peered":"2023-10-09T11:38:09.139190+0000","last_clean":"2023-10-09T11:38:09.139190+0000","last_became_active":"2023-10-09T11:38:09.137354+0000","last_became_peered":"2023-10-09T11:38:09.137354+0000","last_unstale":"2023-10-09T11:38:09.139190+0000","last_undegraded":"2023-10-09T11:38:09.139190+0000","last_fullsized":"2023-10-09T11:38:09.139190+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:06:56.030836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134485+0000","last_change":"2023-10-09T11:38:08.122691+0000","last_active":"2023-10-09T11:38:09.134485+0000","last_peered":"2023-10-09T11:38:09.134485+0000","last_clean":"2023-10-09T11:38:09.134485+0000","last_became_active":"2023-10-09T11:38:08.122469+0000","last_became_peered":"2023-10-09T11:38:08.122469+0000","last_unstale":"2023-10-09T11:38:09.134485+0000","last_undegraded":"2023-10-09T11:38:09.134485+0000","last_fullsized":"2023-10-09T11:38:09.134485+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.140837+0000","last_change":"2023-10-09T11:38:09.139759+0000","last_active":"2023-10-09T11:38:09.140837+0000","last_peered":"2023-10-09T11:38:09.140837+0000","last_clean":"2023-10-09T11:38:09.140837+0000","last_became_active":"2023-10-09T11:38:09.139574+0000","last_became_peered":"2023-10-09T11:38:09.139574+0000","last_unstale":"2023-10-09T11:38:09.140837+0000","last_undegraded":"2023-10-09T11:38:09.140837+0000","last_fullsized":"2023-10-09T11:38:09.140837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:12.510727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134819+0000","last_change":"2023-10-09T11:38:08.120979+0000","last_active":"2023-10-09T11:38:09.134819+0000","last_peered":"2023-10-09T11:38:09.134819+0000","last_clean":"2023-10-09T11:38:09.134819+0000","last_became_active":"2023-10-09T11:38:08.120404+0000","last_became_peered":"2023-10-09T11:38:08.120404+0000","last_unstale":"2023-10-09T11:38:09.134819+0000","last_undegraded":"2023-10-09T11:38:09.134819+0000","last_fullsized":"2023-10-09T11:38:09.134819+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:38:05.054647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.143245+0000","last_change":"2023-10-09T11:38:09.142409+0000","last_active":"2023-10-09T11:38:09.143245+0000","last_peered":"2023-10-09T11:38:09.143245+0000","last_clean":"2023-10-09T11:38:09.143245+0000","last_became_active":"2023-10-09T11:38:09.142115+0000","last_became_peered":"2023-10-09T11:38:09.142115+0000","last_unstale":"2023-10-09T11:38:09.143245+0000","last_undegraded":"2023-10-09T11:38:09.143245+0000","last_fullsized":"2023-10-09T11:38:09.143245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:08.111609+0000","last_clean_scrub_stamp":"2023-10-09T11:38:08.111609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:55.565978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134142+0000","last_change":"2023-10-09T11:38:08.123342+0000","last_active":"2023-10-09T11:38:09.134142+0000","last_peered":"2023-10-09T11:38:09.134142+0000","last_clean":"2023-10-09T11:38:09.134142+0000","last_became_active":"2023-10-09T11:38:08.123106+0000","last_became_peered":"2023-10-09T11:38:08.123106+0000","last_unstale":"2023-10-09T11:38:09.134142+0000","last_undegraded":"2023-10-09T11:38:09.134142+0000","last_fullsized":"2023-10-09T11:38:09.134142+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:38:07.107870+0000","last_clean_scrub_stamp":"2023-10-09T11:38:07.107870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:39.024818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-09T11:38:09.134430+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:38:09.134430+0000","last_peered":"2023-10-09T11:38:09.134430+0000","last_clean":"2023-10-09T11:38:09.134430+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:38:09.134430+0000","last_undegraded":"2023-10-09T11:38:09.134430+0000","last_fullsized":"2023-10-09T11:38:09.134430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":884,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194427,"statfs":{"total":200000000,"available":199093969,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.878,"15min":0.878},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72699999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":1.048,"15min":1.048},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76400000000000001,"5min":1.079,"15min":1.079},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65300000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.45700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51300000000000001,"15min":0.51100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.621,"15min":0.64500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60299999999999998,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.69999999999999996,"15min":0.72699999999999998},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73599999999999999,"5min":5.298,"15min":5.298},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.68400000000000005,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73399999999999999,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77000000000000002,"5min":1.617,"15min":1.617},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":5.46,"15min":5.46},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73099999999999998,"15min":0.76100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65400000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.44800000000000001},"min":{"1min":0.40799999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.60099999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46000000000000002},"min":{"1min":0.35299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68400000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684407,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.39900000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51100000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.315},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.25600000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.51700000000000002,"5min":2.004,"15min":2.004},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41199999999999998,"15min":0.42299999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.49099999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40500000000000003,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56299999999999994,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.61099999999999999,"5min":1.909,"15min":1.909},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.65600000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.63800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82199999999999995,"5min":1.869,"15min":1.869},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65400000000000003,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82899999999999996,"5min":1.952,"15min":1.952},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65100000000000002,"15min":0.66200000000000003},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":1.782,"15min":1.782},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78100000000000003,"5min":1.819,"15min":1.819},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":885,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194426,"statfs":{"total":200000000,"available":199093050,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46999999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.22600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.25}]},{"osd":2,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57599999999999996,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39600000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54500000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.502,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64800000000000002,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74299999999999999,"5min":1.282,"15min":1.282},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70499999999999996,"15min":0.71899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86699999999999999,"5min":3.976,"15min":3.976},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77700000000000002,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82099999999999995,"5min":1.524,"15min":1.524},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84899999999999998,"5min":1.254,"15min":1.254},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.437,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":1.22,"15min":1.22},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.499}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.311,"15min":0.307},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54300000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45300000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.85399999999999998,"15min":0.93100000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58399999999999996,"5min":11.055,"15min":11.055},"last":0.307}]},{"osd":3,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38700000000000001,"15min":0.38500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.32800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84099999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.748,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.626,"15min":0.627},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59199999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195004,"statfs":{"total":200000000,"available":199684441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.375,"15min":0.38200000000000001},"min":{"1min":0.21299999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.44400000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.42499999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.47899999999999998,"5min":1.034,"15min":1.034},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":1.335,"15min":1.335},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.26500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.58399999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":1.405,"15min":1.405},"last":0.439}]},{"osd":4,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":1.167,"15min":1.167},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78500000000000003,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.624}]},{"osd":6,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73299999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64600000000000002,"15min":0.65200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.81100000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46999999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195002,"statfs":{"total":200000000,"available":199682961,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.77400000000000002,"15min":0.81299999999999994},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71099999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.82599999999999996,"15min":0.871},"min":{"1min":0.41599999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70399999999999996,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77800000000000002,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.71299999999999997,"15min":0.747},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":5.274,"15min":5.274},"last":0.626}]},{"osd":3,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.82799999999999996,"15min":0.87},"min":{"1min":0.443,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.84099999999999997,"15min":0.89000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71999999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.47299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:37:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":308,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195003,"statfs":{"total":200000000,"available":199683873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66200000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.499},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83399999999999996,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.629,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58399999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40999999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:37:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.435},{"interface":"front","average":{"1min":0.505,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39800000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:38:18.187 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:38:18.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:38:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.346+0000 7fbcff4f7700 1 Processor -- start 2023-10-09T11:38:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.346+0000 7fbcff4f7700 1 -- start start 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcff4f7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 0x7fbcf8068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcff4f7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 0x7fbcf8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcff4f7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80cca80 con 0x7fbcf80cb790 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcff4f7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80cedd0 con 0x7fbcf81577c0 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcff4f7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80cc4c0 con 0x7fbcf8157b90 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcfd293700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 0x7fbcf8068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcfca92700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 0x7fbcf8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcfda94700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbcf80cb790 0x7fbcf80cbbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:52682/0 (socket says 172.21.15.6:52682) 2023-10-09T11:38:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.347+0000 7fbcfda94700 1 -- 172.21.15.6:0/2019099161 learned_addr learned my addr 172.21.15.6:0/2019099161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcf7fff700 1 -- 172.21.15.6:0/2019099161 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517473609 0 0) 0x7fbcf80cca80 con 0x7fbcf80cb790 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcf7fff700 1 -- 172.21.15.6:0/2019099161 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce0003570 con 0x7fbcf80cb790 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfca92700 1 -- 172.21.15.6:0/2019099161 >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 msgr2=0x7fbcf8068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfca92700 1 --2- 172.21.15.6:0/2019099161 >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 0x7fbcf8068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfca92700 1 -- 172.21.15.6:0/2019099161 >> v1:172.21.15.118:6789/0 conn(0x7fbcf80cb790 legacy=0x7fbcf80cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfca92700 1 -- 172.21.15.6:0/2019099161 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80cc7a0 con 0x7fbcf8157b90 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfd293700 1 --2- 172.21.15.6:0/2019099161 >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 0x7fbcf8068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcfca92700 1 --2- 172.21.15.6:0/2019099161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 0x7fbcf8068d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661393eb865bf586 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcf7fff700 1 -- 172.21.15.6:0/2019099161 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec011630 con 0x7fbcf8157b90 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcf7fff700 1 -- 172.21.15.6:0/2019099161 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec011790 con 0x7fbcf8157b90 2023-10-09T11:38:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.348+0000 7fbcf7fff700 1 -- 172.21.15.6:0/2019099161 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec011b30 con 0x7fbcf8157b90 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 -- 172.21.15.6:0/2019099161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 msgr2=0x7fbcf8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/2019099161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 0x7fbcf8068d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0098e0 tx=0x7fbcec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 -- 172.21.15.6:0/2019099161 shutdown_connections 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/2019099161 >> v2:172.21.15.118:3300/0 conn(0x7fbcf81577c0 0x7fbcf8068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/2019099161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf8157b90 0x7fbcf8068d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 -- 172.21.15.6:0/2019099161 >> 172.21.15.6:0/2019099161 conn(0x7fbcf80d0df0 msgr2=0x7fbcf80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 -- 172.21.15.6:0/2019099161 shutdown_connections 2023-10-09T11:38:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.349+0000 7fbcff4f7700 1 -- 172.21.15.6:0/2019099161 wait complete. 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.350+0000 7fbcff4f7700 1 Processor -- start 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.350+0000 7fbcff4f7700 1 -- start start 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf80cb790 0x7fbcf806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf81577c0 0x7fbcf814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf806dfa0 con 0x7fbcf8157b90 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf806e520 con 0x7fbcf80cb790 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcff4f7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf806e800 con 0x7fbcf81577c0 2023-10-09T11:38:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37230/0 (socket says 172.21.15.6:37230) 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 -- 172.21.15.6:0/3917676554 learned_addr learned my addr 172.21.15.6:0/3917676554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfca92700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf81577c0 0x7fbcf814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfd293700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf80cb790 0x7fbcf806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 -- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf81577c0 msgr2=0x7fbcf814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf81577c0 0x7fbcf814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 -- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf80cb790 msgr2=0x7fbcf806da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf80cb790 0x7fbcf806da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.351+0000 7fbcfda94700 1 -- 172.21.15.6:0/3917676554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009420 con 0x7fbcf8157b90 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcfda94700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbce8001460 tx=0x7fbce8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800a950 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce800aab0 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec009420 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800ae30 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.352+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf806edc0 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.353+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf8067a50 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.353+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbce8007300 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.353+0000 7fbcf57fa700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.354+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbce80849d0 con 0x7fbcf8157b90 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.354+0000 7fbcfd293700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.354+0000 7fbcfd293700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00093f0 tx=0x7fbcf0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.358+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbce8051c30 con 0x7fbcf8157b90 2023-10-09T11:38:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.632+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbcf8065500 con 0x7fbcf8157b90 2023-10-09T11:38:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.635+0000 7fbcf57fa700 1 -- 172.21.15.6:0/3917676554 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbce8055250 con 0x7fbcf8157b90 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 msgr2=0x7fbce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 0x7fbce40693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00093f0 tx=0x7fbcf0008040 comp rx=0 tx=0).stop 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 msgr2=0x7fbcf815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbce8001460 tx=0x7fbce8001a40 comp rx=0 tx=0).stop 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 shutdown_connections 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbce4066f30 0x7fbce40693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcf8157b90 0x7fbcf815b9f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf80cb790 0x7fbcf806da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 --2- 172.21.15.6:0/3917676554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcf81577c0 0x7fbcf814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 >> 172.21.15.6:0/3917676554 conn(0x7fbcf80d0df0 msgr2=0x7fbcf815cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:18.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 shutdown_connections 2023-10-09T11:38:18.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.638+0000 7fbcff4f7700 1 -- 172.21.15.6:0/3917676554 wait complete. 2023-10-09T11:38:18.641 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:38:18.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:38:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.768+0000 7f357410f700 1 Processor -- start 2023-10-09T11:38:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.768+0000 7f357410f700 1 -- start start 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c156420 0x7f356c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f356c0cc250 0x7f356c069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f356c069980 0x7f356c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c06aa10 con 0x7f356c0cc250 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0cb880 con 0x7f356c069980 2023-10-09T11:38:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f357410f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0cac70 con 0x7f356c156420 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f35716aa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f356c0cc250 0x7f356c069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f35716aa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f356c0cc250 0x7f356c069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37234/0 (socket says 172.21.15.6:37234) 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f35716aa700 1 -- 172.21.15.6:0/4261317711 learned_addr learned my addr 172.21.15.6:0/4261317711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f35726ac700 1 --2- 172.21.15.6:0/4261317711 >> v2:172.21.15.118:3300/0 conn(0x7f356c069980 0x7f356c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.769+0000 7f3571eab700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c156420 0x7f356c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 -- 172.21.15.6:0/4261317711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c156420 msgr2=0x7f356c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c156420 0x7f356c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 -- 172.21.15.6:0/4261317711 >> v2:172.21.15.118:3300/0 conn(0x7f356c069980 msgr2=0x7f356c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 --2- 172.21.15.6:0/4261317711 >> v2:172.21.15.118:3300/0 conn(0x7f356c069980 0x7f356c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 -- 172.21.15.6:0/4261317711 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0caf50 con 0x7f356c0cc250 2023-10-09T11:38:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f35716aa700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c0cc250 0x7f356c069440 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f356c064030 tx=0x7f356000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3d4ba07d6ed1bd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f3570ea9700 1 -- 172.21.15.6:0/4261317711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000db10 con 0x7f356c0cc250 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f3570ea9700 1 -- 172.21.15.6:0/4261317711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000dc70 con 0x7f356c0cc250 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f3570ea9700 1 -- 172.21.15.6:0/4261317711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560017410 con 0x7f356c0cc250 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 -- 172.21.15.6:0/4261317711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c0cc250 msgr2=0x7f356c069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c0cc250 0x7f356c069440 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f356c064030 tx=0x7f356000b4e0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 -- 172.21.15.6:0/4261317711 shutdown_connections 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 --2- 172.21.15.6:0/4261317711 >> v2:172.21.15.118:3300/0 conn(0x7f356c069980 0x7f356c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c156420 0x7f356c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 --2- 172.21.15.6:0/4261317711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c0cc250 0x7f356c069440 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 -- 172.21.15.6:0/4261317711 >> 172.21.15.6:0/4261317711 conn(0x7f356c06c660 msgr2=0x7f356c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.770+0000 7f357410f700 1 -- 172.21.15.6:0/4261317711 shutdown_connections 2023-10-09T11:38:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.771+0000 7f357410f700 1 -- 172.21.15.6:0/4261317711 wait complete. 2023-10-09T11:38:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 Processor -- start 2023-10-09T11:38:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 -- start start 2023-10-09T11:38:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c069980 0x7f356c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0cc250 0x7f356c0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c14d350 con 0x7f356c156420 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c14bd70 con 0x7f356c0cc250 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f357410f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c14c050 con 0x7f356c069980 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f35726ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f35726ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37242/0 (socket says 172.21.15.6:37242) 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.772+0000 7f35726ac700 1 -- 172.21.15.6:0/3664292653 learned_addr learned my addr 172.21.15.6:0/3664292653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f3571eab700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c069980 0x7f356c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35716aa700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0cc250 0x7f356c0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 -- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c069980 msgr2=0x7f356c14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c069980 0x7f356c14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 -- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0cc250 msgr2=0x7f356c0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0cc250 0x7f356c0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 -- 172.21.15.6:0/3664292653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356000b780 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f35726ac700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f355c009fa0 tx=0x7f355c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00ebc0 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00ed20 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c14c330 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c014670 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.773+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c14c8f0 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.774+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c069ff0 con 0x7f356c156420 2023-10-09T11:38:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.775+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f355c0149e0 con 0x7f356c156420 2023-10-09T11:38:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.775+0000 7f3569ffb700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 0x7f35580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.775+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f355c084ba0 con 0x7f356c156420 2023-10-09T11:38:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.775+0000 7f3571eab700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 0x7f35580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.776+0000 7f3571eab700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 0x7f35580693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3564006fd0 tx=0x7f3564008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:18.779+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f355c051e10 con 0x7f356c156420 2023-10-09T11:38:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.018+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356c14cae0 con 0x7f356c156420 2023-10-09T11:38:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.019+0000 7f3569ffb700 1 -- 172.21.15.6:0/3664292653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f355c055430 con 0x7f356c156420 2023-10-09T11:38:19.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:19.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:38:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 msgr2=0x7f35580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 0x7f35580693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3564006fd0 tx=0x7f3564008040 comp rx=0 tx=0).stop 2023-10-09T11:38:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 msgr2=0x7f356c14b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f355c009fa0 tx=0x7f355c009900 comp rx=0 tx=0).stop 2023-10-09T11:38:19.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 shutdown_connections 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3558066f30 0x7f35580693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f356c156420 0x7f356c14b2b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356c069980 0x7f356c14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 --2- 172.21.15.6:0/3664292653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0cc250 0x7f356c0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 >> 172.21.15.6:0/3664292653 conn(0x7f356c06c660 msgr2=0x7f356c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 shutdown_connections 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.021+0000 7f357410f700 1 -- 172.21.15.6:0/3664292653 wait complete. 2023-10-09T11:38:19.024 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:38:19.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:38:08.522863+0000', 'modified': '2023-10-09T11:38:12.158427+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5697}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5697': {'gid': 5697, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/1266236588', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6835', 'nonce': 1266236588}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 1266236588}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:38:19.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:38:19.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:38:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.556+0000 7f0b56d97700 1 Processor -- start 2023-10-09T11:38:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 -- start start 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b501578d0 0x7f0b500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b50157ca0 0x7f0b5015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b500d07c0 con 0x7f0b5006d120 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500cfbb0 con 0x7f0b50157ca0 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b56d97700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500cfe90 con 0x7f0b501578d0 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.557+0000 7f0b4ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b50157ca0 0x7f0b5015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b50157ca0 0x7f0b5015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37258/0 (socket says 172.21.15.6:37258) 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 -- 172.21.15.6:0/4288878506 learned_addr learned my addr 172.21.15.6:0/4288878506 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b54b33700 1 --2- 172.21.15.6:0/4288878506 >> v2:172.21.15.118:3300/0 conn(0x7f0b501578d0 0x7f0b500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 -- 172.21.15.6:0/4288878506 >> v2:172.21.15.118:3300/0 conn(0x7f0b501578d0 msgr2=0x7f0b500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/4288878506 >> v2:172.21.15.118:3300/0 conn(0x7f0b501578d0 0x7f0b500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 -- 172.21.15.6:0/4288878506 >> v1:172.21.15.118:6789/0 conn(0x7f0b5006d120 legacy=0x7f0b5006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 -- 172.21.15.6:0/4288878506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500d0170 con 0x7f0b50157ca0 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/4288878506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5015af00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b500646b0 tx=0x7f0b44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e155dc181276e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4f7fe700 1 -- 172.21.15.6:0/4288878506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400b820 con 0x7f0b50157ca0 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4f7fe700 1 -- 172.21.15.6:0/4288878506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4400b980 con 0x7f0b50157ca0 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.558+0000 7f0b4f7fe700 1 -- 172.21.15.6:0/4288878506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400bd20 con 0x7f0b50157ca0 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 -- 172.21.15.6:0/4288878506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 msgr2=0x7f0b5015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 --2- 172.21.15.6:0/4288878506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5015af00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b500646b0 tx=0x7f0b44009250 comp rx=0 tx=0).stop 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 -- 172.21.15.6:0/4288878506 shutdown_connections 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 --2- 172.21.15.6:0/4288878506 >> v2:172.21.15.118:3300/0 conn(0x7f0b501578d0 0x7f0b500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 --2- 172.21.15.6:0/4288878506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5015af00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 -- 172.21.15.6:0/4288878506 >> 172.21.15.6:0/4288878506 conn(0x7f0b5006bb90 msgr2=0x7f0b5006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 -- 172.21.15.6:0/4288878506 shutdown_connections 2023-10-09T11:38:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.559+0000 7f0b56d97700 1 -- 172.21.15.6:0/4288878506 wait complete. 2023-10-09T11:38:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.560+0000 7f0b56d97700 1 Processor -- start 2023-10-09T11:38:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.560+0000 7f0b56d97700 1 -- start start 2023-10-09T11:38:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b5006d120 0x7f0b500ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b501578d0 0x7f0b500ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500ac750 con 0x7f0b50157ca0 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500abb40 con 0x7f0b501578d0 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500abe20 con 0x7f0b5006d120 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37260/0 (socket says 172.21.15.6:37260) 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 -- 172.21.15.6:0/246245039 learned_addr learned my addr 172.21.15.6:0/246245039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b501578d0 0x7f0b500ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b54b33700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b5006d120 0x7f0b500ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 -- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b5006d120 msgr2=0x7f0b500ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b5006d120 0x7f0b500ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 -- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b501578d0 msgr2=0x7f0b500ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b501578d0 0x7f0b500ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 -- 172.21.15.6:0/246245039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440094f0 con 0x7f0b50157ca0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b55334700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c930 tx=0x7f0b480026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b4cff9700 1 -- 172.21.15.6:0/246245039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48012630 con 0x7f0b50157ca0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b4cff9700 1 -- 172.21.15.6:0/246245039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b480127d0 con 0x7f0b50157ca0 2023-10-09T11:38:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500ac100 con 0x7f0b50157ca0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.561+0000 7f0b4cff9700 1 -- 172.21.15.6:0/246245039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48012b90 con 0x7f0b50157ca0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.562+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5016e1f0 con 0x7f0b50157ca0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.563+0000 7f0b4cff9700 1 -- 172.21.15.6:0/246245039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b4801a3b0 con 0x7f0b50157ca0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.563+0000 7f0b4cff9700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 0x7f0b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.564+0000 7f0b4cff9700 1 -- 172.21.15.6:0/246245039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b48084170 con 0x7f0b50157ca0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.564+0000 7f0b54b33700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 0x7f0b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.564+0000 7f0b54b33700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 0x7f0b3c0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b40006fd0 tx=0x7f0b40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.565+0000 7f0b6008fb80 1 Processor -- start 2023-10-09T11:38:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.565+0000 7f0b6008fb80 1 -- start start 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555663376a70 con 0x555663469d00 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555663374270 con 0x55566341fa50 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555663370060 con 0x555663448f60 2023-10-09T11:38:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37262/0 (socket says 172.21.15.6:37262) 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 -- 172.21.15.6:0/353262139 learned_addr learned my addr 172.21.15.6:0/353262139 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b55334700 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b54b33700 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 -- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 msgr2=0x55566341bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 -- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 msgr2=0x55566341fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.566+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b4ffff700 1 -- 172.21.15.6:0/353262139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55566320a270 con 0x555663469d00 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009410 tx=0x7f0b44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50854484f89736a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b35ffb700 1 -- 172.21.15.6:0/353262139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44021070 con 0x555663469d00 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b35ffb700 1 -- 172.21.15.6:0/353262139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44000c90 con 0x555663469d00 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b35ffb700 1 -- 172.21.15.6:0/353262139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400bd40 con 0x555663469d00 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 -- 172.21.15.6:0/353262139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 msgr2=0x555663448a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009410 tx=0x7f0b44016000 comp rx=0 tx=0).stop 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 -- 172.21.15.6:0/353262139 shutdown_connections 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/353262139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663448a20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 -- 172.21.15.6:0/353262139 >> 172.21.15.6:0/353262139 conn(0x555663421370 msgr2=0x555663421740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 -- 172.21.15.6:0/353262139 shutdown_connections 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.567+0000 7f0b6008fb80 1 -- 172.21.15.6:0/353262139 wait complete. 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.568+0000 7f0b6008fb80 1 -- start start 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.568+0000 7f0b6008fb80 1 Processor -- start 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663469250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566341c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566331b890 con 0x555663448f60 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555663336ea0 con 0x55566341fa50 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556631f2e30 con 0x555663469d00 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b6008fb80 10 client.0 _ll_register_callbacks cb 0x5556633e3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37268/0 (socket says 172.21.15.6:37268) 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 -- 172.21.15.6:0/1246345832 learned_addr learned my addr 172.21.15.6:0/1246345832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b55334700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566341c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b54b33700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663469250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 -- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 msgr2=0x55566341c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566341c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 -- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 msgr2=0x555663469250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663469250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b4ffff700 1 -- 172.21.15.6:0/1246345832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500d0170 con 0x555663448f60 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b55334700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566341c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.569+0000 7f0b54b33700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663469250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0b44027040 tx=0x7f0b44021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543f654ecb30b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44011b20 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b44011c80 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555663414b70 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b44011e40 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 10 client.5838 fetch_fsmap learned FSMap version 35 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5556631acfe0 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4403a070 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b44018070 con 0x555663448f60 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 10 client.5838 fetch_fsmap finished waiting for FSMap version 35 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 10 client.5838 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 20 client.5838 populate_metadata read hostname 'smithi006' 2023-10-09T11:38:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x555663463950 0x555663463d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 4 client.5838 mds_command: new command op to 5697 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 --> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556633f1aa0 con 0x555663463950 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.570+0000 7f0b54b33700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x555663463950 0x555663463d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.571+0000 7f0b2effd700 10 client.5838 ms_handle_connect on v2:172.21.15.6:6835/1266236588 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.571+0000 7f0b54b33700 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x555663463950 0x555663463d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9883ed4d98bf412 server_cookie=d00ee3c942e15aa7 in_seq=0 out_seq=0 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.571+0000 7f0b2effd700 1 -- 172.21.15.6:0/1246345832 <== mds.0 v2:172.21.15.6:6835/1266236588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5556633f1aa0 con 0x555663463950 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.571+0000 7f0b2effd700 10 client.5838 handle_command_reply: tid=0 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.571+0000 7f0b6008fb80 1 client.5838 shutdown 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 msgr2=0x555663478ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0b44027040 tx=0x7f0b44021000 comp rx=0 tx=0).stop 2023-10-09T11:38:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 shutdown_connections 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x555663463950 0x555663463d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566341c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663469250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b2effd700 0 client.5838 ms_handle_reset on v2:172.21.15.6:6835/1266236588 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/1246345832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663478ee0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 >> 172.21.15.6:0/1246345832 conn(0x555663421370 msgr2=0x555663422a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 shutdown_connections 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 1 -- 172.21.15.6:0/1246345832 wait complete. 2023-10-09T11:38:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.572+0000 7f0b6008fb80 20 client.5838 trim_cache size 0 max 16384 2023-10-09T11:38:19.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.588+0000 7f0b6008fb80 1 Processor -- start 2023-10-09T11:38:19.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.588+0000 7f0b6008fb80 1 -- start start 2023-10-09T11:38:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663447ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556634635c0 con 0x555663469d00 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555663460800 con 0x55566341fa50 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555663463000 con 0x555663448f60 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37274/0 (socket says 172.21.15.6:37274) 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 -- 172.21.15.6:0/904444572 learned_addr learned my addr 172.21.15.6:0/904444572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 -- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 msgr2=0x55566341fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 -- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 msgr2=0x555663447ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663447ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.589+0000 7f0b55334700 1 -- 172.21.15.6:0/904444572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55566333e780 con 0x555663469d00 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b55334700 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0b48055030 tx=0x7f0b48014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63ba56eb2e86734 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b367fc700 1 -- 172.21.15.6:0/904444572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4806f070 con 0x555663469d00 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b367fc700 1 -- 172.21.15.6:0/904444572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b480550a0 con 0x555663469d00 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b367fc700 1 -- 172.21.15.6:0/904444572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480582f0 con 0x555663469d00 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 -- 172.21.15.6:0/904444572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 msgr2=0x555663420360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0b48055030 tx=0x7f0b48014040 comp rx=0 tx=0).stop 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 -- 172.21.15.6:0/904444572 shutdown_connections 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663469d00 0x555663420360 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x555663447ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/904444572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663448f60 0x55566341fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 -- 172.21.15.6:0/904444572 >> 172.21.15.6:0/904444572 conn(0x555663421370 msgr2=0x5556634184b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 -- 172.21.15.6:0/904444572 shutdown_connections 2023-10-09T11:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.590+0000 7f0b6008fb80 1 -- 172.21.15.6:0/904444572 wait complete. 2023-10-09T11:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.591+0000 7f0b6008fb80 1 -- start start 2023-10-09T11:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.591+0000 7f0b6008fb80 1 Processor -- start 2023-10-09T11:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566345e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566345f350 con 0x555663448f60 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555663468100 con 0x55566341fa50 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555663467e20 con 0x555663469d00 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 10 client.0 _ll_register_callbacks cb 0x5556633e3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37278/0 (socket says 172.21.15.6:37278) 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 -- 172.21.15.6:0/617403960 learned_addr learned my addr 172.21.15.6:0/617403960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b54b33700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b55334700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566345e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 -- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 msgr2=0x55566345e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566345e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 -- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 msgr2=0x55566341fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 -- 172.21.15.6:0/617403960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5016e1f0 con 0x555663448f60 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b4ffff700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006e80 tx=0x7f0b4402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218643366534b54b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44021070 con 0x555663448f60 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b44000c90 con 0x555663448f60 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.592+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b44011630 con 0x555663448f60 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b44011d30 con 0x555663448f60 2023-10-09T11:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 10 client.5844 fetch_fsmap learned FSMap version 35 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x555663325470 con 0x555663448f60 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44000c90 con 0x555663448f60 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b44038070 con 0x555663448f60 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 10 client.5844 fetch_fsmap finished waiting for FSMap version 35 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 10 client.5844 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 20 client.5844 populate_metadata read hostname 'smithi006' 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x5556634c6110 0x55566345eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 4 client.5844 mds_command: new command op to 5697 tid=0[{"prefix": "status"}] 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 --> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555663312e00 con 0x5556634c6110 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b54b33700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x5556634c6110 0x55566345eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b2effd700 10 client.5844 ms_handle_connect on v2:172.21.15.6:6835/1266236588 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.593+0000 7f0b54b33700 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x5556634c6110 0x55566345eab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be64b27a9073590b server_cookie=c381111e8f14e758 in_seq=0 out_seq=0 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b2effd700 1 -- 172.21.15.6:0/617403960 <== mds.0 v2:172.21.15.6:6835/1266236588 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555663312e00 con 0x5556634c6110 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b2effd700 10 client.5844 handle_command_reply: tid=0 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 client.5844 shutdown 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 msgr2=0x555663420360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006e80 tx=0x7f0b4402d000 comp rx=0 tx=0).stop 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 shutdown_connections 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:6835/1266236588,v1:172.21.15.6:6837/1266236588] conn(0x5556634c6110 0x55566345eab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555663469d00 0x55566345e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55566341fa50 0x55566341fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b2effd700 0 client.5844 ms_handle_reset on v2:172.21.15.6:6835/1266236588 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 --2- 172.21.15.6:0/617403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555663448f60 0x555663420360 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 >> 172.21.15.6:0/617403960 conn(0x555663421370 msgr2=0x5556634782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 shutdown_connections 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 1 -- 172.21.15.6:0/617403960 wait complete. 2023-10-09T11:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.594+0000 7f0b6008fb80 20 client.5844 trim_cache size 0 max 16384 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5697, 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.449750076000001, 2023-10-09T11:38:19.604 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 35, 2023-10-09T11:38:19.605 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 62, 2023-10-09T11:38:19.605 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 62, 2023-10-09T11:38:19.605 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 15.402862169 2023-10-09T11:38:19.605 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 msgr2=0x7f0b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 0x7f0b3c0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b40006fd0 tx=0x7f0b40008040 comp rx=0 tx=0).stop 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 msgr2=0x7f0b5016dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c930 tx=0x7f0b480026e0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 shutdown_connections 2023-10-09T11:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0b3c066f30 0x7f0b3c0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b50157ca0 0x7f0b5016dcb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b5006d120 0x7f0b500ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 --2- 172.21.15.6:0/246245039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b501578d0 0x7f0b500ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 >> 172.21.15.6:0/246245039 conn(0x7f0b5006bb90 msgr2=0x7f0b50156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 shutdown_connections 2023-10-09T11:38:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.595+0000 7f0b56d97700 1 -- 172.21.15.6:0/246245039 wait complete. 2023-10-09T11:38:19.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:38:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 Processor -- start 2023-10-09T11:38:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 -- start start 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb64415a2a0 0x7fb6440b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6440ceb30 0x7fb6440cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440b0ca0 con 0x7fb64406d650 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406e160 con 0x7fb6440ceb30 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.726+0000 7fb6493b3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406ea90 con 0x7fb64415a2a0 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6440ceb30 0x7fb6440cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6437fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb64406d650 0x7fb64406da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60128/0 (socket says 172.21.15.6:60128) 2023-10-09T11:38:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6437fe700 1 -- 172.21.15.6:0/3383062908 learned_addr learned my addr 172.21.15.6:0/3383062908 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb642ffd700 1 --2- 172.21.15.6:0/3383062908 >> v2:172.21.15.118:3300/0 conn(0x7fb64415a2a0 0x7fb6440b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 -- 172.21.15.6:0/3383062908 >> v2:172.21.15.118:3300/0 conn(0x7fb64415a2a0 msgr2=0x7fb6440b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 --2- 172.21.15.6:0/3383062908 >> v2:172.21.15.118:3300/0 conn(0x7fb64415a2a0 0x7fb6440b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 -- 172.21.15.6:0/3383062908 >> v1:172.21.15.6:6789/0 conn(0x7fb64406d650 legacy=0x7fb64406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb641ffb700 1 -- 172.21.15.6:0/3383062908 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897576393 0 0) 0x7fb6440b0ca0 con 0x7fb64406d650 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 -- 172.21.15.6:0/3383062908 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440b00d0 con 0x7fb6440ceb30 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb6427fc700 1 --2- 172.21.15.6:0/3383062908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6440ceb30 0x7fb6440cefb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb6440637a0 tx=0x7fb62c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265030e39c3336dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb641ffb700 1 -- 172.21.15.6:0/3383062908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00b6b0 con 0x7fb6440ceb30 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb641ffb700 1 -- 172.21.15.6:0/3383062908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00b810 con 0x7fb6440ceb30 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.727+0000 7fb641ffb700 1 -- 172.21.15.6:0/3383062908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00bbb0 con 0x7fb6440ceb30 2023-10-09T11:38:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 -- 172.21.15.6:0/3383062908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6440ceb30 msgr2=0x7fb6440cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 --2- 172.21.15.6:0/3383062908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6440ceb30 0x7fb6440cefb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb6440637a0 tx=0x7fb62c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 -- 172.21.15.6:0/3383062908 shutdown_connections 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 --2- 172.21.15.6:0/3383062908 >> v2:172.21.15.118:3300/0 conn(0x7fb64415a2a0 0x7fb6440b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 --2- 172.21.15.6:0/3383062908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6440ceb30 0x7fb6440cefb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 -- 172.21.15.6:0/3383062908 >> 172.21.15.6:0/3383062908 conn(0x7fb644067640 msgr2=0x7fb644067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 -- 172.21.15.6:0/3383062908 shutdown_connections 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.728+0000 7fb6493b3700 1 -- 172.21.15.6:0/3383062908 wait complete. 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.729+0000 7fb6493b3700 1 Processor -- start 2023-10-09T11:38:19.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.729+0000 7fb6493b3700 1 -- start start 2023-10-09T11:38:19.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6440ceb30 0x7fb64415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb64415a2a0 0x7fb644147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644147da0 con 0x7fb64406d650 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64415d8f0 con 0x7fb6440ceb30 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6493b3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440cb320 con 0x7fb64415a2a0 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37288/0 (socket says 172.21.15.6:37288) 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 -- 172.21.15.6:0/1907905837 learned_addr learned my addr 172.21.15.6:0/1907905837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6427fc700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6440ceb30 0x7fb64415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb6437fe700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb64415a2a0 0x7fb644147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 -- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb64415a2a0 msgr2=0x7fb644147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb64415a2a0 0x7fb644147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 -- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6440ceb30 msgr2=0x7fb64415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6440ceb30 0x7fb64415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.730+0000 7fb642ffd700 1 -- 172.21.15.6:0/1907905837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c009420 con 0x7fb64406d650 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb642ffd700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb63400ce10 tx=0x7fb634007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400ab90 con 0x7fb64406d650 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63400acf0 con 0x7fb64406d650 2023-10-09T11:38:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440cb600 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634017660 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.731+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440caf40 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.732+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644069e40 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.732+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb634003020 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.733+0000 7fb63affd700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 0x7fb624069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.733+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb634013070 con 0x7fb64406d650 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.733+0000 7fb6427fc700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 0x7fb624069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.733+0000 7fb6427fc700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 0x7fb624069460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb644157380 tx=0x7fb62c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.737+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb634051d10 con 0x7fb64406d650 2023-10-09T11:38:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.973+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb64404bb80 con 0x7fb64406d650 2023-10-09T11:38:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.974+0000 7fb63affd700 1 -- 172.21.15.6:0/1907905837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb63401c070 con 0x7fb64406d650 2023-10-09T11:38:19.975 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 msgr2=0x7fb624069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 0x7fb624069460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb644157380 tx=0x7fb62c017000 comp rx=0 tx=0).stop 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 msgr2=0x7fb64415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb63400ce10 tx=0x7fb634007810 comp rx=0 tx=0).stop 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 shutdown_connections 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb624066fb0 0x7fb624069460 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb64415a2a0 0x7fb644147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64406d650 0x7fb64415d280 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 --2- 172.21.15.6:0/1907905837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6440ceb30 0x7fb64415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 >> 172.21.15.6:0/1907905837 conn(0x7fb644067640 msgr2=0x7fb6440cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 shutdown_connections 2023-10-09T11:38:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:19.976+0000 7fb6493b3700 1 -- 172.21.15.6:0/1907905837 wait complete. 2023-10-09T11:38:19.989 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:38:19.989 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:38:19.990 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:38:19.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:19.990 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:20.006 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42362sec preferred_lft 42362sec 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.007 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:38:20.008 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:20.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.009 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:38:20.070 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:38:20.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.071 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:38:20.127 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:38:20.127 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:38:20.127 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:38:20.127 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:38:20.127 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:38:20.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:38:20.128 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:38:20.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.229 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:38:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:38:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:38:20.244 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:38:20.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:38:20.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:38:20.309 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:38:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:38:20.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:38:20.365 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:38:20.418 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:38:20.418 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:38:20.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:20.499 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:20.499 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:20.518 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:20.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:20.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:38:20.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:38:20.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:38:20.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:38:20.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:38:20.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:38:20.540 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:38:20.541 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:38:20.542 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:38:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:20.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:38:20.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:38:20.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.765+0000 7f2739769700 1 Processor -- start 2023-10-09T11:38:20.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 -- start start 2023-10-09T11:38:20.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 0x7f27340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273406d120 0x7f273406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273406dac0 con 0x7f27341578d0 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340d07c0 con 0x7f273406d120 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.766+0000 7f2739769700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27340cfbb0 con 0x7f2734157ca0 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273406d120 0x7f273406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f273406d120 0x7f273406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37290/0 (socket says 172.21.15.6:37290) 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 -- 172.21.15.6:0/3825317592 learned_addr learned my addr 172.21.15.6:0/3825317592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27327fc700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 0x7f27340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 -- 172.21.15.6:0/3825317592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 msgr2=0x7f27340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:20.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 0x7f27340cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 -- 172.21.15.6:0/3825317592 >> v1:172.21.15.118:6789/0 conn(0x7f27341578d0 legacy=0x7f273415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 -- 172.21.15.6:0/3825317592 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340cfe90 con 0x7f273406d120 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27327fc700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 0x7f27340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f27337fe700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406d120 0x7f273406d580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f272c009f20 tx=0x7f272c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3015ce330ed2685d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f2731ffb700 1 -- 172.21.15.6:0/3825317592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00e070 con 0x7f273406d120 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f2731ffb700 1 -- 172.21.15.6:0/3825317592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00ba40 con 0x7f273406d120 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.767+0000 7f2731ffb700 1 -- 172.21.15.6:0/3825317592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0092e0 con 0x7f273406d120 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 -- 172.21.15.6:0/3825317592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406d120 msgr2=0x7f273406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:20.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406d120 0x7f273406d580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f272c009f20 tx=0x7f272c009840 comp rx=0 tx=0).stop 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 -- 172.21.15.6:0/3825317592 shutdown_connections 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f273406d120 0x7f273406d580 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 --2- 172.21.15.6:0/3825317592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2734157ca0 0x7f27340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 -- 172.21.15.6:0/3825317592 >> 172.21.15.6:0/3825317592 conn(0x7f273406bb90 msgr2=0x7f273406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 -- 172.21.15.6:0/3825317592 shutdown_connections 2023-10-09T11:38:20.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.768+0000 7f2739769700 1 -- 172.21.15.6:0/3825317592 wait complete. 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.769+0000 7f2739769700 1 Processor -- start 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.769+0000 7f2739769700 1 -- start start 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f273406d120 0x7f27340b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2734157ca0 0x7f2734169580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273416dbf0 con 0x7f27341578d0 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273416ded0 con 0x7f2734157ca0 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2739769700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273416e1b0 con 0x7f273406d120 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37296/0 (socket says 172.21.15.6:37296) 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 -- 172.21.15.6:0/1392593759 learned_addr learned my addr 172.21.15.6:0/1392593759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:20.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27337fe700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2734157ca0 0x7f2734169580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f2732ffd700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f273406d120 0x7f27340b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 -- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f273406d120 msgr2=0x7f27340b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f273406d120 0x7f27340b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 -- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2734157ca0 msgr2=0x7f2734169580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2734157ca0 0x7f2734169580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 -- 172.21.15.6:0/1392593759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009ae0 con 0x7f27341578d0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.770+0000 7f27327fc700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c850 tx=0x7f271c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c011600 con 0x7f27341578d0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c011760 con 0x7f27341578d0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273414fd70 con 0x7f27341578d0 2023-10-09T11:38:20.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c011b00 con 0x7f27341578d0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273414fa00 con 0x7f27341578d0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.771+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734067ac0 con 0x7f27341578d0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.772+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f271c0223a0 con 0x7f27341578d0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.772+0000 7f272affd700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 0x7f27140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.772+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f271c0846b0 con 0x7f27341578d0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.772+0000 7f2732ffd700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 0x7f27140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.773+0000 7f2732ffd700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 0x7f27140693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2724003a30 tx=0x7f2724007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:20.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:20.777+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f271c051920 con 0x7f27341578d0 2023-10-09T11:38:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.014+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27340d0170 con 0x7f27341578d0 2023-10-09T11:38:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.015+0000 7f272affd700 1 -- 172.21.15.6:0/1392593759 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f271c054f40 con 0x7f27341578d0 2023-10-09T11:38:21.016 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 msgr2=0x7f27140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 0x7f27140693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2724003a30 tx=0x7f2724007ea0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 msgr2=0x7f273416d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c850 tx=0x7f271c008040 comp rx=0 tx=0).stop 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 shutdown_connections 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2714066f30 0x7f27140693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2734157ca0 0x7f2734169580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f273406d120 0x7f27340b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 --2- 172.21.15.6:0/1392593759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27341578d0 0x7f273416d3a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 >> 172.21.15.6:0/1392593759 conn(0x7f273406bb90 msgr2=0x7f2734069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 shutdown_connections 2023-10-09T11:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.017+0000 7f2739769700 1 -- 172.21.15.6:0/1392593759 wait complete. 2023-10-09T11:38:21.030 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:38:21.030 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:38:21.031 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:38:21.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.031 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:38:21.048 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:38:21.048 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:38:21.048 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:38:21.048 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:38:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.050 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:38:21.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.052 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:38:21.115 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:38:21.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.117 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:38:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:38:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:38:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:38:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:38:21.174 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:38:21.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:38:21.175 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:38:21.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.277 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:38:21.292 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:38:21.292 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:38:21.293 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:38:21.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:38:21.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:38:21.356 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:38:21.411 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:38:21.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:38:21.411 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:38:21.465 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:38:21.465 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:38:21.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:21.544 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:21.544 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:21.563 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:21.563 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:21.563 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:38:21.563 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:38:21.563 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:38:21.564 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:38:21.564 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:38:21.564 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:38:21.585 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:38:21.586 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:38:21.586 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:38:21.586 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:38:21.587 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:38:21.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:38:21.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:38:21.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:38:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.779+0000 7f20d47b2700 1 Processor -- start 2023-10-09T11:38:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.779+0000 7f20d47b2700 1 -- start start 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d47b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20cc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d47b2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0d07c0 con 0x7f20cc06d120 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d47b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0cfbb0 con 0x7f20cc157ca0 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d47b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0cfe90 con 0x7f20cc1578d0 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d2d4f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20cc06d120 0x7f20cc15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60140/0 (socket says 172.21.15.6:60140) 2023-10-09T11:38:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.780+0000 7f20d2d4f700 1 -- 172.21.15.6:0/3805285456 learned_addr learned my addr 172.21.15.6:0/3805285456 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:38:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d254e700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20cc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433387111 0 0) 0x7f20cc0d07c0 con 0x7f20cc06d120 2023-10-09T11:38:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b4003570 con 0x7f20cc06d120 2023-10-09T11:38:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266764972 0 0) 0x7f20b4003570 con 0x7f20cc06d120 2023-10-09T11:38:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 msgr2=0x7f20cc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20cc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 >> v1:172.21.15.118:6789/0 conn(0x7f20cc157ca0 legacy=0x7f20cc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0d0170 con 0x7f20cc06d120 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f20c40017f0 con 0x7f20cc06d120 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 >> v1:172.21.15.6:6789/0 conn(0x7f20cc06d120 legacy=0x7f20cc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20b4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20b4003fd0 0x7f20b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b4004d50 0x7f20b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0cfe90 con 0x7f20b4004d50 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b400bb40 con 0x7f20b4003fd0 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b400bd00 con 0x7f20cc1578d0 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b4004d50 0x7f20b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d1d4d700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20b4003fd0 0x7f20b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.781+0000 7f20d254e700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20b4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 -- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 msgr2=0x7f20b4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20cc1578d0 0x7f20b4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 -- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20b4003fd0 msgr2=0x7f20b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:38:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20b4003fd0 0x7f20b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 -- 172.21.15.6:0/3805285456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4003570 con 0x7f20b4004d50 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b4004d50 0x7f20b40051c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a940 tx=0x7f20cc15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680110411ba1a8b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40070d0 con 0x7f20b4004d50 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4007250 con 0x7f20b4004d50 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d154c700 1 -- 172.21.15.6:0/3805285456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4007610 con 0x7f20b4004d50 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 -- 172.21.15.6:0/3805285456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b4004d50 msgr2=0x7f20b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 --2- 172.21.15.6:0/3805285456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b4004d50 0x7f20b40051c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a940 tx=0x7f20cc15b610 comp rx=0 tx=0).stop 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d2d4f700 1 -- 172.21.15.6:0/3805285456 reap_dead start 2023-10-09T11:38:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 -- 172.21.15.6:0/3805285456 shutdown_connections 2023-10-09T11:38:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 -- 172.21.15.6:0/3805285456 >> 172.21.15.6:0/3805285456 conn(0x7f20cc06bb90 msgr2=0x7f20cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 -- 172.21.15.6:0/3805285456 shutdown_connections 2023-10-09T11:38:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.782+0000 7f20d47b2700 1 -- 172.21.15.6:0/3805285456 wait complete. 2023-10-09T11:38:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 Processor -- start 2023-10-09T11:38:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 -- start start 2023-10-09T11:38:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20b4004d50 0x7f20cc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20cc0c5b20 0x7f20cc0b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0c70a0 con 0x7f20cc0c5f90 2023-10-09T11:38:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0c6490 con 0x7f20cc0c5b20 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d47b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0c6770 con 0x7f20b4004d50 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d2d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d2d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37320/0 (socket says 172.21.15.6:37320) 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.784+0000 7f20d2d4f700 1 -- 172.21.15.6:0/1483640846 learned_addr learned my addr 172.21.15.6:0/1483640846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d1d4d700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20cc0c5b20 0x7f20cc0b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d254e700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20b4004d50 0x7f20cc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 -- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20b4004d50 msgr2=0x7f20cc154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20b4004d50 0x7f20cc154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 -- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20cc0c5b20 msgr2=0x7f20cc0b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20cc0c5b20 0x7f20cc0b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 -- 172.21.15.6:0/1483640846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0c6a50 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d2d4f700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000f80 tx=0x7f20c4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40017f0 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c40011c0 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc0c6d30 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4001330 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.785+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc0cd790 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.786+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc0b3ba0 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.787+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20c4029460 con 0x7f20cc0c5f90 2023-10-09T11:38:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.787+0000 7f20ca7fc700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 0x7f20b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:38:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.787+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20c4086ad0 con 0x7f20cc0c5f90 2023-10-09T11:38:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.787+0000 7f20d254e700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 0x7f20b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:38:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.788+0000 7f20d254e700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 0x7f20b80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006f00 tx=0x7f20bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:38:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:21.792+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20cc0b3ba0 con 0x7f20cc0c5f90 2023-10-09T11:38:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.031+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20cc0b3ba0 con 0x7f20cc0c5f90 2023-10-09T11:38:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.031+0000 7f20ca7fc700 1 -- 172.21.15.6:0/1483640846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f20cc0b3ba0 con 0x7f20cc0c5f90 2023-10-09T11:38:22.033 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:38:22.033 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 msgr2=0x7f20b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 0x7f20b80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f20bc006f00 tx=0x7f20bc008040 comp rx=0 tx=0).stop 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 msgr2=0x7f20cc0b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000f80 tx=0x7f20c4015000 comp rx=0 tx=0).stop 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 shutdown_connections 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20b8066f30 0x7f20b80693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20cc0c5f90 0x7f20cc0b65b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20b4004d50 0x7f20cc154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 --2- 172.21.15.6:0/1483640846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20cc0c5b20 0x7f20cc0b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 >> 172.21.15.6:0/1483640846 conn(0x7f20cc06bb90 msgr2=0x7f20cc156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 shutdown_connections 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:38:22.033+0000 7f20d47b2700 1 -- 172.21.15.6:0/1483640846 wait complete. 2023-10-09T11:38:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:38:22.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T11:38:22.185 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":5697,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.029595485,"mdsmap_epoch":35,"osdmap_epoch":62,"osdmap_epoch_barrier":62,"uptime":17.982704004999999} 2023-10-09T11:38:22.185 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 5697, "mdsmap_epoch": 35, "osdmap_epoch": 62, "osdmap_epoch_barrier": 62, "rank_uptime": 13.029595485, "state": "up:active", "uptime": 17.982704005, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:38:22.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:38:22.319 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:38:22.319 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:38:22.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T11:38:22.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"mon_tick_interval":"5"} 2023-10-09T11:38:22.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T11:38:22.446 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> import time 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> import datetime 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.446 DEBUG:teuthology.orchestra.run.smithi006:> # Write some buffered data through before going full, all should be well 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> print("writing some data through which we expect to succeed") 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> bytes = 0 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> # from write 2023-10-09T11:38:22.447 DEBUG:teuthology.orchestra.run.smithi006:> full = False 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(531 * 0.9)): 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> print("done writing {0} bytes".format(bytes)) 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> # OK, now we should sneak in under the full condition 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> # due to the time it takes the OSDs to report to the 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> # mons, and get a successful fsync on our full-making data 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> # buffered write, add more dirty data to the buffer 2023-10-09T11:38:22.448 DEBUG:teuthology.orchestra.run.smithi006:> print("starting buffered write") 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(531 * 0.2)): 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(15.0) 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> except OSError: 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> pass; 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> # Wait long enough for a background flush that should fail 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(30) 2023-10-09T11:38:22.449 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> # ...and check that the failed background flush is reflected in fclose 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> except OSError: 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> print("close() returned an error as expected") 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("close() failed to raise error") 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> # The kernel cephfs client does not raise errors on fclose 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:38:22.450 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T11:38:22.451 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:writing some data through which we expect to succeed 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-09T11:38:24.273 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-09T11:38:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-09T11:38:24.275 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-09T11:38:24.276 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-09T11:38:24.277 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-09T11:38:24.278 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-09T11:38:24.279 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-09T11:38:24.280 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-09T11:38:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-09T11:38:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-09T11:38:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-09T11:38:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-09T11:38:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-09T11:38:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-09T11:38:24.287 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-09T11:38:24.288 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-09T11:38:24.288 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-09T11:38:24.288 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-09T11:38:24.288 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-09T11:38:24.288 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-09T11:38:24.289 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-09T11:38:24.290 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-09T11:38:24.291 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-09T11:38:24.327 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-09T11:38:24.327 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-09T11:38:24.328 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-09T11:38:24.329 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-09T11:38:24.330 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-09T11:38:24.331 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-09T11:38:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-09T11:38:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-09T11:38:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-09T11:38:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-09T11:38:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-09T11:38:24.337 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-09T11:38:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-09T11:38:24.339 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-09T11:38:24.340 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-09T11:38:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-09T11:38:24.379 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-09T11:38:24.380 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-09T11:38:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-09T11:38:24.382 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-09T11:38:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-09T11:38:24.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-09T11:38:24.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-09T11:38:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-09T11:38:24.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-09T11:38:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-09T11:38:24.389 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-09T11:38:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-09T11:38:24.391 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-09T11:38:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-09T11:38:24.393 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-09T11:38:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-09T11:38:26.906 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:38:26.905+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-09T11:38:34.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:34.068 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:38:35.885 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:38:35.884+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T11:39:04.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:04.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:34.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:34.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:39:39.792 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-09T11:39:39.792 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-09T11:39:39.792 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-09T11:39:39.792 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:done writing 500695040 bytes 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:successfully fsync'ed prior to getting full state reported 2023-10-09T11:39:39.793 INFO:teuthology.orchestra.run.smithi006.stdout:starting buffered write 2023-10-09T11:39:39.794 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:39:39.794 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:39:39.794 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:39:39.794 INFO:teuthology.orchestra.run.smithi006.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-09T11:39:39.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:39:39.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:39:39.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:39:39.915 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:39:39.915 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:39:39.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:39.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:39:39.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:39:39.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:39:39.954 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:39:40.009 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:39:40.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:39:40.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:39:40.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:39:40.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:39:40.046 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:39:40.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.255+0000 7f58b27fa700 1 Processor -- start 2023-10-09T11:39:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.255+0000 7f58b27fa700 1 -- start start 2023-10-09T11:39:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b27fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f58ac155c60 0x7f58ac156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b27fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b27fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac0ca550 con 0x7f58ac0cbc90 2023-10-09T11:39:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b27fa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac0cb3b0 con 0x7f58ac155c60 2023-10-09T11:39:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b27fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0ca7a0 con 0x7f58ac0cb840 2023-10-09T11:39:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58ab7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b0d97700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f58ac0cbc90 0x7f58ac159ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:41062/0 (socket says 172.21.15.6:41062) 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58b0d97700 1 -- 172.21.15.6:0/685515233 learned_addr learned my addr 172.21.15.6:0/685515233 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58abfff700 1 --2- 172.21.15.6:0/685515233 >> v2:172.21.15.118:3300/0 conn(0x7f58ac155c60 0x7f58ac156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58aaffd700 1 -- 172.21.15.6:0/685515233 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683601207 0 0) 0x7f58ac0ca550 con 0x7f58ac0cbc90 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58aaffd700 1 -- 172.21.15.6:0/685515233 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5894005780 con 0x7f58ac0cbc90 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58abfff700 1 -- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 msgr2=0x7f58ac0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58abfff700 1 --2- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58abfff700 1 -- 172.21.15.6:0/685515233 >> v1:172.21.15.118:6789/0 conn(0x7f58ac0cbc90 legacy=0x7f58ac159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.257+0000 7f58abfff700 1 -- 172.21.15.6:0/685515233 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0caa80 con 0x7f58ac155c60 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.258+0000 7f58abfff700 1 --2- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac155c60 0x7f58ac156030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009e60 tx=0x7f58a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4276aee5f1cf499c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.258+0000 7f58aaffd700 1 -- 172.21.15.6:0/685515233 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400e070 con 0x7f58ac155c60 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.258+0000 7f58aaffd700 1 -- 172.21.15.6:0/685515233 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a400bab0 con 0x7f58ac155c60 2023-10-09T11:39:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.258+0000 7f58aaffd700 1 -- 172.21.15.6:0/685515233 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400be70 con 0x7f58ac155c60 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.259+0000 7f58b27fa700 1 -- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac155c60 msgr2=0x7f58ac156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.259+0000 7f58b27fa700 1 --2- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac155c60 0x7f58ac156030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009e60 tx=0x7f58a4009780 comp rx=0 tx=0).stop 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 -- 172.21.15.6:0/685515233 shutdown_connections 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 --2- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac155c60 0x7f58ac156030 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 --2- 172.21.15.6:0/685515233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 -- 172.21.15.6:0/685515233 >> 172.21.15.6:0/685515233 conn(0x7f58ac0cc980 msgr2=0x7f58ac0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 -- 172.21.15.6:0/685515233 shutdown_connections 2023-10-09T11:39:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.260+0000 7f58b27fa700 1 -- 172.21.15.6:0/685515233 wait complete. 2023-10-09T11:39:40.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.261+0000 7f58b27fa700 1 Processor -- start 2023-10-09T11:39:40.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.262+0000 7f58b27fa700 1 -- start start 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 0x7f58ac16ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 0x7f58ac0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac154e90 con 0x7f58ac155c60 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0ae3e0 con 0x7f58ac0cbc90 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b27fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac16b2c0 con 0x7f58ac0cb840 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58abfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58abfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:50466/0 (socket says 172.21.15.6:50466) 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58abfff700 1 -- 172.21.15.6:0/357531215 learned_addr learned my addr 172.21.15.6:0/357531215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58b0d97700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 0x7f58ac0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.263+0000 7f58ab7fe700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 0x7f58ac16ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 -- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 msgr2=0x7f58ac16ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 0x7f58ac16ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 -- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 msgr2=0x7f58ac0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 0x7f58ac0c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009a20 con 0x7f58ac0cb840 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58ab7fe700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 0x7f58ac16ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58b0d97700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 0x7f58ac0c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.264+0000 7f58abfff700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097c0 tx=0x7f58a4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.265+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4012d80 con 0x7f58ac0cb840 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.265+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac15aec0 con 0x7f58ac0cb840 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.265+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac15a590 con 0x7f58ac0cb840 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.265+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4027470 con 0x7f58ac0cb840 2023-10-09T11:39:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.265+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4027850 con 0x7f58ac0cb840 2023-10-09T11:39:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.266+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c0052b0 con 0x7f58ac0cb840 2023-10-09T11:39:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.267+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58a4024070 con 0x7f58ac0cb840 2023-10-09T11:39:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.267+0000 7f5893fff700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 0x7f58980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.268+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58a4086dd0 con 0x7f58ac0cb840 2023-10-09T11:39:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.268+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f589806ea50 con 0x7f58ac0cb840 2023-10-09T11:39:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.268+0000 7f58ab7fe700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 0x7f58980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.268+0000 7f58ab7fe700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 0x7f58980693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58ac16b4d0 tx=0x7f58a00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.273+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58a402c060 con 0x7f58ac0cb840 2023-10-09T11:39:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.532+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f588c005560 con 0x7f58ac0cb840 2023-10-09T11:39:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.533+0000 7f5893fff700 1 -- 172.21.15.6:0/357531215 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f58a4088070 con 0x7f58ac0cb840 2023-10-09T11:39:40.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:40.535 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 msgr2=0x7f58980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 0x7f58980693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58ac16b4d0 tx=0x7f58a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 msgr2=0x7f58ac154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58a40097c0 tx=0x7f58a4019000 comp rx=0 tx=0).stop 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 shutdown_connections 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5898066f30 0x7f58980693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58ac155c60 0x7f58ac0c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58ac0cb840 0x7f58ac154950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 --2- 172.21.15.6:0/357531215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58ac0cbc90 0x7f58ac16ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 >> 172.21.15.6:0/357531215 conn(0x7f58ac0cc980 msgr2=0x7f58ac0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 shutdown_connections 2023-10-09T11:39:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.535+0000 7f58b27fa700 1 -- 172.21.15.6:0/357531215 wait complete. 2023-10-09T11:39:40.538 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:39:40.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.667+0000 7f15fed87700 1 Processor -- start 2023-10-09T11:39:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.667+0000 7f15fed87700 1 -- start start 2023-10-09T11:39:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fed87700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f8159b40 0x7f15f80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fed87700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 0x7f15f8068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fed87700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80cee10 con 0x7f15f80ccb40 2023-10-09T11:39:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fed87700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80cd040 con 0x7f15f8159b40 2023-10-09T11:39:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fed87700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80cd320 con 0x7f15f8159f10 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f8159b40 0x7f15f80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f8159b40 0x7f15f80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51068/0 (socket says 172.21.15.6:51068) 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 -- 172.21.15.6:0/459648949 learned_addr learned my addr 172.21.15.6:0/459648949 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fd584700 1 --2- 172.21.15.6:0/459648949 >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 0x7f15f8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 -- 172.21.15.6:0/459648949 >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 msgr2=0x7f15f8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 --2- 172.21.15.6:0/459648949 >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 0x7f15f8068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 -- 172.21.15.6:0/459648949 >> v1:172.21.15.118:6789/0 conn(0x7f15f80ccb40 legacy=0x7f15f815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fdd85700 1 -- 172.21.15.6:0/459648949 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80ce7c0 con 0x7f15f8159b40 2023-10-09T11:39:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.668+0000 7f15fd584700 1 --2- 172.21.15.6:0/459648949 >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 0x7f15f8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fdd85700 1 --2- 172.21.15.6:0/459648949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f80cc600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f15f806fd80 tx=0x7f15f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b461f42dc446e584 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fcd83700 1 -- 172.21.15.6:0/459648949 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000b820 con 0x7f15f8159b40 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fcd83700 1 -- 172.21.15.6:0/459648949 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000b980 con 0x7f15f8159b40 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fcd83700 1 -- 172.21.15.6:0/459648949 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000bd20 con 0x7f15f8159b40 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 -- 172.21.15.6:0/459648949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 msgr2=0x7f15f80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 --2- 172.21.15.6:0/459648949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f80cc600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f15f806fd80 tx=0x7f15f0009250 comp rx=0 tx=0).stop 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 -- 172.21.15.6:0/459648949 shutdown_connections 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 --2- 172.21.15.6:0/459648949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f80cc600 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 --2- 172.21.15.6:0/459648949 >> v2:172.21.15.118:3300/0 conn(0x7f15f8159f10 0x7f15f8068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 -- 172.21.15.6:0/459648949 >> 172.21.15.6:0/459648949 conn(0x7f15f80cd660 msgr2=0x7f15f80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 -- 172.21.15.6:0/459648949 shutdown_connections 2023-10-09T11:39:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.669+0000 7f15fed87700 1 -- 172.21.15.6:0/459648949 wait complete. 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.670+0000 7f15fed87700 1 Processor -- start 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.670+0000 7f15fed87700 1 -- start start 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f80ccb40 0x7f15f815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8159f10 0x7f15f816a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8157660 con 0x7f15f8159b40 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815cdf0 con 0x7f15f80ccb40 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fed87700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8157ee0 con 0x7f15f8159f10 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fd584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fd584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51072/0 (socket says 172.21.15.6:51072) 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fd584700 1 -- 172.21.15.6:0/1395220505 learned_addr learned my addr 172.21.15.6:0/1395220505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fdd85700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f80ccb40 0x7f15f815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.671+0000 7f15fe586700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8159f10 0x7f15f816a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 -- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8159f10 msgr2=0x7f15f816a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8159f10 0x7f15f816a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 -- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f80ccb40 msgr2=0x7f15f815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f80ccb40 0x7f15f815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00094f0 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fd584700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c880 tx=0x7f15ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011600 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec011760 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f815c850 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011b00 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.672+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f8157890 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.673+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80cb910 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15ec018350 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15f5ffb700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 0x7f15e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15ec084390 con 0x7f15f8159b40 2023-10-09T11:39:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15fdd85700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 0x7f15e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f15e406ea80 con 0x7f15f8159b40 2023-10-09T11:39:40.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.674+0000 7f15fdd85700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 0x7f15e4069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15f806fd80 tx=0x7f15f0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.678+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15ec051560 con 0x7f15f8159b40 2023-10-09T11:39:40.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.871+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15f8158020 con 0x7f15f8159b40 2023-10-09T11:39:40.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.872+0000 7f15f5ffb700 1 -- 172.21.15.6:0/1395220505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15360 (secure 0 0 0) 0x7f15ec01e090 con 0x7f15f8159b40 2023-10-09T11:39:40.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:40.873 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:38:29.971540+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 msgr2=0x7f15e4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 0x7f15e4069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15f806fd80 tx=0x7f15f0016000 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 msgr2=0x7f15f815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c880 tx=0x7f15ec008040 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 shutdown_connections 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f15e4066f60 0x7f15e4069410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15f8159f10 0x7f15f816a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15f80ccb40 0x7f15f815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 --2- 172.21.15.6:0/1395220505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f8159b40 0x7f15f815c310 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:40.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 >> 172.21.15.6:0/1395220505 conn(0x7f15f80cd660 msgr2=0x7f15f806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:40.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 shutdown_connections 2023-10-09T11:39:40.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:40.874+0000 7f15fed87700 1 -- 172.21.15.6:0/1395220505 wait complete. 2023-10-09T11:39:40.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:38:06.942683+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:38:07.491085+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:39:40.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:39:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.008+0000 7f54a1dd2700 1 Processor -- start 2023-10-09T11:39:41.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.008+0000 7f54a1dd2700 1 -- start start 2023-10-09T11:39:41.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f54a1dd2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f549c0aeea0 0x7f549c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f54a1dd2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f549c0c8410 0x7f549c0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f54a1dd2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c06aae0 con 0x7f549c0af270 2023-10-09T11:39:41.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f54a1dd2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c0c8810 con 0x7f549c0c8410 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f54a1dd2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c069ed0 con 0x7f549c0aeea0 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f549bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f549c0c8410 0x7f549c0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f549bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f549c0c8410 0x7f549c0c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51086/0 (socket says 172.21.15.6:51086) 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f549bfff700 1 -- 172.21.15.6:0/4130626500 learned_addr learned my addr 172.21.15.6:0/4130626500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f549affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f549c0af270 0x7f549c0c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37192/0 (socket says 172.21.15.6:37192) 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.009+0000 7f549b7fe700 1 --2- 172.21.15.6:0/4130626500 >> v2:172.21.15.118:3300/0 conn(0x7f549c0aeea0 0x7f549c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549bfff700 1 -- 172.21.15.6:0/4130626500 >> v2:172.21.15.118:3300/0 conn(0x7f549c0aeea0 msgr2=0x7f549c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549bfff700 1 --2- 172.21.15.6:0/4130626500 >> v2:172.21.15.118:3300/0 conn(0x7f549c0aeea0 0x7f549c0c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549bfff700 1 -- 172.21.15.6:0/4130626500 >> v1:172.21.15.6:6789/0 conn(0x7f549c0af270 legacy=0x7f549c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549bfff700 1 -- 172.21.15.6:0/4130626500 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c06a1b0 con 0x7f549c0c8410 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549a7fc700 1 -- 172.21.15.6:0/4130626500 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793377905 0 0) 0x7f549c06aae0 con 0x7f549c0af270 2023-10-09T11:39:41.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549bfff700 1 --2- 172.21.15.6:0/4130626500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0c8410 0x7f549c0c2e60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f549c06f710 tx=0x7f5494009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9135ad78717e789 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549a7fc700 1 -- 172.21.15.6:0/4130626500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400e070 con 0x7f549c0c8410 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549a7fc700 1 -- 172.21.15.6:0/4130626500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400bab0 con 0x7f549c0c8410 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f549a7fc700 1 -- 172.21.15.6:0/4130626500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940092e0 con 0x7f549c0c8410 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f54a1dd2700 1 -- 172.21.15.6:0/4130626500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0c8410 msgr2=0x7f549c0c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.010+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/4130626500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0c8410 0x7f549c0c2e60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f549c06f710 tx=0x7f5494009840 comp rx=0 tx=0).stop 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 -- 172.21.15.6:0/4130626500 shutdown_connections 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/4130626500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0c8410 0x7f549c0c2e60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/4130626500 >> v2:172.21.15.118:3300/0 conn(0x7f549c0aeea0 0x7f549c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 -- 172.21.15.6:0/4130626500 >> 172.21.15.6:0/4130626500 conn(0x7f549c06c660 msgr2=0x7f549c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 -- 172.21.15.6:0/4130626500 shutdown_connections 2023-10-09T11:39:41.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.011+0000 7f54a1dd2700 1 -- 172.21.15.6:0/4130626500 wait complete. 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.012+0000 7f54a1dd2700 1 Processor -- start 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.012+0000 7f54a1dd2700 1 -- start start 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.012+0000 7f54a1dd2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f549c0af270 0x7f549c1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f549c0c8410 0x7f549c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c168520 con 0x7f549c0aeea0 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0c51f0 con 0x7f549c0c8410 2023-10-09T11:39:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c1532d0 con 0x7f549c0af270 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51096/0 (socket says 172.21.15.6:51096) 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 -- 172.21.15.6:0/2433155775 learned_addr learned my addr 172.21.15.6:0/2433155775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549bfff700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f549c0c8410 0x7f549c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549affd700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f549c0af270 0x7f549c1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 -- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f549c0af270 msgr2=0x7f549c1674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f549c0af270 0x7f549c1674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 -- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f549c0c8410 msgr2=0x7f549c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f549c0c8410 0x7f549c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009ae0 con 0x7f549c0aeea0 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f549b7fe700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f548c00ec80 tx=0x7f548c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00c850 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00c9b0 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c1686e0 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00cd50 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.013+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c168240 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.014+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c068470 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.015+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f548c013680 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.015+0000 7f54837fe700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 0x7f54880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.015+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f548c084760 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.015+0000 7f549affd700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 0x7f54880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.015+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f548806ea50 con 0x7f549c0aeea0 2023-10-09T11:39:41.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.016+0000 7f549affd700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 0x7f54880693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f549c0641c0 tx=0x7f5490007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.019+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f548c0519d0 con 0x7f549c0aeea0 2023-10-09T11:39:41.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.211+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f549c06a490 con 0x7f549c0aeea0 2023-10-09T11:39:41.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.212+0000 7f54837fe700 1 -- 172.21.15.6:0/2433155775 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f548c054ff0 con 0x7f549c0aeea0 2023-10-09T11:39:41.213 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:39:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 msgr2=0x7f54880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 0x7f54880693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f549c0641c0 tx=0x7f5490007d50 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 msgr2=0x7f549c152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f548c00ec80 tx=0x7f548c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 shutdown_connections 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5488066f30 0x7f54880693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f549c0c8410 0x7f549c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0aeea0 0x7f549c152d90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 --2- 172.21.15.6:0/2433155775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f549c0af270 0x7f549c1674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 >> 172.21.15.6:0/2433155775 conn(0x7f549c06c660 msgr2=0x7f549c0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 shutdown_connections 2023-10-09T11:39:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.214+0000 7f54a1dd2700 1 -- 172.21.15.6:0/2433155775 wait complete. 2023-10-09T11:39:41.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:39:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.347+0000 7f2f9947e700 1 Processor -- start 2023-10-09T11:39:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.347+0000 7f2f9947e700 1 -- start start 2023-10-09T11:39:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f9947e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 0x7f2f940b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f9947e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f940b17c0 con 0x7f2f940cefa0 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f9947e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f940b1d80 con 0x7f2f94067640 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f9947e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940b37b0 con 0x7f2f940add30 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f937fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f940cefa0 0x7f2f940cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37202/0 (socket says 172.21.15.6:37202) 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f937fe700 1 -- 172.21.15.6:0/1697208836 learned_addr learned my addr 172.21.15.6:0/1697208836 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f92ffd700 1 --2- 172.21.15.6:0/1697208836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 0x7f2f940b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.348+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344558233 0 0) 0x7f2f940b17c0 con 0x7f2f940cefa0 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f80003570 con 0x7f2f940cefa0 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193996261 0 0) 0x7f2f940b1d80 con 0x7f2f94067640 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f940b17c0 con 0x7f2f94067640 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f92ffd700 1 -- 172.21.15.6:0/1697208836 >> v1:172.21.15.118:6789/0 conn(0x7f2f94067640 legacy=0x7f2f940ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f92ffd700 1 -- 172.21.15.6:0/1697208836 >> v1:172.21.15.6:6789/0 conn(0x7f2f940cefa0 legacy=0x7f2f940cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f92ffd700 1 -- 172.21.15.6:0/1697208836 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94068220 con 0x7f2f940add30 2023-10-09T11:39:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f92ffd700 1 --2- 172.21.15.6:0/1697208836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 0x7f2f940b2210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009e90 tx=0x7f2f84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23fe7b12208a716c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e070 con 0x7f2f940add30 2023-10-09T11:39:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400bb80 con 0x7f2f940add30 2023-10-09T11:39:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f91ffb700 1 -- 172.21.15.6:0/1697208836 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84012430 con 0x7f2f940add30 2023-10-09T11:39:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f9947e700 1 -- 172.21.15.6:0/1697208836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 msgr2=0x7f2f940b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f9947e700 1 --2- 172.21.15.6:0/1697208836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 0x7f2f940b2210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009e90 tx=0x7f2f84009780 comp rx=0 tx=0).stop 2023-10-09T11:39:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f9947e700 1 -- 172.21.15.6:0/1697208836 shutdown_connections 2023-10-09T11:39:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.349+0000 7f2f9947e700 1 --2- 172.21.15.6:0/1697208836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940add30 0x7f2f940b2210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.350+0000 7f2f9947e700 1 -- 172.21.15.6:0/1697208836 >> 172.21.15.6:0/1697208836 conn(0x7f2f9406c620 msgr2=0x7f2f9406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.350+0000 7f2f9947e700 1 -- 172.21.15.6:0/1697208836 shutdown_connections 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.350+0000 7f2f9947e700 1 -- 172.21.15.6:0/1697208836 wait complete. 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.351+0000 7f2f9947e700 1 Processor -- start 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.351+0000 7f2f9947e700 1 -- start start 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.351+0000 7f2f9947e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f94067640 0x7f2f940acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.351+0000 7f2f9947e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 0x7f2f940a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f941541c0 con 0x7f2f940add30 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940a7470 con 0x7f2f94067640 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940a9980 con 0x7f2f940cefa0 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51106/0 (socket says 172.21.15.6:51106) 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 -- 172.21.15.6:0/3869140412 learned_addr learned my addr 172.21.15.6:0/3869140412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f92ffd700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f94067640 0x7f2f940acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f937fe700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 0x7f2f940a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 -- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 msgr2=0x7f2f940a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 0x7f2f940a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 -- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f94067640 msgr2=0x7f2f940acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f94067640 0x7f2f940acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009a20 con 0x7f2f940add30 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f937fe700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 0x7f2f940a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f927fc700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c790 tx=0x7f2f7c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c010510 con 0x7f2f940add30 2023-10-09T11:39:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c010670 con 0x7f2f940add30 2023-10-09T11:39:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f940a9c60 con 0x7f2f940add30 2023-10-09T11:39:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c010a30 con 0x7f2f940add30 2023-10-09T11:39:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.352+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f940aa220 con 0x7f2f940add30 2023-10-09T11:39:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.353+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f940a75e0 con 0x7f2f940add30 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.354+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f7c01b3b0 con 0x7f2f940add30 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.354+0000 7f2f8affd700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.354+0000 7f2f92ffd700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.354+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f7c083e20 con 0x7f2f940add30 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.355+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f2f7406ea50 con 0x7f2f940add30 2023-10-09T11:39:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.355+0000 7f2f92ffd700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 0x7f2f740693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009de0 tx=0x7f2f84019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.359+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f7c017020 con 0x7f2f940add30 2023-10-09T11:39:41.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.550+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f94154300 con 0x7f2f940add30 2023-10-09T11:39:41.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.550+0000 7f2f8affd700 1 -- 172.21.15.6:0/3869140412 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f7c051090 con 0x7f2f940add30 2023-10-09T11:39:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 msgr2=0x7f2f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 0x7f2f740693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009de0 tx=0x7f2f84019000 comp rx=0 tx=0).stop 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 msgr2=0x7f2f940a6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c790 tx=0x7f2f7c007e10 comp rx=0 tx=0).stop 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 shutdown_connections 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f940cefa0 0x7f2f940a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f94067640 0x7f2f940acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 --2- 172.21.15.6:0/3869140412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f940add30 0x7f2f940a6f30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 >> 172.21.15.6:0/3869140412 conn(0x7f2f9406c620 msgr2=0x7f2f94157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 shutdown_connections 2023-10-09T11:39:41.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.552+0000 7f2f9947e700 1 -- 172.21.15.6:0/3869140412 wait complete. 2023-10-09T11:39:41.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:39:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.686+0000 7f73461e4700 1 Processor -- start 2023-10-09T11:39:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.686+0000 7f73461e4700 1 -- start start 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f73461e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73401578d0 0x7f73400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f73461e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7340157ca0 0x7f734015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f73461e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400d07c0 con 0x7f734006d120 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f73461e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400cfbb0 con 0x7f73401578d0 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f73461e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400cfe90 con 0x7f7340157ca0 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73401578d0 0x7f73400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f734006d120 0x7f734015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37214/0 (socket says 172.21.15.6:37214) 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733ffff700 1 -- 172.21.15.6:0/762799283 learned_addr learned my addr 172.21.15.6:0/762799283 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733effd700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7340157ca0 0x7f734015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 -- 172.21.15.6:0/762799283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7340157ca0 msgr2=0x7f734015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7340157ca0 0x7f734015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 -- 172.21.15.6:0/762799283 >> v1:172.21.15.6:6789/0 conn(0x7f734006d120 legacy=0x7f734015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 -- 172.21.15.6:0/762799283 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400d0170 con 0x7f73401578d0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733e7fc700 1 -- 172.21.15.6:0/762799283 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240012376 0 0) 0x7f73400d07c0 con 0x7f734006d120 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.687+0000 7f733f7fe700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73401578d0 0x7f73400cf4f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f73300098e0 tx=0x7f73300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716701d4fdb84323 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f733e7fc700 1 -- 172.21.15.6:0/762799283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330009e80 con 0x7f73401578d0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f733e7fc700 1 -- 172.21.15.6:0/762799283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000b860 con 0x7f73401578d0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f733e7fc700 1 -- 172.21.15.6:0/762799283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000bbe0 con 0x7f73401578d0 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 -- 172.21.15.6:0/762799283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73401578d0 msgr2=0x7f73400cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73401578d0 0x7f73400cf4f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f73300098e0 tx=0x7f73300091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 -- 172.21.15.6:0/762799283 shutdown_connections 2023-10-09T11:39:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73401578d0 0x7f73400cf4f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 --2- 172.21.15.6:0/762799283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7340157ca0 0x7f734015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 -- 172.21.15.6:0/762799283 >> 172.21.15.6:0/762799283 conn(0x7f734006bb90 msgr2=0x7f734006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 -- 172.21.15.6:0/762799283 shutdown_connections 2023-10-09T11:39:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.688+0000 7f73461e4700 1 -- 172.21.15.6:0/762799283 wait complete. 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.689+0000 7f73461e4700 1 Processor -- start 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.689+0000 7f73461e4700 1 -- start start 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734006d120 0x7f73400aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73401578d0 0x7f7340154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400b5600 con 0x7f7340157ca0 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400b4d10 con 0x7f73401578d0 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f73461e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73401550e0 con 0x7f734006d120 2023-10-09T11:39:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f733ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f733ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51128/0 (socket says 172.21.15.6:51128) 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f733ffff700 1 -- 172.21.15.6:0/3151912008 learned_addr learned my addr 172.21.15.6:0/3151912008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f733effd700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73401578d0 0x7f7340154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.690+0000 7f733f7fe700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734006d120 0x7f73400aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 -- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734006d120 msgr2=0x7f73400aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734006d120 0x7f73400aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 -- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73401578d0 msgr2=0x7f7340154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73401578d0 0x7f7340154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330009420 con 0x7f7340157ca0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f733ffff700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f733800cc90 tx=0x7f7338001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800a8b0 con 0x7f7340157ca0 2023-10-09T11:39:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800aa10 con 0x7f7340157ca0 2023-10-09T11:39:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800add0 con 0x7f7340157ca0 2023-10-09T11:39:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73400adfa0 con 0x7f7340157ca0 2023-10-09T11:39:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.691+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400b5290 con 0x7f7340157ca0 2023-10-09T11:39:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.692+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400b5770 con 0x7f7340157ca0 2023-10-09T11:39:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.692+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7338007300 con 0x7f7340157ca0 2023-10-09T11:39:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.693+0000 7f73277fe700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 0x7f732c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.693+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7338084850 con 0x7f7340157ca0 2023-10-09T11:39:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.693+0000 7f733f7fe700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 0x7f732c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.693+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f732c06ea50 con 0x7f7340157ca0 2023-10-09T11:39:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.693+0000 7f733f7fe700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 0x7f732c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73300091e0 tx=0x7f7330017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.697+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7338051b40 con 0x7f7340157ca0 2023-10-09T11:39:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.890+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73400d0450 con 0x7f7340157ca0 2023-10-09T11:39:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.890+0000 7f73277fe700 1 -- 172.21.15.6:0/3151912008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7338055160 con 0x7f7340157ca0 2023-10-09T11:39:41.892 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 msgr2=0x7f732c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 0x7f732c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73300091e0 tx=0x7f7330017000 comp rx=0 tx=0).stop 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 msgr2=0x7f73400ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f733800cc90 tx=0x7f7338001a80 comp rx=0 tx=0).stop 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 shutdown_connections 2023-10-09T11:39:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f732c066f30 0x7f732c0693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7340157ca0 0x7f73400ad760 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734006d120 0x7f73400aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 --2- 172.21.15.6:0/3151912008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73401578d0 0x7f7340154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 >> 172.21.15.6:0/3151912008 conn(0x7f734006bb90 msgr2=0x7f7340155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 shutdown_connections 2023-10-09T11:39:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:41.892+0000 7f73461e4700 1 -- 172.21.15.6:0/3151912008 wait complete. 2023-10-09T11:39:41.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.022+0000 7fc6b19cf700 1 Processor -- start 2023-10-09T11:39:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.022+0000 7fc6b19cf700 1 -- start start 2023-10-09T11:39:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6b19cf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ac1578d0 0x7fc6ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6b19cf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0d07c0 con 0x7fc6ac157ca0 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6b19cf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0cfbb0 con 0x7fc6ac06d120 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6b19cf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac0cfe90 con 0x7fc6ac1578d0 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6aaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ac1578d0 0x7fc6ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6aa7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6ac157ca0 0x7fc6ac15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37226/0 (socket says 172.21.15.6:37226) 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.023+0000 7fc6aa7fc700 1 -- 172.21.15.6:0/3857177056 learned_addr learned my addr 172.21.15.6:0/3857177056 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6aaffd700 1 -- 172.21.15.6:0/3857177056 >> v1:172.21.15.118:6789/0 conn(0x7fc6ac06d120 legacy=0x7fc6ac06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6aaffd700 1 -- 172.21.15.6:0/3857177056 >> v1:172.21.15.6:6789/0 conn(0x7fc6ac157ca0 legacy=0x7fc6ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6a9ffb700 1 -- 172.21.15.6:0/3857177056 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746687039 0 0) 0x7fc6ac0d07c0 con 0x7fc6ac157ca0 2023-10-09T11:39:42.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6aaffd700 1 -- 172.21.15.6:0/3857177056 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0d0170 con 0x7fc6ac1578d0 2023-10-09T11:39:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6aaffd700 1 --2- 172.21.15.6:0/3857177056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0cf4f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0098e0 tx=0x7fc69c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa93d5d4152b1e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6a9ffb700 1 -- 172.21.15.6:0/3857177056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c009e80 con 0x7fc6ac1578d0 2023-10-09T11:39:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6a9ffb700 1 -- 172.21.15.6:0/3857177056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00b860 con 0x7fc6ac1578d0 2023-10-09T11:39:42.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.024+0000 7fc6a9ffb700 1 -- 172.21.15.6:0/3857177056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00bbe0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 -- 172.21.15.6:0/3857177056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 msgr2=0x7fc6ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/3857177056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0cf4f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0098e0 tx=0x7fc69c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 -- 172.21.15.6:0/3857177056 shutdown_connections 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/3857177056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0cf4f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 -- 172.21.15.6:0/3857177056 >> 172.21.15.6:0/3857177056 conn(0x7fc6ac06bb90 msgr2=0x7fc6ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 -- 172.21.15.6:0/3857177056 shutdown_connections 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.025+0000 7fc6b19cf700 1 -- 172.21.15.6:0/3857177056 wait complete. 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.026+0000 7fc6b19cf700 1 Processor -- start 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.026+0000 7fc6b19cf700 1 -- start start 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ac06d120 0x7fc6ac0ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ac157ca0 0x7fc6ac1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0ae940 con 0x7fc6ac1578d0 2023-10-09T11:39:42.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0b2070 con 0x7fc6ac06d120 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6b19cf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0b2350 con 0x7fc6ac157ca0 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51140/0 (socket says 172.21.15.6:51140) 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 -- 172.21.15.6:0/4022091849 learned_addr learned my addr 172.21.15.6:0/4022091849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aaffd700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ac06d120 0x7fc6ac0ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6ab7fe700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ac157ca0 0x7fc6ac1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 -- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ac157ca0 msgr2=0x7fc6ac1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ac157ca0 0x7fc6ac1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 -- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ac06d120 msgr2=0x7fc6ac0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ac06d120 0x7fc6ac0ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009420 con 0x7fc6ac1578d0 2023-10-09T11:39:42.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6aa7fc700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c530 tx=0x7fc694007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.027+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694005b30 con 0x7fc6ac1578d0 2023-10-09T11:39:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.028+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694005c90 con 0x7fc6ac1578d0 2023-10-09T11:39:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.028+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac0b2630 con 0x7fc6ac1578d0 2023-10-09T11:39:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.028+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694007320 con 0x7fc6ac1578d0 2023-10-09T11:39:42.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.028+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac0aece0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.029+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0ac4c0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.029+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc69401b3b0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.029+0000 7fc6a2ffd700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 0x7fc68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.029+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6940838b0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.029+0000 7fc6aaffd700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 0x7fc68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.030+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7fc68c06ea50 con 0x7fc6ac1578d0 2023-10-09T11:39:42.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.030+0000 7fc6aaffd700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 0x7fc68c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0093f0 tx=0x7fc69c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.034+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc694017060 con 0x7fc6ac1578d0 2023-10-09T11:39:42.101 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:39:42.100+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-09T11:39:42.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.107+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(67..67 src has 1..67) v4 ==== 296+0+0 (secure 0 0 0) 0x7fc694054ee0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.107+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fc68c06f3a0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.273+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6ac0ac4c0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.273+0000 7fc6a2ffd700 1 -- 172.21.15.6:0/4022091849 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fc6ac0ac4c0 con 0x7fc6ac1578d0 2023-10-09T11:39:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:42.275 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:39:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 msgr2=0x7fc68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 0x7fc68c0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0093f0 tx=0x7fc69c017000 comp rx=0 tx=0).stop 2023-10-09T11:39:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 msgr2=0x7fc6ac0b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c530 tx=0x7fc694007f90 comp rx=0 tx=0).stop 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 shutdown_connections 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc68c066f30 0x7fc68c0693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ac157ca0 0x7fc6ac1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ac06d120 0x7fc6ac0ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 --2- 172.21.15.6:0/4022091849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ac1578d0 0x7fc6ac0b1620 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.275+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 >> 172.21.15.6:0/4022091849 conn(0x7fc6ac06bb90 msgr2=0x7fc6ac156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.276+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 shutdown_connections 2023-10-09T11:39:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.276+0000 7fc6b19cf700 1 -- 172.21.15.6:0/4022091849 wait complete. 2023-10-09T11:39:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:39:42.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:42.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.406+0000 7f81a7165700 1 Processor -- start 2023-10-09T11:39:42.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.406+0000 7f81a7165700 1 -- start start 2023-10-09T11:39:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a7165700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 0x7f81a00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a7165700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00d07c0 con 0x7f81a01578d0 2023-10-09T11:39:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a7165700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00cfbb0 con 0x7f81a0157ca0 2023-10-09T11:39:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a7165700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00cfe90 con 0x7f81a006d830 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a4f01700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81a01578d0 0x7f81a015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37242/0 (socket says 172.21.15.6:37242) 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a4f01700 1 -- 172.21.15.6:0/3174491623 learned_addr learned my addr 172.21.15.6:0/3174491623 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f81a5702700 1 --2- 172.21.15.6:0/3174491623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 0x7f81a00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.407+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520659091 0 0) 0x7f81a00d07c0 con 0x7f81a01578d0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8188003570 con 0x7f81a01578d0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181774273 0 0) 0x7f81a00cfbb0 con 0x7f81a0157ca0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a00d07c0 con 0x7f81a0157ca0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685693998 0 0) 0x7f8188003570 con 0x7f81a01578d0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f81a5702700 1 -- 172.21.15.6:0/3174491623 >> v1:172.21.15.118:6789/0 conn(0x7f81a0157ca0 legacy=0x7f81a006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f81a5702700 1 -- 172.21.15.6:0/3174491623 >> v1:172.21.15.6:6789/0 conn(0x7f81a01578d0 legacy=0x7f81a015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f81a5702700 1 -- 172.21.15.6:0/3174491623 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00d0170 con 0x7f81a006d830 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f81a5702700 1 --2- 172.21.15.6:0/3174491623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 0x7f81a00cf4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8198009e90 tx=0x7f8198009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdee23e7c338e913 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800e070 con 0x7f81a006d830 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800b870 con 0x7f81a006d830 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.408+0000 7f819f7fe700 1 -- 172.21.15.6:0/3174491623 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190001470 con 0x7f81a006d830 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 -- 172.21.15.6:0/3174491623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 msgr2=0x7f81a00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 --2- 172.21.15.6:0/3174491623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 0x7f81a00cf4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8198009e90 tx=0x7f8198009780 comp rx=0 tx=0).stop 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 -- 172.21.15.6:0/3174491623 shutdown_connections 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 --2- 172.21.15.6:0/3174491623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a006d830 0x7f81a00cf4f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 -- 172.21.15.6:0/3174491623 >> 172.21.15.6:0/3174491623 conn(0x7f81a006bb90 msgr2=0x7f81a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 -- 172.21.15.6:0/3174491623 shutdown_connections 2023-10-09T11:39:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.409+0000 7f81a7165700 1 -- 172.21.15.6:0/3174491623 wait complete. 2023-10-09T11:39:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.410+0000 7f81a7165700 1 Processor -- start 2023-10-09T11:39:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.410+0000 7f81a7165700 1 -- start start 2023-10-09T11:39:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a01578d0 0x7f81a00aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a0157ca0 0x7f81a0158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00ac950 con 0x7f81a006d830 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00abd40 con 0x7f81a0157ca0 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00ac020 con 0x7f81a01578d0 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51142/0 (socket says 172.21.15.6:51142) 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 -- 172.21.15.6:0/2868035248 learned_addr learned my addr 172.21.15.6:0/2868035248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a5702700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a0157ca0 0x7f81a0158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f819ffff700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a01578d0 0x7f81a00aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 -- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a01578d0 msgr2=0x7f81a00aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a01578d0 0x7f81a00aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 -- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a0157ca0 msgr2=0x7f81a0158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a0157ca0 0x7f81a0158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198009a20 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a4f01700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f819000cb70 tx=0x7f8190001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000ce80 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190007360 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00ac300 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.411+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190007700 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.412+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a00ab620 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.412+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0067ac0 con 0x7f81a006d830 2023-10-09T11:39:42.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.413+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8190004a40 con 0x7f81a006d830 2023-10-09T11:39:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.413+0000 7f819cff9700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 0x7f818c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.413+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8190083cd0 con 0x7f81a006d830 2023-10-09T11:39:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.413+0000 7f819ffff700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 0x7f818c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.413+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f818c06ea50 con 0x7f81a006d830 2023-10-09T11:39:42.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.414+0000 7f819ffff700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 0x7f818c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8194007fd0 tx=0x7f8194007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.417+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8190018060 con 0x7f81a006d830 2023-10-09T11:39:42.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.610+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81a00d0450 con 0x7f81a006d830 2023-10-09T11:39:42.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.611+0000 7f819cff9700 1 -- 172.21.15.6:0/2868035248 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15346 (secure 0 0 0) 0x7f8190050fc0 con 0x7f81a006d830 2023-10-09T11:39:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:42.613 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":67,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:42.101953+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 msgr2=0x7f818c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 0x7f818c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8194007fd0 tx=0x7f8194007d10 comp rx=0 tx=0).stop 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 msgr2=0x7f81a00acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f819000cb70 tx=0x7f8190001b50 comp rx=0 tx=0).stop 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 shutdown_connections 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f818c066f30 0x7f818c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81a0157ca0 0x7f81a0158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81a006d830 0x7f81a00acde0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 --2- 172.21.15.6:0/2868035248 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81a01578d0 0x7f81a00aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 >> 172.21.15.6:0/2868035248 conn(0x7f81a006bb90 msgr2=0x7f81a0156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 shutdown_connections 2023-10-09T11:39:42.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.613+0000 7f81a7165700 1 -- 172.21.15.6:0/2868035248 wait complete. 2023-10-09T11:39:42.627 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:39:42.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.744+0000 7ff543af6700 1 Processor -- start 2023-10-09T11:39:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 -- start start 2023-10-09T11:39:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff53c1578d0 0x7ff53c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0d07c0 con 0x7ff53c157ca0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c06daa0 con 0x7ff53c1578d0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.745+0000 7ff543af6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cfbb0 con 0x7ff53c06d120 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff541091700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff53c157ca0 0x7ff53c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37246/0 (socket says 172.21.15.6:37246) 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff541091700 1 -- 172.21.15.6:0/568008405 learned_addr learned my addr 172.21.15.6:0/568008405 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff542093700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff541892700 1 --2- 172.21.15.6:0/568008405 >> v2:172.21.15.118:3300/0 conn(0x7ff53c1578d0 0x7ff53c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662688678 0 0) 0x7ff53c0d07c0 con 0x7ff53c157ca0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524003570 con 0x7ff53c157ca0 2023-10-09T11:39:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 376388336 0 0) 0x7ff524003570 con 0x7ff53c157ca0 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 msgr2=0x7ff53c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 >> v2:172.21.15.118:3300/0 conn(0x7ff53c1578d0 msgr2=0x7ff53c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 --2- 172.21.15.6:0/568008405 >> v2:172.21.15.118:3300/0 conn(0x7ff53c1578d0 0x7ff53c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0cfe90 con 0x7ff53c157ca0 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ff530001470 con 0x7ff53c157ca0 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 >> v1:172.21.15.6:6789/0 conn(0x7ff53c157ca0 legacy=0x7ff53c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff524003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff524003fe0 0x7ff524004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff524004d50 0x7ff5240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c06daa0 con 0x7ff524004d50 2023-10-09T11:39:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cfbb0 con 0x7ff524003fe0 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52400ba90 con 0x7ff53c06d120 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff542093700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff524004d50 0x7ff5240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff541892700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff524003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.746+0000 7ff541091700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff524003fe0 0x7ff524004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 -- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff524003fe0 msgr2=0x7ff524004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff524003fe0 0x7ff524004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 -- 172.21.15.6:0/568008405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff524004d50 msgr2=0x7ff5240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff524004d50 0x7ff5240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 -- 172.21.15.6:0/568008405 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524003570 con 0x7ff53c06d120 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff542093700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff524004d50 0x7ff5240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff541892700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff524003a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00e210 tx=0x7ff52c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e2b274b4db880d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00ea60 con 0x7ff53c06d120 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00f040 con 0x7ff53c06d120 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.747+0000 7ff540890700 1 -- 172.21.15.6:0/568008405 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00ee10 con 0x7ff53c06d120 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 -- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 msgr2=0x7ff524003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 --2- 172.21.15.6:0/568008405 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff524003a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00e210 tx=0x7ff52c00b040 comp rx=0 tx=0).stop 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff542093700 1 -- 172.21.15.6:0/568008405 reap_dead start 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 -- 172.21.15.6:0/568008405 shutdown_connections 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 -- 172.21.15.6:0/568008405 >> 172.21.15.6:0/568008405 conn(0x7ff53c06bb90 msgr2=0x7ff53c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 -- 172.21.15.6:0/568008405 shutdown_connections 2023-10-09T11:39:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.748+0000 7ff543af6700 1 -- 172.21.15.6:0/568008405 wait complete. 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.749+0000 7ff543af6700 1 Processor -- start 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.749+0000 7ff543af6700 1 -- start start 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53c0b4de0 0x7ff53c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4950 con 0x7ff53c0b69e0 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b3d40 con 0x7ff53c0b4de0 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b4020 con 0x7ff53c06d120 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51158/0 (socket says 172.21.15.6:51158) 2023-10-09T11:39:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 -- 172.21.15.6:0/148313872 learned_addr learned my addr 172.21.15.6:0/148313872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff542093700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53c0b4de0 0x7ff53c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541892700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 -- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 msgr2=0x7ff53c0ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c0ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 -- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53c0b4de0 msgr2=0x7ff53c0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53c0b4de0 0x7ff53c0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b4300 con 0x7ff53c0b69e0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff541091700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff530001a60 tx=0x7ff53c0d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530018030 con 0x7ff53c0b69e0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000f8d0 con 0x7ff53c0b69e0 2023-10-09T11:39:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0b45e0 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.750+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000fcb0 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.751+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c154540 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.751+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c0b4b00 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.752+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff53001b070 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.752+0000 7ff539ffb700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.752+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff530019070 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.752+0000 7ff541892700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.752+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7ff52806ea50 con 0x7ff53c0b69e0 2023-10-09T11:39:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.753+0000 7ff541892700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 0x7ff5280693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00afd0 tx=0x7ff52c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.756+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff53c0b4b00 con 0x7ff53c0b69e0 2023-10-09T11:39:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.992+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53c0b4a90 con 0x7ff53c0b69e0 2023-10-09T11:39:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.993+0000 7ff539ffb700 1 -- 172.21.15.6:0/148313872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7ff530051860 con 0x7ff53c0b69e0 2023-10-09T11:39:42.995 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:42.995 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:39:42.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 msgr2=0x7ff5280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 0x7ff5280693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00afd0 tx=0x7ff52c01a000 comp rx=0 tx=0).stop 2023-10-09T11:39:42.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 msgr2=0x7ff53c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:42.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff530001a60 tx=0x7ff53c0d0730 comp rx=0 tx=0).stop 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 shutdown_connections 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff528066f30 0x7ff5280693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53c0b4de0 0x7ff53c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff53c06d120 0x7ff53c0ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 --2- 172.21.15.6:0/148313872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff53c0b69e0 0x7ff53c154000 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 >> 172.21.15.6:0/148313872 conn(0x7ff53c06bb90 msgr2=0x7ff53c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.995+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 shutdown_connections 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:42.996+0000 7ff543af6700 1 -- 172.21.15.6:0/148313872 wait complete. 2023-10-09T11:39:42.998 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:39:43.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.129+0000 7f2f119e2700 1 Processor -- start 2023-10-09T11:39:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.129+0000 7f2f119e2700 1 -- start start 2023-10-09T11:39:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f119e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f0c159a90 0x7f2f0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f119e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 0x7f2f0c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f119e2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c06e280 con 0x7f2f0c159e60 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f119e2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c068d60 con 0x7f2f0c159a90 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f119e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c06dfa0 con 0x7f2f0c0691f0 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 0x7f2f0c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f0c159a90 0x7f2f0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0a7fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2f0c159e60 0x7f2f0c06a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:41120/0 (socket says 172.21.15.6:41120) 2023-10-09T11:39:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0a7fc700 1 -- 172.21.15.6:0/43678154 learned_addr learned my addr 172.21.15.6:0/43678154 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0affd700 1 -- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 msgr2=0x7f2f0c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0affd700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 0x7f2f0c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f0affd700 1 -- 172.21.15.6:0/43678154 >> v1:172.21.15.118:6789/0 conn(0x7f2f0c159e60 legacy=0x7f2f0c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f0affd700 1 -- 172.21.15.6:0/43678154 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c068710 con 0x7f2f0c159a90 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.130+0000 7f2f09ffb700 1 -- 172.21.15.6:0/43678154 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249609313 0 0) 0x7f2f0c06e280 con 0x7f2f0c159e60 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f0b7fe700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 0x7f2f0c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f0affd700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c06d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009e60 tx=0x7f2efc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d9f3c3e2c19200 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f09ffb700 1 -- 172.21.15.6:0/43678154 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00e070 con 0x7f2f0c159a90 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f09ffb700 1 -- 172.21.15.6:0/43678154 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00bb60 con 0x7f2f0c159a90 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f09ffb700 1 -- 172.21.15.6:0/43678154 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc012430 con 0x7f2f0c159a90 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 -- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 msgr2=0x7f2f0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c06d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009e60 tx=0x7f2efc009780 comp rx=0 tx=0).stop 2023-10-09T11:39:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 -- 172.21.15.6:0/43678154 shutdown_connections 2023-10-09T11:39:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c0691f0 0x7f2f0c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 --2- 172.21.15.6:0/43678154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c06d990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 -- 172.21.15.6:0/43678154 >> 172.21.15.6:0/43678154 conn(0x7f2f0c06bb90 msgr2=0x7f2f0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 -- 172.21.15.6:0/43678154 shutdown_connections 2023-10-09T11:39:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.131+0000 7f2f119e2700 1 -- 172.21.15.6:0/43678154 wait complete. 2023-10-09T11:39:43.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 Processor -- start 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 -- start start 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c159e60 0x7f2f0c16da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c151fd0 con 0x7f2f0c0691f0 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c15ba70 con 0x7f2f0c159a90 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.133+0000 7f2f119e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c151cf0 con 0x7f2f0c159e60 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51174/0 (socket says 172.21.15.6:51174) 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 -- 172.21.15.6:0/3968609205 learned_addr learned my addr 172.21.15.6:0/3968609205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0a7fc700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0b7fe700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c159e60 0x7f2f0c16da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 -- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c159e60 msgr2=0x7f2f0c16da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c159e60 0x7f2f0c16da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 -- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 msgr2=0x7f2f0c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04009420 con 0x7f2f0c0691f0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0a7fc700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f0affd700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00b6c0 tx=0x7f2efc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc012c10 con 0x7f2f0c0691f0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc012d70 con 0x7f2f0c0691f0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc026640 con 0x7f2f0c0691f0 2023-10-09T11:39:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc009a20 con 0x7f2f0c0691f0 2023-10-09T11:39:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.134+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c15b700 con 0x7f2f0c0691f0 2023-10-09T11:39:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.135+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c067640 con 0x7f2f0c0691f0 2023-10-09T11:39:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.136+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2efc026a30 con 0x7f2f0c0691f0 2023-10-09T11:39:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.136+0000 7f2f02ffd700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 0x7f2eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.136+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2efc085e60 con 0x7f2f0c0691f0 2023-10-09T11:39:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.136+0000 7f2f0a7fc700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 0x7f2eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.136+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f2eec06ea50 con 0x7f2f0c0691f0 2023-10-09T11:39:43.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.137+0000 7f2f0a7fc700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 0x7f2eec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c152900 tx=0x7f2ef4007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.141+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2efc053190 con 0x7f2f0c0691f0 2023-10-09T11:39:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.380+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f0c0689f0 con 0x7f2f0c0691f0 2023-10-09T11:39:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.381+0000 7f2f02ffd700 1 -- 172.21.15.6:0/3968609205 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f2efc057e60 con 0x7f2f0c0691f0 2023-10-09T11:39:43.382 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:43.383 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:38:08.522863+0000","modified":"2023-10-09T11:38:12.158427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5697":{"gid":5697,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/1266236588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1266236588},{"type":"v1","addr":"172.21.15.6:6837","nonce":1266236588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 msgr2=0x7f2eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 0x7f2eec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c152900 tx=0x7f2ef4007f50 comp rx=0 tx=0).stop 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 msgr2=0x7f2f0c16d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00b6c0 tx=0x7f2efc019000 comp rx=0 tx=0).stop 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 shutdown_connections 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2eec066f30 0x7f2eec0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f0c159e60 0x7f2f0c16da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f0c0691f0 0x7f2f0c16d110 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 --2- 172.21.15.6:0/3968609205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f0c159a90 0x7f2f0c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 >> 172.21.15.6:0/3968609205 conn(0x7f2f0c06bb90 msgr2=0x7f2f0c0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 shutdown_connections 2023-10-09T11:39:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.383+0000 7f2f119e2700 1 -- 172.21.15.6:0/3968609205 wait complete. 2023-10-09T11:39:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 35 2023-10-09T11:39:43.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.514+0000 7f8aeb65a700 1 Processor -- start 2023-10-09T11:39:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.514+0000 7f8aeb65a700 1 -- start start 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8aeb65a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ae40aeea0 0x7f8ae40c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8aeb65a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ae40af270 0x7f8ae40c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8aeb65a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae406aae0 con 0x7f8ae40c7d00 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8aeb65a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40c8810 con 0x7f8ae40aeea0 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8aeb65a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae4069ed0 con 0x7f8ae40af270 2023-10-09T11:39:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ae40aeea0 0x7f8ae40c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae9bf7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ae40c7d00 0x7f8ae40c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41172/0 (socket says 172.21.15.6:41172) 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae9bf7700 1 -- 172.21.15.6:0/379921718 learned_addr learned my addr 172.21.15.6:0/379921718 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae8bf5700 1 --2- 172.21.15.6:0/379921718 >> v2:172.21.15.118:3300/0 conn(0x7f8ae40af270 0x7f8ae40c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 -- 172.21.15.6:0/379921718 >> v2:172.21.15.118:3300/0 conn(0x7f8ae40af270 msgr2=0x7f8ae40c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 --2- 172.21.15.6:0/379921718 >> v2:172.21.15.118:3300/0 conn(0x7f8ae40af270 0x7f8ae40c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 -- 172.21.15.6:0/379921718 >> v1:172.21.15.6:6789/0 conn(0x7f8ae40c7d00 legacy=0x7f8ae40c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 -- 172.21.15.6:0/379921718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae406a1b0 con 0x7f8ae40aeea0 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae3fff700 1 -- 172.21.15.6:0/379921718 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621914391 0 0) 0x7f8ae406aae0 con 0x7f8ae40c7d00 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae93f6700 1 --2- 172.21.15.6:0/379921718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40aeea0 0x7f8ae40c2920 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40c73a0 tx=0x7f8ad4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a626e38f6db2ed9a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.515+0000 7f8ae3fff700 1 -- 172.21.15.6:0/379921718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400e070 con 0x7f8ae40aeea0 2023-10-09T11:39:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8ae3fff700 1 -- 172.21.15.6:0/379921718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400bcc0 con 0x7f8ae40aeea0 2023-10-09T11:39:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8ae3fff700 1 -- 172.21.15.6:0/379921718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4012680 con 0x7f8ae40aeea0 2023-10-09T11:39:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 -- 172.21.15.6:0/379921718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40aeea0 msgr2=0x7f8ae40c2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/379921718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40aeea0 0x7f8ae40c2920 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40c73a0 tx=0x7f8ad4009780 comp rx=0 tx=0).stop 2023-10-09T11:39:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 -- 172.21.15.6:0/379921718 shutdown_connections 2023-10-09T11:39:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/379921718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40aeea0 0x7f8ae40c2920 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/379921718 >> v2:172.21.15.118:3300/0 conn(0x7f8ae40af270 0x7f8ae40c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 -- 172.21.15.6:0/379921718 >> 172.21.15.6:0/379921718 conn(0x7f8ae406c660 msgr2=0x7f8ae40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 -- 172.21.15.6:0/379921718 shutdown_connections 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.516+0000 7f8aeb65a700 1 -- 172.21.15.6:0/379921718 wait complete. 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.517+0000 7f8aeb65a700 1 Processor -- start 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.517+0000 7f8aeb65a700 1 -- start start 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ae40aeea0 0x7f8ae41484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ae40c7d00 0x7f8ae4157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4148a30 con 0x7f8ae40af270 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b1e30 con 0x7f8ae40aeea0 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8aeb65a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b1220 con 0x7f8ae40c7d00 2023-10-09T11:39:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8ae8bf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8ae8bf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44088/0 (socket says 172.21.15.6:44088) 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8ae8bf5700 1 -- 172.21.15.6:0/725490108 learned_addr learned my addr 172.21.15.6:0/725490108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8ae9bf7700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ae40c7d00 0x7f8ae4157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.518+0000 7f8ae93f6700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ae40aeea0 0x7f8ae41484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 -- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ae40c7d00 msgr2=0x7f8ae4157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ae40c7d00 0x7f8ae4157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 -- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ae40aeea0 msgr2=0x7f8ae41484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ae40aeea0 0x7f8ae41484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4009a20 con 0x7f8ae40af270 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae8bf5700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800fc40 tx=0x7f8ad8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80078f0 con 0x7f8ae40af270 2023-10-09T11:39:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8007a50 con 0x7f8ae40af270 2023-10-09T11:39:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8007df0 con 0x7f8ae40af270 2023-10-09T11:39:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae40b1500 con 0x7f8ae40af270 2023-10-09T11:39:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.519+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae40b1ac0 con 0x7f8ae40af270 2023-10-09T11:39:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.520+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae4067bc0 con 0x7f8ae40af270 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.520+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ad801a670 con 0x7f8ae40af270 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.521+0000 7f8ae17fa700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.521+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ad8086b80 con 0x7f8ae40af270 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.521+0000 7f8ae93f6700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.521+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f8ad006ea50 con 0x7f8ae40af270 2023-10-09T11:39:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.521+0000 7f8ae93f6700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 0x7f8ad00693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40097c0 tx=0x7f8ad4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.525+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ad8015060 con 0x7f8ae40af270 2023-10-09T11:39:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.719+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ae40b1f70 con 0x7f8ae40af270 2023-10-09T11:39:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.720+0000 7f8ae17fa700 1 -- 172.21.15.6:0/725490108 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f8ad8053df0 con 0x7f8ae40af270 2023-10-09T11:39:43.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:43.721 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:43.106855+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:38:06.942683+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T11:38:07.491085+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 msgr2=0x7f8ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 0x7f8ad00693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40097c0 tx=0x7f8ad4019000 comp rx=0 tx=0).stop 2023-10-09T11:39:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 msgr2=0x7f8ae40b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800fc40 tx=0x7f8ad8008040 comp rx=0 tx=0).stop 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 shutdown_connections 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ad0066f30 0x7f8ad00693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ae40c7d00 0x7f8ae4157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ae40aeea0 0x7f8ae41484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 --2- 172.21.15.6:0/725490108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae40af270 0x7f8ae40b0860 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 >> 172.21.15.6:0/725490108 conn(0x7f8ae406c660 msgr2=0x7f8ae40c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 shutdown_connections 2023-10-09T11:39:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.722+0000 7f8aeb65a700 1 -- 172.21.15.6:0/725490108 wait complete. 2023-10-09T11:39:43.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:39:43.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.853+0000 7fe2830a8700 1 Processor -- start 2023-10-09T11:39:43.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.853+0000 7fe2830a8700 1 -- start start 2023-10-09T11:39:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe2830a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe27c0b3bd0 0x7fe27c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe2830a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 0x7fe27c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe2830a8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c0b2890 con 0x7fe27c157fe0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe2830a8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0b4070 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe2830a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0b4350 con 0x7fe27c1583b0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe27bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe27c0b3bd0 0x7fe27c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe280e44700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe27c157fe0 0x7fe27c0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41186/0 (socket says 172.21.15.6:41186) 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.854+0000 7fe280e44700 1 -- 172.21.15.6:0/1950624261 learned_addr learned my addr 172.21.15.6:0/1950624261 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe281645700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 0x7fe27c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27bfff700 1 -- 172.21.15.6:0/1950624261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 msgr2=0x7fe27c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27bfff700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 0x7fe27c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27bfff700 1 -- 172.21.15.6:0/1950624261 >> v1:172.21.15.6:6789/0 conn(0x7fe27c157fe0 legacy=0x7fe27c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27bfff700 1 -- 172.21.15.6:0/1950624261 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c0b4630 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27b7fe700 1 -- 172.21.15.6:0/1950624261 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932100538 0 0) 0x7fe27c0b2890 con 0x7fe27c157fe0 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe281645700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 0x7fe27c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27bfff700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c0ceb30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098e0 tx=0x7fe26c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6f2a3066ba5678 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27b7fe700 1 -- 172.21.15.6:0/1950624261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c009e80 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27b7fe700 1 -- 172.21.15.6:0/1950624261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c00b860 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.855+0000 7fe27b7fe700 1 -- 172.21.15.6:0/1950624261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00bbe0 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 -- 172.21.15.6:0/1950624261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c0b3bd0 msgr2=0x7fe27c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c0ceb30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098e0 tx=0x7fe26c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 -- 172.21.15.6:0/1950624261 shutdown_connections 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c1583b0 0x7fe27c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 --2- 172.21.15.6:0/1950624261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c0ceb30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 -- 172.21.15.6:0/1950624261 >> 172.21.15.6:0/1950624261 conn(0x7fe27c067640 msgr2=0x7fe27c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 -- 172.21.15.6:0/1950624261 shutdown_connections 2023-10-09T11:39:43.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.856+0000 7fe2830a8700 1 -- 172.21.15.6:0/1950624261 wait complete. 2023-10-09T11:39:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.857+0000 7fe2830a8700 1 Processor -- start 2023-10-09T11:39:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.857+0000 7fe2830a8700 1 -- start start 2023-10-09T11:39:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c157fe0 0x7fe27c0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c16aca0 con 0x7fe27c1583b0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c83b0 con 0x7fe27c0b3bd0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe2830a8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c06d510 con 0x7fe27c157fe0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44110/0 (socket says 172.21.15.6:44110) 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 -- 172.21.15.6:0/3609322269 learned_addr learned my addr 172.21.15.6:0/3609322269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe280e44700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe27bfff700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c157fe0 0x7fe27c0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 -- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c157fe0 msgr2=0x7fe27c0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c157fe0 0x7fe27c0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 -- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c0b3bd0 msgr2=0x7fe27c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c06ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c009420 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.858+0000 7fe281645700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c880 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264011600 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264011780 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c16b7b0 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264011b40 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c16af00 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.859+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c16b940 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.860+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2640193b0 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.860+0000 7fe278ff9700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.860+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2640844f0 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.860+0000 7fe280e44700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.861+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7fe25c06ea50 con 0x7fe27c1583b0 2023-10-09T11:39:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.861+0000 7fe280e44700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 0x7fe25c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe27c155030 tx=0x7fe274009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:43.865+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe264051760 con 0x7fe27c1583b0 2023-10-09T11:39:44.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.103+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe27c155220 con 0x7fe27c1583b0 2023-10-09T11:39:44.107 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:39:44.106+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:39:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.108+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 1546+0+0 (secure 0 0 0) 0x7fe264055b20 con 0x7fe27c1583b0 2023-10-09T11:39:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.108+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fe25c06fd00 con 0x7fe27c1583b0 2023-10-09T11:39:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.112+0000 7fe278ff9700 1 -- 172.21.15.6:0/3609322269 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe26401f020 con 0x7fe27c1583b0 2023-10-09T11:39:44.116 INFO:tasks.ceph.mds.c.smithi006.stderr: -9341> 2023-10-09T11:38:11.112+0000 7f36e88ec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 msgr2=0x7fe25c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 0x7fe25c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe27c155030 tx=0x7fe274009040 comp rx=0 tx=0).stop 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 msgr2=0x7fe27c151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c880 tx=0x7fe264008040 comp rx=0 tx=0).stop 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 shutdown_connections 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe25c066f30 0x7fe25c0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe27c1583b0 0x7fe27c151970 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe27c0b3bd0 0x7fe27c06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 --2- 172.21.15.6:0/3609322269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe27c157fe0 0x7fe27c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 >> 172.21.15.6:0/3609322269 conn(0x7fe27c067640 msgr2=0x7fe27c15b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 shutdown_connections 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.115+0000 7fe2830a8700 1 -- 172.21.15.6:0/3609322269 wait complete. 2023-10-09T11:39:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:39:44.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:39:44.153 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:39:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.254+0000 7f0ad4206700 1 Processor -- start 2023-10-09T11:39:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.254+0000 7f0ad4206700 1 -- start start 2023-10-09T11:39:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0acc157ab0 0x7f0acc15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 0x7f0acc06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc15bc10 con 0x7f0acc157ab0 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc158ba0 con 0x7f0acc069120 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad4206700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc158e80 con 0x7f0acc15c5e0 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad1fa2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0acc157ab0 0x7f0acc15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad1fa2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0acc157ab0 0x7f0acc15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44114/0 (socket says 172.21.15.6:44114) 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.255+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/69908882 learned_addr learned my addr 172.21.15.6:0/69908882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad27a3700 1 --2- 172.21.15.6:0/69908882 >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 0x7f0acc06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad17a1700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/69908882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 msgr2=0x7f0acc06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc06bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/69908882 >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 msgr2=0x7f0acc06c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/69908882 >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 0x7f0acc06c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/69908882 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc159160 con 0x7f0acc157ab0 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad27a3700 1 --2- 172.21.15.6:0/69908882 >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 0x7f0acc06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc157ab0 0x7f0acc15c0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0c7800 tx=0x7f0abc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8559ea848f01ec21 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad0fa0700 1 -- 172.21.15.6:0/69908882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00b860 con 0x7f0acc157ab0 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad0fa0700 1 -- 172.21.15.6:0/69908882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00b9c0 con 0x7f0acc157ab0 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.256+0000 7f0ad0fa0700 1 -- 172.21.15.6:0/69908882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00bd60 con 0x7f0acc157ab0 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 -- 172.21.15.6:0/69908882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc157ab0 msgr2=0x7f0acc15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc157ab0 0x7f0acc15c0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0c7800 tx=0x7f0abc009250 comp rx=0 tx=0).stop 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 -- 172.21.15.6:0/69908882 shutdown_connections 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 --2- 172.21.15.6:0/69908882 >> v2:172.21.15.118:3300/0 conn(0x7f0acc069120 0x7f0acc06c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc157ab0 0x7f0acc15c0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 --2- 172.21.15.6:0/69908882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 -- 172.21.15.6:0/69908882 >> 172.21.15.6:0/69908882 conn(0x7f0acc0c9ca0 msgr2=0x7f0acc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 -- 172.21.15.6:0/69908882 shutdown_connections 2023-10-09T11:39:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.257+0000 7f0ad4206700 1 -- 172.21.15.6:0/69908882 wait complete. 2023-10-09T11:39:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.258+0000 7f0ad4206700 1 Processor -- start 2023-10-09T11:39:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.258+0000 7f0ad4206700 1 -- start start 2023-10-09T11:39:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0acc157ab0 0x7f0acc168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c73b0 con 0x7f0acc069120 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c69e0 con 0x7f0acc157ab0 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc169300 con 0x7f0acc15c5e0 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44128/0 (socket says 172.21.15.6:44128) 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/579556747 learned_addr learned my addr 172.21.15.6:0/579556747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad17a1700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0acc157ab0 0x7f0acc168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad27a3700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 msgr2=0x7f0acc14e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc14e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0acc157ab0 msgr2=0x7f0acc168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0acc157ab0 0x7f0acc168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 -- 172.21.15.6:0/579556747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0094f0 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad1fa2700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009290 tx=0x7f0abc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc026480 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc01f070 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc14e6d0 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.259+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc026830 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.260+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc0c60b0 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.260+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc0c6cc0 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.261+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0abc01a430 con 0x7f0acc069120 2023-10-09T11:39:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.261+0000 7f0ac9ffb700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.261+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0abc021070 con 0x7f0acc069120 2023-10-09T11:39:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.261+0000 7f0ad17a1700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.262+0000 7f0ad17a1700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06b560 tx=0x7f0ac0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:44.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.266+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0abc053790 con 0x7f0acc069120 2023-10-09T11:39:44.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:44.501+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0acc04bb80 con 0x7f0acc069120 2023-10-09T11:39:45.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.112+0000 7f0ac9ffb700 1 -- 172.21.15.6:0/579556747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0abc056db0 con 0x7f0acc069120 2023-10-09T11:39:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 msgr2=0x7f0ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 0x7f0ab80693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0acc06b560 tx=0x7f0ac0008040 comp rx=0 tx=0).stop 2023-10-09T11:39:45.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 msgr2=0x7f0acc0c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009290 tx=0x7f0abc017000 comp rx=0 tx=0).stop 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 shutdown_connections 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0ab8066f30 0x7f0ab80693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0acc15c5e0 0x7f0acc14e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0acc069120 0x7f0acc0c6e70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 --2- 172.21.15.6:0/579556747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0acc157ab0 0x7f0acc168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 >> 172.21.15.6:0/579556747 conn(0x7f0acc0c9ca0 msgr2=0x7f0acc14eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 shutdown_connections 2023-10-09T11:39:45.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.115+0000 7f0ad4206700 1 -- 172.21.15.6:0/579556747 wait complete. 2023-10-09T11:39:45.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:39:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 Processor -- start 2023-10-09T11:39:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 -- start start 2023-10-09T11:39:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19c406d120 0x7f19c406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c406dac0 con 0x7f19c4157ca0 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c40d07c0 con 0x7f19c406d120 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.294+0000 7f19cae8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40cfbb0 con 0x7f19c41578d0 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19c406d120 0x7f19c406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19c406d120 0x7f19c406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44140/0 (socket says 172.21.15.6:44140) 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 -- 172.21.15.6:0/1657260791 learned_addr learned my addr 172.21.15.6:0/1657260791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c8c29700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 -- 172.21.15.6:0/1657260791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 msgr2=0x7f19c40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 -- 172.21.15.6:0/1657260791 >> v1:172.21.15.118:6789/0 conn(0x7f19c4157ca0 legacy=0x7f19c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 -- 172.21.15.6:0/1657260791 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40cfe90 con 0x7f19c406d120 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c942a700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c406d120 0x7f19c406d580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009f20 tx=0x7f19bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9186b289fe811f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c37fe700 1 -- 172.21.15.6:0/1657260791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00e070 con 0x7f19c406d120 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c37fe700 1 -- 172.21.15.6:0/1657260791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00ba80 con 0x7f19c406d120 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.295+0000 7f19c37fe700 1 -- 172.21.15.6:0/1657260791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0092e0 con 0x7f19c406d120 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 -- 172.21.15.6:0/1657260791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c406d120 msgr2=0x7f19c406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c406d120 0x7f19c406d580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009f20 tx=0x7f19bc009840 comp rx=0 tx=0).stop 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 -- 172.21.15.6:0/1657260791 shutdown_connections 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c406d120 0x7f19c406d580 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 --2- 172.21.15.6:0/1657260791 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 -- 172.21.15.6:0/1657260791 >> 172.21.15.6:0/1657260791 conn(0x7f19c406bb90 msgr2=0x7f19c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 -- 172.21.15.6:0/1657260791 shutdown_connections 2023-10-09T11:39:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.296+0000 7f19cae8d700 1 -- 172.21.15.6:0/1657260791 wait complete. 2023-10-09T11:39:45.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.297+0000 7f19cae8d700 1 Processor -- start 2023-10-09T11:39:45.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.297+0000 7f19cae8d700 1 -- start start 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c406d120 0x7f19c4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c4069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4153370 con 0x7f19c4157ca0 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4153d40 con 0x7f19c406d120 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19cae8d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4152760 con 0x7f19c41578d0 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44154/0 (socket says 172.21.15.6:44154) 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 -- 172.21.15.6:0/2934055609 learned_addr learned my addr 172.21.15.6:0/2934055609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c8c29700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c406d120 0x7f19c4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c3fff700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c4069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 -- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 msgr2=0x7f19c4069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c4069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 -- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c406d120 msgr2=0x7f19c4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c406d120 0x7f19c4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.298+0000 7f19c942a700 1 -- 172.21.15.6:0/2934055609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc009ae0 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19c942a700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f19c406fe20 tx=0x7f19bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0032f0 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc008d20 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c4152a40 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc026690 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.299+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c4153000 con 0x7f19c4157ca0 2023-10-09T11:39:45.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.300+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4067ac0 con 0x7f19c4157ca0 2023-10-09T11:39:45.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.300+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19bc003040 con 0x7f19c4157ca0 2023-10-09T11:39:45.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.301+0000 7f19c0ff9700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:45.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.301+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f19bc0865f0 con 0x7f19c4157ca0 2023-10-09T11:39:45.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.301+0000 7f19c8c29700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:45.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.301+0000 7f19c8c29700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 0x7f19b00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19b4006fd0 tx=0x7f19b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:45.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.305+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19bc0538c0 con 0x7f19c4157ca0 2023-10-09T11:39:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:45.497+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19c40d0170 con 0x7f19c4157ca0 2023-10-09T11:39:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.115+0000 7f19c0ff9700 1 -- 172.21.15.6:0/2934055609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7f19bc056ee0 con 0x7f19c4157ca0 2023-10-09T11:39:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 msgr2=0x7f19b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 0x7f19b00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19b4006fd0 tx=0x7f19b4008040 comp rx=0 tx=0).stop 2023-10-09T11:39:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 msgr2=0x7f19c41414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f19c406fe20 tx=0x7f19bc018000 comp rx=0 tx=0).stop 2023-10-09T11:39:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 shutdown_connections 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f19b0066f30 0x7f19b00693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c4157ca0 0x7f19c41414f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.120+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19c406d120 0x7f19c4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.121+0000 7f19cae8d700 1 --2- 172.21.15.6:0/2934055609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19c41578d0 0x7f19c4069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.121+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 >> 172.21.15.6:0/2934055609 conn(0x7f19c406bb90 msgr2=0x7f19c4070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.121+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 shutdown_connections 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.121+0000 7f19cae8d700 1 -- 172.21.15.6:0/2934055609 wait complete. 2023-10-09T11:39:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:39:46.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:39:46.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.259+0000 7f64868cd700 1 Processor -- start 2023-10-09T11:39:46.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 -- start start 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f648006d120 0x7f648006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648006dac0 con 0x7f64801578d0 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64800d07c0 con 0x7f648006d120 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.260+0000 7f64868cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800cfbb0 con 0x7f6480157ca0 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f648006d120 0x7f648006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f648006d120 0x7f648006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:37000/0 (socket says 172.21.15.6:37000) 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 -- 172.21.15.6:0/3611206512 learned_addr learned my addr 172.21.15.6:0/3611206512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f647ffff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f64801578d0 0x7f648015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:36702/0 (socket says 172.21.15.6:36702) 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f647f7fe700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 -- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 msgr2=0x7f64800cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 -- 172.21.15.6:0/3611206512 >> v1:172.21.15.118:6789/0 conn(0x7f64801578d0 legacy=0x7f648015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 -- 172.21.15.6:0/3611206512 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800cfe90 con 0x7f648006d120 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f647effd700 1 -- 172.21.15.6:0/3611206512 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277938899 0 0) 0x7f6468001110 con 0x7f64801578d0 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f6484e6a700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648006d120 0x7f648006d580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6478009f20 tx=0x7f6478009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67bc65756462271e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f647effd700 1 -- 172.21.15.6:0/3611206512 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647800e070 con 0x7f648006d120 2023-10-09T11:39:46.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.261+0000 7f647effd700 1 -- 172.21.15.6:0/3611206512 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647800b9d0 con 0x7f648006d120 2023-10-09T11:39:46.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f647effd700 1 -- 172.21.15.6:0/3611206512 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780092e0 con 0x7f648006d120 2023-10-09T11:39:46.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 -- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648006d120 msgr2=0x7f648006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648006d120 0x7f648006d580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6478009f20 tx=0x7f6478009840 comp rx=0 tx=0).stop 2023-10-09T11:39:46.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 -- 172.21.15.6:0/3611206512 shutdown_connections 2023-10-09T11:39:46.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f648006d120 0x7f648006d580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 --2- 172.21.15.6:0/3611206512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 -- 172.21.15.6:0/3611206512 >> 172.21.15.6:0/3611206512 conn(0x7f648006bb90 msgr2=0x7f648006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 -- 172.21.15.6:0/3611206512 shutdown_connections 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.262+0000 7f64868cd700 1 -- 172.21.15.6:0/3611206512 wait complete. 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.263+0000 7f64868cd700 1 Processor -- start 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.263+0000 7f64868cd700 1 -- start start 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 0x7f64800b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800b44a0 con 0x7f648006d120 2023-10-09T11:39:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800b4780 con 0x7f64801578d0 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f64868cd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800b4a60 con 0x7f6480157ca0 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f647ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f647ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44166/0 (socket says 172.21.15.6:44166) 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f647ffff700 1 -- 172.21.15.6:0/3652662630 learned_addr learned my addr 172.21.15.6:0/3652662630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f6484e6a700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.264+0000 7f647f7fe700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 0x7f64800b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 -- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 msgr2=0x7f64800b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 -- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 msgr2=0x7f64800b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 0x7f64800b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 -- 172.21.15.6:0/3652662630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009ae0 con 0x7f648006d120 2023-10-09T11:39:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647f7fe700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 0x7f64800b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f647ffff700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f646800c810 tx=0x7f6468007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468005a70 con 0x7f648006d120 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468005bd0 con 0x7f648006d120 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64800b5b90 con 0x7f648006d120 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680070d0 con 0x7f648006d120 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.265+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480154f20 con 0x7f648006d120 2023-10-09T11:39:46.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.266+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64800b60b0 con 0x7f648006d120 2023-10-09T11:39:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.266+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6468007500 con 0x7f648006d120 2023-10-09T11:39:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.267+0000 7f6477fff700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 0x7f64600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.267+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f6468083780 con 0x7f648006d120 2023-10-09T11:39:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.267+0000 7f647f7fe700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 0x7f64600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:46.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.267+0000 7f647f7fe700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 0x7f64600693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64800b50f0 tx=0x7f6470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:46.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.271+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64800b60b0 con 0x7f648006d120 2023-10-09T11:39:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:46.464+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f648006dac0 con 0x7f648006d120 2023-10-09T11:39:47.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.127+0000 7f6477fff700 1 -- 172.21.15.6:0/3652662630 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7f648006dac0 con 0x7f648006d120 2023-10-09T11:39:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.129+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 msgr2=0x7f64600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.129+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 0x7f64600693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64800b50f0 tx=0x7f6470008040 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 msgr2=0x7f64801549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f646800c810 tx=0x7f6468007c50 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 shutdown_connections 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6460066f30 0x7f64600693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6480157ca0 0x7f64800b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f648006d120 0x7f64801549e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 --2- 172.21.15.6:0/3652662630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64801578d0 0x7f64800b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 >> 172.21.15.6:0/3652662630 conn(0x7f648006bb90 msgr2=0x7f6480156510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 shutdown_connections 2023-10-09T11:39:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.130+0000 7f64868cd700 1 -- 172.21.15.6:0/3652662630 wait complete. 2023-10-09T11:39:47.133 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:39:47.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:39:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.273+0000 7f6e3359e700 1 Processor -- start 2023-10-09T11:39:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.273+0000 7f6e3359e700 1 -- start start 2023-10-09T11:39:47.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3359e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e340aca50 0x7f6e340c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3406e3d0 con 0x7f6e340ace20 2023-10-09T11:39:47.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3359e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e340c75d0 con 0x7f6e34069860 2023-10-09T11:39:47.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3359e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e34069cf0 con 0x7f6e340aca50 2023-10-09T11:39:47.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e32d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6e340ace20 0x7f6e340c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41202/0 (socket says 172.21.15.6:41202) 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e32d9d700 1 -- 172.21.15.6:0/3195333292 learned_addr learned my addr 172.21.15.6:0/3195333292 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3259c700 1 --2- 172.21.15.6:0/3195333292 >> v2:172.21.15.118:3300/0 conn(0x7f6e340aca50 0x7f6e340c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848610374 0 0) 0x7f6e3406e3d0 con 0x7f6e340ace20 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e20003570 con 0x7f6e340ace20 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258708676 0 0) 0x7f6e1c001110 con 0x7f6e34069860 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e3406e3d0 con 0x7f6e34069860 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617750526 0 0) 0x7f6e20003570 con 0x7f6e340ace20 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 >> v2:172.21.15.118:3300/0 conn(0x7f6e340aca50 msgr2=0x7f6e340c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 --2- 172.21.15.6:0/3195333292 >> v2:172.21.15.118:3300/0 conn(0x7f6e340aca50 0x7f6e340c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 >> v1:172.21.15.118:6789/0 conn(0x7f6e34069860 legacy=0x7f6e34159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34069fd0 con 0x7f6e340ace20 2023-10-09T11:39:47.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f6e24001470 con 0x7f6e340ace20 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 >> v1:172.21.15.6:6789/0 conn(0x7f6e340ace20 legacy=0x7f6e340c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 0x7f6e20003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20004810 0x7f6e20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e200051c0 0x7f6e2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34069cf0 con 0x7f6e20003bf0 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.274+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2000c0b0 con 0x7f6e20004810 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2000c270 con 0x7f6e200051c0 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 0x7f6e20003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e31d9b700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20004810 0x7f6e20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e32d9d700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e200051c0 0x7f6e2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 -- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e200051c0 msgr2=0x7f6e2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:47.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e200051c0 0x7f6e2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 -- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20004810 msgr2=0x7f6e20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20004810 0x7f6e20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 -- 172.21.15.6:0/3195333292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20003570 con 0x7f6e20003bf0 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e32d9d700 1 -- 172.21.15.6:0/3195333292 reap_dead start 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3259c700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 0x7f6e20003fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00e210 tx=0x7f6e2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63177f4caaf09f80 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00eac0 con 0x7f6e20003bf0 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c00f040 con 0x7f6e20003bf0 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.275+0000 7f6e3159a700 1 -- 172.21.15.6:0/3195333292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00ee70 con 0x7f6e20003bf0 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 -- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 msgr2=0x7f6e20003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 0x7f6e20003fe0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00e210 tx=0x7f6e2c00b040 comp rx=0 tx=0).stop 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 -- 172.21.15.6:0/3195333292 shutdown_connections 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 --2- 172.21.15.6:0/3195333292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e20003bf0 0x7f6e20003fe0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 -- 172.21.15.6:0/3195333292 >> 172.21.15.6:0/3195333292 conn(0x7f6e3406cca0 msgr2=0x7f6e3406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 -- 172.21.15.6:0/3195333292 shutdown_connections 2023-10-09T11:39:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.276+0000 7f6e3359e700 1 -- 172.21.15.6:0/3195333292 wait complete. 2023-10-09T11:39:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.277+0000 7f6e3359e700 1 Processor -- start 2023-10-09T11:39:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.277+0000 7f6e3359e700 1 -- start start 2023-10-09T11:39:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20003bf0 0x7f6e3416a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c8b80 0x7f6e340c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3416b6d0 con 0x7f6e340ca250 2023-10-09T11:39:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340c86f0 con 0x7f6e20003bf0 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3416b110 con 0x7f6e340c8b80 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44184/0 (socket says 172.21.15.6:44184) 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 -- 172.21.15.6:0/763130266 learned_addr learned my addr 172.21.15.6:0/763130266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3259c700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20003bf0 0x7f6e3416a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e32d9d700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c8b80 0x7f6e340c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 -- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c8b80 msgr2=0x7f6e340c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c8b80 0x7f6e340c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 -- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20003bf0 msgr2=0x7f6e3416a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20003bf0 0x7f6e3416a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 -- 172.21.15.6:0/763130266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3416b3f0 con 0x7f6e340ca250 2023-10-09T11:39:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e31d9b700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00f880 tx=0x7f6e1c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c006a30 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c006b90 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e340c8380 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007050 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.278+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34158960 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.279+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e34158b80 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.280+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e1c007480 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.280+0000 7f6e2a7fc700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 0x7f6e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.280+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6e1c083f40 con 0x7f6e340ca250 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.280+0000 7f6e3259c700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 0x7f6e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.281+0000 7f6e3259c700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 0x7f6e140693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00afd0 tx=0x7f6e2c01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.284+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e1c0514b0 con 0x7f6e340ca250 2023-10-09T11:39:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.478+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6e340c75d0 con 0x7f6e340ca250 2023-10-09T11:39:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.483+0000 7f6e2a7fc700 1 -- 172.21.15.6:0/763130266 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e340c75d0 con 0x7f6e340ca250 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.485+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 msgr2=0x7f6e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.485+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 0x7f6e140693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00afd0 tx=0x7f6e2c01a000 comp rx=0 tx=0).stop 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.485+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 msgr2=0x7f6e34158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.485+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00f880 tx=0x7f6e1c007d30 comp rx=0 tx=0).stop 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.485+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 shutdown_connections 2023-10-09T11:39:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e14066f30 0x7f6e140693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e340c8b80 0x7f6e340c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e20003bf0 0x7f6e3416a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 --2- 172.21.15.6:0/763130266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e340ca250 0x7f6e34158420 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 >> 172.21.15.6:0/763130266 conn(0x7f6e3406cca0 msgr2=0x7f6e340cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 shutdown_connections 2023-10-09T11:39:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.486+0000 7f6e3359e700 1 -- 172.21.15.6:0/763130266 wait complete. 2023-10-09T11:39:47.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-09T11:39:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.617+0000 7f8787f5f700 1 Processor -- start 2023-10-09T11:39:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 -- start start 2023-10-09T11:39:47.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 0x7f87800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8780157ca0 0x7f878015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f878006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800d07c0 con 0x7f8780157ca0 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878006daa0 con 0x7f87801578d0 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.618+0000 7f8787f5f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cfbb0 con 0x7f878006d120 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8780157ca0 0x7f878015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8780157ca0 0x7f878015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44192/0 (socket says 172.21.15.6:44192) 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 -- 172.21.15.6:0/3521774267 learned_addr learned my addr 172.21.15.6:0/3521774267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f8785cfb700 1 --2- 172.21.15.6:0/3521774267 >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 0x7f87800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87864fc700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f878006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 -- 172.21.15.6:0/3521774267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 msgr2=0x7f878006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f878006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 -- 172.21.15.6:0/3521774267 >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 msgr2=0x7f87800cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 --2- 172.21.15.6:0/3521774267 >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 0x7f87800cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 -- 172.21.15.6:0/3521774267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800cfe90 con 0x7f8780157ca0 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f8785cfb700 1 --2- 172.21.15.6:0/3521774267 >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 0x7f87800cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f87854fa700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f878015af00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87800646b0 tx=0x7f8774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b5a227907e7d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f8784cf9700 1 -- 172.21.15.6:0/3521774267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400b860 con 0x7f8780157ca0 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f8784cf9700 1 -- 172.21.15.6:0/3521774267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877400b9c0 con 0x7f8780157ca0 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.619+0000 7f8784cf9700 1 -- 172.21.15.6:0/3521774267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877400bd60 con 0x7f8780157ca0 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 -- 172.21.15.6:0/3521774267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 msgr2=0x7f878015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f878015af00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87800646b0 tx=0x7f8774009250 comp rx=0 tx=0).stop 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 -- 172.21.15.6:0/3521774267 shutdown_connections 2023-10-09T11:39:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f878006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 --2- 172.21.15.6:0/3521774267 >> v2:172.21.15.118:3300/0 conn(0x7f87801578d0 0x7f87800cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 --2- 172.21.15.6:0/3521774267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f878015af00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 -- 172.21.15.6:0/3521774267 >> 172.21.15.6:0/3521774267 conn(0x7f878006bb90 msgr2=0x7f878006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 -- 172.21.15.6:0/3521774267 shutdown_connections 2023-10-09T11:39:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.620+0000 7f8787f5f700 1 -- 172.21.15.6:0/3521774267 wait complete. 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.621+0000 7f8787f5f700 1 Processor -- start 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.621+0000 7f8787f5f700 1 -- start start 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f87801530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87801578d0 0x7f8780159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800b4f60 con 0x7f8780157ca0 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800b5dc0 con 0x7f87801578d0 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8787f5f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8780153630 con 0x7f878006d120 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44208/0 (socket says 172.21.15.6:44208) 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 -- 172.21.15.6:0/865550653 learned_addr learned my addr 172.21.15.6:0/865550653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87854fa700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87801578d0 0x7f8780159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f8785cfb700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f87801530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 -- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 msgr2=0x7f87801530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f87801530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 -- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87801578d0 msgr2=0x7f8780159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:47.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87801578d0 0x7f8780159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 -- 172.21.15.6:0/865550653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740094f0 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.622+0000 7f87864fc700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8778009fa0 tx=0x7f8778009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.623+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800ebc0 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.623+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800ed20 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.623+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87800b51b0 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.623+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778014670 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.623+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87800b5770 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.624+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8780067ac0 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.624+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87780149e0 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.625+0000 7f877dffb700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 0x7f876c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.625+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8778084960 con 0x7f8780157ca0 2023-10-09T11:39:47.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.625+0000 7f8785cfb700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 0x7f876c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:47.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.625+0000 7f8785cfb700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 0x7f876c0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87800cdb70 tx=0x7f8770008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:47.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.629+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8778051e30 con 0x7f8780157ca0 2023-10-09T11:39:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:47.901+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f87800d0170 con 0x7f8780157ca0 2023-10-09T11:39:48.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.124+0000 7f877dffb700 1 -- 172.21.15.6:0/865550653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v196) v1 ==== 134+0+0 (secure 0 0 0) 0x7f8778055450 con 0x7f8780157ca0 2023-10-09T11:39:48.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 msgr2=0x7f876c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 0x7f876c0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87800cdb70 tx=0x7f8770008040 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 msgr2=0x7f8780155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8778009fa0 tx=0x7f8778009900 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 shutdown_connections 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f876c066f30 0x7f876c0693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8780157ca0 0x7f8780155620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f878006d120 0x7f87801530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 --2- 172.21.15.6:0/865550653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87801578d0 0x7f8780159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 >> 172.21.15.6:0/865550653 conn(0x7f878006bb90 msgr2=0x7f878006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 shutdown_connections 2023-10-09T11:39:48.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.127+0000 7f8787f5f700 1 -- 172.21.15.6:0/865550653 wait complete. 2023-10-09T11:39:48.141 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T11:39:48.141 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-09T11:39:48.141 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T11:39:48.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-09T11:39:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.260+0000 7f535dd07700 1 Processor -- start 2023-10-09T11:39:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.260+0000 7f535dd07700 1 -- start start 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f535dd07700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f535dd07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f535806d120 0x7f535806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f535dd07700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580d07c0 con 0x7f5358157ca0 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f535dd07700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535806da50 con 0x7f535806d120 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f535dd07700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53580cfbb0 con 0x7f53581578d0 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f535806d120 0x7f535806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5356ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5358157ca0 0x7f535815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41208/0 (socket says 172.21.15.6:41208) 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f535806d120 0x7f535806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44216/0 (socket says 172.21.15.6:44216) 2023-10-09T11:39:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5356ffd700 1 -- 172.21.15.6:0/2270065627 learned_addr learned my addr 172.21.15.6:0/2270065627 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f53577fe700 1 --2- 172.21.15.6:0/2270065627 >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 -- 172.21.15.6:0/2270065627 >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 msgr2=0x7f53580cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 --2- 172.21.15.6:0/2270065627 >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 -- 172.21.15.6:0/2270065627 >> v1:172.21.15.6:6789/0 conn(0x7f5358157ca0 legacy=0x7f535815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 -- 172.21.15.6:0/2270065627 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580cfe90 con 0x7f535806d120 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f53567fc700 1 -- 172.21.15.6:0/2270065627 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991596124 0 0) 0x7f53580d07c0 con 0x7f5358157ca0 2023-10-09T11:39:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f53577fe700 1 --2- 172.21.15.6:0/2270065627 >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.261+0000 7f5357fff700 1 --2- 172.21.15.6:0/2270065627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f535806d120 0x7f535806d510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5350009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec39861fbc46e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f53567fc700 1 -- 172.21.15.6:0/2270065627 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000e070 con 0x7f535806d120 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f53567fc700 1 -- 172.21.15.6:0/2270065627 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000bc30 con 0x7f535806d120 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f53567fc700 1 -- 172.21.15.6:0/2270065627 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350012430 con 0x7f535806d120 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 -- 172.21.15.6:0/2270065627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f535806d120 msgr2=0x7f535806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 --2- 172.21.15.6:0/2270065627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f535806d120 0x7f535806d510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f53580646b0 tx=0x7f5350009780 comp rx=0 tx=0).stop 2023-10-09T11:39:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 -- 172.21.15.6:0/2270065627 shutdown_connections 2023-10-09T11:39:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 --2- 172.21.15.6:0/2270065627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f535806d120 0x7f535806d510 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 --2- 172.21.15.6:0/2270065627 >> v2:172.21.15.118:3300/0 conn(0x7f53581578d0 0x7f53580cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 -- 172.21.15.6:0/2270065627 >> 172.21.15.6:0/2270065627 conn(0x7f535806bb90 msgr2=0x7f535806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 -- 172.21.15.6:0/2270065627 shutdown_connections 2023-10-09T11:39:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.262+0000 7f535dd07700 1 -- 172.21.15.6:0/2270065627 wait complete. 2023-10-09T11:39:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.263+0000 7f535dd07700 1 Processor -- start 2023-10-09T11:39:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.263+0000 7f535dd07700 1 -- start start 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535806d120 0x7f5358142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 0x7f5358167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535816c920 con 0x7f53581578d0 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358143430 con 0x7f5358157ca0 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f535dd07700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535816bd10 con 0x7f535806d120 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5356ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5356ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44218/0 (socket says 172.21.15.6:44218) 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5356ffd700 1 -- 172.21.15.6:0/389868310 learned_addr learned my addr 172.21.15.6:0/389868310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5357fff700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 0x7f5358167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f53577fe700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535806d120 0x7f5358142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5356ffd700 1 -- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535806d120 msgr2=0x7f5358142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.264+0000 7f5356ffd700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535806d120 0x7f5358142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f5356ffd700 1 -- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 msgr2=0x7f5358167ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f5356ffd700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 0x7f5358167ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f5356ffd700 1 -- 172.21.15.6:0/389868310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009a20 con 0x7f53581578d0 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f5357fff700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 0x7f5358167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f5356ffd700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c610 tx=0x7f534c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c005b30 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c005cb0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535816bff0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c007320 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.265+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535816c5b0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.266+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535816cad0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.266+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f534c01b3b0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.267+0000 7f533f7fe700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.267+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f534c0836e0 con 0x7f53581578d0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.267+0000 7f53577fe700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.267+0000 7f53577fe700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53580693a0 tx=0x7f5348006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:48.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.271+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f535816cad0 con 0x7f53581578d0 2023-10-09T11:39:48.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:48.546+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f535816cad0 con 0x7f53581578d0 2023-10-09T11:39:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.131+0000 7f533f7fe700 1 -- 172.21.15.6:0/389868310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v197) v1 ==== 136+0+0 (secure 0 0 0) 0x7f535816cad0 con 0x7f53581578d0 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 msgr2=0x7f53440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53580693a0 tx=0x7f5348006f90 comp rx=0 tx=0).stop 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 msgr2=0x7f535816b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c610 tx=0x7f534c000fe0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 shutdown_connections 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5358157ca0 0x7f5358167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f535806d120 0x7f5358142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 --2- 172.21.15.6:0/389868310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53581578d0 0x7f535816b470 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 >> 172.21.15.6:0/389868310 conn(0x7f535806bb90 msgr2=0x7f53581566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 shutdown_connections 2023-10-09T11:39:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.133+0000 7f535dd07700 1 -- 172.21.15.6:0/389868310 wait complete. 2023-10-09T11:39:49.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T11:39:49.285 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_objectstore":"memstore"} 2023-10-09T11:39:49.285 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T11:39:49.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:39:49.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 Processor -- start 2023-10-09T11:39:49.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 -- start start 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c1578d0 0x7fc88c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc88c157ca0 0x7fc88c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0d07c0 con 0x7fc88c06d120 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c0cfbb0 con 0x7fc88c157ca0 2023-10-09T11:39:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.406+0000 7fc8914bb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0cfe90 con 0x7fc88c1578d0 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc88c157ca0 0x7fc88c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88affd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c1578d0 0x7fc88c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc88c157ca0 0x7fc88c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:37088/0 (socket says 172.21.15.6:37088) 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 -- 172.21.15.6:0/1264833283 learned_addr learned my addr 172.21.15.6:0/1264833283 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88b7fe700 1 --1- 172.21.15.6:0/1264833283 >> v1:172.21.15.118:6789/0 conn(0x7fc88c06d120 0x7fc88c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:36724/0 (socket says 172.21.15.6:36724) 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 -- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c1578d0 msgr2=0x7fc88c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c1578d0 0x7fc88c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 -- 172.21.15.6:0/1264833283 >> v1:172.21.15.118:6789/0 conn(0x7fc88c06d120 legacy=0x7fc88c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.407+0000 7fc88a7fc700 1 -- 172.21.15.6:0/1264833283 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0d0170 con 0x7fc88c157ca0 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c157ca0 0x7fc88c15af00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8740099b0 tx=0x7fc874009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8815677dca2779e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc889ffb700 1 -- 172.21.15.6:0/1264833283 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874009ea0 con 0x7fc88c157ca0 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc889ffb700 1 -- 172.21.15.6:0/1264833283 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87400b860 con 0x7fc88c157ca0 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc889ffb700 1 -- 172.21.15.6:0/1264833283 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400bc00 con 0x7fc88c157ca0 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 -- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c157ca0 msgr2=0x7fc88c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 --2- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c157ca0 0x7fc88c15af00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8740099b0 tx=0x7fc874009250 comp rx=0 tx=0).stop 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 -- 172.21.15.6:0/1264833283 shutdown_connections 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 --2- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c1578d0 0x7fc88c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 --2- 172.21.15.6:0/1264833283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c157ca0 0x7fc88c15af00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 -- 172.21.15.6:0/1264833283 >> 172.21.15.6:0/1264833283 conn(0x7fc88c06bb90 msgr2=0x7fc88c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 -- 172.21.15.6:0/1264833283 shutdown_connections 2023-10-09T11:39:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.408+0000 7fc8914bb700 1 -- 172.21.15.6:0/1264833283 wait complete. 2023-10-09T11:39:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.409+0000 7fc8914bb700 1 Processor -- start 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 -- start start 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 0x7fc88c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c157ca0 0x7fc88c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c1452e0 con 0x7fc88c06d120 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0ccfc0 con 0x7fc88c1578d0 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc8914bb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0c6a70 con 0x7fc88c157ca0 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc88affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc88affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44220/0 (socket says 172.21.15.6:44220) 2023-10-09T11:39:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.410+0000 7fc88affd700 1 -- 172.21.15.6:0/2126302623 learned_addr learned my addr 172.21.15.6:0/2126302623 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88b7fe700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c157ca0 0x7fc88c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 0x7fc88c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 -- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c157ca0 msgr2=0x7fc88c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c157ca0 0x7fc88c15a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 -- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 msgr2=0x7fc88c0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 0x7fc88c0cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 -- 172.21.15.6:0/2126302623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094f0 con 0x7fc88c06d120 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 0x7fc88c0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc88affd700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00ecb0 tx=0x7fc87c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00c970 con 0x7fc88c06d120 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c00cad0 con 0x7fc88c06d120 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c0cc3b0 con 0x7fc88c06d120 2023-10-09T11:39:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00ce70 con 0x7fc88c06d120 2023-10-09T11:39:49.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.411+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c0cc970 con 0x7fc88c06d120 2023-10-09T11:39:49.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.412+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c0cd2a0 con 0x7fc88c06d120 2023-10-09T11:39:49.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.413+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc87c013680 con 0x7fc88c06d120 2023-10-09T11:39:49.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.413+0000 7fc882ffd700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 0x7fc86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.413+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc87c084920 con 0x7fc88c06d120 2023-10-09T11:39:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.413+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 0x7fc86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.414+0000 7fc88a7fc700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 0x7fc86c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc8740099b0 tx=0x7fc874017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.417+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc87c051e90 con 0x7fc88c06d120 2023-10-09T11:39:49.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.610+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc88c067b30 con 0x7fc88c06d120 2023-10-09T11:39:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.616+0000 7fc882ffd700 1 -- 172.21.15.6:0/2126302623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc87c0170c0 con 0x7fc88c06d120 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 msgr2=0x7fc86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 0x7fc86c0693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc8740099b0 tx=0x7fc874017000 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 msgr2=0x7fc88c0c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00ecb0 tx=0x7fc87c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 shutdown_connections 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc86c066f30 0x7fc86c0693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc88c157ca0 0x7fc88c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc88c06d120 0x7fc88c0c6530 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 --2- 172.21.15.6:0/2126302623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc88c1578d0 0x7fc88c0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 >> 172.21.15.6:0/2126302623 conn(0x7fc88c06bb90 msgr2=0x7fc88c155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:49.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 shutdown_connections 2023-10-09T11:39:49.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.618+0000 7fc8914bb700 1 -- 172.21.15.6:0/2126302623 wait complete. 2023-10-09T11:39:49.631 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:39:49.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:39:49.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:39:49.710 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:39:49.710 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:39:49.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.827+0000 7f7f3d52e700 1 Processor -- start 2023-10-09T11:39:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.827+0000 7f7f3d52e700 1 -- start start 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.828+0000 7f7f3d52e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 0x7f7f3815de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.828+0000 7f7f3d52e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 0x7f7f38159c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.828+0000 7f7f3d52e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3806d350 con 0x7f7f380cae00 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.828+0000 7f7f3d52e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380c9ac0 con 0x7f7f3815daa0 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.828+0000 7f7f3d52e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3815e3b0 con 0x7f7f380cb2a0 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 0x7f7f38159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f36ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 0x7f7f3815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f367fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7f380cae00 0x7f7f38159540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:36726/0 (socket says 172.21.15.6:36726) 2023-10-09T11:39:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f367fc700 1 -- 172.21.15.6:0/720792905 learned_addr learned my addr 172.21.15.6:0/720792905 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 -- 172.21.15.6:0/720792905 >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 msgr2=0x7f7f3815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 --2- 172.21.15.6:0/720792905 >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 0x7f7f3815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 -- 172.21.15.6:0/720792905 >> v1:172.21.15.118:6789/0 conn(0x7f7f380cae00 legacy=0x7f7f38159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 -- 172.21.15.6:0/720792905 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3806c740 con 0x7f7f380cb2a0 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f36ffd700 1 --2- 172.21.15.6:0/720792905 >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 0x7f7f3815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f377fe700 1 --2- 172.21.15.6:0/720792905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 0x7f7f38159c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009e60 tx=0x7f7f28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd073036d1c3ea94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f35ffb700 1 -- 172.21.15.6:0/720792905 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2800e070 con 0x7f7f380cb2a0 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f35ffb700 1 -- 172.21.15.6:0/720792905 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2800bb60 con 0x7f7f380cb2a0 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.829+0000 7f7f35ffb700 1 -- 172.21.15.6:0/720792905 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28012430 con 0x7f7f380cb2a0 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 -- 172.21.15.6:0/720792905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 msgr2=0x7f7f38159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/720792905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 0x7f7f38159c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009e60 tx=0x7f7f28009780 comp rx=0 tx=0).stop 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 -- 172.21.15.6:0/720792905 shutdown_connections 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/720792905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f380cb2a0 0x7f7f38159c50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/720792905 >> v2:172.21.15.118:3300/0 conn(0x7f7f3815daa0 0x7f7f3815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 -- 172.21.15.6:0/720792905 >> 172.21.15.6:0/720792905 conn(0x7f7f380c9ca0 msgr2=0x7f7f380ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 -- 172.21.15.6:0/720792905 shutdown_connections 2023-10-09T11:39:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.830+0000 7f7f3d52e700 1 -- 172.21.15.6:0/720792905 wait complete. 2023-10-09T11:39:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.831+0000 7f7f3d52e700 1 Processor -- start 2023-10-09T11:39:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.831+0000 7f7f3d52e700 1 -- start start 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f380cae00 0x7f7f380c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f3815daa0 0x7f7f380c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f381552b0 con 0x7f7f380cb2a0 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380b0cc0 con 0x7f7f380cae00 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f3d52e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380b0fa0 con 0x7f7f3815daa0 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44226/0 (socket says 172.21.15.6:44226) 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 -- 172.21.15.6:0/3569903288 learned_addr learned my addr 172.21.15.6:0/3569903288 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f36ffd700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f380cae00 0x7f7f380c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f377fe700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f3815daa0 0x7f7f380c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 -- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f3815daa0 msgr2=0x7f7f380c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f3815daa0 0x7f7f380c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 -- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f380cae00 msgr2=0x7f7f380c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f380cae00 0x7f7f380c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.832+0000 7f7f367fc700 1 -- 172.21.15.6:0/3569903288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30009420 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f367fc700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000c560 tx=0x7f7f20001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20005b30 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20005c90 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20007320 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f28009a20 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.833+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f380b1330 con 0x7f7f380cb2a0 2023-10-09T11:39:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.834+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f380b14c0 con 0x7f7f380cb2a0 2023-10-09T11:39:49.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.834+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f2001b3b0 con 0x7f7f380cb2a0 2023-10-09T11:39:49.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.835+0000 7f7f2effd700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 0x7f7f180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:49.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.835+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7f200835a0 con 0x7f7f380cb2a0 2023-10-09T11:39:49.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.835+0000 7f7f36ffd700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 0x7f7f180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.835+0000 7f7f36ffd700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 0x7f7f180693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009f40 tx=0x7f7f300091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:49.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:49.839+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f380b14c0 con 0x7f7f380cb2a0 2023-10-09T11:39:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.074+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f380b14c0 con 0x7f7f380cb2a0 2023-10-09T11:39:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.074+0000 7f7f2effd700 1 -- 172.21.15.6:0/3569903288 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f7f20017de0 con 0x7f7f380cb2a0 2023-10-09T11:39:50.076 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:50.076 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5186,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1437007540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1437007540},{"type":"v1","addr":"172.21.15.118:6835","nonce":1437007540}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3634498994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3634498994},{"type":"v1","addr":"172.21.15.118:6834","nonce":3634498994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1310127969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1310127969},{"type":"v1","addr":"172.21.15.6:6836","nonce":1310127969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/781464438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":781464438},{"type":"v1","addr":"172.21.15.6:6837","nonce":781464438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-10-09T11:39:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 msgr2=0x7f7f180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 0x7f7f180693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009f40 tx=0x7f7f300091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 msgr2=0x7f7f380c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000c560 tx=0x7f7f20001020 comp rx=0 tx=0).stop 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 shutdown_connections 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7f18066f30 0x7f7f180693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f3815daa0 0x7f7f380c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f380cae00 0x7f7f380c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 --2- 172.21.15.6:0/3569903288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f380cb2a0 0x7f7f380c42e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 >> 172.21.15.6:0/3569903288 conn(0x7f7f380c9ca0 msgr2=0x7f7f380c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 shutdown_connections 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.077+0000 7f7f3d52e700 1 -- 172.21.15.6:0/3569903288 wait complete. 2023-10-09T11:39:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 37 2023-10-09T11:39:50.091 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:39:50.091 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:39:50.091 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:39:50.091 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:39:50.091 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:39:50.092 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:39:50.092 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:39:50.092 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:39:50.092 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:39:50.092 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:39:50.093 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:39:50.093 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:39:50.093 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:39:50.093 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:39:50.093 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:39:50.094 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:39:50.100 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:39:50.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:39:50.101 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:39:50.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:39:50.102 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:39:50.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:39:50.103 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:39:50.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:39:50.142 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:39:50.142 DEBUG:teuthology.parallel:result is None 2023-10-09T11:39:50.143 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:39:50.143 DEBUG:teuthology.parallel:result is None 2023-10-09T11:39:50.145 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:39:50.145 DEBUG:teuthology.parallel:result is None 2023-10-09T11:39:50.145 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:39:50.146 DEBUG:teuthology.parallel:result is None 2023-10-09T11:39:50.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:39:50.217 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:39:50.217 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:39:50.221 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:39:50.221 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:39:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.268+0000 7f43a3145700 1 Processor -- start 2023-10-09T11:39:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.268+0000 7f43a3145700 1 -- start start 2023-10-09T11:39:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a3145700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 0x7f439c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a3145700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f439c0c8880 0x7f439c157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a3145700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06ac50 con 0x7f439c06ceb0 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a3145700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c06a400 con 0x7f439c0c8880 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a3145700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c8fd0 con 0x7f439c156d60 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a16e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f439c0c8880 0x7f439c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a0ee1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 0x7f439c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a16e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f439c0c8880 0x7f439c157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:37170/0 (socket says 172.21.15.6:37170) 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f439bfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f439c06ceb0 0x7f439c157130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:36730/0 (socket says 172.21.15.6:36730) 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a16e2700 1 -- 172.21.15.6:0/4057883607 learned_addr learned my addr 172.21.15.6:0/4057883607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a0ee1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 0x7f439c06b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:59482/0 (socket says 172.21.15.6:59482) 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a16e2700 1 -- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 msgr2=0x7f439c06b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.269+0000 7f43a16e2700 1 --2- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 0x7f439c06b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a16e2700 1 -- 172.21.15.6:0/4057883607 >> v1:172.21.15.118:6789/0 conn(0x7f439c06ceb0 legacy=0x7f439c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a16e2700 1 -- 172.21.15.6:0/4057883607 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c157d80 con 0x7f439c0c8880 2023-10-09T11:39:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a16e2700 1 --2- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c0c8880 0x7f439c157840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f439400d1a0 tx=0x7f439400ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a8e2b4dad7f364 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f439b7fe700 1 -- 172.21.15.6:0/4057883607 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394010070 con 0x7f439c0c8880 2023-10-09T11:39:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f439b7fe700 1 -- 172.21.15.6:0/4057883607 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439400de10 con 0x7f439c0c8880 2023-10-09T11:39:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f439b7fe700 1 -- 172.21.15.6:0/4057883607 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400b320 con 0x7f439c0c8880 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 -- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c0c8880 msgr2=0x7f439c157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 --2- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c0c8880 0x7f439c157840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f439400d1a0 tx=0x7f439400ba50 comp rx=0 tx=0).stop 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 -- 172.21.15.6:0/4057883607 shutdown_connections 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 --2- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c0c8880 0x7f439c157840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 --2- 172.21.15.6:0/4057883607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c156d60 0x7f439c06b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 -- 172.21.15.6:0/4057883607 >> 172.21.15.6:0/4057883607 conn(0x7f439c0c9ca0 msgr2=0x7f439c0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 -- 172.21.15.6:0/4057883607 shutdown_connections 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.270+0000 7f43a3145700 1 -- 172.21.15.6:0/4057883607 wait complete. 2023-10-09T11:39:50.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 Processor -- start 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 -- start start 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c0c8880 0x7f439c143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c156d60 0x7f439c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0b2f50 con 0x7f439c06ceb0 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c4820 con 0x7f439c156d60 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.272+0000 7f43a3145700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0b0be0 con 0x7f439c0c8880 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44274/0 (socket says 172.21.15.6:44274) 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 -- 172.21.15.6:0/2212686885 learned_addr learned my addr 172.21.15.6:0/2212686885 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f439bfff700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c0c8880 0x7f439c143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a16e2700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c156d60 0x7f439c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 -- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c0c8880 msgr2=0x7f439c143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c0c8880 0x7f439c143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 -- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c156d60 msgr2=0x7f439c15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c156d60 0x7f439c15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 -- 172.21.15.6:0/2212686885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439400bcf0 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a0ee1700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e930 tx=0x7f438c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c013680 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c144200 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c0137e0 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c013b80 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.273+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0b02b0 con 0x7f439c06ceb0 2023-10-09T11:39:50.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.274+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c0b0ec0 con 0x7f439c06ceb0 2023-10-09T11:39:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.275+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f438c00c3e0 con 0x7f439c06ceb0 2023-10-09T11:39:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.275+0000 7f4398ff9700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 0x7f43880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.275+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f438c0843b0 con 0x7f439c06ceb0 2023-10-09T11:39:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.275+0000 7f439bfff700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 0x7f43880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:50.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.276+0000 7f439bfff700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 0x7f43880693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f439c06c8f0 tx=0x7f4390007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.280+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f438c051920 con 0x7f439c06ceb0 2023-10-09T11:39:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:50.488+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f439c1562f0 con 0x7f439c06ceb0 2023-10-09T11:39:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.911+0000 7f4398ff9700 1 -- 172.21.15.6:0/2212686885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) v1 ==== 97+0+0 (secure 0 0 0) 0x7f438c054f40 con 0x7f439c06ceb0 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 msgr2=0x7f43880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 0x7f43880693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f439c06c8f0 tx=0x7f4390007eb0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 msgr2=0x7f439c0c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e930 tx=0x7f438c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 shutdown_connections 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4388066f30 0x7f43880693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f439c156d60 0x7f439c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f439c06ceb0 0x7f439c0c42e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 --2- 172.21.15.6:0/2212686885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f439c0c8880 0x7f439c143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 >> 172.21.15.6:0/2212686885 conn(0x7f439c0c9ca0 msgr2=0x7f439c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 shutdown_connections 2023-10-09T11:39:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:51.914+0000 7f43a3145700 1 -- 172.21.15.6:0/2212686885 wait complete. 2023-10-09T11:39:51.917 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:39:51.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:39:52.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.055+0000 7ff53c161700 1 Processor -- start 2023-10-09T11:39:52.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.055+0000 7ff53c161700 1 -- start start 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53c161700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5340b3bd0 0x7ff5340ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53c161700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5341583b0 0x7ff5340cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53c161700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340b2890 con 0x7ff534157fe0 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53c161700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340b4070 con 0x7ff5341583b0 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53c161700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340b4350 con 0x7ff5340b3bd0 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5341583b0 0x7ff5340cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff539efd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff534157fe0 0x7ff5340b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41224/0 (socket says 172.21.15.6:41224) 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff539efd700 1 -- 172.21.15.6:0/1447894595 learned_addr learned my addr 172.21.15.6:0/1447894595 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 -- 172.21.15.6:0/1447894595 >> v2:172.21.15.118:3300/0 conn(0x7ff5340b3bd0 msgr2=0x7ff5340ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:52.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 --2- 172.21.15.6:0/1447894595 >> v2:172.21.15.118:3300/0 conn(0x7ff5340b3bd0 0x7ff5340ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 -- 172.21.15.6:0/1447894595 >> v1:172.21.15.6:6789/0 conn(0x7ff534157fe0 legacy=0x7ff5340b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 -- 172.21.15.6:0/1447894595 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340b4630 con 0x7ff5341583b0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff538efb700 1 -- 172.21.15.6:0/1447894595 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523453920 0 0) 0x7ff5340b2890 con 0x7ff534157fe0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff53a6fe700 1 --2- 172.21.15.6:0/1447894595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5341583b0 0x7ff5340cf070 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff53404c150 tx=0x7ff52c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4271e7e97ec520c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.056+0000 7ff538efb700 1 -- 172.21.15.6:0/1447894595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00e070 con 0x7ff5341583b0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff538efb700 1 -- 172.21.15.6:0/1447894595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00bc30 con 0x7ff5341583b0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff538efb700 1 -- 172.21.15.6:0/1447894595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c012430 con 0x7ff5341583b0 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 -- 172.21.15.6:0/1447894595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5341583b0 msgr2=0x7ff5340cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 --2- 172.21.15.6:0/1447894595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5341583b0 0x7ff5340cf070 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff53404c150 tx=0x7ff52c009780 comp rx=0 tx=0).stop 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 -- 172.21.15.6:0/1447894595 shutdown_connections 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 --2- 172.21.15.6:0/1447894595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5341583b0 0x7ff5340cf070 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 --2- 172.21.15.6:0/1447894595 >> v2:172.21.15.118:3300/0 conn(0x7ff5340b3bd0 0x7ff5340ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 -- 172.21.15.6:0/1447894595 >> 172.21.15.6:0/1447894595 conn(0x7ff534067640 msgr2=0x7ff534067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:52.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 -- 172.21.15.6:0/1447894595 shutdown_connections 2023-10-09T11:39:52.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.057+0000 7ff53c161700 1 -- 172.21.15.6:0/1447894595 wait complete. 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.058+0000 7ff53c161700 1 Processor -- start 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.058+0000 7ff53c161700 1 -- start start 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5340b3bd0 0x7ff534153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341583b0 0x7ff5340cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c6240 con 0x7ff534157fe0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c5f10 con 0x7ff5340b3bd0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53c161700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340ca470 con 0x7ff5341583b0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44292/0 (socket says 172.21.15.6:44292) 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 -- 172.21.15.6:0/1249238467 learned_addr learned my addr 172.21.15.6:0/1249238467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff53a6fe700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341583b0 0x7ff5340cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff539efd700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5340b3bd0 0x7ff534153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 -- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341583b0 msgr2=0x7ff5340cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341583b0 0x7ff5340cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 -- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5340b3bd0 msgr2=0x7ff534153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5340b3bd0 0x7ff534153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.059+0000 7ff5396fc700 1 -- 172.21.15.6:0/1249238467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c009a20 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff5396fc700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff52400b5e0 tx=0x7ff5240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400f510 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400f670 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400fa30 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5340ca750 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.060+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5341544c0 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.061+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534069e40 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.061+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff52401a400 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.062+0000 7ff529ffb700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.062+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff524083d90 con 0x7ff534157fe0 2023-10-09T11:39:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.062+0000 7ff539efd700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.062+0000 7ff539efd700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 0x7ff5180693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5300011e0 tx=0x7ff530009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.066+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5240513d0 con 0x7ff534157fe0 2023-10-09T11:39:52.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.337+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff53415b920 con 0x7ff534157fe0 2023-10-09T11:39:52.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.337+0000 7ff529ffb700 1 -- 172.21.15.6:0/1249238467 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff5240549f0 con 0x7ff534157fe0 2023-10-09T11:39:52.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:52.339 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:39:52.339 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:39:52.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:39:52.340 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:39:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.342 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:39:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.346 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.348 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:39:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:39:52.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:39:52.353 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:39:52.354 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:39:52.355 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 msgr2=0x7ff5180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 0x7ff5180693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5300011e0 tx=0x7ff530009040 comp rx=0 tx=0).stop 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 msgr2=0x7ff5340c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff52400b5e0 tx=0x7ff5240091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 shutdown_connections 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff518066f30 0x7ff5180693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341583b0 0x7ff5340cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5340b3bd0 0x7ff534153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 --2- 172.21.15.6:0/1249238467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157fe0 0x7ff5340c8df0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 >> 172.21.15.6:0/1249238467 conn(0x7ff534067640 msgr2=0x7ff534156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 shutdown_connections 2023-10-09T11:39:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.340+0000 7ff53c161700 1 -- 172.21.15.6:0/1249238467 wait complete. 2023-10-09T11:39:52.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 Processor -- start 2023-10-09T11:39:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 -- start start 2023-10-09T11:39:52.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff744157ca0 0x7ff7440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff74406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7440d07c0 con 0x7ff7441578d0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74406daa0 con 0x7ff744157ca0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.476+0000 7ff74af9f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440cfbb0 con 0x7ff74406d120 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff748d3b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7441578d0 0x7ff74415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41240/0 (socket says 172.21.15.6:41240) 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff748d3b700 1 -- 172.21.15.6:0/2010173166 learned_addr learned my addr 172.21.15.6:0/2010173166 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff743fff700 1 --2- 172.21.15.6:0/2010173166 >> v2:172.21.15.118:3300/0 conn(0x7ff744157ca0 0x7ff7440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff74953c700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff74406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083271668 0 0) 0x7ff7440d07c0 con 0x7ff7441578d0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff730003570 con 0x7ff7441578d0 2023-10-09T11:39:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920826338 0 0) 0x7ff730003570 con 0x7ff7441578d0 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 msgr2=0x7ff74406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff74406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 >> v2:172.21.15.118:3300/0 conn(0x7ff744157ca0 msgr2=0x7ff7440cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 --2- 172.21.15.6:0/2010173166 >> v2:172.21.15.118:3300/0 conn(0x7ff744157ca0 0x7ff7440cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7440cfe90 con 0x7ff7441578d0 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ff72c001470 con 0x7ff7441578d0 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 >> v1:172.21.15.6:6789/0 conn(0x7ff7441578d0 legacy=0x7ff74415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff730003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff730004810 0x7ff730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff7300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74406daa0 con 0x7ff730003a60 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440cfbb0 con 0x7ff730004810 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73000ba60 con 0x7ff74406d120 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff748d3b700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff730003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff743fff700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff730004810 0x7ff730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.477+0000 7ff74953c700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff7300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 -- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 msgr2=0x7ff7300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff74406d120 0x7ff7300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 -- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff730004810 msgr2=0x7ff730004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff730004810 0x7ff730004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 -- 172.21.15.6:0/2010173166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730003570 con 0x7ff730003a60 2023-10-09T11:39:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff748d3b700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff730003e70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c3f0 tx=0x7ff7440d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9b89d23a7cf06c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00cc80 con 0x7ff730003a60 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00ce20 con 0x7ff730003a60 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff7437fe700 1 -- 172.21.15.6:0/2010173166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c005b70 con 0x7ff730003a60 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74af9f700 1 -- 172.21.15.6:0/2010173166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 msgr2=0x7ff730003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74af9f700 1 --2- 172.21.15.6:0/2010173166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff730003e70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c3f0 tx=0x7ff7440d0730 comp rx=0 tx=0).stop 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74953c700 1 -- 172.21.15.6:0/2010173166 reap_dead start 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74af9f700 1 -- 172.21.15.6:0/2010173166 shutdown_connections 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74af9f700 1 -- 172.21.15.6:0/2010173166 >> 172.21.15.6:0/2010173166 conn(0x7ff74406bb90 msgr2=0x7ff74406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.478+0000 7ff74af9f700 1 -- 172.21.15.6:0/2010173166 shutdown_connections 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.479+0000 7ff74af9f700 1 -- 172.21.15.6:0/2010173166 wait complete. 2023-10-09T11:39:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.480+0000 7ff74af9f700 1 Processor -- start 2023-10-09T11:39:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.480+0000 7ff74af9f700 1 -- start start 2023-10-09T11:39:52.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.480+0000 7ff74af9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.480+0000 7ff74af9f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7440c8450 0x7ff7440b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 0x7ff744069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440b6a10 con 0x7ff730003a60 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74406a4f0 con 0x7ff744069b30 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74416b090 con 0x7ff7440c8450 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44310/0 (socket says 172.21.15.6:44310) 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 -- 172.21.15.6:0/3213546177 learned_addr learned my addr 172.21.15.6:0/3213546177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74953c700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 0x7ff744069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff743fff700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7440c8450 0x7ff7440b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 -- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7440c8450 msgr2=0x7ff7440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7440c8450 0x7ff7440b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 -- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 msgr2=0x7ff744069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 0x7ff744069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 -- 172.21.15.6:0/3213546177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74416a760 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74953c700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 0x7ff744069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff748d3b700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c9e0 tx=0x7ff72c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0072e0 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c007440 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74416aa40 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c007800 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.481+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74416b520 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.482+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff744067ac0 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.483+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff72c019070 con 0x7ff730003a60 2023-10-09T11:39:52.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.483+0000 7ff740ff9700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 0x7ff7240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.483+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff72c0851d0 con 0x7ff730003a60 2023-10-09T11:39:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.483+0000 7ff743fff700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 0x7ff7240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.483+0000 7ff743fff700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 0x7ff7240693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff734006dc0 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.487+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff72c056220 con 0x7ff730003a60 2023-10-09T11:39:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.683+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7440d0170 con 0x7ff730003a60 2023-10-09T11:39:52.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.684+0000 7ff740ff9700 1 -- 172.21.15.6:0/3213546177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+12086 (secure 0 0 0) 0x7ff72c083e60 con 0x7ff730003a60 2023-10-09T11:39:52.685 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:52.685 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:51.908934+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 msgr2=0x7ff7240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 0x7ff7240693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff734006dc0 tx=0x7ff734008040 comp rx=0 tx=0).stop 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 msgr2=0x7ff7440cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c9e0 tx=0x7ff72c015000 comp rx=0 tx=0).stop 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 shutdown_connections 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff724066f30 0x7ff7240693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff744069b30 0x7ff744069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff730003a60 0x7ff7440cd4e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 --2- 172.21.15.6:0/3213546177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7440c8450 0x7ff7440b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 >> 172.21.15.6:0/3213546177 conn(0x7ff74406bb90 msgr2=0x7ff744155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 shutdown_connections 2023-10-09T11:39:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.686+0000 7ff74af9f700 1 -- 172.21.15.6:0/3213546177 wait complete. 2023-10-09T11:39:52.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:39:52.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:39:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.820+0000 7f50f3427700 1 Processor -- start 2023-10-09T11:39:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.820+0000 7f50f3427700 1 -- start start 2023-10-09T11:39:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f3427700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50ec0cddd0 0x7f50ec0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f3427700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0cadb0 con 0x7f50ec0b43c0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f3427700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0cf000 con 0x7f50ec0cb240 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f3427700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec0cf2e0 con 0x7f50ec0cddd0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f2425700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f50ec0b43c0 0x7f50ec0cc5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41256/0 (socket says 172.21.15.6:41256) 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f1c24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50ec0cddd0 0x7f50ec0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.821+0000 7f50f2425700 1 -- 172.21.15.6:0/2499489431 learned_addr learned my addr 172.21.15.6:0/2499489431 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1c24700 1 -- 172.21.15.6:0/2499489431 >> v1:172.21.15.118:6789/0 conn(0x7f50ec0cb240 legacy=0x7f50ec0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1c24700 1 -- 172.21.15.6:0/2499489431 >> v1:172.21.15.6:6789/0 conn(0x7f50ec0b43c0 legacy=0x7f50ec0cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1c24700 1 -- 172.21.15.6:0/2499489431 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0ca760 con 0x7f50ec0cddd0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1423700 1 -- 172.21.15.6:0/2499489431 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547802249 0 0) 0x7f50ec0cadb0 con 0x7f50ec0b43c0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1c24700 1 --2- 172.21.15.6:0/2499489431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0cccc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f50e00098e0 tx=0x7f50e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88f938b320487dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1423700 1 -- 172.21.15.6:0/2499489431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0009e80 con 0x7f50ec0cddd0 2023-10-09T11:39:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1423700 1 -- 172.21.15.6:0/2499489431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e000b860 con 0x7f50ec0cddd0 2023-10-09T11:39:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f1423700 1 -- 172.21.15.6:0/2499489431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e000bbe0 con 0x7f50ec0cddd0 2023-10-09T11:39:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.822+0000 7f50f3427700 1 -- 172.21.15.6:0/2499489431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 msgr2=0x7f50ec0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 --2- 172.21.15.6:0/2499489431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0cccc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f50e00098e0 tx=0x7f50e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 -- 172.21.15.6:0/2499489431 shutdown_connections 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 --2- 172.21.15.6:0/2499489431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0cccc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 -- 172.21.15.6:0/2499489431 >> 172.21.15.6:0/2499489431 conn(0x7f50ec068110 msgr2=0x7f50ec06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 -- 172.21.15.6:0/2499489431 shutdown_connections 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.823+0000 7f50f3427700 1 -- 172.21.15.6:0/2499489431 wait complete. 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.824+0000 7f50f3427700 1 Processor -- start 2023-10-09T11:39:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.824+0000 7f50f3427700 1 -- start start 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.824+0000 7f50f3427700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50ec0b43c0 0x7f50ec1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ec0cb240 0x7f50ec158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0a72b0 con 0x7f50ec0cddd0 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec159760 con 0x7f50ec0cb240 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec149b20 con 0x7f50ec0b43c0 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44330/0 (socket says 172.21.15.6:44330) 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 -- 172.21.15.6:0/3220700286 learned_addr learned my addr 172.21.15.6:0/3220700286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2425700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50ec0b43c0 0x7f50ec1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f1c24700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ec0cb240 0x7f50ec158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 -- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50ec0b43c0 msgr2=0x7f50ec1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50ec0b43c0 0x7f50ec1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 -- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ec0cb240 msgr2=0x7f50ec158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ec0cb240 0x7f50ec158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 -- 172.21.15.6:0/3220700286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0009420 con 0x7f50ec0cddd0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f2c26700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c960 tx=0x7f50dc001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012630 con 0x7f50ec0cddd0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc012790 con 0x7f50ec0cddd0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012b50 con 0x7f50ec0cddd0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec158b50 con 0x7f50ec0cddd0 2023-10-09T11:39:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.825+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec159110 con 0x7f50ec0cddd0 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.826+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec069c00 con 0x7f50ec0cddd0 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.827+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50dc01a3a0 con 0x7f50ec0cddd0 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.827+0000 7f50ea7fc700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 0x7f50d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.827+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f50dc0843c0 con 0x7f50ec0cddd0 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.827+0000 7f50f2425700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 0x7f50d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.828+0000 7f50f2425700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 0x7f50d80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0c8f80 tx=0x7f50e4007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:52.831+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50dc051980 con 0x7f50ec0cddd0 2023-10-09T11:39:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.024+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50ec071b10 con 0x7f50ec0cddd0 2023-10-09T11:39:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.024+0000 7f50ea7fc700 1 -- 172.21.15.6:0/3220700286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50dc054fa0 con 0x7f50ec0cddd0 2023-10-09T11:39:53.026 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 msgr2=0x7f50d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 0x7f50d80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0c8f80 tx=0x7f50e4007d10 comp rx=0 tx=0).stop 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 msgr2=0x7f50ec0c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c960 tx=0x7f50dc001750 comp rx=0 tx=0).stop 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 shutdown_connections 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f50d8066f30 0x7f50d80693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50ec0cddd0 0x7f50ec0c8390 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50ec0b43c0 0x7f50ec1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 --2- 172.21.15.6:0/3220700286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ec0cb240 0x7f50ec158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 >> 172.21.15.6:0/3220700286 conn(0x7f50ec068110 msgr2=0x7f50ec156070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 shutdown_connections 2023-10-09T11:39:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.026+0000 7f50f3427700 1 -- 172.21.15.6:0/3220700286 wait complete. 2023-10-09T11:39:53.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:39:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.158+0000 7f8859c54700 1 Processor -- start 2023-10-09T11:39:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.158+0000 7f8859c54700 1 -- start start 2023-10-09T11:39:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859c54700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8854159f10 0x7f8854068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859c54700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8854068cc0 0x7f88540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859c54700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8854069120 con 0x7f8854159b40 2023-10-09T11:39:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859c54700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540cee10 con 0x7f8854068cc0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859c54700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540cd040 con 0x7f8854159f10 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8854068cc0 0x7f88540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8854068cc0 0x7f88540cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44338/0 (socket says 172.21.15.6:44338) 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 -- 172.21.15.6:0/1216748732 learned_addr learned my addr 172.21.15.6:0/1216748732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8853fff700 1 --2- 172.21.15.6:0/1216748732 >> v2:172.21.15.118:3300/0 conn(0x7f8854159f10 0x7f8854068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 -- 172.21.15.6:0/1216748732 >> v2:172.21.15.118:3300/0 conn(0x7f8854159f10 msgr2=0x7f8854068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 --2- 172.21.15.6:0/1216748732 >> v2:172.21.15.118:3300/0 conn(0x7f8854159f10 0x7f8854068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 -- 172.21.15.6:0/1216748732 >> v1:172.21.15.118:6789/0 conn(0x7f8854159b40 legacy=0x7f88540cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.159+0000 7f8859453700 1 -- 172.21.15.6:0/1216748732 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540cd320 con 0x7f8854068cc0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859453700 1 --2- 172.21.15.6:0/1216748732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854068cc0 0x7f88540cf2a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f885406fd80 tx=0x7f884c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a06ad7a10d8ed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f88537fe700 1 -- 172.21.15.6:0/1216748732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c00b860 con 0x7f8854068cc0 2023-10-09T11:39:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f88537fe700 1 -- 172.21.15.6:0/1216748732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c00b9c0 con 0x7f8854068cc0 2023-10-09T11:39:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f88537fe700 1 -- 172.21.15.6:0/1216748732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c00bd60 con 0x7f8854068cc0 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 -- 172.21.15.6:0/1216748732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854068cc0 msgr2=0x7f88540cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 --2- 172.21.15.6:0/1216748732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854068cc0 0x7f88540cf2a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f885406fd80 tx=0x7f884c009250 comp rx=0 tx=0).stop 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 -- 172.21.15.6:0/1216748732 shutdown_connections 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 --2- 172.21.15.6:0/1216748732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854068cc0 0x7f88540cf2a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 --2- 172.21.15.6:0/1216748732 >> v2:172.21.15.118:3300/0 conn(0x7f8854159f10 0x7f8854068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 -- 172.21.15.6:0/1216748732 >> 172.21.15.6:0/1216748732 conn(0x7f88540cd660 msgr2=0x7f88540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 -- 172.21.15.6:0/1216748732 shutdown_connections 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.160+0000 7f8859c54700 1 -- 172.21.15.6:0/1216748732 wait complete. 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.161+0000 7f8859c54700 1 Processor -- start 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 -- start start 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8854068cc0 0x7f8854155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 0x7f885406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854158810 con 0x7f8854159b40 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88541565a0 con 0x7f8854068cc0 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8859c54700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8854156880 con 0x7f8854159f10 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.162+0000 7f8853fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44350/0 (socket says 172.21.15.6:44350) 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 -- 172.21.15.6:0/203546296 learned_addr learned my addr 172.21.15.6:0/203546296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8859453700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 0x7f885406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8858c52700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8854068cc0 0x7f8854155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 -- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 msgr2=0x7f885406ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 0x7f885406ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 -- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8854068cc0 msgr2=0x7f8854155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8854068cc0 0x7f8854155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 -- 172.21.15.6:0/203546296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0094f0 con 0x7f8854159b40 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8859453700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 0x7f885406ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8853fff700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8844009fa0 tx=0x7f8844009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400ed20 con 0x7f8854159b40 2023-10-09T11:39:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400ee80 con 0x7f8854159b40 2023-10-09T11:39:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844014670 con 0x7f8854159b40 2023-10-09T11:39:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8854156b60 con 0x7f8854159b40 2023-10-09T11:39:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.163+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8854153fb0 con 0x7f8854159b40 2023-10-09T11:39:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.164+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88540d0130 con 0x7f8854159b40 2023-10-09T11:39:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.165+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88440149e0 con 0x7f8854159b40 2023-10-09T11:39:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.165+0000 7f8850ff9700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 0x7f88340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.165+0000 7f8858c52700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 0x7f88340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.165+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8844084970 con 0x7f8854159b40 2023-10-09T11:39:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.166+0000 7f8858c52700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 0x7f88340693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f883c003860 tx=0x7f883c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.170+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8844051f30 con 0x7f8854159b40 2023-10-09T11:39:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.364+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8854063e90 con 0x7f8854159b40 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.364+0000 7f8850ff9700 1 -- 172.21.15.6:0/203546296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8844055550 con 0x7f8854159b40 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:39:53.366 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 msgr2=0x7f88340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 0x7f88340693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f883c003860 tx=0x7f883c009040 comp rx=0 tx=0).stop 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 msgr2=0x7f8854153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8844009fa0 tx=0x7f8844009880 comp rx=0 tx=0).stop 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 shutdown_connections 2023-10-09T11:39:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8834066f30 0x7f88340693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8854159f10 0x7f885406ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8854068cc0 0x7f8854155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 --2- 172.21.15.6:0/203546296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8854159b40 0x7f8854153a70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 >> 172.21.15.6:0/203546296 conn(0x7f88540cd660 msgr2=0x7f885406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 shutdown_connections 2023-10-09T11:39:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.366+0000 7f8859c54700 1 -- 172.21.15.6:0/203546296 wait complete. 2023-10-09T11:39:53.380 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:39:53.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:39:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.501+0000 7fb073403700 1 Processor -- start 2023-10-09T11:39:53.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.501+0000 7fb073403700 1 -- start start 2023-10-09T11:39:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.502+0000 7fb073403700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb06c0d0b80 0x7fb06c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.502+0000 7fb073403700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb06c06d700 0x7fb06c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.502+0000 7fb073403700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0cf2d0 con 0x7fb06c0d02b0 2023-10-09T11:39:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.502+0000 7fb073403700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c15a690 con 0x7fb06c06d700 2023-10-09T11:39:53.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.502+0000 7fb073403700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c06dc00 con 0x7fb06c0d0b80 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb06c06d700 0x7fb06c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb071c00700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb06c0d02b0 0x7fb06c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:49682/0 (socket says 172.21.15.6:49682) 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb071c00700 1 -- 172.21.15.6:0/1546589827 learned_addr learned my addr 172.21.15.6:0/1546589827 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072401700 1 --2- 172.21.15.6:0/1546589827 >> v2:172.21.15.118:3300/0 conn(0x7fb06c0d0b80 0x7fb06c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb0713ff700 1 -- 172.21.15.6:0/1546589827 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443862513 0 0) 0x7fb06c0cf2d0 con 0x7fb06c0d02b0 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 -- 172.21.15.6:0/1546589827 >> v2:172.21.15.118:3300/0 conn(0x7fb06c0d0b80 msgr2=0x7fb06c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 --2- 172.21.15.6:0/1546589827 >> v2:172.21.15.118:3300/0 conn(0x7fb06c0d0b80 0x7fb06c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 -- 172.21.15.6:0/1546589827 >> v1:172.21.15.118:6789/0 conn(0x7fb06c0d02b0 legacy=0x7fb06c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 -- 172.21.15.6:0/1546589827 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0cf570 con 0x7fb06c06d700 2023-10-09T11:39:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb072c02700 1 --2- 172.21.15.6:0/1546589827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c15b320 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0098e0 tx=0x7fb05c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597489af7e25fd96 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb0713ff700 1 -- 172.21.15.6:0/1546589827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011630 con 0x7fb06c06d700 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb0713ff700 1 -- 172.21.15.6:0/1546589827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c011790 con 0x7fb06c06d700 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.503+0000 7fb0713ff700 1 -- 172.21.15.6:0/1546589827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011b30 con 0x7fb06c06d700 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 -- 172.21.15.6:0/1546589827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 msgr2=0x7fb06c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 --2- 172.21.15.6:0/1546589827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c15b320 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0098e0 tx=0x7fb05c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 -- 172.21.15.6:0/1546589827 shutdown_connections 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 --2- 172.21.15.6:0/1546589827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c15b320 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 --2- 172.21.15.6:0/1546589827 >> v2:172.21.15.118:3300/0 conn(0x7fb06c0d0b80 0x7fb06c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 -- 172.21.15.6:0/1546589827 >> 172.21.15.6:0/1546589827 conn(0x7fb06c063230 msgr2=0x7fb06c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 -- 172.21.15.6:0/1546589827 shutdown_connections 2023-10-09T11:39:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.504+0000 7fb073403700 1 -- 172.21.15.6:0/1546589827 wait complete. 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.505+0000 7fb073403700 1 Processor -- start 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.505+0000 7fb073403700 1 -- start start 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 0x7fb06c16a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb06c0d0b80 0x7fb06c0ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b3eb0 con 0x7fb06c06d700 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b4a30 con 0x7fb06c0d02b0 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb073403700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b4100 con 0x7fb06c0d0b80 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40770/0 (socket says 172.21.15.6:40770) 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 -- 172.21.15.6:0/477250666 learned_addr learned my addr 172.21.15.6:0/477250666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb071c00700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 0x7fb06c16a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072c02700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb06c0d0b80 0x7fb06c0ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 -- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb06c0d0b80 msgr2=0x7fb06c0ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb06c0d0b80 0x7fb06c0ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 -- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 msgr2=0x7fb06c16a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 0x7fb06c16a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb072401700 1 -- 172.21.15.6:0/477250666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009420 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.506+0000 7fb071c00700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 0x7fb06c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb072401700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb064009e80 tx=0x7fb06400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400cc20 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400f040 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c0b43e0 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064014480 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.507+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c155a00 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.508+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c0b4d10 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.508+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0640147f0 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.509+0000 7fb0627fc700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.509+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb064084e20 con 0x7fb06c06d700 2023-10-09T11:39:53.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.509+0000 7fb071c00700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:53.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.509+0000 7fb071c00700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 0x7fb0500693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb06c157200 tx=0x7fb068009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:53.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.513+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0640523e0 con 0x7fb06c06d700 2023-10-09T11:39:53.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:53.707+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb06c0676e0 con 0x7fb06c06d700 2023-10-09T11:39:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.152+0000 7fb0627fc700 1 -- 172.21.15.6:0/477250666 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb064055a00 con 0x7fb06c06d700 2023-10-09T11:39:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 msgr2=0x7fb0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 0x7fb0500693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb06c157200 tx=0x7fb068009040 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 msgr2=0x7fb06c1554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb064009e80 tx=0x7fb06400b040 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 shutdown_connections 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb050066f30 0x7fb0500693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb06c0d0b80 0x7fb06c0ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb06c06d700 0x7fb06c1554c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 --2- 172.21.15.6:0/477250666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb06c0d02b0 0x7fb06c16a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 >> 172.21.15.6:0/477250666 conn(0x7fb06c063230 msgr2=0x7fb06c157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 shutdown_connections 2023-10-09T11:39:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.156+0000 7fb073403700 1 -- 172.21.15.6:0/477250666 wait complete. 2023-10-09T11:39:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:39:54.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:39:54.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.297+0000 7f1deca83700 1 Processor -- start 2023-10-09T11:39:54.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.297+0000 7f1deca83700 1 -- start start 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1deca83700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1de81577c0 0x7f1de8068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1deca83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1de80cbea0 0x7f1de8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1deca83700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80cca80 con 0x7f1de8157b90 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1deca83700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80cc2e0 con 0x7f1de80cbea0 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1deca83700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80cedd0 con 0x7f1de81577c0 2023-10-09T11:39:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1de6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1de80cbea0 0x7f1de8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1de6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1de80cbea0 0x7f1de8068d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40774/0 (socket says 172.21.15.6:40774) 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1de6d9d700 1 -- 172.21.15.6:0/3195856664 learned_addr learned my addr 172.21.15.6:0/3195856664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1de5d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1de8157b90 0x7f1de80cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55564/0 (socket says 172.21.15.6:55564) 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.298+0000 7f1de659c700 1 --2- 172.21.15.6:0/3195856664 >> v2:172.21.15.118:3300/0 conn(0x7f1de81577c0 0x7f1de8068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de6d9d700 1 -- 172.21.15.6:0/3195856664 >> v2:172.21.15.118:3300/0 conn(0x7f1de81577c0 msgr2=0x7f1de8068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de6d9d700 1 --2- 172.21.15.6:0/3195856664 >> v2:172.21.15.118:3300/0 conn(0x7f1de81577c0 0x7f1de8068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de6d9d700 1 -- 172.21.15.6:0/3195856664 >> v1:172.21.15.6:6789/0 conn(0x7f1de8157b90 legacy=0x7f1de80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de559a700 1 -- 172.21.15.6:0/3195856664 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642083832 0 0) 0x7f1de80cca80 con 0x7f1de8157b90 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de6d9d700 1 -- 172.21.15.6:0/3195856664 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80cc4c0 con 0x7f1de80cbea0 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de6d9d700 1 --2- 172.21.15.6:0/3195856664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de8068d50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1de8068220 tx=0x7f1dd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b1514739dc2ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de559a700 1 -- 172.21.15.6:0/3195856664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e070 con 0x7f1de80cbea0 2023-10-09T11:39:54.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de559a700 1 -- 172.21.15.6:0/3195856664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800ba50 con 0x7f1de80cbea0 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1de559a700 1 -- 172.21.15.6:0/3195856664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80092e0 con 0x7f1de80cbea0 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1deca83700 1 -- 172.21.15.6:0/3195856664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 msgr2=0x7f1de8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.299+0000 7f1deca83700 1 --2- 172.21.15.6:0/3195856664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de8068d50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1de8068220 tx=0x7f1dd8009840 comp rx=0 tx=0).stop 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 -- 172.21.15.6:0/3195856664 shutdown_connections 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 --2- 172.21.15.6:0/3195856664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de8068d50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 --2- 172.21.15.6:0/3195856664 >> v2:172.21.15.118:3300/0 conn(0x7f1de81577c0 0x7f1de8068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 -- 172.21.15.6:0/3195856664 >> 172.21.15.6:0/3195856664 conn(0x7f1de80d0df0 msgr2=0x7f1de80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 -- 172.21.15.6:0/3195856664 shutdown_connections 2023-10-09T11:39:54.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.300+0000 7f1deca83700 1 -- 172.21.15.6:0/3195856664 wait complete. 2023-10-09T11:39:54.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 Processor -- start 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 -- start start 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1de81577c0 0x7f1de816d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 0x7f1de81567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de816e5d0 con 0x7f1de80cbea0 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8156d20 con 0x7f1de8157b90 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1deca83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de816dd30 con 0x7f1de81577c0 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1de659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1de659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40784/0 (socket says 172.21.15.6:40784) 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.301+0000 7f1de659c700 1 -- 172.21.15.6:0/1258016963 learned_addr learned my addr 172.21.15.6:0/1258016963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de5d9b700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1de81577c0 0x7f1de816d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de6d9d700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 0x7f1de81567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 -- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1de81577c0 msgr2=0x7f1de816d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1de81577c0 0x7f1de816d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 -- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 msgr2=0x7f1de81567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 0x7f1de81567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 -- 172.21.15.6:0/1258016963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009ae0 con 0x7f1de80cbea0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de6d9d700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 0x7f1de81567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1de659c700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1de000d890 tx=0x7f1de0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00125f0 con 0x7f1de80cbea0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0012750 con 0x7f1de80cbea0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de816e010 con 0x7f1de80cbea0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0012ad0 con 0x7f1de80cbea0 2023-10-09T11:39:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.302+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80b3dd0 con 0x7f1de80cbea0 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.303+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80b4140 con 0x7f1de80cbea0 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.304+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1de001e460 con 0x7f1de80cbea0 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.304+0000 7f1dde7fc700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 0x7f1dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.304+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1de0084940 con 0x7f1de80cbea0 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.304+0000 7f1de5d9b700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 0x7f1dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.305+0000 7f1de5d9b700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 0x7f1dc80693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1de8159c20 tx=0x7f1dd0007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:54.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.309+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1de0055820 con 0x7f1de80cbea0 2023-10-09T11:39:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:54.502+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1de80b3c30 con 0x7f1de80cbea0 2023-10-09T11:39:55.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.157+0000 7f1dde7fc700 1 -- 172.21.15.6:0/1258016963 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1de80b3c30 con 0x7f1de80cbea0 2023-10-09T11:39:55.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 msgr2=0x7f1dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 0x7f1dc80693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1de8159c20 tx=0x7f1dd0007ef0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 msgr2=0x7f1de80c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1de000d890 tx=0x7f1de0008040 comp rx=0 tx=0).stop 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 shutdown_connections 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1dc8066f30 0x7f1dc80693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1de8157b90 0x7f1de81567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1de80cbea0 0x7f1de80c9c60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 --2- 172.21.15.6:0/1258016963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1de81577c0 0x7f1de816d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.164+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 >> 172.21.15.6:0/1258016963 conn(0x7f1de80d0df0 msgr2=0x7f1de806f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.166+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 shutdown_connections 2023-10-09T11:39:55.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.167+0000 7f1deca83700 1 -- 172.21.15.6:0/1258016963 wait complete. 2023-10-09T11:39:55.171 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:39:55.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:39:55.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 Processor -- start 2023-10-09T11:39:55.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 -- start start 2023-10-09T11:39:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f809c0ce5c0 0x7f809c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c15dfb0 con 0x7f809c0ac570 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c0acec0 con 0x7f809c0ce1f0 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.312+0000 7f80a1e5a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0ad1a0 con 0x7f809c0ce5c0 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f809c0ac570 0x7f809c06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55580/0 (socket says 172.21.15.6:55580) 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809bfff700 1 -- 172.21.15.6:0/32459569 learned_addr learned my addr 172.21.15.6:0/32459569 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809affd700 1 --2- 172.21.15.6:0/32459569 >> v2:172.21.15.118:3300/0 conn(0x7f809c0ce5c0 0x7f809c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755833311 0 0) 0x7f809c15dfb0 con 0x7f809c0ac570 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8084003570 con 0x7f809c0ac570 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846809685 0 0) 0x7f809c0acec0 con 0x7f809c0ce1f0 2023-10-09T11:39:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f809c15dfb0 con 0x7f809c0ce1f0 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185063406 0 0) 0x7f8084003570 con 0x7f809c0ac570 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 >> v2:172.21.15.118:3300/0 conn(0x7f809c0ce5c0 msgr2=0x7f809c0aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 --2- 172.21.15.6:0/32459569 >> v2:172.21.15.118:3300/0 conn(0x7f809c0ce5c0 0x7f809c0aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 >> v1:172.21.15.118:6789/0 conn(0x7f809c0ce1f0 legacy=0x7f809c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c15dc40 con 0x7f809c0ac570 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f80940017f0 con 0x7f809c0ac570 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 >> v1:172.21.15.6:6789/0 conn(0x7f809c0ac570 legacy=0x7f809c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8084003c40 0x7f8084004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f8084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8084005210 0x7f808400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0ad1a0 con 0x7f8084004810 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808400c130 con 0x7f8084003c40 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808400c2c0 con 0x7f8084005210 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809affd700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f8084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.313+0000 7f809b7fe700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8084003c40 0x7f8084004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809bfff700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8084005210 0x7f808400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 -- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8084005210 msgr2=0x7f808400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8084005210 0x7f808400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 -- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8084003c40 msgr2=0x7f8084004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8084003c40 0x7f8084004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 -- 172.21.15.6:0/32459569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084003570 con 0x7f8084004810 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809bfff700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8084005210 0x7f808400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809bfff700 1 -- 172.21.15.6:0/32459569 reap_dead start 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809affd700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f8084004c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8090009c30 tx=0x7f80900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dac36fff3eeaf27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900095b0 con 0x7f8084004810 2023-10-09T11:39:55.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809000e710 con 0x7f8084004810 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.314+0000 7f809a7fc700 1 -- 172.21.15.6:0/32459569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000ead0 con 0x7f8084004810 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 -- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 msgr2=0x7f8084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f8084004c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8090009c30 tx=0x7f80900091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 -- 172.21.15.6:0/32459569 shutdown_connections 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/32459569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f8084004c80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 -- 172.21.15.6:0/32459569 >> 172.21.15.6:0/32459569 conn(0x7f809c06cca0 msgr2=0x7f809c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 -- 172.21.15.6:0/32459569 shutdown_connections 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.315+0000 7f80a1e5a700 1 -- 172.21.15.6:0/32459569 wait complete. 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.316+0000 7f80a1e5a700 1 Processor -- start 2023-10-09T11:39:55.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.316+0000 7f80a1e5a700 1 -- start start 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 0x7f809c16dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f809c0ad3e0 0x7f809c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c144880 con 0x7f8084004810 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0c46d0 con 0x7f809c16d830 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c16e1e0 con 0x7f809c0ad3e0 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40800/0 (socket says 172.21.15.6:40800) 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 -- 172.21.15.6:0/723598036 learned_addr learned my addr 172.21.15.6:0/723598036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809bfff700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f809c0ad3e0 0x7f809c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809affd700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 0x7f809c16dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 -- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f809c0ad3e0 msgr2=0x7f809c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f809c0ad3e0 0x7f809c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 -- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 msgr2=0x7f809c16dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 0x7f809c16dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 -- 172.21.15.6:0/723598036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0aec00 con 0x7f8084004810 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809affd700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 0x7f809c16dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f809b7fe700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f808c002bb0 tx=0x7f808c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00f9a0 con 0x7f8084004810 2023-10-09T11:39:55.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00fb20 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c16e6c0 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00fee0 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.317+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c1445d0 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.318+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c068900 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.319+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f808c0133f0 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.319+0000 7f80837fe700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.319+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f808c0847a0 con 0x7f8084004810 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.319+0000 7f809affd700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:55.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.320+0000 7f809affd700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80900091e0 tx=0x7f809001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:55.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.324+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f808c0519d0 con 0x7f8084004810 2023-10-09T11:39:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:55.560+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f809c0ac9d0 con 0x7f8084004810 2023-10-09T11:39:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.159+0000 7f80837fe700 1 -- 172.21.15.6:0/723598036 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7f808c054ff0 con 0x7f8084004810 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 msgr2=0x7f80880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80900091e0 tx=0x7f809001a000 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 msgr2=0x7f809c144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f808c002bb0 tx=0x7f808c007d30 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 shutdown_connections 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f809c0ad3e0 0x7f809c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8084004810 0x7f809c144010 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 --2- 172.21.15.6:0/723598036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f809c16d830 0x7f809c16dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 >> 172.21.15.6:0/723598036 conn(0x7f809c06cca0 msgr2=0x7f809c0699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.162+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 shutdown_connections 2023-10-09T11:39:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.163+0000 7f80a1e5a700 1 -- 172.21.15.6:0/723598036 wait complete. 2023-10-09T11:39:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T11:39:56.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.298+0000 7f2398493700 1 Processor -- start 2023-10-09T11:39:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.298+0000 7f2398493700 1 -- start start 2023-10-09T11:39:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2398493700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23900b04f0 0x7f23900b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2398493700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900b4390 con 0x7f239015a510 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2398493700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900b3780 con 0x7f239015a140 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2398493700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900b0ed0 con 0x7f23900b04f0 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2395a2e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23900b04f0 0x7f23900b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2396a30700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f239015a510 0x7f239015a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55586/0 (socket says 172.21.15.6:55586) 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.299+0000 7f2396a30700 1 -- 172.21.15.6:0/2131833976 learned_addr learned my addr 172.21.15.6:0/2131833976 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2395a2e700 1 -- 172.21.15.6:0/2131833976 >> v1:172.21.15.118:6789/0 conn(0x7f239015a140 legacy=0x7f23900b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2395a2e700 1 -- 172.21.15.6:0/2131833976 >> v1:172.21.15.6:6789/0 conn(0x7f239015a510 legacy=0x7f239015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2395a2e700 1 -- 172.21.15.6:0/2131833976 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900b3a60 con 0x7f23900b04f0 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2395a2e700 1 --2- 172.21.15.6:0/2131833976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f23900b0990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f23840098e0 tx=0x7f23840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e3e54e8637ce59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f239522d700 1 -- 172.21.15.6:0/2131833976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384009e80 con 0x7f23900b04f0 2023-10-09T11:39:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f239522d700 1 -- 172.21.15.6:0/2131833976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238400b860 con 0x7f23900b04f0 2023-10-09T11:39:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f239522d700 1 -- 172.21.15.6:0/2131833976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400bbe0 con 0x7f23900b04f0 2023-10-09T11:39:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2398493700 1 -- 172.21.15.6:0/2131833976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 msgr2=0x7f23900b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.300+0000 7f2398493700 1 --2- 172.21.15.6:0/2131833976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f23900b0990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f23840098e0 tx=0x7f23840091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.301+0000 7f2398493700 1 -- 172.21.15.6:0/2131833976 shutdown_connections 2023-10-09T11:39:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.301+0000 7f2398493700 1 --2- 172.21.15.6:0/2131833976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f23900b0990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.301+0000 7f2398493700 1 -- 172.21.15.6:0/2131833976 >> 172.21.15.6:0/2131833976 conn(0x7f239006b4f0 msgr2=0x7f2390067640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.301+0000 7f2398493700 1 -- 172.21.15.6:0/2131833976 shutdown_connections 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.301+0000 7f2398493700 1 -- 172.21.15.6:0/2131833976 wait complete. 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 Processor -- start 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 -- start start 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f239015a140 0x7f23900aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f239015a510 0x7f23900a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900cfb30 con 0x7f23900b04f0 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900aa5d0 con 0x7f239015a140 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.302+0000 7f2398493700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2390154780 con 0x7f239015a510 2023-10-09T11:39:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40818/0 (socket says 172.21.15.6:40818) 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 -- 172.21.15.6:0/3623338118 learned_addr learned my addr 172.21.15.6:0/3623338118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f2396a30700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f239015a510 0x7f23900a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 -- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f239015a510 msgr2=0x7f23900a85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f239015a510 0x7f23900a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 -- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f239015a140 msgr2=0x7f23900aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f2395a2e700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f239015a140 0x7f23900aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f239015a140 0x7f23900aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 -- 172.21.15.6:0/3623338118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009420 con 0x7f23900b04f0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f239622f700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f238800c600 tx=0x7f2388007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388011590 con 0x7f23900b04f0 2023-10-09T11:39:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388011710 con 0x7f23900b04f0 2023-10-09T11:39:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388011ad0 con 0x7f23900b04f0 2023-10-09T11:39:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239015d950 con 0x7f23900b04f0 2023-10-09T11:39:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.303+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239015dc30 con 0x7f23900b04f0 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.304+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23900699c0 con 0x7f23900b04f0 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.305+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f238801c460 con 0x7f23900b04f0 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.305+0000 7f238e7fc700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 0x7f237c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.305+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23880842c0 con 0x7f23900b04f0 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.305+0000 7f2395a2e700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 0x7f237c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.306+0000 7f2395a2e700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 0x7f237c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f238400c010 tx=0x7f2384016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.309+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2388051530 con 0x7f23900b04f0 2023-10-09T11:39:56.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.503+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23900b3d40 con 0x7f23900b04f0 2023-10-09T11:39:56.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.503+0000 7f238e7fc700 1 -- 172.21.15.6:0/3623338118 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f2388054b50 con 0x7f23900b04f0 2023-10-09T11:39:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:56.505 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":79,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:55.562200+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.505+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 msgr2=0x7f237c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.505+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 0x7f237c0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f238400c010 tx=0x7f2384016000 comp rx=0 tx=0).stop 2023-10-09T11:39:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.505+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 msgr2=0x7f2390154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.505+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f238800c600 tx=0x7f2388007f60 comp rx=0 tx=0).stop 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 shutdown_connections 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f237c066f30 0x7f237c0693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f239015a510 0x7f23900a85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23900b04f0 0x7f2390154240 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 --2- 172.21.15.6:0/3623338118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f239015a140 0x7f23900aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 >> 172.21.15.6:0/3623338118 conn(0x7f239006b4f0 msgr2=0x7f2390156810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 shutdown_connections 2023-10-09T11:39:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.506+0000 7f2398493700 1 -- 172.21.15.6:0/3623338118 wait complete. 2023-10-09T11:39:56.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:56.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.636+0000 7fa3a2b23700 1 Processor -- start 2023-10-09T11:39:56.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.636+0000 7fa3a2b23700 1 -- start start 2023-10-09T11:39:56.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c1578d0 0x7fa39c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa39c157ca0 0x7fa39c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa39c06d120 0x7fa39c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c06dac0 con 0x7fa39c06d120 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0d07c0 con 0x7fa39c157ca0 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a2b23700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0cfbb0 con 0x7fa39c1578d0 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a10c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa39c06d120 0x7fa39c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a10c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa39c06d120 0x7fa39c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40832/0 (socket says 172.21.15.6:40832) 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a10c0700 1 -- 172.21.15.6:0/2149666799 learned_addr learned my addr 172.21.15.6:0/2149666799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa3a08bf700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c1578d0 0x7fa39c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.637+0000 7fa39bfff700 1 --2- 172.21.15.6:0/2149666799 >> v2:172.21.15.118:3300/0 conn(0x7fa39c157ca0 0x7fa39c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 -- 172.21.15.6:0/2149666799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c1578d0 msgr2=0x7fa39c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c1578d0 0x7fa39c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 -- 172.21.15.6:0/2149666799 >> v2:172.21.15.118:3300/0 conn(0x7fa39c157ca0 msgr2=0x7fa39c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:56.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 --2- 172.21.15.6:0/2149666799 >> v2:172.21.15.118:3300/0 conn(0x7fa39c157ca0 0x7fa39c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 -- 172.21.15.6:0/2149666799 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0cfe90 con 0x7fa39c06d120 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa3a10c0700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c06d120 0x7fa39c06d580 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa39c06cb70 tx=0x7fa394009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980c16c4a327cb74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa39b7fe700 1 -- 172.21.15.6:0/2149666799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400e070 con 0x7fa39c06d120 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa39b7fe700 1 -- 172.21.15.6:0/2149666799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400b970 con 0x7fa39c06d120 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.638+0000 7fa39b7fe700 1 -- 172.21.15.6:0/2149666799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940092e0 con 0x7fa39c06d120 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2149666799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c06d120 msgr2=0x7fa39c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c06d120 0x7fa39c06d580 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa39c06cb70 tx=0x7fa394009840 comp rx=0 tx=0).stop 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2149666799 shutdown_connections 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c06d120 0x7fa39c06d580 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2149666799 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c1578d0 0x7fa39c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2149666799 >> v2:172.21.15.118:3300/0 conn(0x7fa39c157ca0 0x7fa39c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2149666799 >> 172.21.15.6:0/2149666799 conn(0x7fa39c06bb90 msgr2=0x7fa39c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2149666799 shutdown_connections 2023-10-09T11:39:56.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.639+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2149666799 wait complete. 2023-10-09T11:39:56.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.640+0000 7fa3a2b23700 1 Processor -- start 2023-10-09T11:39:56.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.640+0000 7fa3a2b23700 1 -- start start 2023-10-09T11:39:56.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c06d120 0x7fa39c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39c157ca0 0x7fa39c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c155050 con 0x7fa39c1578d0 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c160520 con 0x7fa39c157ca0 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15ef40 con 0x7fa39c06d120 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40848/0 (socket says 172.21.15.6:40848) 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 -- 172.21.15.6:0/2155095974 learned_addr learned my addr 172.21.15.6:0/2155095974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a08bf700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c06d120 0x7fa39c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a10c0700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39c157ca0 0x7fa39c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 -- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c06d120 msgr2=0x7fa39c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c06d120 0x7fa39c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 -- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39c157ca0 msgr2=0x7fa39c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39c157ca0 0x7fa39c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 -- 172.21.15.6:0/2155095974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009ae0 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa39bfff700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e930 tx=0x7fa3900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390013680 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3900137e0 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c15f220 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390013b80 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.641+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c15f7e0 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.642+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c15fe30 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.643+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa39000c3e0 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.643+0000 7fa398ff9700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.643+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3900845e0 con 0x7fa39c1578d0 2023-10-09T11:39:56.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.643+0000 7fa3a08bf700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.644+0000 7fa3a08bf700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 0x7fa3880693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009db0 tx=0x7fa38c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.648+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa390051850 con 0x7fa39c1578d0 2023-10-09T11:39:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.842+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa39c0d0170 con 0x7fa39c1578d0 2023-10-09T11:39:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.843+0000 7fa398ff9700 1 -- 172.21.15.6:0/2155095974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fa390054e70 con 0x7fa39c1578d0 2023-10-09T11:39:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":79,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:55.562200+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 msgr2=0x7fa3880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 0x7fa3880693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009db0 tx=0x7fa38c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 msgr2=0x7fa39c15ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e930 tx=0x7fa3900091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 shutdown_connections 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa39c157ca0 0x7fa39c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39c06d120 0x7fa39c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 --2- 172.21.15.6:0/2155095974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa39c1578d0 0x7fa39c15ffe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 >> 172.21.15.6:0/2155095974 conn(0x7fa39c06bb90 msgr2=0x7fa39c15baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 shutdown_connections 2023-10-09T11:39:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.845+0000 7fa3a2b23700 1 -- 172.21.15.6:0/2155095974 wait complete. 2023-10-09T11:39:56.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:39:56.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.982+0000 7f7fef1b3700 1 Processor -- start 2023-10-09T11:39:56.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.982+0000 7f7fef1b3700 1 -- start start 2023-10-09T11:39:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fef1b3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 0x7f7fe806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fef1b3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 0x7f7fe806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fef1b3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe815bc10 con 0x7f7fe8157ab0 2023-10-09T11:39:56.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fef1b3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe806c530 con 0x7f7fe806c0d0 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fef1b3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe815c7b0 con 0x7f7fe8069120 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fed750700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 0x7f7fe806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fecf4f700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7fe8157ab0 0x7f7fe815c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:49714/0 (socket says 172.21.15.6:49714) 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fecf4f700 1 -- 172.21.15.6:0/1947180685 learned_addr learned my addr 172.21.15.6:0/1947180685 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1947180685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 0x7f7fe806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe77fe700 1 -- 172.21.15.6:0/1947180685 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263592775 0 0) 0x7f7fe815bc10 con 0x7f7fe8157ab0 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe77fe700 1 -- 172.21.15.6:0/1947180685 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd8003570 con 0x7f7fe8157ab0 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe7fff700 1 -- 172.21.15.6:0/1947180685 >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 msgr2=0x7f7fe806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1947180685 >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 0x7f7fe806a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe7fff700 1 -- 172.21.15.6:0/1947180685 >> v1:172.21.15.118:6789/0 conn(0x7f7fe8157ab0 legacy=0x7f7fe815c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fe7fff700 1 -- 172.21.15.6:0/1947180685 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8158ba0 con 0x7f7fe8069120 2023-10-09T11:39:56.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.983+0000 7f7fed750700 1 --2- 172.21.15.6:0/1947180685 >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 0x7f7fe806a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:39:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1947180685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 0x7f7fe806bb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40098e0 tx=0x7f7fd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54da3bb433a3fd50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fe77fe700 1 -- 172.21.15.6:0/1947180685 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4011630 con 0x7f7fe8069120 2023-10-09T11:39:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fe77fe700 1 -- 172.21.15.6:0/1947180685 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd4011790 con 0x7f7fe8069120 2023-10-09T11:39:56.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fe77fe700 1 -- 172.21.15.6:0/1947180685 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4011b10 con 0x7f7fe8069120 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1947180685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 msgr2=0x7f7fe806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1947180685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 0x7f7fe806bb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40098e0 tx=0x7f7fd40091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1947180685 shutdown_connections 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1947180685 >> v2:172.21.15.118:3300/0 conn(0x7f7fe806c0d0 0x7f7fe806a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1947180685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe8069120 0x7f7fe806bb90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1947180685 >> 172.21.15.6:0/1947180685 conn(0x7f7fe80c9ca0 msgr2=0x7f7fe80ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1947180685 shutdown_connections 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.984+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1947180685 wait complete. 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.985+0000 7f7fef1b3700 1 Processor -- start 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 -- start start 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 0x7f7fe8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 0x7f7fe80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8155a90 con 0x7f7fe8069120 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe816b170 con 0x7f7fe8157ab0 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fef1b3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cb300 con 0x7f7fe806c0d0 2023-10-09T11:39:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fecf4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fecf4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40852/0 (socket says 172.21.15.6:40852) 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.986+0000 7f7fecf4f700 1 -- 172.21.15.6:0/1276796150 learned_addr learned my addr 172.21.15.6:0/1276796150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fed750700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 0x7f7fe80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 0x7f7fe8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 -- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 msgr2=0x7f7fe8148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 0x7f7fe8148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 -- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 msgr2=0x7f7fe80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 0x7f7fe80c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 -- 172.21.15.6:0/1276796150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009a20 con 0x7f7fe8069120 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 0x7f7fe8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fed750700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 0x7f7fe80c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fecf4f700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0011e0 tx=0x7f7fdc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc005b30 con 0x7f7fe8069120 2023-10-09T11:39:56.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc005c90 con 0x7f7fe8069120 2023-10-09T11:39:56.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4009420 con 0x7f7fe8069120 2023-10-09T11:39:56.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc007320 con 0x7f7fe8069120 2023-10-09T11:39:56.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.987+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe80cb8c0 con 0x7f7fe8069120 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.988+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8068080 con 0x7f7fe8069120 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.988+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fdc007690 con 0x7f7fe8069120 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.989+0000 7f7fe4ff9700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.989+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fdc0839e0 con 0x7f7fe8069120 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.989+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.989+0000 7f7fe7fff700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 0x7f7fcc0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80c92c0 tx=0x7f7fd4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:56.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:56.993+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fdc050c50 con 0x7f7fe8069120 2023-10-09T11:39:57.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:57.230+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7fe80a6480 con 0x7f7fe8069120 2023-10-09T11:39:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.173+0000 7f7fe4ff9700 1 -- 172.21.15.6:0/1276796150 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7fdc017020 con 0x7f7fe8069120 2023-10-09T11:39:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 msgr2=0x7f7fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 0x7f7fcc0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80c92c0 tx=0x7f7fd4017000 comp rx=0 tx=0).stop 2023-10-09T11:39:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 msgr2=0x7f7fe816ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0011e0 tx=0x7f7fdc007df0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 shutdown_connections 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7fcc066f30 0x7f7fcc0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fe8157ab0 0x7f7fe80c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe8069120 0x7f7fe816ac30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 --2- 172.21.15.6:0/1276796150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fe806c0d0 0x7f7fe8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 >> 172.21.15.6:0/1276796150 conn(0x7f7fe80c9ca0 msgr2=0x7f7fe8155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.175+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 shutdown_connections 2023-10-09T11:39:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.176+0000 7f7fef1b3700 1 -- 172.21.15.6:0/1276796150 wait complete. 2023-10-09T11:39:58.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:39:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.316+0000 7fe0b8725700 1 Processor -- start 2023-10-09T11:39:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.316+0000 7fe0b8725700 1 -- start start 2023-10-09T11:39:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0b0159d40 0x7fe0b00d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b015a110 0x7fe0b00b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 0x7fe0b00b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00ce290 con 0x7fe0b0159d40 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00cda30 con 0x7fe0b00cb390 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b8725700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00cdcd0 con 0x7fe0b015a110 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b64c1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0b0159d40 0x7fe0b00d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b64c1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0b0159d40 0x7fe0b00d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40868/0 (socket says 172.21.15.6:40868) 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b64c1700 1 -- 172.21.15.6:0/746891534 learned_addr learned my addr 172.21.15.6:0/746891534 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b5cc0700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b015a110 0x7fe0b00b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.317+0000 7fe0b6cc2700 1 --2- 172.21.15.6:0/746891534 >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 0x7fe0b00b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 -- 172.21.15.6:0/746891534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b015a110 msgr2=0x7fe0b00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b015a110 0x7fe0b00b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 -- 172.21.15.6:0/746891534 >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 msgr2=0x7fe0b00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/746891534 >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 0x7fe0b00b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 -- 172.21.15.6:0/746891534 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00cdfb0 con 0x7fe0b0159d40 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b6cc2700 1 --2- 172.21.15.6:0/746891534 >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 0x7fe0b00b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b0159d40 0x7fe0b00d06d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00cffb0 tx=0x7fe0a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87e636ee16d451c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b54bf700 1 -- 172.21.15.6:0/746891534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000e070 con 0x7fe0b0159d40 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b54bf700 1 -- 172.21.15.6:0/746891534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000ba20 con 0x7fe0b0159d40 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b54bf700 1 -- 172.21.15.6:0/746891534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00092e0 con 0x7fe0b0159d40 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b8725700 1 -- 172.21.15.6:0/746891534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b0159d40 msgr2=0x7fe0b00d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.318+0000 7fe0b8725700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b0159d40 0x7fe0b00d06d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00cffb0 tx=0x7fe0a0009840 comp rx=0 tx=0).stop 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 -- 172.21.15.6:0/746891534 shutdown_connections 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 --2- 172.21.15.6:0/746891534 >> v2:172.21.15.118:3300/0 conn(0x7fe0b00cb390 0x7fe0b00b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b0159d40 0x7fe0b00d06d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 --2- 172.21.15.6:0/746891534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b015a110 0x7fe0b00b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 -- 172.21.15.6:0/746891534 >> 172.21.15.6:0/746891534 conn(0x7fe0b006bb90 msgr2=0x7fe0b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 -- 172.21.15.6:0/746891534 shutdown_connections 2023-10-09T11:39:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.319+0000 7fe0b8725700 1 -- 172.21.15.6:0/746891534 wait complete. 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 Processor -- start 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 -- start start 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b0159d40 0x7fe0b00ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0b015a110 0x7fe0b00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b015ed40 con 0x7fe0b00cb390 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00cac20 con 0x7fe0b015a110 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b8725700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0068c10 con 0x7fe0b0159d40 2023-10-09T11:39:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b64c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b64c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40880/0 (socket says 172.21.15.6:40880) 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.320+0000 7fe0b64c1700 1 -- 172.21.15.6:0/3611212733 learned_addr learned my addr 172.21.15.6:0/3611212733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 -- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b0159d40 msgr2=0x7fe0b00ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b0159d40 0x7fe0b00ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 -- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0b015a110 msgr2=0x7fe0b00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0b015a110 0x7fe0b00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 -- 172.21.15.6:0/3611212733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009ae0 con 0x7fe0b00cb390 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b64c1700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b6c0 tx=0x7fe0a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00032f0 con 0x7fe0b00cb390 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0008c30 con 0x7fe0b00cb390 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b00c90c0 con 0x7fe0b00cb390 2023-10-09T11:39:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0026460 con 0x7fe0b00cb390 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.321+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b015e9d0 con 0x7fe0b00cb390 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.322+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b015eb90 con 0x7fe0b00cb390 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.322+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0a0003040 con 0x7fe0b00cb390 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.323+0000 7fe0ae7fc700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.323+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0a0086370 con 0x7fe0b00cb390 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.323+0000 7fe0b5cc0700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.323+0000 7fe0b5cc0700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 0x7fe09c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00d09e0 tx=0x7fe0a40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.327+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0a00535e0 con 0x7fe0b00cb390 2023-10-09T11:39:58.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:58.567+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe0b00cb900 con 0x7fe0b00cb390 2023-10-09T11:39:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.178+0000 7fe0ae7fc700 1 -- 172.21.15.6:0/3611212733 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0a0056c00 con 0x7fe0b00cb390 2023-10-09T11:39:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.180+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 msgr2=0x7fe09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.180+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 0x7fe09c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00d09e0 tx=0x7fe0a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.180+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 msgr2=0x7fe0b00b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.180+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b6c0 tx=0x7fe0a0018000 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 shutdown_connections 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe09c066f30 0x7fe09c0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0b015a110 0x7fe0b00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0b00cb390 0x7fe0b00b6520 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 --2- 172.21.15.6:0/3611212733 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0b0159d40 0x7fe0b00ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 >> 172.21.15.6:0/3611212733 conn(0x7fe0b006bb90 msgr2=0x7fe0b0156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 shutdown_connections 2023-10-09T11:39:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.181+0000 7fe0b8725700 1 -- 172.21.15.6:0/3611212733 wait complete. 2023-10-09T11:39:59.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:39:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.321+0000 7fc054c0a700 1 Processor -- start 2023-10-09T11:39:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.321+0000 7fc054c0a700 1 -- start start 2023-10-09T11:39:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc054c0a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0501578d0 0x7fc0500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc054c0a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc050157ca0 0x7fc05015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc054c0a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0500d07c0 con 0x7fc05006d120 2023-10-09T11:39:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc054c0a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0500cfbb0 con 0x7fc0501578d0 2023-10-09T11:39:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc054c0a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500cfe90 con 0x7fc050157ca0 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc05006d120 0x7fc05015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55600/0 (socket says 172.21.15.6:55600) 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04ed9d700 1 -- 172.21.15.6:0/1899110456 learned_addr learned my addr 172.21.15.6:0/1899110456 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04e59c700 1 --2- 172.21.15.6:0/1899110456 >> v2:172.21.15.118:3300/0 conn(0x7fc0501578d0 0x7fc0500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04dd9b700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc050157ca0 0x7fc05015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335458145 0 0) 0x7fc0500d07c0 con 0x7fc05006d120 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03c003570 con 0x7fc05006d120 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04e59c700 1 -- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc050157ca0 msgr2=0x7fc05015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04e59c700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc050157ca0 0x7fc05015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04e59c700 1 -- 172.21.15.6:0/1899110456 >> v1:172.21.15.6:6789/0 conn(0x7fc05006d120 legacy=0x7fc05015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782443346 0 0) 0x7fc03c003570 con 0x7fc05006d120 2023-10-09T11:39:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.322+0000 7fc04e59c700 1 -- 172.21.15.6:0/1899110456 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500d0170 con 0x7fc0501578d0 2023-10-09T11:39:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc04e59c700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500cf4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098e0 tx=0x7fc0400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc616006484fbc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0480017f0 con 0x7fc0501578d0 2023-10-09T11:39:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc040011420 con 0x7fc0501578d0 2023-10-09T11:39:59.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc04d59a700 1 -- 172.21.15.6:0/1899110456 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400117c0 con 0x7fc0501578d0 2023-10-09T11:39:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 -- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 msgr2=0x7fc0500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500cf4f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098e0 tx=0x7fc0400091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 -- 172.21.15.6:0/1899110456 shutdown_connections 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500cf4f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1899110456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc050157ca0 0x7fc05015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 -- 172.21.15.6:0/1899110456 >> 172.21.15.6:0/1899110456 conn(0x7fc05006bb90 msgr2=0x7fc05006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 -- 172.21.15.6:0/1899110456 shutdown_connections 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.323+0000 7fc054c0a700 1 -- 172.21.15.6:0/1899110456 wait complete. 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.324+0000 7fc054c0a700 1 Processor -- start 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 -- start start 2023-10-09T11:39:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05006d120 0x7fc0500b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500b66d0 con 0x7fc050157ca0 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500af670 con 0x7fc0501578d0 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc054c0a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05016b7b0 con 0x7fc05006d120 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40888/0 (socket says 172.21.15.6:40888) 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.325+0000 7fc04ed9d700 1 -- 172.21.15.6:0/1397835151 learned_addr learned my addr 172.21.15.6:0/1397835151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04dd9b700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 -- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05006d120 msgr2=0x7fc0500b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05006d120 0x7fc0500b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 -- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 msgr2=0x7fc0500b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 -- 172.21.15.6:0/1397835151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009420 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc04ed9d700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc048001560 tx=0x7fc048001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048004dc0 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800a750 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800ab10 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05016ba90 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.326+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0500b63e0 con 0x7fc050157ca0 2023-10-09T11:39:59.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.327+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05016bc80 con 0x7fc050157ca0 2023-10-09T11:39:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.328+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc048007150 con 0x7fc050157ca0 2023-10-09T11:39:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.328+0000 7fc0467fc700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.328+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc048083c20 con 0x7fc050157ca0 2023-10-09T11:39:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.328+0000 7fc04e59c700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.329+0000 7fc04e59c700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc0400030c0 tx=0x7fc040016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.332+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc048050f10 con 0x7fc050157ca0 2023-10-09T11:39:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.569+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc05016bec0 con 0x7fc050157ca0 2023-10-09T11:39:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.569+0000 7fc0467fc700 1 -- 172.21.15.6:0/1397835151 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fc048018090 con 0x7fc050157ca0 2023-10-09T11:39:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:59.571 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:39:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.571+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 msgr2=0x7fc0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.571+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc0400030c0 tx=0x7fc040016000 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.571+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 msgr2=0x7fc05016a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.571+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc048001560 tx=0x7fc048001640 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 shutdown_connections 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc050157ca0 0x7fc05016a3e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc05006d120 0x7fc0500b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 --2- 172.21.15.6:0/1397835151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0501578d0 0x7fc0500b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 >> 172.21.15.6:0/1397835151 conn(0x7fc05006bb90 msgr2=0x7fc050155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 shutdown_connections 2023-10-09T11:39:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.572+0000 7fc054c0a700 1 -- 172.21.15.6:0/1397835151 wait complete. 2023-10-09T11:39:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:39:59.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:39:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.702+0000 7f4f445d3700 1 Processor -- start 2023-10-09T11:39:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.702+0000 7f4f445d3700 1 -- start start 2023-10-09T11:39:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f445d3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4f3c1578d0 0x7f4f3c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f445d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f3c157ca0 0x7f4f3c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f445d3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0d07c0 con 0x7f4f3c06d120 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f445d3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cfbb0 con 0x7f4f3c157ca0 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f445d3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cfe90 con 0x7f4f3c1578d0 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f41b6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f3c157ca0 0x7f4f3c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f41b6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f3c157ca0 0x7f4f3c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40892/0 (socket says 172.21.15.6:40892) 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.703+0000 7f4f41b6e700 1 -- 172.21.15.6:0/1942289548 learned_addr learned my addr 172.21.15.6:0/1942289548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f4236f700 1 --2- 172.21.15.6:0/1942289548 >> v2:172.21.15.118:3300/0 conn(0x7f4f3c1578d0 0x7f4f3c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f41b6e700 1 -- 172.21.15.6:0/1942289548 >> v2:172.21.15.118:3300/0 conn(0x7f4f3c1578d0 msgr2=0x7f4f3c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f41b6e700 1 --2- 172.21.15.6:0/1942289548 >> v2:172.21.15.118:3300/0 conn(0x7f4f3c1578d0 0x7f4f3c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f41b6e700 1 -- 172.21.15.6:0/1942289548 >> v1:172.21.15.118:6789/0 conn(0x7f4f3c06d120 legacy=0x7f4f3c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f41b6e700 1 -- 172.21.15.6:0/1942289548 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0d0170 con 0x7f4f3c157ca0 2023-10-09T11:39:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f41b6e700 1 --2- 172.21.15.6:0/1942289548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c157ca0 0x7f4f3c15af00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0646b0 tx=0x7f4f30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a2f436da1313b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f4136d700 1 -- 172.21.15.6:0/1942289548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30009e70 con 0x7f4f3c157ca0 2023-10-09T11:39:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f4136d700 1 -- 172.21.15.6:0/1942289548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000b860 con 0x7f4f3c157ca0 2023-10-09T11:39:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.704+0000 7f4f4136d700 1 -- 172.21.15.6:0/1942289548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000bc00 con 0x7f4f3c157ca0 2023-10-09T11:39:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 -- 172.21.15.6:0/1942289548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c157ca0 msgr2=0x7f4f3c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 --2- 172.21.15.6:0/1942289548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c157ca0 0x7f4f3c15af00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0646b0 tx=0x7f4f30009250 comp rx=0 tx=0).stop 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 -- 172.21.15.6:0/1942289548 shutdown_connections 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 --2- 172.21.15.6:0/1942289548 >> v2:172.21.15.118:3300/0 conn(0x7f4f3c1578d0 0x7f4f3c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 --2- 172.21.15.6:0/1942289548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c157ca0 0x7f4f3c15af00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 -- 172.21.15.6:0/1942289548 >> 172.21.15.6:0/1942289548 conn(0x7f4f3c06bb90 msgr2=0x7f4f3c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 -- 172.21.15.6:0/1942289548 shutdown_connections 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.705+0000 7f4f445d3700 1 -- 172.21.15.6:0/1942289548 wait complete. 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.706+0000 7f4f445d3700 1 Processor -- start 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.706+0000 7f4f445d3700 1 -- start start 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.706+0000 7f4f445d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f3c06d120 0x7f4f3c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.706+0000 7f4f445d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 0x7f4f3c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0ccf30 con 0x7f4f3c1578d0 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cc080 con 0x7f4f3c06d120 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0cc320 con 0x7f4f3c157ca0 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40896/0 (socket says 172.21.15.6:40896) 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 -- 172.21.15.6:0/28175388 learned_addr learned my addr 172.21.15.6:0/28175388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f4236f700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f3c06d120 0x7f4f3c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f42b70700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 0x7f4f3c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 -- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 msgr2=0x7f4f3c1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 0x7f4f3c1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 -- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f3c06d120 msgr2=0x7f4f3c144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f3c06d120 0x7f4f3c144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 -- 172.21.15.6:0/28175388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300094f0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f42b70700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 0x7f4f3c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f41b6e700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06fe20 tx=0x7f4f30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000b9d0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000bb30 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0cc600 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30025670 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.707+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0ccbc0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.708+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c0cd0e0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.709+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f30023070 con 0x7f4f3c1578d0 2023-10-09T11:39:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.709+0000 7f4f3a7fc700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 0x7f4f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:39:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.709+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f30085960 con 0x7f4f3c1578d0 2023-10-09T11:39:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.709+0000 7f4f4236f700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 0x7f4f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:39:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.710+0000 7f4f4236f700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 0x7f4f280693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009db0 tx=0x7f4f340091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:39:59.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.713+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f3c0cd0e0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.908+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f3c0cd070 con 0x7f4f3c1578d0 2023-10-09T11:39:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.909+0000 7f4f3a7fc700 1 -- 172.21.15.6:0/28175388 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f4f30052bd0 con 0x7f4f3c1578d0 2023-10-09T11:39:59.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:39:59.911 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:39:56.901873+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 msgr2=0x7f4f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 0x7f4f280693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009db0 tx=0x7f4f340091a0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 msgr2=0x7f4f3c0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06fe20 tx=0x7f4f30017000 comp rx=0 tx=0).stop 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 shutdown_connections 2023-10-09T11:39:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f28066f30 0x7f4f280693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f3c157ca0 0x7f4f3c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f3c06d120 0x7f4f3c144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 --2- 172.21.15.6:0/28175388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f3c1578d0 0x7f4f3c0cd3c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 >> 172.21.15.6:0/28175388 conn(0x7f4f3c06bb90 msgr2=0x7f4f3c15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 shutdown_connections 2023-10-09T11:39:59.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:39:59.911+0000 7f4f445d3700 1 -- 172.21.15.6:0/28175388 wait complete. 2023-10-09T11:39:59.925 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:39:59.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.042+0000 7fc6f29b3700 1 Processor -- start 2023-10-09T11:40:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.042+0000 7fc6f29b3700 1 -- start start 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6f29b3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6f29b3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0d07c0 con 0x7fc6ec1578d0 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6f29b3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0cfbb0 con 0x7fc6ec06d120 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6f29b3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0cfe90 con 0x7fc6ec157ca0 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6eb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6ebfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6ec1578d0 0x7fc6ec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55602/0 (socket says 172.21.15.6:55602) 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6eb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40912/0 (socket says 172.21.15.6:40912) 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6ebfff700 1 -- 172.21.15.6:0/11829059 learned_addr learned my addr 172.21.15.6:0/11829059 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6eb7fe700 1 -- 172.21.15.6:0/11829059 >> v1:172.21.15.118:6789/0 conn(0x7fc6ec06d120 legacy=0x7fc6ec06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6eb7fe700 1 -- 172.21.15.6:0/11829059 >> v1:172.21.15.6:6789/0 conn(0x7fc6ec1578d0 legacy=0x7fc6ec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.043+0000 7fc6eb7fe700 1 -- 172.21.15.6:0/11829059 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0d0170 con 0x7fc6ec157ca0 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6eb7fe700 1 --2- 172.21.15.6:0/11829059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00098e0 tx=0x7fc6e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e481109818d198c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6eaffd700 1 -- 172.21.15.6:0/11829059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0009e80 con 0x7fc6ec157ca0 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6eaffd700 1 -- 172.21.15.6:0/11829059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000b820 con 0x7fc6ec157ca0 2023-10-09T11:40:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6eaffd700 1 -- 172.21.15.6:0/11829059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000bba0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 -- 172.21.15.6:0/11829059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 msgr2=0x7fc6ec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/11829059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00098e0 tx=0x7fc6e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 -- 172.21.15.6:0/11829059 shutdown_connections 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/11829059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec0cf4f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 -- 172.21.15.6:0/11829059 >> 172.21.15.6:0/11829059 conn(0x7fc6ec06bb90 msgr2=0x7fc6ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 -- 172.21.15.6:0/11829059 shutdown_connections 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.044+0000 7fc6f29b3700 1 -- 172.21.15.6:0/11829059 wait complete. 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.045+0000 7fc6f29b3700 1 Processor -- start 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.045+0000 7fc6f29b3700 1 -- start start 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 0x7fc6ec148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ec1578d0 0x7fc6ec0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec1585e0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0abba0 con 0x7fc6ec1578d0 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f29b3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0abe80 con 0x7fc6ec06d120 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f0f50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f0f50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40928/0 (socket says 172.21.15.6:40928) 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6f0f50700 1 -- 172.21.15.6:0/2965472702 learned_addr learned my addr 172.21.15.6:0/2965472702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6eb7fe700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ec1578d0 0x7fc6ec0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.046+0000 7fc6ebfff700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 0x7fc6ec148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 -- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 msgr2=0x7fc6ec148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 0x7fc6ec148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 -- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ec1578d0 msgr2=0x7fc6ec0ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ec1578d0 0x7fc6ec0ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 -- 172.21.15.6:0/2965472702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009420 con 0x7fc6ec157ca0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6ebfff700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 0x7fc6ec148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f0f50700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c930 tx=0x7fc6e40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4012630 con 0x7fc6ec157ca0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40127d0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec158270 con 0x7fc6ec157ca0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4012b90 con 0x7fc6ec157ca0 2023-10-09T11:40:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.047+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec146250 con 0x7fc6ec157ca0 2023-10-09T11:40:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.048+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec0ac0a0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.048+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6e400a3b0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.049+0000 7fc6d3fff700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 0x7fc6d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.049+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6e4084240 con 0x7fc6ec157ca0 2023-10-09T11:40:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.049+0000 7fc6ebfff700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 0x7fc6d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.049+0000 7fc6ebfff700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 0x7fc6d80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0018c0 tx=0x7fc6dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.053+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6e40514b0 con 0x7fc6ec157ca0 2023-10-09T11:40:00.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.243+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6ec1580f0 con 0x7fc6d8066f30 2023-10-09T11:40:00.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.251+0000 7fc6d3fff700 1 -- 172.21.15.6:0/2965472702 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284863 (secure 0 0 0) 0x7fc6dc001d30 con 0x7fc6d8066f30 2023-10-09T11:40:00.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.254+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 msgr2=0x7fc6d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.254+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 0x7fc6d80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0018c0 tx=0x7fc6dc009040 comp rx=0 tx=0).stop 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.254+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 msgr2=0x7fc6ec155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.254+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c930 tx=0x7fc6e40026e0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 shutdown_connections 2023-10-09T11:40:00.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6d8066f30 0x7fc6d80693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec157ca0 0x7fc6ec155700 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6ec06d120 0x7fc6ec148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 --2- 172.21.15.6:0/2965472702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6ec1578d0 0x7fc6ec0ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 >> 172.21.15.6:0/2965472702 conn(0x7fc6ec06bb90 msgr2=0x7fc6ec06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 shutdown_connections 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.255+0000 7fc6f29b3700 1 -- 172.21.15.6:0/2965472702 wait complete. 2023-10-09T11:40:00.259 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:40:00.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-10-09T11:40:00.197371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4444,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558055,"statfs":{"total":1600000000,"available":1595448511,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914167+0000","last_change":"2023-10-09T11:39:55.913895+0000","last_active":"2023-10-09T11:39:55.914167+0000","last_peered":"2023-10-09T11:39:55.914167+0000","last_clean":"2023-10-09T11:39:55.914167+0000","last_became_active":"2023-10-09T11:39:55.913340+0000","last_became_peered":"2023-10-09T11:39:55.913340+0000","last_unstale":"2023-10-09T11:39:55.914167+0000","last_undegraded":"2023-10-09T11:39:55.914167+0000","last_fullsized":"2023-10-09T11:39:55.914167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:43.914721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918913+0000","last_change":"2023-10-09T11:39:55.918814+0000","last_active":"2023-10-09T11:39:55.918913+0000","last_peered":"2023-10-09T11:39:55.918913+0000","last_clean":"2023-10-09T11:39:55.918913+0000","last_became_active":"2023-10-09T11:39:55.918622+0000","last_became_peered":"2023-10-09T11:39:55.918622+0000","last_unstale":"2023-10-09T11:39:55.918913+0000","last_undegraded":"2023-10-09T11:39:55.918913+0000","last_fullsized":"2023-10-09T11:39:55.918913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:29.316197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911047+0000","last_change":"2023-10-09T11:39:55.910970+0000","last_active":"2023-10-09T11:39:55.911047+0000","last_peered":"2023-10-09T11:39:55.911047+0000","last_clean":"2023-10-09T11:39:55.911047+0000","last_became_active":"2023-10-09T11:39:55.910713+0000","last_became_peered":"2023-10-09T11:39:55.910713+0000","last_unstale":"2023-10-09T11:39:55.911047+0000","last_undegraded":"2023-10-09T11:39:55.911047+0000","last_fullsized":"2023-10-09T11:39:55.911047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:33.369933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915514+0000","last_change":"2023-10-09T11:39:55.915469+0000","last_active":"2023-10-09T11:39:55.915514+0000","last_peered":"2023-10-09T11:39:55.915514+0000","last_clean":"2023-10-09T11:39:55.915514+0000","last_became_active":"2023-10-09T11:39:55.915216+0000","last_became_peered":"2023-10-09T11:39:55.915216+0000","last_unstale":"2023-10-09T11:39:55.915514+0000","last_undegraded":"2023-10-09T11:39:55.915514+0000","last_fullsized":"2023-10-09T11:39:55.915514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:09.064758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911437+0000","last_change":"2023-10-09T11:39:55.911371+0000","last_active":"2023-10-09T11:39:55.911437+0000","last_peered":"2023-10-09T11:39:55.911437+0000","last_clean":"2023-10-09T11:39:55.911437+0000","last_became_active":"2023-10-09T11:39:55.911147+0000","last_became_peered":"2023-10-09T11:39:55.911147+0000","last_unstale":"2023-10-09T11:39:55.911437+0000","last_undegraded":"2023-10-09T11:39:55.911437+0000","last_fullsized":"2023-10-09T11:39:55.911437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:09.415251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918458+0000","last_change":"2023-10-09T11:39:55.918393+0000","last_active":"2023-10-09T11:39:55.918458+0000","last_peered":"2023-10-09T11:39:55.918458+0000","last_clean":"2023-10-09T11:39:55.918458+0000","last_became_active":"2023-10-09T11:39:55.918095+0000","last_became_peered":"2023-10-09T11:39:55.918095+0000","last_unstale":"2023-10-09T11:39:55.918458+0000","last_undegraded":"2023-10-09T11:39:55.918458+0000","last_fullsized":"2023-10-09T11:39:55.918458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:13.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913238+0000","last_change":"2023-10-09T11:39:55.913171+0000","last_active":"2023-10-09T11:39:55.913238+0000","last_peered":"2023-10-09T11:39:55.913238+0000","last_clean":"2023-10-09T11:39:55.913238+0000","last_became_active":"2023-10-09T11:39:55.912908+0000","last_became_peered":"2023-10-09T11:39:55.912908+0000","last_unstale":"2023-10-09T11:39:55.913238+0000","last_undegraded":"2023-10-09T11:39:55.913238+0000","last_fullsized":"2023-10-09T11:39:55.913238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:48.018983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917733+0000","last_change":"2023-10-09T11:39:55.917330+0000","last_active":"2023-10-09T11:39:55.917733+0000","last_peered":"2023-10-09T11:39:55.917733+0000","last_clean":"2023-10-09T11:39:55.917733+0000","last_became_active":"2023-10-09T11:39:55.916929+0000","last_became_peered":"2023-10-09T11:39:55.916929+0000","last_unstale":"2023-10-09T11:39:55.917733+0000","last_undegraded":"2023-10-09T11:39:55.917733+0000","last_fullsized":"2023-10-09T11:39:55.917733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:20.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909500+0000","last_change":"2023-10-09T11:39:55.909441+0000","last_active":"2023-10-09T11:39:55.909500+0000","last_peered":"2023-10-09T11:39:55.909500+0000","last_clean":"2023-10-09T11:39:55.909500+0000","last_became_active":"2023-10-09T11:39:55.909213+0000","last_became_peered":"2023-10-09T11:39:55.909213+0000","last_unstale":"2023-10-09T11:39:55.909500+0000","last_undegraded":"2023-10-09T11:39:55.909500+0000","last_fullsized":"2023-10-09T11:39:55.909500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:18.973805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912214+0000","last_change":"2023-10-09T11:39:55.912016+0000","last_active":"2023-10-09T11:39:55.912214+0000","last_peered":"2023-10-09T11:39:55.912214+0000","last_clean":"2023-10-09T11:39:55.912214+0000","last_became_active":"2023-10-09T11:39:55.911319+0000","last_became_peered":"2023-10-09T11:39:55.911319+0000","last_unstale":"2023-10-09T11:39:55.912214+0000","last_undegraded":"2023-10-09T11:39:55.912214+0000","last_fullsized":"2023-10-09T11:39:55.912214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:19.008544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912008+0000","last_change":"2023-10-09T11:39:55.911937+0000","last_active":"2023-10-09T11:39:55.912008+0000","last_peered":"2023-10-09T11:39:55.912008+0000","last_clean":"2023-10-09T11:39:55.912008+0000","last_became_active":"2023-10-09T11:39:55.911692+0000","last_became_peered":"2023-10-09T11:39:55.911692+0000","last_unstale":"2023-10-09T11:39:55.912008+0000","last_undegraded":"2023-10-09T11:39:55.912008+0000","last_fullsized":"2023-10-09T11:39:55.912008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:06.865641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912270+0000","last_change":"2023-10-09T11:39:55.909766+0000","last_active":"2023-10-09T11:39:55.912270+0000","last_peered":"2023-10-09T11:39:55.912270+0000","last_clean":"2023-10-09T11:39:55.912270+0000","last_became_active":"2023-10-09T11:39:55.909394+0000","last_became_peered":"2023-10-09T11:39:55.909394+0000","last_unstale":"2023-10-09T11:39:55.912270+0000","last_undegraded":"2023-10-09T11:39:55.912270+0000","last_fullsized":"2023-10-09T11:39:55.912270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:08:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915404+0000","last_change":"2023-10-09T11:39:55.915336+0000","last_active":"2023-10-09T11:39:55.915404+0000","last_peered":"2023-10-09T11:39:55.915404+0000","last_clean":"2023-10-09T11:39:55.915404+0000","last_became_active":"2023-10-09T11:39:55.915094+0000","last_became_peered":"2023-10-09T11:39:55.915094+0000","last_unstale":"2023-10-09T11:39:55.915404+0000","last_undegraded":"2023-10-09T11:39:55.915404+0000","last_fullsized":"2023-10-09T11:39:55.915404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:12.018259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906320+0000","last_change":"2023-10-09T11:39:55.905571+0000","last_active":"2023-10-09T11:39:55.906320+0000","last_peered":"2023-10-09T11:39:55.906320+0000","last_clean":"2023-10-09T11:39:55.906320+0000","last_became_active":"2023-10-09T11:39:55.905352+0000","last_became_peered":"2023-10-09T11:39:55.905352+0000","last_unstale":"2023-10-09T11:39:55.906320+0000","last_undegraded":"2023-10-09T11:39:55.906320+0000","last_fullsized":"2023-10-09T11:39:55.906320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:57.940035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.907847+0000","last_change":"2023-10-09T11:39:55.907783+0000","last_active":"2023-10-09T11:39:55.907847+0000","last_peered":"2023-10-09T11:39:55.907847+0000","last_clean":"2023-10-09T11:39:55.907847+0000","last_became_active":"2023-10-09T11:39:55.907537+0000","last_became_peered":"2023-10-09T11:39:55.907537+0000","last_unstale":"2023-10-09T11:39:55.907847+0000","last_undegraded":"2023-10-09T11:39:55.907847+0000","last_fullsized":"2023-10-09T11:39:55.907847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915809+0000","last_change":"2023-10-09T11:39:55.915651+0000","last_active":"2023-10-09T11:39:55.915809+0000","last_peered":"2023-10-09T11:39:55.915809+0000","last_clean":"2023-10-09T11:39:55.915809+0000","last_became_active":"2023-10-09T11:39:55.915402+0000","last_became_peered":"2023-10-09T11:39:55.915402+0000","last_unstale":"2023-10-09T11:39:55.915809+0000","last_undegraded":"2023-10-09T11:39:55.915809+0000","last_fullsized":"2023-10-09T11:39:55.915809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:20.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911393+0000","last_change":"2023-10-09T11:39:55.910811+0000","last_active":"2023-10-09T11:39:55.911393+0000","last_peered":"2023-10-09T11:39:55.911393+0000","last_clean":"2023-10-09T11:39:55.911393+0000","last_became_active":"2023-10-09T11:39:55.910304+0000","last_became_peered":"2023-10-09T11:39:55.910304+0000","last_unstale":"2023-10-09T11:39:55.911393+0000","last_undegraded":"2023-10-09T11:39:55.911393+0000","last_fullsized":"2023-10-09T11:39:55.911393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:34.502955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915876+0000","last_change":"2023-10-09T11:39:55.915819+0000","last_active":"2023-10-09T11:39:55.915876+0000","last_peered":"2023-10-09T11:39:55.915876+0000","last_clean":"2023-10-09T11:39:55.915876+0000","last_became_active":"2023-10-09T11:39:55.915684+0000","last_became_peered":"2023-10-09T11:39:55.915684+0000","last_unstale":"2023-10-09T11:39:55.915876+0000","last_undegraded":"2023-10-09T11:39:55.915876+0000","last_fullsized":"2023-10-09T11:39:55.915876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:04.425916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917750+0000","last_change":"2023-10-09T11:39:55.917405+0000","last_active":"2023-10-09T11:39:55.917750+0000","last_peered":"2023-10-09T11:39:55.917750+0000","last_clean":"2023-10-09T11:39:55.917750+0000","last_became_active":"2023-10-09T11:39:55.917051+0000","last_became_peered":"2023-10-09T11:39:55.917051+0000","last_unstale":"2023-10-09T11:39:55.917750+0000","last_undegraded":"2023-10-09T11:39:55.917750+0000","last_fullsized":"2023-10-09T11:39:55.917750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:16.659213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909828+0000","last_change":"2023-10-09T11:39:55.909417+0000","last_active":"2023-10-09T11:39:55.909828+0000","last_peered":"2023-10-09T11:39:55.909828+0000","last_clean":"2023-10-09T11:39:55.909828+0000","last_became_active":"2023-10-09T11:39:55.909176+0000","last_became_peered":"2023-10-09T11:39:55.909176+0000","last_unstale":"2023-10-09T11:39:55.909828+0000","last_undegraded":"2023-10-09T11:39:55.909828+0000","last_fullsized":"2023-10-09T11:39:55.909828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:36.965411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912200+0000","last_change":"2023-10-09T11:39:55.911209+0000","last_active":"2023-10-09T11:39:55.912200+0000","last_peered":"2023-10-09T11:39:55.912200+0000","last_clean":"2023-10-09T11:39:55.912200+0000","last_became_active":"2023-10-09T11:39:55.910466+0000","last_became_peered":"2023-10-09T11:39:55.910466+0000","last_unstale":"2023-10-09T11:39:55.912200+0000","last_undegraded":"2023-10-09T11:39:55.912200+0000","last_fullsized":"2023-10-09T11:39:55.912200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:51.971679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914194+0000","last_change":"2023-10-09T11:39:55.914125+0000","last_active":"2023-10-09T11:39:55.914194+0000","last_peered":"2023-10-09T11:39:55.914194+0000","last_clean":"2023-10-09T11:39:55.914194+0000","last_became_active":"2023-10-09T11:39:55.913646+0000","last_became_peered":"2023-10-09T11:39:55.913646+0000","last_unstale":"2023-10-09T11:39:55.914194+0000","last_undegraded":"2023-10-09T11:39:55.914194+0000","last_fullsized":"2023-10-09T11:39:55.914194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:11.916697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912370+0000","last_change":"2023-10-09T11:39:55.912285+0000","last_active":"2023-10-09T11:39:55.912370+0000","last_peered":"2023-10-09T11:39:55.912370+0000","last_clean":"2023-10-09T11:39:55.912370+0000","last_became_active":"2023-10-09T11:39:55.912052+0000","last_became_peered":"2023-10-09T11:39:55.912052+0000","last_unstale":"2023-10-09T11:39:55.912370+0000","last_undegraded":"2023-10-09T11:39:55.912370+0000","last_fullsized":"2023-10-09T11:39:55.912370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:57.186981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920382+0000","last_change":"2023-10-09T11:39:55.920331+0000","last_active":"2023-10-09T11:39:55.920382+0000","last_peered":"2023-10-09T11:39:55.920382+0000","last_clean":"2023-10-09T11:39:55.920382+0000","last_became_active":"2023-10-09T11:39:55.919954+0000","last_became_peered":"2023-10-09T11:39:55.919954+0000","last_unstale":"2023-10-09T11:39:55.920382+0000","last_undegraded":"2023-10-09T11:39:55.920382+0000","last_fullsized":"2023-10-09T11:39:55.920382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:25.584819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913852+0000","last_change":"2023-10-09T11:39:55.913784+0000","last_active":"2023-10-09T11:39:55.913852+0000","last_peered":"2023-10-09T11:39:55.913852+0000","last_clean":"2023-10-09T11:39:55.913852+0000","last_became_active":"2023-10-09T11:39:55.913532+0000","last_became_peered":"2023-10-09T11:39:55.913532+0000","last_unstale":"2023-10-09T11:39:55.913852+0000","last_undegraded":"2023-10-09T11:39:55.913852+0000","last_fullsized":"2023-10-09T11:39:55.913852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:46.525321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915493+0000","last_change":"2023-10-09T11:39:55.915365+0000","last_active":"2023-10-09T11:39:55.915493+0000","last_peered":"2023-10-09T11:39:55.915493+0000","last_clean":"2023-10-09T11:39:55.915493+0000","last_became_active":"2023-10-09T11:39:55.915149+0000","last_became_peered":"2023-10-09T11:39:55.915149+0000","last_unstale":"2023-10-09T11:39:55.915493+0000","last_undegraded":"2023-10-09T11:39:55.915493+0000","last_fullsized":"2023-10-09T11:39:55.915493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:47.093548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912846+0000","last_change":"2023-10-09T11:39:55.912791+0000","last_active":"2023-10-09T11:39:55.912846+0000","last_peered":"2023-10-09T11:39:55.912846+0000","last_clean":"2023-10-09T11:39:55.912846+0000","last_became_active":"2023-10-09T11:39:55.912578+0000","last_became_peered":"2023-10-09T11:39:55.912578+0000","last_unstale":"2023-10-09T11:39:55.912846+0000","last_undegraded":"2023-10-09T11:39:55.912846+0000","last_fullsized":"2023-10-09T11:39:55.912846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:57.442636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915440+0000","last_change":"2023-10-09T11:39:55.914832+0000","last_active":"2023-10-09T11:39:55.915440+0000","last_peered":"2023-10-09T11:39:55.915440+0000","last_clean":"2023-10-09T11:39:55.915440+0000","last_became_active":"2023-10-09T11:39:55.914570+0000","last_became_peered":"2023-10-09T11:39:55.914570+0000","last_unstale":"2023-10-09T11:39:55.915440+0000","last_undegraded":"2023-10-09T11:39:55.915440+0000","last_fullsized":"2023-10-09T11:39:55.915440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:20.747638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910574+0000","last_change":"2023-10-09T11:39:55.910386+0000","last_active":"2023-10-09T11:39:55.910574+0000","last_peered":"2023-10-09T11:39:55.910574+0000","last_clean":"2023-10-09T11:39:55.910574+0000","last_became_active":"2023-10-09T11:39:55.910151+0000","last_became_peered":"2023-10-09T11:39:55.910151+0000","last_unstale":"2023-10-09T11:39:55.910574+0000","last_undegraded":"2023-10-09T11:39:55.910574+0000","last_fullsized":"2023-10-09T11:39:55.910574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:22.469628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913882+0000","last_change":"2023-10-09T11:39:55.913325+0000","last_active":"2023-10-09T11:39:55.913882+0000","last_peered":"2023-10-09T11:39:55.913882+0000","last_clean":"2023-10-09T11:39:55.913882+0000","last_became_active":"2023-10-09T11:39:55.913100+0000","last_became_peered":"2023-10-09T11:39:55.913100+0000","last_unstale":"2023-10-09T11:39:55.913882+0000","last_undegraded":"2023-10-09T11:39:55.913882+0000","last_fullsized":"2023-10-09T11:39:55.913882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:57.186981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906249+0000","last_change":"2023-10-09T11:39:55.906161+0000","last_active":"2023-10-09T11:39:55.906249+0000","last_peered":"2023-10-09T11:39:55.906249+0000","last_clean":"2023-10-09T11:39:55.906249+0000","last_became_active":"2023-10-09T11:39:55.905921+0000","last_became_peered":"2023-10-09T11:39:55.905921+0000","last_unstale":"2023-10-09T11:39:55.906249+0000","last_undegraded":"2023-10-09T11:39:55.906249+0000","last_fullsized":"2023-10-09T11:39:55.906249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917687+0000","last_change":"2023-10-09T11:39:55.916825+0000","last_active":"2023-10-09T11:39:55.917687+0000","last_peered":"2023-10-09T11:39:55.917687+0000","last_clean":"2023-10-09T11:39:55.917687+0000","last_became_active":"2023-10-09T11:39:55.916548+0000","last_became_peered":"2023-10-09T11:39:55.916548+0000","last_unstale":"2023-10-09T11:39:55.917687+0000","last_undegraded":"2023-10-09T11:39:55.917687+0000","last_fullsized":"2023-10-09T11:39:55.917687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:04.318503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920238+0000","last_change":"2023-10-09T11:39:55.920175+0000","last_active":"2023-10-09T11:39:55.920238+0000","last_peered":"2023-10-09T11:39:55.920238+0000","last_clean":"2023-10-09T11:39:55.920238+0000","last_became_active":"2023-10-09T11:39:55.919656+0000","last_became_peered":"2023-10-09T11:39:55.919656+0000","last_unstale":"2023-10-09T11:39:55.920238+0000","last_undegraded":"2023-10-09T11:39:55.920238+0000","last_fullsized":"2023-10-09T11:39:55.920238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:24.378274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166853+0000","last_change":"2023-10-09T11:39:55.169436+0000","last_active":"2023-10-09T11:39:56.166853+0000","last_peered":"2023-10-09T11:39:56.166853+0000","last_clean":"2023-10-09T11:39:56.166853+0000","last_became_active":"2023-10-09T11:39:55.168859+0000","last_became_peered":"2023-10-09T11:39:55.168859+0000","last_unstale":"2023-10-09T11:39:56.166853+0000","last_undegraded":"2023-10-09T11:39:56.166853+0000","last_fullsized":"2023-10-09T11:39:56.166853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:18.343121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908488+0000","last_change":"2023-10-09T11:39:55.908331+0000","last_active":"2023-10-09T11:39:55.908488+0000","last_peered":"2023-10-09T11:39:55.908488+0000","last_clean":"2023-10-09T11:39:55.908488+0000","last_became_active":"2023-10-09T11:39:55.907784+0000","last_became_peered":"2023-10-09T11:39:55.907784+0000","last_unstale":"2023-10-09T11:39:55.908488+0000","last_undegraded":"2023-10-09T11:39:55.908488+0000","last_fullsized":"2023-10-09T11:39:55.908488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:12.990945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.168423+0000","last_change":"2023-10-09T11:39:55.170014+0000","last_active":"2023-10-09T11:39:56.168423+0000","last_peered":"2023-10-09T11:39:56.168423+0000","last_clean":"2023-10-09T11:39:56.168423+0000","last_became_active":"2023-10-09T11:39:55.169763+0000","last_became_peered":"2023-10-09T11:39:55.169763+0000","last_unstale":"2023-10-09T11:39:56.168423+0000","last_undegraded":"2023-10-09T11:39:56.168423+0000","last_fullsized":"2023-10-09T11:39:56.168423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:10.907212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920032+0000","last_change":"2023-10-09T11:39:55.919975+0000","last_active":"2023-10-09T11:39:55.920032+0000","last_peered":"2023-10-09T11:39:55.920032+0000","last_clean":"2023-10-09T11:39:55.920032+0000","last_became_active":"2023-10-09T11:39:55.919775+0000","last_became_peered":"2023-10-09T11:39:55.919775+0000","last_unstale":"2023-10-09T11:39:55.920032+0000","last_undegraded":"2023-10-09T11:39:55.920032+0000","last_fullsized":"2023-10-09T11:39:55.920032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:51.971679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166925+0000","last_change":"2023-10-09T11:39:55.166823+0000","last_active":"2023-10-09T11:39:56.166925+0000","last_peered":"2023-10-09T11:39:56.166925+0000","last_clean":"2023-10-09T11:39:56.166925+0000","last_became_active":"2023-10-09T11:39:55.165821+0000","last_became_peered":"2023-10-09T11:39:55.165821+0000","last_unstale":"2023-10-09T11:39:56.166925+0000","last_undegraded":"2023-10-09T11:39:56.166925+0000","last_fullsized":"2023-10-09T11:39:56.166925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:29.193848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913180+0000","last_change":"2023-10-09T11:39:55.912613+0000","last_active":"2023-10-09T11:39:55.913180+0000","last_peered":"2023-10-09T11:39:55.913180+0000","last_clean":"2023-10-09T11:39:55.913180+0000","last_became_active":"2023-10-09T11:39:55.912377+0000","last_became_peered":"2023-10-09T11:39:55.912377+0000","last_unstale":"2023-10-09T11:39:55.913180+0000","last_undegraded":"2023-10-09T11:39:55.913180+0000","last_fullsized":"2023-10-09T11:39:55.913180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:13.853271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167686+0000","last_change":"2023-10-09T11:39:55.168253+0000","last_active":"2023-10-09T11:39:56.167686+0000","last_peered":"2023-10-09T11:39:56.167686+0000","last_clean":"2023-10-09T11:39:56.167686+0000","last_became_active":"2023-10-09T11:39:55.168033+0000","last_became_peered":"2023-10-09T11:39:55.168033+0000","last_unstale":"2023-10-09T11:39:56.167686+0000","last_undegraded":"2023-10-09T11:39:56.167686+0000","last_fullsized":"2023-10-09T11:39:56.167686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:26.981665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910359+0000","last_change":"2023-10-09T11:39:55.910197+0000","last_active":"2023-10-09T11:39:55.910359+0000","last_peered":"2023-10-09T11:39:55.910359+0000","last_clean":"2023-10-09T11:39:55.910359+0000","last_became_active":"2023-10-09T11:39:55.909889+0000","last_became_peered":"2023-10-09T11:39:55.909889+0000","last_unstale":"2023-10-09T11:39:55.910359+0000","last_undegraded":"2023-10-09T11:39:55.910359+0000","last_fullsized":"2023-10-09T11:39:55.910359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:13.853271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167079+0000","last_change":"2023-10-09T11:39:55.169376+0000","last_active":"2023-10-09T11:39:56.167079+0000","last_peered":"2023-10-09T11:39:56.167079+0000","last_clean":"2023-10-09T11:39:56.167079+0000","last_became_active":"2023-10-09T11:39:55.167365+0000","last_became_peered":"2023-10-09T11:39:55.167365+0000","last_unstale":"2023-10-09T11:39:56.167079+0000","last_undegraded":"2023-10-09T11:39:56.167079+0000","last_fullsized":"2023-10-09T11:39:56.167079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:05.856155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914342+0000","last_change":"2023-10-09T11:39:55.914282+0000","last_active":"2023-10-09T11:39:55.914342+0000","last_peered":"2023-10-09T11:39:55.914342+0000","last_clean":"2023-10-09T11:39:55.914342+0000","last_became_active":"2023-10-09T11:39:55.913912+0000","last_became_peered":"2023-10-09T11:39:55.913912+0000","last_unstale":"2023-10-09T11:39:55.914342+0000","last_undegraded":"2023-10-09T11:39:55.914342+0000","last_fullsized":"2023-10-09T11:39:55.914342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:19.352606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.165560+0000","last_change":"2023-10-09T11:39:55.165674+0000","last_active":"2023-10-09T11:39:56.165560+0000","last_peered":"2023-10-09T11:39:56.165560+0000","last_clean":"2023-10-09T11:39:56.165560+0000","last_became_active":"2023-10-09T11:39:55.165139+0000","last_became_peered":"2023-10-09T11:39:55.165139+0000","last_unstale":"2023-10-09T11:39:56.165560+0000","last_undegraded":"2023-10-09T11:39:56.165560+0000","last_fullsized":"2023-10-09T11:39:56.165560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:26.177498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915633+0000","last_change":"2023-10-09T11:39:55.915557+0000","last_active":"2023-10-09T11:39:55.915633+0000","last_peered":"2023-10-09T11:39:55.915633+0000","last_clean":"2023-10-09T11:39:55.915633+0000","last_became_active":"2023-10-09T11:39:55.915141+0000","last_became_peered":"2023-10-09T11:39:55.915141+0000","last_unstale":"2023-10-09T11:39:55.915633+0000","last_undegraded":"2023-10-09T11:39:55.915633+0000","last_fullsized":"2023-10-09T11:39:55.915633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:25.927374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904086+0000","last_change":"2023-10-09T11:39:55.166277+0000","last_active":"2023-10-09T11:39:55.904086+0000","last_peered":"2023-10-09T11:39:55.904086+0000","last_clean":"2023-10-09T11:39:55.904086+0000","last_became_active":"2023-10-09T11:39:55.166081+0000","last_became_peered":"2023-10-09T11:39:55.166081+0000","last_unstale":"2023-10-09T11:39:55.904086+0000","last_undegraded":"2023-10-09T11:39:55.904086+0000","last_fullsized":"2023-10-09T11:39:55.904086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:45.624584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910439+0000","last_change":"2023-10-09T11:39:55.910377+0000","last_active":"2023-10-09T11:39:55.910439+0000","last_peered":"2023-10-09T11:39:55.910439+0000","last_clean":"2023-10-09T11:39:55.910439+0000","last_became_active":"2023-10-09T11:39:55.910160+0000","last_became_peered":"2023-10-09T11:39:55.910160+0000","last_unstale":"2023-10-09T11:39:55.910439+0000","last_undegraded":"2023-10-09T11:39:55.910439+0000","last_fullsized":"2023-10-09T11:39:55.910439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:30.196354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.903504+0000","last_change":"2023-10-09T11:39:55.168944+0000","last_active":"2023-10-09T11:39:55.903504+0000","last_peered":"2023-10-09T11:39:55.903504+0000","last_clean":"2023-10-09T11:39:55.903504+0000","last_became_active":"2023-10-09T11:39:55.168725+0000","last_became_peered":"2023-10-09T11:39:55.168725+0000","last_unstale":"2023-10-09T11:39:55.903504+0000","last_undegraded":"2023-10-09T11:39:55.903504+0000","last_fullsized":"2023-10-09T11:39:55.903504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:23.625966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910708+0000","last_change":"2023-10-09T11:39:55.910614+0000","last_active":"2023-10-09T11:39:55.910708+0000","last_peered":"2023-10-09T11:39:55.910708+0000","last_clean":"2023-10-09T11:39:55.910708+0000","last_became_active":"2023-10-09T11:39:55.910241+0000","last_became_peered":"2023-10-09T11:39:55.910241+0000","last_unstale":"2023-10-09T11:39:55.910708+0000","last_undegraded":"2023-10-09T11:39:55.910708+0000","last_fullsized":"2023-10-09T11:39:55.910708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:24.378274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908790+0000","last_change":"2023-10-09T11:39:55.163796+0000","last_active":"2023-10-09T11:39:55.908790+0000","last_peered":"2023-10-09T11:39:55.908790+0000","last_clean":"2023-10-09T11:39:55.908790+0000","last_became_active":"2023-10-09T11:39:55.163245+0000","last_became_peered":"2023-10-09T11:39:55.163245+0000","last_unstale":"2023-10-09T11:39:55.908790+0000","last_undegraded":"2023-10-09T11:39:55.908790+0000","last_fullsized":"2023-10-09T11:39:55.908790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:21.256891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920091+0000","last_change":"2023-10-09T11:39:55.920029+0000","last_active":"2023-10-09T11:39:55.920091+0000","last_peered":"2023-10-09T11:39:55.920091+0000","last_clean":"2023-10-09T11:39:55.920091+0000","last_became_active":"2023-10-09T11:39:55.919740+0000","last_became_peered":"2023-10-09T11:39:55.919740+0000","last_unstale":"2023-10-09T11:39:55.920091+0000","last_undegraded":"2023-10-09T11:39:55.920091+0000","last_fullsized":"2023-10-09T11:39:55.920091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:47.093548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.907732+0000","last_change":"2023-10-09T11:39:55.170755+0000","last_active":"2023-10-09T11:39:55.907732+0000","last_peered":"2023-10-09T11:39:55.907732+0000","last_clean":"2023-10-09T11:39:55.907732+0000","last_became_active":"2023-10-09T11:39:55.170500+0000","last_became_peered":"2023-10-09T11:39:55.170500+0000","last_unstale":"2023-10-09T11:39:55.907732+0000","last_undegraded":"2023-10-09T11:39:55.907732+0000","last_fullsized":"2023-10-09T11:39:55.907732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:27.057332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918155+0000","last_change":"2023-10-09T11:39:55.918074+0000","last_active":"2023-10-09T11:39:55.918155+0000","last_peered":"2023-10-09T11:39:55.918155+0000","last_clean":"2023-10-09T11:39:55.918155+0000","last_became_active":"2023-10-09T11:39:55.917751+0000","last_became_peered":"2023-10-09T11:39:55.917751+0000","last_unstale":"2023-10-09T11:39:55.918155+0000","last_undegraded":"2023-10-09T11:39:55.918155+0000","last_fullsized":"2023-10-09T11:39:55.918155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:58.983737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.165952+0000","last_change":"2023-10-09T11:39:55.165738+0000","last_active":"2023-10-09T11:39:56.165952+0000","last_peered":"2023-10-09T11:39:56.165952+0000","last_clean":"2023-10-09T11:39:56.165952+0000","last_became_active":"2023-10-09T11:39:55.165300+0000","last_became_peered":"2023-10-09T11:39:55.165300+0000","last_unstale":"2023-10-09T11:39:56.165952+0000","last_undegraded":"2023-10-09T11:39:56.165952+0000","last_fullsized":"2023-10-09T11:39:56.165952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:46.479174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908514+0000","last_change":"2023-10-09T11:39:55.908444+0000","last_active":"2023-10-09T11:39:55.908514+0000","last_peered":"2023-10-09T11:39:55.908514+0000","last_clean":"2023-10-09T11:39:55.908514+0000","last_became_active":"2023-10-09T11:39:55.908106+0000","last_became_peered":"2023-10-09T11:39:55.908106+0000","last_unstale":"2023-10-09T11:39:55.908514+0000","last_undegraded":"2023-10-09T11:39:55.908514+0000","last_fullsized":"2023-10-09T11:39:55.908514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:02.031702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.168123+0000","last_change":"2023-10-09T11:39:55.168380+0000","last_active":"2023-10-09T11:39:56.168123+0000","last_peered":"2023-10-09T11:39:56.168123+0000","last_clean":"2023-10-09T11:39:56.168123+0000","last_became_active":"2023-10-09T11:39:55.168133+0000","last_became_peered":"2023-10-09T11:39:55.168133+0000","last_unstale":"2023-10-09T11:39:56.168123+0000","last_undegraded":"2023-10-09T11:39:56.168123+0000","last_fullsized":"2023-10-09T11:39:56.168123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:10.255630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914186+0000","last_change":"2023-10-09T11:39:55.914034+0000","last_active":"2023-10-09T11:39:55.914186+0000","last_peered":"2023-10-09T11:39:55.914186+0000","last_clean":"2023-10-09T11:39:55.914186+0000","last_became_active":"2023-10-09T11:39:55.913642+0000","last_became_peered":"2023-10-09T11:39:55.913642+0000","last_unstale":"2023-10-09T11:39:55.914186+0000","last_undegraded":"2023-10-09T11:39:55.914186+0000","last_fullsized":"2023-10-09T11:39:55.914186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:47.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166269+0000","last_change":"2023-10-09T11:39:55.169068+0000","last_active":"2023-10-09T11:39:56.166269+0000","last_peered":"2023-10-09T11:39:56.166269+0000","last_clean":"2023-10-09T11:39:56.166269+0000","last_became_active":"2023-10-09T11:39:55.168829+0000","last_became_peered":"2023-10-09T11:39:55.168829+0000","last_unstale":"2023-10-09T11:39:56.166269+0000","last_undegraded":"2023-10-09T11:39:56.166269+0000","last_fullsized":"2023-10-09T11:39:56.166269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:49.368443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909726+0000","last_change":"2023-10-09T11:39:55.909492+0000","last_active":"2023-10-09T11:39:55.909726+0000","last_peered":"2023-10-09T11:39:55.909726+0000","last_clean":"2023-10-09T11:39:55.909726+0000","last_became_active":"2023-10-09T11:39:55.909237+0000","last_became_peered":"2023-10-09T11:39:55.909237+0000","last_unstale":"2023-10-09T11:39:55.909726+0000","last_undegraded":"2023-10-09T11:39:55.909726+0000","last_fullsized":"2023-10-09T11:39:55.909726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:20.545022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911243+0000","last_change":"2023-10-09T11:39:55.171867+0000","last_active":"2023-10-09T11:39:55.911243+0000","last_peered":"2023-10-09T11:39:55.911243+0000","last_clean":"2023-10-09T11:39:55.911243+0000","last_became_active":"2023-10-09T11:39:55.171100+0000","last_became_peered":"2023-10-09T11:39:55.171100+0000","last_unstale":"2023-10-09T11:39:55.911243+0000","last_undegraded":"2023-10-09T11:39:55.911243+0000","last_fullsized":"2023-10-09T11:39:55.911243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:08:04.960271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918180+0000","last_change":"2023-10-09T11:39:55.918111+0000","last_active":"2023-10-09T11:39:55.918180+0000","last_peered":"2023-10-09T11:39:55.918180+0000","last_clean":"2023-10-09T11:39:55.918180+0000","last_became_active":"2023-10-09T11:39:55.917915+0000","last_became_peered":"2023-10-09T11:39:55.917915+0000","last_unstale":"2023-10-09T11:39:55.918180+0000","last_undegraded":"2023-10-09T11:39:55.918180+0000","last_fullsized":"2023-10-09T11:39:55.918180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:14.003883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904778+0000","last_change":"2023-10-09T11:39:55.167299+0000","last_active":"2023-10-09T11:39:55.904778+0000","last_peered":"2023-10-09T11:39:55.904778+0000","last_clean":"2023-10-09T11:39:55.904778+0000","last_became_active":"2023-10-09T11:39:55.166553+0000","last_became_peered":"2023-10-09T11:39:55.166553+0000","last_unstale":"2023-10-09T11:39:55.904778+0000","last_undegraded":"2023-10-09T11:39:55.904778+0000","last_fullsized":"2023-10-09T11:39:55.904778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:22.041652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911364+0000","last_change":"2023-10-09T11:39:55.910667+0000","last_active":"2023-10-09T11:39:55.911364+0000","last_peered":"2023-10-09T11:39:55.911364+0000","last_clean":"2023-10-09T11:39:55.911364+0000","last_became_active":"2023-10-09T11:39:55.909993+0000","last_became_peered":"2023-10-09T11:39:55.909993+0000","last_unstale":"2023-10-09T11:39:55.911364+0000","last_undegraded":"2023-10-09T11:39:55.911364+0000","last_fullsized":"2023-10-09T11:39:55.911364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:16.289080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.169301+0000","last_change":"2023-10-09T11:39:55.168591+0000","last_active":"2023-10-09T11:39:56.169301+0000","last_peered":"2023-10-09T11:39:56.169301+0000","last_clean":"2023-10-09T11:39:56.169301+0000","last_became_active":"2023-10-09T11:39:55.168359+0000","last_became_peered":"2023-10-09T11:39:55.168359+0000","last_unstale":"2023-10-09T11:39:56.169301+0000","last_undegraded":"2023-10-09T11:39:56.169301+0000","last_fullsized":"2023-10-09T11:39:56.169301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:36.075065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912226+0000","last_change":"2023-10-09T11:39:55.912148+0000","last_active":"2023-10-09T11:39:55.912226+0000","last_peered":"2023-10-09T11:39:55.912226+0000","last_clean":"2023-10-09T11:39:55.912226+0000","last_became_active":"2023-10-09T11:39:55.911799+0000","last_became_peered":"2023-10-09T11:39:55.911799+0000","last_unstale":"2023-10-09T11:39:55.912226+0000","last_undegraded":"2023-10-09T11:39:55.912226+0000","last_fullsized":"2023-10-09T11:39:55.912226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:13.608989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167381+0000","last_change":"2023-10-09T11:39:55.168310+0000","last_active":"2023-10-09T11:39:56.167381+0000","last_peered":"2023-10-09T11:39:56.167381+0000","last_clean":"2023-10-09T11:39:56.167381+0000","last_became_active":"2023-10-09T11:39:55.167377+0000","last_became_peered":"2023-10-09T11:39:55.167377+0000","last_unstale":"2023-10-09T11:39:56.167381+0000","last_undegraded":"2023-10-09T11:39:56.167381+0000","last_fullsized":"2023-10-09T11:39:56.167381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:32.144122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913216+0000","last_change":"2023-10-09T11:39:55.913119+0000","last_active":"2023-10-09T11:39:55.913216+0000","last_peered":"2023-10-09T11:39:55.913216+0000","last_clean":"2023-10-09T11:39:55.913216+0000","last_became_active":"2023-10-09T11:39:55.912871+0000","last_became_peered":"2023-10-09T11:39:55.912871+0000","last_unstale":"2023-10-09T11:39:55.913216+0000","last_undegraded":"2023-10-09T11:39:55.913216+0000","last_fullsized":"2023-10-09T11:39:55.913216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:20.545022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167147+0000","last_change":"2023-10-09T11:39:55.166980+0000","last_active":"2023-10-09T11:39:56.167147+0000","last_peered":"2023-10-09T11:39:56.167147+0000","last_clean":"2023-10-09T11:39:56.167147+0000","last_became_active":"2023-10-09T11:39:55.166151+0000","last_became_peered":"2023-10-09T11:39:55.166151+0000","last_unstale":"2023-10-09T11:39:56.167147+0000","last_undegraded":"2023-10-09T11:39:56.167147+0000","last_fullsized":"2023-10-09T11:39:56.167147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:37.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912260+0000","last_change":"2023-10-09T11:39:55.909623+0000","last_active":"2023-10-09T11:39:55.912260+0000","last_peered":"2023-10-09T11:39:55.912260+0000","last_clean":"2023-10-09T11:39:55.912260+0000","last_became_active":"2023-10-09T11:39:55.909106+0000","last_became_peered":"2023-10-09T11:39:55.909106+0000","last_unstale":"2023-10-09T11:39:55.912260+0000","last_undegraded":"2023-10-09T11:39:55.912260+0000","last_fullsized":"2023-10-09T11:39:55.912260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:56.969515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167569+0000","last_change":"2023-10-09T11:39:55.170221+0000","last_active":"2023-10-09T11:39:56.167569+0000","last_peered":"2023-10-09T11:39:56.167569+0000","last_clean":"2023-10-09T11:39:56.167569+0000","last_became_active":"2023-10-09T11:39:55.169988+0000","last_became_peered":"2023-10-09T11:39:55.169988+0000","last_unstale":"2023-10-09T11:39:56.167569+0000","last_undegraded":"2023-10-09T11:39:56.167569+0000","last_fullsized":"2023-10-09T11:39:56.167569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:55.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911304+0000","last_change":"2023-10-09T11:39:55.910509+0000","last_active":"2023-10-09T11:39:55.911304+0000","last_peered":"2023-10-09T11:39:55.911304+0000","last_clean":"2023-10-09T11:39:55.911304+0000","last_became_active":"2023-10-09T11:39:55.910259+0000","last_became_peered":"2023-10-09T11:39:55.910259+0000","last_unstale":"2023-10-09T11:39:55.911304+0000","last_undegraded":"2023-10-09T11:39:55.911304+0000","last_fullsized":"2023-10-09T11:39:55.911304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:06.117368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906969+0000","last_change":"2023-10-09T11:39:55.171868+0000","last_active":"2023-10-09T11:39:55.906969+0000","last_peered":"2023-10-09T11:39:55.906969+0000","last_clean":"2023-10-09T11:39:55.906969+0000","last_became_active":"2023-10-09T11:39:55.171637+0000","last_became_peered":"2023-10-09T11:39:55.171637+0000","last_unstale":"2023-10-09T11:39:55.906969+0000","last_undegraded":"2023-10-09T11:39:55.906969+0000","last_fullsized":"2023-10-09T11:39:55.906969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:20.222643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913065+0000","last_change":"2023-10-09T11:39:55.913008+0000","last_active":"2023-10-09T11:39:55.913065+0000","last_peered":"2023-10-09T11:39:55.913065+0000","last_clean":"2023-10-09T11:39:55.913065+0000","last_became_active":"2023-10-09T11:39:55.912776+0000","last_became_peered":"2023-10-09T11:39:55.912776+0000","last_unstale":"2023-10-09T11:39:55.913065+0000","last_undegraded":"2023-10-09T11:39:55.913065+0000","last_fullsized":"2023-10-09T11:39:55.913065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:43.914721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911461+0000","last_change":"2023-10-09T11:39:55.167022+0000","last_active":"2023-10-09T11:39:55.911461+0000","last_peered":"2023-10-09T11:39:55.911461+0000","last_clean":"2023-10-09T11:39:55.911461+0000","last_became_active":"2023-10-09T11:39:55.166789+0000","last_became_peered":"2023-10-09T11:39:55.166789+0000","last_unstale":"2023-10-09T11:39:55.911461+0000","last_undegraded":"2023-10-09T11:39:55.911461+0000","last_fullsized":"2023-10-09T11:39:55.911461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:28.847807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914846+0000","last_change":"2023-10-09T11:39:55.914769+0000","last_active":"2023-10-09T11:39:55.914846+0000","last_peered":"2023-10-09T11:39:55.914846+0000","last_clean":"2023-10-09T11:39:55.914846+0000","last_became_active":"2023-10-09T11:39:55.914569+0000","last_became_peered":"2023-10-09T11:39:55.914569+0000","last_unstale":"2023-10-09T11:39:55.914846+0000","last_undegraded":"2023-10-09T11:39:55.914846+0000","last_fullsized":"2023-10-09T11:39:55.914846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:39.235820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904655+0000","last_change":"2023-10-09T11:39:55.160658+0000","last_active":"2023-10-09T11:39:55.904655+0000","last_peered":"2023-10-09T11:39:55.904655+0000","last_clean":"2023-10-09T11:39:55.904655+0000","last_became_active":"2023-10-09T11:39:55.160443+0000","last_became_peered":"2023-10-09T11:39:55.160443+0000","last_unstale":"2023-10-09T11:39:55.904655+0000","last_undegraded":"2023-10-09T11:39:55.904655+0000","last_fullsized":"2023-10-09T11:39:55.904655+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:50.035557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914991+0000","last_change":"2023-10-09T11:39:55.914932+0000","last_active":"2023-10-09T11:39:55.914991+0000","last_peered":"2023-10-09T11:39:55.914991+0000","last_clean":"2023-10-09T11:39:55.914991+0000","last_became_active":"2023-10-09T11:39:55.914699+0000","last_became_peered":"2023-10-09T11:39:55.914699+0000","last_unstale":"2023-10-09T11:39:55.914991+0000","last_undegraded":"2023-10-09T11:39:55.914991+0000","last_fullsized":"2023-10-09T11:39:55.914991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:09.511874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.905506+0000","last_change":"2023-10-09T11:39:55.170767+0000","last_active":"2023-10-09T11:39:55.905506+0000","last_peered":"2023-10-09T11:39:55.905506+0000","last_clean":"2023-10-09T11:39:55.905506+0000","last_became_active":"2023-10-09T11:39:55.170529+0000","last_became_peered":"2023-10-09T11:39:55.170529+0000","last_unstale":"2023-10-09T11:39:55.905506+0000","last_undegraded":"2023-10-09T11:39:55.905506+0000","last_fullsized":"2023-10-09T11:39:55.905506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:45.515836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908750+0000","last_change":"2023-10-09T11:39:55.908676+0000","last_active":"2023-10-09T11:39:55.908750+0000","last_peered":"2023-10-09T11:39:55.908750+0000","last_clean":"2023-10-09T11:39:55.908750+0000","last_became_active":"2023-10-09T11:39:55.908469+0000","last_became_peered":"2023-10-09T11:39:55.908469+0000","last_unstale":"2023-10-09T11:39:55.908750+0000","last_undegraded":"2023-10-09T11:39:55.908750+0000","last_fullsized":"2023-10-09T11:39:55.908750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:11.139725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167375+0000","last_change":"2023-10-09T11:39:55.164852+0000","last_active":"2023-10-09T11:39:56.167375+0000","last_peered":"2023-10-09T11:39:56.167375+0000","last_clean":"2023-10-09T11:39:56.167375+0000","last_became_active":"2023-10-09T11:39:55.164583+0000","last_became_peered":"2023-10-09T11:39:55.164583+0000","last_unstale":"2023-10-09T11:39:56.167375+0000","last_undegraded":"2023-10-09T11:39:56.167375+0000","last_fullsized":"2023-10-09T11:39:56.167375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:29.453485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910689+0000","last_change":"2023-10-09T11:39:55.910465+0000","last_active":"2023-10-09T11:39:55.910689+0000","last_peered":"2023-10-09T11:39:55.910689+0000","last_clean":"2023-10-09T11:39:55.910689+0000","last_became_active":"2023-10-09T11:39:55.909936+0000","last_became_peered":"2023-10-09T11:39:55.909936+0000","last_unstale":"2023-10-09T11:39:55.910689+0000","last_undegraded":"2023-10-09T11:39:55.910689+0000","last_fullsized":"2023-10-09T11:39:55.910689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:25.584819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904524+0000","last_change":"2023-10-09T11:39:55.166361+0000","last_active":"2023-10-09T11:39:55.904524+0000","last_peered":"2023-10-09T11:39:55.904524+0000","last_clean":"2023-10-09T11:39:55.904524+0000","last_became_active":"2023-10-09T11:39:55.166033+0000","last_became_peered":"2023-10-09T11:39:55.166033+0000","last_unstale":"2023-10-09T11:39:55.904524+0000","last_undegraded":"2023-10-09T11:39:55.904524+0000","last_fullsized":"2023-10-09T11:39:55.904524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.346223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.919583+0000","last_change":"2023-10-09T11:39:55.919509+0000","last_active":"2023-10-09T11:39:55.919583+0000","last_peered":"2023-10-09T11:39:55.919583+0000","last_clean":"2023-10-09T11:39:55.919583+0000","last_became_active":"2023-10-09T11:39:55.919358+0000","last_became_peered":"2023-10-09T11:39:55.919358+0000","last_unstale":"2023-10-09T11:39:55.919583+0000","last_undegraded":"2023-10-09T11:39:55.919583+0000","last_fullsized":"2023-10-09T11:39:55.919583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:48.018983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.903598+0000","last_change":"2023-10-09T11:39:55.167577+0000","last_active":"2023-10-09T11:39:55.903598+0000","last_peered":"2023-10-09T11:39:55.903598+0000","last_clean":"2023-10-09T11:39:55.903598+0000","last_became_active":"2023-10-09T11:39:55.167105+0000","last_became_peered":"2023-10-09T11:39:55.167105+0000","last_unstale":"2023-10-09T11:39:55.903598+0000","last_undegraded":"2023-10-09T11:39:55.903598+0000","last_fullsized":"2023-10-09T11:39:55.903598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:31.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910013+0000","last_change":"2023-10-09T11:39:55.909754+0000","last_active":"2023-10-09T11:39:55.910013+0000","last_peered":"2023-10-09T11:39:55.910013+0000","last_clean":"2023-10-09T11:39:55.910013+0000","last_became_active":"2023-10-09T11:39:55.909089+0000","last_became_peered":"2023-10-09T11:39:55.909089+0000","last_unstale":"2023-10-09T11:39:55.910013+0000","last_undegraded":"2023-10-09T11:39:55.910013+0000","last_fullsized":"2023-10-09T11:39:55.910013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:47.488659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906206+0000","last_change":"2023-10-09T11:39:55.163873+0000","last_active":"2023-10-09T11:39:55.906206+0000","last_peered":"2023-10-09T11:39:55.906206+0000","last_clean":"2023-10-09T11:39:55.906206+0000","last_became_active":"2023-10-09T11:39:55.163633+0000","last_became_peered":"2023-10-09T11:39:55.163633+0000","last_unstale":"2023-10-09T11:39:55.906206+0000","last_undegraded":"2023-10-09T11:39:55.906206+0000","last_fullsized":"2023-10-09T11:39:55.906206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:19.738153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911322+0000","last_change":"2023-10-09T11:39:55.910530+0000","last_active":"2023-10-09T11:39:55.911322+0000","last_peered":"2023-10-09T11:39:55.911322+0000","last_clean":"2023-10-09T11:39:55.911322+0000","last_became_active":"2023-10-09T11:39:55.909698+0000","last_became_peered":"2023-10-09T11:39:55.909698+0000","last_unstale":"2023-10-09T11:39:55.911322+0000","last_undegraded":"2023-10-09T11:39:55.911322+0000","last_fullsized":"2023-10-09T11:39:55.911322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:53.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.902796+0000","last_change":"2023-10-09T11:39:55.160472+0000","last_active":"2023-10-09T11:39:55.902796+0000","last_peered":"2023-10-09T11:39:55.902796+0000","last_clean":"2023-10-09T11:39:55.902796+0000","last_became_active":"2023-10-09T11:39:55.160219+0000","last_became_peered":"2023-10-09T11:39:55.160219+0000","last_unstale":"2023-10-09T11:39:55.902796+0000","last_undegraded":"2023-10-09T11:39:55.902796+0000","last_fullsized":"2023-10-09T11:39:55.902796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.921295+0000","last_change":"2023-10-09T11:39:55.921245+0000","last_active":"2023-10-09T11:39:55.921295+0000","last_peered":"2023-10-09T11:39:55.921295+0000","last_clean":"2023-10-09T11:39:55.921295+0000","last_became_active":"2023-10-09T11:39:55.920971+0000","last_became_peered":"2023-10-09T11:39:55.920971+0000","last_unstale":"2023-10-09T11:39:55.921295+0000","last_undegraded":"2023-10-09T11:39:55.921295+0000","last_fullsized":"2023-10-09T11:39:55.921295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:18.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904353+0000","last_change":"2023-10-09T11:39:55.167680+0000","last_active":"2023-10-09T11:39:55.904353+0000","last_peered":"2023-10-09T11:39:55.904353+0000","last_clean":"2023-10-09T11:39:55.904353+0000","last_became_active":"2023-10-09T11:39:55.167456+0000","last_became_peered":"2023-10-09T11:39:55.167456+0000","last_unstale":"2023-10-09T11:39:55.904353+0000","last_undegraded":"2023-10-09T11:39:55.904353+0000","last_fullsized":"2023-10-09T11:39:55.904353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:22.916959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912302+0000","last_change":"2023-10-09T11:39:55.910422+0000","last_active":"2023-10-09T11:39:55.912302+0000","last_peered":"2023-10-09T11:39:55.912302+0000","last_clean":"2023-10-09T11:39:55.912302+0000","last_became_active":"2023-10-09T11:39:55.910212+0000","last_became_peered":"2023-10-09T11:39:55.910212+0000","last_unstale":"2023-10-09T11:39:55.912302+0000","last_undegraded":"2023-10-09T11:39:55.912302+0000","last_fullsized":"2023-10-09T11:39:55.912302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:27.991151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908970+0000","last_change":"2023-10-09T11:39:55.170293+0000","last_active":"2023-10-09T11:39:55.908970+0000","last_peered":"2023-10-09T11:39:55.908970+0000","last_clean":"2023-10-09T11:39:55.908970+0000","last_became_active":"2023-10-09T11:39:55.170067+0000","last_became_peered":"2023-10-09T11:39:55.170067+0000","last_unstale":"2023-10-09T11:39:55.908970+0000","last_undegraded":"2023-10-09T11:39:55.908970+0000","last_fullsized":"2023-10-09T11:39:55.908970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:17.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917708+0000","last_change":"2023-10-09T11:39:55.917245+0000","last_active":"2023-10-09T11:39:55.917708+0000","last_peered":"2023-10-09T11:39:55.917708+0000","last_clean":"2023-10-09T11:39:55.917708+0000","last_became_active":"2023-10-09T11:39:55.916264+0000","last_became_peered":"2023-10-09T11:39:55.916264+0000","last_unstale":"2023-10-09T11:39:55.917708+0000","last_undegraded":"2023-10-09T11:39:55.917708+0000","last_fullsized":"2023-10-09T11:39:55.917708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:15.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911575+0000","last_change":"2023-10-09T11:39:55.168988+0000","last_active":"2023-10-09T11:39:55.911575+0000","last_peered":"2023-10-09T11:39:55.911575+0000","last_clean":"2023-10-09T11:39:55.911575+0000","last_became_active":"2023-10-09T11:39:55.168536+0000","last_became_peered":"2023-10-09T11:39:55.168536+0000","last_unstale":"2023-10-09T11:39:55.911575+0000","last_undegraded":"2023-10-09T11:39:55.911575+0000","last_fullsized":"2023-10-09T11:39:55.911575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:45.624584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914863+0000","last_change":"2023-10-09T11:39:55.914796+0000","last_active":"2023-10-09T11:39:55.914863+0000","last_peered":"2023-10-09T11:39:55.914863+0000","last_clean":"2023-10-09T11:39:55.914863+0000","last_became_active":"2023-10-09T11:39:55.914545+0000","last_became_peered":"2023-10-09T11:39:55.914545+0000","last_unstale":"2023-10-09T11:39:55.914863+0000","last_undegraded":"2023-10-09T11:39:55.914863+0000","last_fullsized":"2023-10-09T11:39:55.914863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:06.067819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167664+0000","last_change":"2023-10-09T11:39:55.167987+0000","last_active":"2023-10-09T11:39:56.167664+0000","last_peered":"2023-10-09T11:39:56.167664+0000","last_clean":"2023-10-09T11:39:56.167664+0000","last_became_active":"2023-10-09T11:39:55.167703+0000","last_became_peered":"2023-10-09T11:39:55.167703+0000","last_unstale":"2023-10-09T11:39:56.167664+0000","last_undegraded":"2023-10-09T11:39:56.167664+0000","last_fullsized":"2023-10-09T11:39:56.167664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:01.576909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":213,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908156+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:39:55.908156+0000","last_peered":"2023-10-09T11:39:55.908156+0000","last_clean":"2023-10-09T11:39:55.908156+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:39:55.908156+0000","last_undegraded":"2023-10-09T11:39:55.908156+0000","last_fullsized":"2023-10-09T11:39:55.908156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194323,"statfs":{"total":200000000,"available":198987364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.745,"15min":0.745},"last":0.495},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.32700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.46899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.878,"15min":0.878},"last":0.69299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":1.048,"15min":1.048},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":1.079,"15min":1.079},"last":0.66200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54400000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578228,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.63},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.504}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.621,"15min":0.70099999999999996},"min":{"1min":0.39000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":5.298,"15min":5.298},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60999999999999999,"15min":0.68600000000000005},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":1.617,"15min":1.617},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63400000000000001,"15min":0.71199999999999997},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":5.46,"15min":5.46},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.73399999999999999},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.32600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60499999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199576196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38500000000000001,"15min":0.40699999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59499999999999997,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.45500000000000002},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":2.004,"15min":2.004},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64000000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77000000000000002,"5min":1.909,"15min":1.909},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.78200000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.869,"15min":1.869},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.497,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92200000000000004,"5min":1.952,"15min":1.952},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.878,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.83399999999999996,"5min":1.782,"15min":1.782},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98099999999999998,"5min":1.819,"15min":1.819},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194325,"statfs":{"total":200000000,"available":198988963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.23400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53500000000000003,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.435},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.51700000000000002,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41699999999999998},"min":{"1min":0.25,"5min":0.223,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.46999999999999997,"15min":0.51600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.48999999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.34499999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93000000000000005,"5min":1.282,"15min":1.282},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.67100000000000004,"15min":0.70899999999999996},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76800000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.67200000000000004,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":3.976,"15min":3.976},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98599999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0209999999999999,"5min":1.524,"15min":1.524},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.254,"15min":1.254},"last":0.84799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.012,"5min":1.22,"15min":1.22},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194899,"statfs":{"total":200000000,"available":199576784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.251},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33200000000000002},"min":{"1min":0.26800000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.74399999999999999,"15min":0.89400000000000002},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56899999999999995,"5min":11.055,"15min":11.055},"last":0.35799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36299999999999999},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.51500000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86199999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.24099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.53200000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39700000000000002},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53800000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.314}]},{"osd":1,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.371,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.45900000000000002,"5min":1.034,"15min":1.034},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.50600000000000001,"5min":1.335,"15min":1.335},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.311,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57499999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56499999999999995,"5min":1.405,"15min":1.405},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75900000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.63300000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86599999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194906,"statfs":{"total":200000000,"available":199584538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":0.79500000000000004},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76200000000000001,"15min":0.84999999999999998},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.67200000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54400000000000004,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.67100000000000004,"15min":0.73299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":5.274,"15min":5.274},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.76700000000000002,"15min":0.84999999999999998},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.78200000000000003,"15min":0.87},"min":{"1min":0.45700000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67200000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.502,"15min":0.503},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.68100000000000005,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.438},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68300000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70299999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63}]},{"osd":4,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42899999999999999,"15min":0.435},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.504,"15min":0.51200000000000001},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T11:40:00.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:00.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.427+0000 7f8ad4f92700 1 Processor -- start 2023-10-09T11:40:00.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.427+0000 7f8ad4f92700 1 -- start start 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ad4f92700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ad0156420 0x7f8ad00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ad4f92700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad00c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ad4f92700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad00cb880 con 0x7f8ad00cc250 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ad4f92700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00c7bb0 con 0x7f8ad0156420 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ad4f92700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad006aa10 con 0x7f8ad00c71d0 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ad0156420 0x7f8ad00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8aced9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad00c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8acdd9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8ad00cc250 0x7f8ad0069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:49734/0 (socket says 172.21.15.6:49734) 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8acdd9b700 1 -- 172.21.15.6:0/1015537021 learned_addr learned my addr 172.21.15.6:0/1015537021 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 -- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 msgr2=0x7f8ad00c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 --2- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad00c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 -- 172.21.15.6:0/1015537021 >> v1:172.21.15.118:6789/0 conn(0x7f8ad00cc250 legacy=0x7f8ad0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 -- 172.21.15.6:0/1015537021 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00cac70 con 0x7f8ad0156420 2023-10-09T11:40:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.428+0000 7f8ace59c700 1 --2- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad00cbd10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80098e0 tx=0x7f8ac80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4216f748db58ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8acd59a700 1 -- 172.21.15.6:0/1015537021 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800b640 con 0x7f8ad0156420 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8acd59a700 1 -- 172.21.15.6:0/1015537021 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac800b7a0 con 0x7f8ad0156420 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8acd59a700 1 -- 172.21.15.6:0/1015537021 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800bb40 con 0x7f8ad0156420 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 -- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 msgr2=0x7f8ad00cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad00cbd10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80098e0 tx=0x7f8ac80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 -- 172.21.15.6:0/1015537021 shutdown_connections 2023-10-09T11:40:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad00c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/1015537021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad00cbd10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 -- 172.21.15.6:0/1015537021 >> 172.21.15.6:0/1015537021 conn(0x7f8ad006c660 msgr2=0x7f8ad00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 -- 172.21.15.6:0/1015537021 shutdown_connections 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.429+0000 7f8ad4f92700 1 -- 172.21.15.6:0/1015537021 wait complete. 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.430+0000 7f8ad4f92700 1 Processor -- start 2023-10-09T11:40:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.430+0000 7f8ad4f92700 1 -- start start 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad014b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad01664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00c5230 con 0x7f8ad00cc250 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00c5510 con 0x7f8ad0156420 2023-10-09T11:40:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ad4f92700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00c57f0 con 0x7f8ad00c71d0 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40930/0 (socket says 172.21.15.6:40930) 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 -- 172.21.15.6:0/2953251120 learned_addr learned my addr 172.21.15.6:0/2953251120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8ace59c700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad014b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8aced9d700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad01664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 -- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 msgr2=0x7f8ad014b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad014b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 -- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 msgr2=0x7f8ad01664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad01664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.431+0000 7f8acdd9b700 1 -- 172.21.15.6:0/2953251120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009420 con 0x7f8ad00cc250 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8acdd9b700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c7c0 tx=0x7f8ab8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8005b30 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8005c90 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad00c5ad0 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004a80 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.432+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad014bdc0 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.433+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad006b6b0 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.433+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ab80070d0 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.434+0000 7f8ac67fc700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.434+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ab8083820 con 0x7f8ad00cc250 2023-10-09T11:40:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.434+0000 7f8ace59c700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.434+0000 7f8ace59c700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80093f0 tx=0x7f8ac8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.438+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ab804b5a0 con 0x7f8ad00cc250 2023-10-09T11:40:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.627+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ad00caf50 con 0x7f8ab0066f30 2023-10-09T11:40:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.635+0000 7f8ac67fc700 1 -- 172.21.15.6:0/2953251120 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284863 (secure 0 0 0) 0x7f8ad00caf50 con 0x7f8ab0066f30 2023-10-09T11:40:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 msgr2=0x7f8ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80093f0 tx=0x7f8ac8017000 comp rx=0 tx=0).stop 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 msgr2=0x7f8ad014a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c7c0 tx=0x7f8ab8007f70 comp rx=0 tx=0).stop 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 shutdown_connections 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad0156420 0x7f8ad01664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00c71d0 0x7f8ad014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 --2- 172.21.15.6:0/2953251120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad00cc250 0x7f8ad014a020 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 >> 172.21.15.6:0/2953251120 conn(0x7f8ad006c660 msgr2=0x7f8ad006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 shutdown_connections 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.638+0000 7f8ad4f92700 1 -- 172.21.15.6:0/2953251120 wait complete. 2023-10-09T11:40:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:40:00.652 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-10-09T11:40:00.197371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4444,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558055,"statfs":{"total":1600000000,"available":1595448511,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001335"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914167+0000","last_change":"2023-10-09T11:39:55.913895+0000","last_active":"2023-10-09T11:39:55.914167+0000","last_peered":"2023-10-09T11:39:55.914167+0000","last_clean":"2023-10-09T11:39:55.914167+0000","last_became_active":"2023-10-09T11:39:55.913340+0000","last_became_peered":"2023-10-09T11:39:55.913340+0000","last_unstale":"2023-10-09T11:39:55.914167+0000","last_undegraded":"2023-10-09T11:39:55.914167+0000","last_fullsized":"2023-10-09T11:39:55.914167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:43.914721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918913+0000","last_change":"2023-10-09T11:39:55.918814+0000","last_active":"2023-10-09T11:39:55.918913+0000","last_peered":"2023-10-09T11:39:55.918913+0000","last_clean":"2023-10-09T11:39:55.918913+0000","last_became_active":"2023-10-09T11:39:55.918622+0000","last_became_peered":"2023-10-09T11:39:55.918622+0000","last_unstale":"2023-10-09T11:39:55.918913+0000","last_undegraded":"2023-10-09T11:39:55.918913+0000","last_fullsized":"2023-10-09T11:39:55.918913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:29.316197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911047+0000","last_change":"2023-10-09T11:39:55.910970+0000","last_active":"2023-10-09T11:39:55.911047+0000","last_peered":"2023-10-09T11:39:55.911047+0000","last_clean":"2023-10-09T11:39:55.911047+0000","last_became_active":"2023-10-09T11:39:55.910713+0000","last_became_peered":"2023-10-09T11:39:55.910713+0000","last_unstale":"2023-10-09T11:39:55.911047+0000","last_undegraded":"2023-10-09T11:39:55.911047+0000","last_fullsized":"2023-10-09T11:39:55.911047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:33.369933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915514+0000","last_change":"2023-10-09T11:39:55.915469+0000","last_active":"2023-10-09T11:39:55.915514+0000","last_peered":"2023-10-09T11:39:55.915514+0000","last_clean":"2023-10-09T11:39:55.915514+0000","last_became_active":"2023-10-09T11:39:55.915216+0000","last_became_peered":"2023-10-09T11:39:55.915216+0000","last_unstale":"2023-10-09T11:39:55.915514+0000","last_undegraded":"2023-10-09T11:39:55.915514+0000","last_fullsized":"2023-10-09T11:39:55.915514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:09.064758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911437+0000","last_change":"2023-10-09T11:39:55.911371+0000","last_active":"2023-10-09T11:39:55.911437+0000","last_peered":"2023-10-09T11:39:55.911437+0000","last_clean":"2023-10-09T11:39:55.911437+0000","last_became_active":"2023-10-09T11:39:55.911147+0000","last_became_peered":"2023-10-09T11:39:55.911147+0000","last_unstale":"2023-10-09T11:39:55.911437+0000","last_undegraded":"2023-10-09T11:39:55.911437+0000","last_fullsized":"2023-10-09T11:39:55.911437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:09.415251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918458+0000","last_change":"2023-10-09T11:39:55.918393+0000","last_active":"2023-10-09T11:39:55.918458+0000","last_peered":"2023-10-09T11:39:55.918458+0000","last_clean":"2023-10-09T11:39:55.918458+0000","last_became_active":"2023-10-09T11:39:55.918095+0000","last_became_peered":"2023-10-09T11:39:55.918095+0000","last_unstale":"2023-10-09T11:39:55.918458+0000","last_undegraded":"2023-10-09T11:39:55.918458+0000","last_fullsized":"2023-10-09T11:39:55.918458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:13.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913238+0000","last_change":"2023-10-09T11:39:55.913171+0000","last_active":"2023-10-09T11:39:55.913238+0000","last_peered":"2023-10-09T11:39:55.913238+0000","last_clean":"2023-10-09T11:39:55.913238+0000","last_became_active":"2023-10-09T11:39:55.912908+0000","last_became_peered":"2023-10-09T11:39:55.912908+0000","last_unstale":"2023-10-09T11:39:55.913238+0000","last_undegraded":"2023-10-09T11:39:55.913238+0000","last_fullsized":"2023-10-09T11:39:55.913238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:48.018983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917733+0000","last_change":"2023-10-09T11:39:55.917330+0000","last_active":"2023-10-09T11:39:55.917733+0000","last_peered":"2023-10-09T11:39:55.917733+0000","last_clean":"2023-10-09T11:39:55.917733+0000","last_became_active":"2023-10-09T11:39:55.916929+0000","last_became_peered":"2023-10-09T11:39:55.916929+0000","last_unstale":"2023-10-09T11:39:55.917733+0000","last_undegraded":"2023-10-09T11:39:55.917733+0000","last_fullsized":"2023-10-09T11:39:55.917733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:20.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909500+0000","last_change":"2023-10-09T11:39:55.909441+0000","last_active":"2023-10-09T11:39:55.909500+0000","last_peered":"2023-10-09T11:39:55.909500+0000","last_clean":"2023-10-09T11:39:55.909500+0000","last_became_active":"2023-10-09T11:39:55.909213+0000","last_became_peered":"2023-10-09T11:39:55.909213+0000","last_unstale":"2023-10-09T11:39:55.909500+0000","last_undegraded":"2023-10-09T11:39:55.909500+0000","last_fullsized":"2023-10-09T11:39:55.909500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:18.973805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912214+0000","last_change":"2023-10-09T11:39:55.912016+0000","last_active":"2023-10-09T11:39:55.912214+0000","last_peered":"2023-10-09T11:39:55.912214+0000","last_clean":"2023-10-09T11:39:55.912214+0000","last_became_active":"2023-10-09T11:39:55.911319+0000","last_became_peered":"2023-10-09T11:39:55.911319+0000","last_unstale":"2023-10-09T11:39:55.912214+0000","last_undegraded":"2023-10-09T11:39:55.912214+0000","last_fullsized":"2023-10-09T11:39:55.912214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:19:19.008544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912008+0000","last_change":"2023-10-09T11:39:55.911937+0000","last_active":"2023-10-09T11:39:55.912008+0000","last_peered":"2023-10-09T11:39:55.912008+0000","last_clean":"2023-10-09T11:39:55.912008+0000","last_became_active":"2023-10-09T11:39:55.911692+0000","last_became_peered":"2023-10-09T11:39:55.911692+0000","last_unstale":"2023-10-09T11:39:55.912008+0000","last_undegraded":"2023-10-09T11:39:55.912008+0000","last_fullsized":"2023-10-09T11:39:55.912008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:06.865641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912270+0000","last_change":"2023-10-09T11:39:55.909766+0000","last_active":"2023-10-09T11:39:55.912270+0000","last_peered":"2023-10-09T11:39:55.912270+0000","last_clean":"2023-10-09T11:39:55.912270+0000","last_became_active":"2023-10-09T11:39:55.909394+0000","last_became_peered":"2023-10-09T11:39:55.909394+0000","last_unstale":"2023-10-09T11:39:55.912270+0000","last_undegraded":"2023-10-09T11:39:55.912270+0000","last_fullsized":"2023-10-09T11:39:55.912270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:08:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915404+0000","last_change":"2023-10-09T11:39:55.915336+0000","last_active":"2023-10-09T11:39:55.915404+0000","last_peered":"2023-10-09T11:39:55.915404+0000","last_clean":"2023-10-09T11:39:55.915404+0000","last_became_active":"2023-10-09T11:39:55.915094+0000","last_became_peered":"2023-10-09T11:39:55.915094+0000","last_unstale":"2023-10-09T11:39:55.915404+0000","last_undegraded":"2023-10-09T11:39:55.915404+0000","last_fullsized":"2023-10-09T11:39:55.915404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:12.018259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906320+0000","last_change":"2023-10-09T11:39:55.905571+0000","last_active":"2023-10-09T11:39:55.906320+0000","last_peered":"2023-10-09T11:39:55.906320+0000","last_clean":"2023-10-09T11:39:55.906320+0000","last_became_active":"2023-10-09T11:39:55.905352+0000","last_became_peered":"2023-10-09T11:39:55.905352+0000","last_unstale":"2023-10-09T11:39:55.906320+0000","last_undegraded":"2023-10-09T11:39:55.906320+0000","last_fullsized":"2023-10-09T11:39:55.906320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:57.940035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.907847+0000","last_change":"2023-10-09T11:39:55.907783+0000","last_active":"2023-10-09T11:39:55.907847+0000","last_peered":"2023-10-09T11:39:55.907847+0000","last_clean":"2023-10-09T11:39:55.907847+0000","last_became_active":"2023-10-09T11:39:55.907537+0000","last_became_peered":"2023-10-09T11:39:55.907537+0000","last_unstale":"2023-10-09T11:39:55.907847+0000","last_undegraded":"2023-10-09T11:39:55.907847+0000","last_fullsized":"2023-10-09T11:39:55.907847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915809+0000","last_change":"2023-10-09T11:39:55.915651+0000","last_active":"2023-10-09T11:39:55.915809+0000","last_peered":"2023-10-09T11:39:55.915809+0000","last_clean":"2023-10-09T11:39:55.915809+0000","last_became_active":"2023-10-09T11:39:55.915402+0000","last_became_peered":"2023-10-09T11:39:55.915402+0000","last_unstale":"2023-10-09T11:39:55.915809+0000","last_undegraded":"2023-10-09T11:39:55.915809+0000","last_fullsized":"2023-10-09T11:39:55.915809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:20.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911393+0000","last_change":"2023-10-09T11:39:55.910811+0000","last_active":"2023-10-09T11:39:55.911393+0000","last_peered":"2023-10-09T11:39:55.911393+0000","last_clean":"2023-10-09T11:39:55.911393+0000","last_became_active":"2023-10-09T11:39:55.910304+0000","last_became_peered":"2023-10-09T11:39:55.910304+0000","last_unstale":"2023-10-09T11:39:55.911393+0000","last_undegraded":"2023-10-09T11:39:55.911393+0000","last_fullsized":"2023-10-09T11:39:55.911393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:34.502955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915876+0000","last_change":"2023-10-09T11:39:55.915819+0000","last_active":"2023-10-09T11:39:55.915876+0000","last_peered":"2023-10-09T11:39:55.915876+0000","last_clean":"2023-10-09T11:39:55.915876+0000","last_became_active":"2023-10-09T11:39:55.915684+0000","last_became_peered":"2023-10-09T11:39:55.915684+0000","last_unstale":"2023-10-09T11:39:55.915876+0000","last_undegraded":"2023-10-09T11:39:55.915876+0000","last_fullsized":"2023-10-09T11:39:55.915876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:04.425916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917750+0000","last_change":"2023-10-09T11:39:55.917405+0000","last_active":"2023-10-09T11:39:55.917750+0000","last_peered":"2023-10-09T11:39:55.917750+0000","last_clean":"2023-10-09T11:39:55.917750+0000","last_became_active":"2023-10-09T11:39:55.917051+0000","last_became_peered":"2023-10-09T11:39:55.917051+0000","last_unstale":"2023-10-09T11:39:55.917750+0000","last_undegraded":"2023-10-09T11:39:55.917750+0000","last_fullsized":"2023-10-09T11:39:55.917750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:16.659213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909828+0000","last_change":"2023-10-09T11:39:55.909417+0000","last_active":"2023-10-09T11:39:55.909828+0000","last_peered":"2023-10-09T11:39:55.909828+0000","last_clean":"2023-10-09T11:39:55.909828+0000","last_became_active":"2023-10-09T11:39:55.909176+0000","last_became_peered":"2023-10-09T11:39:55.909176+0000","last_unstale":"2023-10-09T11:39:55.909828+0000","last_undegraded":"2023-10-09T11:39:55.909828+0000","last_fullsized":"2023-10-09T11:39:55.909828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:36.965411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912200+0000","last_change":"2023-10-09T11:39:55.911209+0000","last_active":"2023-10-09T11:39:55.912200+0000","last_peered":"2023-10-09T11:39:55.912200+0000","last_clean":"2023-10-09T11:39:55.912200+0000","last_became_active":"2023-10-09T11:39:55.910466+0000","last_became_peered":"2023-10-09T11:39:55.910466+0000","last_unstale":"2023-10-09T11:39:55.912200+0000","last_undegraded":"2023-10-09T11:39:55.912200+0000","last_fullsized":"2023-10-09T11:39:55.912200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:51.971679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914194+0000","last_change":"2023-10-09T11:39:55.914125+0000","last_active":"2023-10-09T11:39:55.914194+0000","last_peered":"2023-10-09T11:39:55.914194+0000","last_clean":"2023-10-09T11:39:55.914194+0000","last_became_active":"2023-10-09T11:39:55.913646+0000","last_became_peered":"2023-10-09T11:39:55.913646+0000","last_unstale":"2023-10-09T11:39:55.914194+0000","last_undegraded":"2023-10-09T11:39:55.914194+0000","last_fullsized":"2023-10-09T11:39:55.914194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:11.916697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912370+0000","last_change":"2023-10-09T11:39:55.912285+0000","last_active":"2023-10-09T11:39:55.912370+0000","last_peered":"2023-10-09T11:39:55.912370+0000","last_clean":"2023-10-09T11:39:55.912370+0000","last_became_active":"2023-10-09T11:39:55.912052+0000","last_became_peered":"2023-10-09T11:39:55.912052+0000","last_unstale":"2023-10-09T11:39:55.912370+0000","last_undegraded":"2023-10-09T11:39:55.912370+0000","last_fullsized":"2023-10-09T11:39:55.912370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:57.186981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920382+0000","last_change":"2023-10-09T11:39:55.920331+0000","last_active":"2023-10-09T11:39:55.920382+0000","last_peered":"2023-10-09T11:39:55.920382+0000","last_clean":"2023-10-09T11:39:55.920382+0000","last_became_active":"2023-10-09T11:39:55.919954+0000","last_became_peered":"2023-10-09T11:39:55.919954+0000","last_unstale":"2023-10-09T11:39:55.920382+0000","last_undegraded":"2023-10-09T11:39:55.920382+0000","last_fullsized":"2023-10-09T11:39:55.920382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:25.584819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913852+0000","last_change":"2023-10-09T11:39:55.913784+0000","last_active":"2023-10-09T11:39:55.913852+0000","last_peered":"2023-10-09T11:39:55.913852+0000","last_clean":"2023-10-09T11:39:55.913852+0000","last_became_active":"2023-10-09T11:39:55.913532+0000","last_became_peered":"2023-10-09T11:39:55.913532+0000","last_unstale":"2023-10-09T11:39:55.913852+0000","last_undegraded":"2023-10-09T11:39:55.913852+0000","last_fullsized":"2023-10-09T11:39:55.913852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:46.525321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915493+0000","last_change":"2023-10-09T11:39:55.915365+0000","last_active":"2023-10-09T11:39:55.915493+0000","last_peered":"2023-10-09T11:39:55.915493+0000","last_clean":"2023-10-09T11:39:55.915493+0000","last_became_active":"2023-10-09T11:39:55.915149+0000","last_became_peered":"2023-10-09T11:39:55.915149+0000","last_unstale":"2023-10-09T11:39:55.915493+0000","last_undegraded":"2023-10-09T11:39:55.915493+0000","last_fullsized":"2023-10-09T11:39:55.915493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:47.093548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912846+0000","last_change":"2023-10-09T11:39:55.912791+0000","last_active":"2023-10-09T11:39:55.912846+0000","last_peered":"2023-10-09T11:39:55.912846+0000","last_clean":"2023-10-09T11:39:55.912846+0000","last_became_active":"2023-10-09T11:39:55.912578+0000","last_became_peered":"2023-10-09T11:39:55.912578+0000","last_unstale":"2023-10-09T11:39:55.912846+0000","last_undegraded":"2023-10-09T11:39:55.912846+0000","last_fullsized":"2023-10-09T11:39:55.912846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:57.442636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915440+0000","last_change":"2023-10-09T11:39:55.914832+0000","last_active":"2023-10-09T11:39:55.915440+0000","last_peered":"2023-10-09T11:39:55.915440+0000","last_clean":"2023-10-09T11:39:55.915440+0000","last_became_active":"2023-10-09T11:39:55.914570+0000","last_became_peered":"2023-10-09T11:39:55.914570+0000","last_unstale":"2023-10-09T11:39:55.915440+0000","last_undegraded":"2023-10-09T11:39:55.915440+0000","last_fullsized":"2023-10-09T11:39:55.915440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:20.747638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910574+0000","last_change":"2023-10-09T11:39:55.910386+0000","last_active":"2023-10-09T11:39:55.910574+0000","last_peered":"2023-10-09T11:39:55.910574+0000","last_clean":"2023-10-09T11:39:55.910574+0000","last_became_active":"2023-10-09T11:39:55.910151+0000","last_became_peered":"2023-10-09T11:39:55.910151+0000","last_unstale":"2023-10-09T11:39:55.910574+0000","last_undegraded":"2023-10-09T11:39:55.910574+0000","last_fullsized":"2023-10-09T11:39:55.910574+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:22.469628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913882+0000","last_change":"2023-10-09T11:39:55.913325+0000","last_active":"2023-10-09T11:39:55.913882+0000","last_peered":"2023-10-09T11:39:55.913882+0000","last_clean":"2023-10-09T11:39:55.913882+0000","last_became_active":"2023-10-09T11:39:55.913100+0000","last_became_peered":"2023-10-09T11:39:55.913100+0000","last_unstale":"2023-10-09T11:39:55.913882+0000","last_undegraded":"2023-10-09T11:39:55.913882+0000","last_fullsized":"2023-10-09T11:39:55.913882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:57.186981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906249+0000","last_change":"2023-10-09T11:39:55.906161+0000","last_active":"2023-10-09T11:39:55.906249+0000","last_peered":"2023-10-09T11:39:55.906249+0000","last_clean":"2023-10-09T11:39:55.906249+0000","last_became_active":"2023-10-09T11:39:55.905921+0000","last_became_peered":"2023-10-09T11:39:55.905921+0000","last_unstale":"2023-10-09T11:39:55.906249+0000","last_undegraded":"2023-10-09T11:39:55.906249+0000","last_fullsized":"2023-10-09T11:39:55.906249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:38.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917687+0000","last_change":"2023-10-09T11:39:55.916825+0000","last_active":"2023-10-09T11:39:55.917687+0000","last_peered":"2023-10-09T11:39:55.917687+0000","last_clean":"2023-10-09T11:39:55.917687+0000","last_became_active":"2023-10-09T11:39:55.916548+0000","last_became_peered":"2023-10-09T11:39:55.916548+0000","last_unstale":"2023-10-09T11:39:55.917687+0000","last_undegraded":"2023-10-09T11:39:55.917687+0000","last_fullsized":"2023-10-09T11:39:55.917687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:00:04.318503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920238+0000","last_change":"2023-10-09T11:39:55.920175+0000","last_active":"2023-10-09T11:39:55.920238+0000","last_peered":"2023-10-09T11:39:55.920238+0000","last_clean":"2023-10-09T11:39:55.920238+0000","last_became_active":"2023-10-09T11:39:55.919656+0000","last_became_peered":"2023-10-09T11:39:55.919656+0000","last_unstale":"2023-10-09T11:39:55.920238+0000","last_undegraded":"2023-10-09T11:39:55.920238+0000","last_fullsized":"2023-10-09T11:39:55.920238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:24.378274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166853+0000","last_change":"2023-10-09T11:39:55.169436+0000","last_active":"2023-10-09T11:39:56.166853+0000","last_peered":"2023-10-09T11:39:56.166853+0000","last_clean":"2023-10-09T11:39:56.166853+0000","last_became_active":"2023-10-09T11:39:55.168859+0000","last_became_peered":"2023-10-09T11:39:55.168859+0000","last_unstale":"2023-10-09T11:39:56.166853+0000","last_undegraded":"2023-10-09T11:39:56.166853+0000","last_fullsized":"2023-10-09T11:39:56.166853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:18.343121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908488+0000","last_change":"2023-10-09T11:39:55.908331+0000","last_active":"2023-10-09T11:39:55.908488+0000","last_peered":"2023-10-09T11:39:55.908488+0000","last_clean":"2023-10-09T11:39:55.908488+0000","last_became_active":"2023-10-09T11:39:55.907784+0000","last_became_peered":"2023-10-09T11:39:55.907784+0000","last_unstale":"2023-10-09T11:39:55.908488+0000","last_undegraded":"2023-10-09T11:39:55.908488+0000","last_fullsized":"2023-10-09T11:39:55.908488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:12.990945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.168423+0000","last_change":"2023-10-09T11:39:55.170014+0000","last_active":"2023-10-09T11:39:56.168423+0000","last_peered":"2023-10-09T11:39:56.168423+0000","last_clean":"2023-10-09T11:39:56.168423+0000","last_became_active":"2023-10-09T11:39:55.169763+0000","last_became_peered":"2023-10-09T11:39:55.169763+0000","last_unstale":"2023-10-09T11:39:56.168423+0000","last_undegraded":"2023-10-09T11:39:56.168423+0000","last_fullsized":"2023-10-09T11:39:56.168423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:40:10.907212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920032+0000","last_change":"2023-10-09T11:39:55.919975+0000","last_active":"2023-10-09T11:39:55.920032+0000","last_peered":"2023-10-09T11:39:55.920032+0000","last_clean":"2023-10-09T11:39:55.920032+0000","last_became_active":"2023-10-09T11:39:55.919775+0000","last_became_peered":"2023-10-09T11:39:55.919775+0000","last_unstale":"2023-10-09T11:39:55.920032+0000","last_undegraded":"2023-10-09T11:39:55.920032+0000","last_fullsized":"2023-10-09T11:39:55.920032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:51.971679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166925+0000","last_change":"2023-10-09T11:39:55.166823+0000","last_active":"2023-10-09T11:39:56.166925+0000","last_peered":"2023-10-09T11:39:56.166925+0000","last_clean":"2023-10-09T11:39:56.166925+0000","last_became_active":"2023-10-09T11:39:55.165821+0000","last_became_peered":"2023-10-09T11:39:55.165821+0000","last_unstale":"2023-10-09T11:39:56.166925+0000","last_undegraded":"2023-10-09T11:39:56.166925+0000","last_fullsized":"2023-10-09T11:39:56.166925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:36:29.193848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913180+0000","last_change":"2023-10-09T11:39:55.912613+0000","last_active":"2023-10-09T11:39:55.913180+0000","last_peered":"2023-10-09T11:39:55.913180+0000","last_clean":"2023-10-09T11:39:55.913180+0000","last_became_active":"2023-10-09T11:39:55.912377+0000","last_became_peered":"2023-10-09T11:39:55.912377+0000","last_unstale":"2023-10-09T11:39:55.913180+0000","last_undegraded":"2023-10-09T11:39:55.913180+0000","last_fullsized":"2023-10-09T11:39:55.913180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:13.853271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167686+0000","last_change":"2023-10-09T11:39:55.168253+0000","last_active":"2023-10-09T11:39:56.167686+0000","last_peered":"2023-10-09T11:39:56.167686+0000","last_clean":"2023-10-09T11:39:56.167686+0000","last_became_active":"2023-10-09T11:39:55.168033+0000","last_became_peered":"2023-10-09T11:39:55.168033+0000","last_unstale":"2023-10-09T11:39:56.167686+0000","last_undegraded":"2023-10-09T11:39:56.167686+0000","last_fullsized":"2023-10-09T11:39:56.167686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:26.981665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910359+0000","last_change":"2023-10-09T11:39:55.910197+0000","last_active":"2023-10-09T11:39:55.910359+0000","last_peered":"2023-10-09T11:39:55.910359+0000","last_clean":"2023-10-09T11:39:55.910359+0000","last_became_active":"2023-10-09T11:39:55.909889+0000","last_became_peered":"2023-10-09T11:39:55.909889+0000","last_unstale":"2023-10-09T11:39:55.910359+0000","last_undegraded":"2023-10-09T11:39:55.910359+0000","last_fullsized":"2023-10-09T11:39:55.910359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:13.853271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167079+0000","last_change":"2023-10-09T11:39:55.169376+0000","last_active":"2023-10-09T11:39:56.167079+0000","last_peered":"2023-10-09T11:39:56.167079+0000","last_clean":"2023-10-09T11:39:56.167079+0000","last_became_active":"2023-10-09T11:39:55.167365+0000","last_became_peered":"2023-10-09T11:39:55.167365+0000","last_unstale":"2023-10-09T11:39:56.167079+0000","last_undegraded":"2023-10-09T11:39:56.167079+0000","last_fullsized":"2023-10-09T11:39:56.167079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:43:05.856155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914342+0000","last_change":"2023-10-09T11:39:55.914282+0000","last_active":"2023-10-09T11:39:55.914342+0000","last_peered":"2023-10-09T11:39:55.914342+0000","last_clean":"2023-10-09T11:39:55.914342+0000","last_became_active":"2023-10-09T11:39:55.913912+0000","last_became_peered":"2023-10-09T11:39:55.913912+0000","last_unstale":"2023-10-09T11:39:55.914342+0000","last_undegraded":"2023-10-09T11:39:55.914342+0000","last_fullsized":"2023-10-09T11:39:55.914342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:19.352606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.165560+0000","last_change":"2023-10-09T11:39:55.165674+0000","last_active":"2023-10-09T11:39:56.165560+0000","last_peered":"2023-10-09T11:39:56.165560+0000","last_clean":"2023-10-09T11:39:56.165560+0000","last_became_active":"2023-10-09T11:39:55.165139+0000","last_became_peered":"2023-10-09T11:39:55.165139+0000","last_unstale":"2023-10-09T11:39:56.165560+0000","last_undegraded":"2023-10-09T11:39:56.165560+0000","last_fullsized":"2023-10-09T11:39:56.165560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:26.177498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.915633+0000","last_change":"2023-10-09T11:39:55.915557+0000","last_active":"2023-10-09T11:39:55.915633+0000","last_peered":"2023-10-09T11:39:55.915633+0000","last_clean":"2023-10-09T11:39:55.915633+0000","last_became_active":"2023-10-09T11:39:55.915141+0000","last_became_peered":"2023-10-09T11:39:55.915141+0000","last_unstale":"2023-10-09T11:39:55.915633+0000","last_undegraded":"2023-10-09T11:39:55.915633+0000","last_fullsized":"2023-10-09T11:39:55.915633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:25.927374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904086+0000","last_change":"2023-10-09T11:39:55.166277+0000","last_active":"2023-10-09T11:39:55.904086+0000","last_peered":"2023-10-09T11:39:55.904086+0000","last_clean":"2023-10-09T11:39:55.904086+0000","last_became_active":"2023-10-09T11:39:55.166081+0000","last_became_peered":"2023-10-09T11:39:55.166081+0000","last_unstale":"2023-10-09T11:39:55.904086+0000","last_undegraded":"2023-10-09T11:39:55.904086+0000","last_fullsized":"2023-10-09T11:39:55.904086+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:45.624584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910439+0000","last_change":"2023-10-09T11:39:55.910377+0000","last_active":"2023-10-09T11:39:55.910439+0000","last_peered":"2023-10-09T11:39:55.910439+0000","last_clean":"2023-10-09T11:39:55.910439+0000","last_became_active":"2023-10-09T11:39:55.910160+0000","last_became_peered":"2023-10-09T11:39:55.910160+0000","last_unstale":"2023-10-09T11:39:55.910439+0000","last_undegraded":"2023-10-09T11:39:55.910439+0000","last_fullsized":"2023-10-09T11:39:55.910439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:30.196354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.903504+0000","last_change":"2023-10-09T11:39:55.168944+0000","last_active":"2023-10-09T11:39:55.903504+0000","last_peered":"2023-10-09T11:39:55.903504+0000","last_clean":"2023-10-09T11:39:55.903504+0000","last_became_active":"2023-10-09T11:39:55.168725+0000","last_became_peered":"2023-10-09T11:39:55.168725+0000","last_unstale":"2023-10-09T11:39:55.903504+0000","last_undegraded":"2023-10-09T11:39:55.903504+0000","last_fullsized":"2023-10-09T11:39:55.903504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:23.625966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910708+0000","last_change":"2023-10-09T11:39:55.910614+0000","last_active":"2023-10-09T11:39:55.910708+0000","last_peered":"2023-10-09T11:39:55.910708+0000","last_clean":"2023-10-09T11:39:55.910708+0000","last_became_active":"2023-10-09T11:39:55.910241+0000","last_became_peered":"2023-10-09T11:39:55.910241+0000","last_unstale":"2023-10-09T11:39:55.910708+0000","last_undegraded":"2023-10-09T11:39:55.910708+0000","last_fullsized":"2023-10-09T11:39:55.910708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:55:24.378274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908790+0000","last_change":"2023-10-09T11:39:55.163796+0000","last_active":"2023-10-09T11:39:55.908790+0000","last_peered":"2023-10-09T11:39:55.908790+0000","last_clean":"2023-10-09T11:39:55.908790+0000","last_became_active":"2023-10-09T11:39:55.163245+0000","last_became_peered":"2023-10-09T11:39:55.163245+0000","last_unstale":"2023-10-09T11:39:55.908790+0000","last_undegraded":"2023-10-09T11:39:55.908790+0000","last_fullsized":"2023-10-09T11:39:55.908790+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:21.256891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.920091+0000","last_change":"2023-10-09T11:39:55.920029+0000","last_active":"2023-10-09T11:39:55.920091+0000","last_peered":"2023-10-09T11:39:55.920091+0000","last_clean":"2023-10-09T11:39:55.920091+0000","last_became_active":"2023-10-09T11:39:55.919740+0000","last_became_peered":"2023-10-09T11:39:55.919740+0000","last_unstale":"2023-10-09T11:39:55.920091+0000","last_undegraded":"2023-10-09T11:39:55.920091+0000","last_fullsized":"2023-10-09T11:39:55.920091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:17:47.093548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.907732+0000","last_change":"2023-10-09T11:39:55.170755+0000","last_active":"2023-10-09T11:39:55.907732+0000","last_peered":"2023-10-09T11:39:55.907732+0000","last_clean":"2023-10-09T11:39:55.907732+0000","last_became_active":"2023-10-09T11:39:55.170500+0000","last_became_peered":"2023-10-09T11:39:55.170500+0000","last_unstale":"2023-10-09T11:39:55.907732+0000","last_undegraded":"2023-10-09T11:39:55.907732+0000","last_fullsized":"2023-10-09T11:39:55.907732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:27.057332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918155+0000","last_change":"2023-10-09T11:39:55.918074+0000","last_active":"2023-10-09T11:39:55.918155+0000","last_peered":"2023-10-09T11:39:55.918155+0000","last_clean":"2023-10-09T11:39:55.918155+0000","last_became_active":"2023-10-09T11:39:55.917751+0000","last_became_peered":"2023-10-09T11:39:55.917751+0000","last_unstale":"2023-10-09T11:39:55.918155+0000","last_undegraded":"2023-10-09T11:39:55.918155+0000","last_fullsized":"2023-10-09T11:39:55.918155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:58.983737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.165952+0000","last_change":"2023-10-09T11:39:55.165738+0000","last_active":"2023-10-09T11:39:56.165952+0000","last_peered":"2023-10-09T11:39:56.165952+0000","last_clean":"2023-10-09T11:39:56.165952+0000","last_became_active":"2023-10-09T11:39:55.165300+0000","last_became_peered":"2023-10-09T11:39:55.165300+0000","last_unstale":"2023-10-09T11:39:56.165952+0000","last_undegraded":"2023-10-09T11:39:56.165952+0000","last_fullsized":"2023-10-09T11:39:56.165952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:46.479174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908514+0000","last_change":"2023-10-09T11:39:55.908444+0000","last_active":"2023-10-09T11:39:55.908514+0000","last_peered":"2023-10-09T11:39:55.908514+0000","last_clean":"2023-10-09T11:39:55.908514+0000","last_became_active":"2023-10-09T11:39:55.908106+0000","last_became_peered":"2023-10-09T11:39:55.908106+0000","last_unstale":"2023-10-09T11:39:55.908514+0000","last_undegraded":"2023-10-09T11:39:55.908514+0000","last_fullsized":"2023-10-09T11:39:55.908514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:02.031702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.168123+0000","last_change":"2023-10-09T11:39:55.168380+0000","last_active":"2023-10-09T11:39:56.168123+0000","last_peered":"2023-10-09T11:39:56.168123+0000","last_clean":"2023-10-09T11:39:56.168123+0000","last_became_active":"2023-10-09T11:39:55.168133+0000","last_became_peered":"2023-10-09T11:39:55.168133+0000","last_unstale":"2023-10-09T11:39:56.168123+0000","last_undegraded":"2023-10-09T11:39:56.168123+0000","last_fullsized":"2023-10-09T11:39:56.168123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:13:10.255630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914186+0000","last_change":"2023-10-09T11:39:55.914034+0000","last_active":"2023-10-09T11:39:55.914186+0000","last_peered":"2023-10-09T11:39:55.914186+0000","last_clean":"2023-10-09T11:39:55.914186+0000","last_became_active":"2023-10-09T11:39:55.913642+0000","last_became_peered":"2023-10-09T11:39:55.913642+0000","last_unstale":"2023-10-09T11:39:55.914186+0000","last_undegraded":"2023-10-09T11:39:55.914186+0000","last_fullsized":"2023-10-09T11:39:55.914186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:47.609335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.166269+0000","last_change":"2023-10-09T11:39:55.169068+0000","last_active":"2023-10-09T11:39:56.166269+0000","last_peered":"2023-10-09T11:39:56.166269+0000","last_clean":"2023-10-09T11:39:56.166269+0000","last_became_active":"2023-10-09T11:39:55.168829+0000","last_became_peered":"2023-10-09T11:39:55.168829+0000","last_unstale":"2023-10-09T11:39:56.166269+0000","last_undegraded":"2023-10-09T11:39:56.166269+0000","last_fullsized":"2023-10-09T11:39:56.166269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:49.368443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.909726+0000","last_change":"2023-10-09T11:39:55.909492+0000","last_active":"2023-10-09T11:39:55.909726+0000","last_peered":"2023-10-09T11:39:55.909726+0000","last_clean":"2023-10-09T11:39:55.909726+0000","last_became_active":"2023-10-09T11:39:55.909237+0000","last_became_peered":"2023-10-09T11:39:55.909237+0000","last_unstale":"2023-10-09T11:39:55.909726+0000","last_undegraded":"2023-10-09T11:39:55.909726+0000","last_fullsized":"2023-10-09T11:39:55.909726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:20.545022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911243+0000","last_change":"2023-10-09T11:39:55.171867+0000","last_active":"2023-10-09T11:39:55.911243+0000","last_peered":"2023-10-09T11:39:55.911243+0000","last_clean":"2023-10-09T11:39:55.911243+0000","last_became_active":"2023-10-09T11:39:55.171100+0000","last_became_peered":"2023-10-09T11:39:55.171100+0000","last_unstale":"2023-10-09T11:39:55.911243+0000","last_undegraded":"2023-10-09T11:39:55.911243+0000","last_fullsized":"2023-10-09T11:39:55.911243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:08:04.960271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.918180+0000","last_change":"2023-10-09T11:39:55.918111+0000","last_active":"2023-10-09T11:39:55.918180+0000","last_peered":"2023-10-09T11:39:55.918180+0000","last_clean":"2023-10-09T11:39:55.918180+0000","last_became_active":"2023-10-09T11:39:55.917915+0000","last_became_peered":"2023-10-09T11:39:55.917915+0000","last_unstale":"2023-10-09T11:39:55.918180+0000","last_undegraded":"2023-10-09T11:39:55.918180+0000","last_fullsized":"2023-10-09T11:39:55.918180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:14.003883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904778+0000","last_change":"2023-10-09T11:39:55.167299+0000","last_active":"2023-10-09T11:39:55.904778+0000","last_peered":"2023-10-09T11:39:55.904778+0000","last_clean":"2023-10-09T11:39:55.904778+0000","last_became_active":"2023-10-09T11:39:55.166553+0000","last_became_peered":"2023-10-09T11:39:55.166553+0000","last_unstale":"2023-10-09T11:39:55.904778+0000","last_undegraded":"2023-10-09T11:39:55.904778+0000","last_fullsized":"2023-10-09T11:39:55.904778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:22.041652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911364+0000","last_change":"2023-10-09T11:39:55.910667+0000","last_active":"2023-10-09T11:39:55.911364+0000","last_peered":"2023-10-09T11:39:55.911364+0000","last_clean":"2023-10-09T11:39:55.911364+0000","last_became_active":"2023-10-09T11:39:55.909993+0000","last_became_peered":"2023-10-09T11:39:55.909993+0000","last_unstale":"2023-10-09T11:39:55.911364+0000","last_undegraded":"2023-10-09T11:39:55.911364+0000","last_fullsized":"2023-10-09T11:39:55.911364+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:16.289080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.169301+0000","last_change":"2023-10-09T11:39:55.168591+0000","last_active":"2023-10-09T11:39:56.169301+0000","last_peered":"2023-10-09T11:39:56.169301+0000","last_clean":"2023-10-09T11:39:56.169301+0000","last_became_active":"2023-10-09T11:39:55.168359+0000","last_became_peered":"2023-10-09T11:39:55.168359+0000","last_unstale":"2023-10-09T11:39:56.169301+0000","last_undegraded":"2023-10-09T11:39:56.169301+0000","last_fullsized":"2023-10-09T11:39:56.169301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:30:36.075065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912226+0000","last_change":"2023-10-09T11:39:55.912148+0000","last_active":"2023-10-09T11:39:55.912226+0000","last_peered":"2023-10-09T11:39:55.912226+0000","last_clean":"2023-10-09T11:39:55.912226+0000","last_became_active":"2023-10-09T11:39:55.911799+0000","last_became_peered":"2023-10-09T11:39:55.911799+0000","last_unstale":"2023-10-09T11:39:55.912226+0000","last_undegraded":"2023-10-09T11:39:55.912226+0000","last_fullsized":"2023-10-09T11:39:55.912226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:13.608989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167381+0000","last_change":"2023-10-09T11:39:55.168310+0000","last_active":"2023-10-09T11:39:56.167381+0000","last_peered":"2023-10-09T11:39:56.167381+0000","last_clean":"2023-10-09T11:39:56.167381+0000","last_became_active":"2023-10-09T11:39:55.167377+0000","last_became_peered":"2023-10-09T11:39:55.167377+0000","last_unstale":"2023-10-09T11:39:56.167381+0000","last_undegraded":"2023-10-09T11:39:56.167381+0000","last_fullsized":"2023-10-09T11:39:56.167381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:32.144122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913216+0000","last_change":"2023-10-09T11:39:55.913119+0000","last_active":"2023-10-09T11:39:55.913216+0000","last_peered":"2023-10-09T11:39:55.913216+0000","last_clean":"2023-10-09T11:39:55.913216+0000","last_became_active":"2023-10-09T11:39:55.912871+0000","last_became_peered":"2023-10-09T11:39:55.912871+0000","last_unstale":"2023-10-09T11:39:55.913216+0000","last_undegraded":"2023-10-09T11:39:55.913216+0000","last_fullsized":"2023-10-09T11:39:55.913216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:20.545022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167147+0000","last_change":"2023-10-09T11:39:55.166980+0000","last_active":"2023-10-09T11:39:56.167147+0000","last_peered":"2023-10-09T11:39:56.167147+0000","last_clean":"2023-10-09T11:39:56.167147+0000","last_became_active":"2023-10-09T11:39:55.166151+0000","last_became_peered":"2023-10-09T11:39:55.166151+0000","last_unstale":"2023-10-09T11:39:56.167147+0000","last_undegraded":"2023-10-09T11:39:56.167147+0000","last_fullsized":"2023-10-09T11:39:56.167147+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:28:37.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912260+0000","last_change":"2023-10-09T11:39:55.909623+0000","last_active":"2023-10-09T11:39:55.912260+0000","last_peered":"2023-10-09T11:39:55.912260+0000","last_clean":"2023-10-09T11:39:55.912260+0000","last_became_active":"2023-10-09T11:39:55.909106+0000","last_became_peered":"2023-10-09T11:39:55.909106+0000","last_unstale":"2023-10-09T11:39:55.912260+0000","last_undegraded":"2023-10-09T11:39:55.912260+0000","last_fullsized":"2023-10-09T11:39:55.912260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:56.969515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167569+0000","last_change":"2023-10-09T11:39:55.170221+0000","last_active":"2023-10-09T11:39:56.167569+0000","last_peered":"2023-10-09T11:39:56.167569+0000","last_clean":"2023-10-09T11:39:56.167569+0000","last_became_active":"2023-10-09T11:39:55.169988+0000","last_became_peered":"2023-10-09T11:39:55.169988+0000","last_unstale":"2023-10-09T11:39:56.167569+0000","last_undegraded":"2023-10-09T11:39:56.167569+0000","last_fullsized":"2023-10-09T11:39:56.167569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:55.960029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911304+0000","last_change":"2023-10-09T11:39:55.910509+0000","last_active":"2023-10-09T11:39:55.911304+0000","last_peered":"2023-10-09T11:39:55.911304+0000","last_clean":"2023-10-09T11:39:55.911304+0000","last_became_active":"2023-10-09T11:39:55.910259+0000","last_became_peered":"2023-10-09T11:39:55.910259+0000","last_unstale":"2023-10-09T11:39:55.911304+0000","last_undegraded":"2023-10-09T11:39:55.911304+0000","last_fullsized":"2023-10-09T11:39:55.911304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:06.117368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906969+0000","last_change":"2023-10-09T11:39:55.171868+0000","last_active":"2023-10-09T11:39:55.906969+0000","last_peered":"2023-10-09T11:39:55.906969+0000","last_clean":"2023-10-09T11:39:55.906969+0000","last_became_active":"2023-10-09T11:39:55.171637+0000","last_became_peered":"2023-10-09T11:39:55.171637+0000","last_unstale":"2023-10-09T11:39:55.906969+0000","last_undegraded":"2023-10-09T11:39:55.906969+0000","last_fullsized":"2023-10-09T11:39:55.906969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:47:20.222643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.913065+0000","last_change":"2023-10-09T11:39:55.913008+0000","last_active":"2023-10-09T11:39:55.913065+0000","last_peered":"2023-10-09T11:39:55.913065+0000","last_clean":"2023-10-09T11:39:55.913065+0000","last_became_active":"2023-10-09T11:39:55.912776+0000","last_became_peered":"2023-10-09T11:39:55.912776+0000","last_unstale":"2023-10-09T11:39:55.913065+0000","last_undegraded":"2023-10-09T11:39:55.913065+0000","last_fullsized":"2023-10-09T11:39:55.913065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:16:43.914721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911461+0000","last_change":"2023-10-09T11:39:55.167022+0000","last_active":"2023-10-09T11:39:55.911461+0000","last_peered":"2023-10-09T11:39:55.911461+0000","last_clean":"2023-10-09T11:39:55.911461+0000","last_became_active":"2023-10-09T11:39:55.166789+0000","last_became_peered":"2023-10-09T11:39:55.166789+0000","last_unstale":"2023-10-09T11:39:55.911461+0000","last_undegraded":"2023-10-09T11:39:55.911461+0000","last_fullsized":"2023-10-09T11:39:55.911461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:28.847807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914846+0000","last_change":"2023-10-09T11:39:55.914769+0000","last_active":"2023-10-09T11:39:55.914846+0000","last_peered":"2023-10-09T11:39:55.914846+0000","last_clean":"2023-10-09T11:39:55.914846+0000","last_became_active":"2023-10-09T11:39:55.914569+0000","last_became_peered":"2023-10-09T11:39:55.914569+0000","last_unstale":"2023-10-09T11:39:55.914846+0000","last_undegraded":"2023-10-09T11:39:55.914846+0000","last_fullsized":"2023-10-09T11:39:55.914846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:26:39.235820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904655+0000","last_change":"2023-10-09T11:39:55.160658+0000","last_active":"2023-10-09T11:39:55.904655+0000","last_peered":"2023-10-09T11:39:55.904655+0000","last_clean":"2023-10-09T11:39:55.904655+0000","last_became_active":"2023-10-09T11:39:55.160443+0000","last_became_peered":"2023-10-09T11:39:55.160443+0000","last_unstale":"2023-10-09T11:39:55.904655+0000","last_undegraded":"2023-10-09T11:39:55.904655+0000","last_fullsized":"2023-10-09T11:39:55.904655+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:50.035557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914991+0000","last_change":"2023-10-09T11:39:55.914932+0000","last_active":"2023-10-09T11:39:55.914991+0000","last_peered":"2023-10-09T11:39:55.914991+0000","last_clean":"2023-10-09T11:39:55.914991+0000","last_became_active":"2023-10-09T11:39:55.914699+0000","last_became_peered":"2023-10-09T11:39:55.914699+0000","last_unstale":"2023-10-09T11:39:55.914991+0000","last_undegraded":"2023-10-09T11:39:55.914991+0000","last_fullsized":"2023-10-09T11:39:55.914991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:09.511874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.905506+0000","last_change":"2023-10-09T11:39:55.170767+0000","last_active":"2023-10-09T11:39:55.905506+0000","last_peered":"2023-10-09T11:39:55.905506+0000","last_clean":"2023-10-09T11:39:55.905506+0000","last_became_active":"2023-10-09T11:39:55.170529+0000","last_became_peered":"2023-10-09T11:39:55.170529+0000","last_unstale":"2023-10-09T11:39:55.905506+0000","last_undegraded":"2023-10-09T11:39:55.905506+0000","last_fullsized":"2023-10-09T11:39:55.905506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:01:45.515836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908750+0000","last_change":"2023-10-09T11:39:55.908676+0000","last_active":"2023-10-09T11:39:55.908750+0000","last_peered":"2023-10-09T11:39:55.908750+0000","last_clean":"2023-10-09T11:39:55.908750+0000","last_became_active":"2023-10-09T11:39:55.908469+0000","last_became_peered":"2023-10-09T11:39:55.908469+0000","last_unstale":"2023-10-09T11:39:55.908750+0000","last_undegraded":"2023-10-09T11:39:55.908750+0000","last_fullsized":"2023-10-09T11:39:55.908750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:13:11.139725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167375+0000","last_change":"2023-10-09T11:39:55.164852+0000","last_active":"2023-10-09T11:39:56.167375+0000","last_peered":"2023-10-09T11:39:56.167375+0000","last_clean":"2023-10-09T11:39:56.167375+0000","last_became_active":"2023-10-09T11:39:55.164583+0000","last_became_peered":"2023-10-09T11:39:55.164583+0000","last_unstale":"2023-10-09T11:39:56.167375+0000","last_undegraded":"2023-10-09T11:39:56.167375+0000","last_fullsized":"2023-10-09T11:39:56.167375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:29.453485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910689+0000","last_change":"2023-10-09T11:39:55.910465+0000","last_active":"2023-10-09T11:39:55.910689+0000","last_peered":"2023-10-09T11:39:55.910689+0000","last_clean":"2023-10-09T11:39:55.910689+0000","last_became_active":"2023-10-09T11:39:55.909936+0000","last_became_peered":"2023-10-09T11:39:55.909936+0000","last_unstale":"2023-10-09T11:39:55.910689+0000","last_undegraded":"2023-10-09T11:39:55.910689+0000","last_fullsized":"2023-10-09T11:39:55.910689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:25.584819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904524+0000","last_change":"2023-10-09T11:39:55.166361+0000","last_active":"2023-10-09T11:39:55.904524+0000","last_peered":"2023-10-09T11:39:55.904524+0000","last_clean":"2023-10-09T11:39:55.904524+0000","last_became_active":"2023-10-09T11:39:55.166033+0000","last_became_peered":"2023-10-09T11:39:55.166033+0000","last_unstale":"2023-10-09T11:39:55.904524+0000","last_undegraded":"2023-10-09T11:39:55.904524+0000","last_fullsized":"2023-10-09T11:39:55.904524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:56.346223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.919583+0000","last_change":"2023-10-09T11:39:55.919509+0000","last_active":"2023-10-09T11:39:55.919583+0000","last_peered":"2023-10-09T11:39:55.919583+0000","last_clean":"2023-10-09T11:39:55.919583+0000","last_became_active":"2023-10-09T11:39:55.919358+0000","last_became_peered":"2023-10-09T11:39:55.919358+0000","last_unstale":"2023-10-09T11:39:55.919583+0000","last_undegraded":"2023-10-09T11:39:55.919583+0000","last_fullsized":"2023-10-09T11:39:55.919583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:12:48.018983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.903598+0000","last_change":"2023-10-09T11:39:55.167577+0000","last_active":"2023-10-09T11:39:55.903598+0000","last_peered":"2023-10-09T11:39:55.903598+0000","last_clean":"2023-10-09T11:39:55.903598+0000","last_became_active":"2023-10-09T11:39:55.167105+0000","last_became_peered":"2023-10-09T11:39:55.167105+0000","last_unstale":"2023-10-09T11:39:55.903598+0000","last_undegraded":"2023-10-09T11:39:55.903598+0000","last_fullsized":"2023-10-09T11:39:55.903598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:49:31.829889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.910013+0000","last_change":"2023-10-09T11:39:55.909754+0000","last_active":"2023-10-09T11:39:55.910013+0000","last_peered":"2023-10-09T11:39:55.910013+0000","last_clean":"2023-10-09T11:39:55.910013+0000","last_became_active":"2023-10-09T11:39:55.909089+0000","last_became_peered":"2023-10-09T11:39:55.909089+0000","last_unstale":"2023-10-09T11:39:55.910013+0000","last_undegraded":"2023-10-09T11:39:55.910013+0000","last_fullsized":"2023-10-09T11:39:55.910013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:47.488659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.906206+0000","last_change":"2023-10-09T11:39:55.163873+0000","last_active":"2023-10-09T11:39:55.906206+0000","last_peered":"2023-10-09T11:39:55.906206+0000","last_clean":"2023-10-09T11:39:55.906206+0000","last_became_active":"2023-10-09T11:39:55.163633+0000","last_became_peered":"2023-10-09T11:39:55.163633+0000","last_unstale":"2023-10-09T11:39:55.906206+0000","last_undegraded":"2023-10-09T11:39:55.906206+0000","last_fullsized":"2023-10-09T11:39:55.906206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:53:19.738153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911322+0000","last_change":"2023-10-09T11:39:55.910530+0000","last_active":"2023-10-09T11:39:55.911322+0000","last_peered":"2023-10-09T11:39:55.911322+0000","last_clean":"2023-10-09T11:39:55.911322+0000","last_became_active":"2023-10-09T11:39:55.909698+0000","last_became_peered":"2023-10-09T11:39:55.909698+0000","last_unstale":"2023-10-09T11:39:55.911322+0000","last_undegraded":"2023-10-09T11:39:55.911322+0000","last_fullsized":"2023-10-09T11:39:55.911322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:53.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.902796+0000","last_change":"2023-10-09T11:39:55.160472+0000","last_active":"2023-10-09T11:39:55.902796+0000","last_peered":"2023-10-09T11:39:55.902796+0000","last_clean":"2023-10-09T11:39:55.902796+0000","last_became_active":"2023-10-09T11:39:55.160219+0000","last_became_peered":"2023-10-09T11:39:55.160219+0000","last_unstale":"2023-10-09T11:39:55.902796+0000","last_undegraded":"2023-10-09T11:39:55.902796+0000","last_fullsized":"2023-10-09T11:39:55.902796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:10.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.921295+0000","last_change":"2023-10-09T11:39:55.921245+0000","last_active":"2023-10-09T11:39:55.921295+0000","last_peered":"2023-10-09T11:39:55.921295+0000","last_clean":"2023-10-09T11:39:55.921295+0000","last_became_active":"2023-10-09T11:39:55.920971+0000","last_became_peered":"2023-10-09T11:39:55.920971+0000","last_unstale":"2023-10-09T11:39:55.921295+0000","last_undegraded":"2023-10-09T11:39:55.921295+0000","last_fullsized":"2023-10-09T11:39:55.921295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:18.381546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.904353+0000","last_change":"2023-10-09T11:39:55.167680+0000","last_active":"2023-10-09T11:39:55.904353+0000","last_peered":"2023-10-09T11:39:55.904353+0000","last_clean":"2023-10-09T11:39:55.904353+0000","last_became_active":"2023-10-09T11:39:55.167456+0000","last_became_peered":"2023-10-09T11:39:55.167456+0000","last_unstale":"2023-10-09T11:39:55.904353+0000","last_undegraded":"2023-10-09T11:39:55.904353+0000","last_fullsized":"2023-10-09T11:39:55.904353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:22.916959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.912302+0000","last_change":"2023-10-09T11:39:55.910422+0000","last_active":"2023-10-09T11:39:55.912302+0000","last_peered":"2023-10-09T11:39:55.912302+0000","last_clean":"2023-10-09T11:39:55.912302+0000","last_became_active":"2023-10-09T11:39:55.910212+0000","last_became_peered":"2023-10-09T11:39:55.910212+0000","last_unstale":"2023-10-09T11:39:55.912302+0000","last_undegraded":"2023-10-09T11:39:55.912302+0000","last_fullsized":"2023-10-09T11:39:55.912302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:27.991151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908970+0000","last_change":"2023-10-09T11:39:55.170293+0000","last_active":"2023-10-09T11:39:55.908970+0000","last_peered":"2023-10-09T11:39:55.908970+0000","last_clean":"2023-10-09T11:39:55.908970+0000","last_became_active":"2023-10-09T11:39:55.170067+0000","last_became_peered":"2023-10-09T11:39:55.170067+0000","last_unstale":"2023-10-09T11:39:55.908970+0000","last_undegraded":"2023-10-09T11:39:55.908970+0000","last_fullsized":"2023-10-09T11:39:55.908970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:17.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.917708+0000","last_change":"2023-10-09T11:39:55.917245+0000","last_active":"2023-10-09T11:39:55.917708+0000","last_peered":"2023-10-09T11:39:55.917708+0000","last_clean":"2023-10-09T11:39:55.917708+0000","last_became_active":"2023-10-09T11:39:55.916264+0000","last_became_peered":"2023-10-09T11:39:55.916264+0000","last_unstale":"2023-10-09T11:39:55.917708+0000","last_undegraded":"2023-10-09T11:39:55.917708+0000","last_fullsized":"2023-10-09T11:39:55.917708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:15.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.911575+0000","last_change":"2023-10-09T11:39:55.168988+0000","last_active":"2023-10-09T11:39:55.911575+0000","last_peered":"2023-10-09T11:39:55.911575+0000","last_clean":"2023-10-09T11:39:55.911575+0000","last_became_active":"2023-10-09T11:39:55.168536+0000","last_became_peered":"2023-10-09T11:39:55.168536+0000","last_unstale":"2023-10-09T11:39:55.911575+0000","last_undegraded":"2023-10-09T11:39:55.911575+0000","last_fullsized":"2023-10-09T11:39:55.911575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:45.624584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.914863+0000","last_change":"2023-10-09T11:39:55.914796+0000","last_active":"2023-10-09T11:39:55.914863+0000","last_peered":"2023-10-09T11:39:55.914863+0000","last_clean":"2023-10-09T11:39:55.914863+0000","last_became_active":"2023-10-09T11:39:55.914545+0000","last_became_peered":"2023-10-09T11:39:55.914545+0000","last_unstale":"2023-10-09T11:39:55.914863+0000","last_undegraded":"2023-10-09T11:39:55.914863+0000","last_fullsized":"2023-10-09T11:39:55.914863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:55.150485+0000","last_clean_scrub_stamp":"2023-10-09T11:39:55.150485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:06.067819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:56.167664+0000","last_change":"2023-10-09T11:39:55.167987+0000","last_active":"2023-10-09T11:39:56.167664+0000","last_peered":"2023-10-09T11:39:56.167664+0000","last_clean":"2023-10-09T11:39:56.167664+0000","last_became_active":"2023-10-09T11:39:55.167703+0000","last_became_peered":"2023-10-09T11:39:55.167703+0000","last_unstale":"2023-10-09T11:39:56.167664+0000","last_undegraded":"2023-10-09T11:39:56.167664+0000","last_fullsized":"2023-10-09T11:39:56.167664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:39:54.141000+0000","last_clean_scrub_stamp":"2023-10-09T11:39:54.141000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:01.576909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":213,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-09T11:39:55.908156+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:39:55.908156+0000","last_peered":"2023-10-09T11:39:55.908156+0000","last_clean":"2023-10-09T11:39:55.908156+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:39:55.908156+0000","last_undegraded":"2023-10-09T11:39:55.908156+0000","last_fullsized":"2023-10-09T11:39:55.908156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194323,"statfs":{"total":200000000,"available":198987364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.745,"15min":0.745},"last":0.495},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.32700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56000000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.46899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.878,"15min":0.878},"last":0.69299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":1.048,"15min":1.048},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":1.079,"15min":1.079},"last":0.66200000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54400000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578228,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.63},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.504}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.621,"15min":0.70099999999999996},"min":{"1min":0.39000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":5.298,"15min":5.298},"last":0.437},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60999999999999999,"15min":0.68600000000000005},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":1.617,"15min":1.617},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63400000000000001,"15min":0.71199999999999997},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":5.46,"15min":5.46},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.73399999999999999},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.32600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60499999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48099999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56599999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199576196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38500000000000001,"15min":0.40699999999999997},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.59499999999999997,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.45500000000000002},"min":{"1min":0.28899999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":2.004,"15min":2.004},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.30199999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.64000000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77000000000000002,"5min":1.909,"15min":1.909},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.78200000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.622,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.496},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.869,"15min":1.869},"last":0.45800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.497,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91400000000000003,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66700000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92200000000000004,"5min":1.952,"15min":1.952},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.878,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.44400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.83399999999999996,"5min":1.782,"15min":1.782},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98099999999999998,"5min":1.819,"15min":1.819},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194325,"statfs":{"total":200000000,"available":198988963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.23400000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53500000000000003,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.435},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.51700000000000002,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41699999999999998},"min":{"1min":0.25,"5min":0.223,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61499999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.46999999999999997,"15min":0.51600000000000001},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.48999999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.46600000000000003},"min":{"1min":0.34499999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.40200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93000000000000005,"5min":1.282,"15min":1.282},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.67100000000000004,"15min":0.70899999999999996},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76800000000000002,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.67200000000000004,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82399999999999995,"5min":3.976,"15min":3.976},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98599999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0209999999999999,"5min":1.524,"15min":1.524},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":1.254,"15min":1.254},"last":0.84799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.012,"5min":1.22,"15min":1.22},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194899,"statfs":{"total":200000000,"available":199576784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.251},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34100000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.31}]},{"osd":1,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33200000000000002},"min":{"1min":0.26800000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51100000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.74399999999999999,"15min":0.89400000000000002},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56899999999999995,"5min":11.055,"15min":11.055},"last":0.35799999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36299999999999999},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.34300000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.51500000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86199999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84899999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.378},"min":{"1min":0.24099999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.53200000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39700000000000002},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53800000000000003,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.314}]},{"osd":1,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.371,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.45900000000000002,"5min":1.034,"15min":1.034},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.50600000000000001,"5min":1.335,"15min":1.335},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.311,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57499999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56499999999999995,"5min":1.405,"15min":1.405},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75900000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.63300000000000001,"15min":0.64700000000000002},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86599999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194906,"statfs":{"total":200000000,"available":199584538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":0.79500000000000004},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72599999999999998,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.76200000000000001,"15min":0.84999999999999998},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.67200000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54400000000000004,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71599999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.376,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.67100000000000004,"15min":0.73299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":5.274,"15min":5.274},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.76700000000000002,"15min":0.84999999999999998},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.78200000000000003,"15min":0.87},"min":{"1min":0.45700000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.317,"5min":0.307,"15min":0.307},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67200000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.502,"15min":0.503},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.498},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":411,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.68100000000000005,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.438},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.5},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.38200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68300000000000005,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77600000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70299999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79400000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63}]},{"osd":4,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42899999999999999,"15min":0.435},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47799999999999998,"15min":0.49199999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.504,"15min":0.51200000000000001},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.80900000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-09T11:40:00.658 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:40:00.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:40:00.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.817+0000 7fc3ff1c4700 1 Processor -- start 2023-10-09T11:40:00.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.817+0000 7fc3ff1c4700 1 -- start start 2023-10-09T11:40:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3ff1c4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc3f80b29d0 0x7fc3f8164c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3ff1c4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f8068d40 con 0x7fc3f80b1ef0 2023-10-09T11:40:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3ff1c4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f806a1e0 con 0x7fc3f806f4f0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3ff1c4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f815a520 con 0x7fc3f80b29d0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fe1c2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc3f80b1ef0 0x7fc3f806da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55606/0 (socket says 172.21.15.6:55606) 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fe1c2700 1 -- 172.21.15.6:0/2464553213 learned_addr learned my addr 172.21.15.6:0/2464553213 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fe9c3700 1 --2- 172.21.15.6:0/2464553213 >> v2:172.21.15.118:3300/0 conn(0x7fc3f80b29d0 0x7fc3f8164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638664344 0 0) 0x7fc3f8068d40 con 0x7fc3f80b1ef0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e0003570 con 0x7fc3f80b1ef0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264311782 0 0) 0x7fc3f806a1e0 con 0x7fc3f806f4f0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f8068d40 con 0x7fc3f806f4f0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/2464553213 >> v1:172.21.15.118:6789/0 conn(0x7fc3f806f4f0 legacy=0x7fc3f80b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.818+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/2464553213 >> v1:172.21.15.6:6789/0 conn(0x7fc3f80b1ef0 legacy=0x7fc3f806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/2464553213 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f806e2d0 con 0x7fc3f80b29d0 2023-10-09T11:40:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3fe9c3700 1 --2- 172.21.15.6:0/2464553213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b29d0 0x7fc3f8164c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e60 tx=0x7fc3e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101c7f82bd7cf566 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800e070 con 0x7fc3f80b29d0 2023-10-09T11:40:00.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800bab0 con 0x7fc3f80b29d0 2023-10-09T11:40:00.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3fd1c0700 1 -- 172.21.15.6:0/2464553213 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800be70 con 0x7fc3f80b29d0 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/2464553213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b29d0 msgr2=0x7fc3f8164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/2464553213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b29d0 0x7fc3f8164c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e60 tx=0x7fc3e8009780 comp rx=0 tx=0).stop 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/2464553213 shutdown_connections 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/2464553213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b29d0 0x7fc3f8164c00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/2464553213 >> 172.21.15.6:0/2464553213 conn(0x7fc3f80d0bb0 msgr2=0x7fc3f80d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/2464553213 shutdown_connections 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.819+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/2464553213 wait complete. 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.820+0000 7fc3ff1c4700 1 Processor -- start 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 -- start start 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f806f4f0 0x7fc3f8151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 0x7fc3f814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f8153150 con 0x7fc3f80b29d0 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f81522f0 con 0x7fc3f80b1ef0 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3ff1c4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f814eec0 con 0x7fc3f806f4f0 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3fe9c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3fe9c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40934/0 (socket says 172.21.15.6:40934) 2023-10-09T11:40:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.821+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/3787078789 learned_addr learned my addr 172.21.15.6:0/3787078789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe1c2700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f806f4f0 0x7fc3f8151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fd9c1700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 0x7fc3f814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f806f4f0 msgr2=0x7fc3f8151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f806f4f0 0x7fc3f8151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 msgr2=0x7fc3f814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 0x7fc3f814e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 -- 172.21.15.6:0/3787078789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8009a20 con 0x7fc3f80b29d0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fd9c1700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 0x7fc3f814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3fe9c3700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800b610 tx=0x7fc3e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8026480 con 0x7fc3f80b29d0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8026600 con 0x7fc3f80b29d0 2023-10-09T11:40:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8152540 con 0x7fc3f80b29d0 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80269c0 con 0x7fc3f80b29d0 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.822+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f8152b00 con 0x7fc3f80b29d0 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.823+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f8067b70 con 0x7fc3f80b29d0 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.823+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3e801c400 con 0x7fc3f80b29d0 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.824+0000 7fc3f67fc700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:00.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.824+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3e8086870 con 0x7fc3f80b29d0 2023-10-09T11:40:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.824+0000 7fc3fe1c2700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:00.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.824+0000 7fc3fe1c2700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0007fd0 tx=0x7fc3f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:00.828+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3e8053ae0 con 0x7fc3f80b29d0 2023-10-09T11:40:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.102+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc3f8071b10 con 0x7fc3f80b29d0 2023-10-09T11:40:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.106+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3787078789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc3e8057100 con 0x7fc3f80b29d0 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 msgr2=0x7fc3e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 0x7fc3e40693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0007fd0 tx=0x7fc3f0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 msgr2=0x7fc3f814fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800b610 tx=0x7fc3e8019000 comp rx=0 tx=0).stop 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 shutdown_connections 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3e4066f30 0x7fc3e40693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80b29d0 0x7fc3f814fea0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f806f4f0 0x7fc3f8151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 --2- 172.21.15.6:0/3787078789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f80b1ef0 0x7fc3f814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 >> 172.21.15.6:0/3787078789 conn(0x7fc3f80d0bb0 msgr2=0x7fc3f80ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 shutdown_connections 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.108+0000 7fc3ff1c4700 1 -- 172.21.15.6:0/3787078789 wait complete. 2023-10-09T11:40:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:40:01.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:01.139 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-10-09T11:40:01.137+0000 7f12a81ab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:40:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.239+0000 7f5d24c35700 1 Processor -- start 2023-10-09T11:40:01.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.239+0000 7f5d24c35700 1 -- start start 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d24c35700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d200cf240 0x7f5d200b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d24c35700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d200b0ca0 con 0x7f5d2015a2a0 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d24c35700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d200b00d0 con 0x7f5d2006d650 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d24c35700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2006ea90 con 0x7f5d200cf240 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d200cf240 0x7f5d200b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d200cf240 0x7f5d200b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40948/0 (socket says 172.21.15.6:40948) 2023-10-09T11:40:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3181628345 learned_addr learned my addr 172.21.15.6:0/3181628345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1e59c700 1 --1- 172.21.15.6:0/3181628345 >> v1:172.21.15.6:6789/0 conn(0x7f5d2015a2a0 0x7f5d200ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55618/0 (socket says 172.21.15.6:55618) 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3181628345 >> v1:172.21.15.118:6789/0 conn(0x7f5d2006d650 legacy=0x7f5d2006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3181628345 >> v1:172.21.15.6:6789/0 conn(0x7f5d2015a2a0 legacy=0x7f5d200ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3181628345 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200b0370 con 0x7f5d200cf240 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1dd9b700 1 --2- 172.21.15.6:0/3181628345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1130 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5d080099b0 tx=0x7f5d08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73370a887883770 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1d59a700 1 -- 172.21.15.6:0/3181628345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800b820 con 0x7f5d200cf240 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.240+0000 7f5d1d59a700 1 -- 172.21.15.6:0/3181628345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0800b980 con 0x7f5d200cf240 2023-10-09T11:40:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d1d59a700 1 -- 172.21.15.6:0/3181628345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800bd20 con 0x7f5d200cf240 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 -- 172.21.15.6:0/3181628345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 msgr2=0x7f5d200b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3181628345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1130 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5d080099b0 tx=0x7f5d08009250 comp rx=0 tx=0).stop 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 -- 172.21.15.6:0/3181628345 shutdown_connections 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3181628345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1130 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 -- 172.21.15.6:0/3181628345 >> 172.21.15.6:0/3181628345 conn(0x7f5d20067640 msgr2=0x7f5d20067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 -- 172.21.15.6:0/3181628345 shutdown_connections 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.241+0000 7f5d24c35700 1 -- 172.21.15.6:0/3181628345 wait complete. 2023-10-09T11:40:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.242+0000 7f5d24c35700 1 Processor -- start 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.242+0000 7f5d24c35700 1 -- start start 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2006d650 0x7f5d20152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2015a2a0 0x7f5d20157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20153320 con 0x7f5d200cf240 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200b3b60 con 0x7f5d2006d650 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d24c35700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20155510 con 0x7f5d2015a2a0 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40962/0 (socket says 172.21.15.6:40962) 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3139104344 learned_addr learned my addr 172.21.15.6:0/3139104344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1e59c700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2006d650 0x7f5d20152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1ed9d700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2015a2a0 0x7f5d20157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2015a2a0 msgr2=0x7f5d20157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2015a2a0 0x7f5d20157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2006d650 msgr2=0x7f5d20152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2006d650 0x7f5d20152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 -- 172.21.15.6:0/3139104344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d080094f0 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.243+0000 7f5d1dd9b700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c010 tx=0x7f5d08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.244+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08011d60 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.244+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08020070 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.244+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0801b6a0 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.244+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d200b2400 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.244+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d200b29c0 con 0x7f5d200cf240 2023-10-09T11:40:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.245+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d20069e40 con 0x7f5d200cf240 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.245+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d08022030 con 0x7f5d200cf240 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.245+0000 7f5d167fc700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.246+0000 7f5d1e59c700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.246+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d08086340 con 0x7f5d200cf240 2023-10-09T11:40:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.246+0000 7f5d1e59c700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 0x7f5d000693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d18004fd0 tx=0x7f5d18007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:01.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.250+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d080535b0 con 0x7f5d200cf240 2023-10-09T11:40:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.486+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d2006e020 con 0x7f5d200cf240 2023-10-09T11:40:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.487+0000 7f5d167fc700 1 -- 172.21.15.6:0/3139104344 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5d08056bd0 con 0x7f5d200cf240 2023-10-09T11:40:01.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:01.488 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 msgr2=0x7f5d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 0x7f5d000693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d18004fd0 tx=0x7f5d18007eb0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 msgr2=0x7f5d200b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c010 tx=0x7f5d08016000 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 shutdown_connections 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d00066f30 0x7f5d000693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d2015a2a0 0x7f5d20157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d2006d650 0x7f5d20152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 --2- 172.21.15.6:0/3139104344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d200cf240 0x7f5d200b1940 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 >> 172.21.15.6:0/3139104344 conn(0x7f5d20067640 msgr2=0x7f5d200ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 shutdown_connections 2023-10-09T11:40:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:01.489+0000 7f5d24c35700 1 -- 172.21.15.6:0/3139104344 wait complete. 2023-10-09T11:40:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:01.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:39:55.562505+0000', 'modified': '2023-10-09T11:39:59.173680+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6012': {'gid': 6012, 'name': 'd', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6834/2962892052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 2962892052}, {'type': 'v1', 'addr': '172.21.15.118:6834', 'nonce': 2962892052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:40:01.906 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:40:01.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:40:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.031+0000 7f21fdc59700 1 Processor -- start 2023-10-09T11:40:02.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.031+0000 7f21fdc59700 1 -- start start 2023-10-09T11:40:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21fdc59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f81578d0 0x7f21f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21fdc59700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80d07c0 con 0x7f21f806d120 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21fdc59700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80cfbb0 con 0x7f21f8157ca0 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21fdc59700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80cfe90 con 0x7f21f81578d0 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f81578d0 0x7f21f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21f806d120 0x7f21f806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55626/0 (socket says 172.21.15.6:55626) 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f81578d0 0x7f21f80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40966/0 (socket says 172.21.15.6:40966) 2023-10-09T11:40:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f7fff700 1 -- 172.21.15.6:0/287153476 learned_addr learned my addr 172.21.15.6:0/287153476 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 -- 172.21.15.6:0/287153476 >> v1:172.21.15.118:6789/0 conn(0x7f21f8157ca0 legacy=0x7f21f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 -- 172.21.15.6:0/287153476 >> v1:172.21.15.6:6789/0 conn(0x7f21f806d120 legacy=0x7f21f806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 -- 172.21.15.6:0/287153476 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80d0170 con 0x7f21f81578d0 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f77fe700 1 --2- 172.21.15.6:0/287153476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f80cf4f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098e0 tx=0x7f21e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53209749b50b3f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f67fc700 1 -- 172.21.15.6:0/287153476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8009e80 con 0x7f21f81578d0 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f67fc700 1 -- 172.21.15.6:0/287153476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800b820 con 0x7f21f81578d0 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.032+0000 7f21f67fc700 1 -- 172.21.15.6:0/287153476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800bba0 con 0x7f21f81578d0 2023-10-09T11:40:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 -- 172.21.15.6:0/287153476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 msgr2=0x7f21f80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 --2- 172.21.15.6:0/287153476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f80cf4f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098e0 tx=0x7f21e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 -- 172.21.15.6:0/287153476 shutdown_connections 2023-10-09T11:40:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 --2- 172.21.15.6:0/287153476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f80cf4f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 -- 172.21.15.6:0/287153476 >> 172.21.15.6:0/287153476 conn(0x7f21f806bb90 msgr2=0x7f21f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 -- 172.21.15.6:0/287153476 shutdown_connections 2023-10-09T11:40:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.033+0000 7f21fdc59700 1 -- 172.21.15.6:0/287153476 wait complete. 2023-10-09T11:40:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.034+0000 7f21fdc59700 1 Processor -- start 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.034+0000 7f21fdc59700 1 -- start start 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f806d120 0x7f21f816a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f8157ca0 0x7f21f80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f816b500 con 0x7f21f81578d0 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80ccff0 con 0x7f21f806d120 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21fdc59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cd2d0 con 0x7f21f8157ca0 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40972/0 (socket says 172.21.15.6:40972) 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 -- 172.21.15.6:0/2092458956 learned_addr learned my addr 172.21.15.6:0/2092458956 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 -- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f8157ca0 msgr2=0x7f21f80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f8157ca0 0x7f21f80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f6ffd700 1 -- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f806d120 msgr2=0x7f21f816a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.035+0000 7f21f77fe700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f806d120 0x7f21f816a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f806d120 0x7f21f816a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21f6ffd700 1 -- 172.21.15.6:0/2092458956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009420 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b5e0 tx=0x7f21ec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21df7fe700 1 -- 172.21.15.6:0/2092458956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00f510 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21df7fe700 1 -- 172.21.15.6:0/2092458956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00f6b0 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80cd5b0 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21df7fe700 1 -- 172.21.15.6:0/2092458956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00fa70 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.036+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80cdb70 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.037+0000 7f21df7fe700 1 -- 172.21.15.6:0/2092458956 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21ec01a400 con 0x7f21f81578d0 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.038+0000 7f21df7fe700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.038+0000 7f21df7fe700 1 -- 172.21.15.6:0/2092458956 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21ec084120 con 0x7f21f81578d0 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.038+0000 7f21f77fe700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.038+0000 7f21f77fe700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21e80091e0 tx=0x7f21e8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.039+0000 7f2206f51b80 1 Processor -- start 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 -- start start 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd52bcd00 0x55cdd529ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd526ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd51c9a70 con 0x55cdd5272a50 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd51c7270 con 0x55cdd529bf60 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.040+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdd51c3060 con 0x55cdd52bcd00 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40984/0 (socket says 172.21.15.6:40984) 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 -- 172.21.15.6:0/70462297 learned_addr learned my addr 172.21.15.6:0/70462297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f7fff700 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd526ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd52bcd00 0x55cdd529ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 -- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd52bcd00 msgr2=0x55cdd529ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd52bcd00 0x55cdd529ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 -- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 msgr2=0x55cdd526ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd526ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 -- 172.21.15.6:0/70462297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdd505d270 con 0x55cdd5272a50 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21f77fe700 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f21e800bbc0 tx=0x7f21e801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92f5f5e05821a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21dcff9700 1 -- 172.21.15.6:0/70462297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e801c990 con 0x55cdd5272a50 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21dcff9700 1 -- 172.21.15.6:0/70462297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e801caf0 con 0x55cdd5272a50 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.041+0000 7f21dcff9700 1 -- 172.21.15.6:0/70462297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e801ce70 con 0x55cdd5272a50 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- 172.21.15.6:0/70462297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 msgr2=0x55cdd5272e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f21e800bbc0 tx=0x7f21e801e040 comp rx=0 tx=0).stop 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- 172.21.15.6:0/70462297 shutdown_connections 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd526ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5272e20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 --2- 172.21.15.6:0/70462297 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd52bcd00 0x55cdd529ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- 172.21.15.6:0/70462297 >> 172.21.15.6:0/70462297 conn(0x55cdd5274370 msgr2=0x55cdd5274740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- 172.21.15.6:0/70462297 shutdown_connections 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- 172.21.15.6:0/70462297 wait complete. 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.042+0000 7f2206f51b80 1 -- start start 2023-10-09T11:40:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 Processor -- start 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd5272a50 0x55cdd52c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd52cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd516e890 con 0x55cdd52bcd00 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd5189ea0 con 0x55cdd529bf60 2023-10-09T11:40:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdd5045e30 con 0x55cdd5272a50 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f2206f51b80 10 client.0 _ll_register_callbacks cb 0x55cdd5236110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40996/0 (socket says 172.21.15.6:40996) 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f21f7fff700 1 -- 172.21.15.6:0/249272354 learned_addr learned my addr 172.21.15.6:0/249272354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.043+0000 7f21f77fe700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd5272a50 0x55cdd52c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd52cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 -- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd5272a50 msgr2=0x55cdd52c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd5272a50 0x55cdd52c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 -- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 msgr2=0x55cdd52cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd52cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 -- 172.21.15.6:0/249272354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80d0170 con 0x55cdd52bcd00 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21f7fff700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f21f000e8c0 tx=0x7f21f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844a258e2ea8d849 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00072e0 con 0x55cdd52bcd00 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21f0007440 con 0x55cdd52bcd00 2023-10-09T11:40:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdd5267b70 con 0x55cdd52bcd00 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21f0001c40 con 0x55cdd52bcd00 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 10 client.6147 fetch_fsmap learned FSMap version 43 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55cdd4ffffe0 con 0x55cdd52bcd00 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cdd5267b70 con 0x55cdd52bcd00 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f21f0007810 con 0x55cdd52bcd00 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 10 client.6147 fetch_fsmap finished waiting for FSMap version 43 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 10 client.6147 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.044+0000 7f2206f51b80 20 client.6147 populate_metadata read hostname 'smithi006' 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd52bc250 0x55cdd52bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f2206f51b80 4 client.6147 mds_command: new command op to 6012 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 --> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdd5244aa0 con 0x55cdd52bc250 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f21f77fe700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd52bc250 0x55cdd52bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f21d5ffb700 10 client.6147 ms_handle_connect on v2:172.21.15.118:6832/2962892052 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.045+0000 7f21f77fe700 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd52bc250 0x55cdd52bc620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=105a9306136ae429 server_cookie=231264c80ce42116 in_seq=0 out_seq=0 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f21d5ffb700 1 -- 172.21.15.6:0/249272354 <== mds.0 v2:172.21.15.118:6832/2962892052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cdd5244aa0 con 0x55cdd52bc250 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f21d5ffb700 10 client.6147 handle_command_reply: tid=0 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 client.6147 shutdown 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 msgr2=0x55cdd52b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f21f000e8c0 tx=0x7f21f0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 shutdown_connections 2023-10-09T11:40:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd52bc250 0x55cdd52bc620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd52bcd00 0x55cdd52b9ce0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd5272a50 0x55cdd52c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f21d5ffb700 0 client.6147 ms_handle_reset on v2:172.21.15.118:6832/2962892052 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 --2- 172.21.15.6:0/249272354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd529bf60 0x55cdd52cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 >> 172.21.15.6:0/249272354 conn(0x55cdd5274370 msgr2=0x55cdd52b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 shutdown_connections 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 1 -- 172.21.15.6:0/249272354 wait complete. 2023-10-09T11:40:02.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.046+0000 7f2206f51b80 20 client.6147 trim_cache size 0 max 16384 2023-10-09T11:40:02.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.063+0000 7f2206f51b80 1 Processor -- start 2023-10-09T11:40:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.063+0000 7f2206f51b80 1 -- start start 2023-10-09T11:40:02.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd526d5a0 con 0x55cdd5272a50 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd52be180 con 0x55cdd52bcd00 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdd52b09b0 con 0x55cdd529bf60 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41008/0 (socket says 172.21.15.6:41008) 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 -- 172.21.15.6:0/1675058453 learned_addr learned my addr 172.21.15.6:0/1675058453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f7fff700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 -- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 msgr2=0x55cdd52bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 -- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 msgr2=0x55cdd52c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 -- 172.21.15.6:0/1675058453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdd5191780 con 0x55cdd5272a50 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f7fff700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21f77fe700 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21e8028000 tx=0x7f21e8039250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f3b90a44254dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21dd7fa700 1 -- 172.21.15.6:0/1675058453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800bd50 con 0x55cdd5272a50 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21dd7fa700 1 -- 172.21.15.6:0/1675058453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8025690 con 0x55cdd5272a50 2023-10-09T11:40:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.064+0000 7f21dd7fa700 1 -- 172.21.15.6:0/1675058453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8025800 con 0x55cdd5272a50 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 -- 172.21.15.6:0/1675058453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 msgr2=0x55cdd5314520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21e8028000 tx=0x7f21e8039250 comp rx=0 tx=0).stop 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 -- 172.21.15.6:0/1675058453 shutdown_connections 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd5314520 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 --2- 172.21.15.6:0/1675058453 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 -- 172.21.15.6:0/1675058453 >> 172.21.15.6:0/1675058453 conn(0x55cdd5274370 msgr2=0x55cdd526b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 -- 172.21.15.6:0/1675058453 shutdown_connections 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.065+0000 7f2206f51b80 1 -- 172.21.15.6:0/1675058453 wait complete. 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 -- start start 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 Processor -- start 2023-10-09T11:40:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd5320aa0 con 0x55cdd5272a50 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdd5320f00 con 0x55cdd52bcd00 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdd52cb6e0 con 0x55cdd529bf60 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f2206f51b80 10 client.0 _ll_register_callbacks cb 0x55cdd5236110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.066+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41020/0 (socket says 172.21.15.6:41020) 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 -- 172.21.15.6:0/3737693346 learned_addr learned my addr 172.21.15.6:0/3737693346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f7fff700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 -- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 msgr2=0x55cdd52d72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52d72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 -- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 msgr2=0x55cdd52d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 -- 172.21.15.6:0/3737693346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdd505d270 con 0x55cdd5272a50 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f7fff700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21f77fe700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000e50 tx=0x7f21e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77134d5ecc2dbcd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8025e00 con 0x55cdd5272a50 2023-10-09T11:40:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21e8036040 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21e801caf0 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21e8030640 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 10 client.6153 fetch_fsmap learned FSMap version 43 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55cdd5178470 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e801caf0 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f21e8042070 con 0x55cdd5272a50 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 10 client.6153 fetch_fsmap finished waiting for FSMap version 43 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 10 client.6153 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.067+0000 7f2206f51b80 20 client.6153 populate_metadata read hostname 'smithi006' 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd5297870 0x55cdd5297c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 4 client.6153 mds_command: new command op to 6012 tid=0[{"prefix": "status"}] 2023-10-09T11:40:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 --> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cdd5165e00 con 0x55cdd5297870 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd5297870 0x55cdd5297c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21d5ffb700 10 client.6153 ms_handle_connect on v2:172.21.15.118:6832/2962892052 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21f6ffd700 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd5297870 0x55cdd5297c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=590e0ce1eea8c146 server_cookie=1c7d999f81eb657b in_seq=0 out_seq=0 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21d5ffb700 1 -- 172.21.15.6:0/3737693346 <== mds.0 v2:172.21.15.118:6832/2962892052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55cdd5165e00 con 0x55cdd5297870 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21d5ffb700 10 client.6153 handle_command_reply: tid=0 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 client.6153 shutdown 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 msgr2=0x55cdd52caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000e50 tx=0x7f21e8037000 comp rx=0 tx=0).stop 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 shutdown_connections 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:6832/2962892052,v1:172.21.15.118:6834/2962892052] conn(0x55cdd5297870 0x55cdd5297c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cdd52bcd00 0x55cdd52d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cdd5272a50 0x55cdd52caee0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 --2- 172.21.15.6:0/3737693346 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55cdd529bf60 0x55cdd52d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f21d5ffb700 0 client.6153 ms_handle_reset on v2:172.21.15.118:6832/2962892052 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 >> 172.21.15.6:0/3737693346 conn(0x55cdd5274370 msgr2=0x55cdd5275950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.068+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 shutdown_connections 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f2206f51b80 1 -- 172.21.15.6:0/3737693346 wait complete. 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f2206f51b80 20 client.6153 trim_cache size 0 max 16384 2023-10-09T11:40:02.085 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6012, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9102694070000004, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 43, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 80, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 80, 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.847142401999999 2023-10-09T11:40:02.086 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 msgr2=0x7f21e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21e80091e0 tx=0x7f21e8016000 comp rx=0 tx=0).stop 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 msgr2=0x7f21f8152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b5e0 tx=0x7f21ec0090f0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 shutdown_connections 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f8157ca0 0x7f21f80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f806d120 0x7f21f816a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 --2- 172.21.15.6:0/2092458956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f81578d0 0x7f21f8152230 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 >> 172.21.15.6:0/2092458956 conn(0x7f21f806bb90 msgr2=0x7f21f8068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 shutdown_connections 2023-10-09T11:40:02.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.069+0000 7f21fdc59700 1 -- 172.21.15.6:0/2092458956 wait complete. 2023-10-09T11:40:02.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.207+0000 7f1c24225700 1 Processor -- start 2023-10-09T11:40:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.207+0000 7f1c24225700 1 -- start start 2023-10-09T11:40:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c24225700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1c1c157ca0 0x7f1c1c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c24225700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c1c06d120 0x7f1c1c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c24225700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0d07c0 con 0x7f1c1c1578d0 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c24225700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c06da50 con 0x7f1c1c06d120 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c24225700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cfbb0 con 0x7f1c1c157ca0 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c227c2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c1c06d120 0x7f1c1c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c21fc1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1c1c1578d0 0x7f1c1c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55640/0 (socket says 172.21.15.6:55640) 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c21fc1700 1 -- 172.21.15.6:0/1370331604 learned_addr learned my addr 172.21.15.6:0/1370331604 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c217c0700 1 --2- 172.21.15.6:0/1370331604 >> v2:172.21.15.118:3300/0 conn(0x7f1c1c157ca0 0x7f1c1c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c227c2700 1 -- 172.21.15.6:0/1370331604 >> v2:172.21.15.118:3300/0 conn(0x7f1c1c157ca0 msgr2=0x7f1c1c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c227c2700 1 --2- 172.21.15.6:0/1370331604 >> v2:172.21.15.118:3300/0 conn(0x7f1c1c157ca0 0x7f1c1c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c227c2700 1 -- 172.21.15.6:0/1370331604 >> v1:172.21.15.6:6789/0 conn(0x7f1c1c1578d0 legacy=0x7f1c1c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c227c2700 1 -- 172.21.15.6:0/1370331604 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0cfe90 con 0x7f1c1c06d120 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.208+0000 7f1c20fbf700 1 -- 172.21.15.6:0/1370331604 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906396116 0 0) 0x7f1c1c0d07c0 con 0x7f1c1c1578d0 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c227c2700 1 --2- 172.21.15.6:0/1370331604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c06d120 0x7f1c1c06d510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c068510 tx=0x7f1c140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f1b82d51203aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c20fbf700 1 -- 172.21.15.6:0/1370331604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400b6b0 con 0x7f1c1c06d120 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c20fbf700 1 -- 172.21.15.6:0/1370331604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400b810 con 0x7f1c1c06d120 2023-10-09T11:40:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c20fbf700 1 -- 172.21.15.6:0/1370331604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400bbb0 con 0x7f1c1c06d120 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 -- 172.21.15.6:0/1370331604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c06d120 msgr2=0x7f1c1c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 --2- 172.21.15.6:0/1370331604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c06d120 0x7f1c1c06d510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c068510 tx=0x7f1c140091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 -- 172.21.15.6:0/1370331604 shutdown_connections 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 --2- 172.21.15.6:0/1370331604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c06d120 0x7f1c1c06d510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 --2- 172.21.15.6:0/1370331604 >> v2:172.21.15.118:3300/0 conn(0x7f1c1c157ca0 0x7f1c1c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 -- 172.21.15.6:0/1370331604 >> 172.21.15.6:0/1370331604 conn(0x7f1c1c06bb90 msgr2=0x7f1c1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 -- 172.21.15.6:0/1370331604 shutdown_connections 2023-10-09T11:40:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.209+0000 7f1c24225700 1 -- 172.21.15.6:0/1370331604 wait complete. 2023-10-09T11:40:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.210+0000 7f1c24225700 1 Processor -- start 2023-10-09T11:40:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 -- start start 2023-10-09T11:40:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c1c06d120 0x7f1c1c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c1c1578d0 0x7f1c1c0ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b6240 con 0x7f1c1c157ca0 2023-10-09T11:40:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b6490 con 0x7f1c1c06d120 2023-10-09T11:40:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c24225700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b6770 con 0x7f1c1c1578d0 2023-10-09T11:40:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c227c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c227c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41036/0 (socket says 172.21.15.6:41036) 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c227c2700 1 -- 172.21.15.6:0/1285061661 learned_addr learned my addr 172.21.15.6:0/1285061661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.211+0000 7f1c21fc1700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c1c06d120 0x7f1c1c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c217c0700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c1c1578d0 0x7f1c1c0ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 -- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c1c1578d0 msgr2=0x7f1c1c0ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c1c1578d0 0x7f1c1c0ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 -- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c1c06d120 msgr2=0x7f1c1c0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c1c06d120 0x7f1c1c0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 -- 172.21.15.6:0/1285061661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009420 con 0x7f1c1c157ca0 2023-10-09T11:40:02.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c227c2700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06fe20 tx=0x7f1c14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14025420 con 0x7f1c1c157ca0 2023-10-09T11:40:02.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14025580 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0b6a50 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14025920 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.212+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0ab890 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.213+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c067ac0 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.213+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c14023070 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.214+0000 7f1c19ffb700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 0x7f1c080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.214+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c14085cb0 con 0x7f1c1c157ca0 2023-10-09T11:40:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.214+0000 7f1c21fc1700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 0x7f1c080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:02.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.214+0000 7f1c21fc1700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 0x7f1c080693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c001560 tx=0x7f1c0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:02.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.218+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c14052f20 con 0x7f1c1c157ca0 2023-10-09T11:40:02.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.456+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c1c0d0170 con 0x7f1c1c157ca0 2023-10-09T11:40:02.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.457+0000 7f1c19ffb700 1 -- 172.21.15.6:0/1285061661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c14056540 con 0x7f1c1c157ca0 2023-10-09T11:40:02.458 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 msgr2=0x7f1c080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 0x7f1c080693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c001560 tx=0x7f1c0c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 msgr2=0x7f1c1c159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06fe20 tx=0x7f1c14017000 comp rx=0 tx=0).stop 2023-10-09T11:40:02.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 shutdown_connections 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1c08066f30 0x7f1c080693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1c157ca0 0x7f1c1c159380 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c1c06d120 0x7f1c1c0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 --2- 172.21.15.6:0/1285061661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1c1c1578d0 0x7f1c1c0ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 >> 172.21.15.6:0/1285061661 conn(0x7f1c1c06bb90 msgr2=0x7f1c1c1554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 shutdown_connections 2023-10-09T11:40:02.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:02.459+0000 7f1c24225700 1 -- 172.21.15.6:0/1285061661 wait complete. 2023-10-09T11:40:02.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:02.473 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:02.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.473 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:40:02.489 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:02.489 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:02.490 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:02.490 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.490 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:02.490 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.490 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:02.491 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42259sec preferred_lft 42259sec 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:02.492 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:02.493 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:40:02.493 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:02.493 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:02.493 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:02.494 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.494 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:40:02.494 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.494 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:02.494 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:40:02.495 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:02.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.497 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:02.566 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:40:02.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.568 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:40:02.626 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:40:02.626 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:02.626 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:40:02.626 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:40:02.626 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:02.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:40:02.627 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:40:02.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.729 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:40:02.744 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:40:02.744 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:40:02.745 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:02.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:02.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:40:02.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:02.810 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:02.866 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:02.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:02.867 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:02.924 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:40:02.924 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:02.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:03.006 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:03.006 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:03.025 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:03.025 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:03.027 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:03.047 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:03.047 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:40:03.048 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:40:03.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:40:03.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:03.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.276+0000 7fc25e189700 1 Processor -- start 2023-10-09T11:40:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.276+0000 7fc25e189700 1 -- start start 2023-10-09T11:40:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc25e189700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc258159d40 0x7fc2580d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc25e189700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 0x7fc2580b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc25e189700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2580ce290 con 0x7fc2580cb390 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc25e189700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580cda30 con 0x7fc258159d40 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc25e189700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580cdcd0 con 0x7fc25815a110 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc2577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc258159d40 0x7fc2580d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc257fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc2580cb390 0x7fc25806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53894/0 (socket says 172.21.15.6:53894) 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc2577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc258159d40 0x7fc2580d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45010/0 (socket says 172.21.15.6:45010) 2023-10-09T11:40:03.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.277+0000 7fc257fff700 1 -- 172.21.15.6:0/2413162161 learned_addr learned my addr 172.21.15.6:0/2413162161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc256ffd700 1 --2- 172.21.15.6:0/2413162161 >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 0x7fc2580b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2577fe700 1 -- 172.21.15.6:0/2413162161 >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 msgr2=0x7fc2580b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2577fe700 1 --2- 172.21.15.6:0/2413162161 >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 0x7fc2580b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2577fe700 1 -- 172.21.15.6:0/2413162161 >> v1:172.21.15.6:6789/0 conn(0x7fc2580cb390 legacy=0x7fc25806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2577fe700 1 -- 172.21.15.6:0/2413162161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580cdfb0 con 0x7fc258159d40 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2567fc700 1 -- 172.21.15.6:0/2413162161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074802719 0 0) 0x7fc2580ce290 con 0x7fc2580cb390 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc256ffd700 1 --2- 172.21.15.6:0/2413162161 >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 0x7fc2580b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2577fe700 1 --2- 172.21.15.6:0/2413162161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580d06d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc25806e870 tx=0x7fc2480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8d895b2c33f961 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2567fc700 1 -- 172.21.15.6:0/2413162161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b6b0 con 0x7fc258159d40 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2567fc700 1 -- 172.21.15.6:0/2413162161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800b810 con 0x7fc258159d40 2023-10-09T11:40:03.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc2567fc700 1 -- 172.21.15.6:0/2413162161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800bbb0 con 0x7fc258159d40 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc25e189700 1 -- 172.21.15.6:0/2413162161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 msgr2=0x7fc2580d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.278+0000 7fc25e189700 1 --2- 172.21.15.6:0/2413162161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580d06d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc25806e870 tx=0x7fc2480091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 -- 172.21.15.6:0/2413162161 shutdown_connections 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 --2- 172.21.15.6:0/2413162161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580d06d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 --2- 172.21.15.6:0/2413162161 >> v2:172.21.15.118:3300/0 conn(0x7fc25815a110 0x7fc2580b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 -- 172.21.15.6:0/2413162161 >> 172.21.15.6:0/2413162161 conn(0x7fc25806bb90 msgr2=0x7fc25806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 -- 172.21.15.6:0/2413162161 shutdown_connections 2023-10-09T11:40:03.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.279+0000 7fc25e189700 1 -- 172.21.15.6:0/2413162161 wait complete. 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.280+0000 7fc25e189700 1 Processor -- start 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.280+0000 7fc25e189700 1 -- start start 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2580cb390 0x7fc2581406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 0x7fc2580b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25814fa30 con 0x7fc258159d40 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580b6880 con 0x7fc25815a110 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25814fec0 con 0x7fc2580cb390 2023-10-09T11:40:03.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45024/0 (socket says 172.21.15.6:45024) 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 -- 172.21.15.6:0/4041629495 learned_addr learned my addr 172.21.15.6:0/4041629495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc257fff700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 0x7fc2580b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc2577fe700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2580cb390 0x7fc2581406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 -- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2580cb390 msgr2=0x7fc2581406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2580cb390 0x7fc2581406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 -- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 msgr2=0x7fc2580b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 0x7fc2580b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 -- 172.21.15.6:0/4041629495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248009420 con 0x7fc258159d40 2023-10-09T11:40:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc257fff700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 0x7fc2580b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc256ffd700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c800 tx=0x7fc24c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c011600 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c011760 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c011ae0 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25814ee20 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.281+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25814f3e0 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.282+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc258067d30 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.283+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc24c010350 con 0x7fc258159d40 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.283+0000 7fc23f7fe700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 0x7fc2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:03.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.283+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc24c084480 con 0x7fc258159d40 2023-10-09T11:40:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.283+0000 7fc2577fe700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 0x7fc2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.284+0000 7fc2577fe700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 0x7fc2440693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc248003080 tx=0x7fc248017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:03.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.287+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc24c055180 con 0x7fc258159d40 2023-10-09T11:40:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.525+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc2580b3440 con 0x7fc258159d40 2023-10-09T11:40:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.525+0000 7fc23f7fe700 1 -- 172.21.15.6:0/4041629495 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc24c054d10 con 0x7fc258159d40 2023-10-09T11:40:03.528 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 msgr2=0x7fc2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 0x7fc2440693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc248003080 tx=0x7fc248017000 comp rx=0 tx=0).stop 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 msgr2=0x7fc2580b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c800 tx=0x7fc24c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 shutdown_connections 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc244066f30 0x7fc2440693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc25815a110 0x7fc2580b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc2580cb390 0x7fc2581406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 --2- 172.21.15.6:0/4041629495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258159d40 0x7fc2580b5e00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 >> 172.21.15.6:0/4041629495 conn(0x7fc25806bb90 msgr2=0x7fc258150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 shutdown_connections 2023-10-09T11:40:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:03.528+0000 7fc25e189700 1 -- 172.21.15.6:0/4041629495 wait complete. 2023-10-09T11:40:03.542 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:03.543 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:03.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.543 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:40:03.561 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42271sec preferred_lft 42271sec 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:03.562 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:40:03.563 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:03.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.564 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:03.629 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:40:03.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.631 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:40:03.690 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:40:03.690 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:03.690 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:40:03.690 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:40:03.690 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:03.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:40:03.691 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:40:03.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.796 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:40:03.810 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:40:03.810 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:40:03.811 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:03.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:03.811 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:40:03.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:03.877 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:03.933 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:03.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:03.933 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:03.991 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:40:03.991 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:03.991 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:04.071 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:04.071 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:04.090 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:04.091 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:04.112 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:04.112 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:04.112 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:40:04.113 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:40:04.115 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:40:04.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:04.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:04.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:04.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:04.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:04.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 Processor -- start 2023-10-09T11:40:04.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 -- start start 2023-10-09T11:40:04.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 0x7fcd600b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:04.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6006e280 con 0x7fcd6006d990 2023-10-09T11:40:04.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd60068d60 con 0x7fcd60159a90 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.308+0000 7fcd6545a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60069900 con 0x7fcd60159e60 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcd6006d990 0x7fcd600691f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53896/0 (socket says 172.21.15.6:53896) 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5e7fc700 1 -- 172.21.15.6:0/852215727 learned_addr learned my addr 172.21.15.6:0/852215727 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/852215727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 0x7fcd600b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267843166 0 0) 0x7fcd60068d60 con 0x7fcd60159a90 2023-10-09T11:40:04.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd48003570 con 0x7fcd60159a90 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252658935 0 0) 0x7fcd6006e280 con 0x7fcd6006d990 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd60068d60 con 0x7fcd6006d990 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/852215727 >> v1:172.21.15.118:6789/0 conn(0x7fcd60159a90 legacy=0x7fcd6006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/852215727 >> v1:172.21.15.6:6789/0 conn(0x7fcd6006d990 legacy=0x7fcd600691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/852215727 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6006dfa0 con 0x7fcd60159e60 2023-10-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/852215727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 0x7fcd600b2b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009e90 tx=0x7fcd58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cdcadb344af7cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800e070 con 0x7fcd60159e60 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800bb80 con 0x7fcd60159e60 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.309+0000 7fcd5dffb700 1 -- 172.21.15.6:0/852215727 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58012430 con 0x7fcd60159e60 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 -- 172.21.15.6:0/852215727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 msgr2=0x7fcd600b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 --2- 172.21.15.6:0/852215727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 0x7fcd600b2b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009e90 tx=0x7fcd58009780 comp rx=0 tx=0).stop 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 -- 172.21.15.6:0/852215727 shutdown_connections 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 --2- 172.21.15.6:0/852215727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd60159e60 0x7fcd600b2b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 -- 172.21.15.6:0/852215727 >> 172.21.15.6:0/852215727 conn(0x7fcd6006bb90 msgr2=0x7fcd6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 -- 172.21.15.6:0/852215727 shutdown_connections 2023-10-09T11:40:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.310+0000 7fcd6545a700 1 -- 172.21.15.6:0/852215727 wait complete. 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.311+0000 7fcd6545a700 1 Processor -- start 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.311+0000 7fcd6545a700 1 -- start start 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 0x7fcd6015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 0x7fcd6015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60153c30 con 0x7fcd60159a90 2023-10-09T11:40:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6015cc30 con 0x7fcd60159e60 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd6545a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6015c670 con 0x7fcd6006d990 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd5e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd5e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45028/0 (socket says 172.21.15.6:45028) 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd5e7fc700 1 -- 172.21.15.6:0/957514741 learned_addr learned my addr 172.21.15.6:0/957514741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 0x7fcd6015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.312+0000 7fcd5effd700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 0x7fcd6015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 msgr2=0x7fcd6015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 0x7fcd6015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 msgr2=0x7fcd60153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 -- 172.21.15.6:0/957514741 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009a20 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5e7fc700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5effd700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 0x7fcd6015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd5f7fe700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 0x7fcd6015b510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd58016000 tx=0x7fcd58019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58007000 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd580263f0 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6015c950 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580267f0 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.313+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6015aff0 con 0x7fcd60159e60 2023-10-09T11:40:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.314+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd600b3ba0 con 0x7fcd60159e60 2023-10-09T11:40:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.315+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd5802f450 con 0x7fcd60159e60 2023-10-09T11:40:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.315+0000 7fcd46ffd700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 0x7fcd4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.316+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd58086670 con 0x7fcd60159e60 2023-10-09T11:40:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.316+0000 7fcd5effd700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 0x7fcd4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:04.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.316+0000 7fcd5effd700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 0x7fcd4c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcd50007fd0 tx=0x7fcd50007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.320+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd580538e0 con 0x7fcd60159e60 2023-10-09T11:40:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.555+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd6015cd70 con 0x7fcd60159e60 2023-10-09T11:40:04.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.556+0000 7fcd46ffd700 1 -- 172.21.15.6:0/957514741 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fcd58056f00 con 0x7fcd60159e60 2023-10-09T11:40:04.557 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:04.558 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 msgr2=0x7fcd4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 0x7fcd4c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcd50007fd0 tx=0x7fcd50007d50 comp rx=0 tx=0).stop 2023-10-09T11:40:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 msgr2=0x7fcd6015b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 0x7fcd6015b510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd58016000 tx=0x7fcd58019000 comp rx=0 tx=0).stop 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 shutdown_connections 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcd4c066f30 0x7fcd4c0693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd60159e60 0x7fcd6015b510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd6006d990 0x7fcd6015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 --2- 172.21.15.6:0/957514741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd60159a90 0x7fcd60153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 >> 172.21.15.6:0/957514741 conn(0x7fcd6006bb90 msgr2=0x7fcd601556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 shutdown_connections 2023-10-09T11:40:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:04.558+0000 7fcd6545a700 1 -- 172.21.15.6:0/957514741 wait complete. 2023-10-09T11:40:04.562 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:04.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:40:04.704 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":6012,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5352955749999992,"mdsmap_epoch":43,"osdmap_epoch":80,"osdmap_epoch_barrier":80,"uptime":14.472167539999999} 2023-10-09T11:40:04.705 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 6012, "mdsmap_epoch": 43, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "rank_uptime": 8.535295575, "state": "up:active", "uptime": 14.47216754, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:40:04.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:40:04.840 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:40:04.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:40:04.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T11:40:04.967 INFO:teuthology.orchestra.run.smithi006.stdout:{"mon_tick_interval":"5"} 2023-10-09T11:40:04.967 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T11:40:04.968 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> import time 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> import datetime 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> # Write some buffered data through before going full, all should be well 2023-10-09T11:40:04.968 DEBUG:teuthology.orchestra.run.smithi006:> print("writing some data through which we expect to succeed") 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> bytes = 0 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> # from write 2023-10-09T11:40:04.969 DEBUG:teuthology.orchestra.run.smithi006:> full = False 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(531 * 1.1)): 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> raise 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:40:04.970 DEBUG:teuthology.orchestra.run.smithi006:> full = True 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> break 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed successfully") 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> full = True 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> break 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:40:04.971 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> if n > 531 * 0.9: 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> # Be cautious in the last region where we expect to hit 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(15.0) 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.972 DEBUG:teuthology.orchestra.run.smithi006:> if not full: 2023-10-09T11:40:04.973 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-09T11:40:04.973 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.973 DEBUG:teuthology.orchestra.run.smithi006:> # close() should not raise an error because we already caught it in 2023-10-09T11:40:04.973 DEBUG:teuthology.orchestra.run.smithi006:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-09T11:40:04.973 DEBUG:teuthology.orchestra.run.smithi006:> # since then because all IOs got cancelled on the full flag. 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> print("calling close") 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> print("close() did not raise error") 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T11:40:04.974 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:40:05.450 INFO:teuthology.orchestra.run.smithi006.stdout:writing some data through which we expect to succeed 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 1.00 MB 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 2.00 MB 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 3.00 MB 2023-10-09T11:40:05.451 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 4.00 MB 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 5.00 MB 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 6.00 MB 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 7.00 MB 2023-10-09T11:40:05.452 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 8.00 MB 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 9.00 MB 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 10.00 MB 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 11.00 MB 2023-10-09T11:40:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 12.00 MB 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 13.00 MB 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 14.00 MB 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.454 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 15.00 MB 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 16.00 MB 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 17.00 MB 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 18.00 MB 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.455 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 19.00 MB 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 20.00 MB 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 21.00 MB 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 22.00 MB 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 23.00 MB 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 24.00 MB 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 25.00 MB 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 26.00 MB 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 27.00 MB 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 28.00 MB 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 29.00 MB 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 30.00 MB 2023-10-09T11:40:05.458 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 31.00 MB 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 32.00 MB 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 33.00 MB 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 34.00 MB 2023-10-09T11:40:05.459 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 35.00 MB 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 36.00 MB 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 37.00 MB 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 38.00 MB 2023-10-09T11:40:05.460 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 39.00 MB 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 40.00 MB 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 41.00 MB 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 42.00 MB 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 43.00 MB 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 44.00 MB 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 45.00 MB 2023-10-09T11:40:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 46.00 MB 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 47.00 MB 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 48.00 MB 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 49.00 MB 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 50.00 MB 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 51.00 MB 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 52.00 MB 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.464 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 53.00 MB 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 54.00 MB 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 55.00 MB 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 56.00 MB 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 57.00 MB 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 58.00 MB 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 59.00 MB 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 60.00 MB 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 61.00 MB 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 62.00 MB 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 63.00 MB 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 64.00 MB 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.467 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 65.00 MB 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 66.00 MB 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 67.00 MB 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 68.00 MB 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 69.00 MB 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 70.00 MB 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 71.00 MB 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 72.00 MB 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.469 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 73.00 MB 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 74.00 MB 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 75.00 MB 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 76.00 MB 2023-10-09T11:40:05.470 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 77.00 MB 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 78.00 MB 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 79.00 MB 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 80.00 MB 2023-10-09T11:40:05.647 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.647 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.647 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 81.00 MB 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 82.00 MB 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 83.00 MB 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 84.00 MB 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 85.00 MB 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 86.00 MB 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 87.00 MB 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 88.00 MB 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 89.00 MB 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 90.00 MB 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 91.00 MB 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 92.00 MB 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 93.00 MB 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 94.00 MB 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 95.00 MB 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 96.00 MB 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 97.00 MB 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 98.00 MB 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 99.00 MB 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 100.00 MB 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 101.00 MB 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 102.00 MB 2023-10-09T11:40:05.653 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 103.00 MB 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 104.00 MB 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 105.00 MB 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 106.00 MB 2023-10-09T11:40:05.654 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 107.00 MB 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 108.00 MB 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 109.00 MB 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 110.00 MB 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.655 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 111.00 MB 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 112.00 MB 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 113.00 MB 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 114.00 MB 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.656 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 115.00 MB 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 116.00 MB 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 117.00 MB 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 118.00 MB 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 119.00 MB 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 120.00 MB 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 121.00 MB 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 122.00 MB 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 123.00 MB 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 124.00 MB 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 125.00 MB 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 126.00 MB 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.659 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 127.00 MB 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 128.00 MB 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 129.00 MB 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 130.00 MB 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.660 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 131.00 MB 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 132.00 MB 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 133.00 MB 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 134.00 MB 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.661 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 135.00 MB 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 136.00 MB 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 137.00 MB 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 138.00 MB 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.662 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 139.00 MB 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 140.00 MB 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 141.00 MB 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 142.00 MB 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.663 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 143.00 MB 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 144.00 MB 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 145.00 MB 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 146.00 MB 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 147.00 MB 2023-10-09T11:40:05.664 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 148.00 MB 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 149.00 MB 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 150.00 MB 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 151.00 MB 2023-10-09T11:40:05.665 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 152.00 MB 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 153.00 MB 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 154.00 MB 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 155.00 MB 2023-10-09T11:40:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 156.00 MB 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 157.00 MB 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 158.00 MB 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 159.00 MB 2023-10-09T11:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.668 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.668 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 160.00 MB 2023-10-09T11:40:05.668 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.668 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.668 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 161.00 MB 2023-10-09T11:40:05.841 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.841 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.841 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 162.00 MB 2023-10-09T11:40:05.841 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.841 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 163.00 MB 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 164.00 MB 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 165.00 MB 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 166.00 MB 2023-10-09T11:40:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 167.00 MB 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 168.00 MB 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 169.00 MB 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 170.00 MB 2023-10-09T11:40:05.843 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 171.00 MB 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 172.00 MB 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 173.00 MB 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 174.00 MB 2023-10-09T11:40:05.844 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 175.00 MB 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 176.00 MB 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 177.00 MB 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 178.00 MB 2023-10-09T11:40:05.845 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 179.00 MB 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 180.00 MB 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 181.00 MB 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 182.00 MB 2023-10-09T11:40:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 183.00 MB 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 184.00 MB 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 185.00 MB 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 186.00 MB 2023-10-09T11:40:05.847 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 187.00 MB 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 188.00 MB 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 189.00 MB 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 190.00 MB 2023-10-09T11:40:05.848 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 191.00 MB 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 192.00 MB 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 193.00 MB 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.849 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 194.00 MB 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 195.00 MB 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 196.00 MB 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 197.00 MB 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 198.00 MB 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 199.00 MB 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 200.00 MB 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 201.00 MB 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 202.00 MB 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 203.00 MB 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 204.00 MB 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 205.00 MB 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.852 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 206.00 MB 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 207.00 MB 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 208.00 MB 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 209.00 MB 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 210.00 MB 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 211.00 MB 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 212.00 MB 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 213.00 MB 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.854 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 214.00 MB 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 215.00 MB 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 216.00 MB 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 217.00 MB 2023-10-09T11:40:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 218.00 MB 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 219.00 MB 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 220.00 MB 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 221.00 MB 2023-10-09T11:40:05.856 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 222.00 MB 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 223.00 MB 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 224.00 MB 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 225.00 MB 2023-10-09T11:40:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 226.00 MB 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 227.00 MB 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 228.00 MB 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 229.00 MB 2023-10-09T11:40:05.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 230.00 MB 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 231.00 MB 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 232.00 MB 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 233.00 MB 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 234.00 MB 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 235.00 MB 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 236.00 MB 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 237.00 MB 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 238.00 MB 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 239.00 MB 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 240.00 MB 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:05.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 241.00 MB 2023-10-09T11:40:06.029 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 242.00 MB 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 243.00 MB 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 244.00 MB 2023-10-09T11:40:06.030 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 245.00 MB 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 246.00 MB 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 247.00 MB 2023-10-09T11:40:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 248.00 MB 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 249.00 MB 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 250.00 MB 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 251.00 MB 2023-10-09T11:40:06.032 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 252.00 MB 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 253.00 MB 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 254.00 MB 2023-10-09T11:40:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 255.00 MB 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 256.00 MB 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 257.00 MB 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 258.00 MB 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 259.00 MB 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 260.00 MB 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 261.00 MB 2023-10-09T11:40:06.035 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 262.00 MB 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 263.00 MB 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 264.00 MB 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.036 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 265.00 MB 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 266.00 MB 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 267.00 MB 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 268.00 MB 2023-10-09T11:40:06.037 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 269.00 MB 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 270.00 MB 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 271.00 MB 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 272.00 MB 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 273.00 MB 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 274.00 MB 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 275.00 MB 2023-10-09T11:40:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 276.00 MB 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 277.00 MB 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 278.00 MB 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 279.00 MB 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 280.00 MB 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 281.00 MB 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.041 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 282.00 MB 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 283.00 MB 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 284.00 MB 2023-10-09T11:40:06.042 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 285.00 MB 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 286.00 MB 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 287.00 MB 2023-10-09T11:40:06.043 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 288.00 MB 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 289.00 MB 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 290.00 MB 2023-10-09T11:40:06.044 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 291.00 MB 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 292.00 MB 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 293.00 MB 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 294.00 MB 2023-10-09T11:40:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 295.00 MB 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 296.00 MB 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.046 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 297.00 MB 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 298.00 MB 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 299.00 MB 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 300.00 MB 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 301.00 MB 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 302.00 MB 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 303.00 MB 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 304.00 MB 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.048 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 305.00 MB 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 306.00 MB 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 307.00 MB 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 308.00 MB 2023-10-09T11:40:06.049 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 309.00 MB 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 310.00 MB 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 311.00 MB 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 312.00 MB 2023-10-09T11:40:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 313.00 MB 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 314.00 MB 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 315.00 MB 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 316.00 MB 2023-10-09T11:40:06.051 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 317.00 MB 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 318.00 MB 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 319.00 MB 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 320.00 MB 2023-10-09T11:40:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.053 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.053 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 321.00 MB 2023-10-09T11:40:06.053 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.053 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 322.00 MB 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 323.00 MB 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 324.00 MB 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 325.00 MB 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 326.00 MB 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 327.00 MB 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 328.00 MB 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 329.00 MB 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 330.00 MB 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 331.00 MB 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 332.00 MB 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 333.00 MB 2023-10-09T11:40:06.228 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 334.00 MB 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 335.00 MB 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 336.00 MB 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 337.00 MB 2023-10-09T11:40:06.229 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 338.00 MB 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 339.00 MB 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 340.00 MB 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 341.00 MB 2023-10-09T11:40:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 342.00 MB 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 343.00 MB 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 344.00 MB 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 345.00 MB 2023-10-09T11:40:06.231 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 346.00 MB 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 347.00 MB 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 348.00 MB 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 349.00 MB 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.232 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 350.00 MB 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 351.00 MB 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 352.00 MB 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 353.00 MB 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 354.00 MB 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 355.00 MB 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 356.00 MB 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 357.00 MB 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 358.00 MB 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 359.00 MB 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 360.00 MB 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 361.00 MB 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 362.00 MB 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 363.00 MB 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 364.00 MB 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 365.00 MB 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 366.00 MB 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 367.00 MB 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 368.00 MB 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 369.00 MB 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 370.00 MB 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 371.00 MB 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 372.00 MB 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 373.00 MB 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 374.00 MB 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 375.00 MB 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 376.00 MB 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 377.00 MB 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 378.00 MB 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 379.00 MB 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 380.00 MB 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 381.00 MB 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 382.00 MB 2023-10-09T11:40:06.240 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 383.00 MB 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 384.00 MB 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 385.00 MB 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 386.00 MB 2023-10-09T11:40:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 387.00 MB 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 388.00 MB 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 389.00 MB 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 390.00 MB 2023-10-09T11:40:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 391.00 MB 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 392.00 MB 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 393.00 MB 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 394.00 MB 2023-10-09T11:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 395.00 MB 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 396.00 MB 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 397.00 MB 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 398.00 MB 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.244 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 399.00 MB 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 400.00 MB 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 401.00 MB 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:06.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 402.00 MB 2023-10-09T11:40:08.916 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:40:08.915+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-09T11:40:13.989 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:40:13.988+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T11:40:34.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:34.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 403.00 MB 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 404.00 MB 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 405.00 MB 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 406.00 MB 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 407.00 MB 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 408.00 MB 2023-10-09T11:40:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 409.00 MB 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 410.00 MB 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 411.00 MB 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 412.00 MB 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 413.00 MB 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 414.00 MB 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 415.00 MB 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.477 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 416.00 MB 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 417.00 MB 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 418.00 MB 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 419.00 MB 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.478 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 420.00 MB 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 421.00 MB 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 422.00 MB 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 423.00 MB 2023-10-09T11:40:36.479 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 424.00 MB 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 425.00 MB 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 426.00 MB 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 427.00 MB 2023-10-09T11:40:36.480 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 428.00 MB 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 429.00 MB 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 430.00 MB 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 431.00 MB 2023-10-09T11:40:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 432.00 MB 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 433.00 MB 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 434.00 MB 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 435.00 MB 2023-10-09T11:40:36.482 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 436.00 MB 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 437.00 MB 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 438.00 MB 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 439.00 MB 2023-10-09T11:40:36.483 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 440.00 MB 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 441.00 MB 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 442.00 MB 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 443.00 MB 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 444.00 MB 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 445.00 MB 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 446.00 MB 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 447.00 MB 2023-10-09T11:40:36.485 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 448.00 MB 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 449.00 MB 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 450.00 MB 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 451.00 MB 2023-10-09T11:40:36.486 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 452.00 MB 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 453.00 MB 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 454.00 MB 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 455.00 MB 2023-10-09T11:40:36.487 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 456.00 MB 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 457.00 MB 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 458.00 MB 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 459.00 MB 2023-10-09T11:40:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 460.00 MB 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 461.00 MB 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 462.00 MB 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 463.00 MB 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.489 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 464.00 MB 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 465.00 MB 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 466.00 MB 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 467.00 MB 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.490 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 468.00 MB 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 469.00 MB 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 470.00 MB 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 471.00 MB 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.491 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 472.00 MB 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 473.00 MB 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 474.00 MB 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 475.00 MB 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 476.00 MB 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 477.00 MB 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 478.00 MB 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 479.00 MB 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:40:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 480.00 MB 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:Reached fullness after 480.00 MB 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:calling close 2023-10-09T11:40:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:close() did not raise error 2023-10-09T11:40:36.674 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:36.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:36.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:36.755 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:36.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:40:36.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:36.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:36.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:40:36.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:36.800 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:40:36.857 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:40:36.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:40:36.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:36.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:40:36.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:36.900 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:40:36.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:37.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.082+0000 7f6c7b722700 1 Processor -- start 2023-10-09T11:40:37.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.082+0000 7f6c7b722700 1 -- start start 2023-10-09T11:40:37.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c7b722700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c740ce5c0 0x7f6c740aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c7b722700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7415dfb0 con 0x7f6c740ce1f0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c7b722700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740acec0 con 0x7f6c740ac570 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c7b722700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c740ad1a0 con 0x7f6c740ce5c0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c794be700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c740ce1f0 0x7f6c7415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37814/0 (socket says 172.21.15.6:37814) 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c794be700 1 -- 172.21.15.6:0/1127710468 learned_addr learned my addr 172.21.15.6:0/1127710468 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.083+0000 7f6c78cbd700 1 --2- 172.21.15.6:0/1127710468 >> v2:172.21.15.6:3300/0 conn(0x7f6c740ce5c0 0x7f6c740aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c73fff700 1 -- 172.21.15.6:0/1127710468 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285587953 0 0) 0x7f6c7415dfb0 con 0x7f6c740ce1f0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c73fff700 1 -- 172.21.15.6:0/1127710468 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c5c003570 con 0x7f6c740ce1f0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c78cbd700 1 -- 172.21.15.6:0/1127710468 >> v1:172.21.15.118:6789/0 conn(0x7f6c740ac570 legacy=0x7f6c7406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c78cbd700 1 -- 172.21.15.6:0/1127710468 >> v1:172.21.15.6:6789/0 conn(0x7f6c740ce1f0 legacy=0x7f6c7415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c78cbd700 1 -- 172.21.15.6:0/1127710468 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7415dc40 con 0x7f6c740ce5c0 2023-10-09T11:40:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c78cbd700 1 --2- 172.21.15.6:0/1127710468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce5c0 0x7f6c740aacf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c680098e0 tx=0x7f6c680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0715cde6367cf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c73fff700 1 -- 172.21.15.6:0/1127710468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800b640 con 0x7f6c740ce5c0 2023-10-09T11:40:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c73fff700 1 -- 172.21.15.6:0/1127710468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6800b7a0 con 0x7f6c740ce5c0 2023-10-09T11:40:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.084+0000 7f6c73fff700 1 -- 172.21.15.6:0/1127710468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800bb40 con 0x7f6c740ce5c0 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 -- 172.21.15.6:0/1127710468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce5c0 msgr2=0x7f6c740aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 --2- 172.21.15.6:0/1127710468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce5c0 0x7f6c740aacf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c680098e0 tx=0x7f6c680091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 -- 172.21.15.6:0/1127710468 shutdown_connections 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 --2- 172.21.15.6:0/1127710468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce5c0 0x7f6c740aacf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 -- 172.21.15.6:0/1127710468 >> 172.21.15.6:0/1127710468 conn(0x7f6c7406cca0 msgr2=0x7f6c7406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 -- 172.21.15.6:0/1127710468 shutdown_connections 2023-10-09T11:40:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.085+0000 7f6c7b722700 1 -- 172.21.15.6:0/1127710468 wait complete. 2023-10-09T11:40:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.086+0000 7f6c7b722700 1 Processor -- start 2023-10-09T11:40:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.086+0000 7f6c7b722700 1 -- start start 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 0x7f6c74155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740ce5c0 0x7f6c74159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7416b910 con 0x7f6c740ce1f0 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7416b630 con 0x7f6c740ce5c0 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c7b722700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7416bc40 con 0x7f6c740ac570 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c78cbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c78cbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36642/0 (socket says 172.21.15.6:36642) 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c78cbd700 1 -- 172.21.15.6:0/3093538329 learned_addr learned my addr 172.21.15.6:0/3093538329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c79cbf700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740ce5c0 0x7f6c74159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.087+0000 7f6c794be700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 0x7f6c74155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 -- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 msgr2=0x7f6c74155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 0x7f6c74155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 -- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740ce5c0 msgr2=0x7f6c74159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740ce5c0 0x7f6c74159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009420 con 0x7f6c740ce1f0 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c794be700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 0x7f6c74155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c78cbd700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6c680093f0 tx=0x7f6c68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800bb20 con 0x7f6c740ce1f0 2023-10-09T11:40:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68011420 con 0x7f6c740ce1f0 2023-10-09T11:40:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680117e0 con 0x7f6c740ce1f0 2023-10-09T11:40:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7416bf20 con 0x7f6c740ce1f0 2023-10-09T11:40:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.088+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c74155d60 con 0x7f6c740ce1f0 2023-10-09T11:40:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.089+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7416c440 con 0x7f6c740ce1f0 2023-10-09T11:40:37.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.089+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c68011c10 con 0x7f6c740ce1f0 2023-10-09T11:40:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.090+0000 7f6c717fa700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 0x7f6c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.090+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c68085e20 con 0x7f6c740ce1f0 2023-10-09T11:40:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.090+0000 7f6c794be700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 0x7f6c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.090+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f6c6006ea50 con 0x7f6c740ce1f0 2023-10-09T11:40:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.090+0000 7f6c794be700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 0x7f6c600693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c74159ed0 tx=0x7f6c6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.094+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c7416c440 con 0x7f6c740ce1f0 2023-10-09T11:40:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.386+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c7416c440 con 0x7f6c740ce1f0 2023-10-09T11:40:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.387+0000 7f6c717fa700 1 -- 172.21.15.6:0/3093538329 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f6c7416c440 con 0x7f6c740ce1f0 2023-10-09T11:40:37.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:37.387 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 msgr2=0x7f6c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 0x7f6c600693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c74159ed0 tx=0x7f6c6c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 msgr2=0x7f6c74159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6c680093f0 tx=0x7f6c68017000 comp rx=0 tx=0).stop 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 shutdown_connections 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6c60066f30 0x7f6c600693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740ce5c0 0x7f6c74159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6c740ac570 0x7f6c74155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 --2- 172.21.15.6:0/3093538329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c740ce1f0 0x7f6c74159310 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 >> 172.21.15.6:0/3093538329 conn(0x7f6c7406cca0 msgr2=0x7f6c740699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 shutdown_connections 2023-10-09T11:40:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.389+0000 7f6c7b722700 1 -- 172.21.15.6:0/3093538329 wait complete. 2023-10-09T11:40:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:37.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.520+0000 7f3c1f59e700 1 Processor -- start 2023-10-09T11:40:37.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.520+0000 7f3c1f59e700 1 -- start start 2023-10-09T11:40:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c20164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200cee10 con 0x7f3c20159f10 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1f59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200cd040 con 0x7f3c20159b40 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1f59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200cd320 con 0x7f3c20068e90 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c20159f10 0x7f3c20068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37820/0 (socket says 172.21.15.6:37820) 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1dd9b700 1 -- 172.21.15.6:0/3606467000 learned_addr learned my addr 172.21.15.6:0/3606467000 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1ed9d700 1 --2- 172.21.15.6:0/3606467000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c20164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211115058 0 0) 0x7f3c200cee10 con 0x7f3c20159f10 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.521+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c003570 con 0x7f3c20159f10 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272203405 0 0) 0x7f3c200cd040 con 0x7f3c20159b40 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c200cee10 con 0x7f3c20159b40 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1ed9d700 1 -- 172.21.15.6:0/3606467000 >> v1:172.21.15.118:6789/0 conn(0x7f3c20159b40 legacy=0x7f3c200cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1ed9d700 1 -- 172.21.15.6:0/3606467000 >> v1:172.21.15.6:6789/0 conn(0x7f3c20159f10 legacy=0x7f3c20068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1ed9d700 1 -- 172.21.15.6:0/3606467000 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200ce7c0 con 0x7f3c20068e90 2023-10-09T11:40:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1ed9d700 1 --2- 172.21.15.6:0/3606467000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c20164c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009e90 tx=0x7f3c10009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a43cd36e99d258d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000e070 con 0x7f3c20068e90 2023-10-09T11:40:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1000bb80 con 0x7f3c20068e90 2023-10-09T11:40:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1d59a700 1 -- 172.21.15.6:0/3606467000 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012430 con 0x7f3c20068e90 2023-10-09T11:40:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1f59e700 1 -- 172.21.15.6:0/3606467000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 msgr2=0x7f3c20164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.522+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/3606467000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c20164c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009e90 tx=0x7f3c10009780 comp rx=0 tx=0).stop 2023-10-09T11:40:37.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.523+0000 7f3c1f59e700 1 -- 172.21.15.6:0/3606467000 shutdown_connections 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.523+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/3606467000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c20164c70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.523+0000 7f3c1f59e700 1 -- 172.21.15.6:0/3606467000 >> 172.21.15.6:0/3606467000 conn(0x7f3c200cd660 msgr2=0x7f3c200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.523+0000 7f3c1f59e700 1 -- 172.21.15.6:0/3606467000 shutdown_connections 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.523+0000 7f3c1f59e700 1 -- 172.21.15.6:0/3606467000 wait complete. 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 Processor -- start 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 -- start start 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c2016a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20159f10 0x7f3c2015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200c8f50 con 0x7f3c20159b40 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2016a8f0 con 0x7f3c20159f10 2023-10-09T11:40:37.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1f59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2016abd0 con 0x7f3c20068e90 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.524+0000 7f3c1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36652/0 (socket says 172.21.15.6:36652) 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 -- 172.21.15.6:0/925715232 learned_addr learned my addr 172.21.15.6:0/925715232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1ed9d700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20159f10 0x7f3c2015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1e59c700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c2016a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 -- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 msgr2=0x7f3c2016a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c2016a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 -- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20159f10 msgr2=0x7f3c2015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20159f10 0x7f3c2015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10009a20 con 0x7f3c20159b40 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1dd9b700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c790 tx=0x7f3c08007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08005b30 con 0x7f3c20159b40 2023-10-09T11:40:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08005c90 con 0x7f3c20159b40 2023-10-09T11:40:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2016aeb0 con 0x7f3c20159b40 2023-10-09T11:40:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08007300 con 0x7f3c20159b40 2023-10-09T11:40:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.525+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c201592c0 con 0x7f3c20159b40 2023-10-09T11:40:37.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.526+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c200c9170 con 0x7f3c20159b40 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c0801b3b0 con 0x7f3c20159b40 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c167fc700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 0x7f3c000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c08083960 con 0x7f3c20159b40 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c1e59c700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 0x7f3c000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f3c0006ea50 con 0x7f3c20159b40 2023-10-09T11:40:37.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.527+0000 7f3c1e59c700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 0x7f3c000693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c20155e60 tx=0x7f3c18007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.531+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c08017020 con 0x7f3c20159b40 2023-10-09T11:40:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.726+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c20063e90 con 0x7f3c20159b40 2023-10-09T11:40:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.727+0000 7f3c167fc700 1 -- 172.21.15.6:0/925715232 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+15348 (secure 0 0 0) 0x7f3c200c9170 con 0x7f3c20159b40 2023-10-09T11:40:37.728 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:37.728 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:13.989150+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 msgr2=0x7f3c000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 0x7f3c000693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c20155e60 tx=0x7f3c18007d50 comp rx=0 tx=0).stop 2023-10-09T11:40:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 msgr2=0x7f3c20158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c790 tx=0x7f3c08007ea0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 shutdown_connections 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3c00066f30 0x7f3c000693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20159f10 0x7f3c2015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3c20068e90 0x7f3c2016a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 --2- 172.21.15.6:0/925715232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c20159b40 0x7f3c20158d80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 >> 172.21.15.6:0/925715232 conn(0x7f3c200cd660 msgr2=0x7f3c2006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.729+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 shutdown_connections 2023-10-09T11:40:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.730+0000 7f3c1f59e700 1 -- 172.21.15.6:0/925715232 wait complete. 2023-10-09T11:40:37.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:39:53.738005+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:39:54.532996+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:40:37.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.864+0000 7f00ec8d1700 1 Processor -- start 2023-10-09T11:40:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.864+0000 7f00ec8d1700 1 -- start start 2023-10-09T11:40:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00ec8d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e81578d0 0x7f00e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00ec8d1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e8157ca0 0x7f00e815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00ec8d1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80d07c0 con 0x7f00e806d120 2023-10-09T11:40:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00ec8d1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80cfbb0 con 0x7f00e81578d0 2023-10-09T11:40:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00ec8d1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80cfe90 con 0x7f00e8157ca0 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e81578d0 0x7f00e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e81578d0 0x7f00e80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36662/0 (socket says 172.21.15.6:36662) 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 -- 172.21.15.6:0/3928070910 learned_addr learned my addr 172.21.15.6:0/3928070910 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e5d9b700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e8157ca0 0x7f00e815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 -- 172.21.15.6:0/3928070910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e8157ca0 msgr2=0x7f00e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e8157ca0 0x7f00e815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 -- 172.21.15.6:0/3928070910 >> v1:172.21.15.118:6789/0 conn(0x7f00e806d120 legacy=0x7f00e815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 -- 172.21.15.6:0/3928070910 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80d0170 con 0x7f00e81578d0 2023-10-09T11:40:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e659c700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e80cf4f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009f20 tx=0x7f00d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e91fde88b22015d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e559a700 1 -- 172.21.15.6:0/3928070910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800e070 con 0x7f00e81578d0 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e559a700 1 -- 172.21.15.6:0/3928070910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d800b9d0 con 0x7f00e81578d0 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.865+0000 7f00e559a700 1 -- 172.21.15.6:0/3928070910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80092e0 con 0x7f00e81578d0 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 -- 172.21.15.6:0/3928070910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 msgr2=0x7f00e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e80cf4f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009f20 tx=0x7f00d8009840 comp rx=0 tx=0).stop 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 -- 172.21.15.6:0/3928070910 shutdown_connections 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e80cf4f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/3928070910 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e8157ca0 0x7f00e815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 -- 172.21.15.6:0/3928070910 >> 172.21.15.6:0/3928070910 conn(0x7f00e806bb90 msgr2=0x7f00e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 -- 172.21.15.6:0/3928070910 shutdown_connections 2023-10-09T11:40:37.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.866+0000 7f00ec8d1700 1 -- 172.21.15.6:0/3928070910 wait complete. 2023-10-09T11:40:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.867+0000 7f00ec8d1700 1 Processor -- start 2023-10-09T11:40:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.867+0000 7f00ec8d1700 1 -- start start 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e806d120 0x7f00e814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 0x7f00e815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b4ce0 con 0x7f00e81578d0 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b4850 con 0x7f00e8157ca0 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00ec8d1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b3c40 con 0x7f00e806d120 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36678/0 (socket says 172.21.15.6:36678) 2023-10-09T11:40:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 -- 172.21.15.6:0/2671102069 learned_addr learned my addr 172.21.15.6:0/2671102069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e659c700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e806d120 0x7f00e814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e6d9d700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 0x7f00e815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 -- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e806d120 msgr2=0x7f00e814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e806d120 0x7f00e814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 -- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 msgr2=0x7f00e815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 0x7f00e815b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e5d9b700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8009ae0 con 0x7f00e81578d0 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.868+0000 7f00e6d9d700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 0x7f00e815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00e5d9b700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f00d000e930 tx=0x7f00d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0013680 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d00137e0 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0013b80 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e80b3f20 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.869+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e80b44e0 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.870+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80b49e0 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.870+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00d000c460 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.870+0000 7f00de7fc700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.871+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00d0084780 con 0x7f00e81578d0 2023-10-09T11:40:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.871+0000 7f00e659c700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.871+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f00c806ea50 con 0x7f00e81578d0 2023-10-09T11:40:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.871+0000 7f00e659c700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009880 tx=0x7f00d8018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:37.875+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00d0017060 con 0x7f00e81578d0 2023-10-09T11:40:38.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.069+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00e814b080 con 0x7f00e81578d0 2023-10-09T11:40:38.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.069+0000 7f00de7fc700 1 -- 172.21.15.6:0/2671102069 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00d0051950 con 0x7f00e81578d0 2023-10-09T11:40:38.070 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:40:38.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 msgr2=0x7f00c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009880 tx=0x7f00d8018000 comp rx=0 tx=0).stop 2023-10-09T11:40:38.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 msgr2=0x7f00e8153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f00d000e930 tx=0x7f00d00091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 shutdown_connections 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00e8157ca0 0x7f00e815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00e806d120 0x7f00e814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 --2- 172.21.15.6:0/2671102069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e81578d0 0x7f00e8153880 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 >> 172.21.15.6:0/2671102069 conn(0x7f00e806bb90 msgr2=0x7f00e806a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 shutdown_connections 2023-10-09T11:40:38.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.071+0000 7f00ec8d1700 1 -- 172.21.15.6:0/2671102069 wait complete. 2023-10-09T11:40:38.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:40:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.206+0000 7fc6cc38e700 1 Processor -- start 2023-10-09T11:40:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.206+0000 7fc6cc38e700 1 -- start start 2023-10-09T11:40:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.207+0000 7fc6cc38e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6cc38e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40d07c0 con 0x7fc6c406d120 2023-10-09T11:40:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6cc38e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40cfbb0 con 0x7fc6c4157ca0 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6cc38e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cfe90 con 0x7fc6c41578d0 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6ca92b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6c406d120 0x7fc6c415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37830/0 (socket says 172.21.15.6:37830) 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6ca92b700 1 -- 172.21.15.6:0/4034143809 learned_addr learned my addr 172.21.15.6:0/4034143809 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6ca12a700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123474833 0 0) 0x7fc6c40d07c0 con 0x7fc6c406d120 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b0003570 con 0x7fc6c406d120 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191624807 0 0) 0x7fc6b0003570 con 0x7fc6c406d120 2023-10-09T11:40:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 msgr2=0x7fc6c40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6c40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 >> v1:172.21.15.118:6789/0 conn(0x7fc6c4157ca0 legacy=0x7fc6c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40d0170 con 0x7fc6c406d120 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fc6bc0017f0 con 0x7fc6c406d120 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 >> v1:172.21.15.6:6789/0 conn(0x7fc6c406d120 legacy=0x7fc6c415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6b0003a90 0x7fc6b0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6b00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40cfe90 con 0x7fc6b0004810 2023-10-09T11:40:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b000bb60 con 0x7fc6b0003a90 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b000bd20 con 0x7fc6c41578d0 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.208+0000 7fc6c9929700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6ca12a700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6b0003a90 0x7fc6b0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6ca92b700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6b00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 -- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 msgr2=0x7fc6b00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c41578d0 0x7fc6b00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 -- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6b0003a90 msgr2=0x7fc6b0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6b0003a90 0x7fc6b0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 -- 172.21.15.6:0/4034143809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0003570 con 0x7fc6b0004810 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9929700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6b0004c80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40018b0 tx=0x7fc6b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f415053f4fea32e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4012420 con 0x7fc6b0004810 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4012580 con 0x7fc6b0004810 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.209+0000 7fc6c9128700 1 -- 172.21.15.6:0/4034143809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4012920 con 0x7fc6b0004810 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 -- 172.21.15.6:0/4034143809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 msgr2=0x7fc6b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/4034143809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6b0004c80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40018b0 tx=0x7fc6b4007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6ca92b700 1 -- 172.21.15.6:0/4034143809 reap_dead start 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 -- 172.21.15.6:0/4034143809 shutdown_connections 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 -- 172.21.15.6:0/4034143809 >> 172.21.15.6:0/4034143809 conn(0x7fc6c406bb90 msgr2=0x7fc6c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 -- 172.21.15.6:0/4034143809 shutdown_connections 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.210+0000 7fc6cc38e700 1 -- 172.21.15.6:0/4034143809 wait complete. 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.211+0000 7fc6cc38e700 1 Processor -- start 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.211+0000 7fc6cc38e700 1 -- start start 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.211+0000 7fc6cc38e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 0x7fc6c4154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 0x7fc6c4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41509c0 con 0x7fc6b0004810 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c414e430 con 0x7fc6c40b40a0 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b45a0 con 0x7fc6c40b3c30 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36694/0 (socket says 172.21.15.6:36694) 2023-10-09T11:40:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 -- 172.21.15.6:0/2821208582 learned_addr learned my addr 172.21.15.6:0/2821208582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6c9929700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 0x7fc6c4154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca92b700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 0x7fc6c4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 -- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 msgr2=0x7fc6c4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 0x7fc6c4154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 -- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 msgr2=0x7fc6c4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 0x7fc6c4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40b4880 con 0x7fc6b0004810 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca92b700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 0x7fc6c4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6c9929700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 0x7fc6c4154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ca12a700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0011d70 tx=0x7fc6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0009e20 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000fcd0 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40b4b60 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0014650 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.212+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40b6470 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.213+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c4150790 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6c0014a80 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6ba7fc700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 0x7fc6a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6c0018030 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6c9929700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 0x7fc6a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7fc6a806ea50 con 0x7fc6b0004810 2023-10-09T11:40:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.214+0000 7fc6c9929700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 0x7fc6a80693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6c416db80 tx=0x7fc6b4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.218+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6c4150790 con 0x7fc6b0004810 2023-10-09T11:40:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.409+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6c4150790 con 0x7fc6b0004810 2023-10-09T11:40:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.410+0000 7fc6ba7fc700 1 -- 172.21.15.6:0/2821208582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6c4150790 con 0x7fc6b0004810 2023-10-09T11:40:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:40:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 msgr2=0x7fc6a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 0x7fc6a80693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6c416db80 tx=0x7fc6b4015000 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 msgr2=0x7fc6c414def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0011d70 tx=0x7fc6c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 shutdown_connections 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc6a8066f30 0x7fc6a80693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6c40b40a0 0x7fc6c4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b0004810 0x7fc6c414def0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 --2- 172.21.15.6:0/2821208582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6c40b3c30 0x7fc6c4154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.411+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 >> 172.21.15.6:0/2821208582 conn(0x7fc6c406bb90 msgr2=0x7fc6c414ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.412+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 shutdown_connections 2023-10-09T11:40:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.412+0000 7fc6cc38e700 1 -- 172.21.15.6:0/2821208582 wait complete. 2023-10-09T11:40:38.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:40:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.551+0000 7f22aee71700 1 Processor -- start 2023-10-09T11:40:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.551+0000 7f22aee71700 1 -- start start 2023-10-09T11:40:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22aee71700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a8157fe0 0x7f22a80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22aee71700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22a81583b0 0x7f22a80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22aee71700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a80b2890 con 0x7f22a80ceb30 2023-10-09T11:40:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22aee71700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a80b4070 con 0x7f22a8157fe0 2023-10-09T11:40:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22aee71700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a80b4350 con 0x7f22a81583b0 2023-10-09T11:40:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22acc0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a8157fe0 0x7f22a80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22acc0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a8157fe0 0x7f22a80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36710/0 (socket says 172.21.15.6:36710) 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22ad40e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22a80ceb30 0x7f22a80cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37838/0 (socket says 172.21.15.6:37838) 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.552+0000 7f22acc0d700 1 -- 172.21.15.6:0/1622771935 learned_addr learned my addr 172.21.15.6:0/1622771935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22a7fff700 1 --2- 172.21.15.6:0/1622771935 >> v2:172.21.15.118:3300/0 conn(0x7f22a81583b0 0x7f22a80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22acc0d700 1 -- 172.21.15.6:0/1622771935 >> v2:172.21.15.118:3300/0 conn(0x7f22a81583b0 msgr2=0x7f22a80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22acc0d700 1 --2- 172.21.15.6:0/1622771935 >> v2:172.21.15.118:3300/0 conn(0x7f22a81583b0 0x7f22a80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22acc0d700 1 -- 172.21.15.6:0/1622771935 >> v1:172.21.15.6:6789/0 conn(0x7f22a80ceb30 legacy=0x7f22a80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22acc0d700 1 -- 172.21.15.6:0/1622771935 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80b4630 con 0x7f22a8157fe0 2023-10-09T11:40:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22a77fe700 1 -- 172.21.15.6:0/1622771935 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735589053 0 0) 0x7f22a80b2890 con 0x7f22a80ceb30 2023-10-09T11:40:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22acc0d700 1 --2- 172.21.15.6:0/1622771935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a8157fe0 0x7f22a80b34c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f22a804c150 tx=0x7f22a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77e010804f73450 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22a77fe700 1 -- 172.21.15.6:0/1622771935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000e070 con 0x7f22a8157fe0 2023-10-09T11:40:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22a77fe700 1 -- 172.21.15.6:0/1622771935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000ba50 con 0x7f22a8157fe0 2023-10-09T11:40:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.553+0000 7f22a77fe700 1 -- 172.21.15.6:0/1622771935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00092e0 con 0x7f22a8157fe0 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 -- 172.21.15.6:0/1622771935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a8157fe0 msgr2=0x7f22a80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 --2- 172.21.15.6:0/1622771935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a8157fe0 0x7f22a80b34c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f22a804c150 tx=0x7f22a0009840 comp rx=0 tx=0).stop 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 -- 172.21.15.6:0/1622771935 shutdown_connections 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 --2- 172.21.15.6:0/1622771935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a8157fe0 0x7f22a80b34c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 --2- 172.21.15.6:0/1622771935 >> v2:172.21.15.118:3300/0 conn(0x7f22a81583b0 0x7f22a80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 -- 172.21.15.6:0/1622771935 >> 172.21.15.6:0/1622771935 conn(0x7f22a8067640 msgr2=0x7f22a8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 -- 172.21.15.6:0/1622771935 shutdown_connections 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.554+0000 7f22aee71700 1 -- 172.21.15.6:0/1622771935 wait complete. 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.555+0000 7f22aee71700 1 Processor -- start 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.555+0000 7f22aee71700 1 -- start start 2023-10-09T11:40:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22a80ceb30 0x7f22a8168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 0x7f22a81690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8168540 con 0x7f22a81583b0 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a816a720 con 0x7f22a8157fe0 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22aee71700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8169620 con 0x7f22a80ceb30 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36724/0 (socket says 172.21.15.6:36724) 2023-10-09T11:40:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 -- 172.21.15.6:0/560709249 learned_addr learned my addr 172.21.15.6:0/560709249 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22a7fff700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 0x7f22a81690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22acc0d700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22a80ceb30 0x7f22a8168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 -- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22a80ceb30 msgr2=0x7f22a8168000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22a80ceb30 0x7f22a8168000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 -- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 msgr2=0x7f22a81690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 0x7f22a81690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009ae0 con 0x7f22a81583b0 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22a7fff700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 0x7f22a81690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22ad40e700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f229800c500 tx=0x7f2298007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.556+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298005a70 con 0x7f22a81583b0 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.557+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2298005bd0 con 0x7f22a81583b0 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.557+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a8169830 con 0x7f22a81583b0 2023-10-09T11:40:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.557+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22980070d0 con 0x7f22a81583b0 2023-10-09T11:40:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.557+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a8169df0 con 0x7f22a81583b0 2023-10-09T11:40:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.558+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a816a890 con 0x7f22a81583b0 2023-10-09T11:40:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.558+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2298007440 con 0x7f22a81583b0 2023-10-09T11:40:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.558+0000 7f22a4ff9700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.559+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2298083890 con 0x7f22a81583b0 2023-10-09T11:40:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.559+0000 7f22acc0d700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.559+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f229406ea50 con 0x7f22a81583b0 2023-10-09T11:40:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.559+0000 7f22acc0d700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009ab0 tx=0x7f22a0018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.563+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2298017070 con 0x7f22a81583b0 2023-10-09T11:40:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.755+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22a80cc6b0 con 0x7f22a81583b0 2023-10-09T11:40:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.755+0000 7f22a4ff9700 1 -- 172.21.15.6:0/560709249 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2298050b00 con 0x7f22a81583b0 2023-10-09T11:40:38.756 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:40:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 msgr2=0x7f22940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 0x7f22940693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009ab0 tx=0x7f22a0018000 comp rx=0 tx=0).stop 2023-10-09T11:40:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 msgr2=0x7f22a80ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f229800c500 tx=0x7f2298007f60 comp rx=0 tx=0).stop 2023-10-09T11:40:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 shutdown_connections 2023-10-09T11:40:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2294066f30 0x7f22940693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a81583b0 0x7f22a80ccaa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22a80ceb30 0x7f22a8168000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 --2- 172.21.15.6:0/560709249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a8157fe0 0x7f22a81690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 >> 172.21.15.6:0/560709249 conn(0x7f22a8067640 msgr2=0x7f22a80cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 shutdown_connections 2023-10-09T11:40:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.757+0000 7f22aee71700 1 -- 172.21.15.6:0/560709249 wait complete. 2023-10-09T11:40:38.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.892+0000 7fa6b9e1e700 1 Processor -- start 2023-10-09T11:40:38.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.892+0000 7fa6b9e1e700 1 -- start start 2023-10-09T11:40:38.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b9e1e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b40ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b9e1e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6b41583b0 0x7fa6b40cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b9e1e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b40b2890 con 0x7fa6b4157fe0 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b9e1e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40b4070 con 0x7fa6b41583b0 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b9e1e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40b4350 con 0x7fa6b40b3bd0 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6b41583b0 0x7fa6b40cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6b41583b0 0x7fa6b40cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36738/0 (socket says 172.21.15.6:36738) 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.893+0000 7fa6b3fff700 1 -- 172.21.15.6:0/1420672509 learned_addr learned my addr 172.21.15.6:0/1420672509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b2ffd700 1 --2- 172.21.15.6:0/1420672509 >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b3fff700 1 -- 172.21.15.6:0/1420672509 >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 msgr2=0x7fa6b40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b3fff700 1 --2- 172.21.15.6:0/1420672509 >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b3fff700 1 -- 172.21.15.6:0/1420672509 >> v1:172.21.15.118:6789/0 conn(0x7fa6b4157fe0 legacy=0x7fa6b40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b3fff700 1 -- 172.21.15.6:0/1420672509 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40b4630 con 0x7fa6b41583b0 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b2ffd700 1 --2- 172.21.15.6:0/1420672509 >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b40ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b3fff700 1 --2- 172.21.15.6:0/1420672509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b41583b0 0x7fa6b40cf070 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa6b404c150 tx=0x7fa6ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ec36d77e58cf18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b27fc700 1 -- 172.21.15.6:0/1420672509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac00e070 con 0x7fa6b41583b0 2023-10-09T11:40:38.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b27fc700 1 -- 172.21.15.6:0/1420672509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac00ba50 con 0x7fa6b41583b0 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b27fc700 1 -- 172.21.15.6:0/1420672509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0092e0 con 0x7fa6b41583b0 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.894+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/1420672509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b41583b0 msgr2=0x7fa6b40cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/1420672509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b41583b0 0x7fa6b40cf070 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa6b404c150 tx=0x7fa6ac009840 comp rx=0 tx=0).stop 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/1420672509 shutdown_connections 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/1420672509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b41583b0 0x7fa6b40cf070 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/1420672509 >> v2:172.21.15.118:3300/0 conn(0x7fa6b40b3bd0 0x7fa6b40ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/1420672509 >> 172.21.15.6:0/1420672509 conn(0x7fa6b4067640 msgr2=0x7fa6b4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/1420672509 shutdown_connections 2023-10-09T11:40:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.895+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/1420672509 wait complete. 2023-10-09T11:40:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.896+0000 7fa6b9e1e700 1 Processor -- start 2023-10-09T11:40:38.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.896+0000 7fa6b9e1e700 1 -- start start 2023-10-09T11:40:38.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6b40b3bd0 0x7fa6b4147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6b41583b0 0x7fa6b40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40c9f30 con 0x7fa6b4157fe0 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b406d7e0 con 0x7fa6b40b3bd0 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b406ce40 con 0x7fa6b41583b0 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36748/0 (socket says 172.21.15.6:36748) 2023-10-09T11:40:38.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 -- 172.21.15.6:0/2450205661 learned_addr learned my addr 172.21.15.6:0/2450205661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b37fe700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6b40b3bd0 0x7fa6b4147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b3fff700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6b41583b0 0x7fa6b40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 -- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6b41583b0 msgr2=0x7fa6b40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6b41583b0 0x7fa6b40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 -- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6b40b3bd0 msgr2=0x7fa6b4147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6b40b3bd0 0x7fa6b4147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:38.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac009ae0 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b2ffd700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800d890 tx=0x7fa6a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80125f0 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8012750 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b406d120 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8012b10 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.897+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b4155080 con 0x7fa6b4157fe0 2023-10-09T11:40:38.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.898+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b406d920 con 0x7fa6b4157fe0 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.899+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6a8014430 con 0x7fa6b4157fe0 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.899+0000 7fa69b7fe700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.899+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6a80848a0 con 0x7fa6b4157fe0 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.899+0000 7fa6b37fe700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.899+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7fa6a006ea50 con 0x7fa6b4157fe0 2023-10-09T11:40:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.900+0000 7fa6b37fe700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 0x7fa6a00693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4003a80 tx=0x7fa6a4007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:38.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:38.903+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6b406d920 con 0x7fa6b4157fe0 2023-10-09T11:40:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.141+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6b406d920 con 0x7fa6b4157fe0 2023-10-09T11:40:39.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.141+0000 7fa69b7fe700 1 -- 172.21.15.6:0/2450205661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa6b406d920 con 0x7fa6b4157fe0 2023-10-09T11:40:39.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:39.143 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 msgr2=0x7fa6a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 0x7fa6a00693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4003a80 tx=0x7fa6a4007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 msgr2=0x7fa6b4154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800d890 tx=0x7fa6a8008040 comp rx=0 tx=0).stop 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 shutdown_connections 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6a0066f30 0x7fa6a00693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6b41583b0 0x7fa6b40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6b40b3bd0 0x7fa6b4147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.143+0000 7fa6b9e1e700 1 --2- 172.21.15.6:0/2450205661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b4157fe0 0x7fa6b4154b40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.144+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 >> 172.21.15.6:0/2450205661 conn(0x7fa6b4067640 msgr2=0x7fa6b4156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.144+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 shutdown_connections 2023-10-09T11:40:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.144+0000 7fa6b9e1e700 1 -- 172.21.15.6:0/2450205661 wait complete. 2023-10-09T11:40:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:39.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:39.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.275+0000 7ff5c811e700 1 Processor -- start 2023-10-09T11:40:39.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.276+0000 7ff5c811e700 1 -- start start 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.276+0000 7ff5c811e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5c0157ca0 0x7ff5c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.276+0000 7ff5c811e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c00d07c0 con 0x7ff5c01578d0 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.276+0000 7ff5c811e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c00cfbb0 con 0x7ff5c006d120 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.276+0000 7ff5c811e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00cfe90 con 0x7ff5c0157ca0 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c5eba700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5c01578d0 0x7ff5c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37852/0 (socket says 172.21.15.6:37852) 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c5eba700 1 -- 172.21.15.6:0/1590399908 learned_addr learned my addr 172.21.15.6:0/1590399908 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c56b9700 1 --2- 172.21.15.6:0/1590399908 >> v2:172.21.15.118:3300/0 conn(0x7ff5c0157ca0 0x7ff5c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905800719 0 0) 0x7ff5c00d07c0 con 0x7ff5c01578d0 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a8003570 con 0x7ff5c01578d0 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659593269 0 0) 0x7ff5c00cfbb0 con 0x7ff5c006d120 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c00d07c0 con 0x7ff5c006d120 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c56b9700 1 -- 172.21.15.6:0/1590399908 >> v1:172.21.15.118:6789/0 conn(0x7ff5c006d120 legacy=0x7ff5c006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c56b9700 1 -- 172.21.15.6:0/1590399908 >> v1:172.21.15.6:6789/0 conn(0x7ff5c01578d0 legacy=0x7ff5c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c56b9700 1 -- 172.21.15.6:0/1590399908 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00d0170 con 0x7ff5c0157ca0 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c56b9700 1 --2- 172.21.15.6:0/1590399908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0157ca0 0x7ff5c00cf4f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40098e0 tx=0x7ff5b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a5e64e74cf7364 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011630 con 0x7ff5c0157ca0 2023-10-09T11:40:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4011790 con 0x7ff5c0157ca0 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.277+0000 7ff5c4eb8700 1 -- 172.21.15.6:0/1590399908 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011b30 con 0x7ff5c0157ca0 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 -- 172.21.15.6:0/1590399908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0157ca0 msgr2=0x7ff5c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 --2- 172.21.15.6:0/1590399908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0157ca0 0x7ff5c00cf4f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40098e0 tx=0x7ff5b40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 -- 172.21.15.6:0/1590399908 shutdown_connections 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 --2- 172.21.15.6:0/1590399908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c0157ca0 0x7ff5c00cf4f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 -- 172.21.15.6:0/1590399908 >> 172.21.15.6:0/1590399908 conn(0x7ff5c006bb90 msgr2=0x7ff5c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 -- 172.21.15.6:0/1590399908 shutdown_connections 2023-10-09T11:40:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.278+0000 7ff5c811e700 1 -- 172.21.15.6:0/1590399908 wait complete. 2023-10-09T11:40:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.279+0000 7ff5c811e700 1 Processor -- start 2023-10-09T11:40:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.279+0000 7ff5c811e700 1 -- start start 2023-10-09T11:40:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c01578d0 0x7ff5c013d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5c0157ca0 0x7ff5c016dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0158e50 con 0x7ff5c006d120 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0159e00 con 0x7ff5c01578d0 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c811e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0159970 con 0x7ff5c0157ca0 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36750/0 (socket says 172.21.15.6:36750) 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 -- 172.21.15.6:0/2368337973 learned_addr learned my addr 172.21.15.6:0/2368337973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c56b9700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c01578d0 0x7ff5c013d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c66bb700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5c0157ca0 0x7ff5c016dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 -- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5c0157ca0 msgr2=0x7ff5c016dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5c0157ca0 0x7ff5c016dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 -- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c01578d0 msgr2=0x7ff5c013d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c01578d0 0x7ff5c013d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.280+0000 7ff5c5eba700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009420 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5c5eba700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000c7c0 tx=0x7ff5b0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0005b30 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b0005c90 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0159040 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0007300 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.281+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c0159600 con 0x7ff5c006d120 2023-10-09T11:40:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.282+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0067ac0 con 0x7ff5c006d120 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.282+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5b001b3b0 con 0x7ff5c006d120 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.283+0000 7ff5bdffb700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 0x7ff5ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.283+0000 7ff5c56b9700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 0x7ff5ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.283+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5b0083ac0 con 0x7ff5c006d120 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.283+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7ff5ac06ea50 con 0x7ff5c006d120 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.283+0000 7ff5c56b9700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 0x7ff5ac0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff5c01580c0 tx=0x7ff5b4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.287+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5b0017020 con 0x7ff5c006d120 2023-10-09T11:40:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.481+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c00d0450 con 0x7ff5c006d120 2023-10-09T11:40:39.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.482+0000 7ff5bdffb700 1 -- 172.21.15.6:0/2368337973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+15348 (secure 0 0 0) 0x7ff5b0050c90 con 0x7ff5c006d120 2023-10-09T11:40:39.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:39.483 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:13.989150+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 msgr2=0x7ff5ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 0x7ff5ac0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff5c01580c0 tx=0x7ff5b4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 msgr2=0x7ff5c014db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000c7c0 tx=0x7ff5b0007ea0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 shutdown_connections 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ac066f30 0x7ff5ac0693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5c0157ca0 0x7ff5c016dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c006d120 0x7ff5c014db10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 --2- 172.21.15.6:0/2368337973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5c01578d0 0x7ff5c013d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 >> 172.21.15.6:0/2368337973 conn(0x7ff5c006bb90 msgr2=0x7ff5c006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 shutdown_connections 2023-10-09T11:40:39.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.484+0000 7ff5c811e700 1 -- 172.21.15.6:0/2368337973 wait complete. 2023-10-09T11:40:39.497 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:40:39.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.615+0000 7f71e64e5700 1 Processor -- start 2023-10-09T11:40:39.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.615+0000 7f71e64e5700 1 -- start start 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e64e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71e0159f10 0x7f71e0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e64e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0068cc0 0x7f71e00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e64e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00cee10 con 0x7f71e0159b40 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e64e5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e0069140 con 0x7f71e0159f10 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e64e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00cd040 con 0x7f71e0068cc0 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71e0159f10 0x7f71e0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e54e3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f71e0159b40 0x7f71e00cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37858/0 (socket says 172.21.15.6:37858) 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71e0159f10 0x7f71e0068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36762/0 (socket says 172.21.15.6:36762) 2023-10-09T11:40:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e54e3700 1 -- 172.21.15.6:0/3174933274 learned_addr learned my addr 172.21.15.6:0/3174933274 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e5ce4700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0068cc0 0x7f71e00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 -- 172.21.15.6:0/3174933274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0068cc0 msgr2=0x7f71e00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0068cc0 0x7f71e00cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 -- 172.21.15.6:0/3174933274 >> v1:172.21.15.6:6789/0 conn(0x7f71e0159b40 legacy=0x7f71e00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71e4ce2700 1 -- 172.21.15.6:0/3174933274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00cd320 con 0x7f71e0159f10 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.616+0000 7f71dffff700 1 -- 172.21.15.6:0/3174933274 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520650511 0 0) 0x7f71e00cee10 con 0x7f71e0159b40 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0159f10 0x7f71e0068780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098e0 tx=0x7f71d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a039b54fd878c905 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71dffff700 1 -- 172.21.15.6:0/3174933274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4009e80 con 0x7f71e0159f10 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71dffff700 1 -- 172.21.15.6:0/3174933274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400b860 con 0x7f71e0159f10 2023-10-09T11:40:39.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71dffff700 1 -- 172.21.15.6:0/3174933274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400bbe0 con 0x7f71e0159f10 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 -- 172.21.15.6:0/3174933274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0159f10 msgr2=0x7f71e0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0159f10 0x7f71e0068780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098e0 tx=0x7f71d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 -- 172.21.15.6:0/3174933274 shutdown_connections 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0068cc0 0x7f71e00cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 --2- 172.21.15.6:0/3174933274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0159f10 0x7f71e0068780 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 -- 172.21.15.6:0/3174933274 >> 172.21.15.6:0/3174933274 conn(0x7f71e00cd660 msgr2=0x7f71e00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 -- 172.21.15.6:0/3174933274 shutdown_connections 2023-10-09T11:40:39.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.617+0000 7f71e64e5700 1 -- 172.21.15.6:0/3174933274 wait complete. 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.618+0000 7f71e64e5700 1 Processor -- start 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.618+0000 7f71e64e5700 1 -- start start 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 0x7f71e015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 0x7f71e00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8c70 con 0x7f71e0068cc0 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c9ad0 con 0x7f71e0159f10 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e64e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8ec0 con 0x7f71e0159b40 2023-10-09T11:40:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e54e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e54e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36768/0 (socket says 172.21.15.6:36768) 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.619+0000 7f71e54e3700 1 -- 172.21.15.6:0/2012817239 learned_addr learned my addr 172.21.15.6:0/2012817239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 0x7f71e015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e5ce4700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 0x7f71e00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 -- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 msgr2=0x7f71e015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 0x7f71e015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 -- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 msgr2=0x7f71e00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 0x7f71e00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009420 con 0x7f71e0068cc0 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 0x7f71e015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e5ce4700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 0x7f71e00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e54e3700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c7e0 tx=0x7f71d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8005b30 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8005c90 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8007300 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00c91a0 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.620+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e00c9760 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.621+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e00cca10 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.621+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71d801b400 con 0x7f71e0068cc0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.622+0000 7f71dd7fa700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.622+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.622+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71d80840b0 con 0x7f71e0068cc0 2023-10-09T11:40:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.622+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7f71cc06ea50 con 0x7f71e0068cc0 2023-10-09T11:40:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.622+0000 7f71e4ce2700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 0x7f71cc0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f71d40091e0 tx=0x7f71d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.626+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71d80513a0 con 0x7f71e0068cc0 2023-10-09T11:40:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.865+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71e00c9db0 con 0x7f71e0068cc0 2023-10-09T11:40:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.866+0000 7f71dd7fa700 1 -- 172.21.15.6:0/2012817239 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f71d80549c0 con 0x7f71e0068cc0 2023-10-09T11:40:39.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:39.867 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 msgr2=0x7f71cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 0x7f71cc0693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f71d40091e0 tx=0x7f71d4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 msgr2=0x7f71e014fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c7e0 tx=0x7f71d8007df0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 shutdown_connections 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71e0159f10 0x7f71e00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71e0068cc0 0x7f71e014fcd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 --2- 172.21.15.6:0/2012817239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71e0159b40 0x7f71e015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 >> 172.21.15.6:0/2012817239 conn(0x7f71e00cd660 msgr2=0x7f71e00cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 shutdown_connections 2023-10-09T11:40:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.868+0000 7f71e64e5700 1 -- 172.21.15.6:0/2012817239 wait complete. 2023-10-09T11:40:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:39.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.999+0000 7fa1e170e700 1 Processor -- start 2023-10-09T11:40:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:39.999+0000 7fa1e170e700 1 -- start start 2023-10-09T11:40:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1e170e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1dc159a90 0x7fa1dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1e170e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc0691f0 0x7fa1dc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1e170e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc06e280 con 0x7fa1dc159e60 2023-10-09T11:40:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1e170e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc068d60 con 0x7fa1dc159a90 2023-10-09T11:40:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1e170e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc06dfa0 con 0x7fa1dc0691f0 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1daffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1dc159a90 0x7fa1dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1da7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1dc159e60 0x7fa1dc06a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37872/0 (socket says 172.21.15.6:37872) 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1da7fc700 1 -- 172.21.15.6:0/3247908627 learned_addr learned my addr 172.21.15.6:0/3247908627 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1db7fe700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc0691f0 0x7fa1dc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1daffd700 1 -- 172.21.15.6:0/3247908627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc0691f0 msgr2=0x7fa1dc0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1daffd700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc0691f0 0x7fa1dc0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1daffd700 1 -- 172.21.15.6:0/3247908627 >> v1:172.21.15.6:6789/0 conn(0x7fa1dc159e60 legacy=0x7fa1dc06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1d9ffb700 1 -- 172.21.15.6:0/3247908627 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718876392 0 0) 0x7fa1dc06e280 con 0x7fa1dc159e60 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.000+0000 7fa1daffd700 1 -- 172.21.15.6:0/3247908627 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc068710 con 0x7fa1dc159a90 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1daffd700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc06d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40098e0 tx=0x7fa1d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9a0a4223c872ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1d9ffb700 1 -- 172.21.15.6:0/3247908627 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4009e80 con 0x7fa1dc159a90 2023-10-09T11:40:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1d9ffb700 1 -- 172.21.15.6:0/3247908627 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400b860 con 0x7fa1dc159a90 2023-10-09T11:40:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1d9ffb700 1 -- 172.21.15.6:0/3247908627 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d400bbe0 con 0x7fa1dc159a90 2023-10-09T11:40:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 -- 172.21.15.6:0/3247908627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 msgr2=0x7fa1dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc06d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40098e0 tx=0x7fa1d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 -- 172.21.15.6:0/3247908627 shutdown_connections 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc0691f0 0x7fa1dc0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 --2- 172.21.15.6:0/3247908627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc06d990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 -- 172.21.15.6:0/3247908627 >> 172.21.15.6:0/3247908627 conn(0x7fa1dc06bb90 msgr2=0x7fa1dc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 -- 172.21.15.6:0/3247908627 shutdown_connections 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.001+0000 7fa1e170e700 1 -- 172.21.15.6:0/3247908627 wait complete. 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 Processor -- start 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 -- start start 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1dc0691f0 0x7fa1dc13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc159e60 0x7fa1dc157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc153db0 con 0x7fa1dc159a90 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc13bae0 con 0x7fa1dc0691f0 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1e170e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc152ec0 con 0x7fa1dc159e60 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1da7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1da7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36786/0 (socket says 172.21.15.6:36786) 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1da7fc700 1 -- 172.21.15.6:0/114143814 learned_addr learned my addr 172.21.15.6:0/114143814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.003+0000 7fa1db7fe700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc159e60 0x7fa1dc157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1daffd700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1dc0691f0 0x7fa1dc13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 -- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc159e60 msgr2=0x7fa1dc157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc159e60 0x7fa1dc157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 -- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1dc0691f0 msgr2=0x7fa1dc13b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1dc0691f0 0x7fa1dc13b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4009420 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1da7fc700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c5b0 tx=0x7fa1c4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4005b30 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4005c90 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc1531a0 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4007300 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.004+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc153760 con 0x7fa1dc159a90 2023-10-09T11:40:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.005+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc067640 con 0x7fa1dc159a90 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.005+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1c401b3b0 con 0x7fa1dc159a90 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.006+0000 7fa1d2ffd700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 0x7fa1bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.006+0000 7fa1daffd700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 0x7fa1bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.006+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1c4083960 con 0x7fa1dc159a90 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.006+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=84}) v3 -- 0x7fa1bc06ea50 con 0x7fa1dc159a90 2023-10-09T11:40:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.006+0000 7fa1daffd700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 0x7fa1bc0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40093a0 tx=0x7fa1d4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.010+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1c4017060 con 0x7fa1dc159a90 2023-10-09T11:40:40.037 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:40:40.037+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-09T11:40:40.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.041+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(84..84 src has 1..84) v4 ==== 296+0+0 (secure 0 0 0) 0x7fa1c4054f90 con 0x7fa1dc159a90 2023-10-09T11:40:40.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.041+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7fa1bc06f3a0 con 0x7fa1dc159a90 2023-10-09T11:40:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.252+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1dc0689f0 con 0x7fa1dc159a90 2023-10-09T11:40:40.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.252+0000 7fa1d2ffd700 1 -- 172.21.15.6:0/114143814 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa1c40541f0 con 0x7fa1dc159a90 2023-10-09T11:40:40.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:40.254 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:39:55.562505+0000","modified":"2023-10-09T11:39:59.173680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6834/2962892052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2962892052},{"type":"v1","addr":"172.21.15.118:6834","nonce":2962892052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T11:40:40.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 msgr2=0x7fa1bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 0x7fa1bc0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40093a0 tx=0x7fa1d4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 msgr2=0x7fa1dc154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c5b0 tx=0x7fa1c4001070 comp rx=0 tx=0).stop 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 shutdown_connections 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa1bc066f30 0x7fa1bc0693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1dc159e60 0x7fa1dc157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1dc0691f0 0x7fa1dc13b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 --2- 172.21.15.6:0/114143814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1dc159a90 0x7fa1dc154240 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 >> 172.21.15.6:0/114143814 conn(0x7fa1dc06bb90 msgr2=0x7fa1dc06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.254+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 shutdown_connections 2023-10-09T11:40:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.255+0000 7fa1e170e700 1 -- 172.21.15.6:0/114143814 wait complete. 2023-10-09T11:40:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 43 2023-10-09T11:40:40.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:40.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.386+0000 7fc36650a700 1 Processor -- start 2023-10-09T11:40:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.386+0000 7fc36650a700 1 -- start start 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3601578d0 0x7fc3600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 0x7fc36015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36006d120 0x7fc36006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36006dac0 con 0x7fc36006d120 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600d07c0 con 0x7fc360157ca0 2023-10-09T11:40:40.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc36650a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600cfbb0 con 0x7fc3601578d0 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36006d120 0x7fc36006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36006d120 0x7fc36006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36796/0 (socket says 172.21.15.6:36796) 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 -- 172.21.15.6:0/3910345644 learned_addr learned my addr 172.21.15.6:0/3910345644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc35f7fe700 1 --2- 172.21.15.6:0/3910345644 >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 0x7fc36015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc35ffff700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3601578d0 0x7fc3600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 -- 172.21.15.6:0/3910345644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3601578d0 msgr2=0x7fc3600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3601578d0 0x7fc3600cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 -- 172.21.15.6:0/3910345644 >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 msgr2=0x7fc36015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:40.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 --2- 172.21.15.6:0/3910345644 >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 0x7fc36015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 -- 172.21.15.6:0/3910345644 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600cfe90 con 0x7fc36006d120 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc35f7fe700 1 --2- 172.21.15.6:0/3910345644 >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 0x7fc36015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.387+0000 7fc364aa7700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36006d120 0x7fc36006d580 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc36006cb70 tx=0x7fc358009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7c3e101bc1744 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc35effd700 1 -- 172.21.15.6:0/3910345644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800e070 con 0x7fc36006d120 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc35effd700 1 -- 172.21.15.6:0/3910345644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800ba50 con 0x7fc36006d120 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc35effd700 1 -- 172.21.15.6:0/3910345644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580092e0 con 0x7fc36006d120 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 -- 172.21.15.6:0/3910345644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36006d120 msgr2=0x7fc36006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36006d120 0x7fc36006d580 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc36006cb70 tx=0x7fc358009840 comp rx=0 tx=0).stop 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 -- 172.21.15.6:0/3910345644 shutdown_connections 2023-10-09T11:40:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36006d120 0x7fc36006d580 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 --2- 172.21.15.6:0/3910345644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3601578d0 0x7fc3600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 --2- 172.21.15.6:0/3910345644 >> v2:172.21.15.118:3300/0 conn(0x7fc360157ca0 0x7fc36015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 -- 172.21.15.6:0/3910345644 >> 172.21.15.6:0/3910345644 conn(0x7fc36006bb90 msgr2=0x7fc36006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 -- 172.21.15.6:0/3910345644 shutdown_connections 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.388+0000 7fc36650a700 1 -- 172.21.15.6:0/3910345644 wait complete. 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.389+0000 7fc36650a700 1 Processor -- start 2023-10-09T11:40:40.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.389+0000 7fc36650a700 1 -- start start 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 0x7fc36016b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 0x7fc36016b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36016bd90 con 0x7fc360157ca0 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36016cbb0 con 0x7fc3601578d0 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc36650a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36016bfa0 con 0x7fc36006d120 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc364aa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc364aa7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36810/0 (socket says 172.21.15.6:36810) 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.390+0000 7fc364aa7700 1 -- 172.21.15.6:0/442689607 learned_addr learned my addr 172.21.15.6:0/442689607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc35f7fe700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 0x7fc36016b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc35ffff700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 0x7fc36016b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 -- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 msgr2=0x7fc36016b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 0x7fc36016b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 -- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 msgr2=0x7fc36016b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 0x7fc36016b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009ae0 con 0x7fc360157ca0 2023-10-09T11:40:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc35f7fe700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 0x7fc36016b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc35ffff700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 0x7fc36016b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc364aa7700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc36006fe20 tx=0x7fc358018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580032f0 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358008e80 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36016c280 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358026690 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.391+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36016c840 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.392+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360067ac0 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.392+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc358003040 con 0x7fc360157ca0 2023-10-09T11:40:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.393+0000 7fc357fff700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.393+0000 7fc35ffff700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.393+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc358086180 con 0x7fc360157ca0 2023-10-09T11:40:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.393+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7fc34006ea50 con 0x7fc360157ca0 2023-10-09T11:40:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.393+0000 7fc35ffff700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 0x7fc3400693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc348008a80 tx=0x7fc348008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.397+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3580534a0 con 0x7fc360157ca0 2023-10-09T11:40:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.588+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc36016ccf0 con 0x7fc360157ca0 2023-10-09T11:40:40.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.589+0000 7fc357fff700 1 -- 172.21.15.6:0/442689607 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15334 (secure 0 0 0) 0x7fc358021020 con 0x7fc360157ca0 2023-10-09T11:40:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:40.038014+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:39:53.738005+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T11:39:54.532996+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 msgr2=0x7fc3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 0x7fc3400693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc348008a80 tx=0x7fc348008040 comp rx=0 tx=0).stop 2023-10-09T11:40:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 msgr2=0x7fc3601682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc36006fe20 tx=0x7fc358018000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 shutdown_connections 2023-10-09T11:40:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc340066f30 0x7fc3400693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc360157ca0 0x7fc3601682c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc36006d120 0x7fc36016b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 --2- 172.21.15.6:0/442689607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3601578d0 0x7fc36016b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 >> 172.21.15.6:0/442689607 conn(0x7fc36006bb90 msgr2=0x7fc360068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 shutdown_connections 2023-10-09T11:40:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.591+0000 7fc36650a700 1 -- 172.21.15.6:0/442689607 wait complete. 2023-10-09T11:40:40.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:40:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.724+0000 7fb2c4d20700 1 Processor -- start 2023-10-09T11:40:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.724+0000 7fb2c4d20700 1 -- start start 2023-10-09T11:40:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2c4d20700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2c0069120 0x7fb2c006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2c4d20700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c015bc10 con 0x7fb2c0157ab0 2023-10-09T11:40:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2c4d20700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c015c7b0 con 0x7fb2c006c0d0 2023-10-09T11:40:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2c4d20700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c006c510 con 0x7fb2c0069120 2023-10-09T11:40:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2be59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2c0157ab0 0x7fb2c015c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37886/0 (socket says 172.21.15.6:37886) 2023-10-09T11:40:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2be59c700 1 -- 172.21.15.6:0/1485581491 learned_addr learned my addr 172.21.15.6:0/1485581491 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.725+0000 7fb2bdd9b700 1 --2- 172.21.15.6:0/1485581491 >> v2:172.21.15.118:3300/0 conn(0x7fb2c0069120 0x7fb2c006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bd59a700 1 -- 172.21.15.6:0/1485581491 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445262591 0 0) 0x7fb2c015bc10 con 0x7fb2c0157ab0 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bd59a700 1 -- 172.21.15.6:0/1485581491 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ac003570 con 0x7fb2c0157ab0 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/1485581491 >> v1:172.21.15.118:6789/0 conn(0x7fb2c006c0d0 legacy=0x7fb2c006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/1485581491 >> v1:172.21.15.6:6789/0 conn(0x7fb2c0157ab0 legacy=0x7fb2c015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/1485581491 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0158ba0 con 0x7fb2c0069120 2023-10-09T11:40:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bdd9b700 1 --2- 172.21.15.6:0/1485581491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c006bb90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098e0 tx=0x7fb2a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b1cca45b1d5beb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bd59a700 1 -- 172.21.15.6:0/1485581491 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b640 con 0x7fb2c0069120 2023-10-09T11:40:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bd59a700 1 -- 172.21.15.6:0/1485581491 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800b7a0 con 0x7fb2c0069120 2023-10-09T11:40:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.726+0000 7fb2bd59a700 1 -- 172.21.15.6:0/1485581491 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800bb20 con 0x7fb2c0069120 2023-10-09T11:40:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 -- 172.21.15.6:0/1485581491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 msgr2=0x7fb2c006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/1485581491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c006bb90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098e0 tx=0x7fb2a80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 -- 172.21.15.6:0/1485581491 shutdown_connections 2023-10-09T11:40:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/1485581491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c006bb90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 -- 172.21.15.6:0/1485581491 >> 172.21.15.6:0/1485581491 conn(0x7fb2c00c9ca0 msgr2=0x7fb2c00ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 -- 172.21.15.6:0/1485581491 shutdown_connections 2023-10-09T11:40:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.727+0000 7fb2c4d20700 1 -- 172.21.15.6:0/1485581491 wait complete. 2023-10-09T11:40:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.728+0000 7fb2c4d20700 1 Processor -- start 2023-10-09T11:40:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.728+0000 7fb2c4d20700 1 -- start start 2023-10-09T11:40:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c0146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2c0157ab0 0x7fb2c00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c91a0 con 0x7fb2c006c0d0 2023-10-09T11:40:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c6980 con 0x7fb2c0069120 2023-10-09T11:40:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c8ec0 con 0x7fb2c0157ab0 2023-10-09T11:40:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36820/0 (socket says 172.21.15.6:36820) 2023-10-09T11:40:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/3527933846 learned_addr learned my addr 172.21.15.6:0/3527933846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2be59c700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c0146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bed9d700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2c0157ab0 0x7fb2c00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2c0157ab0 msgr2=0x7fb2c00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2c0157ab0 0x7fb2c00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 msgr2=0x7fb2c0146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c0146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009420 con 0x7fb2c006c0d0 2023-10-09T11:40:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2bdd9b700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80093f0 tx=0x7fb2a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b910 con 0x7fb2c006c0d0 2023-10-09T11:40:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800ba90 con 0x7fb2c006c0d0 2023-10-09T11:40:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c00c6330 con 0x7fb2c006c0d0 2023-10-09T11:40:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.729+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8025670 con 0x7fb2c006c0d0 2023-10-09T11:40:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.730+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c01471a0 con 0x7fb2c006c0d0 2023-10-09T11:40:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.730+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00c6190 con 0x7fb2c006c0d0 2023-10-09T11:40:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.731+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2a8023070 con 0x7fb2c006c0d0 2023-10-09T11:40:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.731+0000 7fb2b67fc700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 0x7fb2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.731+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2a8086770 con 0x7fb2c006c0d0 2023-10-09T11:40:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.731+0000 7fb2be59c700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 0x7fb2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.732+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=85}) v3 -- 0x7fb2a006ea50 con 0x7fb2c006c0d0 2023-10-09T11:40:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.732+0000 7fb2be59c700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 0x7fb2a00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00058d0 tx=0x7fb2b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.736+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2c00c6190 con 0x7fb2c006c0d0 2023-10-09T11:40:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.973+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2c00c6190 con 0x7fb2c006c0d0 2023-10-09T11:40:40.975 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:40:40.974+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:40:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.975+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(85..85 src has 1..85) v4 ==== 374+0+0 (secure 0 0 0) 0x7fb2a80572d0 con 0x7fb2c006c0d0 2023-10-09T11:40:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.975+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7fb2a006f3f0 con 0x7fb2c006c0d0 2023-10-09T11:40:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.978+0000 7fb2b67fc700 1 -- 172.21.15.6:0/3527933846 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb2c00c6190 con 0x7fb2c006c0d0 2023-10-09T11:40:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 msgr2=0x7fb2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 0x7fb2a00693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00058d0 tx=0x7fb2b0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 msgr2=0x7fb2c00c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80093f0 tx=0x7fb2a8017000 comp rx=0 tx=0).stop 2023-10-09T11:40:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 shutdown_connections 2023-10-09T11:40:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.980+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb2a0066f30 0x7fb2a00693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2c0157ab0 0x7fb2c00c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2c0069120 0x7fb2c0146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 --2- 172.21.15.6:0/3527933846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c006c0d0 0x7fb2c00c42e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 >> 172.21.15.6:0/3527933846 conn(0x7fb2c00c9ca0 msgr2=0x7fb2c0159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 shutdown_connections 2023-10-09T11:40:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:40.981+0000 7fb2c4d20700 1 -- 172.21.15.6:0/3527933846 wait complete. 2023-10-09T11:40:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:40:40.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:40:41.014 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:40:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.115+0000 7f6500984700 1 Processor -- start 2023-10-09T11:40:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 -- start start 2023-10-09T11:40:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64fc1578d0 0x7f64fc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64fc06d120 0x7f64fc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0d07c0 con 0x7f64fc157ca0 2023-10-09T11:40:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc06da50 con 0x7f64fc1578d0 2023-10-09T11:40:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.116+0000 7f6500984700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc0cfbb0 con 0x7f64fc06d120 2023-10-09T11:40:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64fc1578d0 0x7f64fc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64fc157ca0 0x7f64fc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37896/0 (socket says 172.21.15.6:37896) 2023-10-09T11:40:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f9d9b700 1 -- 172.21.15.6:0/4202701439 learned_addr learned my addr 172.21.15.6:0/4202701439 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fad9d700 1 --2- 172.21.15.6:0/4202701439 >> v2:172.21.15.118:3300/0 conn(0x7f64fc06d120 0x7f64fc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 -- 172.21.15.6:0/4202701439 >> v2:172.21.15.118:3300/0 conn(0x7f64fc06d120 msgr2=0x7f64fc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 --2- 172.21.15.6:0/4202701439 >> v2:172.21.15.118:3300/0 conn(0x7f64fc06d120 0x7f64fc06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 -- 172.21.15.6:0/4202701439 >> v1:172.21.15.6:6789/0 conn(0x7f64fc157ca0 legacy=0x7f64fc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f959a700 1 -- 172.21.15.6:0/4202701439 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326406807 0 0) 0x7f64fc0d07c0 con 0x7f64fc157ca0 2023-10-09T11:40:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 -- 172.21.15.6:0/4202701439 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0cfe90 con 0x7f64fc1578d0 2023-10-09T11:40:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64fa59c700 1 --2- 172.21.15.6:0/4202701439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0cf4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f64fc068300 tx=0x7f64ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65abc5b949d68302 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f959a700 1 -- 172.21.15.6:0/4202701439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec011630 con 0x7f64fc1578d0 2023-10-09T11:40:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f959a700 1 -- 172.21.15.6:0/4202701439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec011790 con 0x7f64fc1578d0 2023-10-09T11:40:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.117+0000 7f64f959a700 1 -- 172.21.15.6:0/4202701439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec011b30 con 0x7f64fc1578d0 2023-10-09T11:40:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 -- 172.21.15.6:0/4202701439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 msgr2=0x7f64fc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 --2- 172.21.15.6:0/4202701439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0cf4f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f64fc068300 tx=0x7f64ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 -- 172.21.15.6:0/4202701439 shutdown_connections 2023-10-09T11:40:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 --2- 172.21.15.6:0/4202701439 >> v2:172.21.15.118:3300/0 conn(0x7f64fc06d120 0x7f64fc06d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 --2- 172.21.15.6:0/4202701439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0cf4f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 -- 172.21.15.6:0/4202701439 >> 172.21.15.6:0/4202701439 conn(0x7f64fc06bb90 msgr2=0x7f64fc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 -- 172.21.15.6:0/4202701439 shutdown_connections 2023-10-09T11:40:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.118+0000 7f6500984700 1 -- 172.21.15.6:0/4202701439 wait complete. 2023-10-09T11:40:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.119+0000 7f6500984700 1 Processor -- start 2023-10-09T11:40:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.119+0000 7f6500984700 1 -- start start 2023-10-09T11:40:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64fc06d120 0x7f64fc16dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64fc157ca0 0x7f64fc0abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0b4c10 con 0x7f64fc1578d0 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0b4ef0 con 0x7f64fc157ca0 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f6500984700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0b51d0 con 0x7f64fc06d120 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36842/0 (socket says 172.21.15.6:36842) 2023-10-09T11:40:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 -- 172.21.15.6:0/3518241394 learned_addr learned my addr 172.21.15.6:0/3518241394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64fad9d700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64fc157ca0 0x7f64fc0abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64fa59c700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64fc06d120 0x7f64fc16dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 -- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64fc06d120 msgr2=0x7f64fc16dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64fc06d120 0x7f64fc16dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 -- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64fc157ca0 msgr2=0x7f64fc0abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64fc157ca0 0x7f64fc0abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009420 con 0x7f64fc1578d0 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.120+0000 7f64f9d9b700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c5e0 tx=0x7f64e4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4005b30 con 0x7f64fc1578d0 2023-10-09T11:40:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4005c90 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0b54b0 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4007300 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc16e850 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.121+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc067ac0 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.122+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64e401b3b0 con 0x7f64fc1578d0 2023-10-09T11:40:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.122+0000 7f64f27fc700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 0x7f64dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.122+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f64e4083960 con 0x7f64fc1578d0 2023-10-09T11:40:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.122+0000 7f64fa59c700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 0x7f64dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.123+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f64dc06eaf0 con 0x7f64fc1578d0 2023-10-09T11:40:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.123+0000 7f64fa59c700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 0x7f64dc0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0093f0 tx=0x7f64ec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.127+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64e4017060 con 0x7f64fc1578d0 2023-10-09T11:40:41.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.362+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f64fc0d0170 con 0x7f64fc1578d0 2023-10-09T11:40:41.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.978+0000 7f64f27fc700 1 -- 172.21.15.6:0/3518241394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f64e4050b80 con 0x7f64fc1578d0 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 msgr2=0x7f64dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 0x7f64dc0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0093f0 tx=0x7f64ec017000 comp rx=0 tx=0).stop 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 msgr2=0x7f64fc0af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c5e0 tx=0x7f64e4000fe0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 shutdown_connections 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f64dc066f30 0x7f64dc0693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64fc157ca0 0x7f64fc0abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64fc06d120 0x7f64fc16dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 --2- 172.21.15.6:0/3518241394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64fc1578d0 0x7f64fc0af820 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:41.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 >> 172.21.15.6:0/3518241394 conn(0x7f64fc06bb90 msgr2=0x7f64fc155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:41.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 shutdown_connections 2023-10-09T11:40:41.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:41.981+0000 7f6500984700 1 -- 172.21.15.6:0/3518241394 wait complete. 2023-10-09T11:40:41.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:40:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.126+0000 7f9c69e7e700 1 Processor -- start 2023-10-09T11:40:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.126+0000 7f9c69e7e700 1 -- start start 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c641578d0 0x7f9c640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c64157ca0 0x7f9c6415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c6406d120 0x7f9c6406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6406dac0 con 0x7f9c641578d0 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c640d07c0 con 0x7f9c6406d120 2023-10-09T11:40:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c69e7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640cfbb0 con 0x7f9c64157ca0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c641578d0 0x7f9c640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c641578d0 0x7f9c640cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36858/0 (socket says 172.21.15.6:36858) 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 -- 172.21.15.6:0/4150060796 learned_addr learned my addr 172.21.15.6:0/4150060796 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c62ffd700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c64157ca0 0x7f9c6415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c63fff700 1 --2- 172.21.15.6:0/4150060796 >> v2:172.21.15.118:3300/0 conn(0x7f9c6406d120 0x7f9c6406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 -- 172.21.15.6:0/4150060796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c64157ca0 msgr2=0x7f9c6415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c64157ca0 0x7f9c6415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 -- 172.21.15.6:0/4150060796 >> v2:172.21.15.118:3300/0 conn(0x7f9c6406d120 msgr2=0x7f9c6406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 --2- 172.21.15.6:0/4150060796 >> v2:172.21.15.118:3300/0 conn(0x7f9c6406d120 0x7f9c6406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 -- 172.21.15.6:0/4150060796 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640cfe90 con 0x7f9c641578d0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.127+0000 7f9c637fe700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c641578d0 0x7f9c640cf4f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9c640b3940 tx=0x7f9c54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c6c690b911efe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c627fc700 1 -- 172.21.15.6:0/4150060796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400b860 con 0x7f9c641578d0 2023-10-09T11:40:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c627fc700 1 -- 172.21.15.6:0/4150060796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400b9c0 con 0x7f9c641578d0 2023-10-09T11:40:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c627fc700 1 -- 172.21.15.6:0/4150060796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400bd60 con 0x7f9c641578d0 2023-10-09T11:40:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 -- 172.21.15.6:0/4150060796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c641578d0 msgr2=0x7f9c640cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c641578d0 0x7f9c640cf4f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9c640b3940 tx=0x7f9c54009250 comp rx=0 tx=0).stop 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 -- 172.21.15.6:0/4150060796 shutdown_connections 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/4150060796 >> v2:172.21.15.118:3300/0 conn(0x7f9c6406d120 0x7f9c6406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c641578d0 0x7f9c640cf4f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/4150060796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c64157ca0 0x7f9c6415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 -- 172.21.15.6:0/4150060796 >> 172.21.15.6:0/4150060796 conn(0x7f9c6406bb90 msgr2=0x7f9c6406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 -- 172.21.15.6:0/4150060796 shutdown_connections 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.128+0000 7f9c69e7e700 1 -- 172.21.15.6:0/4150060796 wait complete. 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.129+0000 7f9c69e7e700 1 Processor -- start 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.129+0000 7f9c69e7e700 1 -- start start 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6406d120 0x7f9c640b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c641578d0 0x7f9c640cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640b5870 con 0x7f9c64157ca0 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640b4ca0 con 0x7f9c641578d0 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c69e7e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640cb7a0 con 0x7f9c6406d120 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36860/0 (socket says 172.21.15.6:36860) 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.130+0000 7f9c63fff700 1 -- 172.21.15.6:0/3438805966 learned_addr learned my addr 172.21.15.6:0/3438805966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 -- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6406d120 msgr2=0x7f9c640b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6406d120 0x7f9c640b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 -- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c641578d0 msgr2=0x7f9c640cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c641578d0 0x7f9c640cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540094f0 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c63fff700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00ceb0 tx=0x7f9c5c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ae40 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c016430 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c640b4f40 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0167d0 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.131+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c640b5500 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.132+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c64067ac0 con 0x7f9c64157ca0 2023-10-09T11:40:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.132+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c5c003020 con 0x7f9c64157ca0 2023-10-09T11:40:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.132+0000 7f9c4b7fe700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.133+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9c5c012070 con 0x7f9c64157ca0 2023-10-09T11:40:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.133+0000 7f9c637fe700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.133+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f9c5006eaf0 con 0x7f9c64157ca0 2023-10-09T11:40:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.133+0000 7f9c637fe700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 0x7f9c500693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9c640b3940 tx=0x7f9c54017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:42.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.137+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c5c056150 con 0x7f9c64157ca0 2023-10-09T11:40:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:42.329+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9c640b59b0 con 0x7f9c64157ca0 2023-10-09T11:40:43.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.049+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(86..86 src has 1..86) v4 ==== 1057+0+0 (secure 0 0 0) 0x7f9c5c056a80 con 0x7f9c64157ca0 2023-10-09T11:40:43.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.050+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f9c5006cf20 con 0x7f9c64157ca0 2023-10-09T11:40:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.053+0000 7f9c4b7fe700 1 -- 172.21.15.6:0/3438805966 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9c5c055ce0 con 0x7f9c64157ca0 2023-10-09T11:40:43.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.057+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 msgr2=0x7f9c500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.057+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 0x7f9c500693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9c640b3940 tx=0x7f9c54017000 comp rx=0 tx=0).stop 2023-10-09T11:40:43.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.057+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 msgr2=0x7f9c640cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.057+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00ceb0 tx=0x7f9c5c007870 comp rx=0 tx=0).stop 2023-10-09T11:40:43.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 shutdown_connections 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9c50066f30 0x7f9c500693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c64157ca0 0x7f9c640cb260 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c6406d120 0x7f9c640b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 --2- 172.21.15.6:0/3438805966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c641578d0 0x7f9c640cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 >> 172.21.15.6:0/3438805966 conn(0x7f9c6406bb90 msgr2=0x7f9c64069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 shutdown_connections 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.058+0000 7f9c69e7e700 1 -- 172.21.15.6:0/3438805966 wait complete. 2023-10-09T11:40:43.059 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:40:43.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:40:43.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.201+0000 7f845b407700 1 Processor -- start 2023-10-09T11:40:43.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.201+0000 7f845b407700 1 -- start start 2023-10-09T11:40:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f845b407700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84541578d0 0x7f84540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f845b407700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540d07c0 con 0x7f845406d120 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f845b407700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540cfbb0 con 0x7f8454157ca0 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f845b407700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540cfe90 con 0x7f84541578d0 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f84599a4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f845406d120 0x7f845406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37900/0 (socket says 172.21.15.6:37900) 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f84599a4700 1 -- 172.21.15.6:0/1859448777 learned_addr learned my addr 172.21.15.6:0/1859448777 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f84591a3700 1 --2- 172.21.15.6:0/1859448777 >> v2:172.21.15.118:3300/0 conn(0x7f84541578d0 0x7f84540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.202+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298225404 0 0) 0x7f84540d07c0 con 0x7f845406d120 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003570 con 0x7f845406d120 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f84591a3700 1 -- 172.21.15.6:0/1859448777 >> v1:172.21.15.118:6789/0 conn(0x7f8454157ca0 legacy=0x7f845415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f84591a3700 1 -- 172.21.15.6:0/1859448777 >> v1:172.21.15.6:6789/0 conn(0x7f845406d120 legacy=0x7f845406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276776371 0 0) 0x7f843c003570 con 0x7f845406d120 2023-10-09T11:40:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f84591a3700 1 -- 172.21.15.6:0/1859448777 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540d0170 con 0x7f84541578d0 2023-10-09T11:40:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f84591a3700 1 --2- 172.21.15.6:0/1859448777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84541578d0 0x7f84540cf4f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8444009e60 tx=0x7f8444009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f752f950f394543e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400e070 con 0x7f84541578d0 2023-10-09T11:40:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400b850 con 0x7f84541578d0 2023-10-09T11:40:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.203+0000 7f8453fff700 1 -- 172.21.15.6:0/1859448777 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c001470 con 0x7f84541578d0 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 -- 172.21.15.6:0/1859448777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84541578d0 msgr2=0x7f84540cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 --2- 172.21.15.6:0/1859448777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84541578d0 0x7f84540cf4f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8444009e60 tx=0x7f8444009780 comp rx=0 tx=0).stop 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 -- 172.21.15.6:0/1859448777 shutdown_connections 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 --2- 172.21.15.6:0/1859448777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84541578d0 0x7f84540cf4f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 -- 172.21.15.6:0/1859448777 >> 172.21.15.6:0/1859448777 conn(0x7f845406bb90 msgr2=0x7f845406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 -- 172.21.15.6:0/1859448777 shutdown_connections 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.204+0000 7f845b407700 1 -- 172.21.15.6:0/1859448777 wait complete. 2023-10-09T11:40:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.205+0000 7f845b407700 1 Processor -- start 2023-10-09T11:40:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.205+0000 7f845b407700 1 -- start start 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 0x7f84540cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8454157ca0 0x7f84540c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c6ea0 con 0x7f845406d120 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845416b920 con 0x7f8454157ca0 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f845b407700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c5b20 con 0x7f84541578d0 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36866/0 (socket says 172.21.15.6:36866) 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 -- 172.21.15.6:0/1538915897 learned_addr learned my addr 172.21.15.6:0/1538915897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84599a4700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8454157ca0 0x7f84540c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84589a2700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 0x7f84540cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 -- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 msgr2=0x7f84540cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 0x7f84540cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 -- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8454157ca0 msgr2=0x7f84540c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8454157ca0 0x7f84540c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 -- 172.21.15.6:0/1538915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444009a20 con 0x7f845406d120 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84589a2700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 0x7f84540cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.206+0000 7f84591a3700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f845406fe20 tx=0x7f8444017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.207+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444012ae0 con 0x7f845406d120 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.207+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444012c60 con 0x7f845406d120 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.207+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84540c5e00 con 0x7f845406d120 2023-10-09T11:40:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.207+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844401e450 con 0x7f845406d120 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.207+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84540c63c0 con 0x7f845406d120 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.208+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845406e7e0 con 0x7f845406d120 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.208+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f844401e7c0 con 0x7f845406d120 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.208+0000 7f84517fa700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 0x7f84400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.208+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f8444086760 con 0x7f845406d120 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.208+0000 7f84589a2700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 0x7f84400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.209+0000 7f84589a2700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 0x7f84400693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8448007fd0 tx=0x7f8448009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:43.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.213+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8444053b30 con 0x7f845406d120 2023-10-09T11:40:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:43.404+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f845406dc20 con 0x7f845406d120 2023-10-09T11:40:44.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.061+0000 7f84517fa700 1 -- 172.21.15.6:0/1538915897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8444057150 con 0x7f845406d120 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 msgr2=0x7f84400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 0x7f84400693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8448007fd0 tx=0x7f8448009040 comp rx=0 tx=0).stop 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 msgr2=0x7f845416b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f845406fe20 tx=0x7f8444017000 comp rx=0 tx=0).stop 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 shutdown_connections 2023-10-09T11:40:44.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8440066f30 0x7f84400693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8454157ca0 0x7f84540c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845406d120 0x7f845416b3e0 secure :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f845406fe20 tx=0x7f8444017000 comp rx=0 tx=0).stop 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 --2- 172.21.15.6:0/1538915897 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84541578d0 0x7f84540cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.066+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 >> 172.21.15.6:0/1538915897 conn(0x7f845406bb90 msgr2=0x7f845415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.067+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 shutdown_connections 2023-10-09T11:40:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.067+0000 7f845b407700 1 -- 172.21.15.6:0/1538915897 wait complete. 2023-10-09T11:40:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:40:44.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:40:44.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.205+0000 7f14c2959700 1 Processor -- start 2023-10-09T11:40:44.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.205+0000 7f14c2959700 1 -- start start 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14c2959700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14bc1578d0 0x7f14bc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14c2959700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 0x7f14bc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14c2959700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0d07c0 con 0x7f14bc157ca0 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14c2959700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc06daa0 con 0x7f14bc1578d0 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14c2959700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0cfbb0 con 0x7f14bc06d120 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14bbfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14bc1578d0 0x7f14bc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.206+0000 7f14bb7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f14bc157ca0 0x7f14bc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:58802/0 (socket says 172.21.15.6:58802) 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bb7fe700 1 -- 172.21.15.6:0/1410372040 learned_addr learned my addr 172.21.15.6:0/1410372040 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14c0ef6700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 0x7f14bc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bbfff700 1 -- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 msgr2=0x7f14bc06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bbfff700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 0x7f14bc06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bbfff700 1 -- 172.21.15.6:0/1410372040 >> v1:172.21.15.118:6789/0 conn(0x7f14bc157ca0 legacy=0x7f14bc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bbfff700 1 -- 172.21.15.6:0/1410372040 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0cfe90 con 0x7f14bc1578d0 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14c0ef6700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 0x7f14bc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14baffd700 1 -- 172.21.15.6:0/1410372040 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201378897 0 0) 0x7f14bc0d07c0 con 0x7f14bc157ca0 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14bbfff700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc1578d0 0x7f14bc0cf4f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0098e0 tx=0x7f14ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ce0e55c8e9f628 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14baffd700 1 -- 172.21.15.6:0/1410372040 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00b640 con 0x7f14bc1578d0 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14baffd700 1 -- 172.21.15.6:0/1410372040 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00b7a0 con 0x7f14bc1578d0 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.207+0000 7f14baffd700 1 -- 172.21.15.6:0/1410372040 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00bb40 con 0x7f14bc1578d0 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 -- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc1578d0 msgr2=0x7f14bc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc1578d0 0x7f14bc0cf4f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0098e0 tx=0x7f14ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 -- 172.21.15.6:0/1410372040 shutdown_connections 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc06d120 0x7f14bc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 --2- 172.21.15.6:0/1410372040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc1578d0 0x7f14bc0cf4f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 -- 172.21.15.6:0/1410372040 >> 172.21.15.6:0/1410372040 conn(0x7f14bc06bb90 msgr2=0x7f14bc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 -- 172.21.15.6:0/1410372040 shutdown_connections 2023-10-09T11:40:44.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.208+0000 7f14c2959700 1 -- 172.21.15.6:0/1410372040 wait complete. 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.209+0000 7f14c2959700 1 Processor -- start 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.209+0000 7f14c2959700 1 -- start start 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc06d120 0x7f14bc16b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc1578d0 0x7f14bc0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b62b0 con 0x7f14bc157ca0 2023-10-09T11:40:44.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc16ac40 con 0x7f14bc06d120 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c2959700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b5630 con 0x7f14bc1578d0 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55588/0 (socket says 172.21.15.6:55588) 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 -- 172.21.15.6:0/403416933 learned_addr learned my addr 172.21.15.6:0/403416933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14bbfff700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc06d120 0x7f14bc16b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14bb7fe700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc1578d0 0x7f14bc0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 -- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc1578d0 msgr2=0x7f14bc0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc1578d0 0x7f14bc0b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 -- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc06d120 msgr2=0x7f14bc16b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc06d120 0x7f14bc16b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 -- 172.21.15.6:0/403416933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009a20 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.210+0000 7f14c0ef6700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009fc0 tx=0x7f14b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400cbd0 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400f040 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac009420 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4014480 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0b5bf0 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.211+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc067ac0 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.212+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14b4003020 con 0x7f14bc157ca0 2023-10-09T11:40:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.212+0000 7f14b3fff700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.212+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f14b4084b50 con 0x7f14bc157ca0 2023-10-09T11:40:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.212+0000 7f14bbfff700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.213+0000 7f14bbfff700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0093f0 tx=0x7f14ac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.216+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14b40520c0 con 0x7f14bc157ca0 2023-10-09T11:40:44.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.411+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f14bc0d0170 con 0x7f14bc157ca0 2023-10-09T11:40:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.417+0000 7f14b3fff700 1 -- 172.21.15.6:0/403416933 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f14b40556e0 con 0x7f14bc157ca0 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 msgr2=0x7f149c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0093f0 tx=0x7f14ac017000 comp rx=0 tx=0).stop 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 msgr2=0x7f14bc0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009fc0 tx=0x7f14b400b040 comp rx=0 tx=0).stop 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 shutdown_connections 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc157ca0 0x7f14bc0c9180 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14bc06d120 0x7f14bc16b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 --2- 172.21.15.6:0/403416933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14bc1578d0 0x7f14bc0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 >> 172.21.15.6:0/403416933 conn(0x7f14bc06bb90 msgr2=0x7f14bc068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 shutdown_connections 2023-10-09T11:40:44.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.419+0000 7f14c2959700 1 -- 172.21.15.6:0/403416933 wait complete. 2023-10-09T11:40:44.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-09T11:40:44.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.550+0000 7f507c6f9700 1 Processor -- start 2023-10-09T11:40:44.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.550+0000 7f507c6f9700 1 -- start start 2023-10-09T11:40:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507c6f9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5074157ca0 0x7f50740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507c6f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740d07c0 con 0x7f507406d120 2023-10-09T11:40:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507c6f9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740cfbb0 con 0x7f50741578d0 2023-10-09T11:40:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507c6f9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740cfe90 con 0x7f5074157ca0 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507ac96700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f507406d120 0x7f507406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50532/0 (socket says 172.21.15.6:50532) 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507ac96700 1 -- 172.21.15.6:0/4111841519 learned_addr learned my addr 172.21.15.6:0/4111841519 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079c94700 1 --2- 172.21.15.6:0/4111841519 >> v2:172.21.15.118:3300/0 conn(0x7f5074157ca0 0x7f50740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904184939 0 0) 0x7f50740d07c0 con 0x7f507406d120 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5060003570 con 0x7f507406d120 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405126190 0 0) 0x7f5060003570 con 0x7f507406d120 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 >> v2:172.21.15.118:3300/0 conn(0x7f5074157ca0 msgr2=0x7f50740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 --2- 172.21.15.6:0/4111841519 >> v2:172.21.15.118:3300/0 conn(0x7f5074157ca0 0x7f50740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 >> v1:172.21.15.118:6789/0 conn(0x7f50741578d0 legacy=0x7f507415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740d0170 con 0x7f507406d120 2023-10-09T11:40:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f506c0017f0 con 0x7f507406d120 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 >> v1:172.21.15.6:6789/0 conn(0x7f507406d120 legacy=0x7f507406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 0x7f5060003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060004810 0x7f5060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50600051c0 0x7f506000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740cfe90 con 0x7f5060003a60 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506000c0d0 con 0x7f50600051c0 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506000c290 con 0x7f5060004810 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.551+0000 7f507a495700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 0x7f5060003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f5079c94700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060004810 0x7f5060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507ac96700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50600051c0 0x7f506000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 -- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060004810 msgr2=0x7f5060004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060004810 0x7f5060004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 -- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50600051c0 msgr2=0x7f506000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50600051c0 0x7f506000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 -- 172.21.15.6:0/4111841519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060003570 con 0x7f5060003a60 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f5079c94700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060004810 0x7f5060004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507ac96700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50600051c0 0x7f506000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507ac96700 1 -- 172.21.15.6:0/4111841519 reap_dead start 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f507a495700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 0x7f5060003e70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f50700018b0 tx=0x7f5070007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed560db723e8617b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070012420 con 0x7f5060003a60 2023-10-09T11:40:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50700125a0 con 0x7f5060003a60 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.552+0000 7f5079493700 1 -- 172.21.15.6:0/4111841519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070012960 con 0x7f5060003a60 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 -- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 msgr2=0x7f5060003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 0x7f5060003e70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f50700018b0 tx=0x7f5070007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 -- 172.21.15.6:0/4111841519 shutdown_connections 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 --2- 172.21.15.6:0/4111841519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5060003a60 0x7f5060003e70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 -- 172.21.15.6:0/4111841519 >> 172.21.15.6:0/4111841519 conn(0x7f507406bb90 msgr2=0x7f507406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 -- 172.21.15.6:0/4111841519 shutdown_connections 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.553+0000 7f507c6f9700 1 -- 172.21.15.6:0/4111841519 wait complete. 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.554+0000 7f507c6f9700 1 Processor -- start 2023-10-09T11:40:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.554+0000 7f507c6f9700 1 -- start start 2023-10-09T11:40:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060003a60 0x7f50740c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 0x7f50740cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c6d60 con 0x7f50740c9f60 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c7040 con 0x7f50740c6880 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740c7320 con 0x7f5060003a60 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55618/0 (socket says 172.21.15.6:55618) 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 -- 172.21.15.6:0/1624546801 learned_addr learned my addr 172.21.15.6:0/1624546801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f5079c94700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 0x7f50740cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507a495700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060003a60 0x7f50740c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 -- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060003a60 msgr2=0x7f50740c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060003a60 0x7f50740c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 -- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 msgr2=0x7f50740cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 0x7f50740cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 -- 172.21.15.6:0/1624546801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740c7600 con 0x7f50740c9f60 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f5079c94700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 0x7f50740cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507ac96700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f506c001370 tx=0x7f506c001300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00ec90 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c00edf0 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50740c78e0 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c013670 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.555+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740cbd40 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.556+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740c7ad0 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.557+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f506c0139e0 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.557+0000 7f506a7fc700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 0x7f50580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.557+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f506c084920 con 0x7f50740c9f60 2023-10-09T11:40:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.557+0000 7f507a495700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 0x7f50580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.558+0000 7f507a495700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 0x7f50580693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50700018b0 tx=0x7f5070015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.562+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f506c051e90 con 0x7f50740c9f60 2023-10-09T11:40:44.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:44.836+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f50740d0450 con 0x7f50740c9f60 2023-10-09T11:40:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.062+0000 7f506a7fc700 1 -- 172.21.15.6:0/1624546801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v239) v1 ==== 133+0+0 (secure 0 0 0) 0x7f506c0554b0 con 0x7f50740c9f60 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 msgr2=0x7f50580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 0x7f50580693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50700018b0 tx=0x7f5070015000 comp rx=0 tx=0).stop 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 msgr2=0x7f50740cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f506c001370 tx=0x7f506c001300 comp rx=0 tx=0).stop 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 shutdown_connections 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5058066f30 0x7f50580693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50740c9f60 0x7f50740cd5b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5060003a60 0x7f50740c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 --2- 172.21.15.6:0/1624546801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50740c6880 0x7f50740cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 >> 172.21.15.6:0/1624546801 conn(0x7f507406bb90 msgr2=0x7f5074155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 shutdown_connections 2023-10-09T11:40:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.064+0000 7f507c6f9700 1 -- 172.21.15.6:0/1624546801 wait complete. 2023-10-09T11:40:45.077 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-09T11:40:45.077 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-09T11:40:45.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-09T11:40:45.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.196+0000 7f5368262700 1 Processor -- start 2023-10-09T11:40:45.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.197+0000 7f5368262700 1 -- start start 2023-10-09T11:40:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.197+0000 7f5368262700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53601578d0 0x7f53600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.197+0000 7f5368262700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f536006d120 0x7f536006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.197+0000 7f5368262700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600d07c0 con 0x7f5360157ca0 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5368262700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536006da50 con 0x7f53601578d0 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5368262700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600cfbb0 con 0x7f536006d120 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53601578d0 0x7f53600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f53657fd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5360157ca0 0x7f536015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50536/0 (socket says 172.21.15.6:50536) 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f53657fd700 1 -- 172.21.15.6:0/3717460628 learned_addr learned my addr 172.21.15.6:0/3717460628 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 -- 172.21.15.6:0/3717460628 >> v2:172.21.15.118:3300/0 conn(0x7f536006d120 msgr2=0x7f536006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f53667ff700 1 --2- 172.21.15.6:0/3717460628 >> v2:172.21.15.118:3300/0 conn(0x7f536006d120 0x7f536006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 --2- 172.21.15.6:0/3717460628 >> v2:172.21.15.118:3300/0 conn(0x7f536006d120 0x7f536006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5364ffc700 1 -- 172.21.15.6:0/3717460628 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506629728 0 0) 0x7f53600d07c0 con 0x7f5360157ca0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 -- 172.21.15.6:0/3717460628 >> v1:172.21.15.6:6789/0 conn(0x7f5360157ca0 legacy=0x7f536015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 -- 172.21.15.6:0/3717460628 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600cfe90 con 0x7f53601578d0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5365ffe700 1 --2- 172.21.15.6:0/3717460628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53601578d0 0x7f53600cf4f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5360068300 tx=0x7f535c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922aac7b169b2e07 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5364ffc700 1 -- 172.21.15.6:0/3717460628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00b6b0 con 0x7f53601578d0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5364ffc700 1 -- 172.21.15.6:0/3717460628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00b810 con 0x7f53601578d0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.198+0000 7f5364ffc700 1 -- 172.21.15.6:0/3717460628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00bbb0 con 0x7f53601578d0 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 -- 172.21.15.6:0/3717460628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53601578d0 msgr2=0x7f53600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 --2- 172.21.15.6:0/3717460628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53601578d0 0x7f53600cf4f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5360068300 tx=0x7f535c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 -- 172.21.15.6:0/3717460628 shutdown_connections 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 --2- 172.21.15.6:0/3717460628 >> v2:172.21.15.118:3300/0 conn(0x7f536006d120 0x7f536006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 --2- 172.21.15.6:0/3717460628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53601578d0 0x7f53600cf4f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 -- 172.21.15.6:0/3717460628 >> 172.21.15.6:0/3717460628 conn(0x7f536006bb90 msgr2=0x7f536006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 -- 172.21.15.6:0/3717460628 shutdown_connections 2023-10-09T11:40:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.199+0000 7f5368262700 1 -- 172.21.15.6:0/3717460628 wait complete. 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.200+0000 7f5368262700 1 Processor -- start 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.200+0000 7f5368262700 1 -- start start 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53601578d0 0x7f5360069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 0x7f536006a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c6820 con 0x7f536006d120 2023-10-09T11:40:45.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c5c50 con 0x7f53601578d0 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5368262700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c5ef0 con 0x7f5360157ca0 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55626/0 (socket says 172.21.15.6:55626) 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 -- 172.21.15.6:0/1515972674 learned_addr learned my addr 172.21.15.6:0/1515972674 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f53657fd700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53601578d0 0x7f5360069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f53667ff700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 0x7f536006a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 -- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 msgr2=0x7f536006a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 0x7f536006a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 -- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53601578d0 msgr2=0x7f5360069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53601578d0 0x7f5360069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 -- 172.21.15.6:0/1515972674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c009420 con 0x7f536006d120 2023-10-09T11:40:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f53667ff700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 0x7f536006a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.201+0000 7f5365ffe700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f536006fe20 tx=0x7f535c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.202+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c011420 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.202+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c011580 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.202+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53600c61d0 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.202+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c011920 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.202+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53600c78b0 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.203+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360067ac0 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.203+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f535c011d10 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.204+0000 7f5355ffb700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.204+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f535c085d40 con 0x7f536006d120 2023-10-09T11:40:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.204+0000 7f53657fd700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:45.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.204+0000 7f53657fd700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f53600cd940 tx=0x7f5350009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:45.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.208+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f535c053290 con 0x7f536006d120 2023-10-09T11:40:45.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:45.481+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f53600d0170 con 0x7f536006d120 2023-10-09T11:40:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.061+0000 7f5355ffb700 1 -- 172.21.15.6:0/1515972674 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v240) v1 ==== 140+0+0 (secure 0 0 0) 0x7f535c0568b0 con 0x7f536006d120 2023-10-09T11:40:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 msgr2=0x7f53440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f53600cd940 tx=0x7f5350009040 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 msgr2=0x7f53600b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f536006fe20 tx=0x7f535c017000 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 shutdown_connections 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5344066f30 0x7f53440693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5360157ca0 0x7f536006a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536006d120 0x7f53600b6350 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 --2- 172.21.15.6:0/1515972674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53601578d0 0x7f5360069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 >> 172.21.15.6:0/1515972674 conn(0x7f536006bb90 msgr2=0x7f5360068a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 shutdown_connections 2023-10-09T11:40:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.064+0000 7f5368262700 1 -- 172.21.15.6:0/1515972674 wait complete. 2023-10-09T11:40:46.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-09T11:40:46.214 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_objectstore":"memstore"} 2023-10-09T11:40:46.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-09T11:40:46.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:40:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 Processor -- start 2023-10-09T11:40:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 -- start start 2023-10-09T11:40:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4e00c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa4e00af270 0x7fa4e00c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e006aae0 con 0x7fa4e00c7d00 2023-10-09T11:40:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e0069ed0 con 0x7fa4e00af270 2023-10-09T11:40:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.336+0000 7fa4e5ced700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e006a1b0 con 0x7fa4e00aeea0 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4dffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4e00c7d00 0x7fa4e00c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50548/0 (socket says 172.21.15.6:50548) 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4dffff700 1 -- 172.21.15.6:0/879892875 learned_addr learned my addr 172.21.15.6:0/879892875 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/879892875 >> v2:172.21.15.118:3300/0 conn(0x7fa4e00af270 0x7fa4e00c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287219525 0 0) 0x7fa4e006aae0 con 0x7fa4e00c7d00 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4df7fe700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4e00c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc003570 con 0x7fa4e00c7d00 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672393327 0 0) 0x7fa4cc003570 con 0x7fa4e00c7d00 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 msgr2=0x7fa4e00c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4e00c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 >> v2:172.21.15.118:3300/0 conn(0x7fa4e00af270 msgr2=0x7fa4e00c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 --2- 172.21.15.6:0/879892875 >> v2:172.21.15.118:3300/0 conn(0x7fa4e00af270 0x7fa4e00c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e006a490 con 0x7fa4e00c7d00 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fa4d80017f0 con 0x7fa4e00c7d00 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 >> v1:172.21.15.6:6789/0 conn(0x7fa4e00c7d00 legacy=0x7fa4e00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4cc003a60 0x7fa4cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0069ed0 con 0x7fa4cc004d50 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e006a1b0 con 0x7fa4cc003a60 2023-10-09T11:40:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc00dc70 con 0x7fa4e00aeea0 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4dffff700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.337+0000 7fa4df7fe700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4cc003a60 0x7fa4cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 -- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 msgr2=0x7fa4cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00aeea0 0x7fa4cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 -- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4cc003a60 msgr2=0x7fa4cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4cc003a60 0x7fa4cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 -- 172.21.15.6:0/879892875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc003570 con 0x7fa4cc004d50 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800a970 tx=0x7fa4d8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a23af8a3126b521 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8012440 con 0x7fa4cc004d50 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d80125c0 con 0x7fa4cc004d50 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4deffd700 1 -- 172.21.15.6:0/879892875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8012980 con 0x7fa4cc004d50 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4e5ced700 1 -- 172.21.15.6:0/879892875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc004d50 msgr2=0x7fa4cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/879892875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800a970 tx=0x7fa4d8002210 comp rx=0 tx=0).stop 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4dffff700 1 -- 172.21.15.6:0/879892875 reap_dead start 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4e5ced700 1 -- 172.21.15.6:0/879892875 shutdown_connections 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.338+0000 7fa4e5ced700 1 -- 172.21.15.6:0/879892875 >> 172.21.15.6:0/879892875 conn(0x7fa4e006c660 msgr2=0x7fa4e00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.339+0000 7fa4e5ced700 1 -- 172.21.15.6:0/879892875 shutdown_connections 2023-10-09T11:40:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.339+0000 7fa4e5ced700 1 -- 172.21.15.6:0/879892875 wait complete. 2023-10-09T11:40:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 Processor -- start 2023-10-09T11:40:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 -- start start 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 0x7fa4e00c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00c3fe0 0x7fa4e016d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.340+0000 7fa4e5ced700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0145f30 con 0x7fa4e0154470 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4e5ced700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00c5420 con 0x7fa4e015ad40 2023-10-09T11:40:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4e5ced700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0154840 con 0x7fa4e00c3fe0 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55632/0 (socket says 172.21.15.6:55632) 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 -- 172.21.15.6:0/1670435550 learned_addr learned my addr 172.21.15.6:0/1670435550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4dffff700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00c3fe0 0x7fa4e016d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 0x7fa4e00c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 -- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00c3fe0 msgr2=0x7fa4e016d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00c3fe0 0x7fa4e016d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 -- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 msgr2=0x7fa4e00c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 0x7fa4e00c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 -- 172.21.15.6:0/1670435550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00c4810 con 0x7fa4e0154470 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 0x7fa4e00c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4df7fe700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006ac0 tx=0x7fa4d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000f9b0 con 0x7fa4e0154470 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000fb10 con 0x7fa4e0154470 2023-10-09T11:40:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000fe90 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e00c4af0 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.341+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e00c50b0 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.342+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0063d30 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.343+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4d0014650 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.343+0000 7fa4d7fff700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 0x7fa4c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.343+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa4d0018030 con 0x7fa4e0154470 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.343+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 0x7fa4c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.343+0000 7fa4d6ffd700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 0x7fa4c00693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ccda0 tx=0x7fa4c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.347+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4d0052270 con 0x7fa4e0154470 2023-10-09T11:40:46.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.539+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa4e004bb80 con 0x7fa4e0154470 2023-10-09T11:40:46.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.542+0000 7fa4d7fff700 1 -- 172.21.15.6:0/1670435550 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4d00220c0 con 0x7fa4e0154470 2023-10-09T11:40:46.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 msgr2=0x7fa4c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 0x7fa4c00693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ccda0 tx=0x7fa4c8008040 comp rx=0 tx=0).stop 2023-10-09T11:40:46.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 msgr2=0x7fa4e015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006ac0 tx=0x7fa4d00091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 shutdown_connections 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4c0066f30 0x7fa4c00693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4e00c3fe0 0x7fa4e016d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4e0154470 0x7fa4e015a800 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 --2- 172.21.15.6:0/1670435550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e015ad40 0x7fa4e00c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 >> 172.21.15.6:0/1670435550 conn(0x7fa4e006c660 msgr2=0x7fa4e00692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 shutdown_connections 2023-10-09T11:40:46.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.544+0000 7fa4e5ced700 1 -- 172.21.15.6:0/1670435550 wait complete. 2023-10-09T11:40:46.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:40:46.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:46.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:40:46.645 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:40:46.645 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:40:46.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.763+0000 7f4bffe6d700 1 Processor -- start 2023-10-09T11:40:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.764+0000 7f4bffe6d700 1 -- start start 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.764+0000 7f4bffe6d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bf8157ca0 0x7f4bf80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.764+0000 7f4bffe6d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80d07c0 con 0x7f4bf81578d0 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.764+0000 7f4bffe6d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80cfbb0 con 0x7f4bf806d120 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.764+0000 7f4bffe6d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80cfe90 con 0x7f4bf8157ca0 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfdc09700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4bf81578d0 0x7f4bf815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50558/0 (socket says 172.21.15.6:50558) 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfdc09700 1 -- 172.21.15.6:0/571466366 learned_addr learned my addr 172.21.15.6:0/571466366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfd408700 1 --2- 172.21.15.6:0/571466366 >> v2:172.21.15.118:3300/0 conn(0x7f4bf8157ca0 0x7f4bf80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899736615 0 0) 0x7f4bf80d07c0 con 0x7f4bf81578d0 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be0003570 con 0x7f4bf81578d0 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573947604 0 0) 0x7f4bf80cfbb0 con 0x7f4bf806d120 2023-10-09T11:40:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf80d07c0 con 0x7f4bf806d120 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815920808 0 0) 0x7f4be0003570 con 0x7f4bf81578d0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfd408700 1 -- 172.21.15.6:0/571466366 >> v1:172.21.15.118:6789/0 conn(0x7f4bf806d120 legacy=0x7f4bf806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfd408700 1 -- 172.21.15.6:0/571466366 >> v1:172.21.15.6:6789/0 conn(0x7f4bf81578d0 legacy=0x7f4bf815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfd408700 1 -- 172.21.15.6:0/571466366 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80d0170 con 0x7f4bf8157ca0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.765+0000 7f4bfd408700 1 --2- 172.21.15.6:0/571466366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf8157ca0 0x7f4bf80cf4f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0098e0 tx=0x7f4bec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e46d0a0bd45f85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80017f0 con 0x7f4bf8157ca0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec011420 con 0x7f4bf8157ca0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bfcc07700 1 -- 172.21.15.6:0/571466366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0117c0 con 0x7f4bf8157ca0 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 -- 172.21.15.6:0/571466366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf8157ca0 msgr2=0x7f4bf80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/571466366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf8157ca0 0x7f4bf80cf4f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0098e0 tx=0x7f4bec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 -- 172.21.15.6:0/571466366 shutdown_connections 2023-10-09T11:40:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/571466366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf8157ca0 0x7f4bf80cf4f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 -- 172.21.15.6:0/571466366 >> 172.21.15.6:0/571466366 conn(0x7f4bf806bb90 msgr2=0x7f4bf806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 -- 172.21.15.6:0/571466366 shutdown_connections 2023-10-09T11:40:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.766+0000 7f4bffe6d700 1 -- 172.21.15.6:0/571466366 wait complete. 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.767+0000 7f4bffe6d700 1 Processor -- start 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.767+0000 7f4bffe6d700 1 -- start start 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf81578d0 0x7f4bf8144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bf8157ca0 0x7f4bf80aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80abf70 con 0x7f4bf806d120 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ad4b0 con 0x7f4bf81578d0 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bffe6d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ac8a0 con 0x7f4bf8157ca0 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55640/0 (socket says 172.21.15.6:55640) 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 -- 172.21.15.6:0/2300863050 learned_addr learned my addr 172.21.15.6:0/2300863050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfe40a700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bf8157ca0 0x7f4bf80aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 -- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bf8157ca0 msgr2=0x7f4bf80aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfd408700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf81578d0 0x7f4bf8144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bf8157ca0 0x7f4bf80aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 -- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf81578d0 msgr2=0x7f4bf8144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf81578d0 0x7f4bf8144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.768+0000 7f4bfdc09700 1 -- 172.21.15.6:0/2300863050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009420 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bfdc09700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4be800ccc0 tx=0x7f4be8007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8004dc0 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be800a8c0 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80acb80 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800ac80 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.769+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80ad140 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.770+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8067ac0 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.770+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4be8007360 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.771+0000 7f4bf5ffb700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 0x7f4be40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.771+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4be8083d50 con 0x7f4bf806d120 2023-10-09T11:40:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.771+0000 7f4bfd408700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 0x7f4be40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.771+0000 7f4bfd408700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 0x7f4be40693b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bf81580c0 tx=0x7f4bec016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:46.775+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4be8087030 con 0x7f4bf806d120 2023-10-09T11:40:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.010+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bf80d0450 con 0x7f4bf806d120 2023-10-09T11:40:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.011+0000 7f4bf5ffb700 1 -- 172.21.15.6:0/2300863050 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f4be8018de0 con 0x7f4bf806d120 2023-10-09T11:40:47.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:47.012 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5405,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2886288583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2886288583},{"type":"v1","addr":"172.21.15.118:6835","nonce":2886288583}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5543,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1004191202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1004191202},{"type":"v1","addr":"172.21.15.118:6834","nonce":1004191202}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2644323405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2644323405},{"type":"v1","addr":"172.21.15.6:6836","nonce":2644323405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/716788994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":716788994},{"type":"v1","addr":"172.21.15.6:6837","nonce":716788994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 msgr2=0x7f4be40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 0x7f4be40693b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bf81580c0 tx=0x7f4bec016000 comp rx=0 tx=0).stop 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 msgr2=0x7f4bf80ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4be800ccc0 tx=0x7f4be8007da0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 shutdown_connections 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4be4066f00 0x7f4be40693b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bf8157ca0 0x7f4bf80aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf806d120 0x7f4bf80ac250 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 --2- 172.21.15.6:0/2300863050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf81578d0 0x7f4bf8144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 >> 172.21.15.6:0/2300863050 conn(0x7f4bf806bb90 msgr2=0x7f4bf8068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 shutdown_connections 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.013+0000 7f4bffe6d700 1 -- 172.21.15.6:0/2300863050 wait complete. 2023-10-09T11:40:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 45 2023-10-09T11:40:47.026 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:40:47.026 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:40:47.026 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:40:47.026 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:47.027 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:40:47.027 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:40:47.027 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:40:47.027 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:47.027 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:40:47.027 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:40:47.028 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:40:47.028 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:47.028 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:40:47.028 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:40:47.028 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:40:47.028 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:40:47.035 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:40:47.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:40:47.036 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:40:47.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:40:47.040 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:40:47.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:40:47.041 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:40:47.041 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:40:47.078 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:40:47.078 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:47.078 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:40:47.079 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:47.083 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:40:47.083 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:47.083 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:40:47.083 DEBUG:teuthology.parallel:result is None 2023-10-09T11:40:47.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:40:47.154 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:40:47.154 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:40:47.161 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:40:47.161 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:40:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.209+0000 7ff6927a0700 1 Processor -- start 2023-10-09T11:40:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 -- start start 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff68c159bc0 0x7ff68c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c0cf060 0x7ff68c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c067640 con 0x7ff68c159f90 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c0b1e50 con 0x7ff68c159bc0 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.210+0000 7ff6927a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c067890 con 0x7ff68c0cf060 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff68c159bc0 0x7ff68c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff68c159bc0 0x7ff68c0b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55668/0 (socket says 172.21.15.6:55668) 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 -- 172.21.15.6:0/3660999226 learned_addr learned my addr 172.21.15.6:0/3660999226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff691f9f700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c0cf060 0x7ff68c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 -- 172.21.15.6:0/3660999226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c0cf060 msgr2=0x7ff68c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c0cf060 0x7ff68c06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 -- 172.21.15.6:0/3660999226 >> v1:172.21.15.118:6789/0 conn(0x7ff68c159f90 legacy=0x7ff68c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff68bfff700 1 -- 172.21.15.6:0/3660999226 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800290749 0 0) 0x7ff68c067640 con 0x7ff68c159f90 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 -- 172.21.15.6:0/3660999226 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c067b70 con 0x7ff68c159bc0 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff69179e700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c159bc0 0x7ff68c0b17c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f20 tx=0x7ff684009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dc26b46175601b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff68bfff700 1 -- 172.21.15.6:0/3660999226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400e070 con 0x7ff68c159bc0 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff68bfff700 1 -- 172.21.15.6:0/3660999226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400b9d0 con 0x7ff68c159bc0 2023-10-09T11:40:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.211+0000 7ff68bfff700 1 -- 172.21.15.6:0/3660999226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6840092e0 con 0x7ff68c159bc0 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 -- 172.21.15.6:0/3660999226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c159bc0 msgr2=0x7ff68c0b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c159bc0 0x7ff68c0b17c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f20 tx=0x7ff684009840 comp rx=0 tx=0).stop 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 -- 172.21.15.6:0/3660999226 shutdown_connections 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c0cf060 0x7ff68c06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 --2- 172.21.15.6:0/3660999226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c159bc0 0x7ff68c0b17c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 -- 172.21.15.6:0/3660999226 >> 172.21.15.6:0/3660999226 conn(0x7ff68c06c620 msgr2=0x7ff68c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 -- 172.21.15.6:0/3660999226 shutdown_connections 2023-10-09T11:40:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.212+0000 7ff6927a0700 1 -- 172.21.15.6:0/3660999226 wait complete. 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.213+0000 7ff6927a0700 1 Processor -- start 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.213+0000 7ff6927a0700 1 -- start start 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c159bc0 0x7ff68c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c159f90 0x7ff68c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0c8710 con 0x7ff68c0cf060 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0b03b0 con 0x7ff68c159f90 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff6927a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0b0690 con 0x7ff68c159bc0 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55682/0 (socket says 172.21.15.6:55682) 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 -- 172.21.15.6:0/160500991 learned_addr learned my addr 172.21.15.6:0/160500991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff691f9f700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c159f90 0x7ff68c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff690f9d700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c159bc0 0x7ff68c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 -- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c159bc0 msgr2=0x7ff68c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c159bc0 0x7ff68c0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 -- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c159f90 msgr2=0x7ff68c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c159f90 0x7ff68c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 -- 172.21.15.6:0/160500991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684009ae0 con 0x7ff68c0cf060 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.214+0000 7ff69179e700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff68c063870 tx=0x7ff684018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.215+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684008870 con 0x7ff68c0cf060 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.215+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6840089d0 con 0x7ff68c0cf060 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.215+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684008d90 con 0x7ff68c0cf060 2023-10-09T11:40:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.215+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c0b0970 con 0x7ff68c0cf060 2023-10-09T11:40:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.215+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c16a2b0 con 0x7ff68c0cf060 2023-10-09T11:40:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.216+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c16a470 con 0x7ff68c0cf060 2023-10-09T11:40:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.216+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff684003040 con 0x7ff68c0cf060 2023-10-09T11:40:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.216+0000 7ff6897fa700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.216+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff684085cc0 con 0x7ff68c0cf060 2023-10-09T11:40:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.216+0000 7ff690f9d700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:47.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.217+0000 7ff690f9d700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 0x7ff6780693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff68c06b5e0 tx=0x7ff680007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:47.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.221+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6840532e0 con 0x7ff68c0cf060 2023-10-09T11:40:47.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:47.429+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff68c071b10 con 0x7ff68c0cf060 2023-10-09T11:40:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.073+0000 7ff6897fa700 1 -- 172.21.15.6:0/160500991 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff684056900 con 0x7ff68c0cf060 2023-10-09T11:40:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 msgr2=0x7ff6780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 0x7ff6780693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff68c06b5e0 tx=0x7ff680007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 msgr2=0x7ff68c0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff68c063870 tx=0x7ff684018000 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 shutdown_connections 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff68c159f90 0x7ff68c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff68c0cf060 0x7ff68c0cdd30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 --2- 172.21.15.6:0/160500991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff68c159bc0 0x7ff68c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 >> 172.21.15.6:0/160500991 conn(0x7ff68c06c620 msgr2=0x7ff68c154200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 shutdown_connections 2023-10-09T11:40:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.076+0000 7ff6927a0700 1 -- 172.21.15.6:0/160500991 wait complete. 2023-10-09T11:40:48.079 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:40:48.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:40:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.213+0000 7f43267f3700 1 Processor -- start 2023-10-09T11:40:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.213+0000 7f43267f3700 1 -- start start 2023-10-09T11:40:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43267f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 0x7f43200cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43267f3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4320068e90 0x7f43200cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43267f3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200cee10 con 0x7f4320159f10 2023-10-09T11:40:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43267f3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43200cd040 con 0x7f4320068e90 2023-10-09T11:40:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43267f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200cd320 con 0x7f4320159b40 2023-10-09T11:40:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43257f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 0x7f43200cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4320068e90 0x7f43200cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4320068e90 0x7f43200cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:35750/0 (socket says 172.21.15.6:35750) 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f43257f1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 0x7f43200cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:54108/0 (socket says 172.21.15.6:54108) 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 -- 172.21.15.6:0/3611807588 learned_addr learned my addr 172.21.15.6:0/3611807588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4324ff0700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4320159f10 0x7f4320068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:58850/0 (socket says 172.21.15.6:58850) 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 -- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 msgr2=0x7f43200cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 --2- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 0x7f43200cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 -- 172.21.15.6:0/3611807588 >> v1:172.21.15.118:6789/0 conn(0x7f4320159f10 legacy=0x7f4320068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f431ffff700 1 -- 172.21.15.6:0/3611807588 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330362633 0 0) 0x7f43200cee10 con 0x7f4320159f10 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.214+0000 7f4325ff2700 1 -- 172.21.15.6:0/3611807588 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200ce7c0 con 0x7f4320068e90 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f4325ff2700 1 --2- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320068e90 0x7f43200cf2a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4310009f20 tx=0x7f4310009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eebbcc591bde63be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f431ffff700 1 -- 172.21.15.6:0/3611807588 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e070 con 0x7f4320068e90 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f431ffff700 1 -- 172.21.15.6:0/3611807588 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000b9d0 con 0x7f4320068e90 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f431ffff700 1 -- 172.21.15.6:0/3611807588 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100092e0 con 0x7f4320068e90 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 -- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320068e90 msgr2=0x7f43200cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 --2- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320068e90 0x7f43200cf2a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4310009f20 tx=0x7f4310009840 comp rx=0 tx=0).stop 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 -- 172.21.15.6:0/3611807588 shutdown_connections 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 --2- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320068e90 0x7f43200cf2a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 --2- 172.21.15.6:0/3611807588 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320159b40 0x7f43200cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 -- 172.21.15.6:0/3611807588 >> 172.21.15.6:0/3611807588 conn(0x7f43200cd660 msgr2=0x7f43200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 -- 172.21.15.6:0/3611807588 shutdown_connections 2023-10-09T11:40:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.215+0000 7f43267f3700 1 -- 172.21.15.6:0/3611807588 wait complete. 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.216+0000 7f43267f3700 1 Processor -- start 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 -- start start 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320068e90 0x7f43200b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320159b40 0x7f4320152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c93b0 con 0x7f4320159f10 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c9650 con 0x7f4320159b40 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.217+0000 7f43267f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c9930 con 0x7f4320068e90 2023-10-09T11:40:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55692/0 (socket says 172.21.15.6:55692) 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 -- 172.21.15.6:0/3658397084 learned_addr learned my addr 172.21.15.6:0/3658397084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4324ff0700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320159b40 0x7f4320152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f43257f1700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320068e90 0x7f43200b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 -- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320068e90 msgr2=0x7f43200b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320068e90 0x7f43200b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 -- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320159b40 msgr2=0x7f4320152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320159b40 0x7f4320152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 -- 172.21.15.6:0/3658397084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310009ae0 con 0x7f4320159f10 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f4325ff2700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4310012000 tx=0x7f4310018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310008b10 con 0x7f4320159f10 2023-10-09T11:40:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310008c90 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43200c9c10 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100266b0 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.218+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43200ca260 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.219+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320063e90 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.220+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4310003040 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.220+0000 7f431d7fa700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.220+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4310086100 con 0x7f4320159f10 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.220+0000 7f43257f1700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.220+0000 7f43257f1700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4318009db0 tx=0x7f43180091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.224+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43100536c0 con 0x7f4320159f10 2023-10-09T11:40:48.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.495+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43200ceaa0 con 0x7f4320159f10 2023-10-09T11:40:48.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.496+0000 7f431d7fa700 1 -- 172.21.15.6:0/3658397084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4310056ce0 con 0x7f4320159f10 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:40:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:40:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:40:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:40:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:40:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:40:48.513 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:40:48.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 msgr2=0x7f430c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4318009db0 tx=0x7f43180091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 msgr2=0x7f43200cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4310012000 tx=0x7f4310018000 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 shutdown_connections 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4320159f10 0x7f43200cf960 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4320068e90 0x7f43200b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 --2- 172.21.15.6:0/3658397084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4320159b40 0x7f4320152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 >> 172.21.15.6:0/3658397084 conn(0x7f43200cd660 msgr2=0x7f432006dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 shutdown_connections 2023-10-09T11:40:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.498+0000 7f43267f3700 1 -- 172.21.15.6:0/3658397084 wait complete. 2023-10-09T11:40:48.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 Processor -- start 2023-10-09T11:40:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 -- start start 2023-10-09T11:40:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 0x7f5f840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f84157ca0 0x7f5f8415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f840d07c0 con 0x7f5f8406d120 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f840cfbb0 con 0x7f5f84157ca0 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.634+0000 7f5f8a996700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840cfe90 con 0x7f5f841578d0 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f84157ca0 0x7f5f8415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f88f33700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f8406d120 0x7f5f8415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50572/0 (socket says 172.21.15.6:50572) 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f88f33700 1 -- 172.21.15.6:0/868733040 learned_addr learned my addr 172.21.15.6:0/868733040 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f83fff700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 0x7f5f840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 -- 172.21.15.6:0/868733040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 msgr2=0x7f5f840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 0x7f5f840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 -- 172.21.15.6:0/868733040 >> v1:172.21.15.6:6789/0 conn(0x7f5f8406d120 legacy=0x7f5f8415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 -- 172.21.15.6:0/868733040 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840d0170 con 0x7f5f84157ca0 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f83fff700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 0x7f5f840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f837fe700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f8415af00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5f780098e0 tx=0x7f5f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb14ebfdc920fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f82ffd700 1 -- 172.21.15.6:0/868733040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78009e80 con 0x7f5f84157ca0 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f82ffd700 1 -- 172.21.15.6:0/868733040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7800b860 con 0x7f5f84157ca0 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.635+0000 7f5f82ffd700 1 -- 172.21.15.6:0/868733040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7800bbe0 con 0x7f5f84157ca0 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 -- 172.21.15.6:0/868733040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 msgr2=0x7f5f8415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f8415af00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5f780098e0 tx=0x7f5f780091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 -- 172.21.15.6:0/868733040 shutdown_connections 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f841578d0 0x7f5f840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 --2- 172.21.15.6:0/868733040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f8415af00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 -- 172.21.15.6:0/868733040 >> 172.21.15.6:0/868733040 conn(0x7f5f8406bb90 msgr2=0x7f5f8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 -- 172.21.15.6:0/868733040 shutdown_connections 2023-10-09T11:40:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.636+0000 7f5f8a996700 1 -- 172.21.15.6:0/868733040 wait complete. 2023-10-09T11:40:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.637+0000 7f5f8a996700 1 Processor -- start 2023-10-09T11:40:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.637+0000 7f5f8a996700 1 -- start start 2023-10-09T11:40:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8406d120 0x7f5f8414b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f841578d0 0x7f5f8416b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840cac50 con 0x7f5f84157ca0 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c7be0 con 0x7f5f841578d0 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f8a996700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8414be00 con 0x7f5f8406d120 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55708/0 (socket says 172.21.15.6:55708) 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 -- 172.21.15.6:0/2221824100 learned_addr learned my addr 172.21.15.6:0/2221824100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f837fe700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f841578d0 0x7f5f8416b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f83fff700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8406d120 0x7f5f8414b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 -- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8406d120 msgr2=0x7f5f8414b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8406d120 0x7f5f8414b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 -- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f841578d0 msgr2=0x7f5f8416b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f841578d0 0x7f5f8416b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 -- 172.21.15.6:0/2221824100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78009420 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f88f33700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00cc40 tx=0x7f5f7c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.638+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00a8b0 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.639+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00aa10 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.639+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f840c6fd0 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.639+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00add0 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.639+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f840c7590 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.639+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8406e700 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.640+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7c007300 con 0x7f5f84157ca0 2023-10-09T11:40:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.640+0000 7f5f6bfff700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.640+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5f7c084480 con 0x7f5f84157ca0 2023-10-09T11:40:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.640+0000 7f5f83fff700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.641+0000 7f5f83fff700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5f8415c210 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.645+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f7c051ac0 con 0x7f5f84157ca0 2023-10-09T11:40:48.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.840+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f8415cfd0 con 0x7f5f84157ca0 2023-10-09T11:40:48.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.841+0000 7f5f6bfff700 1 -- 172.21.15.6:0/2221824100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f5f7c0550e0 con 0x7f5f84157ca0 2023-10-09T11:40:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:48.843 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":91,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:48.078604+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 msgr2=0x7f5f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5f8415c210 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2023-10-09T11:40:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 msgr2=0x7f5f84069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00cc40 tx=0x7f5f7c001a50 comp rx=0 tx=0).stop 2023-10-09T11:40:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 shutdown_connections 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f84157ca0 0x7f5f84069890 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f8406d120 0x7f5f8414b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 --2- 172.21.15.6:0/2221824100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f841578d0 0x7f5f8416b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 >> 172.21.15.6:0/2221824100 conn(0x7f5f8406bb90 msgr2=0x7f5f84156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 shutdown_connections 2023-10-09T11:40:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.843+0000 7f5f8a996700 1 -- 172.21.15.6:0/2221824100 wait complete. 2023-10-09T11:40:48.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:40:48.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:40:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.978+0000 7f1654740700 1 Processor -- start 2023-10-09T11:40:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.978+0000 7f1654740700 1 -- start start 2023-10-09T11:40:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c1578d0 0x7f164c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f164c157ca0 0x7f164c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f164c06d120 0x7f164c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c06dac0 con 0x7f164c06d120 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0d07c0 con 0x7f164c157ca0 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.979+0000 7f1654740700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0cfbb0 con 0x7f164c1578d0 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f164c06d120 0x7f164c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f164c06d120 0x7f164c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55718/0 (socket says 172.21.15.6:55718) 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 -- 172.21.15.6:0/1332032632 learned_addr learned my addr 172.21.15.6:0/1332032632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f16524dc700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c1578d0 0x7f164c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1651cdb700 1 --2- 172.21.15.6:0/1332032632 >> v2:172.21.15.118:3300/0 conn(0x7f164c157ca0 0x7f164c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 -- 172.21.15.6:0/1332032632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c1578d0 msgr2=0x7f164c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c1578d0 0x7f164c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 -- 172.21.15.6:0/1332032632 >> v2:172.21.15.118:3300/0 conn(0x7f164c157ca0 msgr2=0x7f164c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 --2- 172.21.15.6:0/1332032632 >> v2:172.21.15.118:3300/0 conn(0x7f164c157ca0 0x7f164c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 -- 172.21.15.6:0/1332032632 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0cfe90 con 0x7f164c06d120 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f1652cdd700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c06d120 0x7f164c06d580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f164c06cb70 tx=0x7f1644009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a57bac4431b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f16514da700 1 -- 172.21.15.6:0/1332032632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400e070 con 0x7f164c06d120 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f16514da700 1 -- 172.21.15.6:0/1332032632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400ba50 con 0x7f164c06d120 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.980+0000 7f16514da700 1 -- 172.21.15.6:0/1332032632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440092e0 con 0x7f164c06d120 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 -- 172.21.15.6:0/1332032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c06d120 msgr2=0x7f164c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c06d120 0x7f164c06d580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f164c06cb70 tx=0x7f1644009840 comp rx=0 tx=0).stop 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 -- 172.21.15.6:0/1332032632 shutdown_connections 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c06d120 0x7f164c06d580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 --2- 172.21.15.6:0/1332032632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c1578d0 0x7f164c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 --2- 172.21.15.6:0/1332032632 >> v2:172.21.15.118:3300/0 conn(0x7f164c157ca0 0x7f164c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 -- 172.21.15.6:0/1332032632 >> 172.21.15.6:0/1332032632 conn(0x7f164c06bb90 msgr2=0x7f164c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 -- 172.21.15.6:0/1332032632 shutdown_connections 2023-10-09T11:40:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.981+0000 7f1654740700 1 -- 172.21.15.6:0/1332032632 wait complete. 2023-10-09T11:40:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.982+0000 7f1654740700 1 Processor -- start 2023-10-09T11:40:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.982+0000 7f1654740700 1 -- start start 2023-10-09T11:40:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c06d120 0x7f164c14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164c1578d0 0x7f164c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b03d0 con 0x7f164c157ca0 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0ac080 con 0x7f164c1578d0 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0ab3e0 con 0x7f164c06d120 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55728/0 (socket says 172.21.15.6:55728) 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 -- 172.21.15.6:0/4001884309 learned_addr learned my addr 172.21.15.6:0/4001884309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f16524dc700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c06d120 0x7f164c14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1651cdb700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164c1578d0 0x7f164c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 -- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c06d120 msgr2=0x7f164c14a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c06d120 0x7f164c14a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 -- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164c1578d0 msgr2=0x7f164c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164c1578d0 0x7f164c0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 -- 172.21.15.6:0/4001884309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009ae0 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1652cdd700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f164c06fe20 tx=0x7f1644018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440032f0 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644008d20 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440266b0 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.983+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0ab6c0 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.984+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c0abd10 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.984+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c067ac0 con 0x7f164c157ca0 2023-10-09T11:40:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.985+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1644003040 con 0x7f164c157ca0 2023-10-09T11:40:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.985+0000 7f164a7fc700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 0x7f16380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.985+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1644085f40 con 0x7f164c157ca0 2023-10-09T11:40:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.985+0000 7f16524dc700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 0x7f16380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.986+0000 7f16524dc700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 0x7f16380693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f163c006fd0 tx=0x7f163c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:48.989+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1644053510 con 0x7f164c157ca0 2023-10-09T11:40:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.182+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f164c0ac1c0 con 0x7f164c157ca0 2023-10-09T11:40:49.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.183+0000 7f164a7fc700 1 -- 172.21.15.6:0/4001884309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1644021020 con 0x7f164c157ca0 2023-10-09T11:40:49.185 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 msgr2=0x7f16380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 0x7f16380693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f163c006fd0 tx=0x7f163c008040 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 msgr2=0x7f164c0aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f164c06fe20 tx=0x7f1644018000 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 shutdown_connections 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1638066f30 0x7f16380693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164c157ca0 0x7f164c0aadd0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f164c06d120 0x7f164c14a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 --2- 172.21.15.6:0/4001884309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164c1578d0 0x7f164c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 >> 172.21.15.6:0/4001884309 conn(0x7f164c06bb90 msgr2=0x7f164c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 shutdown_connections 2023-10-09T11:40:49.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.185+0000 7f1654740700 1 -- 172.21.15.6:0/4001884309 wait complete. 2023-10-09T11:40:49.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:40:49.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.316+0000 7facdbfc1700 1 Processor -- start 2023-10-09T11:40:49.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.316+0000 7facdbfc1700 1 -- start start 2023-10-09T11:40:49.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facd41578d0 0x7facd40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd4157ca0 0x7facd415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facd406d120 0x7facd406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd406dac0 con 0x7facd41578d0 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40d07c0 con 0x7facd406d120 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facdbfc1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40cfbb0 con 0x7facd4157ca0 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facd41578d0 0x7facd40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facd41578d0 0x7facd40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55732/0 (socket says 172.21.15.6:55732) 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 -- 172.21.15.6:0/3591930187 learned_addr learned my addr 172.21.15.6:0/3591930187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd955c700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd4157ca0 0x7facd415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facda55e700 1 --2- 172.21.15.6:0/3591930187 >> v2:172.21.15.118:3300/0 conn(0x7facd406d120 0x7facd406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 -- 172.21.15.6:0/3591930187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd4157ca0 msgr2=0x7facd415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd4157ca0 0x7facd415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 -- 172.21.15.6:0/3591930187 >> v2:172.21.15.118:3300/0 conn(0x7facd406d120 msgr2=0x7facd406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 --2- 172.21.15.6:0/3591930187 >> v2:172.21.15.118:3300/0 conn(0x7facd406d120 0x7facd406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 -- 172.21.15.6:0/3591930187 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40cfe90 con 0x7facd41578d0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd9d5d700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd41578d0 0x7facd40cf4f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7facd40b3940 tx=0x7facd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf44e43ccae2b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd8d5b700 1 -- 172.21.15.6:0/3591930187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000b860 con 0x7facd41578d0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd8d5b700 1 -- 172.21.15.6:0/3591930187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000b9c0 con 0x7facd41578d0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.317+0000 7facd8d5b700 1 -- 172.21.15.6:0/3591930187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000bd60 con 0x7facd41578d0 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 -- 172.21.15.6:0/3591930187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd41578d0 msgr2=0x7facd40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd41578d0 0x7facd40cf4f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7facd40b3940 tx=0x7facd0009250 comp rx=0 tx=0).stop 2023-10-09T11:40:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 -- 172.21.15.6:0/3591930187 shutdown_connections 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 --2- 172.21.15.6:0/3591930187 >> v2:172.21.15.118:3300/0 conn(0x7facd406d120 0x7facd406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd41578d0 0x7facd40cf4f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 --2- 172.21.15.6:0/3591930187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd4157ca0 0x7facd415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 -- 172.21.15.6:0/3591930187 >> 172.21.15.6:0/3591930187 conn(0x7facd406bb90 msgr2=0x7facd406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 -- 172.21.15.6:0/3591930187 shutdown_connections 2023-10-09T11:40:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.318+0000 7facdbfc1700 1 -- 172.21.15.6:0/3591930187 wait complete. 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.319+0000 7facdbfc1700 1 Processor -- start 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.319+0000 7facdbfc1700 1 -- start start 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd406d120 0x7facd4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd41578d0 0x7facd40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c7070 con 0x7facd4157ca0 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c6460 con 0x7facd406d120 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facdbfc1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c6740 con 0x7facd41578d0 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55744/0 (socket says 172.21.15.6:55744) 2023-10-09T11:40:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 -- 172.21.15.6:0/1586969602 learned_addr learned my addr 172.21.15.6:0/1586969602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facd9d5d700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd406d120 0x7facd4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facd955c700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd41578d0 0x7facd40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 -- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd41578d0 msgr2=0x7facd40c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd41578d0 0x7facd40c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 -- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd406d120 msgr2=0x7facd4153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd406d120 0x7facd4153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.320+0000 7facda55e700 1 -- 172.21.15.6:0/1586969602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00094f0 con 0x7facd4157ca0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facda55e700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faccc009fa0 tx=0x7faccc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00ebc0 con 0x7facd4157ca0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00ed20 con 0x7facd4157ca0 2023-10-09T11:40:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40c6a20 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc014670 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.321+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd4153fb0 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.322+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd40c7220 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.322+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faccc0149e0 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.323+0000 7facc9ffb700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 0x7facb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.323+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faccc0847e0 con 0x7facd4157ca0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.323+0000 7facd9d5d700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 0x7facb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.323+0000 7facd9d5d700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 0x7facb80693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7facd40b3940 tx=0x7facd0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.327+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facd40c7220 con 0x7facd4157ca0 2023-10-09T11:40:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.526+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7facd40c71b0 con 0x7facd4157ca0 2023-10-09T11:40:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.527+0000 7facc9ffb700 1 -- 172.21.15.6:0/1586969602 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+65 (secure 0 0 0) 0x7faccc051da0 con 0x7facd4157ca0 2023-10-09T11:40:49.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:40:49.529 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 msgr2=0x7facb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 0x7facb80693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7facd40b3940 tx=0x7facd0017000 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 msgr2=0x7facd4156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faccc009fa0 tx=0x7faccc009900 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 shutdown_connections 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facb8066f30 0x7facb80693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd4157ca0 0x7facd4156740 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd406d120 0x7facd4153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 --2- 172.21.15.6:0/1586969602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd41578d0 0x7facd40c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 >> 172.21.15.6:0/1586969602 conn(0x7facd406bb90 msgr2=0x7facd4154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 shutdown_connections 2023-10-09T11:40:49.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.529+0000 7facdbfc1700 1 -- 172.21.15.6:0/1586969602 wait complete. 2023-10-09T11:40:49.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:40:49.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:40:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.664+0000 7f3123fff700 1 Processor -- start 2023-10-09T11:40:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.664+0000 7f3123fff700 1 -- start start 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f3123fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31240d0f50 0x7f312406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f3123fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312406d990 con 0x7f312406d530 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f3123fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31240cf2d0 con 0x7f31240d0b80 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f3123fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312415a690 con 0x7f31240d0f50 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31240d0f50 0x7f312406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31240d0f50 0x7f312406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55758/0 (socket says 172.21.15.6:55758) 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31237fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f312406d530 0x7f312415b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50578/0 (socket says 172.21.15.6:50578) 2023-10-09T11:40:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 -- 172.21.15.6:0/3247696454 learned_addr learned my addr 172.21.15.6:0/3247696454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 -- 172.21.15.6:0/3247696454 >> v1:172.21.15.118:6789/0 conn(0x7f31240d0b80 legacy=0x7f31240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 -- 172.21.15.6:0/3247696454 >> v1:172.21.15.6:6789/0 conn(0x7f312406d530 legacy=0x7f312415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f31227fc700 1 -- 172.21.15.6:0/3247696454 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240d0480 con 0x7f31240d0f50 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.665+0000 7f3121ffb700 1 -- 172.21.15.6:0/3247696454 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150059310 0 0) 0x7f312406d990 con 0x7f312406d530 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f31227fc700 1 --2- 172.21.15.6:0/3247696454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0f50 0x7f312406cff0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f310c0099b0 tx=0x7f310c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88456c95eaa47caf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3121ffb700 1 -- 172.21.15.6:0/3247696454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00b820 con 0x7f31240d0f50 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3121ffb700 1 -- 172.21.15.6:0/3247696454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c00b980 con 0x7f31240d0f50 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3121ffb700 1 -- 172.21.15.6:0/3247696454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00bd20 con 0x7f31240d0f50 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 -- 172.21.15.6:0/3247696454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0f50 msgr2=0x7f312406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 --2- 172.21.15.6:0/3247696454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0f50 0x7f312406cff0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f310c0099b0 tx=0x7f310c009250 comp rx=0 tx=0).stop 2023-10-09T11:40:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 -- 172.21.15.6:0/3247696454 shutdown_connections 2023-10-09T11:40:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 --2- 172.21.15.6:0/3247696454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0f50 0x7f312406cff0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 -- 172.21.15.6:0/3247696454 >> 172.21.15.6:0/3247696454 conn(0x7f3124063230 msgr2=0x7f3124063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 -- 172.21.15.6:0/3247696454 shutdown_connections 2023-10-09T11:40:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.666+0000 7f3123fff700 1 -- 172.21.15.6:0/3247696454 wait complete. 2023-10-09T11:40:49.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.667+0000 7f3123fff700 1 Processor -- start 2023-10-09T11:40:49.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.667+0000 7f3123fff700 1 -- start start 2023-10-09T11:40:49.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f312406d530 0x7f312414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31240d0f50 0x7f31241508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240b48c0 con 0x7f31240d0b80 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240b5720 con 0x7f312406d530 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f3123fff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31240b4b10 con 0x7f31240d0f50 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f31227fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f31227fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55770/0 (socket says 172.21.15.6:55770) 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.668+0000 7f31227fc700 1 -- 172.21.15.6:0/391394090 learned_addr learned my addr 172.21.15.6:0/391394090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 -- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31240d0f50 msgr2=0x7f31241508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31240d0f50 0x7f31241508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 -- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f312406d530 msgr2=0x7f312414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f3122ffd700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f312406d530 0x7f312414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f312406d530 0x7f312414e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:49.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 -- 172.21.15.6:0/391394090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0094f0 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f31227fc700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f310c009290 tx=0x7f310c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00bc40 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c020070 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31240b4df0 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c01b6a0 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.669+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31240b53b0 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.670+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31240b5890 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.670+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f310c022030 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.671+0000 7f311affd700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 0x7f31040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.671+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f310c086110 con 0x7f31240d0b80 2023-10-09T11:40:49.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.671+0000 7f3122ffd700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 0x7f31040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:49.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.671+0000 7f3122ffd700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 0x7f31040693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f31240b6330 tx=0x7f311c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.675+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f310c0536d0 con 0x7f31240d0b80 2023-10-09T11:40:49.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:49.868+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f31240b5890 con 0x7f31240d0b80 2023-10-09T11:40:50.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.087+0000 7f311affd700 1 -- 172.21.15.6:0/391394090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7f310c056cf0 con 0x7f31240d0b80 2023-10-09T11:40:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 msgr2=0x7f31040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 0x7f31040693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f31240b6330 tx=0x7f311c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 msgr2=0x7f3124150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f310c009290 tx=0x7f310c016000 comp rx=0 tx=0).stop 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 shutdown_connections 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3104066f30 0x7f31040693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31240d0f50 0x7f31241508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f312406d530 0x7f312414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 --2- 172.21.15.6:0/391394090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31240d0b80 0x7f3124150370 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.090+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 >> 172.21.15.6:0/391394090 conn(0x7f3124063230 msgr2=0x7f3124068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.091+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 shutdown_connections 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.091+0000 7f3123fff700 1 -- 172.21.15.6:0/391394090 wait complete. 2023-10-09T11:40:50.093 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:40:50.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:40:50.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.229+0000 7fbf1359e700 1 Processor -- start 2023-10-09T11:40:50.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.229+0000 7fbf1359e700 1 -- start start 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf14164fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140c40e0 con 0x7fbf1415a250 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1359e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140c43c0 con 0x7fbf1415e800 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1415dad0 con 0x7fbf1406c2a0 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf1415a250 0x7fbf1406a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50590/0 (socket says 172.21.15.6:50590) 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1259c700 1 -- 172.21.15.6:0/1432981252 learned_addr learned my addr 172.21.15.6:0/1432981252 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:50.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf14164fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.230+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302304548 0 0) 0x7fbf140c40e0 con 0x7fbf1415a250 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf00003570 con 0x7fbf1415a250 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868926230 0 0) 0x7fbf00003570 con 0x7fbf1415a250 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 msgr2=0x7fbf14164fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf14164fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 >> v1:172.21.15.118:6789/0 conn(0x7fbf1415e800 legacy=0x7fbf1406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140c46a0 con 0x7fbf1415a250 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fbf0c001470 con 0x7fbf1415a250 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 >> v1:172.21.15.6:6789/0 conn(0x7fbf1415a250 legacy=0x7fbf1406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf00003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf00003fd0 0x7fbf00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf00004d50 0x7fbf000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1415dad0 con 0x7fbf00004d50 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0000bb40 con 0x7fbf00003fd0 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0000bd00 con 0x7fbf1406c2a0 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf00004d50 0x7fbf000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf1259c700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf00003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf11d9b700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf00003fd0 0x7fbf00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 -- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 msgr2=0x7fbf00003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf1406c2a0 0x7fbf00003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 -- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf00003fd0 msgr2=0x7fbf00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf00003fd0 0x7fbf00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.231+0000 7fbf12d9d700 1 -- 172.21.15.6:0/1432981252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf00003570 con 0x7fbf00004d50 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf00004d50 0x7fbf000051c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbf1406c6a0 tx=0x7fbf0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d64940176d1f9ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ea90 con 0x7fbf00004d50 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400f040 con 0x7fbf00004d50 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1159a700 1 -- 172.21.15.6:0/1432981252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ee40 con 0x7fbf00004d50 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 -- 172.21.15.6:0/1432981252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf00004d50 msgr2=0x7fbf000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 --2- 172.21.15.6:0/1432981252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf00004d50 0x7fbf000051c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbf1406c6a0 tx=0x7fbf0400b040 comp rx=0 tx=0).stop 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf12d9d700 1 -- 172.21.15.6:0/1432981252 reap_dead start 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 -- 172.21.15.6:0/1432981252 shutdown_connections 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 -- 172.21.15.6:0/1432981252 >> 172.21.15.6:0/1432981252 conn(0x7fbf1406cca0 msgr2=0x7fbf1406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 -- 172.21.15.6:0/1432981252 shutdown_connections 2023-10-09T11:40:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.232+0000 7fbf1359e700 1 -- 172.21.15.6:0/1432981252 wait complete. 2023-10-09T11:40:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.233+0000 7fbf1359e700 1 Processor -- start 2023-10-09T11:40:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.233+0000 7fbf1359e700 1 -- start start 2023-10-09T11:40:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 0x7fbf1416b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 0x7fbf140b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140b0e60 con 0x7fbf140aee70 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140af3c0 con 0x7fbf14156700 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140b0810 con 0x7fbf00004d50 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55788/0 (socket says 172.21.15.6:55788) 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 -- 172.21.15.6:0/226970683 learned_addr learned my addr 172.21.15.6:0/226970683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf1259c700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 0x7fbf1416b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 0x7fbf140b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 -- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 msgr2=0x7fbf1416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 0x7fbf1416b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 -- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 msgr2=0x7fbf140b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 0x7fbf140b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.234+0000 7fbf11d9b700 1 -- 172.21.15.6:0/226970683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140b0af0 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf1259c700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 0x7fbf1416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf12d9d700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 0x7fbf140b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf11d9b700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00f8d0 tx=0x7fbefc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00d640 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00d7a0 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1416bb00 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00db40 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.235+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140ad480 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.236+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf140b1010 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.236+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbefc01c400 con 0x7fbf140aee70 2023-10-09T11:40:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.237+0000 7fbf0a7fc700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 0x7fbef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.237+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fbefc084680 con 0x7fbf140aee70 2023-10-09T11:40:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.237+0000 7fbf1259c700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 0x7fbef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.237+0000 7fbf1259c700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 0x7fbef40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c001c80 tx=0x7fbf0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.241+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf140b1010 con 0x7fbf140aee70 2023-10-09T11:40:50.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:50.433+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbf140b0c80 con 0x7fbf140aee70 2023-10-09T11:40:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.101+0000 7fbf0a7fc700 1 -- 172.21.15.6:0/226970683 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbefc0170d0 con 0x7fbf140aee70 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 msgr2=0x7fbef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 0x7fbef40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c001c80 tx=0x7fbf0c009040 comp rx=0 tx=0).stop 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 msgr2=0x7fbf140acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00f8d0 tx=0x7fbefc007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 shutdown_connections 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbef4066f30 0x7fbef40693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf14156700 0x7fbf140b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbf00004d50 0x7fbf1416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 --2- 172.21.15.6:0/226970683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf140aee70 0x7fbf140acd80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 >> 172.21.15.6:0/226970683 conn(0x7fbf1406cca0 msgr2=0x7fbf14069610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 shutdown_connections 2023-10-09T11:40:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.108+0000 7fbf1359e700 1 -- 172.21.15.6:0/226970683 wait complete. 2023-10-09T11:40:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:40:51.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:40:51.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.244+0000 7f4186f3c700 1 Processor -- start 2023-10-09T11:40:51.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.244+0000 7f4186f3c700 1 -- start start 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4186f3c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41800d0f50 0x7f418006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4186f3c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f418006d530 0x7f418015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4186f3c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418006d990 con 0x7f41800d0b80 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4186f3c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418015a690 con 0x7f41800d0f50 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4186f3c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800cf2d0 con 0x7f418006d530 2023-10-09T11:40:51.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4185739700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41800d0f50 0x7f418006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4185f3a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41800d0b80 0x7f41800cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50598/0 (socket says 172.21.15.6:50598) 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f4185f3a700 1 -- 172.21.15.6:0/988969516 learned_addr learned my addr 172.21.15.6:0/988969516 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.245+0000 7f418673b700 1 --2- 172.21.15.6:0/988969516 >> v2:172.21.15.118:3300/0 conn(0x7f418006d530 0x7f418015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4185739700 1 -- 172.21.15.6:0/988969516 >> v2:172.21.15.118:3300/0 conn(0x7f418006d530 msgr2=0x7f418015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4185739700 1 --2- 172.21.15.6:0/988969516 >> v2:172.21.15.118:3300/0 conn(0x7f418006d530 0x7f418015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4185739700 1 -- 172.21.15.6:0/988969516 >> v1:172.21.15.6:6789/0 conn(0x7f41800d0b80 legacy=0x7f41800cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4185739700 1 -- 172.21.15.6:0/988969516 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800d0480 con 0x7f41800d0f50 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4184f38700 1 -- 172.21.15.6:0/988969516 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419744520 0 0) 0x7f418006d990 con 0x7f41800d0b80 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4185739700 1 --2- 172.21.15.6:0/988969516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0f50 0x7f418006cff0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f41800ce9b0 tx=0x7f41740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423486c504270e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4184f38700 1 -- 172.21.15.6:0/988969516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400b6b0 con 0x7f41800d0f50 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4184f38700 1 -- 172.21.15.6:0/988969516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400b810 con 0x7f41800d0f50 2023-10-09T11:40:51.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4184f38700 1 -- 172.21.15.6:0/988969516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400bbb0 con 0x7f41800d0f50 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 -- 172.21.15.6:0/988969516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0f50 msgr2=0x7f418006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 --2- 172.21.15.6:0/988969516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0f50 0x7f418006cff0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f41800ce9b0 tx=0x7f41740091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 -- 172.21.15.6:0/988969516 shutdown_connections 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 --2- 172.21.15.6:0/988969516 >> v2:172.21.15.118:3300/0 conn(0x7f418006d530 0x7f418015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 --2- 172.21.15.6:0/988969516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0f50 0x7f418006cff0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.246+0000 7f4186f3c700 1 -- 172.21.15.6:0/988969516 >> 172.21.15.6:0/988969516 conn(0x7f4180063230 msgr2=0x7f4180063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.247+0000 7f4186f3c700 1 -- 172.21.15.6:0/988969516 shutdown_connections 2023-10-09T11:40:51.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.247+0000 7f4186f3c700 1 -- 172.21.15.6:0/988969516 wait complete. 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 Processor -- start 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 -- start start 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418006d530 0x7f418016b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41800d0f50 0x7f41800ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c6450 con 0x7f41800d0b80 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418016b000 con 0x7f418006d530 2023-10-09T11:40:51.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4186f3c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c5b20 con 0x7f41800d0f50 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4185739700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4185739700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55812/0 (socket says 172.21.15.6:55812) 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.248+0000 7f4185739700 1 -- 172.21.15.6:0/429006154 learned_addr learned my addr 172.21.15.6:0/429006154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185f3a700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418006d530 0x7f418016b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f418673b700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41800d0f50 0x7f41800ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 -- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41800d0f50 msgr2=0x7f41800ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41800d0f50 0x7f41800ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 -- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418006d530 msgr2=0x7f418016b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418006d530 0x7f418016b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 -- 172.21.15.6:0/429006154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009420 con 0x7f41800d0b80 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4185739700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f418006fcc0 tx=0x7f4174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011420 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011580 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800c5e00 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011940 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.249+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180148a30 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.250+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418006c770 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.251+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4174011d30 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.251+0000 7f417dffb700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.251+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4174085930 con 0x7f41800d0b80 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.251+0000 7f4185f3a700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:51.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.251+0000 7f4185f3a700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f41800cdc80 tx=0x7f4178009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:51.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.256+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4174052c00 con 0x7f41800d0b80 2023-10-09T11:40:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:51.492+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f41800676e0 con 0x7f41800d0b80 2023-10-09T11:40:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.104+0000 7f417dffb700 1 -- 172.21.15.6:0/429006154 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f41740150c0 con 0x7f41800d0b80 2023-10-09T11:40:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 msgr2=0x7f416c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f41800cdc80 tx=0x7f4178009040 comp rx=0 tx=0).stop 2023-10-09T11:40:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 msgr2=0x7f41801484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f418006fcc0 tx=0x7f4174017000 comp rx=0 tx=0).stop 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 shutdown_connections 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41800d0f50 0x7f41800ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418006d530 0x7f418016b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 --2- 172.21.15.6:0/429006154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d0b80 0x7f41801484f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 >> 172.21.15.6:0/429006154 conn(0x7f4180063230 msgr2=0x7f41800b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 shutdown_connections 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.116+0000 7f4186f3c700 1 -- 172.21.15.6:0/429006154 wait complete. 2023-10-09T11:40:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T11:40:52.131 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.251+0000 7f6bc36e4700 1 Processor -- start 2023-10-09T11:40:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.251+0000 7f6bc36e4700 1 -- start start 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc36e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bbc06d830 0x7f6bbc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc36e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0d07c0 con 0x7f6bbc157ca0 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc36e4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0cfbb0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc36e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0cfe90 con 0x7f6bbc06d830 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc0c7f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6bbc157ca0 0x7f6bbc06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50608/0 (socket says 172.21.15.6:50608) 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc0c7f700 1 -- 172.21.15.6:0/304648801 learned_addr learned my addr 172.21.15.6:0/304648801 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc1c81700 1 --2- 172.21.15.6:0/304648801 >> v2:172.21.15.6:3300/0 conn(0x7f6bbc06d830 0x7f6bbc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751201815 0 0) 0x7f6bbc0d07c0 con 0x7f6bbc157ca0 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba4003570 con 0x7f6bbc157ca0 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bc1c81700 1 -- 172.21.15.6:0/304648801 >> v1:172.21.15.118:6789/0 conn(0x7f6bbc1578d0 legacy=0x7f6bbc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.252+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633435353 0 0) 0x7f6bbc0cfbb0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc1c81700 1 -- 172.21.15.6:0/304648801 >> v1:172.21.15.6:6789/0 conn(0x7f6bbc157ca0 legacy=0x7f6bbc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc1c81700 1 -- 172.21.15.6:0/304648801 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0d0170 con 0x7f6bbc06d830 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc1c81700 1 --2- 172.21.15.6:0/304648801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc06d830 0x7f6bbc0cf4f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e60 tx=0x7f6bac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4e561944b65bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00e070 con 0x7f6bbc06d830 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00bb60 con 0x7f6bbc06d830 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bbbfff700 1 -- 172.21.15.6:0/304648801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac012430 con 0x7f6bbc06d830 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 -- 172.21.15.6:0/304648801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc06d830 msgr2=0x7f6bbc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/304648801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc06d830 0x7f6bbc0cf4f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e60 tx=0x7f6bac009780 comp rx=0 tx=0).stop 2023-10-09T11:40:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 -- 172.21.15.6:0/304648801 shutdown_connections 2023-10-09T11:40:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/304648801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc06d830 0x7f6bbc0cf4f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 -- 172.21.15.6:0/304648801 >> 172.21.15.6:0/304648801 conn(0x7f6bbc06bb90 msgr2=0x7f6bbc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.253+0000 7f6bc36e4700 1 -- 172.21.15.6:0/304648801 shutdown_connections 2023-10-09T11:40:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.254+0000 7f6bc36e4700 1 -- 172.21.15.6:0/304648801 wait complete. 2023-10-09T11:40:52.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 Processor -- start 2023-10-09T11:40:52.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 -- start start 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 0x7f6bbc14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 0x7f6bbc0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0aadd0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0abbf0 con 0x7f6bbc157ca0 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.255+0000 7f6bc36e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0aafe0 con 0x7f6bbc06d830 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55828/0 (socket says 172.21.15.6:55828) 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 -- 172.21.15.6:0/4133315298 learned_addr learned my addr 172.21.15.6:0/4133315298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc1480700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 0x7f6bbc14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc1c81700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 0x7f6bbc0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 -- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 msgr2=0x7f6bbc14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 0x7f6bbc14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 -- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 msgr2=0x7f6bbc0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 0x7f6bbc0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 -- 172.21.15.6:0/4133315298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009a20 con 0x7f6bbc1578d0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc1c81700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 0x7f6bbc0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc1480700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 0x7f6bbc14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc0c7f700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c590 tx=0x7f6bb0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005c00 con 0x7f6bbc1578d0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0005d60 con 0x7f6bbc1578d0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0ab2c0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00072e0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.256+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0ab880 con 0x7f6bbc1578d0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.257+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0abda0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.258+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bb0007690 con 0x7f6bbc1578d0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.258+0000 7f6bb97fa700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.258+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bb00839d0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.258+0000 7f6bc1480700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.259+0000 7f6bc1480700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40011e0 tx=0x7f6bb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.263+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bbc0abda0 con 0x7f6bbc1578d0 2023-10-09T11:40:52.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.459+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bbc0abd60 con 0x7f6bbc1578d0 2023-10-09T11:40:52.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.460+0000 7f6bb97fa700 1 -- 172.21.15.6:0/4133315298 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f6bb0017020 con 0x7f6bbc1578d0 2023-10-09T11:40:52.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:52.462 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:51.494593+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 msgr2=0x7f6ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40011e0 tx=0x7f6bb4009040 comp rx=0 tx=0).stop 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 msgr2=0x7f6bbc0b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c590 tx=0x7f6bb0007d90 comp rx=0 tx=0).stop 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 shutdown_connections 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bbc157ca0 0x7f6bbc0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6bbc06d830 0x7f6bbc14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 --2- 172.21.15.6:0/4133315298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1578d0 0x7f6bbc0b22e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 >> 172.21.15.6:0/4133315298 conn(0x7f6bbc06bb90 msgr2=0x7f6bbc156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 shutdown_connections 2023-10-09T11:40:52.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.462+0000 7f6bc36e4700 1 -- 172.21.15.6:0/4133315298 wait complete. 2023-10-09T11:40:52.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.593+0000 7f753cf4d700 1 Processor -- start 2023-10-09T11:40:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.593+0000 7f753cf4d700 1 -- start start 2023-10-09T11:40:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7538159b40 0x7f75380cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7538159f10 0x7f7538068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f7538068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380cee10 con 0x7f7538159f10 2023-10-09T11:40:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380cd040 con 0x7f7538159b40 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f753cf4d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380cd320 con 0x7f75380ccb40 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7538159f10 0x7f7538068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7538159f10 0x7f7538068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55836/0 (socket says 172.21.15.6:55836) 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 -- 172.21.15.6:0/2613690409 learned_addr learned my addr 172.21.15.6:0/2613690409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7537fff700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f7538068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f75377fe700 1 --2- 172.21.15.6:0/2613690409 >> v2:172.21.15.118:3300/0 conn(0x7f7538159b40 0x7f75380cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 -- 172.21.15.6:0/2613690409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 msgr2=0x7f7538068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f7538068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 -- 172.21.15.6:0/2613690409 >> v2:172.21.15.118:3300/0 conn(0x7f7538159b40 msgr2=0x7f75380cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 --2- 172.21.15.6:0/2613690409 >> v2:172.21.15.118:3300/0 conn(0x7f7538159b40 0x7f75380cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 -- 172.21.15.6:0/2613690409 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380ce7c0 con 0x7f7538159f10 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.594+0000 7f7536ffd700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538068780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f75380d0bc0 tx=0x7f752c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90acf63a54017c5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f75367fc700 1 -- 172.21.15.6:0/2613690409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00b860 con 0x7f7538159f10 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f75367fc700 1 -- 172.21.15.6:0/2613690409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c00b9c0 con 0x7f7538159f10 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f75367fc700 1 -- 172.21.15.6:0/2613690409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00bd60 con 0x7f7538159f10 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 -- 172.21.15.6:0/2613690409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 msgr2=0x7f7538068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538068780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f75380d0bc0 tx=0x7f752c009250 comp rx=0 tx=0).stop 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 -- 172.21.15.6:0/2613690409 shutdown_connections 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f7538068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 --2- 172.21.15.6:0/2613690409 >> v2:172.21.15.118:3300/0 conn(0x7f7538159b40 0x7f75380cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 --2- 172.21.15.6:0/2613690409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538068780 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 -- 172.21.15.6:0/2613690409 >> 172.21.15.6:0/2613690409 conn(0x7f75380cd660 msgr2=0x7f75380cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 -- 172.21.15.6:0/2613690409 shutdown_connections 2023-10-09T11:40:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.595+0000 7f753cf4d700 1 -- 172.21.15.6:0/2613690409 wait complete. 2023-10-09T11:40:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.596+0000 7f753cf4d700 1 Processor -- start 2023-10-09T11:40:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.596+0000 7f753cf4d700 1 -- start start 2023-10-09T11:40:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f753816d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7538159b40 0x7f753816dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753816b570 con 0x7f7538159f10 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380ca140 con 0x7f7538159b40 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f753cf4d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380ca420 con 0x7f75380ccb40 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f7537fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f7537fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55848/0 (socket says 172.21.15.6:55848) 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f7537fff700 1 -- 172.21.15.6:0/213250566 learned_addr learned my addr 172.21.15.6:0/213250566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f7536ffd700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7538159b40 0x7f753816dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.597+0000 7f75377fe700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f753816d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 -- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 msgr2=0x7f753816d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f753816d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 -- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7538159b40 msgr2=0x7f753816dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7538159b40 0x7f753816dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 -- 172.21.15.6:0/213250566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0094f0 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f7537fff700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fa0 tx=0x7f7530009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000ebc0 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000ed20 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753816b7c0 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530014670 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.598+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753815a540 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.599+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75380cb890 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.599+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7530014a20 con 0x7f7538159f10 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.600+0000 7f751f7fe700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 0x7f75240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.600+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7530084b20 con 0x7f7538159f10 2023-10-09T11:40:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.600+0000 7f75377fe700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 0x7f75240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.600+0000 7f75377fe700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 0x7f75240693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.604+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7530051d90 con 0x7f7538159f10 2023-10-09T11:40:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.799+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75380ceaa0 con 0x7f7538159f10 2023-10-09T11:40:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.800+0000 7f751f7fe700 1 -- 172.21.15.6:0/213250566 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f75300553b0 con 0x7f7538159f10 2023-10-09T11:40:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:52.802 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:51.494593+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 msgr2=0x7f75240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 0x7f75240693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7528006fd0 tx=0x7f7528008040 comp rx=0 tx=0).stop 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 msgr2=0x7f7538163d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fa0 tx=0x7f7530009900 comp rx=0 tx=0).stop 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 shutdown_connections 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7524066f30 0x7f75240693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7538159f10 0x7f7538163d70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75380ccb40 0x7f753816d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 --2- 172.21.15.6:0/213250566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7538159b40 0x7f753816dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 >> 172.21.15.6:0/213250566 conn(0x7f75380cd660 msgr2=0x7f753806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 shutdown_connections 2023-10-09T11:40:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.802+0000 7f753cf4d700 1 -- 172.21.15.6:0/213250566 wait complete. 2023-10-09T11:40:52.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:40:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.937+0000 7fdf8a324700 1 Processor -- start 2023-10-09T11:40:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.937+0000 7fdf8a324700 1 -- start start 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf8a324700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 0x7fdf840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf8a324700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf8a324700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf840d07c0 con 0x7fdf84157ca0 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf8a324700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8406daa0 con 0x7fdf841578d0 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf8a324700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840cfbb0 con 0x7fdf8406d120 2023-10-09T11:40:52.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf83fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 0x7fdf840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:54254/0 (socket says 172.21.15.6:54254) 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 -- 172.21.15.6:0/103157287 learned_addr learned my addr 172.21.15.6:0/103157287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf83fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 0x7fdf840cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:35882/0 (socket says 172.21.15.6:35882) 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 -- 172.21.15.6:0/103157287 >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 msgr2=0x7fdf840cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 --2- 172.21.15.6:0/103157287 >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 0x7fdf840cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 -- 172.21.15.6:0/103157287 >> v1:172.21.15.118:6789/0 conn(0x7fdf84157ca0 legacy=0x7fdf8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 -- 172.21.15.6:0/103157287 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840cfe90 con 0x7fdf8406d120 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.938+0000 7fdf888c1700 1 --2- 172.21.15.6:0/103157287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009f20 tx=0x7fdf7c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43e501d9d059ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf82ffd700 1 -- 172.21.15.6:0/103157287 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00e070 con 0x7fdf8406d120 2023-10-09T11:40:52.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf82ffd700 1 -- 172.21.15.6:0/103157287 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00b9d0 con 0x7fdf8406d120 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf82ffd700 1 -- 172.21.15.6:0/103157287 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0092e0 con 0x7fdf8406d120 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 -- 172.21.15.6:0/103157287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 msgr2=0x7fdf8406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 --2- 172.21.15.6:0/103157287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009f20 tx=0x7fdf7c009840 comp rx=0 tx=0).stop 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 -- 172.21.15.6:0/103157287 shutdown_connections 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 --2- 172.21.15.6:0/103157287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf8406d120 0x7fdf8406d560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 --2- 172.21.15.6:0/103157287 >> v2:172.21.15.118:3300/0 conn(0x7fdf841578d0 0x7fdf840cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 -- 172.21.15.6:0/103157287 >> 172.21.15.6:0/103157287 conn(0x7fdf8406bb90 msgr2=0x7fdf8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 -- 172.21.15.6:0/103157287 shutdown_connections 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.939+0000 7fdf8a324700 1 -- 172.21.15.6:0/103157287 wait complete. 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.940+0000 7fdf8a324700 1 Processor -- start 2023-10-09T11:40:52.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.940+0000 7fdf8a324700 1 -- start start 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 0x7fdf84158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf84157ca0 0x7fdf841590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840b6900 con 0x7fdf8406d120 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf84155040 con 0x7fdf84157ca0 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf8a324700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840b5cf0 con 0x7fdf841578d0 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55858/0 (socket says 172.21.15.6:55858) 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.941+0000 7fdf83fff700 1 -- 172.21.15.6:0/1044218012 learned_addr learned my addr 172.21.15.6:0/1044218012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf888c1700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf84157ca0 0x7fdf841590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf837fe700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 0x7fdf84158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 -- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 msgr2=0x7fdf84158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 0x7fdf84158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 -- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf84157ca0 msgr2=0x7fdf841590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf84157ca0 0x7fdf841590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 -- 172.21.15.6:0/1044218012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009ae0 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf837fe700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 0x7fdf84158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf83fff700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400ec80 tx=0x7fdf740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400c9d0 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400cb30 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf840b5fd0 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74013470 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.942+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf840b6590 con 0x7fdf8406d120 2023-10-09T11:40:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.943+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf84071b70 con 0x7fdf8406d120 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.944+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf74013820 con 0x7fdf8406d120 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.944+0000 7fdf6bfff700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.944+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf740848c0 con 0x7fdf8406d120 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.944+0000 7fdf837fe700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.945+0000 7fdf837fe700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 0x7fdf700693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdf840d0990 tx=0x7fdf78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:52.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:52.948+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf74051b30 con 0x7fdf8406d120 2023-10-09T11:40:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:53.188+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf840d0170 con 0x7fdf8406d120 2023-10-09T11:40:54.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.125+0000 7fdf6bfff700 1 -- 172.21.15.6:0/1044218012 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf74055150 con 0x7fdf8406d120 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.127+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 msgr2=0x7fdf700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.127+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 0x7fdf700693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdf840d0990 tx=0x7fdf78009040 comp rx=0 tx=0).stop 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.127+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 msgr2=0x7fdf84154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.127+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400ec80 tx=0x7fdf740091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 shutdown_connections 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf70066f30 0x7fdf700693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf84157ca0 0x7fdf841590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8406d120 0x7fdf84154b00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 --2- 172.21.15.6:0/1044218012 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf841578d0 0x7fdf84158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 >> 172.21.15.6:0/1044218012 conn(0x7fdf8406bb90 msgr2=0x7fdf841583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 shutdown_connections 2023-10-09T11:40:54.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.128+0000 7fdf8a324700 1 -- 172.21.15.6:0/1044218012 wait complete. 2023-10-09T11:40:54.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:40:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.271+0000 7f7d1b73e700 1 Processor -- start 2023-10-09T11:40:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d1b73e700 1 -- start start 2023-10-09T11:40:54.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d1b73e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d140cf240 0x7f7d140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d1b73e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140b0ca0 con 0x7f7d1415a2a0 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d1b73e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140b00d0 con 0x7f7d1406d650 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d1b73e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1406ea90 con 0x7f7d140cf240 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d194da700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d1415a2a0 0x7f7d140ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60962/0 (socket says 172.21.15.6:60962) 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.272+0000 7f7d194da700 1 -- 172.21.15.6:0/2999364390 learned_addr learned my addr 172.21.15.6:0/2999364390 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170226080 0 0) 0x7f7d140b0ca0 con 0x7f7d1415a2a0 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc003570 con 0x7f7d1415a2a0 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d18cd9700 1 --2- 172.21.15.6:0/2999364390 >> v2:172.21.15.118:3300/0 conn(0x7f7d140cf240 0x7f7d140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559712303 0 0) 0x7f7cfc003570 con 0x7f7d1415a2a0 2023-10-09T11:40:54.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 >> v2:172.21.15.118:3300/0 conn(0x7f7d140cf240 msgr2=0x7f7d140b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 --2- 172.21.15.6:0/2999364390 >> v2:172.21.15.118:3300/0 conn(0x7f7d140cf240 0x7f7d140b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 >> v1:172.21.15.118:6789/0 conn(0x7f7d1406d650 legacy=0x7f7d1406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140b0370 con 0x7f7d1415a2a0 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f7d0c001470 con 0x7f7d1415a2a0 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 >> v1:172.21.15.6:6789/0 conn(0x7f7d1415a2a0 legacy=0x7f7d140ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cfc004810 0x7f7cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc0051c0 0x7f7cfc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406ea90 con 0x7f7cfc003a60 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc00c0d0 con 0x7f7cfc0051c0 2023-10-09T11:40:54.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc00c290 con 0x7f7cfc004810 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d194da700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d18cd9700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cfc004810 0x7f7cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.273+0000 7f7d19cdb700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc0051c0 0x7f7cfc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 -- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cfc004810 msgr2=0x7f7cfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7cfc004810 0x7f7cfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 -- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc0051c0 msgr2=0x7f7cfc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc0051c0 0x7f7cfc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 -- 172.21.15.6:0/2999364390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc003570 con 0x7f7cfc003a60 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d19cdb700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc0051c0 0x7f7cfc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d19cdb700 1 -- 172.21.15.6:0/2999364390 reap_dead start 2023-10-09T11:40:54.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d194da700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c390 tx=0x7f7d140b0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d752b1808ebf7e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00cc60 con 0x7f7cfc003a60 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00cdc0 con 0x7f7cfc003a60 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d13fff700 1 -- 172.21.15.6:0/2999364390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c005b70 con 0x7f7cfc003a60 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 msgr2=0x7f7cfc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c390 tx=0x7f7d140b0260 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2999364390 shutdown_connections 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2999364390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cfc003a60 0x7f7cfc003e70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.274+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2999364390 >> 172.21.15.6:0/2999364390 conn(0x7f7d14067640 msgr2=0x7f7d14067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.275+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2999364390 shutdown_connections 2023-10-09T11:40:54.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.275+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2999364390 wait complete. 2023-10-09T11:40:54.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.276+0000 7f7d1b73e700 1 Processor -- start 2023-10-09T11:40:54.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.276+0000 7f7d1b73e700 1 -- start start 2023-10-09T11:40:54.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.276+0000 7f7d1b73e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc003a60 0x7f7d14144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.276+0000 7f7d1b73e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.276+0000 7f7d1b73e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d140b2450 0x7f7d140b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d1b73e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14155960 con 0x7f7d141548e0 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d1b73e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14154d50 con 0x7f7cfc003a60 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d1b73e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14155030 con 0x7f7d140b2450 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37560/0 (socket says 172.21.15.6:37560) 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 -- 172.21.15.6:0/2044789841 learned_addr learned my addr 172.21.15.6:0/2044789841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d194da700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc003a60 0x7f7d14144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d19cdb700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d140b2450 0x7f7d140b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 -- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d140b2450 msgr2=0x7f7d140b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d140b2450 0x7f7d140b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 -- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc003a60 msgr2=0x7f7d14144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc003a60 0x7f7d14144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 -- 172.21.15.6:0/2044789841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d14155310 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d18cd9700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7d08011af0 tx=0x7f7d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800f940 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800faa0 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d141555f0 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800fe20 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.277+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d140b28f0 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.278+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d14069e40 con 0x7f7d141548e0 2023-10-09T11:40:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.279+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d08014650 con 0x7f7d141548e0 2023-10-09T11:40:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.279+0000 7f7d117fa700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.279+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d08018030 con 0x7f7d141548e0 2023-10-09T11:40:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.279+0000 7f7d194da700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.280+0000 7f7d194da700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 0x7f7d000693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c007cd0 tx=0x7f7d0c015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:54.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.283+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d080b65a0 con 0x7f7d141548e0 2023-10-09T11:40:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:54.522+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7d14155aa0 con 0x7f7d141548e0 2023-10-09T11:40:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.129+0000 7f7d117fa700 1 -- 172.21.15.6:0/2044789841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7d080220c0 con 0x7f7d141548e0 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 msgr2=0x7f7d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 0x7f7d000693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c007cd0 tx=0x7f7d0c015000 comp rx=0 tx=0).stop 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 msgr2=0x7f7d1415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7d08011af0 tx=0x7f7d080091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 shutdown_connections 2023-10-09T11:40:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d00066f30 0x7f7d000693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d140b2450 0x7f7d140b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cfc003a60 0x7f7d14144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 --2- 172.21.15.6:0/2044789841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d141548e0 0x7f7d1415ef80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 >> 172.21.15.6:0/2044789841 conn(0x7f7d14067640 msgr2=0x7f7d1406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 shutdown_connections 2023-10-09T11:40:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.131+0000 7f7d1b73e700 1 -- 172.21.15.6:0/2044789841 wait complete. 2023-10-09T11:40:55.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.266+0000 7f3492fef700 1 Processor -- start 2023-10-09T11:40:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.266+0000 7f3492fef700 1 -- start start 2023-10-09T11:40:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3492fef700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 0x7f348c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3492fef700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3492fef700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0cee10 con 0x7f348c159f10 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3492fef700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c0cd040 con 0x7f348c159b40 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3492fef700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cd320 con 0x7f348c068e90 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f34927ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f3491fed700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 0x7f348c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f34927ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:58340/0 (socket says 172.21.15.6:58340) 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.267+0000 7f34927ee700 1 -- 172.21.15.6:0/489156604 learned_addr learned my addr 172.21.15.6:0/489156604 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f34927ee700 1 -- 172.21.15.6:0/489156604 >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 msgr2=0x7f348c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f34927ee700 1 --2- 172.21.15.6:0/489156604 >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 0x7f348c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f34927ee700 1 -- 172.21.15.6:0/489156604 >> v1:172.21.15.118:6789/0 conn(0x7f348c159f10 legacy=0x7f348c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f34927ee700 1 -- 172.21.15.6:0/489156604 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0ce7c0 con 0x7f348c068e90 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f3491fed700 1 --2- 172.21.15.6:0/489156604 >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 0x7f348c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f34927ee700 1 --2- 172.21.15.6:0/489156604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3484009f20 tx=0x7f3484009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c54d15117a194c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f3490feb700 1 -- 172.21.15.6:0/489156604 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400e070 con 0x7f348c068e90 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f3490feb700 1 -- 172.21.15.6:0/489156604 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400b9d0 con 0x7f348c068e90 2023-10-09T11:40:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.268+0000 7f3490feb700 1 -- 172.21.15.6:0/489156604 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840092e0 con 0x7f348c068e90 2023-10-09T11:40:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 -- 172.21.15.6:0/489156604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 msgr2=0x7f348c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 --2- 172.21.15.6:0/489156604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3484009f20 tx=0x7f3484009840 comp rx=0 tx=0).stop 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 -- 172.21.15.6:0/489156604 shutdown_connections 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 --2- 172.21.15.6:0/489156604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c068e90 0x7f348c0cf2a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 --2- 172.21.15.6:0/489156604 >> v2:172.21.15.118:3300/0 conn(0x7f348c159b40 0x7f348c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 -- 172.21.15.6:0/489156604 >> 172.21.15.6:0/489156604 conn(0x7f348c0cd660 msgr2=0x7f348c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 -- 172.21.15.6:0/489156604 shutdown_connections 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.269+0000 7f3492fef700 1 -- 172.21.15.6:0/489156604 wait complete. 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.270+0000 7f3492fef700 1 Processor -- start 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.270+0000 7f3492fef700 1 -- start start 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c159b40 0x7f348c16bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f348c159f10 0x7f348c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0b6770 con 0x7f348c068e90 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c16af40 con 0x7f348c159f10 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3492fef700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c16b220 con 0x7f348c159b40 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37570/0 (socket says 172.21.15.6:37570) 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 -- 172.21.15.6:0/249660267 learned_addr learned my addr 172.21.15.6:0/249660267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f34927ee700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f348c159f10 0x7f348c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f34917ec700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c159b40 0x7f348c16bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 -- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c159b40 msgr2=0x7f348c16bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c159b40 0x7f348c16bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 -- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f348c159f10 msgr2=0x7f348c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f348c159f10 0x7f348c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 -- 172.21.15.6:0/249660267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488009420 con 0x7f348c068e90 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3491fed700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f348800ec80 tx=0x7f34880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.271+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800c920 con 0x7f348c068e90 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.272+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800ca80 con 0x7f348c068e90 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.272+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484009ae0 con 0x7f348c068e90 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.272+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800ce00 con 0x7f348c068e90 2023-10-09T11:40:55.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.272+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c16b7e0 con 0x7f348c068e90 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.273+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c0c9140 con 0x7f348c068e90 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.274+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3488013680 con 0x7f348c068e90 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.274+0000 7f3481ffb700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.274+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3488085060 con 0x7f348c068e90 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.274+0000 7f34917ec700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.275+0000 7f34917ec700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f348c152ad0 tx=0x7f347c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.277+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3488052350 con 0x7f348c068e90 2023-10-09T11:40:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.513+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f348c063e90 con 0x7f348c068e90 2023-10-09T11:40:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.513+0000 7f3481ffb700 1 -- 172.21.15.6:0/249660267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3488055970 con 0x7f348c068e90 2023-10-09T11:40:55.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:55.515 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.515+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 msgr2=0x7f34700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.515+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 0x7f34700693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f348c152ad0 tx=0x7f347c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 msgr2=0x7f348c16a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f348800ec80 tx=0x7f34880091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 shutdown_connections 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3470066f30 0x7f34700693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f348c159f10 0x7f348c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c068e90 0x7f348c16a960 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 --2- 172.21.15.6:0/249660267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f348c159b40 0x7f348c16bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 >> 172.21.15.6:0/249660267 conn(0x7f348c0cd660 msgr2=0x7f348c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 shutdown_connections 2023-10-09T11:40:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.516+0000 7f3492fef700 1 -- 172.21.15.6:0/249660267 wait complete. 2023-10-09T11:40:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:40:55.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:40:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.647+0000 7efe2328c700 1 Processor -- start 2023-10-09T11:40:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 -- start start 2023-10-09T11:40:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe1c1578d0 0x7efe1c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe1c06d120 0x7efe1c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c0d07c0 con 0x7efe1c157ca0 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c06da50 con 0x7efe1c06d120 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.648+0000 7efe2328c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0cfbb0 con 0x7efe1c1578d0 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe1c06d120 0x7efe1c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe1c06d120 0x7efe1c06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37572/0 (socket says 172.21.15.6:37572) 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21028700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe1c1578d0 0x7efe1c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 -- 172.21.15.6:0/3332984914 learned_addr learned my addr 172.21.15.6:0/3332984914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 -- 172.21.15.6:0/3332984914 >> v2:172.21.15.118:3300/0 conn(0x7efe1c1578d0 msgr2=0x7efe1c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 --2- 172.21.15.6:0/3332984914 >> v2:172.21.15.118:3300/0 conn(0x7efe1c1578d0 0x7efe1c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 -- 172.21.15.6:0/3332984914 >> v1:172.21.15.118:6789/0 conn(0x7efe1c157ca0 legacy=0x7efe1c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 -- 172.21.15.6:0/3332984914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0cfe90 con 0x7efe1c06d120 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe21829700 1 --2- 172.21.15.6:0/3332984914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c06d510 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0646b0 tx=0x7efe0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb3f9da78e376fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe1bfff700 1 -- 172.21.15.6:0/3332984914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00e070 con 0x7efe1c06d120 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe1bfff700 1 -- 172.21.15.6:0/3332984914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c00ba20 con 0x7efe1c06d120 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.649+0000 7efe1bfff700 1 -- 172.21.15.6:0/3332984914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0092e0 con 0x7efe1c06d120 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 -- 172.21.15.6:0/3332984914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 msgr2=0x7efe1c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 --2- 172.21.15.6:0/3332984914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c06d510 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0646b0 tx=0x7efe0c009840 comp rx=0 tx=0).stop 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 -- 172.21.15.6:0/3332984914 shutdown_connections 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 --2- 172.21.15.6:0/3332984914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c06d510 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 --2- 172.21.15.6:0/3332984914 >> v2:172.21.15.118:3300/0 conn(0x7efe1c1578d0 0x7efe1c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 -- 172.21.15.6:0/3332984914 >> 172.21.15.6:0/3332984914 conn(0x7efe1c06bb90 msgr2=0x7efe1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 -- 172.21.15.6:0/3332984914 shutdown_connections 2023-10-09T11:40:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.650+0000 7efe2328c700 1 -- 172.21.15.6:0/3332984914 wait complete. 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.651+0000 7efe2328c700 1 Processor -- start 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.651+0000 7efe2328c700 1 -- start start 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe1c1578d0 0x7efe1c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c157ca0 0x7efe1c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c153f40 con 0x7efe1c06d120 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0b4760 con 0x7efe1c157ca0 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe2328c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0b4de0 con 0x7efe1c1578d0 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37588/0 (socket says 172.21.15.6:37588) 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 -- 172.21.15.6:0/1652086102 learned_addr learned my addr 172.21.15.6:0/1652086102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21829700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c157ca0 0x7efe1c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe20827700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe1c1578d0 0x7efe1c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 -- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe1c1578d0 msgr2=0x7efe1c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe1c1578d0 0x7efe1c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 -- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c157ca0 msgr2=0x7efe1c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c157ca0 0x7efe1c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 -- 172.21.15.6:0/1652086102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009ae0 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.652+0000 7efe21028700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efe1400ec80 tx=0x7efe140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.653+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400c850 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.653+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1400c9b0 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.653+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c0b50c0 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.653+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400cd50 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.653+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c0b4a40 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.654+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c0ceb10 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.654+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe14013680 con 0x7efe1c06d120 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.654+0000 7efe197fa700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 0x7efe080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.654+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe14084760 con 0x7efe1c06d120 2023-10-09T11:40:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.654+0000 7efe20827700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 0x7efe080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.655+0000 7efe20827700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 0x7efe080693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe1c1580c0 tx=0x7efe10007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.658+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe140519d0 con 0x7efe1c06d120 2023-10-09T11:40:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.852+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe1c0d0170 con 0x7efe1c06d120 2023-10-09T11:40:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.853+0000 7efe197fa700 1 -- 172.21.15.6:0/1652086102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+15305 (secure 0 0 0) 0x7efe14054ff0 con 0x7efe1c06d120 2023-10-09T11:40:55.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:55.855 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":95,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:40:53.094143+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 msgr2=0x7efe080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 0x7efe080693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe1c1580c0 tx=0x7efe10007ec0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 msgr2=0x7efe1c1595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efe1400ec80 tx=0x7efe140091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 shutdown_connections 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe08066f30 0x7efe080693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c157ca0 0x7efe1c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c06d120 0x7efe1c1595f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 --2- 172.21.15.6:0/1652086102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efe1c1578d0 0x7efe1c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 >> 172.21.15.6:0/1652086102 conn(0x7efe1c06bb90 msgr2=0x7efe1c156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 shutdown_connections 2023-10-09T11:40:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.855+0000 7efe2328c700 1 -- 172.21.15.6:0/1652086102 wait complete. 2023-10-09T11:40:55.869 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:40:55.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.988+0000 7f6295109700 1 Processor -- start 2023-10-09T11:40:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.988+0000 7f6295109700 1 -- start start 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6295109700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6290159f10 0x7f6290068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6295109700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 0x7f62900cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6295109700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900cee10 con 0x7f6290159b40 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6295109700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6290069140 con 0x7f6290159f10 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6295109700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cd040 con 0x7f6290068cc0 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6290159f10 0x7f6290068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6290159b40 0x7f62900cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60966/0 (socket says 172.21.15.6:60966) 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628ffff700 1 -- 172.21.15.6:0/3393357577 learned_addr learned my addr 172.21.15.6:0/3393357577 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6294908700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 0x7f62900cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628f7fe700 1 -- 172.21.15.6:0/3393357577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 msgr2=0x7f62900cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628f7fe700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 0x7f62900cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628f7fe700 1 -- 172.21.15.6:0/3393357577 >> v1:172.21.15.6:6789/0 conn(0x7f6290159b40 legacy=0x7f62900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f628f7fe700 1 -- 172.21.15.6:0/3393357577 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900cd320 con 0x7f6290159f10 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.989+0000 7f6294908700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 0x7f62900cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f628f7fe700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159f10 0x7f6290068780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f62780098e0 tx=0x7f62780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c960c226b967ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f628effd700 1 -- 172.21.15.6:0/3393357577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278009e80 con 0x7f6290159f10 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f628effd700 1 -- 172.21.15.6:0/3393357577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800b860 con 0x7f6290159f10 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f628effd700 1 -- 172.21.15.6:0/3393357577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bbe0 con 0x7f6290159f10 2023-10-09T11:40:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 -- 172.21.15.6:0/3393357577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159f10 msgr2=0x7f6290068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159f10 0x7f6290068780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f62780098e0 tx=0x7f62780091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 -- 172.21.15.6:0/3393357577 shutdown_connections 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290068cc0 0x7f62900cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 --2- 172.21.15.6:0/3393357577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159f10 0x7f6290068780 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 -- 172.21.15.6:0/3393357577 >> 172.21.15.6:0/3393357577 conn(0x7f62900cd660 msgr2=0x7f62900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 -- 172.21.15.6:0/3393357577 shutdown_connections 2023-10-09T11:40:55.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.990+0000 7f6295109700 1 -- 172.21.15.6:0/3393357577 wait complete. 2023-10-09T11:40:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.991+0000 7f6295109700 1 Processor -- start 2023-10-09T11:40:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.991+0000 7f6295109700 1 -- start start 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 0x7f629014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290159f10 0x7f6290154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629016b7b0 con 0x7f6290159b40 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900c8750 con 0x7f6290068cc0 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6295109700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6290153c90 con 0x7f6290159f10 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f628f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f628f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37610/0 (socket says 172.21.15.6:37610) 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f628f7fe700 1 -- 172.21.15.6:0/3728008111 learned_addr learned my addr 172.21.15.6:0/3728008111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f6294908700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290159f10 0x7f6290154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.992+0000 7f628ffff700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 0x7f629014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 -- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290159f10 msgr2=0x7f6290154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290159f10 0x7f6290154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 -- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 msgr2=0x7f629014d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 0x7f629014d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 -- 172.21.15.6:0/3728008111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009420 con 0x7f6290159b40 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628ffff700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 0x7f629014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f628f7fe700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f629006fe10 tx=0x7f6278017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bbe0 con 0x7f6290159b40 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278011420 con 0x7f6290159b40 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900c7e20 con 0x7f6290159b40 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780117c0 con 0x7f6290159b40 2023-10-09T11:40:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.993+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62900c83e0 con 0x7f6290159b40 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.994+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62900c8890 con 0x7f6290159b40 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.994+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6278011bf0 con 0x7f6290159b40 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.995+0000 7f6287fff700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.995+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6278085ea0 con 0x7f6290159b40 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.995+0000 7f628ffff700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:55.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.995+0000 7f628ffff700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6280001820 tx=0x7f6280009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:55.999+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6278053110 con 0x7f6290159b40 2023-10-09T11:40:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.188+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62900ce7c0 con 0x7f6270066f30 2023-10-09T11:40:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.197+0000 7f6287fff700 1 -- 172.21.15.6:0/3728008111 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284781 (secure 0 0 0) 0x7f62900ce7c0 con 0x7f6270066f30 2023-10-09T11:40:56.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 msgr2=0x7f62700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6280001820 tx=0x7f6280009040 comp rx=0 tx=0).stop 2023-10-09T11:40:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 msgr2=0x7f629016b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f629006fe10 tx=0x7f6278017000 comp rx=0 tx=0).stop 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 shutdown_connections 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6290159f10 0x7f6290154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6290068cc0 0x7f629014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 --2- 172.21.15.6:0/3728008111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6290159b40 0x7f629016b270 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 >> 172.21.15.6:0/3728008111 conn(0x7f62900cd660 msgr2=0x7f629006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 shutdown_connections 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.200+0000 7f6295109700 1 -- 172.21.15.6:0/3728008111 wait complete. 2023-10-09T11:40:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:40:56.214 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-09T11:40:54.209405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5094,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557405,"statfs":{"total":1600000000,"available":1594783303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.122418"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113787+0000","last_change":"2023-10-09T11:40:52.113787+0000","last_active":"2023-10-09T11:40:52.113787+0000","last_peered":"2023-10-09T11:40:52.113787+0000","last_clean":"2023-10-09T11:40:52.113787+0000","last_became_active":"2023-10-09T11:40:52.113489+0000","last_became_peered":"2023-10-09T11:40:52.113489+0000","last_unstale":"2023-10-09T11:40:52.113787+0000","last_undegraded":"2023-10-09T11:40:52.113787+0000","last_fullsized":"2023-10-09T11:40:52.113787+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113626+0000","last_change":"2023-10-09T11:40:52.113626+0000","last_active":"2023-10-09T11:40:52.113626+0000","last_peered":"2023-10-09T11:40:52.113626+0000","last_clean":"2023-10-09T11:40:52.113626+0000","last_became_active":"2023-10-09T11:40:52.112783+0000","last_became_peered":"2023-10-09T11:40:52.112783+0000","last_unstale":"2023-10-09T11:40:52.113626+0000","last_undegraded":"2023-10-09T11:40:52.113626+0000","last_fullsized":"2023-10-09T11:40:52.113626+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:27.551007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113994+0000","last_change":"2023-10-09T11:40:52.113994+0000","last_active":"2023-10-09T11:40:52.113994+0000","last_peered":"2023-10-09T11:40:52.113994+0000","last_clean":"2023-10-09T11:40:52.113994+0000","last_became_active":"2023-10-09T11:40:52.113623+0000","last_became_peered":"2023-10-09T11:40:52.113623+0000","last_unstale":"2023-10-09T11:40:52.113994+0000","last_undegraded":"2023-10-09T11:40:52.113994+0000","last_fullsized":"2023-10-09T11:40:52.113994+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:15.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113310+0000","last_change":"2023-10-09T11:40:52.113215+0000","last_active":"2023-10-09T11:40:52.113310+0000","last_peered":"2023-10-09T11:40:52.113310+0000","last_clean":"2023-10-09T11:40:52.113310+0000","last_became_active":"2023-10-09T11:40:52.111314+0000","last_became_peered":"2023-10-09T11:40:52.111314+0000","last_unstale":"2023-10-09T11:40:52.113310+0000","last_undegraded":"2023-10-09T11:40:52.113310+0000","last_fullsized":"2023-10-09T11:40:52.113310+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:00.346684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107670+0000","last_change":"2023-10-09T11:40:52.107607+0000","last_active":"2023-10-09T11:40:52.107670+0000","last_peered":"2023-10-09T11:40:52.107670+0000","last_clean":"2023-10-09T11:40:52.107670+0000","last_became_active":"2023-10-09T11:40:52.107390+0000","last_became_peered":"2023-10-09T11:40:52.107390+0000","last_unstale":"2023-10-09T11:40:52.107670+0000","last_undegraded":"2023-10-09T11:40:52.107670+0000","last_fullsized":"2023-10-09T11:40:52.107670+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107933+0000","last_change":"2023-10-09T11:40:52.107870+0000","last_active":"2023-10-09T11:40:52.107933+0000","last_peered":"2023-10-09T11:40:52.107933+0000","last_clean":"2023-10-09T11:40:52.107933+0000","last_became_active":"2023-10-09T11:40:52.107441+0000","last_became_peered":"2023-10-09T11:40:52.107441+0000","last_unstale":"2023-10-09T11:40:52.107933+0000","last_undegraded":"2023-10-09T11:40:52.107933+0000","last_fullsized":"2023-10-09T11:40:52.107933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.220453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105885+0000","last_change":"2023-10-09T11:40:52.105824+0000","last_active":"2023-10-09T11:40:52.105885+0000","last_peered":"2023-10-09T11:40:52.105885+0000","last_clean":"2023-10-09T11:40:52.105885+0000","last_became_active":"2023-10-09T11:40:52.105397+0000","last_became_peered":"2023-10-09T11:40:52.105397+0000","last_unstale":"2023-10-09T11:40:52.105885+0000","last_undegraded":"2023-10-09T11:40:52.105885+0000","last_fullsized":"2023-10-09T11:40:52.105885+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:37.489916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107669+0000","last_change":"2023-10-09T11:40:52.107599+0000","last_active":"2023-10-09T11:40:52.107669+0000","last_peered":"2023-10-09T11:40:52.107669+0000","last_clean":"2023-10-09T11:40:52.107669+0000","last_became_active":"2023-10-09T11:40:52.107335+0000","last_became_peered":"2023-10-09T11:40:52.107335+0000","last_unstale":"2023-10-09T11:40:52.107669+0000","last_undegraded":"2023-10-09T11:40:52.107669+0000","last_fullsized":"2023-10-09T11:40:52.107669+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:52.524478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100050+0000","last_change":"2023-10-09T11:40:52.099896+0000","last_active":"2023-10-09T11:40:52.100050+0000","last_peered":"2023-10-09T11:40:52.100050+0000","last_clean":"2023-10-09T11:40:52.100050+0000","last_became_active":"2023-10-09T11:40:52.099666+0000","last_became_peered":"2023-10-09T11:40:52.099666+0000","last_unstale":"2023-10-09T11:40:52.100050+0000","last_undegraded":"2023-10-09T11:40:52.100050+0000","last_fullsized":"2023-10-09T11:40:52.100050+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:07.215810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.104942+0000","last_change":"2023-10-09T11:40:52.104942+0000","last_active":"2023-10-09T11:40:52.104942+0000","last_peered":"2023-10-09T11:40:52.104942+0000","last_clean":"2023-10-09T11:40:52.104942+0000","last_became_active":"2023-10-09T11:40:52.104727+0000","last_became_peered":"2023-10-09T11:40:52.104727+0000","last_unstale":"2023-10-09T11:40:52.104942+0000","last_undegraded":"2023-10-09T11:40:52.104942+0000","last_fullsized":"2023-10-09T11:40:52.104942+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:01.681560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109768+0000","last_change":"2023-10-09T11:40:52.109768+0000","last_active":"2023-10-09T11:40:52.109768+0000","last_peered":"2023-10-09T11:40:52.109768+0000","last_clean":"2023-10-09T11:40:52.109768+0000","last_became_active":"2023-10-09T11:40:52.109531+0000","last_became_peered":"2023-10-09T11:40:52.109531+0000","last_unstale":"2023-10-09T11:40:52.109768+0000","last_undegraded":"2023-10-09T11:40:52.109768+0000","last_fullsized":"2023-10-09T11:40:52.109768+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:21.330312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107723+0000","last_change":"2023-10-09T11:40:52.107723+0000","last_active":"2023-10-09T11:40:52.107723+0000","last_peered":"2023-10-09T11:40:52.107723+0000","last_clean":"2023-10-09T11:40:52.107723+0000","last_became_active":"2023-10-09T11:40:52.106918+0000","last_became_peered":"2023-10-09T11:40:52.106918+0000","last_unstale":"2023-10-09T11:40:52.107723+0000","last_undegraded":"2023-10-09T11:40:52.107723+0000","last_fullsized":"2023-10-09T11:40:52.107723+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:00.763704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102802+0000","last_change":"2023-10-09T11:40:52.102802+0000","last_active":"2023-10-09T11:40:52.102802+0000","last_peered":"2023-10-09T11:40:52.102802+0000","last_clean":"2023-10-09T11:40:52.102802+0000","last_became_active":"2023-10-09T11:40:52.102558+0000","last_became_peered":"2023-10-09T11:40:52.102558+0000","last_unstale":"2023-10-09T11:40:52.102802+0000","last_undegraded":"2023-10-09T11:40:52.102802+0000","last_fullsized":"2023-10-09T11:40:52.102802+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:38.646852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113295+0000","last_change":"2023-10-09T11:40:52.113084+0000","last_active":"2023-10-09T11:40:52.113295+0000","last_peered":"2023-10-09T11:40:52.113295+0000","last_clean":"2023-10-09T11:40:52.113295+0000","last_became_active":"2023-10-09T11:40:52.110989+0000","last_became_peered":"2023-10-09T11:40:52.110989+0000","last_unstale":"2023-10-09T11:40:52.113295+0000","last_undegraded":"2023-10-09T11:40:52.113295+0000","last_fullsized":"2023-10-09T11:40:52.113295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.451357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106829+0000","last_change":"2023-10-09T11:40:52.106829+0000","last_active":"2023-10-09T11:40:52.106829+0000","last_peered":"2023-10-09T11:40:52.106829+0000","last_clean":"2023-10-09T11:40:52.106829+0000","last_became_active":"2023-10-09T11:40:52.106599+0000","last_became_peered":"2023-10-09T11:40:52.106599+0000","last_unstale":"2023-10-09T11:40:52.106829+0000","last_undegraded":"2023-10-09T11:40:52.106829+0000","last_fullsized":"2023-10-09T11:40:52.106829+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:38.646852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112205+0000","last_change":"2023-10-09T11:40:52.111401+0000","last_active":"2023-10-09T11:40:52.112205+0000","last_peered":"2023-10-09T11:40:52.112205+0000","last_clean":"2023-10-09T11:40:52.112205+0000","last_became_active":"2023-10-09T11:40:52.110567+0000","last_became_peered":"2023-10-09T11:40:52.110567+0000","last_unstale":"2023-10-09T11:40:52.112205+0000","last_undegraded":"2023-10-09T11:40:52.112205+0000","last_fullsized":"2023-10-09T11:40:52.112205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:26.740273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112407+0000","last_change":"2023-10-09T11:40:52.112324+0000","last_active":"2023-10-09T11:40:52.112407+0000","last_peered":"2023-10-09T11:40:52.112407+0000","last_clean":"2023-10-09T11:40:52.112407+0000","last_became_active":"2023-10-09T11:40:52.111861+0000","last_became_peered":"2023-10-09T11:40:52.111861+0000","last_unstale":"2023-10-09T11:40:52.112407+0000","last_undegraded":"2023-10-09T11:40:52.112407+0000","last_fullsized":"2023-10-09T11:40:52.112407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107035+0000","last_change":"2023-10-09T11:40:52.106936+0000","last_active":"2023-10-09T11:40:52.107035+0000","last_peered":"2023-10-09T11:40:52.107035+0000","last_clean":"2023-10-09T11:40:52.107035+0000","last_became_active":"2023-10-09T11:40:52.106730+0000","last_became_peered":"2023-10-09T11:40:52.106730+0000","last_unstale":"2023-10-09T11:40:52.107035+0000","last_undegraded":"2023-10-09T11:40:52.107035+0000","last_fullsized":"2023-10-09T11:40:52.107035+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:10.426089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108335+0000","last_change":"2023-10-09T11:40:52.108335+0000","last_active":"2023-10-09T11:40:52.108335+0000","last_peered":"2023-10-09T11:40:52.108335+0000","last_clean":"2023-10-09T11:40:52.108335+0000","last_became_active":"2023-10-09T11:40:52.107868+0000","last_became_peered":"2023-10-09T11:40:52.107868+0000","last_unstale":"2023-10-09T11:40:52.108335+0000","last_undegraded":"2023-10-09T11:40:52.108335+0000","last_fullsized":"2023-10-09T11:40:52.108335+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107013+0000","last_change":"2023-10-09T11:40:52.106227+0000","last_active":"2023-10-09T11:40:52.107013+0000","last_peered":"2023-10-09T11:40:52.107013+0000","last_clean":"2023-10-09T11:40:52.107013+0000","last_became_active":"2023-10-09T11:40:52.105941+0000","last_became_peered":"2023-10-09T11:40:52.105941+0000","last_unstale":"2023-10-09T11:40:52.107013+0000","last_undegraded":"2023-10-09T11:40:52.107013+0000","last_fullsized":"2023-10-09T11:40:52.107013+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:17.967259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.114281+0000","last_change":"2023-10-09T11:40:52.114179+0000","last_active":"2023-10-09T11:40:52.114281+0000","last_peered":"2023-10-09T11:40:52.114281+0000","last_clean":"2023-10-09T11:40:52.114281+0000","last_became_active":"2023-10-09T11:40:52.113798+0000","last_became_peered":"2023-10-09T11:40:52.113798+0000","last_unstale":"2023-10-09T11:40:52.114281+0000","last_undegraded":"2023-10-09T11:40:52.114281+0000","last_fullsized":"2023-10-09T11:40:52.114281+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:11.582448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113789+0000","last_change":"2023-10-09T11:40:52.113789+0000","last_active":"2023-10-09T11:40:52.113789+0000","last_peered":"2023-10-09T11:40:52.113789+0000","last_clean":"2023-10-09T11:40:52.113789+0000","last_became_active":"2023-10-09T11:40:52.113084+0000","last_became_peered":"2023-10-09T11:40:52.113084+0000","last_unstale":"2023-10-09T11:40:52.113789+0000","last_undegraded":"2023-10-09T11:40:52.113789+0000","last_fullsized":"2023-10-09T11:40:52.113789+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:03.092166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110050+0000","last_change":"2023-10-09T11:40:52.110050+0000","last_active":"2023-10-09T11:40:52.110050+0000","last_peered":"2023-10-09T11:40:52.110050+0000","last_clean":"2023-10-09T11:40:52.110050+0000","last_became_active":"2023-10-09T11:40:52.108767+0000","last_became_peered":"2023-10-09T11:40:52.108767+0000","last_unstale":"2023-10-09T11:40:52.110050+0000","last_undegraded":"2023-10-09T11:40:52.110050+0000","last_fullsized":"2023-10-09T11:40:52.110050+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:04.482360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108490+0000","last_change":"2023-10-09T11:40:52.108425+0000","last_active":"2023-10-09T11:40:52.108490+0000","last_peered":"2023-10-09T11:40:52.108490+0000","last_clean":"2023-10-09T11:40:52.108490+0000","last_became_active":"2023-10-09T11:40:52.108153+0000","last_became_peered":"2023-10-09T11:40:52.108153+0000","last_unstale":"2023-10-09T11:40:52.108490+0000","last_undegraded":"2023-10-09T11:40:52.108490+0000","last_fullsized":"2023-10-09T11:40:52.108490+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:19.639406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110908+0000","last_change":"2023-10-09T11:40:52.110908+0000","last_active":"2023-10-09T11:40:52.110908+0000","last_peered":"2023-10-09T11:40:52.110908+0000","last_clean":"2023-10-09T11:40:52.110908+0000","last_became_active":"2023-10-09T11:40:52.110339+0000","last_became_peered":"2023-10-09T11:40:52.110339+0000","last_unstale":"2023-10-09T11:40:52.110908+0000","last_undegraded":"2023-10-09T11:40:52.110908+0000","last_fullsized":"2023-10-09T11:40:52.110908+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:15.089277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110519+0000","last_change":"2023-10-09T11:40:52.110519+0000","last_active":"2023-10-09T11:40:52.110519+0000","last_peered":"2023-10-09T11:40:52.110519+0000","last_clean":"2023-10-09T11:40:52.110519+0000","last_became_active":"2023-10-09T11:40:52.110103+0000","last_became_peered":"2023-10-09T11:40:52.110103+0000","last_unstale":"2023-10-09T11:40:52.110519+0000","last_undegraded":"2023-10-09T11:40:52.110519+0000","last_fullsized":"2023-10-09T11:40:52.110519+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:49.483487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112181+0000","last_change":"2023-10-09T11:40:52.112114+0000","last_active":"2023-10-09T11:40:52.112181+0000","last_peered":"2023-10-09T11:40:52.112181+0000","last_clean":"2023-10-09T11:40:52.112181+0000","last_became_active":"2023-10-09T11:40:52.111560+0000","last_became_peered":"2023-10-09T11:40:52.111560+0000","last_unstale":"2023-10-09T11:40:52.112181+0000","last_undegraded":"2023-10-09T11:40:52.112181+0000","last_fullsized":"2023-10-09T11:40:52.112181+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:02.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111592+0000","last_change":"2023-10-09T11:40:52.111592+0000","last_active":"2023-10-09T11:40:52.111592+0000","last_peered":"2023-10-09T11:40:52.111592+0000","last_clean":"2023-10-09T11:40:52.111592+0000","last_became_active":"2023-10-09T11:40:52.111352+0000","last_became_peered":"2023-10-09T11:40:52.111352+0000","last_unstale":"2023-10-09T11:40:52.111592+0000","last_undegraded":"2023-10-09T11:40:52.111592+0000","last_fullsized":"2023-10-09T11:40:52.111592+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110071+0000","last_change":"2023-10-09T11:40:52.110071+0000","last_active":"2023-10-09T11:40:52.110071+0000","last_peered":"2023-10-09T11:40:52.110071+0000","last_clean":"2023-10-09T11:40:52.110071+0000","last_became_active":"2023-10-09T11:40:52.109821+0000","last_became_peered":"2023-10-09T11:40:52.109821+0000","last_unstale":"2023-10-09T11:40:52.110071+0000","last_undegraded":"2023-10-09T11:40:52.110071+0000","last_fullsized":"2023-10-09T11:40:52.110071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:04.686314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111001+0000","last_change":"2023-10-09T11:40:52.111001+0000","last_active":"2023-10-09T11:40:52.111001+0000","last_peered":"2023-10-09T11:40:52.111001+0000","last_clean":"2023-10-09T11:40:52.111001+0000","last_became_active":"2023-10-09T11:40:52.110625+0000","last_became_peered":"2023-10-09T11:40:52.110625+0000","last_unstale":"2023-10-09T11:40:52.111001+0000","last_undegraded":"2023-10-09T11:40:52.111001+0000","last_fullsized":"2023-10-09T11:40:52.111001+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:44.608479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.101135+0000","last_change":"2023-10-09T11:40:52.101064+0000","last_active":"2023-10-09T11:40:52.101135+0000","last_peered":"2023-10-09T11:40:52.101135+0000","last_clean":"2023-10-09T11:40:52.101135+0000","last_became_active":"2023-10-09T11:40:52.100724+0000","last_became_peered":"2023-10-09T11:40:52.100724+0000","last_unstale":"2023-10-09T11:40:52.101135+0000","last_undegraded":"2023-10-09T11:40:52.101135+0000","last_fullsized":"2023-10-09T11:40:52.101135+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112974+0000","last_change":"2023-10-09T11:40:52.112974+0000","last_active":"2023-10-09T11:40:52.112974+0000","last_peered":"2023-10-09T11:40:52.112974+0000","last_clean":"2023-10-09T11:40:52.112974+0000","last_became_active":"2023-10-09T11:40:52.112635+0000","last_became_peered":"2023-10-09T11:40:52.112635+0000","last_unstale":"2023-10-09T11:40:52.112974+0000","last_undegraded":"2023-10-09T11:40:52.112974+0000","last_fullsized":"2023-10-09T11:40:52.112974+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:02.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110404+0000","last_change":"2023-10-09T11:40:52.110181+0000","last_active":"2023-10-09T11:40:52.110404+0000","last_peered":"2023-10-09T11:40:52.110404+0000","last_clean":"2023-10-09T11:40:52.110404+0000","last_became_active":"2023-10-09T11:40:52.109609+0000","last_became_peered":"2023-10-09T11:40:52.109609+0000","last_unstale":"2023-10-09T11:40:52.110404+0000","last_undegraded":"2023-10-09T11:40:52.110404+0000","last_fullsized":"2023-10-09T11:40:52.110404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:26.873169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"94'4","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117814+0000","last_change":"2023-10-09T11:40:51.106892+0000","last_active":"2023-10-09T11:40:52.117814+0000","last_peered":"2023-10-09T11:40:52.117814+0000","last_clean":"2023-10-09T11:40:52.117814+0000","last_became_active":"2023-10-09T11:40:51.106564+0000","last_became_peered":"2023-10-09T11:40:51.106564+0000","last_unstale":"2023-10-09T11:40:52.117814+0000","last_undegraded":"2023-10-09T11:40:52.117814+0000","last_fullsized":"2023-10-09T11:40:52.117814+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:02.088194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110222+0000","last_change":"2023-10-09T11:40:52.110222+0000","last_active":"2023-10-09T11:40:52.110222+0000","last_peered":"2023-10-09T11:40:52.110222+0000","last_clean":"2023-10-09T11:40:52.110222+0000","last_became_active":"2023-10-09T11:40:52.109182+0000","last_became_peered":"2023-10-09T11:40:52.109182+0000","last_unstale":"2023-10-09T11:40:52.110222+0000","last_undegraded":"2023-10-09T11:40:52.110222+0000","last_fullsized":"2023-10-09T11:40:52.110222+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.315042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115621+0000","last_change":"2023-10-09T11:40:51.104900+0000","last_active":"2023-10-09T11:40:52.115621+0000","last_peered":"2023-10-09T11:40:52.115621+0000","last_clean":"2023-10-09T11:40:52.115621+0000","last_became_active":"2023-10-09T11:40:51.104410+0000","last_became_peered":"2023-10-09T11:40:51.104410+0000","last_unstale":"2023-10-09T11:40:52.115621+0000","last_undegraded":"2023-10-09T11:40:52.115621+0000","last_fullsized":"2023-10-09T11:40:52.115621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:13.519743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106808+0000","last_change":"2023-10-09T11:40:52.106808+0000","last_active":"2023-10-09T11:40:52.106808+0000","last_peered":"2023-10-09T11:40:52.106808+0000","last_clean":"2023-10-09T11:40:52.106808+0000","last_became_active":"2023-10-09T11:40:52.106551+0000","last_became_peered":"2023-10-09T11:40:52.106551+0000","last_unstale":"2023-10-09T11:40:52.106808+0000","last_undegraded":"2023-10-09T11:40:52.106808+0000","last_fullsized":"2023-10-09T11:40:52.106808+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:19.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117870+0000","last_change":"2023-10-09T11:40:51.098933+0000","last_active":"2023-10-09T11:40:52.117870+0000","last_peered":"2023-10-09T11:40:52.117870+0000","last_clean":"2023-10-09T11:40:52.117870+0000","last_became_active":"2023-10-09T11:40:51.098701+0000","last_became_peered":"2023-10-09T11:40:51.098701+0000","last_unstale":"2023-10-09T11:40:52.117870+0000","last_undegraded":"2023-10-09T11:40:52.117870+0000","last_fullsized":"2023-10-09T11:40:52.117870+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:59.759732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109284+0000","last_change":"2023-10-09T11:40:52.109284+0000","last_active":"2023-10-09T11:40:52.109284+0000","last_peered":"2023-10-09T11:40:52.109284+0000","last_clean":"2023-10-09T11:40:52.109284+0000","last_became_active":"2023-10-09T11:40:52.108681+0000","last_became_peered":"2023-10-09T11:40:52.108681+0000","last_unstale":"2023-10-09T11:40:52.109284+0000","last_undegraded":"2023-10-09T11:40:52.109284+0000","last_fullsized":"2023-10-09T11:40:52.109284+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:35.343633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115850+0000","last_change":"2023-10-09T11:40:51.099000+0000","last_active":"2023-10-09T11:40:52.115850+0000","last_peered":"2023-10-09T11:40:52.115850+0000","last_clean":"2023-10-09T11:40:52.115850+0000","last_became_active":"2023-10-09T11:40:51.098778+0000","last_became_peered":"2023-10-09T11:40:51.098778+0000","last_unstale":"2023-10-09T11:40:52.115850+0000","last_undegraded":"2023-10-09T11:40:52.115850+0000","last_fullsized":"2023-10-09T11:40:52.115850+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:32.701074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108310+0000","last_change":"2023-10-09T11:40:52.108310+0000","last_active":"2023-10-09T11:40:52.108310+0000","last_peered":"2023-10-09T11:40:52.108310+0000","last_clean":"2023-10-09T11:40:52.108310+0000","last_became_active":"2023-10-09T11:40:52.107911+0000","last_became_peered":"2023-10-09T11:40:52.107911+0000","last_unstale":"2023-10-09T11:40:52.108310+0000","last_undegraded":"2023-10-09T11:40:52.108310+0000","last_fullsized":"2023-10-09T11:40:52.108310+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:04.971709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.116634+0000","last_change":"2023-10-09T11:40:51.108984+0000","last_active":"2023-10-09T11:40:52.116634+0000","last_peered":"2023-10-09T11:40:52.116634+0000","last_clean":"2023-10-09T11:40:52.116634+0000","last_became_active":"2023-10-09T11:40:51.108720+0000","last_became_peered":"2023-10-09T11:40:51.108720+0000","last_unstale":"2023-10-09T11:40:52.116634+0000","last_undegraded":"2023-10-09T11:40:52.116634+0000","last_fullsized":"2023-10-09T11:40:52.116634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:26.547035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105284+0000","last_change":"2023-10-09T11:40:52.105031+0000","last_active":"2023-10-09T11:40:52.105284+0000","last_peered":"2023-10-09T11:40:52.105284+0000","last_clean":"2023-10-09T11:40:52.105284+0000","last_became_active":"2023-10-09T11:40:52.104762+0000","last_became_peered":"2023-10-09T11:40:52.104762+0000","last_unstale":"2023-10-09T11:40:52.105284+0000","last_undegraded":"2023-10-09T11:40:52.105284+0000","last_fullsized":"2023-10-09T11:40:52.105284+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:19.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115118+0000","last_change":"2023-10-09T11:40:51.107341+0000","last_active":"2023-10-09T11:40:52.115118+0000","last_peered":"2023-10-09T11:40:52.115118+0000","last_clean":"2023-10-09T11:40:52.115118+0000","last_became_active":"2023-10-09T11:40:51.107163+0000","last_became_peered":"2023-10-09T11:40:51.107163+0000","last_unstale":"2023-10-09T11:40:52.115118+0000","last_undegraded":"2023-10-09T11:40:52.115118+0000","last_fullsized":"2023-10-09T11:40:52.115118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:30.642966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109044+0000","last_change":"2023-10-09T11:40:52.109044+0000","last_active":"2023-10-09T11:40:52.109044+0000","last_peered":"2023-10-09T11:40:52.109044+0000","last_clean":"2023-10-09T11:40:52.109044+0000","last_became_active":"2023-10-09T11:40:52.108111+0000","last_became_peered":"2023-10-09T11:40:52.108111+0000","last_unstale":"2023-10-09T11:40:52.109044+0000","last_undegraded":"2023-10-09T11:40:52.109044+0000","last_fullsized":"2023-10-09T11:40:52.109044+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:36.403791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.100496+0000","last_change":"2023-10-09T11:40:51.100434+0000","last_active":"2023-10-09T11:40:51.100496+0000","last_peered":"2023-10-09T11:40:51.100496+0000","last_clean":"2023-10-09T11:40:51.100496+0000","last_became_active":"2023-10-09T11:40:51.100148+0000","last_became_peered":"2023-10-09T11:40:51.100148+0000","last_unstale":"2023-10-09T11:40:51.100496+0000","last_undegraded":"2023-10-09T11:40:51.100496+0000","last_fullsized":"2023-10-09T11:40:51.100496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:24.026310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109383+0000","last_change":"2023-10-09T11:40:52.109383+0000","last_active":"2023-10-09T11:40:52.109383+0000","last_peered":"2023-10-09T11:40:52.109383+0000","last_clean":"2023-10-09T11:40:52.109383+0000","last_became_active":"2023-10-09T11:40:52.109091+0000","last_became_peered":"2023-10-09T11:40:52.109091+0000","last_unstale":"2023-10-09T11:40:52.109383+0000","last_undegraded":"2023-10-09T11:40:52.109383+0000","last_fullsized":"2023-10-09T11:40:52.109383+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104222+0000","last_change":"2023-10-09T11:40:51.104160+0000","last_active":"2023-10-09T11:40:51.104222+0000","last_peered":"2023-10-09T11:40:51.104222+0000","last_clean":"2023-10-09T11:40:51.104222+0000","last_became_active":"2023-10-09T11:40:51.103920+0000","last_became_peered":"2023-10-09T11:40:51.103920+0000","last_unstale":"2023-10-09T11:40:51.104222+0000","last_undegraded":"2023-10-09T11:40:51.104222+0000","last_fullsized":"2023-10-09T11:40:51.104222+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:59.342712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115483+0000","last_change":"2023-10-09T11:40:52.115483+0000","last_active":"2023-10-09T11:40:52.115483+0000","last_peered":"2023-10-09T11:40:52.115483+0000","last_clean":"2023-10-09T11:40:52.115483+0000","last_became_active":"2023-10-09T11:40:52.115236+0000","last_became_peered":"2023-10-09T11:40:52.115236+0000","last_unstale":"2023-10-09T11:40:52.115483+0000","last_undegraded":"2023-10-09T11:40:52.115483+0000","last_fullsized":"2023-10-09T11:40:52.115483+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:15.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104711+0000","last_change":"2023-10-09T11:40:51.104636+0000","last_active":"2023-10-09T11:40:51.104711+0000","last_peered":"2023-10-09T11:40:51.104711+0000","last_clean":"2023-10-09T11:40:51.104711+0000","last_became_active":"2023-10-09T11:40:51.104376+0000","last_became_peered":"2023-10-09T11:40:51.104376+0000","last_unstale":"2023-10-09T11:40:51.104711+0000","last_undegraded":"2023-10-09T11:40:51.104711+0000","last_fullsized":"2023-10-09T11:40:51.104711+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:13.519743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107788+0000","last_change":"2023-10-09T11:40:52.107700+0000","last_active":"2023-10-09T11:40:52.107788+0000","last_peered":"2023-10-09T11:40:52.107788+0000","last_clean":"2023-10-09T11:40:52.107788+0000","last_became_active":"2023-10-09T11:40:52.107115+0000","last_became_peered":"2023-10-09T11:40:52.107115+0000","last_unstale":"2023-10-09T11:40:52.107788+0000","last_undegraded":"2023-10-09T11:40:52.107788+0000","last_fullsized":"2023-10-09T11:40:52.107788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:42.773756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.108074+0000","last_change":"2023-10-09T11:40:51.108021+0000","last_active":"2023-10-09T11:40:51.108074+0000","last_peered":"2023-10-09T11:40:51.108074+0000","last_clean":"2023-10-09T11:40:51.108074+0000","last_became_active":"2023-10-09T11:40:51.107788+0000","last_became_peered":"2023-10-09T11:40:51.107788+0000","last_unstale":"2023-10-09T11:40:51.108074+0000","last_undegraded":"2023-10-09T11:40:51.108074+0000","last_fullsized":"2023-10-09T11:40:51.108074+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:17.562435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108487+0000","last_change":"2023-10-09T11:40:52.108487+0000","last_active":"2023-10-09T11:40:52.108487+0000","last_peered":"2023-10-09T11:40:52.108487+0000","last_clean":"2023-10-09T11:40:52.108487+0000","last_became_active":"2023-10-09T11:40:52.108106+0000","last_became_peered":"2023-10-09T11:40:52.108106+0000","last_unstale":"2023-10-09T11:40:52.108487+0000","last_undegraded":"2023-10-09T11:40:52.108487+0000","last_fullsized":"2023-10-09T11:40:52.108487+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"94'3","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115390+0000","last_change":"2023-10-09T11:40:51.103850+0000","last_active":"2023-10-09T11:40:52.115390+0000","last_peered":"2023-10-09T11:40:52.115390+0000","last_clean":"2023-10-09T11:40:52.115390+0000","last_became_active":"2023-10-09T11:40:51.103546+0000","last_became_peered":"2023-10-09T11:40:51.103546+0000","last_unstale":"2023-10-09T11:40:52.115390+0000","last_undegraded":"2023-10-09T11:40:52.115390+0000","last_fullsized":"2023-10-09T11:40:52.115390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:15.864847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100543+0000","last_change":"2023-10-09T11:40:52.100166+0000","last_active":"2023-10-09T11:40:52.100543+0000","last_peered":"2023-10-09T11:40:52.100543+0000","last_clean":"2023-10-09T11:40:52.100543+0000","last_became_active":"2023-10-09T11:40:52.099890+0000","last_became_peered":"2023-10-09T11:40:52.099890+0000","last_unstale":"2023-10-09T11:40:52.100543+0000","last_undegraded":"2023-10-09T11:40:52.100543+0000","last_fullsized":"2023-10-09T11:40:52.100543+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:42.773756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117950+0000","last_change":"2023-10-09T11:40:51.103195+0000","last_active":"2023-10-09T11:40:52.117950+0000","last_peered":"2023-10-09T11:40:52.117950+0000","last_clean":"2023-10-09T11:40:52.117950+0000","last_became_active":"2023-10-09T11:40:51.102764+0000","last_became_peered":"2023-10-09T11:40:51.102764+0000","last_unstale":"2023-10-09T11:40:52.117950+0000","last_undegraded":"2023-10-09T11:40:52.117950+0000","last_fullsized":"2023-10-09T11:40:52.117950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:59.759732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102755+0000","last_change":"2023-10-09T11:40:52.102755+0000","last_active":"2023-10-09T11:40:52.102755+0000","last_peered":"2023-10-09T11:40:52.102755+0000","last_clean":"2023-10-09T11:40:52.102755+0000","last_became_active":"2023-10-09T11:40:52.102157+0000","last_became_peered":"2023-10-09T11:40:52.102157+0000","last_unstale":"2023-10-09T11:40:52.102755+0000","last_undegraded":"2023-10-09T11:40:52.102755+0000","last_fullsized":"2023-10-09T11:40:52.102755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112362+0000","last_change":"2023-10-09T11:40:51.100321+0000","last_active":"2023-10-09T11:40:52.112362+0000","last_peered":"2023-10-09T11:40:52.112362+0000","last_clean":"2023-10-09T11:40:52.112362+0000","last_became_active":"2023-10-09T11:40:51.100117+0000","last_became_peered":"2023-10-09T11:40:51.100117+0000","last_unstale":"2023-10-09T11:40:52.112362+0000","last_undegraded":"2023-10-09T11:40:52.112362+0000","last_fullsized":"2023-10-09T11:40:52.112362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:20.339471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109179+0000","last_change":"2023-10-09T11:40:52.109179+0000","last_active":"2023-10-09T11:40:52.109179+0000","last_peered":"2023-10-09T11:40:52.109179+0000","last_clean":"2023-10-09T11:40:52.109179+0000","last_became_active":"2023-10-09T11:40:52.108416+0000","last_became_peered":"2023-10-09T11:40:52.108416+0000","last_unstale":"2023-10-09T11:40:52.109179+0000","last_undegraded":"2023-10-09T11:40:52.109179+0000","last_fullsized":"2023-10-09T11:40:52.109179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.099532+0000","last_change":"2023-10-09T11:40:51.099483+0000","last_active":"2023-10-09T11:40:51.099532+0000","last_peered":"2023-10-09T11:40:51.099532+0000","last_clean":"2023-10-09T11:40:51.099532+0000","last_became_active":"2023-10-09T11:40:51.098933+0000","last_became_peered":"2023-10-09T11:40:51.098933+0000","last_unstale":"2023-10-09T11:40:51.099532+0000","last_undegraded":"2023-10-09T11:40:51.099532+0000","last_fullsized":"2023-10-09T11:40:51.099532+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:53.777336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108152+0000","last_change":"2023-10-09T11:40:52.108152+0000","last_active":"2023-10-09T11:40:52.108152+0000","last_peered":"2023-10-09T11:40:52.108152+0000","last_clean":"2023-10-09T11:40:52.108152+0000","last_became_active":"2023-10-09T11:40:52.107604+0000","last_became_peered":"2023-10-09T11:40:52.107604+0000","last_unstale":"2023-10-09T11:40:52.108152+0000","last_undegraded":"2023-10-09T11:40:52.108152+0000","last_fullsized":"2023-10-09T11:40:52.108152+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:18.566407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.097237+0000","last_change":"2023-10-09T11:40:51.107968+0000","last_active":"2023-10-09T11:40:52.097237+0000","last_peered":"2023-10-09T11:40:52.097237+0000","last_clean":"2023-10-09T11:40:52.097237+0000","last_became_active":"2023-10-09T11:40:51.107711+0000","last_became_peered":"2023-10-09T11:40:51.107711+0000","last_unstale":"2023-10-09T11:40:52.097237+0000","last_undegraded":"2023-10-09T11:40:52.097237+0000","last_fullsized":"2023-10-09T11:40:52.097237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:03.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109492+0000","last_change":"2023-10-09T11:40:52.109492+0000","last_active":"2023-10-09T11:40:52.109492+0000","last_peered":"2023-10-09T11:40:52.109492+0000","last_clean":"2023-10-09T11:40:52.109492+0000","last_became_active":"2023-10-09T11:40:52.108933+0000","last_became_peered":"2023-10-09T11:40:52.108933+0000","last_unstale":"2023-10-09T11:40:52.109492+0000","last_undegraded":"2023-10-09T11:40:52.109492+0000","last_fullsized":"2023-10-09T11:40:52.109492+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:16.868819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"94'8","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117143+0000","last_change":"2023-10-09T11:40:51.104258+0000","last_active":"2023-10-09T11:40:52.117143+0000","last_peered":"2023-10-09T11:40:52.117143+0000","last_clean":"2023-10-09T11:40:52.117143+0000","last_became_active":"2023-10-09T11:40:51.104024+0000","last_became_peered":"2023-10-09T11:40:51.104024+0000","last_unstale":"2023-10-09T11:40:52.117143+0000","last_undegraded":"2023-10-09T11:40:52.117143+0000","last_fullsized":"2023-10-09T11:40:52.117143+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105993+0000","last_change":"2023-10-09T11:40:52.105993+0000","last_active":"2023-10-09T11:40:52.105993+0000","last_peered":"2023-10-09T11:40:52.105993+0000","last_clean":"2023-10-09T11:40:52.105993+0000","last_became_active":"2023-10-09T11:40:52.105772+0000","last_became_peered":"2023-10-09T11:40:52.105772+0000","last_unstale":"2023-10-09T11:40:52.105993+0000","last_undegraded":"2023-10-09T11:40:52.105993+0000","last_fullsized":"2023-10-09T11:40:52.105993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:15.963559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"94'1","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.103013+0000","last_change":"2023-10-09T11:40:51.104870+0000","last_active":"2023-10-09T11:40:52.103013+0000","last_peered":"2023-10-09T11:40:52.103013+0000","last_clean":"2023-10-09T11:40:52.103013+0000","last_became_active":"2023-10-09T11:40:51.104236+0000","last_became_peered":"2023-10-09T11:40:51.104236+0000","last_unstale":"2023-10-09T11:40:52.103013+0000","last_undegraded":"2023-10-09T11:40:52.103013+0000","last_fullsized":"2023-10-09T11:40:52.103013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:03.967737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106229+0000","last_change":"2023-10-09T11:40:52.106229+0000","last_active":"2023-10-09T11:40:52.106229+0000","last_peered":"2023-10-09T11:40:52.106229+0000","last_clean":"2023-10-09T11:40:52.106229+0000","last_became_active":"2023-10-09T11:40:52.105993+0000","last_became_peered":"2023-10-09T11:40:52.105993+0000","last_unstale":"2023-10-09T11:40:52.106229+0000","last_undegraded":"2023-10-09T11:40:52.106229+0000","last_fullsized":"2023-10-09T11:40:52.106229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.116691+0000","last_change":"2023-10-09T11:40:51.106514+0000","last_active":"2023-10-09T11:40:52.116691+0000","last_peered":"2023-10-09T11:40:52.116691+0000","last_clean":"2023-10-09T11:40:52.116691+0000","last_became_active":"2023-10-09T11:40:51.106251+0000","last_became_peered":"2023-10-09T11:40:51.106251+0000","last_unstale":"2023-10-09T11:40:52.116691+0000","last_undegraded":"2023-10-09T11:40:52.116691+0000","last_fullsized":"2023-10-09T11:40:52.116691+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:25.869197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112391+0000","last_change":"2023-10-09T11:40:52.112298+0000","last_active":"2023-10-09T11:40:52.112391+0000","last_peered":"2023-10-09T11:40:52.112391+0000","last_clean":"2023-10-09T11:40:52.112391+0000","last_became_active":"2023-10-09T11:40:52.111110+0000","last_became_peered":"2023-10-09T11:40:52.111110+0000","last_unstale":"2023-10-09T11:40:52.112391+0000","last_undegraded":"2023-10-09T11:40:52.112391+0000","last_fullsized":"2023-10-09T11:40:52.112391+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:07.215810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101732+0000","last_change":"2023-10-09T11:40:51.101669+0000","last_active":"2023-10-09T11:40:51.101732+0000","last_peered":"2023-10-09T11:40:51.101732+0000","last_clean":"2023-10-09T11:40:51.101732+0000","last_became_active":"2023-10-09T11:40:51.101427+0000","last_became_peered":"2023-10-09T11:40:51.101427+0000","last_unstale":"2023-10-09T11:40:51.101732+0000","last_undegraded":"2023-10-09T11:40:51.101732+0000","last_fullsized":"2023-10-09T11:40:51.101732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:13.929873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113278+0000","last_change":"2023-10-09T11:40:52.112925+0000","last_active":"2023-10-09T11:40:52.113278+0000","last_peered":"2023-10-09T11:40:52.113278+0000","last_clean":"2023-10-09T11:40:52.113278+0000","last_became_active":"2023-10-09T11:40:52.110656+0000","last_became_peered":"2023-10-09T11:40:52.110656+0000","last_unstale":"2023-10-09T11:40:52.113278+0000","last_undegraded":"2023-10-09T11:40:52.113278+0000","last_fullsized":"2023-10-09T11:40:52.113278+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:48.739490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109794+0000","last_change":"2023-10-09T11:40:51.099442+0000","last_active":"2023-10-09T11:40:52.109794+0000","last_peered":"2023-10-09T11:40:52.109794+0000","last_clean":"2023-10-09T11:40:52.109794+0000","last_became_active":"2023-10-09T11:40:51.099199+0000","last_became_peered":"2023-10-09T11:40:51.099199+0000","last_unstale":"2023-10-09T11:40:52.109794+0000","last_undegraded":"2023-10-09T11:40:52.109794+0000","last_fullsized":"2023-10-09T11:40:52.109794+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:41.769784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106212+0000","last_change":"2023-10-09T11:40:52.105765+0000","last_active":"2023-10-09T11:40:52.106212+0000","last_peered":"2023-10-09T11:40:52.106212+0000","last_clean":"2023-10-09T11:40:52.106212+0000","last_became_active":"2023-10-09T11:40:52.105540+0000","last_became_peered":"2023-10-09T11:40:52.105540+0000","last_unstale":"2023-10-09T11:40:52.106212+0000","last_undegraded":"2023-10-09T11:40:52.106212+0000","last_fullsized":"2023-10-09T11:40:52.106212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:54.781308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100485+0000","last_change":"2023-10-09T11:40:51.098517+0000","last_active":"2023-10-09T11:40:52.100485+0000","last_peered":"2023-10-09T11:40:52.100485+0000","last_clean":"2023-10-09T11:40:52.100485+0000","last_became_active":"2023-10-09T11:40:51.098190+0000","last_became_peered":"2023-10-09T11:40:51.098190+0000","last_unstale":"2023-10-09T11:40:52.100485+0000","last_undegraded":"2023-10-09T11:40:52.100485+0000","last_fullsized":"2023-10-09T11:40:52.100485+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:46.355088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109205+0000","last_change":"2023-10-09T11:40:52.109071+0000","last_active":"2023-10-09T11:40:52.109205+0000","last_peered":"2023-10-09T11:40:52.109205+0000","last_clean":"2023-10-09T11:40:52.109205+0000","last_became_active":"2023-10-09T11:40:52.108727+0000","last_became_peered":"2023-10-09T11:40:52.108727+0000","last_unstale":"2023-10-09T11:40:52.109205+0000","last_undegraded":"2023-10-09T11:40:52.109205+0000","last_fullsized":"2023-10-09T11:40:52.109205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:56.414842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100702+0000","last_change":"2023-10-09T11:40:51.100980+0000","last_active":"2023-10-09T11:40:52.100702+0000","last_peered":"2023-10-09T11:40:52.100702+0000","last_clean":"2023-10-09T11:40:52.100702+0000","last_became_active":"2023-10-09T11:40:51.100760+0000","last_became_peered":"2023-10-09T11:40:51.100760+0000","last_unstale":"2023-10-09T11:40:52.100702+0000","last_undegraded":"2023-10-09T11:40:52.100702+0000","last_fullsized":"2023-10-09T11:40:52.100702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.573301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099366+0000","last_change":"2023-10-09T11:40:52.099200+0000","last_active":"2023-10-09T11:40:52.099366+0000","last_peered":"2023-10-09T11:40:52.099366+0000","last_clean":"2023-10-09T11:40:52.099366+0000","last_became_active":"2023-10-09T11:40:52.098966+0000","last_became_peered":"2023-10-09T11:40:52.098966+0000","last_unstale":"2023-10-09T11:40:52.099366+0000","last_undegraded":"2023-10-09T11:40:52.099366+0000","last_fullsized":"2023-10-09T11:40:52.099366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:26.740273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.099679+0000","last_change":"2023-10-09T11:40:51.099618+0000","last_active":"2023-10-09T11:40:51.099679+0000","last_peered":"2023-10-09T11:40:51.099679+0000","last_clean":"2023-10-09T11:40:51.099679+0000","last_became_active":"2023-10-09T11:40:51.099238+0000","last_became_peered":"2023-10-09T11:40:51.099238+0000","last_unstale":"2023-10-09T11:40:51.099679+0000","last_undegraded":"2023-10-09T11:40:51.099679+0000","last_fullsized":"2023-10-09T11:40:51.099679+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:51.520505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099314+0000","last_change":"2023-10-09T11:40:52.099133+0000","last_active":"2023-10-09T11:40:52.099314+0000","last_peered":"2023-10-09T11:40:52.099314+0000","last_clean":"2023-10-09T11:40:52.099314+0000","last_became_active":"2023-10-09T11:40:52.098896+0000","last_became_peered":"2023-10-09T11:40:52.098896+0000","last_unstale":"2023-10-09T11:40:52.099314+0000","last_undegraded":"2023-10-09T11:40:52.099314+0000","last_fullsized":"2023-10-09T11:40:52.099314+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.315042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113328+0000","last_change":"2023-10-09T11:40:51.107393+0000","last_active":"2023-10-09T11:40:52.113328+0000","last_peered":"2023-10-09T11:40:52.113328+0000","last_clean":"2023-10-09T11:40:52.113328+0000","last_became_active":"2023-10-09T11:40:51.106531+0000","last_became_peered":"2023-10-09T11:40:51.106531+0000","last_unstale":"2023-10-09T11:40:52.113328+0000","last_undegraded":"2023-10-09T11:40:52.113328+0000","last_fullsized":"2023-10-09T11:40:52.113328+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:09.422117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108885+0000","last_change":"2023-10-09T11:40:52.108885+0000","last_active":"2023-10-09T11:40:52.108885+0000","last_peered":"2023-10-09T11:40:52.108885+0000","last_clean":"2023-10-09T11:40:52.108885+0000","last_became_active":"2023-10-09T11:40:52.108637+0000","last_became_peered":"2023-10-09T11:40:52.108637+0000","last_unstale":"2023-10-09T11:40:52.108885+0000","last_undegraded":"2023-10-09T11:40:52.108885+0000","last_fullsized":"2023-10-09T11:40:52.108885+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.220453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.100066+0000","last_change":"2023-10-09T11:40:51.099918+0000","last_active":"2023-10-09T11:40:51.100066+0000","last_peered":"2023-10-09T11:40:51.100066+0000","last_clean":"2023-10-09T11:40:51.100066+0000","last_became_active":"2023-10-09T11:40:51.099553+0000","last_became_peered":"2023-10-09T11:40:51.099553+0000","last_unstale":"2023-10-09T11:40:51.100066+0000","last_undegraded":"2023-10-09T11:40:51.100066+0000","last_fullsized":"2023-10-09T11:40:51.100066+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:24.766508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111494+0000","last_change":"2023-10-09T11:40:52.111494+0000","last_active":"2023-10-09T11:40:52.111494+0000","last_peered":"2023-10-09T11:40:52.111494+0000","last_clean":"2023-10-09T11:40:52.111494+0000","last_became_active":"2023-10-09T11:40:52.111254+0000","last_became_peered":"2023-10-09T11:40:52.111254+0000","last_unstale":"2023-10-09T11:40:52.111494+0000","last_undegraded":"2023-10-09T11:40:52.111494+0000","last_fullsized":"2023-10-09T11:40:52.111494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:25.030282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101922+0000","last_change":"2023-10-09T11:40:51.100312+0000","last_active":"2023-10-09T11:40:51.101922+0000","last_peered":"2023-10-09T11:40:51.101922+0000","last_clean":"2023-10-09T11:40:51.101922+0000","last_became_active":"2023-10-09T11:40:51.100117+0000","last_became_peered":"2023-10-09T11:40:51.100117+0000","last_unstale":"2023-10-09T11:40:51.101922+0000","last_undegraded":"2023-10-09T11:40:51.101922+0000","last_fullsized":"2023-10-09T11:40:51.101922+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:43.604507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110428+0000","last_change":"2023-10-09T11:40:52.110342+0000","last_active":"2023-10-09T11:40:52.110428+0000","last_peered":"2023-10-09T11:40:52.110428+0000","last_clean":"2023-10-09T11:40:52.110428+0000","last_became_active":"2023-10-09T11:40:52.109943+0000","last_became_peered":"2023-10-09T11:40:52.109943+0000","last_unstale":"2023-10-09T11:40:52.110428+0000","last_undegraded":"2023-10-09T11:40:52.110428+0000","last_fullsized":"2023-10-09T11:40:52.110428+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104021+0000","last_change":"2023-10-09T11:40:51.103959+0000","last_active":"2023-10-09T11:40:51.104021+0000","last_peered":"2023-10-09T11:40:51.104021+0000","last_clean":"2023-10-09T11:40:51.104021+0000","last_became_active":"2023-10-09T11:40:51.103735+0000","last_became_peered":"2023-10-09T11:40:51.103735+0000","last_unstale":"2023-10-09T11:40:51.104021+0000","last_undegraded":"2023-10-09T11:40:51.104021+0000","last_fullsized":"2023-10-09T11:40:51.104021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:25.369194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106274+0000","last_change":"2023-10-09T11:40:52.106210+0000","last_active":"2023-10-09T11:40:52.106274+0000","last_peered":"2023-10-09T11:40:52.106274+0000","last_clean":"2023-10-09T11:40:52.106274+0000","last_became_active":"2023-10-09T11:40:52.105985+0000","last_became_peered":"2023-10-09T11:40:52.105985+0000","last_unstale":"2023-10-09T11:40:52.106274+0000","last_undegraded":"2023-10-09T11:40:52.106274+0000","last_fullsized":"2023-10-09T11:40:52.106274+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:07.686846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.105784+0000","last_change":"2023-10-09T11:40:51.105722+0000","last_active":"2023-10-09T11:40:51.105784+0000","last_peered":"2023-10-09T11:40:51.105784+0000","last_clean":"2023-10-09T11:40:51.105784+0000","last_became_active":"2023-10-09T11:40:51.105471+0000","last_became_peered":"2023-10-09T11:40:51.105471+0000","last_unstale":"2023-10-09T11:40:51.105784+0000","last_undegraded":"2023-10-09T11:40:51.105784+0000","last_fullsized":"2023-10-09T11:40:51.105784+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:00.402871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102905+0000","last_change":"2023-10-09T11:40:52.102905+0000","last_active":"2023-10-09T11:40:52.102905+0000","last_peered":"2023-10-09T11:40:52.102905+0000","last_clean":"2023-10-09T11:40:52.102905+0000","last_became_active":"2023-10-09T11:40:52.102472+0000","last_became_peered":"2023-10-09T11:40:52.102472+0000","last_unstale":"2023-10-09T11:40:52.102905+0000","last_undegraded":"2023-10-09T11:40:52.102905+0000","last_fullsized":"2023-10-09T11:40:52.102905+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099199+0000","last_change":"2023-10-09T11:40:51.106312+0000","last_active":"2023-10-09T11:40:52.099199+0000","last_peered":"2023-10-09T11:40:52.099199+0000","last_clean":"2023-10-09T11:40:52.099199+0000","last_became_active":"2023-10-09T11:40:51.105864+0000","last_became_peered":"2023-10-09T11:40:51.105864+0000","last_unstale":"2023-10-09T11:40:52.099199+0000","last_undegraded":"2023-10-09T11:40:52.099199+0000","last_fullsized":"2023-10-09T11:40:52.099199+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:31.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.104745+0000","last_change":"2023-10-09T11:40:52.104745+0000","last_active":"2023-10-09T11:40:52.104745+0000","last_peered":"2023-10-09T11:40:52.104745+0000","last_clean":"2023-10-09T11:40:52.104745+0000","last_became_active":"2023-10-09T11:40:52.104473+0000","last_became_peered":"2023-10-09T11:40:52.104473+0000","last_unstale":"2023-10-09T11:40:52.104745+0000","last_undegraded":"2023-10-09T11:40:52.104745+0000","last_fullsized":"2023-10-09T11:40:52.104745+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:07.686846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.105112+0000","last_change":"2023-10-09T11:40:51.105018+0000","last_active":"2023-10-09T11:40:51.105112+0000","last_peered":"2023-10-09T11:40:51.105112+0000","last_clean":"2023-10-09T11:40:51.105112+0000","last_became_active":"2023-10-09T11:40:51.104536+0000","last_became_peered":"2023-10-09T11:40:51.104536+0000","last_unstale":"2023-10-09T11:40:51.105112+0000","last_undegraded":"2023-10-09T11:40:51.105112+0000","last_fullsized":"2023-10-09T11:40:51.105112+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:26.547035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110371+0000","last_change":"2023-10-09T11:40:52.110371+0000","last_active":"2023-10-09T11:40:52.110371+0000","last_peered":"2023-10-09T11:40:52.110371+0000","last_clean":"2023-10-09T11:40:52.110371+0000","last_became_active":"2023-10-09T11:40:52.109750+0000","last_became_peered":"2023-10-09T11:40:52.109750+0000","last_unstale":"2023-10-09T11:40:52.110371+0000","last_undegraded":"2023-10-09T11:40:52.110371+0000","last_fullsized":"2023-10-09T11:40:52.110371+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.098573+0000","last_change":"2023-10-09T11:40:51.102983+0000","last_active":"2023-10-09T11:40:52.098573+0000","last_peered":"2023-10-09T11:40:52.098573+0000","last_clean":"2023-10-09T11:40:52.098573+0000","last_became_active":"2023-10-09T11:40:51.102750+0000","last_became_peered":"2023-10-09T11:40:51.102750+0000","last_unstale":"2023-10-09T11:40:52.098573+0000","last_undegraded":"2023-10-09T11:40:52.098573+0000","last_fullsized":"2023-10-09T11:40:52.098573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:40.402368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112540+0000","last_change":"2023-10-09T11:40:52.112540+0000","last_active":"2023-10-09T11:40:52.112540+0000","last_peered":"2023-10-09T11:40:52.112540+0000","last_clean":"2023-10-09T11:40:52.112540+0000","last_became_active":"2023-10-09T11:40:52.109187+0000","last_became_peered":"2023-10-09T11:40:52.109187+0000","last_unstale":"2023-10-09T11:40:52.112540+0000","last_undegraded":"2023-10-09T11:40:52.112540+0000","last_fullsized":"2023-10-09T11:40:52.112540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:26.373166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"94'1","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102173+0000","last_change":"2023-10-09T11:40:51.102981+0000","last_active":"2023-10-09T11:40:52.102173+0000","last_peered":"2023-10-09T11:40:52.102173+0000","last_clean":"2023-10-09T11:40:52.102173+0000","last_became_active":"2023-10-09T11:40:51.102754+0000","last_became_peered":"2023-10-09T11:40:51.102754+0000","last_unstale":"2023-10-09T11:40:52.102173+0000","last_undegraded":"2023-10-09T11:40:52.102173+0000","last_fullsized":"2023-10-09T11:40:52.102173+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:00.677588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101079+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:40:51.101079+0000","last_peered":"2023-10-09T11:40:51.101079+0000","last_clean":"2023-10-09T11:40:51.101079+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:40:51.101079+0000","last_undegraded":"2023-10-09T11:40:51.101079+0000","last_fullsized":"2023-10-09T11:40:51.101079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1068,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194243,"statfs":{"total":200000000,"available":198905517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.745,"15min":0.745},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.32700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.46899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.372},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.878,"15min":0.878},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":1.048,"15min":1.048},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":1.079,"15min":1.079},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.436}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54400000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.435,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194819,"statfs":{"total":200000000,"available":199495289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.63},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.621,"15min":0.70099999999999996},"min":{"1min":0.39000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":5.298,"15min":5.298},"last":0.625},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60999999999999999,"15min":0.68600000000000005},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":1.617,"15min":1.617},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63400000000000001,"15min":0.71199999999999997},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":5.46,"15min":5.46},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.73399999999999999},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.32600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60499999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194820,"statfs":{"total":200000000,"available":199495761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.40100000000000002},"min":{"1min":0.22,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.442,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.41599999999999998,"15min":0.44900000000000001},"min":{"1min":0.249,"5min":0.247,"15min":0.247},"max":{"1min":0.55200000000000005,"5min":2.004,"15min":2.004},"last":0.307}]},{"osd":2,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39500000000000002,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45500000000000002,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56100000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46200000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.625,"5min":1.909,"15min":1.909},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.442,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.53500000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.35199999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61799999999999999,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73999999999999999,"5min":1.869,"15min":1.869},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86599999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.43099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.755,"5min":1.952,"15min":1.952},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94999999999999996,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":1.782,"15min":1.782},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.48699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89200000000000002,"5min":1.819,"15min":1.819},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1067,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194244,"statfs":{"total":200000000,"available":198906564,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.25900000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53400000000000003,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.64100000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44500000000000001,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57299999999999995,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72599999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":1.282,"15min":1.282},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.70199999999999996},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88800000000000001,"5min":3.976,"15min":3.976},"last":0.62},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.47399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90600000000000003,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":1.524,"15min":1.524},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91000000000000003,"5min":1.254,"15min":1.254},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":1.22,"15min":1.22},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194819,"statfs":{"total":200000000,"available":199495401,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.316},"min":{"1min":0.248,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.34499999999999997},"min":{"1min":0.26900000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52700000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.629,"15min":0.85599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60299999999999998,"5min":11.055,"15min":11.055},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.622,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57599999999999996,"5min":0.62,"15min":0.62},"last":0.434}]},{"osd":4,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.44700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96199999999999997,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.253,"5min":0.19,"15min":0.19},"max":{"1min":0.57099999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54900000000000004,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.376},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":1.034,"15min":1.034},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":1.335,"15min":1.335},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.68999999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.46700000000000003},"min":{"1min":0.29399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64100000000000001,"5min":1.405,"15min":1.405},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76100000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.499,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":1.387,"15min":1.387},"last":0.44600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82999999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.50700000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.53400000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.45900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194820,"statfs":{"total":200000000,"available":199495955,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66500000000000004,"15min":0.77700000000000002},"min":{"1min":0.32100000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71399999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.82999999999999996},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81100000000000005,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.623,"15min":0.71699999999999997},"min":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":5.274,"15min":5.274},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.70099999999999996,"15min":0.82799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.71999999999999997,"15min":0.84999999999999998},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59399999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.37},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.61799999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.623},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66700000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68999999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68700000000000006,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.65600000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46200000000000002,"15min":0.48099999999999998},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64300000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59699999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T11:40:56.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:40:56.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.372+0000 7f5d5e445700 1 Processor -- start 2023-10-09T11:40:56.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.372+0000 7f5d5e445700 1 -- start start 2023-10-09T11:40:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d5e445700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d58157ca0 0x7f5d580cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d5e445700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d5806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d5e445700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d580d07c0 con 0x7f5d581578d0 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d5e445700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5806daa0 con 0x7f5d58157ca0 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d5e445700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580cfbb0 con 0x7f5d5806d120 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d577fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d58157ca0 0x7f5d580cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d57fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5d581578d0 0x7f5d5815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60970/0 (socket says 172.21.15.6:60970) 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.373+0000 7f5d57fff700 1 -- 172.21.15.6:0/1183974554 learned_addr learned my addr 172.21.15.6:0/1183974554 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d5c9e2700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d5806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d577fe700 1 -- 172.21.15.6:0/1183974554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 msgr2=0x7f5d5806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d577fe700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d5806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d577fe700 1 -- 172.21.15.6:0/1183974554 >> v1:172.21.15.6:6789/0 conn(0x7f5d581578d0 legacy=0x7f5d5815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d56ffd700 1 -- 172.21.15.6:0/1183974554 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160354427 0 0) 0x7f5d580d07c0 con 0x7f5d581578d0 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d577fe700 1 -- 172.21.15.6:0/1183974554 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d580cfe90 con 0x7f5d58157ca0 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d5c9e2700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d5806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d577fe700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580cf4f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098e0 tx=0x7f5d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde2e7b180299dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d56ffd700 1 -- 172.21.15.6:0/1183974554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c009e80 con 0x7f5d58157ca0 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d56ffd700 1 -- 172.21.15.6:0/1183974554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c00b860 con 0x7f5d58157ca0 2023-10-09T11:40:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.374+0000 7f5d56ffd700 1 -- 172.21.15.6:0/1183974554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00bbe0 con 0x7f5d58157ca0 2023-10-09T11:40:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 -- 172.21.15.6:0/1183974554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 msgr2=0x7f5d580cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580cf4f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098e0 tx=0x7f5d4c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 -- 172.21.15.6:0/1183974554 shutdown_connections 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d5806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 --2- 172.21.15.6:0/1183974554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580cf4f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 -- 172.21.15.6:0/1183974554 >> 172.21.15.6:0/1183974554 conn(0x7f5d5806bb90 msgr2=0x7f5d5806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 -- 172.21.15.6:0/1183974554 shutdown_connections 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.375+0000 7f5d5e445700 1 -- 172.21.15.6:0/1183974554 wait complete. 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.376+0000 7f5d5e445700 1 Processor -- start 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.376+0000 7f5d5e445700 1 -- start start 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d580af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d581578d0 0x7f5d580aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580adc60 con 0x7f5d58157ca0 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580b5700 con 0x7f5d581578d0 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5e445700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580b5120 con 0x7f5d5806d120 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37628/0 (socket says 172.21.15.6:37628) 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 -- 172.21.15.6:0/2811864864 learned_addr learned my addr 172.21.15.6:0/2811864864 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d577fe700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d581578d0 0x7f5d580aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d57fff700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 -- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 msgr2=0x7f5d580af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d580af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 -- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d581578d0 msgr2=0x7f5d580aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d581578d0 0x7f5d580aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 -- 172.21.15.6:0/2811864864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c009420 con 0x7f5d58157ca0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d57fff700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d580af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.377+0000 7f5d5c9e2700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000a380 tx=0x7f5d50007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.378+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000ae10 con 0x7f5d58157ca0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.378+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5000d650 con 0x7f5d58157ca0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.378+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000da10 con 0x7f5d58157ca0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.378+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d580ade70 con 0x7f5d58157ca0 2023-10-09T11:40:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.378+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d580ae150 con 0x7f5d58157ca0 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.379+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58067ac0 con 0x7f5d58157ca0 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.379+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d5001e3b0 con 0x7f5d58157ca0 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.379+0000 7f5d3ffff700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.380+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d50084f80 con 0x7f5d58157ca0 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.380+0000 7f5d57fff700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.380+0000 7f5d57fff700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 0x7f5d440693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d480018d0 tx=0x7f5d48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.384+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d500521f0 con 0x7f5d58157ca0 2023-10-09T11:40:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.570+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d580b5840 con 0x7f5d44066f30 2023-10-09T11:40:56.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.578+0000 7f5d3ffff700 1 -- 172.21.15.6:0/2811864864 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284781 (secure 0 0 0) 0x7f5d580b5840 con 0x7f5d44066f30 2023-10-09T11:40:56.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 msgr2=0x7f5d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 0x7f5d440693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d480018d0 tx=0x7f5d48009040 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 msgr2=0x7f5d580ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000a380 tx=0x7f5d50007900 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 shutdown_connections 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d44066f30 0x7f5d440693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d58157ca0 0x7f5d580ad720 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d5806d120 0x7f5d580af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 --2- 172.21.15.6:0/2811864864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d581578d0 0x7f5d580aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 >> 172.21.15.6:0/2811864864 conn(0x7f5d5806bb90 msgr2=0x7f5d58155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 shutdown_connections 2023-10-09T11:40:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.581+0000 7f5d5e445700 1 -- 172.21.15.6:0/2811864864 wait complete. 2023-10-09T11:40:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:40:56.595 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2023-10-09T11:40:56.209856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5094,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557405,"statfs":{"total":1600000000,"available":1594783303,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001009"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113787+0000","last_change":"2023-10-09T11:40:52.113787+0000","last_active":"2023-10-09T11:40:52.113787+0000","last_peered":"2023-10-09T11:40:52.113787+0000","last_clean":"2023-10-09T11:40:52.113787+0000","last_became_active":"2023-10-09T11:40:52.113489+0000","last_became_peered":"2023-10-09T11:40:52.113489+0000","last_unstale":"2023-10-09T11:40:52.113787+0000","last_undegraded":"2023-10-09T11:40:52.113787+0000","last_fullsized":"2023-10-09T11:40:52.113787+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113626+0000","last_change":"2023-10-09T11:40:52.113626+0000","last_active":"2023-10-09T11:40:52.113626+0000","last_peered":"2023-10-09T11:40:52.113626+0000","last_clean":"2023-10-09T11:40:52.113626+0000","last_became_active":"2023-10-09T11:40:52.112783+0000","last_became_peered":"2023-10-09T11:40:52.112783+0000","last_unstale":"2023-10-09T11:40:52.113626+0000","last_undegraded":"2023-10-09T11:40:52.113626+0000","last_fullsized":"2023-10-09T11:40:52.113626+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:27.551007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113994+0000","last_change":"2023-10-09T11:40:52.113994+0000","last_active":"2023-10-09T11:40:52.113994+0000","last_peered":"2023-10-09T11:40:52.113994+0000","last_clean":"2023-10-09T11:40:52.113994+0000","last_became_active":"2023-10-09T11:40:52.113623+0000","last_became_peered":"2023-10-09T11:40:52.113623+0000","last_unstale":"2023-10-09T11:40:52.113994+0000","last_undegraded":"2023-10-09T11:40:52.113994+0000","last_fullsized":"2023-10-09T11:40:52.113994+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:15.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113310+0000","last_change":"2023-10-09T11:40:52.113215+0000","last_active":"2023-10-09T11:40:52.113310+0000","last_peered":"2023-10-09T11:40:52.113310+0000","last_clean":"2023-10-09T11:40:52.113310+0000","last_became_active":"2023-10-09T11:40:52.111314+0000","last_became_peered":"2023-10-09T11:40:52.111314+0000","last_unstale":"2023-10-09T11:40:52.113310+0000","last_undegraded":"2023-10-09T11:40:52.113310+0000","last_fullsized":"2023-10-09T11:40:52.113310+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:00.346684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107670+0000","last_change":"2023-10-09T11:40:52.107607+0000","last_active":"2023-10-09T11:40:52.107670+0000","last_peered":"2023-10-09T11:40:52.107670+0000","last_clean":"2023-10-09T11:40:52.107670+0000","last_became_active":"2023-10-09T11:40:52.107390+0000","last_became_peered":"2023-10-09T11:40:52.107390+0000","last_unstale":"2023-10-09T11:40:52.107670+0000","last_undegraded":"2023-10-09T11:40:52.107670+0000","last_fullsized":"2023-10-09T11:40:52.107670+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107933+0000","last_change":"2023-10-09T11:40:52.107870+0000","last_active":"2023-10-09T11:40:52.107933+0000","last_peered":"2023-10-09T11:40:52.107933+0000","last_clean":"2023-10-09T11:40:52.107933+0000","last_became_active":"2023-10-09T11:40:52.107441+0000","last_became_peered":"2023-10-09T11:40:52.107441+0000","last_unstale":"2023-10-09T11:40:52.107933+0000","last_undegraded":"2023-10-09T11:40:52.107933+0000","last_fullsized":"2023-10-09T11:40:52.107933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.220453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105885+0000","last_change":"2023-10-09T11:40:52.105824+0000","last_active":"2023-10-09T11:40:52.105885+0000","last_peered":"2023-10-09T11:40:52.105885+0000","last_clean":"2023-10-09T11:40:52.105885+0000","last_became_active":"2023-10-09T11:40:52.105397+0000","last_became_peered":"2023-10-09T11:40:52.105397+0000","last_unstale":"2023-10-09T11:40:52.105885+0000","last_undegraded":"2023-10-09T11:40:52.105885+0000","last_fullsized":"2023-10-09T11:40:52.105885+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:17:37.489916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107669+0000","last_change":"2023-10-09T11:40:52.107599+0000","last_active":"2023-10-09T11:40:52.107669+0000","last_peered":"2023-10-09T11:40:52.107669+0000","last_clean":"2023-10-09T11:40:52.107669+0000","last_became_active":"2023-10-09T11:40:52.107335+0000","last_became_peered":"2023-10-09T11:40:52.107335+0000","last_unstale":"2023-10-09T11:40:52.107669+0000","last_undegraded":"2023-10-09T11:40:52.107669+0000","last_fullsized":"2023-10-09T11:40:52.107669+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:52.524478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100050+0000","last_change":"2023-10-09T11:40:52.099896+0000","last_active":"2023-10-09T11:40:52.100050+0000","last_peered":"2023-10-09T11:40:52.100050+0000","last_clean":"2023-10-09T11:40:52.100050+0000","last_became_active":"2023-10-09T11:40:52.099666+0000","last_became_peered":"2023-10-09T11:40:52.099666+0000","last_unstale":"2023-10-09T11:40:52.100050+0000","last_undegraded":"2023-10-09T11:40:52.100050+0000","last_fullsized":"2023-10-09T11:40:52.100050+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:07.215810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.104942+0000","last_change":"2023-10-09T11:40:52.104942+0000","last_active":"2023-10-09T11:40:52.104942+0000","last_peered":"2023-10-09T11:40:52.104942+0000","last_clean":"2023-10-09T11:40:52.104942+0000","last_became_active":"2023-10-09T11:40:52.104727+0000","last_became_peered":"2023-10-09T11:40:52.104727+0000","last_unstale":"2023-10-09T11:40:52.104942+0000","last_undegraded":"2023-10-09T11:40:52.104942+0000","last_fullsized":"2023-10-09T11:40:52.104942+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:01.681560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109768+0000","last_change":"2023-10-09T11:40:52.109768+0000","last_active":"2023-10-09T11:40:52.109768+0000","last_peered":"2023-10-09T11:40:52.109768+0000","last_clean":"2023-10-09T11:40:52.109768+0000","last_became_active":"2023-10-09T11:40:52.109531+0000","last_became_peered":"2023-10-09T11:40:52.109531+0000","last_unstale":"2023-10-09T11:40:52.109768+0000","last_undegraded":"2023-10-09T11:40:52.109768+0000","last_fullsized":"2023-10-09T11:40:52.109768+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:27:21.330312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107723+0000","last_change":"2023-10-09T11:40:52.107723+0000","last_active":"2023-10-09T11:40:52.107723+0000","last_peered":"2023-10-09T11:40:52.107723+0000","last_clean":"2023-10-09T11:40:52.107723+0000","last_became_active":"2023-10-09T11:40:52.106918+0000","last_became_peered":"2023-10-09T11:40:52.106918+0000","last_unstale":"2023-10-09T11:40:52.107723+0000","last_undegraded":"2023-10-09T11:40:52.107723+0000","last_fullsized":"2023-10-09T11:40:52.107723+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:56:00.763704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102802+0000","last_change":"2023-10-09T11:40:52.102802+0000","last_active":"2023-10-09T11:40:52.102802+0000","last_peered":"2023-10-09T11:40:52.102802+0000","last_clean":"2023-10-09T11:40:52.102802+0000","last_became_active":"2023-10-09T11:40:52.102558+0000","last_became_peered":"2023-10-09T11:40:52.102558+0000","last_unstale":"2023-10-09T11:40:52.102802+0000","last_undegraded":"2023-10-09T11:40:52.102802+0000","last_fullsized":"2023-10-09T11:40:52.102802+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:38.646852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113295+0000","last_change":"2023-10-09T11:40:52.113084+0000","last_active":"2023-10-09T11:40:52.113295+0000","last_peered":"2023-10-09T11:40:52.113295+0000","last_clean":"2023-10-09T11:40:52.113295+0000","last_became_active":"2023-10-09T11:40:52.110989+0000","last_became_peered":"2023-10-09T11:40:52.110989+0000","last_unstale":"2023-10-09T11:40:52.113295+0000","last_undegraded":"2023-10-09T11:40:52.113295+0000","last_fullsized":"2023-10-09T11:40:52.113295+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.451357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106829+0000","last_change":"2023-10-09T11:40:52.106829+0000","last_active":"2023-10-09T11:40:52.106829+0000","last_peered":"2023-10-09T11:40:52.106829+0000","last_clean":"2023-10-09T11:40:52.106829+0000","last_became_active":"2023-10-09T11:40:52.106599+0000","last_became_peered":"2023-10-09T11:40:52.106599+0000","last_unstale":"2023-10-09T11:40:52.106829+0000","last_undegraded":"2023-10-09T11:40:52.106829+0000","last_fullsized":"2023-10-09T11:40:52.106829+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:38.646852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112205+0000","last_change":"2023-10-09T11:40:52.111401+0000","last_active":"2023-10-09T11:40:52.112205+0000","last_peered":"2023-10-09T11:40:52.112205+0000","last_clean":"2023-10-09T11:40:52.112205+0000","last_became_active":"2023-10-09T11:40:52.110567+0000","last_became_peered":"2023-10-09T11:40:52.110567+0000","last_unstale":"2023-10-09T11:40:52.112205+0000","last_undegraded":"2023-10-09T11:40:52.112205+0000","last_fullsized":"2023-10-09T11:40:52.112205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:26.740273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112407+0000","last_change":"2023-10-09T11:40:52.112324+0000","last_active":"2023-10-09T11:40:52.112407+0000","last_peered":"2023-10-09T11:40:52.112407+0000","last_clean":"2023-10-09T11:40:52.112407+0000","last_became_active":"2023-10-09T11:40:52.111861+0000","last_became_peered":"2023-10-09T11:40:52.111861+0000","last_unstale":"2023-10-09T11:40:52.112407+0000","last_undegraded":"2023-10-09T11:40:52.112407+0000","last_fullsized":"2023-10-09T11:40:52.112407+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107035+0000","last_change":"2023-10-09T11:40:52.106936+0000","last_active":"2023-10-09T11:40:52.107035+0000","last_peered":"2023-10-09T11:40:52.107035+0000","last_clean":"2023-10-09T11:40:52.107035+0000","last_became_active":"2023-10-09T11:40:52.106730+0000","last_became_peered":"2023-10-09T11:40:52.106730+0000","last_unstale":"2023-10-09T11:40:52.107035+0000","last_undegraded":"2023-10-09T11:40:52.107035+0000","last_fullsized":"2023-10-09T11:40:52.107035+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:10.426089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108335+0000","last_change":"2023-10-09T11:40:52.108335+0000","last_active":"2023-10-09T11:40:52.108335+0000","last_peered":"2023-10-09T11:40:52.108335+0000","last_clean":"2023-10-09T11:40:52.108335+0000","last_became_active":"2023-10-09T11:40:52.107868+0000","last_became_peered":"2023-10-09T11:40:52.107868+0000","last_unstale":"2023-10-09T11:40:52.108335+0000","last_undegraded":"2023-10-09T11:40:52.108335+0000","last_fullsized":"2023-10-09T11:40:52.108335+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107013+0000","last_change":"2023-10-09T11:40:52.106227+0000","last_active":"2023-10-09T11:40:52.107013+0000","last_peered":"2023-10-09T11:40:52.107013+0000","last_clean":"2023-10-09T11:40:52.107013+0000","last_became_active":"2023-10-09T11:40:52.105941+0000","last_became_peered":"2023-10-09T11:40:52.105941+0000","last_unstale":"2023-10-09T11:40:52.107013+0000","last_undegraded":"2023-10-09T11:40:52.107013+0000","last_fullsized":"2023-10-09T11:40:52.107013+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:19:17.967259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.114281+0000","last_change":"2023-10-09T11:40:52.114179+0000","last_active":"2023-10-09T11:40:52.114281+0000","last_peered":"2023-10-09T11:40:52.114281+0000","last_clean":"2023-10-09T11:40:52.114281+0000","last_became_active":"2023-10-09T11:40:52.113798+0000","last_became_peered":"2023-10-09T11:40:52.113798+0000","last_unstale":"2023-10-09T11:40:52.114281+0000","last_undegraded":"2023-10-09T11:40:52.114281+0000","last_fullsized":"2023-10-09T11:40:52.114281+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:11.582448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113789+0000","last_change":"2023-10-09T11:40:52.113789+0000","last_active":"2023-10-09T11:40:52.113789+0000","last_peered":"2023-10-09T11:40:52.113789+0000","last_clean":"2023-10-09T11:40:52.113789+0000","last_became_active":"2023-10-09T11:40:52.113084+0000","last_became_peered":"2023-10-09T11:40:52.113084+0000","last_unstale":"2023-10-09T11:40:52.113789+0000","last_undegraded":"2023-10-09T11:40:52.113789+0000","last_fullsized":"2023-10-09T11:40:52.113789+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:03.092166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110050+0000","last_change":"2023-10-09T11:40:52.110050+0000","last_active":"2023-10-09T11:40:52.110050+0000","last_peered":"2023-10-09T11:40:52.110050+0000","last_clean":"2023-10-09T11:40:52.110050+0000","last_became_active":"2023-10-09T11:40:52.108767+0000","last_became_peered":"2023-10-09T11:40:52.108767+0000","last_unstale":"2023-10-09T11:40:52.110050+0000","last_undegraded":"2023-10-09T11:40:52.110050+0000","last_fullsized":"2023-10-09T11:40:52.110050+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:04.482360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108490+0000","last_change":"2023-10-09T11:40:52.108425+0000","last_active":"2023-10-09T11:40:52.108490+0000","last_peered":"2023-10-09T11:40:52.108490+0000","last_clean":"2023-10-09T11:40:52.108490+0000","last_became_active":"2023-10-09T11:40:52.108153+0000","last_became_peered":"2023-10-09T11:40:52.108153+0000","last_unstale":"2023-10-09T11:40:52.108490+0000","last_undegraded":"2023-10-09T11:40:52.108490+0000","last_fullsized":"2023-10-09T11:40:52.108490+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:59:19.639406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110908+0000","last_change":"2023-10-09T11:40:52.110908+0000","last_active":"2023-10-09T11:40:52.110908+0000","last_peered":"2023-10-09T11:40:52.110908+0000","last_clean":"2023-10-09T11:40:52.110908+0000","last_became_active":"2023-10-09T11:40:52.110339+0000","last_became_peered":"2023-10-09T11:40:52.110339+0000","last_unstale":"2023-10-09T11:40:52.110908+0000","last_undegraded":"2023-10-09T11:40:52.110908+0000","last_fullsized":"2023-10-09T11:40:52.110908+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:15.089277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110519+0000","last_change":"2023-10-09T11:40:52.110519+0000","last_active":"2023-10-09T11:40:52.110519+0000","last_peered":"2023-10-09T11:40:52.110519+0000","last_clean":"2023-10-09T11:40:52.110519+0000","last_became_active":"2023-10-09T11:40:52.110103+0000","last_became_peered":"2023-10-09T11:40:52.110103+0000","last_unstale":"2023-10-09T11:40:52.110519+0000","last_undegraded":"2023-10-09T11:40:52.110519+0000","last_fullsized":"2023-10-09T11:40:52.110519+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:49.483487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112181+0000","last_change":"2023-10-09T11:40:52.112114+0000","last_active":"2023-10-09T11:40:52.112181+0000","last_peered":"2023-10-09T11:40:52.112181+0000","last_clean":"2023-10-09T11:40:52.112181+0000","last_became_active":"2023-10-09T11:40:52.111560+0000","last_became_peered":"2023-10-09T11:40:52.111560+0000","last_unstale":"2023-10-09T11:40:52.112181+0000","last_undegraded":"2023-10-09T11:40:52.112181+0000","last_fullsized":"2023-10-09T11:40:52.112181+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:02.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111592+0000","last_change":"2023-10-09T11:40:52.111592+0000","last_active":"2023-10-09T11:40:52.111592+0000","last_peered":"2023-10-09T11:40:52.111592+0000","last_clean":"2023-10-09T11:40:52.111592+0000","last_became_active":"2023-10-09T11:40:52.111352+0000","last_became_peered":"2023-10-09T11:40:52.111352+0000","last_unstale":"2023-10-09T11:40:52.111592+0000","last_undegraded":"2023-10-09T11:40:52.111592+0000","last_fullsized":"2023-10-09T11:40:52.111592+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110071+0000","last_change":"2023-10-09T11:40:52.110071+0000","last_active":"2023-10-09T11:40:52.110071+0000","last_peered":"2023-10-09T11:40:52.110071+0000","last_clean":"2023-10-09T11:40:52.110071+0000","last_became_active":"2023-10-09T11:40:52.109821+0000","last_became_peered":"2023-10-09T11:40:52.109821+0000","last_unstale":"2023-10-09T11:40:52.110071+0000","last_undegraded":"2023-10-09T11:40:52.110071+0000","last_fullsized":"2023-10-09T11:40:52.110071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:04.686314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111001+0000","last_change":"2023-10-09T11:40:52.111001+0000","last_active":"2023-10-09T11:40:52.111001+0000","last_peered":"2023-10-09T11:40:52.111001+0000","last_clean":"2023-10-09T11:40:52.111001+0000","last_became_active":"2023-10-09T11:40:52.110625+0000","last_became_peered":"2023-10-09T11:40:52.110625+0000","last_unstale":"2023-10-09T11:40:52.111001+0000","last_undegraded":"2023-10-09T11:40:52.111001+0000","last_fullsized":"2023-10-09T11:40:52.111001+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:44.608479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.101135+0000","last_change":"2023-10-09T11:40:52.101064+0000","last_active":"2023-10-09T11:40:52.101135+0000","last_peered":"2023-10-09T11:40:52.101135+0000","last_clean":"2023-10-09T11:40:52.101135+0000","last_became_active":"2023-10-09T11:40:52.100724+0000","last_became_peered":"2023-10-09T11:40:52.100724+0000","last_unstale":"2023-10-09T11:40:52.101135+0000","last_undegraded":"2023-10-09T11:40:52.101135+0000","last_fullsized":"2023-10-09T11:40:52.101135+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112974+0000","last_change":"2023-10-09T11:40:52.112974+0000","last_active":"2023-10-09T11:40:52.112974+0000","last_peered":"2023-10-09T11:40:52.112974+0000","last_clean":"2023-10-09T11:40:52.112974+0000","last_became_active":"2023-10-09T11:40:52.112635+0000","last_became_peered":"2023-10-09T11:40:52.112635+0000","last_unstale":"2023-10-09T11:40:52.112974+0000","last_undegraded":"2023-10-09T11:40:52.112974+0000","last_fullsized":"2023-10-09T11:40:52.112974+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:02.830061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110404+0000","last_change":"2023-10-09T11:40:52.110181+0000","last_active":"2023-10-09T11:40:52.110404+0000","last_peered":"2023-10-09T11:40:52.110404+0000","last_clean":"2023-10-09T11:40:52.110404+0000","last_became_active":"2023-10-09T11:40:52.109609+0000","last_became_peered":"2023-10-09T11:40:52.109609+0000","last_unstale":"2023-10-09T11:40:52.110404+0000","last_undegraded":"2023-10-09T11:40:52.110404+0000","last_fullsized":"2023-10-09T11:40:52.110404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:26.873169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"94'4","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117814+0000","last_change":"2023-10-09T11:40:51.106892+0000","last_active":"2023-10-09T11:40:52.117814+0000","last_peered":"2023-10-09T11:40:52.117814+0000","last_clean":"2023-10-09T11:40:52.117814+0000","last_became_active":"2023-10-09T11:40:51.106564+0000","last_became_peered":"2023-10-09T11:40:51.106564+0000","last_unstale":"2023-10-09T11:40:52.117814+0000","last_undegraded":"2023-10-09T11:40:52.117814+0000","last_fullsized":"2023-10-09T11:40:52.117814+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:06:02.088194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110222+0000","last_change":"2023-10-09T11:40:52.110222+0000","last_active":"2023-10-09T11:40:52.110222+0000","last_peered":"2023-10-09T11:40:52.110222+0000","last_clean":"2023-10-09T11:40:52.110222+0000","last_became_active":"2023-10-09T11:40:52.109182+0000","last_became_peered":"2023-10-09T11:40:52.109182+0000","last_unstale":"2023-10-09T11:40:52.110222+0000","last_undegraded":"2023-10-09T11:40:52.110222+0000","last_fullsized":"2023-10-09T11:40:52.110222+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.315042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115621+0000","last_change":"2023-10-09T11:40:51.104900+0000","last_active":"2023-10-09T11:40:52.115621+0000","last_peered":"2023-10-09T11:40:52.115621+0000","last_clean":"2023-10-09T11:40:52.115621+0000","last_became_active":"2023-10-09T11:40:51.104410+0000","last_became_peered":"2023-10-09T11:40:51.104410+0000","last_unstale":"2023-10-09T11:40:52.115621+0000","last_undegraded":"2023-10-09T11:40:52.115621+0000","last_fullsized":"2023-10-09T11:40:52.115621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:13.519743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106808+0000","last_change":"2023-10-09T11:40:52.106808+0000","last_active":"2023-10-09T11:40:52.106808+0000","last_peered":"2023-10-09T11:40:52.106808+0000","last_clean":"2023-10-09T11:40:52.106808+0000","last_became_active":"2023-10-09T11:40:52.106551+0000","last_became_peered":"2023-10-09T11:40:52.106551+0000","last_unstale":"2023-10-09T11:40:52.106808+0000","last_undegraded":"2023-10-09T11:40:52.106808+0000","last_fullsized":"2023-10-09T11:40:52.106808+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:19.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117870+0000","last_change":"2023-10-09T11:40:51.098933+0000","last_active":"2023-10-09T11:40:52.117870+0000","last_peered":"2023-10-09T11:40:52.117870+0000","last_clean":"2023-10-09T11:40:52.117870+0000","last_became_active":"2023-10-09T11:40:51.098701+0000","last_became_peered":"2023-10-09T11:40:51.098701+0000","last_unstale":"2023-10-09T11:40:52.117870+0000","last_undegraded":"2023-10-09T11:40:52.117870+0000","last_fullsized":"2023-10-09T11:40:52.117870+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:59.759732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109284+0000","last_change":"2023-10-09T11:40:52.109284+0000","last_active":"2023-10-09T11:40:52.109284+0000","last_peered":"2023-10-09T11:40:52.109284+0000","last_clean":"2023-10-09T11:40:52.109284+0000","last_became_active":"2023-10-09T11:40:52.108681+0000","last_became_peered":"2023-10-09T11:40:52.108681+0000","last_unstale":"2023-10-09T11:40:52.109284+0000","last_undegraded":"2023-10-09T11:40:52.109284+0000","last_fullsized":"2023-10-09T11:40:52.109284+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:35.343633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115850+0000","last_change":"2023-10-09T11:40:51.099000+0000","last_active":"2023-10-09T11:40:52.115850+0000","last_peered":"2023-10-09T11:40:52.115850+0000","last_clean":"2023-10-09T11:40:52.115850+0000","last_became_active":"2023-10-09T11:40:51.098778+0000","last_became_peered":"2023-10-09T11:40:51.098778+0000","last_unstale":"2023-10-09T11:40:52.115850+0000","last_undegraded":"2023-10-09T11:40:52.115850+0000","last_fullsized":"2023-10-09T11:40:52.115850+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:38:32.701074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108310+0000","last_change":"2023-10-09T11:40:52.108310+0000","last_active":"2023-10-09T11:40:52.108310+0000","last_peered":"2023-10-09T11:40:52.108310+0000","last_clean":"2023-10-09T11:40:52.108310+0000","last_became_active":"2023-10-09T11:40:52.107911+0000","last_became_peered":"2023-10-09T11:40:52.107911+0000","last_unstale":"2023-10-09T11:40:52.108310+0000","last_undegraded":"2023-10-09T11:40:52.108310+0000","last_fullsized":"2023-10-09T11:40:52.108310+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:04.971709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.116634+0000","last_change":"2023-10-09T11:40:51.108984+0000","last_active":"2023-10-09T11:40:52.116634+0000","last_peered":"2023-10-09T11:40:52.116634+0000","last_clean":"2023-10-09T11:40:52.116634+0000","last_became_active":"2023-10-09T11:40:51.108720+0000","last_became_peered":"2023-10-09T11:40:51.108720+0000","last_unstale":"2023-10-09T11:40:52.116634+0000","last_undegraded":"2023-10-09T11:40:52.116634+0000","last_fullsized":"2023-10-09T11:40:52.116634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:26.547035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105284+0000","last_change":"2023-10-09T11:40:52.105031+0000","last_active":"2023-10-09T11:40:52.105284+0000","last_peered":"2023-10-09T11:40:52.105284+0000","last_clean":"2023-10-09T11:40:52.105284+0000","last_became_active":"2023-10-09T11:40:52.104762+0000","last_became_peered":"2023-10-09T11:40:52.104762+0000","last_unstale":"2023-10-09T11:40:52.105284+0000","last_undegraded":"2023-10-09T11:40:52.105284+0000","last_fullsized":"2023-10-09T11:40:52.105284+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:19.614707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115118+0000","last_change":"2023-10-09T11:40:51.107341+0000","last_active":"2023-10-09T11:40:52.115118+0000","last_peered":"2023-10-09T11:40:52.115118+0000","last_clean":"2023-10-09T11:40:52.115118+0000","last_became_active":"2023-10-09T11:40:51.107163+0000","last_became_peered":"2023-10-09T11:40:51.107163+0000","last_unstale":"2023-10-09T11:40:52.115118+0000","last_undegraded":"2023-10-09T11:40:52.115118+0000","last_fullsized":"2023-10-09T11:40:52.115118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:30.642966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109044+0000","last_change":"2023-10-09T11:40:52.109044+0000","last_active":"2023-10-09T11:40:52.109044+0000","last_peered":"2023-10-09T11:40:52.109044+0000","last_clean":"2023-10-09T11:40:52.109044+0000","last_became_active":"2023-10-09T11:40:52.108111+0000","last_became_peered":"2023-10-09T11:40:52.108111+0000","last_unstale":"2023-10-09T11:40:52.109044+0000","last_undegraded":"2023-10-09T11:40:52.109044+0000","last_fullsized":"2023-10-09T11:40:52.109044+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:28:36.403791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.100496+0000","last_change":"2023-10-09T11:40:51.100434+0000","last_active":"2023-10-09T11:40:51.100496+0000","last_peered":"2023-10-09T11:40:51.100496+0000","last_clean":"2023-10-09T11:40:51.100496+0000","last_became_active":"2023-10-09T11:40:51.100148+0000","last_became_peered":"2023-10-09T11:40:51.100148+0000","last_unstale":"2023-10-09T11:40:51.100496+0000","last_undegraded":"2023-10-09T11:40:51.100496+0000","last_fullsized":"2023-10-09T11:40:51.100496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:24.026310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109383+0000","last_change":"2023-10-09T11:40:52.109383+0000","last_active":"2023-10-09T11:40:52.109383+0000","last_peered":"2023-10-09T11:40:52.109383+0000","last_clean":"2023-10-09T11:40:52.109383+0000","last_became_active":"2023-10-09T11:40:52.109091+0000","last_became_peered":"2023-10-09T11:40:52.109091+0000","last_unstale":"2023-10-09T11:40:52.109383+0000","last_undegraded":"2023-10-09T11:40:52.109383+0000","last_fullsized":"2023-10-09T11:40:52.109383+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104222+0000","last_change":"2023-10-09T11:40:51.104160+0000","last_active":"2023-10-09T11:40:51.104222+0000","last_peered":"2023-10-09T11:40:51.104222+0000","last_clean":"2023-10-09T11:40:51.104222+0000","last_became_active":"2023-10-09T11:40:51.103920+0000","last_became_peered":"2023-10-09T11:40:51.103920+0000","last_unstale":"2023-10-09T11:40:51.104222+0000","last_undegraded":"2023-10-09T11:40:51.104222+0000","last_fullsized":"2023-10-09T11:40:51.104222+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:13:59.342712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115483+0000","last_change":"2023-10-09T11:40:52.115483+0000","last_active":"2023-10-09T11:40:52.115483+0000","last_peered":"2023-10-09T11:40:52.115483+0000","last_clean":"2023-10-09T11:40:52.115483+0000","last_became_active":"2023-10-09T11:40:52.115236+0000","last_became_peered":"2023-10-09T11:40:52.115236+0000","last_unstale":"2023-10-09T11:40:52.115483+0000","last_undegraded":"2023-10-09T11:40:52.115483+0000","last_fullsized":"2023-10-09T11:40:52.115483+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:15.948528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104711+0000","last_change":"2023-10-09T11:40:51.104636+0000","last_active":"2023-10-09T11:40:51.104711+0000","last_peered":"2023-10-09T11:40:51.104711+0000","last_clean":"2023-10-09T11:40:51.104711+0000","last_became_active":"2023-10-09T11:40:51.104376+0000","last_became_peered":"2023-10-09T11:40:51.104376+0000","last_unstale":"2023-10-09T11:40:51.104711+0000","last_undegraded":"2023-10-09T11:40:51.104711+0000","last_fullsized":"2023-10-09T11:40:51.104711+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:13.519743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.107788+0000","last_change":"2023-10-09T11:40:52.107700+0000","last_active":"2023-10-09T11:40:52.107788+0000","last_peered":"2023-10-09T11:40:52.107788+0000","last_clean":"2023-10-09T11:40:52.107788+0000","last_became_active":"2023-10-09T11:40:52.107115+0000","last_became_peered":"2023-10-09T11:40:52.107115+0000","last_unstale":"2023-10-09T11:40:52.107788+0000","last_undegraded":"2023-10-09T11:40:52.107788+0000","last_fullsized":"2023-10-09T11:40:52.107788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:42.773756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.108074+0000","last_change":"2023-10-09T11:40:51.108021+0000","last_active":"2023-10-09T11:40:51.108074+0000","last_peered":"2023-10-09T11:40:51.108074+0000","last_clean":"2023-10-09T11:40:51.108074+0000","last_became_active":"2023-10-09T11:40:51.107788+0000","last_became_peered":"2023-10-09T11:40:51.107788+0000","last_unstale":"2023-10-09T11:40:51.108074+0000","last_undegraded":"2023-10-09T11:40:51.108074+0000","last_fullsized":"2023-10-09T11:40:51.108074+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:17.562435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108487+0000","last_change":"2023-10-09T11:40:52.108487+0000","last_active":"2023-10-09T11:40:52.108487+0000","last_peered":"2023-10-09T11:40:52.108487+0000","last_clean":"2023-10-09T11:40:52.108487+0000","last_became_active":"2023-10-09T11:40:52.108106+0000","last_became_peered":"2023-10-09T11:40:52.108106+0000","last_unstale":"2023-10-09T11:40:52.108487+0000","last_undegraded":"2023-10-09T11:40:52.108487+0000","last_fullsized":"2023-10-09T11:40:52.108487+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:35:36.970112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"94'3","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.115390+0000","last_change":"2023-10-09T11:40:51.103850+0000","last_active":"2023-10-09T11:40:52.115390+0000","last_peered":"2023-10-09T11:40:52.115390+0000","last_clean":"2023-10-09T11:40:52.115390+0000","last_became_active":"2023-10-09T11:40:51.103546+0000","last_became_peered":"2023-10-09T11:40:51.103546+0000","last_unstale":"2023-10-09T11:40:52.115390+0000","last_undegraded":"2023-10-09T11:40:52.115390+0000","last_fullsized":"2023-10-09T11:40:52.115390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:15.864847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100543+0000","last_change":"2023-10-09T11:40:52.100166+0000","last_active":"2023-10-09T11:40:52.100543+0000","last_peered":"2023-10-09T11:40:52.100543+0000","last_clean":"2023-10-09T11:40:52.100543+0000","last_became_active":"2023-10-09T11:40:52.099890+0000","last_became_peered":"2023-10-09T11:40:52.099890+0000","last_unstale":"2023-10-09T11:40:52.100543+0000","last_undegraded":"2023-10-09T11:40:52.100543+0000","last_fullsized":"2023-10-09T11:40:52.100543+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:42.773756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"94'6","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117950+0000","last_change":"2023-10-09T11:40:51.103195+0000","last_active":"2023-10-09T11:40:52.117950+0000","last_peered":"2023-10-09T11:40:52.117950+0000","last_clean":"2023-10-09T11:40:52.117950+0000","last_became_active":"2023-10-09T11:40:51.102764+0000","last_became_peered":"2023-10-09T11:40:51.102764+0000","last_unstale":"2023-10-09T11:40:52.117950+0000","last_undegraded":"2023-10-09T11:40:52.117950+0000","last_fullsized":"2023-10-09T11:40:52.117950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:55:59.759732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102755+0000","last_change":"2023-10-09T11:40:52.102755+0000","last_active":"2023-10-09T11:40:52.102755+0000","last_peered":"2023-10-09T11:40:52.102755+0000","last_clean":"2023-10-09T11:40:52.102755+0000","last_became_active":"2023-10-09T11:40:52.102157+0000","last_became_peered":"2023-10-09T11:40:52.102157+0000","last_unstale":"2023-10-09T11:40:52.102755+0000","last_undegraded":"2023-10-09T11:40:52.102755+0000","last_fullsized":"2023-10-09T11:40:52.102755+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:54:28.886681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112362+0000","last_change":"2023-10-09T11:40:51.100321+0000","last_active":"2023-10-09T11:40:52.112362+0000","last_peered":"2023-10-09T11:40:52.112362+0000","last_clean":"2023-10-09T11:40:52.112362+0000","last_became_active":"2023-10-09T11:40:51.100117+0000","last_became_peered":"2023-10-09T11:40:51.100117+0000","last_unstale":"2023-10-09T11:40:52.112362+0000","last_undegraded":"2023-10-09T11:40:52.112362+0000","last_fullsized":"2023-10-09T11:40:52.112362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:32:20.339471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109179+0000","last_change":"2023-10-09T11:40:52.109179+0000","last_active":"2023-10-09T11:40:52.109179+0000","last_peered":"2023-10-09T11:40:52.109179+0000","last_clean":"2023-10-09T11:40:52.109179+0000","last_became_active":"2023-10-09T11:40:52.108416+0000","last_became_peered":"2023-10-09T11:40:52.108416+0000","last_unstale":"2023-10-09T11:40:52.109179+0000","last_undegraded":"2023-10-09T11:40:52.109179+0000","last_fullsized":"2023-10-09T11:40:52.109179+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.285306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.099532+0000","last_change":"2023-10-09T11:40:51.099483+0000","last_active":"2023-10-09T11:40:51.099532+0000","last_peered":"2023-10-09T11:40:51.099532+0000","last_clean":"2023-10-09T11:40:51.099532+0000","last_became_active":"2023-10-09T11:40:51.098933+0000","last_became_peered":"2023-10-09T11:40:51.098933+0000","last_unstale":"2023-10-09T11:40:51.099532+0000","last_undegraded":"2023-10-09T11:40:51.099532+0000","last_fullsized":"2023-10-09T11:40:51.099532+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:53.777336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108152+0000","last_change":"2023-10-09T11:40:52.108152+0000","last_active":"2023-10-09T11:40:52.108152+0000","last_peered":"2023-10-09T11:40:52.108152+0000","last_clean":"2023-10-09T11:40:52.108152+0000","last_became_active":"2023-10-09T11:40:52.107604+0000","last_became_peered":"2023-10-09T11:40:52.107604+0000","last_unstale":"2023-10-09T11:40:52.108152+0000","last_undegraded":"2023-10-09T11:40:52.108152+0000","last_fullsized":"2023-10-09T11:40:52.108152+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:18.566407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.097237+0000","last_change":"2023-10-09T11:40:51.107968+0000","last_active":"2023-10-09T11:40:52.097237+0000","last_peered":"2023-10-09T11:40:52.097237+0000","last_clean":"2023-10-09T11:40:52.097237+0000","last_became_active":"2023-10-09T11:40:51.107711+0000","last_became_peered":"2023-10-09T11:40:51.107711+0000","last_unstale":"2023-10-09T11:40:52.097237+0000","last_undegraded":"2023-10-09T11:40:52.097237+0000","last_fullsized":"2023-10-09T11:40:52.097237+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:03.478388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109492+0000","last_change":"2023-10-09T11:40:52.109492+0000","last_active":"2023-10-09T11:40:52.109492+0000","last_peered":"2023-10-09T11:40:52.109492+0000","last_clean":"2023-10-09T11:40:52.109492+0000","last_became_active":"2023-10-09T11:40:52.108933+0000","last_became_peered":"2023-10-09T11:40:52.108933+0000","last_unstale":"2023-10-09T11:40:52.109492+0000","last_undegraded":"2023-10-09T11:40:52.109492+0000","last_fullsized":"2023-10-09T11:40:52.109492+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:47:16.868819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"94'8","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.117143+0000","last_change":"2023-10-09T11:40:51.104258+0000","last_active":"2023-10-09T11:40:52.117143+0000","last_peered":"2023-10-09T11:40:52.117143+0000","last_clean":"2023-10-09T11:40:52.117143+0000","last_became_active":"2023-10-09T11:40:51.104024+0000","last_became_peered":"2023-10-09T11:40:51.104024+0000","last_unstale":"2023-10-09T11:40:52.117143+0000","last_undegraded":"2023-10-09T11:40:52.117143+0000","last_fullsized":"2023-10-09T11:40:52.117143+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:36:30.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.105993+0000","last_change":"2023-10-09T11:40:52.105993+0000","last_active":"2023-10-09T11:40:52.105993+0000","last_peered":"2023-10-09T11:40:52.105993+0000","last_clean":"2023-10-09T11:40:52.105993+0000","last_became_active":"2023-10-09T11:40:52.105772+0000","last_became_peered":"2023-10-09T11:40:52.105772+0000","last_unstale":"2023-10-09T11:40:52.105993+0000","last_undegraded":"2023-10-09T11:40:52.105993+0000","last_fullsized":"2023-10-09T11:40:52.105993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:51:15.963559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"94'1","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.103013+0000","last_change":"2023-10-09T11:40:51.104870+0000","last_active":"2023-10-09T11:40:52.103013+0000","last_peered":"2023-10-09T11:40:52.103013+0000","last_clean":"2023-10-09T11:40:52.103013+0000","last_became_active":"2023-10-09T11:40:51.104236+0000","last_became_peered":"2023-10-09T11:40:51.104236+0000","last_unstale":"2023-10-09T11:40:52.103013+0000","last_undegraded":"2023-10-09T11:40:52.103013+0000","last_fullsized":"2023-10-09T11:40:52.103013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:03.967737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106229+0000","last_change":"2023-10-09T11:40:52.106229+0000","last_active":"2023-10-09T11:40:52.106229+0000","last_peered":"2023-10-09T11:40:52.106229+0000","last_clean":"2023-10-09T11:40:52.106229+0000","last_became_active":"2023-10-09T11:40:52.105993+0000","last_became_peered":"2023-10-09T11:40:52.105993+0000","last_unstale":"2023-10-09T11:40:52.106229+0000","last_undegraded":"2023-10-09T11:40:52.106229+0000","last_fullsized":"2023-10-09T11:40:52.106229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.116691+0000","last_change":"2023-10-09T11:40:51.106514+0000","last_active":"2023-10-09T11:40:52.116691+0000","last_peered":"2023-10-09T11:40:52.116691+0000","last_clean":"2023-10-09T11:40:52.116691+0000","last_became_active":"2023-10-09T11:40:51.106251+0000","last_became_peered":"2023-10-09T11:40:51.106251+0000","last_unstale":"2023-10-09T11:40:52.116691+0000","last_undegraded":"2023-10-09T11:40:52.116691+0000","last_fullsized":"2023-10-09T11:40:52.116691+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:10:25.869197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112391+0000","last_change":"2023-10-09T11:40:52.112298+0000","last_active":"2023-10-09T11:40:52.112391+0000","last_peered":"2023-10-09T11:40:52.112391+0000","last_clean":"2023-10-09T11:40:52.112391+0000","last_became_active":"2023-10-09T11:40:52.111110+0000","last_became_peered":"2023-10-09T11:40:52.111110+0000","last_unstale":"2023-10-09T11:40:52.112391+0000","last_undegraded":"2023-10-09T11:40:52.112391+0000","last_fullsized":"2023-10-09T11:40:52.112391+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:07.215810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101732+0000","last_change":"2023-10-09T11:40:51.101669+0000","last_active":"2023-10-09T11:40:51.101732+0000","last_peered":"2023-10-09T11:40:51.101732+0000","last_clean":"2023-10-09T11:40:51.101732+0000","last_became_active":"2023-10-09T11:40:51.101427+0000","last_became_peered":"2023-10-09T11:40:51.101427+0000","last_unstale":"2023-10-09T11:40:51.101732+0000","last_undegraded":"2023-10-09T11:40:51.101732+0000","last_fullsized":"2023-10-09T11:40:51.101732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:13.929873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113278+0000","last_change":"2023-10-09T11:40:52.112925+0000","last_active":"2023-10-09T11:40:52.113278+0000","last_peered":"2023-10-09T11:40:52.113278+0000","last_clean":"2023-10-09T11:40:52.113278+0000","last_became_active":"2023-10-09T11:40:52.110656+0000","last_became_peered":"2023-10-09T11:40:52.110656+0000","last_unstale":"2023-10-09T11:40:52.113278+0000","last_undegraded":"2023-10-09T11:40:52.113278+0000","last_fullsized":"2023-10-09T11:40:52.113278+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:03:48.739490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109794+0000","last_change":"2023-10-09T11:40:51.099442+0000","last_active":"2023-10-09T11:40:52.109794+0000","last_peered":"2023-10-09T11:40:52.109794+0000","last_clean":"2023-10-09T11:40:52.109794+0000","last_became_active":"2023-10-09T11:40:51.099199+0000","last_became_peered":"2023-10-09T11:40:51.099199+0000","last_unstale":"2023-10-09T11:40:52.109794+0000","last_undegraded":"2023-10-09T11:40:52.109794+0000","last_fullsized":"2023-10-09T11:40:52.109794+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:39:41.769784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106212+0000","last_change":"2023-10-09T11:40:52.105765+0000","last_active":"2023-10-09T11:40:52.106212+0000","last_peered":"2023-10-09T11:40:52.106212+0000","last_clean":"2023-10-09T11:40:52.106212+0000","last_became_active":"2023-10-09T11:40:52.105540+0000","last_became_peered":"2023-10-09T11:40:52.105540+0000","last_unstale":"2023-10-09T11:40:52.106212+0000","last_undegraded":"2023-10-09T11:40:52.106212+0000","last_fullsized":"2023-10-09T11:40:52.106212+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:54.781308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100485+0000","last_change":"2023-10-09T11:40:51.098517+0000","last_active":"2023-10-09T11:40:52.100485+0000","last_peered":"2023-10-09T11:40:52.100485+0000","last_clean":"2023-10-09T11:40:52.100485+0000","last_became_active":"2023-10-09T11:40:51.098190+0000","last_became_peered":"2023-10-09T11:40:51.098190+0000","last_unstale":"2023-10-09T11:40:52.100485+0000","last_undegraded":"2023-10-09T11:40:52.100485+0000","last_fullsized":"2023-10-09T11:40:52.100485+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:43:46.355088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.109205+0000","last_change":"2023-10-09T11:40:52.109071+0000","last_active":"2023-10-09T11:40:52.109205+0000","last_peered":"2023-10-09T11:40:52.109205+0000","last_clean":"2023-10-09T11:40:52.109205+0000","last_became_active":"2023-10-09T11:40:52.108727+0000","last_became_peered":"2023-10-09T11:40:52.108727+0000","last_unstale":"2023-10-09T11:40:52.109205+0000","last_undegraded":"2023-10-09T11:40:52.109205+0000","last_fullsized":"2023-10-09T11:40:52.109205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:56.414842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.100702+0000","last_change":"2023-10-09T11:40:51.100980+0000","last_active":"2023-10-09T11:40:52.100702+0000","last_peered":"2023-10-09T11:40:52.100702+0000","last_clean":"2023-10-09T11:40:52.100702+0000","last_became_active":"2023-10-09T11:40:51.100760+0000","last_became_peered":"2023-10-09T11:40:51.100760+0000","last_unstale":"2023-10-09T11:40:52.100702+0000","last_undegraded":"2023-10-09T11:40:52.100702+0000","last_fullsized":"2023-10-09T11:40:52.100702+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:38:00.573301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099366+0000","last_change":"2023-10-09T11:40:52.099200+0000","last_active":"2023-10-09T11:40:52.099366+0000","last_peered":"2023-10-09T11:40:52.099366+0000","last_clean":"2023-10-09T11:40:52.099366+0000","last_became_active":"2023-10-09T11:40:52.098966+0000","last_became_peered":"2023-10-09T11:40:52.098966+0000","last_unstale":"2023-10-09T11:40:52.099366+0000","last_undegraded":"2023-10-09T11:40:52.099366+0000","last_fullsized":"2023-10-09T11:40:52.099366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:15:26.740273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.099679+0000","last_change":"2023-10-09T11:40:51.099618+0000","last_active":"2023-10-09T11:40:51.099679+0000","last_peered":"2023-10-09T11:40:51.099679+0000","last_clean":"2023-10-09T11:40:51.099679+0000","last_became_active":"2023-10-09T11:40:51.099238+0000","last_became_peered":"2023-10-09T11:40:51.099238+0000","last_unstale":"2023-10-09T11:40:51.099679+0000","last_undegraded":"2023-10-09T11:40:51.099679+0000","last_fullsized":"2023-10-09T11:40:51.099679+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:21:51.520505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099314+0000","last_change":"2023-10-09T11:40:52.099133+0000","last_active":"2023-10-09T11:40:52.099314+0000","last_peered":"2023-10-09T11:40:52.099314+0000","last_clean":"2023-10-09T11:40:52.099314+0000","last_became_active":"2023-10-09T11:40:52.098896+0000","last_became_peered":"2023-10-09T11:40:52.098896+0000","last_unstale":"2023-10-09T11:40:52.099314+0000","last_undegraded":"2023-10-09T11:40:52.099314+0000","last_fullsized":"2023-10-09T11:40:52.099314+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:10:38.315042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"94'2","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.113328+0000","last_change":"2023-10-09T11:40:51.107393+0000","last_active":"2023-10-09T11:40:52.113328+0000","last_peered":"2023-10-09T11:40:52.113328+0000","last_clean":"2023-10-09T11:40:52.113328+0000","last_became_active":"2023-10-09T11:40:51.106531+0000","last_became_peered":"2023-10-09T11:40:51.106531+0000","last_unstale":"2023-10-09T11:40:52.113328+0000","last_undegraded":"2023-10-09T11:40:52.113328+0000","last_fullsized":"2023-10-09T11:40:52.113328+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:09.422117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.108885+0000","last_change":"2023-10-09T11:40:52.108885+0000","last_active":"2023-10-09T11:40:52.108885+0000","last_peered":"2023-10-09T11:40:52.108885+0000","last_clean":"2023-10-09T11:40:52.108885+0000","last_became_active":"2023-10-09T11:40:52.108637+0000","last_became_peered":"2023-10-09T11:40:52.108637+0000","last_unstale":"2023-10-09T11:40:52.108885+0000","last_undegraded":"2023-10-09T11:40:52.108885+0000","last_fullsized":"2023-10-09T11:40:52.108885+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:31.220453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.100066+0000","last_change":"2023-10-09T11:40:51.099918+0000","last_active":"2023-10-09T11:40:51.100066+0000","last_peered":"2023-10-09T11:40:51.100066+0000","last_clean":"2023-10-09T11:40:51.100066+0000","last_became_active":"2023-10-09T11:40:51.099553+0000","last_became_peered":"2023-10-09T11:40:51.099553+0000","last_unstale":"2023-10-09T11:40:51.100066+0000","last_undegraded":"2023-10-09T11:40:51.100066+0000","last_fullsized":"2023-10-09T11:40:51.100066+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:24.766508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.111494+0000","last_change":"2023-10-09T11:40:52.111494+0000","last_active":"2023-10-09T11:40:52.111494+0000","last_peered":"2023-10-09T11:40:52.111494+0000","last_clean":"2023-10-09T11:40:52.111494+0000","last_became_active":"2023-10-09T11:40:52.111254+0000","last_became_peered":"2023-10-09T11:40:52.111254+0000","last_unstale":"2023-10-09T11:40:52.111494+0000","last_undegraded":"2023-10-09T11:40:52.111494+0000","last_fullsized":"2023-10-09T11:40:52.111494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:25.030282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101922+0000","last_change":"2023-10-09T11:40:51.100312+0000","last_active":"2023-10-09T11:40:51.101922+0000","last_peered":"2023-10-09T11:40:51.101922+0000","last_clean":"2023-10-09T11:40:51.101922+0000","last_became_active":"2023-10-09T11:40:51.100117+0000","last_became_peered":"2023-10-09T11:40:51.100117+0000","last_unstale":"2023-10-09T11:40:51.101922+0000","last_undegraded":"2023-10-09T11:40:51.101922+0000","last_fullsized":"2023-10-09T11:40:51.101922+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:29:43.604507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110428+0000","last_change":"2023-10-09T11:40:52.110342+0000","last_active":"2023-10-09T11:40:52.110428+0000","last_peered":"2023-10-09T11:40:52.110428+0000","last_clean":"2023-10-09T11:40:52.110428+0000","last_became_active":"2023-10-09T11:40:52.109943+0000","last_became_peered":"2023-10-09T11:40:52.109943+0000","last_unstale":"2023-10-09T11:40:52.110428+0000","last_undegraded":"2023-10-09T11:40:52.110428+0000","last_fullsized":"2023-10-09T11:40:52.110428+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:01.404908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.104021+0000","last_change":"2023-10-09T11:40:51.103959+0000","last_active":"2023-10-09T11:40:51.104021+0000","last_peered":"2023-10-09T11:40:51.104021+0000","last_clean":"2023-10-09T11:40:51.104021+0000","last_became_active":"2023-10-09T11:40:51.103735+0000","last_became_peered":"2023-10-09T11:40:51.103735+0000","last_unstale":"2023-10-09T11:40:51.104021+0000","last_undegraded":"2023-10-09T11:40:51.104021+0000","last_fullsized":"2023-10-09T11:40:51.104021+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:25.369194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.106274+0000","last_change":"2023-10-09T11:40:52.106210+0000","last_active":"2023-10-09T11:40:52.106274+0000","last_peered":"2023-10-09T11:40:52.106274+0000","last_clean":"2023-10-09T11:40:52.106274+0000","last_became_active":"2023-10-09T11:40:52.105985+0000","last_became_peered":"2023-10-09T11:40:52.105985+0000","last_unstale":"2023-10-09T11:40:52.106274+0000","last_undegraded":"2023-10-09T11:40:52.106274+0000","last_fullsized":"2023-10-09T11:40:52.106274+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:07.686846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.105784+0000","last_change":"2023-10-09T11:40:51.105722+0000","last_active":"2023-10-09T11:40:51.105784+0000","last_peered":"2023-10-09T11:40:51.105784+0000","last_clean":"2023-10-09T11:40:51.105784+0000","last_became_active":"2023-10-09T11:40:51.105471+0000","last_became_peered":"2023-10-09T11:40:51.105471+0000","last_unstale":"2023-10-09T11:40:51.105784+0000","last_undegraded":"2023-10-09T11:40:51.105784+0000","last_fullsized":"2023-10-09T11:40:51.105784+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:00.402871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102905+0000","last_change":"2023-10-09T11:40:52.102905+0000","last_active":"2023-10-09T11:40:52.102905+0000","last_peered":"2023-10-09T11:40:52.102905+0000","last_clean":"2023-10-09T11:40:52.102905+0000","last_became_active":"2023-10-09T11:40:52.102472+0000","last_became_peered":"2023-10-09T11:40:52.102472+0000","last_unstale":"2023-10-09T11:40:52.102905+0000","last_undegraded":"2023-10-09T11:40:52.102905+0000","last_fullsized":"2023-10-09T11:40:52.102905+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.099199+0000","last_change":"2023-10-09T11:40:51.106312+0000","last_active":"2023-10-09T11:40:52.099199+0000","last_peered":"2023-10-09T11:40:52.099199+0000","last_clean":"2023-10-09T11:40:52.099199+0000","last_became_active":"2023-10-09T11:40:51.105864+0000","last_became_peered":"2023-10-09T11:40:51.105864+0000","last_unstale":"2023-10-09T11:40:52.099199+0000","last_undegraded":"2023-10-09T11:40:52.099199+0000","last_fullsized":"2023-10-09T11:40:52.099199+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:31.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.104745+0000","last_change":"2023-10-09T11:40:52.104745+0000","last_active":"2023-10-09T11:40:52.104745+0000","last_peered":"2023-10-09T11:40:52.104745+0000","last_clean":"2023-10-09T11:40:52.104745+0000","last_became_active":"2023-10-09T11:40:52.104473+0000","last_became_peered":"2023-10-09T11:40:52.104473+0000","last_unstale":"2023-10-09T11:40:52.104745+0000","last_undegraded":"2023-10-09T11:40:52.104745+0000","last_fullsized":"2023-10-09T11:40:52.104745+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:07.686846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.105112+0000","last_change":"2023-10-09T11:40:51.105018+0000","last_active":"2023-10-09T11:40:51.105112+0000","last_peered":"2023-10-09T11:40:51.105112+0000","last_clean":"2023-10-09T11:40:51.105112+0000","last_became_active":"2023-10-09T11:40:51.104536+0000","last_became_peered":"2023-10-09T11:40:51.104536+0000","last_unstale":"2023-10-09T11:40:51.105112+0000","last_undegraded":"2023-10-09T11:40:51.105112+0000","last_fullsized":"2023-10-09T11:40:51.105112+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:59:26.547035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.110371+0000","last_change":"2023-10-09T11:40:52.110371+0000","last_active":"2023-10-09T11:40:52.110371+0000","last_peered":"2023-10-09T11:40:52.110371+0000","last_clean":"2023-10-09T11:40:52.110371+0000","last_became_active":"2023-10-09T11:40:52.109750+0000","last_became_peered":"2023-10-09T11:40:52.109750+0000","last_unstale":"2023-10-09T11:40:52.110371+0000","last_undegraded":"2023-10-09T11:40:52.110371+0000","last_fullsized":"2023-10-09T11:40:52.110371+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:33.216407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.098573+0000","last_change":"2023-10-09T11:40:51.102983+0000","last_active":"2023-10-09T11:40:52.098573+0000","last_peered":"2023-10-09T11:40:52.098573+0000","last_clean":"2023-10-09T11:40:52.098573+0000","last_became_active":"2023-10-09T11:40:51.102750+0000","last_became_peered":"2023-10-09T11:40:51.102750+0000","last_unstale":"2023-10-09T11:40:52.098573+0000","last_undegraded":"2023-10-09T11:40:52.098573+0000","last_fullsized":"2023-10-09T11:40:52.098573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:48:40.402368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.112540+0000","last_change":"2023-10-09T11:40:52.112540+0000","last_active":"2023-10-09T11:40:52.112540+0000","last_peered":"2023-10-09T11:40:52.112540+0000","last_clean":"2023-10-09T11:40:52.112540+0000","last_became_active":"2023-10-09T11:40:52.109187+0000","last_became_peered":"2023-10-09T11:40:52.109187+0000","last_unstale":"2023-10-09T11:40:52.112540+0000","last_undegraded":"2023-10-09T11:40:52.112540+0000","last_fullsized":"2023-10-09T11:40:52.112540+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:51.084614+0000","last_clean_scrub_stamp":"2023-10-09T11:40:51.084614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:26.373166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"94'1","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-09T11:40:52.102173+0000","last_change":"2023-10-09T11:40:51.102981+0000","last_active":"2023-10-09T11:40:52.102173+0000","last_peered":"2023-10-09T11:40:52.102173+0000","last_clean":"2023-10-09T11:40:52.102173+0000","last_became_active":"2023-10-09T11:40:51.102754+0000","last_became_peered":"2023-10-09T11:40:51.102754+0000","last_unstale":"2023-10-09T11:40:52.102173+0000","last_undegraded":"2023-10-09T11:40:52.102173+0000","last_fullsized":"2023-10-09T11:40:52.102173+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:40:50.080642+0000","last_clean_scrub_stamp":"2023-10-09T11:40:50.080642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:54:00.677588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-09T11:40:51.101079+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:40:51.101079+0000","last_peered":"2023-10-09T11:40:51.101079+0000","last_clean":"2023-10-09T11:40:51.101079+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:40:51.101079+0000","last_undegraded":"2023-10-09T11:40:51.101079+0000","last_fullsized":"2023-10-09T11:40:51.101079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1068,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194243,"statfs":{"total":200000000,"available":198905517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.745,"15min":0.745},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.32700000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"min":{"1min":0.46899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.372},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.45900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.75900000000000001,"5min":0.878,"15min":0.878},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":1.048,"15min":1.048},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75600000000000001,"5min":1.079,"15min":1.079},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.441},"min":{"1min":0.307,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.61899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.436}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46700000000000003,"15min":0.45900000000000002},"min":{"1min":0.32300000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68700000000000006,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.54400000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.622,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.435,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194819,"statfs":{"total":200000000,"available":199495289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.63},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.621,"15min":0.70099999999999996},"min":{"1min":0.39000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.746,"5min":5.298,"15min":5.298},"last":0.625},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60999999999999999,"15min":0.68600000000000005},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70299999999999996,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.52500000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78200000000000003,"5min":1.617,"15min":1.617},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.63400000000000001,"15min":0.71199999999999997},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":5.46,"15min":5.46},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65000000000000002,"15min":0.73399999999999999},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.74299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.32600000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60499999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34100000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.504},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:39:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.314,"15min":0.314},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194820,"statfs":{"total":200000000,"available":199495761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.40100000000000002},"min":{"1min":0.22,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.442,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.41599999999999998,"15min":0.44900000000000001},"min":{"1min":0.249,"5min":0.247,"15min":0.247},"max":{"1min":0.55200000000000005,"5min":2.004,"15min":2.004},"last":0.307}]},{"osd":2,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.39500000000000002,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45500000000000002,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56100000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46200000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.625,"5min":1.909,"15min":1.909},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.442,"15min":0.46800000000000003},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.53500000000000003,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.35199999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60699999999999998,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61799999999999999,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73999999999999999,"5min":1.869,"15min":1.869},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86599999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.43099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.755,"5min":1.952,"15min":1.952},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94999999999999996,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.82599999999999996,"5min":1.782,"15min":1.782},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67000000000000004,"15min":0.68200000000000005},"min":{"1min":0.48699999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89200000000000002,"5min":1.819,"15min":1.819},"last":0.47099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1067,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194244,"statfs":{"total":200000000,"available":198906564,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.38900000000000001},"min":{"1min":0.25900000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.53400000000000003,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38600000000000001},"min":{"1min":0.29499999999999998,"5min":0.22,"15min":0.22},"max":{"1min":0.58699999999999997,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.64100000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41099999999999998,"15min":0.40400000000000003},"min":{"1min":0.28000000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44500000000000001,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57299999999999995,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72599999999999998,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":1.282,"15min":1.282},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.70199999999999996},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84899999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65200000000000002,"15min":0.70199999999999996},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88800000000000001,"5min":3.976,"15min":3.976},"last":0.62},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.47399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90600000000000003,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":1.524,"15min":1.524},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91000000000000003,"5min":1.254,"15min":1.254},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 11:40:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95699999999999996,"5min":1.22,"15min":1.22},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.77700000000000002},"min":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194819,"statfs":{"total":200000000,"available":199495401,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33600000000000002,"15min":0.316},"min":{"1min":0.248,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.34499999999999997},"min":{"1min":0.26900000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52700000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.629,"15min":0.85599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60299999999999998,"5min":11.055,"15min":11.055},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.622,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.39000000000000001},"min":{"1min":0.309,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57599999999999996,"5min":0.62,"15min":0.62},"last":0.434}]},{"osd":4,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.44700000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.45800000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96199999999999997,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.253,"5min":0.19,"15min":0.19},"max":{"1min":0.57099999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.39600000000000002},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54900000000000004,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.376},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":1.034,"15min":1.034},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.28599999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":1.335,"15min":1.335},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40799999999999997,"15min":0.41199999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.68999999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.46700000000000003},"min":{"1min":0.29399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64100000000000001,"5min":1.405,"15min":1.405},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76100000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.499,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.74099999999999999,"5min":1.387,"15min":1.387},"last":0.44600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.47799999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82999999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.50700000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.53400000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.45900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":492,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194820,"statfs":{"total":200000000,"available":199495955,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.66500000000000004,"15min":0.77700000000000002},"min":{"1min":0.32100000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71399999999999997,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.70199999999999996,"15min":0.82999999999999996},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81100000000000005,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55100000000000005,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.53200000000000003},"min":{"1min":0.38300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57799999999999996,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.623,"15min":0.71699999999999997},"min":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":5.274,"15min":5.274},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.70099999999999996,"15min":0.82799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.71999999999999997,"15min":0.84999999999999998},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.77400000000000002,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59399999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73899999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70699999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194818,"statfs":{"total":200000000,"available":199494397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.37},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.61799999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.623},{"interface":"front","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66700000000000004,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68999999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68700000000000006,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.49399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.65600000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42799999999999999,"15min":0.435},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47099999999999997,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46200000000000002,"15min":0.48099999999999998},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66700000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64300000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.65400000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59699999999999998}]}]}],"pool_statfs":[]}} 2023-10-09T11:40:56.601 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:40:56.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:40:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.761+0000 7fa5f14ab700 1 Processor -- start 2023-10-09T11:40:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.761+0000 7fa5f14ab700 1 -- start start 2023-10-09T11:40:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5f14ab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5ec1577c0 0x7fa5ec068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5f14ab700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5ec0cbea0 0x7fa5ec068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5f14ab700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec0cca80 con 0x7fa5ec157b90 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5f14ab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec0cc2e0 con 0x7fa5ec1577c0 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5f14ab700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec0cedd0 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5ec1577c0 0x7fa5ec068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5ec1577c0 0x7fa5ec068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37636/0 (socket says 172.21.15.6:37636) 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.762+0000 7fa5eaffd700 1 -- 172.21.15.6:0/4251549081 learned_addr learned my addr 172.21.15.6:0/4251549081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eb7fe700 1 --2- 172.21.15.6:0/4251549081 >> v2:172.21.15.118:3300/0 conn(0x7fa5ec0cbea0 0x7fa5ec068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eaffd700 1 -- 172.21.15.6:0/4251549081 >> v2:172.21.15.118:3300/0 conn(0x7fa5ec0cbea0 msgr2=0x7fa5ec068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eaffd700 1 --2- 172.21.15.6:0/4251549081 >> v2:172.21.15.118:3300/0 conn(0x7fa5ec0cbea0 0x7fa5ec068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eaffd700 1 -- 172.21.15.6:0/4251549081 >> v1:172.21.15.118:6789/0 conn(0x7fa5ec157b90 legacy=0x7fa5ec0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eaffd700 1 -- 172.21.15.6:0/4251549081 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0cc4c0 con 0x7fa5ec1577c0 2023-10-09T11:40:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5eaffd700 1 --2- 172.21.15.6:0/4251549081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec1577c0 0x7fa5ec068810 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec06fc40 tx=0x7fa5e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884bfd7648acfd75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5e9ffb700 1 -- 172.21.15.6:0/4251549081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400e070 con 0x7fa5ec1577c0 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5e9ffb700 1 -- 172.21.15.6:0/4251549081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400ba20 con 0x7fa5ec1577c0 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5e9ffb700 1 -- 172.21.15.6:0/4251549081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40092e0 con 0x7fa5ec1577c0 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.763+0000 7fa5f14ab700 1 -- 172.21.15.6:0/4251549081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec1577c0 msgr2=0x7fa5ec068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/4251549081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec1577c0 0x7fa5ec068810 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec06fc40 tx=0x7fa5e4009840 comp rx=0 tx=0).stop 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 -- 172.21.15.6:0/4251549081 shutdown_connections 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/4251549081 >> v2:172.21.15.118:3300/0 conn(0x7fa5ec0cbea0 0x7fa5ec068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/4251549081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec1577c0 0x7fa5ec068810 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 -- 172.21.15.6:0/4251549081 >> 172.21.15.6:0/4251549081 conn(0x7fa5ec0d0df0 msgr2=0x7fa5ec0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 -- 172.21.15.6:0/4251549081 shutdown_connections 2023-10-09T11:40:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.764+0000 7fa5f14ab700 1 -- 172.21.15.6:0/4251549081 wait complete. 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.765+0000 7fa5f14ab700 1 Processor -- start 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.765+0000 7fa5f14ab700 1 -- start start 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 0x7fa5ec1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5ec1577c0 0x7fa5ec0b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec06e450 con 0x7fa5ec157b90 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec06e730 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec06ea10 con 0x7fa5ec1577c0 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 0x7fa5ec1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37640/0 (socket says 172.21.15.6:37640) 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eb7fe700 1 -- 172.21.15.6:0/187512412 learned_addr learned my addr 172.21.15.6:0/187512412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5ea7fc700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5ec1577c0 0x7fa5ec0b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 -- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5ec1577c0 msgr2=0x7fa5ec0b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5ec1577c0 0x7fa5ec0b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 -- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 msgr2=0x7fa5ec0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 -- 172.21.15.6:0/187512412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e4009ae0 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eb7fe700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5eaffd700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 0x7fa5ec1541d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4015000 tx=0x7fa5e4018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e40078f0 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4007a70 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.766+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec06ecf0 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.767+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4007e30 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.767+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec154710 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.767+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec06eb50 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.768+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5e4003040 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.768+0000 7fa5e2ffd700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.768+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5e4086000 con 0x7fa5ec0cbea0 2023-10-09T11:40:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.768+0000 7fa5ea7fc700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.769+0000 7fa5ea7fc700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 0x7fa5cc0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b39d0 tx=0x7fa5d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:56.773+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5ec06eb50 con 0x7fa5ec0cbea0 2023-10-09T11:40:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.047+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa5ec06eb50 con 0x7fa5ec0cbea0 2023-10-09T11:40:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.052+0000 7fa5e2ffd700 1 -- 172.21.15.6:0/187512412 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa5ec06eb50 con 0x7fa5ec0cbea0 2023-10-09T11:40:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 msgr2=0x7fa5cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 0x7fa5cc0693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b39d0 tx=0x7fa5d4009040 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 msgr2=0x7fa5ec1541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 0x7fa5ec1541d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4015000 tx=0x7fa5e4018000 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 shutdown_connections 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5ec157b90 0x7fa5ec0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0cbea0 0x7fa5ec1541d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 --2- 172.21.15.6:0/187512412 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5ec1577c0 0x7fa5ec0b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 >> 172.21.15.6:0/187512412 conn(0x7fa5ec0d0df0 msgr2=0x7fa5ec0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 shutdown_connections 2023-10-09T11:40:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.054+0000 7fa5f14ab700 1 -- 172.21.15.6:0/187512412 wait complete. 2023-10-09T11:40:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:40:57.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:40:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.185+0000 7f6df80d9700 1 Processor -- start 2023-10-09T11:40:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.185+0000 7f6df80d9700 1 -- start start 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df80d9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6df00b3bd0 0x7f6df00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df80d9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df00b2890 con 0x7f6df0157fe0 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df80d9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df00b4070 con 0x7f6df01583b0 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df80d9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00b4350 con 0x7f6df00b3bd0 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df5e75700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6df0157fe0 0x7f6df00b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60978/0 (socket says 172.21.15.6:60978) 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df5e75700 1 -- 172.21.15.6:0/1764019093 learned_addr learned my addr 172.21.15.6:0/1764019093 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df5674700 1 --2- 172.21.15.6:0/1764019093 >> v2:172.21.15.6:3300/0 conn(0x7f6df00b3bd0 0x7f6df00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df4e73700 1 -- 172.21.15.6:0/1764019093 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488615171 0 0) 0x7f6df00b2890 con 0x7f6df0157fe0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.186+0000 7f6df4e73700 1 -- 172.21.15.6:0/1764019093 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd8003570 con 0x7f6df0157fe0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df5674700 1 -- 172.21.15.6:0/1764019093 >> v1:172.21.15.118:6789/0 conn(0x7f6df01583b0 legacy=0x7f6df0158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df5674700 1 -- 172.21.15.6:0/1764019093 >> v1:172.21.15.6:6789/0 conn(0x7f6df0157fe0 legacy=0x7f6df00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df5674700 1 -- 172.21.15.6:0/1764019093 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00b4630 con 0x7f6df00b3bd0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df5674700 1 --2- 172.21.15.6:0/1764019093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df00b3bd0 0x7f6df00ceb30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6de40098e0 tx=0x7f6de40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e4c463c6a0a869 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df4e73700 1 -- 172.21.15.6:0/1764019093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400b640 con 0x7f6df00b3bd0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df4e73700 1 -- 172.21.15.6:0/1764019093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400b7a0 con 0x7f6df00b3bd0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df4e73700 1 -- 172.21.15.6:0/1764019093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400bb40 con 0x7f6df00b3bd0 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df80d9700 1 -- 172.21.15.6:0/1764019093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df00b3bd0 msgr2=0x7f6df00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df80d9700 1 --2- 172.21.15.6:0/1764019093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df00b3bd0 0x7f6df00ceb30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6de40098e0 tx=0x7f6de40091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df80d9700 1 -- 172.21.15.6:0/1764019093 shutdown_connections 2023-10-09T11:40:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df80d9700 1 --2- 172.21.15.6:0/1764019093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df00b3bd0 0x7f6df00ceb30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.187+0000 7f6df80d9700 1 -- 172.21.15.6:0/1764019093 >> 172.21.15.6:0/1764019093 conn(0x7f6df0067640 msgr2=0x7f6df0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.188+0000 7f6df80d9700 1 -- 172.21.15.6:0/1764019093 shutdown_connections 2023-10-09T11:40:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.188+0000 7f6df80d9700 1 -- 172.21.15.6:0/1764019093 wait complete. 2023-10-09T11:40:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 Processor -- start 2023-10-09T11:40:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 -- start start 2023-10-09T11:40:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6df00b3bd0 0x7f6df0159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6df01583b0 0x7f6df015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df016c130 con 0x7f6df0157fe0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df01599e0 con 0x7f6df00b3bd0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df80d9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df0159cc0 con 0x7f6df01583b0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df5674700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df5674700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37660/0 (socket says 172.21.15.6:37660) 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.189+0000 7f6df5674700 1 -- 172.21.15.6:0/3319968440 learned_addr learned my addr 172.21.15.6:0/3319968440 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5e75700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6df00b3bd0 0x7f6df0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df6676700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6df01583b0 0x7f6df015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 -- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6df01583b0 msgr2=0x7f6df015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6df01583b0 0x7f6df015ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 -- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6df00b3bd0 msgr2=0x7f6df0159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6df00b3bd0 0x7f6df0159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 -- 172.21.15.6:0/3319968440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4009420 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df5674700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6de4013000 tx=0x7f6de4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400bb20 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4011420 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df0159fa0 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40117a0 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.190+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df01596d0 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.191+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df016c2a0 con 0x7f6df0157fe0 2023-10-09T11:40:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.192+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6de4011b10 con 0x7f6df0157fe0 2023-10-09T11:40:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.192+0000 7f6dedffb700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.192+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6de4085880 con 0x7f6df0157fe0 2023-10-09T11:40:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.192+0000 7f6df5e75700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.193+0000 7f6df5e75700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6df01698a0 tx=0x7f6de8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.197+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de4052b70 con 0x7f6df0157fe0 2023-10-09T11:40:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.438+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6df004bb80 con 0x7f6df0157fe0 2023-10-09T11:40:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.439+0000 7f6dedffb700 1 -- 172.21.15.6:0/3319968440 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6de4056190 con 0x7f6df0157fe0 2023-10-09T11:40:57.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:40:57.441 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:40:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 msgr2=0x7f6ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6df01698a0 tx=0x7f6de8009040 comp rx=0 tx=0).stop 2023-10-09T11:40:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 msgr2=0x7f6df016c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6de4013000 tx=0x7f6de4017000 comp rx=0 tx=0).stop 2023-10-09T11:40:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 shutdown_connections 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6df01583b0 0x7f6df015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6df00b3bd0 0x7f6df0159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 --2- 172.21.15.6:0/3319968440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df0157fe0 0x7f6df016c5c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 >> 172.21.15.6:0/3319968440 conn(0x7f6df0067640 msgr2=0x7f6df00b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 shutdown_connections 2023-10-09T11:40:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.441+0000 7f6df80d9700 1 -- 172.21.15.6:0/3319968440 wait complete. 2023-10-09T11:40:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:40:57.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:40:51.494990+0000', 'modified': '2023-10-09T11:40:55.125039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6336': {'gid': 6336, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/2462389569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 2462389569}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 2462389569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:40:57.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:40:57.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:40:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.979+0000 7fd5cc975700 1 Processor -- start 2023-10-09T11:40:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.979+0000 7fd5cc975700 1 -- start start 2023-10-09T11:40:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5cc975700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5cc975700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80cee10 con 0x7fd5c8159f10 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5cc975700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80cd040 con 0x7fd5c8068e90 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5cc975700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80cd320 con 0x7fd5c8159b40 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5c6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5c8159f10 0x7fd5c8068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60982/0 (socket says 172.21.15.6:60982) 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/1468223254 learned_addr learned my addr 172.21.15.6:0/1468223254 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/1468223254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.980+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935463922 0 0) 0x7fd5c80cee10 con 0x7fd5c8159f10 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b0003570 con 0x7fd5c8159f10 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792125700 0 0) 0x7fd5c80cd040 con 0x7fd5c8068e90 2023-10-09T11:40:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c80cee10 con 0x7fd5c8068e90 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c77fe700 1 -- 172.21.15.6:0/1468223254 >> v1:172.21.15.118:6789/0 conn(0x7fd5c8068e90 legacy=0x7fd5c80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c77fe700 1 -- 172.21.15.6:0/1468223254 >> v1:172.21.15.6:6789/0 conn(0x7fd5c8159f10 legacy=0x7fd5c8068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2885303221 0 0) 0x7fd5b0003570 con 0x7fd5c8159f10 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c77fe700 1 -- 172.21.15.6:0/1468223254 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80ce7c0 con 0x7fd5c8159b40 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/1468223254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c80cc600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009910 tx=0x7fd5b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d54d9dca620cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc001470 con 0x7fd5c8159b40 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8011420 con 0x7fd5c8159b40 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.981+0000 7fd5c67fc700 1 -- 172.21.15.6:0/1468223254 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80117c0 con 0x7fd5c8159b40 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 -- 172.21.15.6:0/1468223254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 msgr2=0x7fd5c80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 --2- 172.21.15.6:0/1468223254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c80cc600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009910 tx=0x7fd5b80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 -- 172.21.15.6:0/1468223254 shutdown_connections 2023-10-09T11:40:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 --2- 172.21.15.6:0/1468223254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c80cc600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 -- 172.21.15.6:0/1468223254 >> 172.21.15.6:0/1468223254 conn(0x7fd5c80cd660 msgr2=0x7fd5c80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 -- 172.21.15.6:0/1468223254 shutdown_connections 2023-10-09T11:40:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.982+0000 7fd5cc975700 1 -- 172.21.15.6:0/1468223254 wait complete. 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.983+0000 7fd5cc975700 1 Processor -- start 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.983+0000 7fd5cc975700 1 -- start start 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c8156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5c8159f10 0x7fd5c8155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815b7f0 con 0x7fd5c8068e90 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8157de0 con 0x7fd5c8159f10 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5cc975700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81580c0 con 0x7fd5c8159b40 2023-10-09T11:40:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37664/0 (socket says 172.21.15.6:37664) 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 -- 172.21.15.6:0/3123663930 learned_addr learned my addr 172.21.15.6:0/3123663930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c8156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5c8159f10 0x7fd5c8155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 -- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 msgr2=0x7fd5c8156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c8156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 -- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5c8159f10 msgr2=0x7fd5c8155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5c8159f10 0x7fd5c8155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 -- 172.21.15.6:0/3123663930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8009420 con 0x7fd5c8068e90 2023-10-09T11:40:57.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80091e0 tx=0x7fd5b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5af7fe700 1 -- 172.21.15.6:0/3123663930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b801cb30 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.984+0000 7fd5af7fe700 1 -- 172.21.15.6:0/3123663930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b801cc90 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.985+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c81583a0 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.985+0000 7fd5af7fe700 1 -- 172.21.15.6:0/3123663930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b801a6a0 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.985+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c8154b70 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.986+0000 7fd5af7fe700 1 -- 172.21.15.6:0/3123663930 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5b801aa90 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.986+0000 7fd5af7fe700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 0x7fd5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.987+0000 7fd5af7fe700 1 -- 172.21.15.6:0/3123663930 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5b80862d0 con 0x7fd5c8068e90 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.987+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 0x7fd5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.987+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 0x7fd5b40693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8158ac0 tx=0x7fd5bc000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.988+0000 7fd5d6ecfb80 1 Processor -- start 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 -- start start 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b6567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b62cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b583a70 con 0x55765b62a5f0 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b581270 con 0x55765b62cb80 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55765b57d060 con 0x55765b677480 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37676/0 (socket says 172.21.15.6:37676) 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/3359981202 learned_addr learned my addr 172.21.15.6:0/3359981202 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b6567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.989+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b62cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 msgr2=0x55765b6567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b6567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 msgr2=0x55765b62cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b62cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/3359981202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55765b417270 con 0x55765b62a5f0 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00fc60 tx=0x7fd5bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54a7b40649c173c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:57.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5acff9700 1 -- 172.21.15.6:0/3359981202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc013700 con 0x55765b62a5f0 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5acff9700 1 -- 172.21.15.6:0/3359981202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc013860 con 0x55765b62a5f0 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.990+0000 7fd5acff9700 1 -- 172.21.15.6:0/3359981202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc013be0 con 0x55765b62a5f0 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/3359981202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 msgr2=0x55765b677850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00fc60 tx=0x7fd5bc014000 comp rx=0 tx=0).stop 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/3359981202 shutdown_connections 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b62cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b6567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/3359981202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b677850 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/3359981202 >> 172.21.15.6:0/3359981202 conn(0x55765b62e0c0 msgr2=0x55765b62e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/3359981202 shutdown_connections 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/3359981202 wait complete. 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.991+0000 7fd5d6ecfb80 1 -- start start 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 Processor -- start 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b657dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b655100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b528890 con 0x55765b62a5f0 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b543ea0 con 0x55765b62cb80 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55765b3ffe30 con 0x55765b677480 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5d6ecfb80 10 client.0 _ll_register_callbacks cb 0x55765b5f02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:58.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37678/0 (socket says 172.21.15.6:37678) 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5c77fe700 1 -- 172.21.15.6:0/2465435772 learned_addr learned my addr 172.21.15.6:0/2465435772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b657dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.992+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b655100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 -- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 msgr2=0x55765b655100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b655100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 -- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 msgr2=0x55765b657dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b657dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 -- 172.21.15.6:0/2465435772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc00f9b0 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009f00 tx=0x7fd5b8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8100af6c23f94916 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b805a450 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5b805c040 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55765b621cd0 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5b805e1a0 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 10 client.6468 fetch_fsmap learned FSMap version 52 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55765b3b9fe0 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55765b621cd0 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd5b8053910 con 0x55765b62a5f0 2023-10-09T11:40:58.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 10 client.6468 fetch_fsmap finished waiting for FSMap version 52 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 10 client.6468 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 20 client.6468 populate_metadata read hostname 'smithi006' 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b656ac0 0x55765b656e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 4 client.6468 mds_command: new command op to 6336 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.993+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 --> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55765b5feaa0 con 0x55765b656ac0 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.994+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b656ac0 0x55765b656e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.994+0000 7fd5a5ffb700 10 client.6468 ms_handle_connect on v2:172.21.15.118:6833/2462389569 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.994+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b656ac0 0x55765b656e90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f15a1382df60b1 server_cookie=3af4737321be39a9 in_seq=0 out_seq=0 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2465435772 <== mds.0 v2:172.21.15.118:6833/2462389569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55765b5feaa0 con 0x55765b656ac0 2023-10-09T11:40:58.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5a5ffb700 10 client.6468 handle_command_reply: tid=0 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 client.6468 shutdown 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 msgr2=0x55765b651050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009f00 tx=0x7fd5b8086040 comp rx=0 tx=0).stop 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 shutdown_connections 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b677480 0x55765b655100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62a5f0 0x55765b651050 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b656ac0 0x55765b656e90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2465435772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62cb80 0x55765b657dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5a5ffb700 0 client.6468 ms_handle_reset on v2:172.21.15.118:6833/2462389569 2023-10-09T11:40:58.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 >> 172.21.15.6:0/2465435772 conn(0x55765b62e0c0 msgr2=0x55765b630560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 shutdown_connections 2023-10-09T11:40:58.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2465435772 wait complete. 2023-10-09T11:40:58.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:57.995+0000 7fd5d6ecfb80 20 client.6468 trim_cache size 0 max 16384 2023-10-09T11:40:58.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.012+0000 7fd5d6ecfb80 1 Processor -- start 2023-10-09T11:40:58.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.012+0000 7fd5d6ecfb80 1 -- start start 2023-10-09T11:40:58.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 0x55765b652430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b677480 0x55765b6829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b62e530 con 0x55765b62cb80 2023-10-09T11:40:58.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b624390 con 0x55765b677480 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55765b62ae40 con 0x55765b62a5f0 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37694/0 (socket says 172.21.15.6:37694) 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/2881944176 learned_addr learned my addr 172.21.15.6:0/2881944176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b677480 0x55765b6829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 0x55765b652430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 msgr2=0x55765b652430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 0x55765b652430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b677480 msgr2=0x55765b6829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b677480 0x55765b6829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 -- 172.21.15.6:0/2881944176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55765b65a070 con 0x55765b62cb80 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 0x55765b652430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00fc30 tx=0x7fd5bc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99ae4a5e9c9d58f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5ad7fa700 1 -- 172.21.15.6:0/2881944176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0016e0 con 0x55765b62cb80 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5ad7fa700 1 -- 172.21.15.6:0/2881944176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0139d0 con 0x55765b62cb80 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.013+0000 7fd5ad7fa700 1 -- 172.21.15.6:0/2881944176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc013b40 con 0x55765b62cb80 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2881944176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 msgr2=0x55765b6824a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00fc30 tx=0x7fd5bc01e000 comp rx=0 tx=0).stop 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2881944176 shutdown_connections 2023-10-09T11:40:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b677480 0x55765b6829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62a5f0 0x55765b652430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2881944176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b62cb80 0x55765b6824a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2881944176 >> 172.21.15.6:0/2881944176 conn(0x55765b62e0c0 msgr2=0x55765b654d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2881944176 shutdown_connections 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.014+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2881944176 wait complete. 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 -- start start 2023-10-09T11:40:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 Processor -- start 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62a5f0 0x55765b6851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62cb80 0x55765b655e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b623280 con 0x55765b677480 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55765b623910 con 0x55765b62a5f0 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55765b623f20 con 0x55765b62cb80 2023-10-09T11:40:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.015+0000 7fd5d6ecfb80 10 client.0 _ll_register_callbacks cb 0x55765b5f02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37706/0 (socket says 172.21.15.6:37706) 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62a5f0 0x55765b6851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 -- 172.21.15.6:0/2455366032 learned_addr learned my addr 172.21.15.6:0/2455366032 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c6ffd700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62cb80 0x55765b655e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 -- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62cb80 msgr2=0x55765b655e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62cb80 0x55765b655e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 -- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62a5f0 msgr2=0x55765b6851e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62a5f0 0x55765b6851e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 -- 172.21.15.6:0/2455366032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55765b417270 con 0x55765b677480 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5c7fff700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00012e0 tx=0x7fd5c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29837b52481d4995 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0015870 con 0x55765b677480 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5c00159d0 con 0x55765b677480 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5bc013860 con 0x55765b677480 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5c0015de0 con 0x55765b677480 2023-10-09T11:40:58.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5d6ecfb80 10 client.6474 fetch_fsmap learned FSMap version 52 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55765b54b780 con 0x55765b677480 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.016+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc013860 con 0x55765b677480 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd5c0022450 con 0x55765b677480 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 10 client.6474 fetch_fsmap finished waiting for FSMap version 52 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 10 client.6474 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 20 client.6474 populate_metadata read hostname 'smithi006' 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b630620 0x55765b64ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 4 client.6474 mds_command: new command op to 6336 tid=0[{"prefix": "status"}] 2023-10-09T11:40:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 --> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55765b51fe00 con 0x55765b630620 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b630620 0x55765b64ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5c77fe700 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b630620 0x55765b64ede0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29c74c6d0fc1c9 server_cookie=19602c180c5d629e in_seq=0 out_seq=0 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5a5ffb700 10 client.6474 ms_handle_connect on v2:172.21.15.118:6833/2462389569 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5a5ffb700 1 -- 172.21.15.6:0/2455366032 <== mds.0 v2:172.21.15.118:6833/2462389569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55765b51fe00 con 0x55765b630620 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5a5ffb700 10 client.6474 handle_command_reply: tid=0 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 1 client.6474 shutdown 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.017+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 msgr2=0x55765b656390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00012e0 tx=0x7fd5c0009040 comp rx=0 tx=0).stop 2023-10-09T11:40:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 shutdown_connections 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55765b677480 0x55765b656390 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:6833/2462389569,v1:172.21.15.118:6835/2462389569] conn(0x55765b630620 0x55765b64ede0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55765b62a5f0 0x55765b6851e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 --2- 172.21.15.6:0/2455366032 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55765b62cb80 0x55765b655e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5a5ffb700 0 client.6474 ms_handle_reset on v2:172.21.15.118:6833/2462389569 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 >> 172.21.15.6:0/2455366032 conn(0x55765b62e0c0 msgr2=0x55765b675300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 shutdown_connections 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 1 -- 172.21.15.6:0/2455366032 wait complete. 2023-10-09T11:40:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5d6ecfb80 20 client.6474 trim_cache size 0 max 16384 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6336, 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9244246509999998, 2023-10-09T11:40:58.029 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 52, 2023-10-09T11:40:58.030 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 95, 2023-10-09T11:40:58.030 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 95, 2023-10-09T11:40:58.030 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.85635489 2023-10-09T11:40:58.030 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 msgr2=0x7fd5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 0x7fd5b40693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8158ac0 tx=0x7fd5bc000bc0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 msgr2=0x7fd5c8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80091e0 tx=0x7fd5b8016000 comp rx=0 tx=0).stop 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 shutdown_connections 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd5b4066f30 0x7fd5b40693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5c8159f10 0x7fd5c8155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5c8068e90 0x7fd5c8154630 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 --2- 172.21.15.6:0/3123663930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5c8159b40 0x7fd5c8156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 >> 172.21.15.6:0/3123663930 conn(0x7fd5c80cd660 msgr2=0x7fd5c806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 shutdown_connections 2023-10-09T11:40:58.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.018+0000 7fd5cc975700 1 -- 172.21.15.6:0/3123663930 wait complete. 2023-10-09T11:40:58.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:58.077 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-10-09T11:40:58.076+0000 7f842dcca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:40:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.150+0000 7ff0555fa700 1 Processor -- start 2023-10-09T11:40:58.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.150+0000 7ff0555fa700 1 -- start start 2023-10-09T11:40:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff0555fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff0500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff0555fa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500d07c0 con 0x7ff0501578d0 2023-10-09T11:40:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff0555fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500cfbb0 con 0x7ff050157ca0 2023-10-09T11:40:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff0555fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500cfe90 con 0x7ff05006d830 2023-10-09T11:40:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff04effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff0501578d0 0x7ff05015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60996/0 (socket says 172.21.15.6:60996) 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.151+0000 7ff04effd700 1 -- 172.21.15.6:0/3126563161 learned_addr learned my addr 172.21.15.6:0/3126563161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918167556 0 0) 0x7ff0500d07c0 con 0x7ff0501578d0 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff03c003570 con 0x7ff0501578d0 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04f7fe700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff0500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151750548 0 0) 0x7ff03c003570 con 0x7ff0501578d0 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 msgr2=0x7ff0500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff0500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 >> v1:172.21.15.118:6789/0 conn(0x7ff050157ca0 legacy=0x7ff05006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500d0170 con 0x7ff0501578d0 2023-10-09T11:40:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ff048001470 con 0x7ff0501578d0 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 >> v1:172.21.15.6:6789/0 conn(0x7ff0501578d0 legacy=0x7ff05015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff03c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff03c004010 0x7ff03c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff03c004d50 0x7ff03c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500cfe90 con 0x7ff03c004010 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c00bbf0 con 0x7ff03c004d50 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c00bdb0 con 0x7ff05006d830 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff03c004010 0x7ff03c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04effd700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff03c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04f7fe700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff03c004d50 0x7ff03c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 -- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 msgr2=0x7ff03c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff05006d830 0x7ff03c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 -- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff03c004d50 msgr2=0x7ff03c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff03c004d50 0x7ff03c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04e7fc700 1 -- 172.21.15.6:0/3126563161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c003570 con 0x7ff03c004010 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.152+0000 7ff04f7fe700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff03c004d50 0x7ff03c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff03c004010 0x7ff03c004810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff0501580c0 tx=0x7ff038007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3e9887bc287e9f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038012420 con 0x7ff03c004010 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038012580 con 0x7ff03c004010 2023-10-09T11:40:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff04dffb700 1 -- 172.21.15.6:0/3126563161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038012920 con 0x7ff03c004010 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 -- 172.21.15.6:0/3126563161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff03c004010 msgr2=0x7ff03c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 --2- 172.21.15.6:0/3126563161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff03c004010 0x7ff03c004810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff0501580c0 tx=0x7ff038007d30 comp rx=0 tx=0).stop 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff04f7fe700 1 -- 172.21.15.6:0/3126563161 reap_dead start 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 -- 172.21.15.6:0/3126563161 shutdown_connections 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 -- 172.21.15.6:0/3126563161 >> 172.21.15.6:0/3126563161 conn(0x7ff05006bb90 msgr2=0x7ff05006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 -- 172.21.15.6:0/3126563161 shutdown_connections 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.153+0000 7ff0555fa700 1 -- 172.21.15.6:0/3126563161 wait complete. 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.154+0000 7ff0555fa700 1 Processor -- start 2023-10-09T11:40:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 -- start start 2023-10-09T11:40:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff03c004010 0x7ff0500b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 0x7ff0500c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c6ec0 con 0x7ff0500b63a0 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b4b70 con 0x7ff0500c6a40 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff0555fa700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b59d0 con 0x7ff03c004010 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff04e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff04e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37724/0 (socket says 172.21.15.6:37724) 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.155+0000 7ff04e7fc700 1 -- 172.21.15.6:0/2880396818 learned_addr learned my addr 172.21.15.6:0/2880396818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 -- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff03c004010 msgr2=0x7ff0500b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff03c004010 0x7ff0500b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04f7fe700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 0x7ff0500c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 -- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 msgr2=0x7ff0500c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 0x7ff0500c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 -- 172.21.15.6:0/2880396818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500b4dc0 con 0x7ff0500b63a0 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04f7fe700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 0x7ff0500c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff04e7fc700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff038001e70 tx=0x7ff038015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03801e6e0 con 0x7ff0500b63a0 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03801e840 con 0x7ff0500b63a0 2023-10-09T11:40:58.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03801ec00 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500b50a0 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.156+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500b5660 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.157+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050067ac0 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.157+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff038019030 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.158+0000 7ff046ffd700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 0x7ff0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.158+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff038085660 con 0x7ff0500b63a0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.158+0000 7ff04effd700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 0x7ff0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.158+0000 7ff04effd700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 0x7ff0300693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff048001ed0 tx=0x7ff05015b610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.162+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff038052950 con 0x7ff0500b63a0 2023-10-09T11:40:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.403+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff0500b5b60 con 0x7ff0500b63a0 2023-10-09T11:40:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.403+0000 7ff046ffd700 1 -- 172.21.15.6:0/2880396818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff038017060 con 0x7ff0500b63a0 2023-10-09T11:40:58.405 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 msgr2=0x7ff0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 0x7ff0300693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff048001ed0 tx=0x7ff05015b610 comp rx=0 tx=0).stop 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 msgr2=0x7ff0500c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff038001e70 tx=0x7ff038015000 comp rx=0 tx=0).stop 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 shutdown_connections 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff030066f30 0x7ff0300693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff0500c6a40 0x7ff0500c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff03c004010 0x7ff0500b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 --2- 172.21.15.6:0/2880396818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500b63a0 0x7ff0500c6500 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 >> 172.21.15.6:0/2880396818 conn(0x7ff05006bb90 msgr2=0x7ff050156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 shutdown_connections 2023-10-09T11:40:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:58.405+0000 7ff0555fa700 1 -- 172.21.15.6:0/2880396818 wait complete. 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:58.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:58.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:58.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:58.420 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:58.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.420 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:40:58.435 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42203sec preferred_lft 42203sec 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:40:58.437 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:40:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:40:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:58.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.439 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:58.500 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:40:58.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.502 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:40:58.558 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:40:58.558 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:58.558 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:40:58.558 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:40:58.559 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:58.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:40:58.559 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:40:58.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.660 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:40:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:40:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:40:58.675 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:58.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:40:58.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:58.740 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:58.795 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:40:58.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:58.795 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:58.850 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:40:58.850 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:58.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:58.931 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:58.931 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:58.950 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:58.950 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:58.950 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:40:58.973 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:40:58.974 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:40:58.974 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:40:58.974 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:40:58.974 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:40:58.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:40:58.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:58.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:40:59.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:40:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.202+0000 7f010bac5700 1 Processor -- start 2023-10-09T11:40:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.202+0000 7f010bac5700 1 -- start start 2023-10-09T11:40:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.202+0000 7f010bac5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0104157ca0 0x7f01040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.202+0000 7f010bac5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040d07c0 con 0x7f01041578d0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010bac5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040cfbb0 con 0x7f010406d120 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010bac5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01040cfe90 con 0x7f0104157ca0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109861700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f01041578d0 0x7f010415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32768/0 (socket says 172.21.15.6:32768) 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109861700 1 -- 172.21.15.6:0/2894367077 learned_addr learned my addr 172.21.15.6:0/2894367077 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109060700 1 --2- 172.21.15.6:0/2894367077 >> v2:172.21.15.6:3300/0 conn(0x7f0104157ca0 0x7f01040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010885f700 1 -- 172.21.15.6:0/2894367077 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819736839 0 0) 0x7f01040d07c0 con 0x7f01041578d0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010885f700 1 -- 172.21.15.6:0/2894367077 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec003570 con 0x7f01041578d0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109060700 1 -- 172.21.15.6:0/2894367077 >> v1:172.21.15.118:6789/0 conn(0x7f010406d120 legacy=0x7f010406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109060700 1 -- 172.21.15.6:0/2894367077 >> v1:172.21.15.6:6789/0 conn(0x7f01041578d0 legacy=0x7f010415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109060700 1 -- 172.21.15.6:0/2894367077 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040d0170 con 0x7f0104157ca0 2023-10-09T11:40:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f0109060700 1 --2- 172.21.15.6:0/2894367077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0104157ca0 0x7f01040cf4f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098e0 tx=0x7f00f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2fedca988c0762 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010885f700 1 -- 172.21.15.6:0/2894367077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f800b640 con 0x7f0104157ca0 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010885f700 1 -- 172.21.15.6:0/2894367077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f800b7a0 con 0x7f0104157ca0 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.203+0000 7f010885f700 1 -- 172.21.15.6:0/2894367077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f800bb40 con 0x7f0104157ca0 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 -- 172.21.15.6:0/2894367077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0104157ca0 msgr2=0x7f01040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 --2- 172.21.15.6:0/2894367077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0104157ca0 0x7f01040cf4f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098e0 tx=0x7f00f80091a0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 -- 172.21.15.6:0/2894367077 shutdown_connections 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 --2- 172.21.15.6:0/2894367077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0104157ca0 0x7f01040cf4f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 -- 172.21.15.6:0/2894367077 >> 172.21.15.6:0/2894367077 conn(0x7f010406bb90 msgr2=0x7f010406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 -- 172.21.15.6:0/2894367077 shutdown_connections 2023-10-09T11:40:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.204+0000 7f010bac5700 1 -- 172.21.15.6:0/2894367077 wait complete. 2023-10-09T11:40:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.205+0000 7f010bac5700 1 Processor -- start 2023-10-09T11:40:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.205+0000 7f010bac5700 1 -- start start 2023-10-09T11:40:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f010406d120 0x7f01041550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 0x7f010416a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040aca00 con 0x7f01041578d0 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010416b310 con 0x7f0104157ca0 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010bac5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010416b5f0 con 0x7f010406d120 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37744/0 (socket says 172.21.15.6:37744) 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 -- 172.21.15.6:0/978442954 learned_addr learned my addr 172.21.15.6:0/978442954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109861700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f010406d120 0x7f01041550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010a062700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 0x7f010416a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 -- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f010406d120 msgr2=0x7f01041550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f010406d120 0x7f01041550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 -- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 msgr2=0x7f010416a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 0x7f010416a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 -- 172.21.15.6:0/978442954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009420 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f010a062700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 0x7f010416a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.206+0000 7f0109060700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013000 tx=0x7f00f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.207+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8000d10 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.207+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f800bb20 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.207+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011650 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.207+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01040acc50 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.207+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01040ac270 con 0x7f01041578d0 2023-10-09T11:40:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.208+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01040ad170 con 0x7f01041578d0 2023-10-09T11:40:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.208+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00f8011a00 con 0x7f01041578d0 2023-10-09T11:40:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.209+0000 7f0101ffb700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 0x7f00f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:40:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.209+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00f8085b60 con 0x7f01041578d0 2023-10-09T11:40:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.209+0000 7f0109861700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 0x7f00f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:40:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.209+0000 7f0109861700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 0x7f00f00693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005c50 tx=0x7f00fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:40:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.213+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01040ad170 con 0x7f01041578d0 2023-10-09T11:40:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.452+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f01040ad170 con 0x7f01041578d0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.452+0000 7f0101ffb700 1 -- 172.21.15.6:0/978442954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f01040ad170 con 0x7f01041578d0 2023-10-09T11:40:59.454 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:40:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 msgr2=0x7f00f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 0x7f00f00693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005c50 tx=0x7f00fc009040 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 msgr2=0x7f01040ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013000 tx=0x7f00f8017000 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 shutdown_connections 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00f0066f30 0x7f00f00693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0104157ca0 0x7f010416a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f010406d120 0x7f01041550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 --2- 172.21.15.6:0/978442954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01041578d0 0x7f01040ad450 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 >> 172.21.15.6:0/978442954 conn(0x7f010406bb90 msgr2=0x7f010406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 shutdown_connections 2023-10-09T11:40:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:40:59.455+0000 7f010bac5700 1 -- 172.21.15.6:0/978442954 wait complete. 2023-10-09T11:40:59.468 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:40:59.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:40:59.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:40:59.469 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:59.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.469 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:40:59.487 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42215sec preferred_lft 42215sec 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:40:59.488 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:40:59.489 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:40:59.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.490 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:40:59.552 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:40:59.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.554 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:40:59.611 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:40:59.611 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:40:59.612 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:40:59.612 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:40:59.612 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:40:59.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.612 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:40:59.612 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:40:59.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:40:59.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:40:59.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:40:59.613 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:40:59.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.715 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:40:59.729 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:40:59.729 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:40:59.729 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:59.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:40:59.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:40:59.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:59.793 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:59.848 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:40:59.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:40:59.849 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:40:59.902 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:40:59.903 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:40:59.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:59.982 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:40:59.982 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:00.000 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:00.000 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:00.001 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:00.021 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:41:00.022 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:41:00.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:00.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:00.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:00.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.215+0000 7fb19e7fe700 1 Processor -- start 2023-10-09T11:41:00.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.215+0000 7fb19e7fe700 1 -- start start 2023-10-09T11:41:00.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19e7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb198157ca0 0x7fb1980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19e7fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980d07c0 con 0x7fb19806d120 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19e7fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980cfbb0 con 0x7fb1981578d0 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19e7fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1980cfe90 con 0x7fb198157ca0 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb18ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb198157ca0 0x7fb1980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19cd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb19806d120 0x7fb19806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32776/0 (socket says 172.21.15.6:32776) 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.216+0000 7fb19cd9b700 1 -- 172.21.15.6:0/3954395590 learned_addr learned my addr 172.21.15.6:0/3954395590 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb18ffff700 1 -- 172.21.15.6:0/3954395590 >> v1:172.21.15.118:6789/0 conn(0x7fb1981578d0 legacy=0x7fb19815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb18ffff700 1 -- 172.21.15.6:0/3954395590 >> v1:172.21.15.6:6789/0 conn(0x7fb19806d120 legacy=0x7fb19806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb18ffff700 1 -- 172.21.15.6:0/3954395590 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980d0170 con 0x7fb198157ca0 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb1977fe700 1 -- 172.21.15.6:0/3954395590 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311195708 0 0) 0x7fb1980d07c0 con 0x7fb19806d120 2023-10-09T11:41:00.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb18ffff700 1 --2- 172.21.15.6:0/3954395590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb198157ca0 0x7fb1980cf4f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb1800098e0 tx=0x7fb1800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cad527d7b8e3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb1977fe700 1 -- 172.21.15.6:0/3954395590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180009e80 con 0x7fb198157ca0 2023-10-09T11:41:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb1977fe700 1 -- 172.21.15.6:0/3954395590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18000b860 con 0x7fb198157ca0 2023-10-09T11:41:00.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.217+0000 7fb1977fe700 1 -- 172.21.15.6:0/3954395590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18000bbe0 con 0x7fb198157ca0 2023-10-09T11:41:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3954395590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb198157ca0 msgr2=0x7fb1980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3954395590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb198157ca0 0x7fb1980cf4f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb1800098e0 tx=0x7fb1800091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3954395590 shutdown_connections 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3954395590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb198157ca0 0x7fb1980cf4f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3954395590 >> 172.21.15.6:0/3954395590 conn(0x7fb19806bb90 msgr2=0x7fb19806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3954395590 shutdown_connections 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.218+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3954395590 wait complete. 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 Processor -- start 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 -- start start 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1981578d0 0x7fb198152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb198157ca0 0x7fb19816a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19816b5b0 con 0x7fb19806d120 2023-10-09T11:41:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980aba50 con 0x7fb198157ca0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.219+0000 7fb19e7fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980abd30 con 0x7fb1981578d0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37758/0 (socket says 172.21.15.6:37758) 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 -- 172.21.15.6:0/3439737416 learned_addr learned my addr 172.21.15.6:0/3439737416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb18ffff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1981578d0 0x7fb198152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb19cd9b700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb198157ca0 0x7fb19816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 -- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1981578d0 msgr2=0x7fb198152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1981578d0 0x7fb198152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 -- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb198157ca0 msgr2=0x7fb19816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb198157ca0 0x7fb19816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 -- 172.21.15.6:0/3439737416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180009420 con 0x7fb19806d120 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb197fff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c590 tx=0x7fb18800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011590 con 0x7fb19806d120 2023-10-09T11:41:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188011710 con 0x7fb19806d120 2023-10-09T11:41:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1980ac010 con 0x7fb19806d120 2023-10-09T11:41:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011ad0 con 0x7fb19806d120 2023-10-09T11:41:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.220+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19815ce70 con 0x7fb19806d120 2023-10-09T11:41:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.221+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198067ac0 con 0x7fb19806d120 2023-10-09T11:41:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.222+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb18801b3b0 con 0x7fb19806d120 2023-10-09T11:41:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.222+0000 7fb194ff9700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.222+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb188083960 con 0x7fb19806d120 2023-10-09T11:41:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.222+0000 7fb18ffff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.223+0000 7fb18ffff700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1981580c0 tx=0x7fb180017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:00.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.226+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb188050bd0 con 0x7fb19806d120 2023-10-09T11:41:00.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.462+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1980d0450 con 0x7fb19806d120 2023-10-09T11:41:00.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.463+0000 7fb194ff9700 1 -- 172.21.15.6:0/3439737416 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb188017070 con 0x7fb19806d120 2023-10-09T11:41:00.464 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:00.465 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:00.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 msgr2=0x7fb1780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1981580c0 tx=0x7fb180017000 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 msgr2=0x7fb198151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c590 tx=0x7fb18800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 shutdown_connections 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb198157ca0 0x7fb19816a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb19806d120 0x7fb198151fe0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 --2- 172.21.15.6:0/3439737416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1981578d0 0x7fb198152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 >> 172.21.15.6:0/3439737416 conn(0x7fb19806bb90 msgr2=0x7fb198069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:00.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 shutdown_connections 2023-10-09T11:41:00.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:00.465+0000 7fb19e7fe700 1 -- 172.21.15.6:0/3439737416 wait complete. 2023-10-09T11:41:00.468 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:00.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:41:00.612 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5070444179999996,"mdsmap_epoch":52,"osdmap_epoch":95,"osdmap_epoch_barrier":95,"uptime":13.438976297} 2023-10-09T11:41:00.613 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 52, "osdmap_epoch": 95, "osdmap_epoch_barrier": 95, "rank_uptime": 8.507044418, "state": "up:active", "uptime": 13.438976297, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:41:00.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:41:00.748 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:41:00.748 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:41:00.748 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-09T11:41:00.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:00.749 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-09T11:41:02.142 INFO:teuthology.orchestra.run.smithi006.stderr:265+0 records in 2023-10-09T11:41:02.142 INFO:teuthology.orchestra.run.smithi006.stderr:265+0 records out 2023-10-09T11:41:02.142 INFO:teuthology.orchestra.run.smithi006.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.37529 s, 202 MB/s 2023-10-09T11:41:02.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:02.143 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-09T11:41:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:292+0 records in 2023-10-09T11:41:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:292+0 records out 2023-10-09T11:41:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.52286 s, 201 MB/s 2023-10-09T11:41:03.683 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T11:41:03.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.800+0000 7f3044562700 1 Processor -- start 2023-10-09T11:41:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.800+0000 7f3044562700 1 -- start start 2023-10-09T11:41:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.801+0000 7f3044562700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f303c0cf240 0x7f303c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.801+0000 7f3044562700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0b0ca0 con 0x7f303c06d650 2023-10-09T11:41:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.801+0000 7f3044562700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c0b00d0 con 0x7f303c15a2a0 2023-10-09T11:41:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.801+0000 7f3044562700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c06ea90 con 0x7f303c0cf240 2023-10-09T11:41:03.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.801+0000 7f3042aff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f303c06d650 0x7f303c06da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39406/0 (socket says 172.21.15.6:39406) 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f3042aff700 1 -- 172.21.15.6:0/194080591 learned_addr learned my addr 172.21.15.6:0/194080591 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f3041afd700 1 --2- 172.21.15.6:0/194080591 >> v2:172.21.15.118:3300/0 conn(0x7f303c0cf240 0x7f303c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636645600 0 0) 0x7f303c0b0ca0 con 0x7f303c06d650 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3024003570 con 0x7f303c06d650 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554772919 0 0) 0x7f3024003570 con 0x7f303c06d650 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 >> v2:172.21.15.118:3300/0 conn(0x7f303c0cf240 msgr2=0x7f303c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 --2- 172.21.15.6:0/194080591 >> v2:172.21.15.118:3300/0 conn(0x7f303c0cf240 0x7f303c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 >> v1:172.21.15.118:6789/0 conn(0x7f303c15a2a0 legacy=0x7f303c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0b0370 con 0x7f303c06d650 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f302c0017f0 con 0x7f303c06d650 2023-10-09T11:41:03.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 >> v1:172.21.15.6:6789/0 conn(0x7f303c06d650 legacy=0x7f303c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3024003a60 0x7f3024003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3024004810 0x7f3024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 0x7f302400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c06ea90 con 0x7f30240051c0 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302400c0d0 con 0x7f3024004810 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302400c290 con 0x7f3024003a60 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f3042aff700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 0x7f302400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f3041afd700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3024004810 0x7f3024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.802+0000 7f30422fe700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3024003a60 0x7f3024003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 -- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3024003a60 msgr2=0x7f3024003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3024003a60 0x7f3024003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 -- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3024004810 msgr2=0x7f3024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3024004810 0x7f3024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 -- 172.21.15.6:0/194080591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024003570 con 0x7f30240051c0 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 -- 172.21.15.6:0/194080591 reap_dead start 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3042aff700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 0x7f302400ba60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a900 tx=0x7f303c0b0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25b2c56160d8696 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0070d0 con 0x7f30240051c0 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c007230 con 0x7f30240051c0 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f30412fc700 1 -- 172.21.15.6:0/194080591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0075f0 con 0x7f30240051c0 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 -- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 msgr2=0x7f302400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 0x7f302400ba60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f302c00a900 tx=0x7f303c0b0260 comp rx=0 tx=0).stop 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 -- 172.21.15.6:0/194080591 shutdown_connections 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 --2- 172.21.15.6:0/194080591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30240051c0 0x7f302400ba60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 -- 172.21.15.6:0/194080591 >> 172.21.15.6:0/194080591 conn(0x7f303c067640 msgr2=0x7f303c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:03.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.803+0000 7f3044562700 1 -- 172.21.15.6:0/194080591 shutdown_connections 2023-10-09T11:41:03.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.804+0000 7f3044562700 1 -- 172.21.15.6:0/194080591 wait complete. 2023-10-09T11:41:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 Processor -- start 2023-10-09T11:41:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 -- start start 2023-10-09T11:41:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30240051c0 0x7f303c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f303c0b3860 0x7f303c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b33d0 con 0x7f303c0b2300 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b27c0 con 0x7f30240051c0 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3044562700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b2aa0 con 0x7f303c0b3860 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3041afd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.805+0000 7f3041afd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46120/0 (socket says 172.21.15.6:46120) 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 -- 172.21.15.6:0/2014993026 learned_addr learned my addr 172.21.15.6:0/2014993026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3042aff700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f303c0b3860 0x7f303c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f30422fe700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30240051c0 0x7f303c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 -- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f303c0b3860 msgr2=0x7f303c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f303c0b3860 0x7f303c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 -- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30240051c0 msgr2=0x7f303c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30240051c0 0x7f303c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 -- 172.21.15.6:0/2014993026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0b2d80 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3041afd700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3030011a40 tx=0x7f30300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000f940 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303000faa0 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0b3060 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000fe20 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.806+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c145d80 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.807+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c069e40 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.808+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3030014650 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.808+0000 7f303a7fc700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 0x7f30280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.808+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3030018030 con 0x7f303c0b2300 2023-10-09T11:41:03.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.808+0000 7f30422fe700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 0x7f30280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.808+0000 7f30422fe700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 0x7f30280693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f303c1495d0 tx=0x7f3034007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:03.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:03.812+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3030052080 con 0x7f303c0b2300 2023-10-09T11:41:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.006+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f303c0b3510 con 0x7f303c0b2300 2023-10-09T11:41:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.007+0000 7f303a7fc700 1 -- 172.21.15.6:0/2014993026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v95) v1 ==== 81+0+32215 (secure 0 0 0) 0x7f3030022090 con 0x7f303c0b2300 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 95, 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:40:53.094143+0000", 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "86", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "94", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "95", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:04.092 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 msgr2=0x7f30280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 0x7f30280693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f303c1495d0 tx=0x7f3034007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 msgr2=0x7f303c145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3030011a40 tx=0x7f30300091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 shutdown_connections 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3028066f30 0x7f30280693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f303c0b3860 0x7f303c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30240051c0 0x7f303c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 --2- 172.21.15.6:0/2014993026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f303c0b2300 0x7f303c145840 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 >> 172.21.15.6:0/2014993026 conn(0x7f303c067640 msgr2=0x7f303c156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 shutdown_connections 2023-10-09T11:41:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:04.009+0000 7f3044562700 1 -- 172.21.15.6:0/2014993026 wait complete. 2023-10-09T11:41:04.096 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:41:04.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:04.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:05.148 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:41:05.147+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check failed: 3 full osd(s) (OSD_FULL) 2023-10-09T11:41:09.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:09.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.228+0000 7f1d77b78700 1 Processor -- start 2023-10-09T11:41:09.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.229+0000 7f1d77b78700 1 -- start start 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.229+0000 7f1d77b78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7006d830 0x7f1d700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.229+0000 7f1d77b78700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700d07c0 con 0x7f1d70157ca0 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d77b78700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700cfbb0 con 0x7f1d701578d0 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d77b78700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700cfe90 con 0x7f1d7006d830 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d76115700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d7006d830 0x7f1d700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d75113700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d70157ca0 0x7f1d7006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39416/0 (socket says 172.21.15.6:39416) 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d75113700 1 -- 172.21.15.6:0/433185233 learned_addr learned my addr 172.21.15.6:0/433185233 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d76115700 1 -- 172.21.15.6:0/433185233 >> v1:172.21.15.118:6789/0 conn(0x7f1d701578d0 legacy=0x7f1d7015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d76115700 1 -- 172.21.15.6:0/433185233 >> v1:172.21.15.6:6789/0 conn(0x7f1d70157ca0 legacy=0x7f1d7006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d76115700 1 -- 172.21.15.6:0/433185233 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700d0170 con 0x7f1d7006d830 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d74912700 1 -- 172.21.15.6:0/433185233 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391978299 0 0) 0x7f1d700d07c0 con 0x7f1d70157ca0 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d76115700 1 --2- 172.21.15.6:0/433185233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7006d830 0x7f1d700cf4f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1d680098e0 tx=0x7f1d680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae3bd216fa09342 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d74912700 1 -- 172.21.15.6:0/433185233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68009e80 con 0x7f1d7006d830 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d74912700 1 -- 172.21.15.6:0/433185233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800b820 con 0x7f1d7006d830 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.230+0000 7f1d74912700 1 -- 172.21.15.6:0/433185233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800bba0 con 0x7f1d7006d830 2023-10-09T11:41:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 -- 172.21.15.6:0/433185233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7006d830 msgr2=0x7f1d700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 --2- 172.21.15.6:0/433185233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7006d830 0x7f1d700cf4f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1d680098e0 tx=0x7f1d680091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 -- 172.21.15.6:0/433185233 shutdown_connections 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 --2- 172.21.15.6:0/433185233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d7006d830 0x7f1d700cf4f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 -- 172.21.15.6:0/433185233 >> 172.21.15.6:0/433185233 conn(0x7f1d7006bb90 msgr2=0x7f1d7006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 -- 172.21.15.6:0/433185233 shutdown_connections 2023-10-09T11:41:09.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.231+0000 7f1d77b78700 1 -- 172.21.15.6:0/433185233 wait complete. 2023-10-09T11:41:09.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.232+0000 7f1d77b78700 1 Processor -- start 2023-10-09T11:41:09.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.232+0000 7f1d77b78700 1 -- start start 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7006d830 0x7f1d70069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 0x7f1d70155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70155a90 con 0x7f1d701578d0 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7016a810 con 0x7f1d7006d830 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d77b78700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7016aaf0 con 0x7f1d70157ca0 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46148/0 (socket says 172.21.15.6:46148) 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 -- 172.21.15.6:0/4236171409 learned_addr learned my addr 172.21.15.6:0/4236171409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d76115700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 0x7f1d70155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75914700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7006d830 0x7f1d70069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 -- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 msgr2=0x7f1d70155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 0x7f1d70155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 -- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7006d830 msgr2=0x7f1d70069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7006d830 0x7f1d70069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009420 con 0x7f1d701578d0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d76115700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 0x7f1d70155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.233+0000 7f1d75113700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c5e0 tx=0x7f1d64000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.234+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64005b30 con 0x7f1d701578d0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.234+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64005c90 con 0x7f1d701578d0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.234+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7016add0 con 0x7f1d701578d0 2023-10-09T11:41:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.234+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007300 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.234+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7016b390 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.235+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7016b5b0 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.235+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d640076b0 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.236+0000 7f1d6dffb700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 0x7f1d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.236+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d64083a70 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.236+0000 7f1d75914700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 0x7f1d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.236+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f1d5c06ea50 con 0x7f1d701578d0 2023-10-09T11:41:09.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.236+0000 7f1d75914700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 0x7f1d5c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007fd0 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.240+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d64017060 con 0x7f1d701578d0 2023-10-09T11:41:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.434+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1d700d0450 con 0x7f1d701578d0 2023-10-09T11:41:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.435+0000 7f1d6dffb700 1 -- 172.21.15.6:0/4236171409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+32382 (secure 0 0 0) 0x7f1d64050ce0 con 0x7f1d701578d0 2023-10-09T11:41:09.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 98, 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:07.202095+0000", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:09.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:09.461 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:09.462 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:09.463 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:09.464 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:09.465 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:09.466 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:09.467 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:09.469 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:09.470 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:09.472 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:09.473 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:09.474 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:09.476 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:09.477 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:09.477 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:09.477 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:09.477 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:09.477 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:09.478 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:09.479 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:09.482 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.483 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:09.484 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.486 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.488 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.492 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:09.494 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:09.495 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.496 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.506 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.507 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.508 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.509 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.510 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.511 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:09.512 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.515 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.518 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.520 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:09.522 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.523 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:09.528 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:09.529 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:09.533 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:09.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.537 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.538 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:09.539 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:09.541 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:09.542 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:09.543 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.437+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 msgr2=0x7f1d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.437+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 0x7f1d5c0693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007fd0 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.437+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 msgr2=0x7f1d70155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.437+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c5e0 tx=0x7f1d64000fe0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 shutdown_connections 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1d5c066f30 0x7f1d5c0693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d70157ca0 0x7f1d70155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7006d830 0x7f1d70069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 --2- 172.21.15.6:0/4236171409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d701578d0 0x7f1d70155010 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 >> 172.21.15.6:0/4236171409 conn(0x7f1d7006bb90 msgr2=0x7f1d701568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 shutdown_connections 2023-10-09T11:41:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.438+0000 7f1d77b78700 1 -- 172.21.15.6:0/4236171409 wait complete. 2023-10-09T11:41:09.547 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T11:41:09.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:09.548 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-09T11:41:09.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:09.801 INFO:teuthology.orchestra.run.smithi006.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T11:41:09.801 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:41:09.801 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:41:09.801 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.231801 s, 226 MB/s 2023-10-09T11:41:09.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 Processor -- start 2023-10-09T11:41:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 -- start start 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f45300ce5c0 0x7f45300aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45300ac570 0x7f453006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453015dfb0 con 0x7f45300ce1f0 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300acec0 con 0x7f45300ac570 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.920+0000 7f453723a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300ad1a0 con 0x7f45300ce5c0 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45300ac570 0x7f453006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45300ac570 0x7f453006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46156/0 (socket says 172.21.15.6:46156) 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 -- 172.21.15.6:0/332101274 learned_addr learned my addr 172.21.15.6:0/332101274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f452ffff700 1 --2- 172.21.15.6:0/332101274 >> v2:172.21.15.118:3300/0 conn(0x7f45300ce5c0 0x7f45300aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 -- 172.21.15.6:0/332101274 >> v2:172.21.15.118:3300/0 conn(0x7f45300ce5c0 msgr2=0x7f45300aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 --2- 172.21.15.6:0/332101274 >> v2:172.21.15.118:3300/0 conn(0x7f45300ce5c0 0x7f45300aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 -- 172.21.15.6:0/332101274 >> v1:172.21.15.118:6789/0 conn(0x7f45300ce1f0 legacy=0x7f453015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 -- 172.21.15.6:0/332101274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453015dc40 con 0x7f45300ac570 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f45357d7700 1 --2- 172.21.15.6:0/332101274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ac570 0x7f453006e230 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f453006f590 tx=0x7f4518009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ef7d6da66bfe79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f452f7fe700 1 -- 172.21.15.6:0/332101274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800b820 con 0x7f45300ac570 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f452f7fe700 1 -- 172.21.15.6:0/332101274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800b980 con 0x7f45300ac570 2023-10-09T11:41:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.921+0000 7f452f7fe700 1 -- 172.21.15.6:0/332101274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800bd20 con 0x7f45300ac570 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 -- 172.21.15.6:0/332101274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ac570 msgr2=0x7f453006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 --2- 172.21.15.6:0/332101274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ac570 0x7f453006e230 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f453006f590 tx=0x7f4518009250 comp rx=0 tx=0).stop 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 -- 172.21.15.6:0/332101274 shutdown_connections 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 --2- 172.21.15.6:0/332101274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ac570 0x7f453006e230 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 --2- 172.21.15.6:0/332101274 >> v2:172.21.15.118:3300/0 conn(0x7f45300ce5c0 0x7f45300aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 -- 172.21.15.6:0/332101274 >> 172.21.15.6:0/332101274 conn(0x7f453006cca0 msgr2=0x7f453006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 -- 172.21.15.6:0/332101274 shutdown_connections 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.922+0000 7f453723a700 1 -- 172.21.15.6:0/332101274 wait complete. 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.923+0000 7f453723a700 1 Processor -- start 2023-10-09T11:41:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.923+0000 7f453723a700 1 -- start start 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45300ac570 0x7f45300c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45300ce1f0 0x7f45300b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300b0580 con 0x7f45300ce5c0 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300c3b20 con 0x7f45300ce1f0 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f453723a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45300c2f10 con 0x7f45300ac570 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46172/0 (socket says 172.21.15.6:46172) 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 -- 172.21.15.6:0/2937954961 learned_addr learned my addr 172.21.15.6:0/2937954961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f452ffff700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45300ce1f0 0x7f45300b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f4534fd6700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45300ac570 0x7f45300c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 -- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45300ac570 msgr2=0x7f45300c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45300ac570 0x7f45300c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 -- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45300ce1f0 msgr2=0x7f45300b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45300ce1f0 0x7f45300b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180094f0 con 0x7f45300ce5c0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.924+0000 7f45357d7700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f453006cc70 tx=0x7f4518016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.925+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801b450 con 0x7f45300ce5c0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.925+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518020070 con 0x7f45300ce5c0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.925+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45300c31f0 con 0x7f45300ce5c0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.925+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801b820 con 0x7f45300ce5c0 2023-10-09T11:41:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.925+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45300c37b0 con 0x7f45300ce5c0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.926+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45300ab120 con 0x7f45300ce5c0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.926+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4518022030 con 0x7f45300ce5c0 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.926+0000 7f452cff9700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.927+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4518086510 con 0x7f45300ce5c0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.927+0000 7f4534fd6700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.927+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f451006ea50 con 0x7f45300ce5c0 2023-10-09T11:41:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.927+0000 7f4534fd6700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45280075c0 tx=0x7f4528009780 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:09.931+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45180536e0 con 0x7f45300ce5c0 2023-10-09T11:41:10.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.125+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f45300ab120 con 0x7f45300ce5c0 2023-10-09T11:41:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.126+0000 7f452cff9700 1 -- 172.21.15.6:0/2937954961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+32382 (secure 0 0 0) 0x7f4518056d00 con 0x7f45300ce5c0 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 98, 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:07.202095+0000", 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:10.128 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:10.129 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:10.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:10.131 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:10.132 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:10.133 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:10.134 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:10.135 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:10.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:10.137 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:10.140 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:10.142 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:10.143 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:10.144 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:10.146 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:10.147 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:10.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:10.150 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:10.151 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:10.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.153 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.157 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.158 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.159 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.160 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:10.161 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:10.165 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.166 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.173 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:10.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.179 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:10.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.186 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.187 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:10.192 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.193 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:10.194 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.198 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:10.199 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:10.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.209 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.210 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.211 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.213 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:10.214 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:10.215 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 msgr2=0x7f45100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45280075c0 tx=0x7f4528009780 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 msgr2=0x7f4530156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f453006cc70 tx=0x7f4518016000 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 shutdown_connections 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45300ce5c0 0x7f4530156600 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45300ac570 0x7f45300c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 --2- 172.21.15.6:0/2937954961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45300ce1f0 0x7f45300b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 >> 172.21.15.6:0/2937954961 conn(0x7f453006cca0 msgr2=0x7f45300b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 shutdown_connections 2023-10-09T11:41:10.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.128+0000 7f453723a700 1 -- 172.21.15.6:0/2937954961 wait complete. 2023-10-09T11:41:10.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:10.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.336+0000 7f611aa3a700 1 Processor -- start 2023-10-09T11:41:10.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.336+0000 7f611aa3a700 1 -- start start 2023-10-09T11:41:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f611aa3a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 0x7f6114157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f611aa3a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114069810 con 0x7f61141513b0 2023-10-09T11:41:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f611aa3a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114068f20 con 0x7f61140c28e0 2023-10-09T11:41:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f611aa3a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61141581b0 con 0x7f61140c2cb0 2023-10-09T11:41:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f6119237700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61141513b0 0x7f6114157110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39420/0 (socket says 172.21.15.6:39420) 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f6119237700 1 -- 172.21.15.6:0/661839029 learned_addr learned my addr 172.21.15.6:0/661839029 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f611a239700 1 --2- 172.21.15.6:0/661839029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 0x7f6114157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188681592 0 0) 0x7f6114069810 con 0x7f61141513b0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.337+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc003570 con 0x7f61141513b0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219106146 0 0) 0x7f6114068f20 con 0x7f61140c28e0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6114069810 con 0x7f61140c28e0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539426702 0 0) 0x7f60fc003570 con 0x7f61141513b0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611a239700 1 -- 172.21.15.6:0/661839029 >> v1:172.21.15.118:6789/0 conn(0x7f61140c28e0 legacy=0x7f6114150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611a239700 1 -- 172.21.15.6:0/661839029 >> v1:172.21.15.6:6789/0 conn(0x7f61141513b0 legacy=0x7f6114157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611a239700 1 -- 172.21.15.6:0/661839029 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114157ed0 con 0x7f61140c2cb0 2023-10-09T11:41:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611a239700 1 --2- 172.21.15.6:0/661839029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 0x7f6114157820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e90 tx=0x7f6104009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493ac82ebf6efaa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400e070 con 0x7f61140c2cb0 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400b870 con 0x7f61140c2cb0 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f6118a36700 1 -- 172.21.15.6:0/661839029 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108001470 con 0x7f61140c2cb0 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611aa3a700 1 -- 172.21.15.6:0/661839029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 msgr2=0x7f6114157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.338+0000 7f611aa3a700 1 --2- 172.21.15.6:0/661839029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 0x7f6114157820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e90 tx=0x7f6104009780 comp rx=0 tx=0).stop 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.339+0000 7f611aa3a700 1 -- 172.21.15.6:0/661839029 shutdown_connections 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.339+0000 7f611aa3a700 1 --2- 172.21.15.6:0/661839029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61140c2cb0 0x7f6114157820 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.339+0000 7f611aa3a700 1 -- 172.21.15.6:0/661839029 >> 172.21.15.6:0/661839029 conn(0x7f61140cd2b0 msgr2=0x7f61140c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.339+0000 7f611aa3a700 1 -- 172.21.15.6:0/661839029 shutdown_connections 2023-10-09T11:41:10.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.339+0000 7f611aa3a700 1 -- 172.21.15.6:0/661839029 wait complete. 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 Processor -- start 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 -- start start 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61140c28e0 0x7f61140c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61141513b0 0x7f61140b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611416af40 con 0x7f61140c2cb0 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140c47a0 con 0x7f61140c28e0 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f611aa3a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611416a3c0 con 0x7f61141513b0 2023-10-09T11:41:10.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.340+0000 7f6119237700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46188/0 (socket says 172.21.15.6:46188) 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 -- 172.21.15.6:0/365756042 learned_addr learned my addr 172.21.15.6:0/365756042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f611a239700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61141513b0 0x7f61140b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119a38700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61140c28e0 0x7f61140c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 -- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61141513b0 msgr2=0x7f61140b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61141513b0 0x7f61140b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 -- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61140c28e0 msgr2=0x7f61140c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61140c28e0 0x7f61140c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009a20 con 0x7f61140c2cb0 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6119237700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f610800c7c0 tx=0x7f6108001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108005b10 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108005c70 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611416a6a0 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080070f0 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.341+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61140c69d0 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.342+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6114063c90 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61080074a0 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6111ffb700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 0x7f61000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6108084210 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6119a38700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 0x7f61000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f610006ea50 con 0x7f61140c2cb0 2023-10-09T11:41:10.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.343+0000 7f6119a38700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 0x7f61000693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f610c003870 tx=0x7f610c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:10.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.347+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6108051500 con 0x7f61140c2cb0 2023-10-09T11:41:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.581+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61140676e0 con 0x7f61140c2cb0 2023-10-09T11:41:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.582+0000 7f6111ffb700 1 -- 172.21.15.6:0/365756042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6108054b20 con 0x7f61140c2cb0 2023-10-09T11:41:10.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:10.584 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:10.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.583+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 msgr2=0x7f61000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.583+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 0x7f61000693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f610c003870 tx=0x7f610c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:10.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.583+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 msgr2=0x7f61140b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.583+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f610800c7c0 tx=0x7f6108001930 comp rx=0 tx=0).stop 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 shutdown_connections 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6100066f30 0x7f61000693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61141513b0 0x7f61140b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61140c28e0 0x7f61140c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 --2- 172.21.15.6:0/365756042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61140c2cb0 0x7f61140b17d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 >> 172.21.15.6:0/365756042 conn(0x7f61140cd2b0 msgr2=0x7f611414d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 shutdown_connections 2023-10-09T11:41:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:10.584+0000 7f611aa3a700 1 -- 172.21.15.6:0/365756042 wait complete. 2023-10-09T11:41:10.587 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:10.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:41:10.738 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.633881257999999,"mdsmap_epoch":52,"osdmap_epoch":98,"osdmap_epoch_barrier":98,"uptime":23.565811653000001} 2023-10-09T11:41:10.738 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 52, "osdmap_epoch": 98, "osdmap_epoch_barrier": 98, "rank_uptime": 18.633881258, "state": "up:active", "uptime": 23.565811653, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:41:10.739 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:41:10.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:10.739 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T11:41:10.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-09T11:41:10.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:10.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T11:41:10.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:10.812 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T11:41:10.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:10.913 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:41:10.912+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-09T11:41:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.029+0000 7f8be889a700 1 Processor -- start 2023-10-09T11:41:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.030+0000 7f8be889a700 1 -- start start 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be889a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40aeea0 0x7f8be40c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be889a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be40c8410 0x7f8be40c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be889a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be406aae0 con 0x7f8be40af270 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be889a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be4069ed0 con 0x7f8be40c8410 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be889a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be406a1b0 con 0x7f8be40aeea0 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8be40af270 0x7f8be40c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39436/0 (socket says 172.21.15.6:39436) 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be1d9b700 1 -- 172.21.15.6:0/621909300 learned_addr learned my addr 172.21.15.6:0/621909300 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be40c8410 0x7f8be40c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be259c700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40aeea0 0x7f8be40c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 -- 172.21.15.6:0/621909300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40aeea0 msgr2=0x7f8be40c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40aeea0 0x7f8be40c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 -- 172.21.15.6:0/621909300 >> v1:172.21.15.6:6789/0 conn(0x7f8be40af270 legacy=0x7f8be40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be159a700 1 -- 172.21.15.6:0/621909300 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294162791 0 0) 0x7f8be406aae0 con 0x7f8be40af270 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 -- 172.21.15.6:0/621909300 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be406a490 con 0x7f8be40c8410 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be2d9d700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8410 0x7f8be40c2e60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009e60 tx=0x7f8bd4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaafb792c1bdc41e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be159a700 1 -- 172.21.15.6:0/621909300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400e070 con 0x7f8be40c8410 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be159a700 1 -- 172.21.15.6:0/621909300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400bcc0 con 0x7f8be40c8410 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.031+0000 7f8be159a700 1 -- 172.21.15.6:0/621909300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4012680 con 0x7f8be40c8410 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 -- 172.21.15.6:0/621909300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8410 msgr2=0x7f8be40c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8410 0x7f8be40c2e60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009e60 tx=0x7f8bd4009780 comp rx=0 tx=0).stop 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 -- 172.21.15.6:0/621909300 shutdown_connections 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8410 0x7f8be40c2e60 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 --2- 172.21.15.6:0/621909300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40aeea0 0x7f8be40c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 -- 172.21.15.6:0/621909300 >> 172.21.15.6:0/621909300 conn(0x7f8be406c660 msgr2=0x7f8be40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 -- 172.21.15.6:0/621909300 shutdown_connections 2023-10-09T11:41:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.032+0000 7f8be889a700 1 -- 172.21.15.6:0/621909300 wait complete. 2023-10-09T11:41:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.033+0000 7f8be889a700 1 Processor -- start 2023-10-09T11:41:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.033+0000 7f8be889a700 1 -- start start 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 0x7f8be4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40c8410 0x7f8be41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be415c620 con 0x7f8be40aeea0 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be415ba10 con 0x7f8be40af270 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be889a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be415bcf0 con 0x7f8be40c8410 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46200/0 (socket says 172.21.15.6:46200) 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 -- 172.21.15.6:0/2467821066 learned_addr learned my addr 172.21.15.6:0/2467821066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be2d9d700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40c8410 0x7f8be41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be1d9b700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 0x7f8be4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 -- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40c8410 msgr2=0x7f8be41561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40c8410 0x7f8be41561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 -- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 msgr2=0x7f8be4155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 0x7f8be4155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4009a20 con 0x7f8be40aeea0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be1d9b700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 0x7f8be4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8be259c700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d860 tx=0x7f8bdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0125f0 con 0x7f8be40aeea0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.034+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc012750 con 0x7f8be40aeea0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.035+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc012b10 con 0x7f8be40aeea0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.035+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be415bfd0 con 0x7f8be40aeea0 2023-10-09T11:41:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.035+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be41504d0 con 0x7f8be40aeea0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.035+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be4067bc0 con 0x7f8be40aeea0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.036+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bdc01e460 con 0x7f8be40aeea0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.036+0000 7f8bda7fc700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.036+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bdc084ad0 con 0x7f8be40aeea0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.036+0000 7f8be1d9b700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.036+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7f8bc406ea50 con 0x7f8be40aeea0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.037+0000 7f8be1d9b700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 0x7f8bc40693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8be4069710 tx=0x7f8bcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.041+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bdc051d40 con 0x7f8be40aeea0 2023-10-09T11:41:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.236+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8be404bb80 con 0x7f8be40aeea0 2023-10-09T11:41:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.236+0000 7f8bda7fc700 1 -- 172.21.15.6:0/2467821066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v98) v1 ==== 81+0+32382 (secure 0 0 0) 0x7f8bdc055360 con 0x7f8be40aeea0 2023-10-09T11:41:11.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:11.238 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 98, 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:07.202095+0000", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:11.239 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:11.240 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:11.241 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:11.242 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:11.243 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:11.244 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:11.245 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:11.246 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:11.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:11.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:11.249 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:11.250 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:11.251 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:11.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:11.253 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:11.254 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:11.255 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:11.256 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:11.257 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:11.258 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.259 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:11.260 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:11.261 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.262 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.266 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:11.267 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:11.274 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.275 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.276 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.278 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.280 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:11.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:11.282 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.283 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:11.284 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.288 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.289 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:11.292 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.294 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.297 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:11.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.304 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:11.305 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:11.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:11.310 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.311 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.313 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:11.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:11.316 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:11.317 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:11.319 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.320 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.321 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:11.322 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:11.326 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 msgr2=0x7f8bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 0x7f8bc40693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8be4069710 tx=0x7f8bcc009040 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 msgr2=0x7f8be414ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d860 tx=0x7f8bdc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 shutdown_connections 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bc4066f30 0x7f8bc40693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8be40c8410 0x7f8be41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40aeea0 0x7f8be414ff90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 --2- 172.21.15.6:0/2467821066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8be40af270 0x7f8be4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.238+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 >> 172.21.15.6:0/2467821066 conn(0x7f8be406c660 msgr2=0x7f8be40c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.239+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 shutdown_connections 2023-10-09T11:41:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:11.239+0000 7f8be889a700 1 -- 172.21.15.6:0/2467821066 wait complete. 2023-10-09T11:41:11.329 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:41:15.914 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:41:15.913+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-09T11:41:16.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:16.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.460+0000 7f8b8e1bc700 1 Processor -- start 2023-10-09T11:41:16.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.460+0000 7f8b8e1bc700 1 -- start start 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b881578d0 0x7f8b880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b88157ca0 0x7f8b8815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b8806d120 0x7f8b8806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8806dac0 con 0x7f8b8806d120 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b880d07c0 con 0x7f8b881578d0 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b8e1bc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880cfbb0 con 0x7f8b88157ca0 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b8806d120 0x7f8b8806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b8806d120 0x7f8b8806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43236/0 (socket says 172.21.15.6:43236) 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 -- 172.21.15.6:0/1558082212 learned_addr learned my addr 172.21.15.6:0/1558082212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b877fe700 1 --2- 172.21.15.6:0/1558082212 >> v2:172.21.15.118:3300/0 conn(0x7f8b881578d0 0x7f8b880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b86ffd700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b88157ca0 0x7f8b8815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 -- 172.21.15.6:0/1558082212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b88157ca0 msgr2=0x7f8b8815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b88157ca0 0x7f8b8815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 -- 172.21.15.6:0/1558082212 >> v2:172.21.15.118:3300/0 conn(0x7f8b881578d0 msgr2=0x7f8b880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 --2- 172.21.15.6:0/1558082212 >> v2:172.21.15.118:3300/0 conn(0x7f8b881578d0 0x7f8b880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.461+0000 7f8b87fff700 1 -- 172.21.15.6:0/1558082212 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880cfe90 con 0x7f8b8806d120 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b87fff700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8806d120 0x7f8b8806d580 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b880646b0 tx=0x7f8b80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565424e40334b50e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b867fc700 1 -- 172.21.15.6:0/1558082212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000e070 con 0x7f8b8806d120 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b867fc700 1 -- 172.21.15.6:0/1558082212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8000b970 con 0x7f8b8806d120 2023-10-09T11:41:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b867fc700 1 -- 172.21.15.6:0/1558082212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800092e0 con 0x7f8b8806d120 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/1558082212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8806d120 msgr2=0x7f8b8806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8806d120 0x7f8b8806d580 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b880646b0 tx=0x7f8b80009840 comp rx=0 tx=0).stop 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/1558082212 shutdown_connections 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8806d120 0x7f8b8806d580 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/1558082212 >> v2:172.21.15.118:3300/0 conn(0x7f8b881578d0 0x7f8b880cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/1558082212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b88157ca0 0x7f8b8815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/1558082212 >> 172.21.15.6:0/1558082212 conn(0x7f8b8806bb90 msgr2=0x7f8b8806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/1558082212 shutdown_connections 2023-10-09T11:41:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.462+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/1558082212 wait complete. 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 Processor -- start 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 -- start start 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 0x7f8b88155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b88157ca0 0x7f8b88149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880aaf10 con 0x7f8b881578d0 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8816e030 con 0x7f8b88157ca0 2023-10-09T11:41:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b8e1bc700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8816e310 con 0x7f8b8806d120 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.464+0000 7f8b86ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43248/0 (socket says 172.21.15.6:43248) 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 -- 172.21.15.6:0/3157939635 learned_addr learned my addr 172.21.15.6:0/3157939635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b877fe700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 0x7f8b88155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b87fff700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b88157ca0 0x7f8b88149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 -- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 msgr2=0x7f8b88155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 0x7f8b88155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 -- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b88157ca0 msgr2=0x7f8b88149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b88157ca0 0x7f8b88149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009ae0 con 0x7f8b881578d0 2023-10-09T11:41:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b877fe700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 0x7f8b88155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b86ffd700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00e930 tx=0x7f8b7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00eed0 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00c850 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8816e5f0 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00cbf0 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.465+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8816dd20 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.466+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b880ab080 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.467+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b7c013470 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.467+0000 7f8b6f7fe700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 0x7f8b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.467+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b7c084760 con 0x7f8b881578d0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.467+0000 7f8b877fe700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 0x7f8b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.467+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=100}) v3 -- 0x7f8b7406ea50 con 0x7f8b881578d0 2023-10-09T11:41:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.468+0000 7f8b877fe700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 0x7f8b740693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b881593d0 tx=0x7f8b78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.472+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b7c021060 con 0x7f8b881578d0 2023-10-09T11:41:16.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.667+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8b880d0170 con 0x7f8b881578d0 2023-10-09T11:41:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.668+0000 7f8b6f7fe700 1 -- 172.21.15.6:0/3157939635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) v1 ==== 81+0+32390 (secure 0 0 0) 0x7f8b7c0519d0 con 0x7f8b881578d0 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 99, 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:11.915324+0000", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:16.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:16.671 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:16.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:16.673 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:16.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:16.676 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:16.677 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:16.679 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:16.680 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:16.681 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:16.682 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:16.683 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:16.684 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:16.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 3, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full", 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:16.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "96", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:16.688 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:16.689 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:16.690 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:16.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.692 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.694 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.696 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.697 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.699 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:16.701 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.704 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.705 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:16.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:16.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.713 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.714 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.717 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.718 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:16.721 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.722 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:16.723 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.724 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.727 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.728 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.729 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:16.730 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.732 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.734 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "full", 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:16.737 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:16.741 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:16.742 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull", 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.744 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:16.746 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.747 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.748 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:16.750 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:16.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:16.752 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 msgr2=0x7f8b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 0x7f8b740693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8b881593d0 tx=0x7f8b78008040 comp rx=0 tx=0).stop 2023-10-09T11:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 msgr2=0x7f8b8816d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00e930 tx=0x7f8b7c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 shutdown_connections 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b74066f30 0x7f8b740693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b88157ca0 0x7f8b88149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b8806d120 0x7f8b88155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 --2- 172.21.15.6:0/3157939635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b881578d0 0x7f8b8816d7e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 >> 172.21.15.6:0/3157939635 conn(0x7f8b8806bb90 msgr2=0x7f8b88069560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 shutdown_connections 2023-10-09T11:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:16.670+0000 7f8b8e1bc700 1 -- 172.21.15.6:0/3157939635 wait complete. 2023-10-09T11:41:16.755 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:41:20.915 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:41:20.914+0000 7ff16fb2a700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-09T11:41:21.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.887+0000 7ff4feb41700 1 Processor -- start 2023-10-09T11:41:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.887+0000 7ff4feb41700 1 -- start start 2023-10-09T11:41:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4feb41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4f806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4feb41700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f8069d10 con 0x7ff4f806c190 2023-10-09T11:41:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4feb41700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f815c130 con 0x7ff4f8157a60 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4feb41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f815c410 con 0x7ff4f80b3340 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4f806c190 0x7ff4f80b2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47792/0 (socket says 172.21.15.6:47792) 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f7fff700 1 -- 172.21.15.6:0/326161655 learned_addr learned my addr 172.21.15.6:0/326161655 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4fd0de700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4f806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706586618 0 0) 0x7ff4f8069d10 con 0x7ff4f806c190 2023-10-09T11:41:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e4003570 con 0x7ff4f806c190 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757934207 0 0) 0x7ff4e4003570 con 0x7ff4f806c190 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 msgr2=0x7ff4f806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4f806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 >> v1:172.21.15.118:6789/0 conn(0x7ff4f8157a60 legacy=0x7ff4f815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f815c6f0 con 0x7ff4f806c190 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ff4e80017f0 con 0x7ff4f806c190 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 >> v1:172.21.15.6:6789/0 conn(0x7ff4f806c190 legacy=0x7ff4f80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e4003a90 0x7ff4e4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4e4004810 0x7ff4e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4e40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f815c410 con 0x7ff4e4004810 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e400bb60 con 0x7ff4e4003a90 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.888+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e400bd20 con 0x7ff4f80b3340 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4e4004810 0x7ff4e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4fc8dd700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e4003a90 0x7ff4e4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4fd0de700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4e40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 -- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 msgr2=0x7ff4e40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f80b3340 0x7ff4e40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 -- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e4003a90 msgr2=0x7ff4e4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4e4003a90 0x7ff4e4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 -- 172.21.15.6:0/326161655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4003570 con 0x7ff4e4004810 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4e4004810 0x7ff4e4004c80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800a930 tx=0x7ff4e80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea10ed54525a5882 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80070d0 con 0x7ff4e4004810 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8007230 con 0x7ff4e4004810 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.889+0000 7ff4f77fe700 1 -- 172.21.15.6:0/326161655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80075d0 con 0x7ff4e4004810 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 -- 172.21.15.6:0/326161655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4e4004810 msgr2=0x7ff4e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 --2- 172.21.15.6:0/326161655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4e4004810 0x7ff4e4004c80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800a930 tx=0x7ff4e80021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4fd0de700 1 -- 172.21.15.6:0/326161655 reap_dead start 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 -- 172.21.15.6:0/326161655 shutdown_connections 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 -- 172.21.15.6:0/326161655 >> 172.21.15.6:0/326161655 conn(0x7ff4f806cca0 msgr2=0x7ff4f806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 -- 172.21.15.6:0/326161655 shutdown_connections 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.890+0000 7ff4feb41700 1 -- 172.21.15.6:0/326161655 wait complete. 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.891+0000 7ff4feb41700 1 Processor -- start 2023-10-09T11:41:21.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.891+0000 7ff4feb41700 1 -- start start 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e4004810 0x7ff4f80b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80cce00 0x7ff4f80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b1920 con 0x7ff4f80abea0 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80cd7b0 con 0x7ff4f80cce00 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4feb41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80acfb0 con 0x7ff4e4004810 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43266/0 (socket says 172.21.15.6:43266) 2023-10-09T11:41:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 -- 172.21.15.6:0/1317464846 learned_addr learned my addr 172.21.15.6:0/1317464846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4fd0de700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80cce00 0x7ff4f80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4fc8dd700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e4004810 0x7ff4f80b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 -- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e4004810 msgr2=0x7ff4f80b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e4004810 0x7ff4f80b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 -- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80cce00 msgr2=0x7ff4f80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80cce00 0x7ff4f80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.892+0000 7ff4f7fff700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f81522a0 con 0x7ff4f80abea0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4f7fff700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800a290 tx=0x7ff4e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80075b0 con 0x7ff4f80abea0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8001250 con 0x7ff4f80abea0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80b2200 con 0x7ff4f80abea0 2023-10-09T11:41:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80276c0 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.893+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80ac680 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.894+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80ad0f0 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.894+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4e8024070 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.895+0000 7ff4f4ff9700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.895+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4e8086610 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.895+0000 7ff4fc8dd700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.895+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=103}) v3 -- 0x7ff4d806ea50 con 0x7ff4f80abea0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.895+0000 7ff4fc8dd700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0003c00 tx=0x7ff4f0007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.899+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4f80ad0f0 con 0x7ff4f80abea0 2023-10-09T11:41:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.947+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(103..103 src has 1..103) v4 ==== 1460+0+0 (secure 0 0 0) 0x7ff4e8057c40 con 0x7ff4f80abea0 2023-10-09T11:41:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:21.947+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=104}) v3 -- 0x7ff4d806fca0 con 0x7ff4f80abea0 2023-10-09T11:41:22.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.093+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff4f80ad0f0 con 0x7ff4f80abea0 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.094+0000 7ff4f4ff9700 1 -- 172.21.15.6:0/1317464846 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+32219 (secure 0 0 0) 0x7ff4f80ad0f0 con 0x7ff4f80abea0 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 103, 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:21.943811+0000", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:22.097 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.098 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.099 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.100 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.101 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.102 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:22.104 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.105 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.107 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.108 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:22.112 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.115 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.116 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.117 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:22.119 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.120 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:22.122 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:22.123 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.124 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.126 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.128 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:22.130 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.132 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.134 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.137 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:22.138 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:22.141 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.142 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.143 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.144 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:22.145 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:22.148 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:22.149 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.150 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:22.151 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:22.163 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.164 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:22.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:22.169 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:22.170 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.171 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:22.172 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.174 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.175 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:22.177 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:22.178 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:22.179 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:22.179 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:22.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.179 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 msgr2=0x7ff4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0003c00 tx=0x7ff4f0007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 msgr2=0x7ff4f8151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800a290 tx=0x7ff4e8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 shutdown_connections 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80cce00 0x7ff4f80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4e4004810 0x7ff4f80b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 --2- 172.21.15.6:0/1317464846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f80abea0 0x7ff4f8151d60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.096+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 >> 172.21.15.6:0/1317464846 conn(0x7ff4f806cca0 msgr2=0x7ff4f806e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.097+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 shutdown_connections 2023-10-09T11:41:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.097+0000 7ff4feb41700 1 -- 172.21.15.6:0/1317464846 wait complete. 2023-10-09T11:41:22.182 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T11:41:22.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:41:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.299+0000 7fb459f3e700 1 Processor -- start 2023-10-09T11:41:22.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.299+0000 7fb459f3e700 1 -- start start 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb459f3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb459f3e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb454068cc0 0x7fb4540cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb459f3e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540cee10 con 0x7fb454159b40 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb459f3e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb454069140 con 0x7fb454068cc0 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb459f3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540cd040 con 0x7fb454159f10 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb458f3c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb454159b40 0x7fb4540cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47800/0 (socket says 172.21.15.6:47800) 2023-10-09T11:41:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb458f3c700 1 -- 172.21.15.6:0/3526978576 learned_addr learned my addr 172.21.15.6:0/3526978576 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb45973d700 1 --2- 172.21.15.6:0/3526978576 >> v2:172.21.15.6:3300/0 conn(0x7fb454068cc0 0x7fb4540cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb453fff700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb4537fe700 1 -- 172.21.15.6:0/3526978576 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235918237 0 0) 0x7fb4540cee10 con 0x7fb454159b40 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb4537fe700 1 -- 172.21.15.6:0/3526978576 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003570 con 0x7fb454159b40 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb45973d700 1 -- 172.21.15.6:0/3526978576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 msgr2=0x7fb454068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb45973d700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb45973d700 1 -- 172.21.15.6:0/3526978576 >> v1:172.21.15.6:6789/0 conn(0x7fb454159b40 legacy=0x7fb4540cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.300+0000 7fb45973d700 1 -- 172.21.15.6:0/3526978576 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540cd320 con 0x7fb454068cc0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb453fff700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb45973d700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454068cc0 0x7fb4540cf2a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0098e0 tx=0x7fb43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17342952663982cd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb4537fe700 1 -- 172.21.15.6:0/3526978576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00b640 con 0x7fb454068cc0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb4537fe700 1 -- 172.21.15.6:0/3526978576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00b7a0 con 0x7fb454068cc0 2023-10-09T11:41:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb4537fe700 1 -- 172.21.15.6:0/3526978576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00bb40 con 0x7fb454068cc0 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 -- 172.21.15.6:0/3526978576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454068cc0 msgr2=0x7fb4540cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454068cc0 0x7fb4540cf2a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0098e0 tx=0x7fb43c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 -- 172.21.15.6:0/3526978576 shutdown_connections 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454068cc0 0x7fb4540cf2a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3526978576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 -- 172.21.15.6:0/3526978576 >> 172.21.15.6:0/3526978576 conn(0x7fb4540cd660 msgr2=0x7fb4540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 -- 172.21.15.6:0/3526978576 shutdown_connections 2023-10-09T11:41:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.301+0000 7fb459f3e700 1 -- 172.21.15.6:0/3526978576 wait complete. 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.302+0000 7fb459f3e700 1 Processor -- start 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 -- start start 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 0x7fb45416d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b3990 con 0x7fb454159b40 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b4510 con 0x7fb454068cc0 2023-10-09T11:41:22.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb459f3e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b3be0 con 0x7fb454159f10 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb453fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.303+0000 7fb453fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43290/0 (socket says 172.21.15.6:43290) 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 -- 172.21.15.6:0/3193280077 learned_addr learned my addr 172.21.15.6:0/3193280077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb458f3c700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 0x7fb45416d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb45973d700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 -- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 msgr2=0x7fb454169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 -- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 msgr2=0x7fb45416d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 0x7fb45416d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 -- 172.21.15.6:0/3193280077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009420 con 0x7fb454159b40 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb458f3c700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 0x7fb45416d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb45973d700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:22.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb453fff700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb44400d180 tx=0x7fb4440099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400de20 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400f040 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4540b3ec0 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444015670 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.304+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45416dc80 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.305+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4540b4680 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.306+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb444015aa0 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.306+0000 7fb450ff9700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 0x7fb4340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.306+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4440848f0 con 0x7fb454159b40 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.306+0000 7fb458f3c700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 0x7fb4340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.306+0000 7fb458f3c700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 0x7fb4340693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb44c007fd0 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.310+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb44404e5a0 con 0x7fb454159b40 2023-10-09T11:41:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.502+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb454063e90 con 0x7fb454159b40 2023-10-09T11:41:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.503+0000 7fb450ff9700 1 -- 172.21.15.6:0/3193280077 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+32219 (secure 0 0 0) 0x7fb44401a090 con 0x7fb454159b40 2023-10-09T11:41:22.505 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:22.505 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:22.505 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 103, 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:41:21.943811+0000", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:41:22.506 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 13, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:41:22.507 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.508 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.509 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.510 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.511 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:41:22.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 12, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:49.900396+0000", 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.514 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.515 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.516 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.519 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 13, 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:40:50.465059+0000", 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:41:22.520 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:41:22.521 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:41:22.522 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:41:22.523 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:41:22.524 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:41:22.525 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.526 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.528 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.529 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.530 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:41:22.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.533 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:41:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.536 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.538 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:41:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:41:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.545 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.546 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.547 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.550 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.551 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:41:22.555 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:41:22.556 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.557 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:41:22.558 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:41:22.562 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.563 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.566 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:41:22.568 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:41:22.569 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 93, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:41:22.570 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.571 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.572 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:41:22.574 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.575 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:41:22.576 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.578 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:41:22.580 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.581 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:41:22.582 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:41:22.583 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:41:22.584 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:41:22.584 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:22.584 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 msgr2=0x7fb4340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 0x7fb4340693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb44c007fd0 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 msgr2=0x7fb45415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb44400d180 tx=0x7fb4440099f0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 shutdown_connections 2023-10-09T11:41:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb434066f30 0x7fb4340693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb454159f10 0x7fb454169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb454068cc0 0x7fb45416d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 --2- 172.21.15.6:0/3193280077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb454159b40 0x7fb45415b100 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 >> 172.21.15.6:0/3193280077 conn(0x7fb4540cd660 msgr2=0x7fb4540c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 shutdown_connections 2023-10-09T11:41:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.506+0000 7fb459f3e700 1 -- 172.21.15.6:0/3193280077 wait complete. 2023-10-09T11:41:22.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:22.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.704+0000 7f9b6282a700 1 Processor -- start 2023-10-09T11:41:22.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.704+0000 7f9b6282a700 1 -- start start 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b6282a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b5c1578d0 0x7f9b5c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b6282a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0d07c0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b6282a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0cfbb0 con 0x7f9b5c06d120 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b6282a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cfe90 con 0x7f9b5c1578d0 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9b5c1578d0 0x7f9b5c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9b5c157ca0 0x7f9b5c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47812/0 (socket says 172.21.15.6:47812) 2023-10-09T11:41:22.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5b7fe700 1 -- 172.21.15.6:0/3878792878 learned_addr learned my addr 172.21.15.6:0/3878792878 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5bfff700 1 -- 172.21.15.6:0/3878792878 >> v1:172.21.15.118:6789/0 conn(0x7f9b5c06d120 legacy=0x7f9b5c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5bfff700 1 -- 172.21.15.6:0/3878792878 >> v1:172.21.15.6:6789/0 conn(0x7f9b5c157ca0 legacy=0x7f9b5c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5bfff700 1 -- 172.21.15.6:0/3878792878 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0d0170 con 0x7f9b5c1578d0 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5affd700 1 -- 172.21.15.6:0/3878792878 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246588129 0 0) 0x7f9b5c0d07c0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.705+0000 7f9b5bfff700 1 --2- 172.21.15.6:0/3878792878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c1578d0 0x7f9b5c0cf4f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9b440098e0 tx=0x7f9b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945d790537f52fd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b5affd700 1 -- 172.21.15.6:0/3878792878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44009e80 con 0x7f9b5c1578d0 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b5affd700 1 -- 172.21.15.6:0/3878792878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400b820 con 0x7f9b5c1578d0 2023-10-09T11:41:22.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b5affd700 1 -- 172.21.15.6:0/3878792878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400bba0 con 0x7f9b5c1578d0 2023-10-09T11:41:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 -- 172.21.15.6:0/3878792878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c1578d0 msgr2=0x7f9b5c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 --2- 172.21.15.6:0/3878792878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c1578d0 0x7f9b5c0cf4f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9b440098e0 tx=0x7f9b440091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 -- 172.21.15.6:0/3878792878 shutdown_connections 2023-10-09T11:41:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 --2- 172.21.15.6:0/3878792878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c1578d0 0x7f9b5c0cf4f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 -- 172.21.15.6:0/3878792878 >> 172.21.15.6:0/3878792878 conn(0x7f9b5c06bb90 msgr2=0x7f9b5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 -- 172.21.15.6:0/3878792878 shutdown_connections 2023-10-09T11:41:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.706+0000 7f9b6282a700 1 -- 172.21.15.6:0/3878792878 wait complete. 2023-10-09T11:41:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.707+0000 7f9b6282a700 1 Processor -- start 2023-10-09T11:41:22.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 -- start start 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 0x7f9b5c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 0x7f9b5c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 0x7f9b5c16aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b51c0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b68d0 con 0x7f9b5c06d120 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b6282a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c16b610 con 0x7f9b5c1578d0 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.708+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 0x7f9b5c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 0x7f9b5c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 0x7f9b5c0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:39278/0 (socket says 172.21.15.6:39278) 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 0x7f9b5c1539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:37744/0 (socket says 172.21.15.6:37744) 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b5bfff700 1 -- 172.21.15.6:0/519103369 learned_addr learned my addr 172.21.15.6:0/519103369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 0x7f9b5c16aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 -- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 msgr2=0x7f9b5c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 0x7f9b5c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 -- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 msgr2=0x7f9b5c0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 0x7f9b5c0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 -- 172.21.15.6:0/519103369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009420 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b60dc7700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 0x7f9b5c16aa30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c810 tx=0x7f9b54002620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54012630 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b540127b0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54012b70 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c16b8f0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.709+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c0b4e50 con 0x7f9b5c157ca0 2023-10-09T11:41:22.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.710+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c067ac0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.711+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b5401a3b0 con 0x7f9b5c157ca0 2023-10-09T11:41:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.711+0000 7f9b53fff700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 0x7f9b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.711+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b54084170 con 0x7f9b5c157ca0 2023-10-09T11:41:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.711+0000 7f9b5bfff700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 0x7f9b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.712+0000 7f9b5bfff700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 0x7f9b3c0693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b440091e0 tx=0x7f9b44016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.715+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b54054e70 con 0x7f9b5c157ca0 2023-10-09T11:41:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.951+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b5c0d0450 con 0x7f9b5c157ca0 2023-10-09T11:41:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.951+0000 7f9b53fff700 1 -- 172.21.15.6:0/519103369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9b54054a00 con 0x7f9b5c157ca0 2023-10-09T11:41:22.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:22.953 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 msgr2=0x7f9b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 0x7f9b3c0693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9b440091e0 tx=0x7f9b44016000 comp rx=0 tx=0).stop 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 msgr2=0x7f9b5c16aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 0x7f9b5c16aa30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c810 tx=0x7f9b54002620 comp rx=0 tx=0).stop 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 shutdown_connections 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9b3c066f30 0x7f9b3c0693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b5c157ca0 0x7f9b5c16aa30 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b5c06d120 0x7f9b5c0b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 --2- 172.21.15.6:0/519103369 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9b5c1578d0 0x7f9b5c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 >> 172.21.15.6:0/519103369 conn(0x7f9b5c06bb90 msgr2=0x7f9b5c15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 shutdown_connections 2023-10-09T11:41:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:22.953+0000 7f9b6282a700 1 -- 172.21.15.6:0/519103369 wait complete. 2023-10-09T11:41:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:22.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:41:23.109 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":6336,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.003968352000001,"mdsmap_epoch":52,"osdmap_epoch":103,"osdmap_epoch_barrier":98,"uptime":35.935900199999999} 2023-10-09T11:41:23.109 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 6336, "mdsmap_epoch": 52, "osdmap_epoch": 103, "osdmap_epoch_barrier": 98, "rank_uptime": 31.003968352, "state": "up:active", "uptime": 35.9359002, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:41:23.109 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:41:23.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:23.109 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T11:41:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:41:23.400 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:41:23.400 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.273451 s, 192 MB/s 2023-10-09T11:41:23.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:23.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:23.437 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:23.480 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:23.480 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:41:23.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:23.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:23.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:41:23.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:23.552 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:41:23.567 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:41:23.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:23.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:23.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:41:23.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:23.602 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:41:23.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:23.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.774+0000 7f7dce1c6700 1 Processor -- start 2023-10-09T11:41:23.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.774+0000 7f7dce1c6700 1 -- start start 2023-10-09T11:41:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dce1c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806f200 0x7f7dc80cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dce1c6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7dc8154720 0x7f7dc80cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dce1c6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80b2c20 con 0x7f7dc8154350 2023-10-09T11:41:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dce1c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc8157010 con 0x7f7dc806f200 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dce1c6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80b2f00 con 0x7f7dc8154720 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dcc9c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806f200 0x7f7dc80cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dcc9c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806f200 0x7f7dc80cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44626/0 (socket says 172.21.15.6:44626) 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.775+0000 7f7dcc9c3700 1 -- 172.21.15.6:0/1196702036 learned_addr learned my addr 172.21.15.6:0/1196702036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcd9c5700 1 --2- 172.21.15.6:0/1196702036 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8154720 0x7f7dc80cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcc9c3700 1 -- 172.21.15.6:0/1196702036 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8154720 msgr2=0x7f7dc80cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcc9c3700 1 --2- 172.21.15.6:0/1196702036 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8154720 0x7f7dc80cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcc9c3700 1 -- 172.21.15.6:0/1196702036 >> v1:172.21.15.118:6789/0 conn(0x7f7dc8154350 legacy=0x7f7dc815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcc9c3700 1 -- 172.21.15.6:0/1196702036 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80b31e0 con 0x7f7dc806f200 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dcc9c3700 1 --2- 172.21.15.6:0/1196702036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc80cd040 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b37a0 tx=0x7f7dbc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3602a73ef891b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dc7fff700 1 -- 172.21.15.6:0/1196702036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00dc10 con 0x7f7dc806f200 2023-10-09T11:41:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dc7fff700 1 -- 172.21.15.6:0/1196702036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc00dd70 con 0x7f7dc806f200 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dc7fff700 1 -- 172.21.15.6:0/1196702036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0106c0 con 0x7f7dc806f200 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dce1c6700 1 -- 172.21.15.6:0/1196702036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 msgr2=0x7f7dc80cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.776+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/1196702036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc80cd040 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b37a0 tx=0x7f7dbc00b4f0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 -- 172.21.15.6:0/1196702036 shutdown_connections 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/1196702036 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8154720 0x7f7dc80cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/1196702036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc80cd040 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 -- 172.21.15.6:0/1196702036 >> 172.21.15.6:0/1196702036 conn(0x7f7dc8063230 msgr2=0x7f7dc8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 -- 172.21.15.6:0/1196702036 shutdown_connections 2023-10-09T11:41:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.777+0000 7f7dce1c6700 1 -- 172.21.15.6:0/1196702036 wait complete. 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.778+0000 7f7dce1c6700 1 Processor -- start 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.778+0000 7f7dce1c6700 1 -- start start 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.778+0000 7f7dce1c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8154350 0x7f7dc8157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 0x7f7dc80ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80c7c70 con 0x7f7dc806f200 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8157ec0 con 0x7f7dc8154720 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc81581a0 con 0x7f7dc8154350 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcc9c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8154350 0x7f7dc8157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44640/0 (socket says 172.21.15.6:44640) 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 -- 172.21.15.6:0/464750441 learned_addr learned my addr 172.21.15.6:0/464750441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd9c5700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 0x7f7dc80ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 -- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8154350 msgr2=0x7f7dc8157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8154350 0x7f7dc8157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 -- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 msgr2=0x7f7dc80ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 0x7f7dc80ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 -- 172.21.15.6:0/464750441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc00b790 con 0x7f7dc806f200 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd9c5700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 0x7f7dc80ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dcd1c4700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c950 tx=0x7f7dc0002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0012630 con 0x7f7dc806f200 2023-10-09T11:41:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc0012790 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc8158480 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0012b50 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.779+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc814ee30 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.781+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80690d0 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.781+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dc000a420 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.781+0000 7f7dc57fa700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.781+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dc00849d0 con 0x7f7dc806f200 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.781+0000 7f7dcc9c3700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.782+0000 7f7dcc9c3700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b37a0 tx=0x7f7dbc01a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:23.785+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc0051c40 con 0x7f7dc806f200 2023-10-09T11:41:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.027+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc80c7db0 con 0x7f7dc806f200 2023-10-09T11:41:24.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.027+0000 7f7dc57fa700 1 -- 172.21.15.6:0/464750441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7dc0055260 con 0x7f7dc806f200 2023-10-09T11:41:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:24.029 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:24.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.029+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 msgr2=0x7f7db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.029+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80b37a0 tx=0x7f7dbc01a000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.029+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 msgr2=0x7f7dc814e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.029+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000c950 tx=0x7f7dc0002760 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 shutdown_connections 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc8154720 0x7f7dc80ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806f200 0x7f7dc814e8f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 --2- 172.21.15.6:0/464750441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8154350 0x7f7dc8157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 >> 172.21.15.6:0/464750441 conn(0x7f7dc8063230 msgr2=0x7f7dc80cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 shutdown_connections 2023-10-09T11:41:24.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.030+0000 7f7dce1c6700 1 -- 172.21.15.6:0/464750441 wait complete. 2023-10-09T11:41:24.033 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:24.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.164+0000 7f00f1edd700 1 Processor -- start 2023-10-09T11:41:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.164+0000 7f00f1edd700 1 -- start start 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00f1edd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec157ca0 0x7f00ec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00f1edd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00ec06d120 0x7f00ec06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00f1edd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec06dac0 con 0x7f00ec1578d0 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00f1edd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec0d07c0 con 0x7f00ec06d120 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00f1edd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0cfbb0 con 0x7f00ec157ca0 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00eb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f00ec1578d0 0x7f00ec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47630/0 (socket says 172.21.15.6:47630) 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00eb7fe700 1 -- 172.21.15.6:0/2763220215 learned_addr learned my addr 172.21.15.6:0/2763220215 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 --2- 172.21.15.6:0/2763220215 >> v2:172.21.15.6:3300/0 conn(0x7f00ec06d120 0x7f00ec06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00eaffd700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec157ca0 0x7f00ec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ea7fc700 1 -- 172.21.15.6:0/2763220215 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363786662 0 0) 0x7f00e4001110 con 0x7f00ec1578d0 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ea7fc700 1 -- 172.21.15.6:0/2763220215 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d8003570 con 0x7f00ec1578d0 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 -- 172.21.15.6:0/2763220215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec157ca0 msgr2=0x7f00ec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec157ca0 0x7f00ec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 -- 172.21.15.6:0/2763220215 >> v1:172.21.15.6:6789/0 conn(0x7f00ec1578d0 legacy=0x7f00ec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 -- 172.21.15.6:0/2763220215 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0cfe90 con 0x7f00ec06d120 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ebfff700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec06d120 0x7f00ec06d580 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009e60 tx=0x7f00dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466882cc552581c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ea7fc700 1 -- 172.21.15.6:0/2763220215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00e070 con 0x7f00ec06d120 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.165+0000 7f00ea7fc700 1 -- 172.21.15.6:0/2763220215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc00bab0 con 0x7f00ec06d120 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00ea7fc700 1 -- 172.21.15.6:0/2763220215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00be70 con 0x7f00ec06d120 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 -- 172.21.15.6:0/2763220215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec06d120 msgr2=0x7f00ec06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec06d120 0x7f00ec06d580 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009e60 tx=0x7f00dc009780 comp rx=0 tx=0).stop 2023-10-09T11:41:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 -- 172.21.15.6:0/2763220215 shutdown_connections 2023-10-09T11:41:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec06d120 0x7f00ec06d580 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 --2- 172.21.15.6:0/2763220215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec157ca0 0x7f00ec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 -- 172.21.15.6:0/2763220215 >> 172.21.15.6:0/2763220215 conn(0x7f00ec06bb90 msgr2=0x7f00ec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 -- 172.21.15.6:0/2763220215 shutdown_connections 2023-10-09T11:41:24.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.166+0000 7f00f1edd700 1 -- 172.21.15.6:0/2763220215 wait complete. 2023-10-09T11:41:24.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.167+0000 7f00f1edd700 1 Processor -- start 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.167+0000 7f00f1edd700 1 -- start start 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 0x7f00ec0ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 0x7f00ec0adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0af9e0 con 0x7f00ec157ca0 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0ab460 con 0x7f00ec1578d0 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00f1edd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0ab740 con 0x7f00ec06d120 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44664/0 (socket says 172.21.15.6:44664) 2023-10-09T11:41:24.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00ebfff700 1 -- 172.21.15.6:0/3401803128 learned_addr learned my addr 172.21.15.6:0/3401803128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.168+0000 7f00eb7fe700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 0x7f00ec0ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00eaffd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 0x7f00ec0adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 -- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 msgr2=0x7f00ec0ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 0x7f00ec0ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 -- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 msgr2=0x7f00ec0adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 0x7f00ec0adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 -- 172.21.15.6:0/3401803128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009a20 con 0x7f00ec157ca0 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00eb7fe700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 0x7f00ec0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00eaffd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 0x7f00ec0adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00ebfff700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f00ec06fe20 tx=0x7f00dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc027470 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0275f0 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec0aba20 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0279b0 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.169+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec0abfe0 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.170+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec0ac200 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.170+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00dc024070 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.171+0000 7f00e37fe700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.171+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00dc086cc0 con 0x7f00ec157ca0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.171+0000 7f00eb7fe700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.171+0000 7f00eb7fe700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 0x7f00cc0693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001270 tx=0x7f00e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.175+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00dc053f30 con 0x7f00ec157ca0 2023-10-09T11:41:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.370+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00ec0d0170 con 0x7f00ec157ca0 2023-10-09T11:41:24.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.371+0000 7f00e37fe700 1 -- 172.21.15.6:0/3401803128 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15309 (secure 0 0 0) 0x7f00dc057550 con 0x7f00ec157ca0 2023-10-09T11:41:24.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:24.373 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":103,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:21.943811+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 msgr2=0x7f00cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 0x7f00cc0693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00e4001270 tx=0x7f00e4009040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 msgr2=0x7f00ec16d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f00ec06fe20 tx=0x7f00dc019000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 shutdown_connections 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f00cc066f30 0x7f00cc0693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00ec157ca0 0x7f00ec16d9c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f00ec06d120 0x7f00ec0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 --2- 172.21.15.6:0/3401803128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00ec1578d0 0x7f00ec0adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 >> 172.21.15.6:0/3401803128 conn(0x7f00ec06bb90 msgr2=0x7f00ec155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 shutdown_connections 2023-10-09T11:41:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.373+0000 7f00f1edd700 1 -- 172.21.15.6:0/3401803128 wait complete. 2023-10-09T11:41:24.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:40:49.900396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:40:50.465059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:24.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.506+0000 7ffa63923700 1 Processor -- start 2023-10-09T11:41:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.506+0000 7ffa63923700 1 -- start start 2023-10-09T11:41:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa63923700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa63923700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffa5c157ca0 0x7ffa5c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa63923700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0d07c0 con 0x7ffa5c06d120 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa63923700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0cfbb0 con 0x7ffa5c157ca0 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa63923700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0cfe90 con 0x7ffa5c1578d0 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa616bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.507+0000 7ffa60ebe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffa5c157ca0 0x7ffa5c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffa5c157ca0 0x7ffa5c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:49260/0 (socket says 172.21.15.6:49260) 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa616bf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:35082/0 (socket says 172.21.15.6:35082) 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 -- 172.21.15.6:0/482250880 learned_addr learned my addr 172.21.15.6:0/482250880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa61ec0700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ffa5c06d120 0x7ffa5c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37004/0 (socket says 172.21.15.6:37004) 2023-10-09T11:41:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 -- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 msgr2=0x7ffa5c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 -- 172.21.15.6:0/482250880 >> v1:172.21.15.118:6789/0 conn(0x7ffa5c06d120 legacy=0x7ffa5c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 -- 172.21.15.6:0/482250880 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0d0170 con 0x7ffa5c157ca0 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa616bf700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa60ebe700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c15af00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41e9d92737b9047b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa5bfff700 1 -- 172.21.15.6:0/482250880 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50009ea0 con 0x7ffa5c157ca0 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa5bfff700 1 -- 172.21.15.6:0/482250880 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000b860 con 0x7ffa5c157ca0 2023-10-09T11:41:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.508+0000 7ffa5bfff700 1 -- 172.21.15.6:0/482250880 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000bc00 con 0x7ffa5c157ca0 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 -- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 msgr2=0x7ffa5c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c15af00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50009250 comp rx=0 tx=0).stop 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 -- 172.21.15.6:0/482250880 shutdown_connections 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c1578d0 0x7ffa5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 --2- 172.21.15.6:0/482250880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c15af00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 -- 172.21.15.6:0/482250880 >> 172.21.15.6:0/482250880 conn(0x7ffa5c06bb90 msgr2=0x7ffa5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 -- 172.21.15.6:0/482250880 shutdown_connections 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.509+0000 7ffa63923700 1 -- 172.21.15.6:0/482250880 wait complete. 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.510+0000 7ffa63923700 1 Processor -- start 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.510+0000 7ffa63923700 1 -- start start 2023-10-09T11:41:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c06d120 0x7ffa5c16afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c16b510 con 0x7ffa5c1578d0 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0ccba0 con 0x7ffa5c157ca0 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa63923700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0cce80 con 0x7ffa5c06d120 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44672/0 (socket says 172.21.15.6:44672) 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 -- 172.21.15.6:0/716132385 learned_addr learned my addr 172.21.15.6:0/716132385 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa61ec0700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa616bf700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c06d120 0x7ffa5c16afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 -- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c06d120 msgr2=0x7ffa5c16afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c06d120 0x7ffa5c16afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 -- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 msgr2=0x7ffa5c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.511+0000 7ffa60ebe700 1 -- 172.21.15.6:0/716132385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54009420 con 0x7ffa5c1578d0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa60ebe700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c06fe20 tx=0x7ffa50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000bbe0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50011420 con 0x7ffa5c1578d0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa500094f0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500117c0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.512+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0cd440 con 0x7ffa5c1578d0 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.513+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c067ac0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.513+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa50011bb0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.513+0000 7ffa597fa700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 0x7ffa480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.514+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa50085e40 con 0x7ffa5c1578d0 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.514+0000 7ffa616bf700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 0x7ffa480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.514+0000 7ffa616bf700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 0x7ffa480693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa540093f0 tx=0x7ffa54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.518+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa500530b0 con 0x7ffa5c1578d0 2023-10-09T11:41:24.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.709+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa5c0d0450 con 0x7ffa5c1578d0 2023-10-09T11:41:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.709+0000 7ffa597fa700 1 -- 172.21.15.6:0/716132385 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa50011e60 con 0x7ffa5c1578d0 2023-10-09T11:41:24.711 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:41:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 msgr2=0x7ffa480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 0x7ffa480693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa540093f0 tx=0x7ffa54008040 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 msgr2=0x7ffa5c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c06fe20 tx=0x7ffa50017000 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 shutdown_connections 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa48066f30 0x7ffa480693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa5c157ca0 0x7ffa5c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa5c06d120 0x7ffa5c16afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 --2- 172.21.15.6:0/716132385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c1578d0 0x7ffa5c0cc0c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 >> 172.21.15.6:0/716132385 conn(0x7ffa5c06bb90 msgr2=0x7ffa5c1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 shutdown_connections 2023-10-09T11:41:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.712+0000 7ffa63923700 1 -- 172.21.15.6:0/716132385 wait complete. 2023-10-09T11:41:24.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.845+0000 7f8f518d5700 1 Processor -- start 2023-10-09T11:41:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.845+0000 7f8f518d5700 1 -- start start 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f518d5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 0x7f8f4c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f518d5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8f4c06dd60 0x7f8f4c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f518d5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0cf4e0 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f518d5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c06ea90 con 0x7f8f4c06dd60 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f518d5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0b0ca0 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8f4c0ceb30 0x7f8f4c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47636/0 (socket says 172.21.15.6:47636) 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4a7fc700 1 -- 172.21.15.6:0/4063862366 learned_addr learned my addr 172.21.15.6:0/4063862366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4affd700 1 --2- 172.21.15.6:0/4063862366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 0x7f8f4c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4b7fe700 1 --2- 172.21.15.6:0/4063862366 >> v2:172.21.15.118:3300/0 conn(0x7f8f4c06dd60 0x7f8f4c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f49ffb700 1 -- 172.21.15.6:0/4063862366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633482606 0 0) 0x7f8f4c0cf4e0 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f49ffb700 1 -- 172.21.15.6:0/4063862366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f38003570 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4affd700 1 -- 172.21.15.6:0/4063862366 >> v2:172.21.15.118:3300/0 conn(0x7f8f4c06dd60 msgr2=0x7f8f4c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4affd700 1 --2- 172.21.15.6:0/4063862366 >> v2:172.21.15.118:3300/0 conn(0x7f8f4c06dd60 0x7f8f4c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4affd700 1 -- 172.21.15.6:0/4063862366 >> v1:172.21.15.6:6789/0 conn(0x7f8f4c0ceb30 legacy=0x7f8f4c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.846+0000 7f8f4affd700 1 -- 172.21.15.6:0/4063862366 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0b00d0 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f4affd700 1 --2- 172.21.15.6:0/4063862366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 0x7f8f4c0b1130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009e60 tx=0x7f8f44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22e39b2e0e340c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f49ffb700 1 -- 172.21.15.6:0/4063862366 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400e070 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f49ffb700 1 -- 172.21.15.6:0/4063862366 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400bab0 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f49ffb700 1 -- 172.21.15.6:0/4063862366 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400be70 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 -- 172.21.15.6:0/4063862366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 msgr2=0x7f8f4c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 --2- 172.21.15.6:0/4063862366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 0x7f8f4c0b1130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009e60 tx=0x7f8f44009780 comp rx=0 tx=0).stop 2023-10-09T11:41:24.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 -- 172.21.15.6:0/4063862366 shutdown_connections 2023-10-09T11:41:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 --2- 172.21.15.6:0/4063862366 >> v2:172.21.15.118:3300/0 conn(0x7f8f4c06dd60 0x7f8f4c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 --2- 172.21.15.6:0/4063862366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c15a2a0 0x7f8f4c0b1130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 -- 172.21.15.6:0/4063862366 >> 172.21.15.6:0/4063862366 conn(0x7f8f4c067640 msgr2=0x7f8f4c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 -- 172.21.15.6:0/4063862366 shutdown_connections 2023-10-09T11:41:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.847+0000 7f8f518d5700 1 -- 172.21.15.6:0/4063862366 wait complete. 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.848+0000 7f8f518d5700 1 Processor -- start 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.848+0000 7f8f518d5700 1 -- start start 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c06dd60 0x7f8f4c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f4c15a2a0 0x7f8f4c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15d890 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15ee50 con 0x7f8f4c15a2a0 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f518d5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15e520 con 0x7f8f4c06dd60 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f4a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f4a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44688/0 (socket says 172.21.15.6:44688) 2023-10-09T11:41:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f4a7fc700 1 -- 172.21.15.6:0/275871739 learned_addr learned my addr 172.21.15.6:0/275871739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f4b7fe700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f4c15a2a0 0x7f8f4c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.849+0000 7f8f4affd700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c06dd60 0x7f8f4c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 -- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c06dd60 msgr2=0x7f8f4c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c06dd60 0x7f8f4c15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 -- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f4c15a2a0 msgr2=0x7f8f4c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f4c15a2a0 0x7f8f4c158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 -- 172.21.15.6:0/275871739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44009a20 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f4a7fc700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c7f0 tx=0x7f8f34007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34005cd0 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34005e50 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007320 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c15e800 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.850+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c147c70 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.851+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c069e40 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.851+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f3401b3b0 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.852+0000 7f8f42ffd700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 0x7f8f2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.852+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f34083bf0 con 0x7f8f4c0ceb30 2023-10-09T11:41:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.852+0000 7f8f4affd700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 0x7f8f2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.852+0000 7f8f4affd700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 0x7f8f2c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8f440097c0 tx=0x7f8f44019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:24.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:24.856+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f34050e60 con 0x7f8f4c0ceb30 2023-10-09T11:41:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.047+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f4c04bb80 con 0x7f8f4c0ceb30 2023-10-09T11:41:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.047+0000 7f8f42ffd700 1 -- 172.21.15.6:0/275871739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f34017020 con 0x7f8f4c0ceb30 2023-10-09T11:41:25.049 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:41:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 msgr2=0x7f8f2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 0x7f8f2c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8f440097c0 tx=0x7f8f44019000 comp rx=0 tx=0).stop 2023-10-09T11:41:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 msgr2=0x7f8f4c147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400c7f0 tx=0x7f8f34007e00 comp rx=0 tx=0).stop 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 shutdown_connections 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8f2c066f30 0x7f8f2c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f4c15a2a0 0x7f8f4c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f4c06dd60 0x7f8f4c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 --2- 172.21.15.6:0/275871739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c0ceb30 0x7f8f4c147730 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 >> 172.21.15.6:0/275871739 conn(0x7f8f4c067640 msgr2=0x7f8f4c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 shutdown_connections 2023-10-09T11:41:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.049+0000 7f8f518d5700 1 -- 172.21.15.6:0/275871739 wait complete. 2023-10-09T11:41:25.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.183+0000 7f5998f05700 1 Processor -- start 2023-10-09T11:41:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.183+0000 7f5998f05700 1 -- start start 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5998f05700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5994157ca0 0x7f59940cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5998f05700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f599406d120 0x7f599406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5998f05700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59940d07c0 con 0x7f59941578d0 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5998f05700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599406da50 con 0x7f5994157ca0 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5998f05700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59940cfbb0 con 0x7f599406d120 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5991d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5994157ca0 0x7f59940cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f599259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59941578d0 0x7f599415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47646/0 (socket says 172.21.15.6:47646) 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f599259c700 1 -- 172.21.15.6:0/3399229269 learned_addr learned my addr 172.21.15.6:0/3399229269 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5991d9b700 1 -- 172.21.15.6:0/3399229269 >> v2:172.21.15.118:3300/0 conn(0x7f599406d120 msgr2=0x7f599406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5992d9d700 1 --2- 172.21.15.6:0/3399229269 >> v2:172.21.15.118:3300/0 conn(0x7f599406d120 0x7f599406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f599159a700 1 -- 172.21.15.6:0/3399229269 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864110332 0 0) 0x7f59940d07c0 con 0x7f59941578d0 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5991d9b700 1 --2- 172.21.15.6:0/3399229269 >> v2:172.21.15.118:3300/0 conn(0x7f599406d120 0x7f599406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5991d9b700 1 -- 172.21.15.6:0/3399229269 >> v1:172.21.15.6:6789/0 conn(0x7f59941578d0 legacy=0x7f599415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.184+0000 7f5991d9b700 1 -- 172.21.15.6:0/3399229269 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940cfe90 con 0x7f5994157ca0 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5991d9b700 1 --2- 172.21.15.6:0/3399229269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59940cf4f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5994068300 tx=0x7f59880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8675009d3d24d9d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f599159a700 1 -- 172.21.15.6:0/3399229269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800b6b0 con 0x7f5994157ca0 2023-10-09T11:41:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f599159a700 1 -- 172.21.15.6:0/3399229269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800b810 con 0x7f5994157ca0 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f599159a700 1 -- 172.21.15.6:0/3399229269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800bbb0 con 0x7f5994157ca0 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 -- 172.21.15.6:0/3399229269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 msgr2=0x7f59940cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 --2- 172.21.15.6:0/3399229269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59940cf4f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5994068300 tx=0x7f59880091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 -- 172.21.15.6:0/3399229269 shutdown_connections 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 --2- 172.21.15.6:0/3399229269 >> v2:172.21.15.118:3300/0 conn(0x7f599406d120 0x7f599406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 --2- 172.21.15.6:0/3399229269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59940cf4f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 -- 172.21.15.6:0/3399229269 >> 172.21.15.6:0/3399229269 conn(0x7f599406bb90 msgr2=0x7f599406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 -- 172.21.15.6:0/3399229269 shutdown_connections 2023-10-09T11:41:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.185+0000 7f5998f05700 1 -- 172.21.15.6:0/3399229269 wait complete. 2023-10-09T11:41:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.186+0000 7f5998f05700 1 Processor -- start 2023-10-09T11:41:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.186+0000 7f5998f05700 1 -- start start 2023-10-09T11:41:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 0x7f59940aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59941578d0 0x7f59941605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599415f510 con 0x7f5994157ca0 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599415f7f0 con 0x7f599406d120 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5998f05700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599415fad0 con 0x7f59941578d0 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5992d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5992d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44702/0 (socket says 172.21.15.6:44702) 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5992d9d700 1 -- 172.21.15.6:0/4188169516 learned_addr learned my addr 172.21.15.6:0/4188169516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f599259c700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 0x7f59940aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.187+0000 7f5991d9b700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59941578d0 0x7f59941605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 -- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59941578d0 msgr2=0x7f59941605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59941578d0 0x7f59941605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 -- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 msgr2=0x7f59940aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 0x7f59940aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 -- 172.21.15.6:0/4188169516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009420 con 0x7f5994157ca0 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f599259c700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 0x7f59940aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5992d9d700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f598c00ceb0 tx=0x7f598c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c016430 con 0x7f5994157ca0 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c016590 con 0x7f5994157ca0 2023-10-09T11:41:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c016930 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599415fdb0 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.188+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5994160af0 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.189+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59941602d0 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.189+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f598c003020 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.190+0000 7f59827fc700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 0x7f59740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.190+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f598c012070 con 0x7f5994157ca0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.190+0000 7f599259c700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 0x7f59740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.190+0000 7f599259c700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 0x7f59740693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f59840011e0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.194+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59941602d0 con 0x7f5994157ca0 2023-10-09T11:41:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.386+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59941602d0 con 0x7f5994157ca0 2023-10-09T11:41:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.386+0000 7f59827fc700 1 -- 172.21.15.6:0/4188169516 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59941602d0 con 0x7f5994157ca0 2023-10-09T11:41:25.388 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 msgr2=0x7f59740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 0x7f59740693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f59840011e0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 msgr2=0x7f59941476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f598c00ceb0 tx=0x7f598c007870 comp rx=0 tx=0).stop 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 shutdown_connections 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5974066f30 0x7f59740693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5994157ca0 0x7f59941476e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f599406d120 0x7f59940aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 --2- 172.21.15.6:0/4188169516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59941578d0 0x7f59941605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 >> 172.21.15.6:0/4188169516 conn(0x7f599406bb90 msgr2=0x7f599406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 shutdown_connections 2023-10-09T11:41:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.388+0000 7f5998f05700 1 -- 172.21.15.6:0/4188169516 wait complete. 2023-10-09T11:41:25.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.519+0000 7f9a1b384700 1 Processor -- start 2023-10-09T11:41:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.519+0000 7f9a1b384700 1 -- start start 2023-10-09T11:41:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1b384700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a14157ca0 0x7f9a140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1b384700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140d07c0 con 0x7f9a1406d120 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1b384700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140cfbb0 con 0x7f9a141578d0 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1b384700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140cfe90 con 0x7f9a14157ca0 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1891f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a14157ca0 0x7f9a140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a19921700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a1406d120 0x7f9a1406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47648/0 (socket says 172.21.15.6:47648) 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a19921700 1 -- 172.21.15.6:0/1927923232 learned_addr learned my addr 172.21.15.6:0/1927923232 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1891f700 1 -- 172.21.15.6:0/1927923232 >> v1:172.21.15.118:6789/0 conn(0x7f9a141578d0 legacy=0x7f9a1415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1891f700 1 -- 172.21.15.6:0/1927923232 >> v1:172.21.15.6:6789/0 conn(0x7f9a1406d120 legacy=0x7f9a1406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1891f700 1 -- 172.21.15.6:0/1927923232 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140d0170 con 0x7f9a14157ca0 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a13fff700 1 -- 172.21.15.6:0/1927923232 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589294152 0 0) 0x7f9a140d07c0 con 0x7f9a1406d120 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a1891f700 1 --2- 172.21.15.6:0/1927923232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a14157ca0 0x7f9a140cf4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea829b9e9f9b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a13fff700 1 -- 172.21.15.6:0/1927923232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08009e80 con 0x7f9a14157ca0 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a13fff700 1 -- 172.21.15.6:0/1927923232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800b820 con 0x7f9a14157ca0 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.520+0000 7f9a13fff700 1 -- 172.21.15.6:0/1927923232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800bba0 con 0x7f9a14157ca0 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 -- 172.21.15.6:0/1927923232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a14157ca0 msgr2=0x7f9a140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 --2- 172.21.15.6:0/1927923232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a14157ca0 0x7f9a140cf4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 -- 172.21.15.6:0/1927923232 shutdown_connections 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 --2- 172.21.15.6:0/1927923232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a14157ca0 0x7f9a140cf4f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 -- 172.21.15.6:0/1927923232 >> 172.21.15.6:0/1927923232 conn(0x7f9a1406bb90 msgr2=0x7f9a1406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 -- 172.21.15.6:0/1927923232 shutdown_connections 2023-10-09T11:41:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.521+0000 7f9a1b384700 1 -- 172.21.15.6:0/1927923232 wait complete. 2023-10-09T11:41:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.522+0000 7f9a1b384700 1 Processor -- start 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.522+0000 7f9a1b384700 1 -- start start 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a141578d0 0x7f9a1408c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 0x7f9a141718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14089da0 con 0x7f9a1406d120 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14159950 con 0x7f9a141578d0 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1b384700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14089470 con 0x7f9a14157ca0 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44714/0 (socket says 172.21.15.6:44714) 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 -- 172.21.15.6:0/2896993806 learned_addr learned my addr 172.21.15.6:0/2896993806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a1891f700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a141578d0 0x7f9a1408c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19921700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 0x7f9a141718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 -- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 msgr2=0x7f9a141718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 0x7f9a141718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 -- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a141578d0 msgr2=0x7f9a1408c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a141578d0 0x7f9a1408c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19120700 1 -- 172.21.15.6:0/2896993806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009420 con 0x7f9a1406d120 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.523+0000 7f9a19921700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 0x7f9a141718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a19120700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c950 tx=0x7f9a04002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012630 con 0x7f9a1406d120 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04012790 con 0x7f9a1406d120 2023-10-09T11:41:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a14089750 con 0x7f9a1406d120 2023-10-09T11:41:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012b50 con 0x7f9a1406d120 2023-10-09T11:41:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.524+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a14171e30 con 0x7f9a1406d120 2023-10-09T11:41:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.525+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14067ac0 con 0x7f9a1406d120 2023-10-09T11:41:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.525+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a0400a420 con 0x7f9a1406d120 2023-10-09T11:41:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.526+0000 7f9a117fa700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.526+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a04084970 con 0x7f9a1406d120 2023-10-09T11:41:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.526+0000 7f9a1891f700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.526+0000 7f9a1891f700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 0x7f9a000693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a141580c0 tx=0x7f9a08016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.530+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a04051be0 con 0x7f9a1406d120 2023-10-09T11:41:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.770+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a140d0450 con 0x7f9a1406d120 2023-10-09T11:41:25.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.771+0000 7f9a117fa700 1 -- 172.21.15.6:0/2896993806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9a04055200 con 0x7f9a1406d120 2023-10-09T11:41:25.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:25.773 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 msgr2=0x7f9a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 0x7f9a000693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a141580c0 tx=0x7f9a08016000 comp rx=0 tx=0).stop 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 msgr2=0x7f9a1408be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c950 tx=0x7f9a04002760 comp rx=0 tx=0).stop 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 shutdown_connections 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9a00066f30 0x7f9a000693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9a14157ca0 0x7f9a141718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a1406d120 0x7f9a1408be90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 --2- 172.21.15.6:0/2896993806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a141578d0 0x7f9a1408c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 >> 172.21.15.6:0/2896993806 conn(0x7f9a1406bb90 msgr2=0x7f9a14155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 shutdown_connections 2023-10-09T11:41:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.773+0000 7f9a1b384700 1 -- 172.21.15.6:0/2896993806 wait complete. 2023-10-09T11:41:25.776 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:25.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:25.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.904+0000 7fe5ab915700 1 Processor -- start 2023-10-09T11:41:25.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.904+0000 7fe5ab915700 1 -- start start 2023-10-09T11:41:25.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5ab915700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 0x7fe5a415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5ab915700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a406d350 con 0x7fe5a40cae00 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5ab915700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40c9ac0 con 0x7fe5a40cb270 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5ab915700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a415a360 con 0x7fe5a415daa0 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5a8eb0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe5a40cae00 0x7fe5a4159540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47662/0 (socket says 172.21.15.6:47662) 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.905+0000 7fe5a8eb0700 1 -- 172.21.15.6:0/682496173 learned_addr learned my addr 172.21.15.6:0/682496173 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a96b1700 1 --2- 172.21.15.6:0/682496173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 0x7fe5a415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637498647 0 0) 0x7fe5a406d350 con 0x7fe5a40cae00 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c003570 con 0x7fe5a40cae00 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978412700 0 0) 0x7fe5a40c9ac0 con 0x7fe5a40cb270 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a406d350 con 0x7fe5a40cb270 2023-10-09T11:41:25.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a96b1700 1 -- 172.21.15.6:0/682496173 >> v1:172.21.15.118:6789/0 conn(0x7fe5a40cb270 legacy=0x7fe5a4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a96b1700 1 -- 172.21.15.6:0/682496173 >> v1:172.21.15.6:6789/0 conn(0x7fe5a40cae00 legacy=0x7fe5a4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a96b1700 1 -- 172.21.15.6:0/682496173 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a415e3b0 con 0x7fe5a415daa0 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a96b1700 1 --2- 172.21.15.6:0/682496173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 0x7fe5a415de70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009910 tx=0x7fe59c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593cf9fdff8e9f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c011630 con 0x7fe5a415daa0 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c011790 con 0x7fe5a415daa0 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.906+0000 7fe5a3fff700 1 -- 172.21.15.6:0/682496173 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c011b30 con 0x7fe5a415daa0 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 -- 172.21.15.6:0/682496173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 msgr2=0x7fe5a415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 --2- 172.21.15.6:0/682496173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 0x7fe5a415de70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009910 tx=0x7fe59c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 -- 172.21.15.6:0/682496173 shutdown_connections 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 --2- 172.21.15.6:0/682496173 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a415daa0 0x7fe5a415de70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 -- 172.21.15.6:0/682496173 >> 172.21.15.6:0/682496173 conn(0x7fe5a40c9ca0 msgr2=0x7fe5a40ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:25.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 -- 172.21.15.6:0/682496173 shutdown_connections 2023-10-09T11:41:25.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.907+0000 7fe5ab915700 1 -- 172.21.15.6:0/682496173 wait complete. 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.908+0000 7fe5ab915700 1 Processor -- start 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.908+0000 7fe5ab915700 1 -- start start 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a40cb270 0x7fe5a40c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5a415daa0 0x7fe5a415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c5260 con 0x7fe5a40cae00 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c4650 con 0x7fe5a415daa0 2023-10-09T11:41:25.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5ab915700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c4930 con 0x7fe5a40cb270 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44720/0 (socket says 172.21.15.6:44720) 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 -- 172.21.15.6:0/301697649 learned_addr learned my addr 172.21.15.6:0/301697649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 -- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a40cb270 msgr2=0x7fe5a40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a40cb270 0x7fe5a40c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a9eb2700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5a415daa0 0x7fe5a415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 -- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5a415daa0 msgr2=0x7fe5a415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5a415daa0 0x7fe5a415aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.909+0000 7fe5a96b1700 1 -- 172.21.15.6:0/301697649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009420 con 0x7fe5a40cae00 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5a96b1700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe5a406ebb0 tx=0x7fe59c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c01f070 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c000bc0 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a40c4c10 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c025420 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.910+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40c42e0 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.911+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4068080 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.911+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe59c023070 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.911+0000 7fe5a17fa700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 0x7fe590069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.912+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe59c085880 con 0x7fe5a40cae00 2023-10-09T11:41:25.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.912+0000 7fe5a8eb0700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 0x7fe590069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:25.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.912+0000 7fe5a8eb0700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 0x7fe590069410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe5980058d0 tx=0x7fe5980079f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:25.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:25.916+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe59c052af0 con 0x7fe5a40cae00 2023-10-09T11:41:26.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.112+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a40c5540 con 0x7fe5a40cae00 2023-10-09T11:41:26.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.113+0000 7fe5a17fa700 1 -- 172.21.15.6:0/301697649 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15309 (secure 0 0 0) 0x7fe59c015090 con 0x7fe5a40cae00 2023-10-09T11:41:26.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:26.115 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":103,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:21.943811+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 msgr2=0x7fe590069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 0x7fe590069410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe5980058d0 tx=0x7fe5980079f0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 msgr2=0x7fe5a4157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe5a406ebb0 tx=0x7fe59c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 shutdown_connections 2023-10-09T11:41:26.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe590066f60 0x7fe590069410 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5a415daa0 0x7fe5a415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5a40cae00 0x7fe5a4157220 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 --2- 172.21.15.6:0/301697649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5a40cb270 0x7fe5a40c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 >> 172.21.15.6:0/301697649 conn(0x7fe5a40c9ca0 msgr2=0x7fe5a40ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 shutdown_connections 2023-10-09T11:41:26.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.115+0000 7fe5ab915700 1 -- 172.21.15.6:0/301697649 wait complete. 2023-10-09T11:41:26.129 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:41:26.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.247+0000 7f0dc83fb700 1 Processor -- start 2023-10-09T11:41:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.247+0000 7f0dc83fb700 1 -- start start 2023-10-09T11:41:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc83fb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0dc006d830 0x7f0dc00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc83fb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00d07c0 con 0x7f0dc0157ca0 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc83fb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00cfbb0 con 0x7f0dc01578d0 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc83fb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc00cfe90 con 0x7f0dc006d830 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc6998700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0dc006d830 0x7f0dc00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc5996700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0dc0157ca0 0x7f0dc006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47678/0 (socket says 172.21.15.6:47678) 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.248+0000 7f0dc5996700 1 -- 172.21.15.6:0/4075863040 learned_addr learned my addr 172.21.15.6:0/4075863040 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc6998700 1 -- 172.21.15.6:0/4075863040 >> v1:172.21.15.118:6789/0 conn(0x7f0dc01578d0 legacy=0x7f0dc015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc6998700 1 -- 172.21.15.6:0/4075863040 >> v1:172.21.15.6:6789/0 conn(0x7f0dc0157ca0 legacy=0x7f0dc006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc5195700 1 -- 172.21.15.6:0/4075863040 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239968656 0 0) 0x7f0dc00d07c0 con 0x7f0dc0157ca0 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc6998700 1 -- 172.21.15.6:0/4075863040 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00d0170 con 0x7f0dc006d830 2023-10-09T11:41:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc6998700 1 --2- 172.21.15.6:0/4075863040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc006d830 0x7f0dc00cf4f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009e60 tx=0x7f0db8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa53e7624bac1ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc5195700 1 -- 172.21.15.6:0/4075863040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800e070 con 0x7f0dc006d830 2023-10-09T11:41:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc5195700 1 -- 172.21.15.6:0/4075863040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db800bbf0 con 0x7f0dc006d830 2023-10-09T11:41:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.249+0000 7f0dc5195700 1 -- 172.21.15.6:0/4075863040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8012430 con 0x7f0dc006d830 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 -- 172.21.15.6:0/4075863040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc006d830 msgr2=0x7f0dc00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/4075863040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc006d830 0x7f0dc00cf4f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009e60 tx=0x7f0db8009780 comp rx=0 tx=0).stop 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 -- 172.21.15.6:0/4075863040 shutdown_connections 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/4075863040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc006d830 0x7f0dc00cf4f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 -- 172.21.15.6:0/4075863040 >> 172.21.15.6:0/4075863040 conn(0x7f0dc006bb90 msgr2=0x7f0dc006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 -- 172.21.15.6:0/4075863040 shutdown_connections 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.250+0000 7f0dc83fb700 1 -- 172.21.15.6:0/4075863040 wait complete. 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.251+0000 7f0dc83fb700 1 Processor -- start 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.251+0000 7f0dc83fb700 1 -- start start 2023-10-09T11:41:26.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.251+0000 7f0dc83fb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dc006d830 0x7f0dc0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc0157ca0 0x7f0dc0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0155a90 con 0x7f0dc01578d0 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc016a810 con 0x7f0dc0157ca0 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc016aaf0 con 0x7f0dc006d830 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44742/0 (socket says 172.21.15.6:44742) 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 -- 172.21.15.6:0/1062497035 learned_addr learned my addr 172.21.15.6:0/1062497035 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc6998700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc0157ca0 0x7f0dc0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc6197700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dc006d830 0x7f0dc0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 -- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dc006d830 msgr2=0x7f0dc0069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dc006d830 0x7f0dc0069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 -- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc0157ca0 msgr2=0x7f0dc0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc0157ca0 0x7f0dc0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 -- 172.21.15.6:0/1062497035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009a20 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc5996700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c5e0 tx=0x7f0db4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005b30 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4005c90 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc016add0 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4007300 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.252+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc016b390 con 0x7f0dc01578d0 2023-10-09T11:41:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.253+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc016b5b0 con 0x7f0dc01578d0 2023-10-09T11:41:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.254+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0db401b3b0 con 0x7f0dc01578d0 2023-10-09T11:41:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.254+0000 7f0dbe7fc700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 0x7f0dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.254+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0db40839c0 con 0x7f0dc01578d0 2023-10-09T11:41:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.254+0000 7f0dc6197700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 0x7f0dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.255+0000 7f0dc6197700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 0x7f0dac0693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0db0003a30 tx=0x7f0db0007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.259+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db4050c30 con 0x7f0dc01578d0 2023-10-09T11:41:26.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.494+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc00d0450 con 0x7f0dc01578d0 2023-10-09T11:41:26.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.495+0000 7f0dbe7fc700 1 -- 172.21.15.6:0/1062497035 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0db4017020 con 0x7f0dc01578d0 2023-10-09T11:41:26.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:26.496 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 msgr2=0x7f0dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 0x7f0dac0693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0db0003a30 tx=0x7f0db0007ea0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 msgr2=0x7f0dc0155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c5e0 tx=0x7f0db4000fe0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 shutdown_connections 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0dac066f30 0x7f0dac0693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0dc0157ca0 0x7f0dc0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0dc006d830 0x7f0dc0069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 --2- 172.21.15.6:0/1062497035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0dc01578d0 0x7f0dc0155010 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 >> 172.21.15.6:0/1062497035 conn(0x7f0dc006bb90 msgr2=0x7f0dc01568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 shutdown_connections 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.497+0000 7f0dc83fb700 1 -- 172.21.15.6:0/1062497035 wait complete. 2023-10-09T11:41:26.500 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:26.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.628+0000 7f32b1b29700 1 Processor -- start 2023-10-09T11:41:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.628+0000 7f32b1b29700 1 -- start start 2023-10-09T11:41:26.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32b1b29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32b1b29700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32ac06d120 0x7f32ac06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32b1b29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac06dac0 con 0x7f32ac1578d0 2023-10-09T11:41:26.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32b1b29700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0d07c0 con 0x7f32ac06d120 2023-10-09T11:41:26.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32b1b29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0cfbb0 con 0x7f32ac157ca0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32ab7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32ac1578d0 0x7f32ac15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47680/0 (socket says 172.21.15.6:47680) 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32ab7fe700 1 -- 172.21.15.6:0/471467852 learned_addr learned my addr 172.21.15.6:0/471467852 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32abfff700 1 --2- 172.21.15.6:0/471467852 >> v2:172.21.15.118:3300/0 conn(0x7f32ac06d120 0x7f32ac06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32aaffd700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.629+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978470029 0 0) 0x7f329c001110 con 0x7f32ac1578d0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3294003570 con 0x7f32ac1578d0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877807793 0 0) 0x7f3294003570 con 0x7f32ac1578d0 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 msgr2=0x7f32ac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32ac0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 >> v2:172.21.15.118:3300/0 conn(0x7f32ac06d120 msgr2=0x7f32ac06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 --2- 172.21.15.6:0/471467852 >> v2:172.21.15.118:3300/0 conn(0x7f32ac06d120 0x7f32ac06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0cfe90 con 0x7f32ac1578d0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f329c001600 con 0x7f32ac1578d0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 >> v1:172.21.15.6:6789/0 conn(0x7f32ac1578d0 legacy=0x7f32ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294003a60 0x7f3294003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294004810 0x7f3294004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0d07c0 con 0x7f3294004810 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0cfbb0 con 0x7f3294003a60 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329400ba60 con 0x7f32ac157ca0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294004810 0x7f3294004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32ab7fe700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294003a60 0x7f3294003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32abfff700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 -- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 msgr2=0x7f32940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac157ca0 0x7f32940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 -- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294003a60 msgr2=0x7f3294003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294003a60 0x7f3294003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 -- 172.21.15.6:0/471467852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294003570 con 0x7f3294004810 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.630+0000 7f32aaffd700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294004810 0x7f3294004c80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009c30 tx=0x7f32a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3812d14dd9027c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000e710 con 0x7f3294004810 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000e870 con 0x7f3294004810 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32aa7fc700 1 -- 172.21.15.6:0/471467852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000ec30 con 0x7f3294004810 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 -- 172.21.15.6:0/471467852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294004810 msgr2=0x7f3294004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 --2- 172.21.15.6:0/471467852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294004810 0x7f3294004c80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009c30 tx=0x7f32a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32abfff700 1 -- 172.21.15.6:0/471467852 reap_dead start 2023-10-09T11:41:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 -- 172.21.15.6:0/471467852 shutdown_connections 2023-10-09T11:41:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 -- 172.21.15.6:0/471467852 >> 172.21.15.6:0/471467852 conn(0x7f32ac06bb90 msgr2=0x7f32ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 -- 172.21.15.6:0/471467852 shutdown_connections 2023-10-09T11:41:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.631+0000 7f32b1b29700 1 -- 172.21.15.6:0/471467852 wait complete. 2023-10-09T11:41:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.632+0000 7f32b1b29700 1 Processor -- start 2023-10-09T11:41:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.632+0000 7f32b1b29700 1 -- start start 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 0x7f32ac15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac154df0 0x7f32ac146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac161330 con 0x7f32ac146eb0 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac144230 con 0x7f3294004810 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32b1b29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac160720 con 0x7f32ac154df0 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44748/0 (socket says 172.21.15.6:44748) 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.633+0000 7f32abfff700 1 -- 172.21.15.6:0/3134155577 learned_addr learned my addr 172.21.15.6:0/3134155577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32ab7fe700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 0x7f32ac15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32aaffd700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac154df0 0x7f32ac146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 -- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac154df0 msgr2=0x7f32ac146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac154df0 0x7f32ac146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 -- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 msgr2=0x7f32ac15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 0x7f32ac15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 -- 172.21.15.6:0/3134155577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac160a00 con 0x7f32ac146eb0 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32ab7fe700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 0x7f32ac15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32abfff700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f32ac068300 tx=0x7f32a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400e040 con 0x7f32ac146eb0 2023-10-09T11:41:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400f040 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400fe20 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac160ce0 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.634+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac160410 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.635+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac0b2fb0 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.635+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32a4015640 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.636+0000 7f32937fe700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 0x7f3298069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.636+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32a4084ed0 con 0x7f32ac146eb0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.636+0000 7f32ab7fe700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 0x7f3298069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.636+0000 7f32ab7fe700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 0x7f3298069410 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.640+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32a4052140 con 0x7f32ac146eb0 2023-10-09T11:41:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.880+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32ac15d570 con 0x7f32ac146eb0 2023-10-09T11:41:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.881+0000 7f32937fe700 1 -- 172.21.15.6:0/3134155577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f32a4055760 con 0x7f32ac146eb0 2023-10-09T11:41:26.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:26.883 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:40:51.494990+0000","modified":"2023-10-09T11:40:55.125039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6336":{"gid":6336,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/2462389569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2462389569},{"type":"v1","addr":"172.21.15.118:6835","nonce":2462389569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T11:41:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 msgr2=0x7f3298069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 0x7f3298069410 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 msgr2=0x7f32ac1617c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f32ac068300 tx=0x7f32a400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 shutdown_connections 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3298066f60 0x7f3298069410 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32ac146eb0 0x7f32ac1617c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3294004810 0x7f32ac15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 --2- 172.21.15.6:0/3134155577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32ac154df0 0x7f32ac146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 >> 172.21.15.6:0/3134155577 conn(0x7f32ac06bb90 msgr2=0x7f32ac068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 shutdown_connections 2023-10-09T11:41:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:26.883+0000 7f32b1b29700 1 -- 172.21.15.6:0/3134155577 wait complete. 2023-10-09T11:41:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2023-10-09T11:41:26.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.014+0000 7f59c8397700 1 Processor -- start 2023-10-09T11:41:27.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.014+0000 7f59c8397700 1 -- start start 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.015+0000 7f59c8397700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59c015a2a0 0x7f59c00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.015+0000 7f59c8397700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f59c006dd60 0x7f59c00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.015+0000 7f59c8397700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c00b0ca0 con 0x7f59c00ceb30 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.015+0000 7f59c8397700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c006e160 con 0x7f59c015a2a0 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.015+0000 7f59c8397700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c006ea90 con 0x7f59c006dd60 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59c015a2a0 0x7f59c00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5932700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59c00ceb30 0x7f59c006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47682/0 (socket says 172.21.15.6:47682) 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5932700 1 -- 172.21.15.6:0/3794710427 learned_addr learned my addr 172.21.15.6:0/3794710427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:27.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6934700 1 --2- 172.21.15.6:0/3794710427 >> v2:172.21.15.118:3300/0 conn(0x7f59c006dd60 0x7f59c00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 -- 172.21.15.6:0/3794710427 >> v2:172.21.15.118:3300/0 conn(0x7f59c006dd60 msgr2=0x7f59c00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 --2- 172.21.15.6:0/3794710427 >> v2:172.21.15.118:3300/0 conn(0x7f59c006dd60 0x7f59c00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 -- 172.21.15.6:0/3794710427 >> v1:172.21.15.6:6789/0 conn(0x7f59c00ceb30 legacy=0x7f59c006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 -- 172.21.15.6:0/3794710427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00b00d0 con 0x7f59c015a2a0 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5131700 1 -- 172.21.15.6:0/3794710427 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958636781 0 0) 0x7f59c00b0ca0 con 0x7f59c00ceb30 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c6133700 1 --2- 172.21.15.6:0/3794710427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c015a2a0 0x7f59c00b1130 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f59c0069790 tx=0x7f59b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6599c94b10774124 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5131700 1 -- 172.21.15.6:0/3794710427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e070 con 0x7f59c015a2a0 2023-10-09T11:41:27.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5131700 1 -- 172.21.15.6:0/3794710427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800bc30 con 0x7f59c015a2a0 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.016+0000 7f59c5131700 1 -- 172.21.15.6:0/3794710427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8012430 con 0x7f59c015a2a0 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 -- 172.21.15.6:0/3794710427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c015a2a0 msgr2=0x7f59c00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 --2- 172.21.15.6:0/3794710427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c015a2a0 0x7f59c00b1130 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f59c0069790 tx=0x7f59b8009780 comp rx=0 tx=0).stop 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 -- 172.21.15.6:0/3794710427 shutdown_connections 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 --2- 172.21.15.6:0/3794710427 >> v2:172.21.15.118:3300/0 conn(0x7f59c006dd60 0x7f59c00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 --2- 172.21.15.6:0/3794710427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c015a2a0 0x7f59c00b1130 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 -- 172.21.15.6:0/3794710427 >> 172.21.15.6:0/3794710427 conn(0x7f59c0067640 msgr2=0x7f59c0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 -- 172.21.15.6:0/3794710427 shutdown_connections 2023-10-09T11:41:27.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.017+0000 7f59c8397700 1 -- 172.21.15.6:0/3794710427 wait complete. 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.018+0000 7f59c8397700 1 Processor -- start 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.018+0000 7f59c8397700 1 -- start start 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59c00ceb30 0x7f59c00b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59c015a2a0 0x7f59c00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0152590 con 0x7f59c006dd60 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0150620 con 0x7f59c00ceb30 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c8397700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00b2a00 con 0x7f59c015a2a0 2023-10-09T11:41:27.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44768/0 (socket says 172.21.15.6:44768) 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 -- 172.21.15.6:0/2784331065 learned_addr learned my addr 172.21.15.6:0/2784331065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c5932700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59c00ceb30 0x7f59c00b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6934700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59c015a2a0 0x7f59c00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 -- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59c015a2a0 msgr2=0x7f59c00b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59c015a2a0 0x7f59c00b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 -- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59c00ceb30 msgr2=0x7f59c00b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59c00ceb30 0x7f59c00b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 -- 172.21.15.6:0/2784331065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009a20 con 0x7f59c006dd60 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.019+0000 7f59c6133700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f59b8012580 tx=0x7f59b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8012ea0 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8027470 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c00b2ce0 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8027830 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c0152220 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.020+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c0152080 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.022+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59b8024070 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.022+0000 7f59be7fc700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.022+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59b8086c20 con 0x7f59c006dd60 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.022+0000 7f59c5932700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.023+0000 7f59c5932700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 0x7f59ac0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f59c00cbf60 tx=0x7f59b4007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.026+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59b8053f10 con 0x7f59c006dd60 2023-10-09T11:41:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.219+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c0152080 con 0x7f59c006dd60 2023-10-09T11:41:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.220+0000 7f59be7fc700 1 -- 172.21.15.6:0/2784331065 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15309 (secure 0 0 0) 0x7f59c0152080 con 0x7f59c006dd60 2023-10-09T11:41:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:27.222 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":103,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:21.943811+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:40:49.900396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T11:40:50.465059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 msgr2=0x7f59ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 0x7f59ac0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f59c00cbf60 tx=0x7f59b4007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 msgr2=0x7f59c01500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f59b8012580 tx=0x7f59b8019000 comp rx=0 tx=0).stop 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 shutdown_connections 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59ac066f30 0x7f59ac0693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59c015a2a0 0x7f59c00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c006dd60 0x7f59c01500e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 --2- 172.21.15.6:0/2784331065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59c00ceb30 0x7f59c00b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 >> 172.21.15.6:0/2784331065 conn(0x7f59c0067640 msgr2=0x7f59c0160680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 shutdown_connections 2023-10-09T11:41:27.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.222+0000 7f59c8397700 1 -- 172.21.15.6:0/2784331065 wait complete. 2023-10-09T11:41:27.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:41:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.353+0000 7f172f72a700 1 Processor -- start 2023-10-09T11:41:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.354+0000 7f172f72a700 1 -- start start 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.354+0000 7f172f72a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f17280aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.354+0000 7f172f72a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172806d350 con 0x7f17280cb2a0 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.354+0000 7f172f72a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280c9ac0 con 0x7f172815daa0 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.354+0000 7f172f72a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172806c740 con 0x7f17280cae00 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172dcc7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17280cb2a0 0x7f17280aadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47692/0 (socket says 172.21.15.6:47692) 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172dcc7700 1 -- 172.21.15.6:0/834089305 learned_addr learned my addr 172.21.15.6:0/834089305 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172ccc5700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f17280aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182699309 0 0) 0x7f172806d350 con 0x7f17280cb2a0 2023-10-09T11:41:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1710003570 con 0x7f17280cb2a0 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281270570 0 0) 0x7f1710003570 con 0x7f17280cb2a0 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 msgr2=0x7f17280aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f17280aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 >> v1:172.21.15.118:6789/0 conn(0x7f172815daa0 legacy=0x7f172815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172806ca20 con 0x7f17280cb2a0 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f17180017f0 con 0x7f17280cb2a0 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 >> v1:172.21.15.6:6789/0 conn(0x7f17280cb2a0 legacy=0x7f17280aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710003a90 0x7f1710003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f1710004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1710004d50 0x7f17100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172806c740 con 0x7f1710004d50 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171000bb40 con 0x7f1710003a90 2023-10-09T11:41:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171000bd00 con 0x7f17280cae00 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172dcc7700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1710004d50 0x7f17100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172ccc5700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f1710004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.355+0000 7f172d4c6700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710003a90 0x7f1710003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 -- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 msgr2=0x7f1710004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17280cae00 0x7f1710004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 -- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710003a90 msgr2=0x7f1710003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710003a90 0x7f1710003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 -- 172.21.15.6:0/834089305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710003570 con 0x7f1710004d50 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f172dcc7700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1710004d50 0x7f17100051c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f171800a950 tx=0x7f17180021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d9b7a30fea3467 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180070d0 con 0x7f1710004d50 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718007230 con 0x7f1710004d50 2023-10-09T11:41:27.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.356+0000 7f1727fff700 1 -- 172.21.15.6:0/834089305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180075f0 con 0x7f1710004d50 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 -- 172.21.15.6:0/834089305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1710004d50 msgr2=0x7f17100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 --2- 172.21.15.6:0/834089305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1710004d50 0x7f17100051c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f171800a950 tx=0x7f17180021f0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172dcc7700 1 -- 172.21.15.6:0/834089305 reap_dead start 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 -- 172.21.15.6:0/834089305 shutdown_connections 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 -- 172.21.15.6:0/834089305 >> 172.21.15.6:0/834089305 conn(0x7f17280c9ca0 msgr2=0x7f17280ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 -- 172.21.15.6:0/834089305 shutdown_connections 2023-10-09T11:41:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.357+0000 7f172f72a700 1 -- 172.21.15.6:0/834089305 wait complete. 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.358+0000 7f172f72a700 1 Processor -- start 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.358+0000 7f172f72a700 1 -- start start 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f172814ece0 0x7f17280ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172814f0b0 0x7f17280b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c6730 con 0x7f17280abb20 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c6a10 con 0x7f172814f0b0 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172f72a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c6cf0 con 0x7f172814ece0 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44780/0 (socket says 172.21.15.6:44780) 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 -- 172.21.15.6:0/1620746900 learned_addr learned my addr 172.21.15.6:0/1620746900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172d4c6700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f172814ece0 0x7f17280ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172dcc7700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172814f0b0 0x7f17280b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 -- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f172814ece0 msgr2=0x7f17280ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f172814ece0 0x7f17280ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 -- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172814f0b0 msgr2=0x7f17280b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172814f0b0 0x7f17280b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 -- 172.21.15.6:0/1620746900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280c6fd0 con 0x7f17280abb20 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f172ccc5700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f171c006ac0 tx=0x7f171c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.359+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c00f8e0 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.360+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00fa40 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.360+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280c72b0 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.360+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c00fdc0 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.360+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280c42e0 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.360+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728068080 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.361+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f171c014650 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.361+0000 7f17257fa700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.362+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f171c018030 con 0x7f17280abb20 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.362+0000 7f172d4c6700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.362+0000 7f172d4c6700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 0x7f17140693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1720003c80 tx=0x7f1720007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.366+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f171c0520d0 con 0x7f17280abb20 2023-10-09T11:41:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.603+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f172804bb80 con 0x7f17280abb20 2023-10-09T11:41:27.605 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:41:27.604+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:41:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.608+0000 7f17257fa700 1 -- 172.21.15.6:0/1620746900 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f171c022090 con 0x7f17280abb20 2023-10-09T11:41:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.610+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 msgr2=0x7f17140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.610+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 0x7f17140693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1720003c80 tx=0x7f1720007d10 comp rx=0 tx=0).stop 2023-10-09T11:41:27.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.610+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 msgr2=0x7f17280b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.610+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f171c006ac0 tx=0x7f171c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 shutdown_connections 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1714066f30 0x7f17140693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f172814f0b0 0x7f17280b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f172814ece0 0x7f17280ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 --2- 172.21.15.6:0/1620746900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17280abb20 0x7f17280b2120 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 >> 172.21.15.6:0/1620746900 conn(0x7f17280c9ca0 msgr2=0x7f17280691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 shutdown_connections 2023-10-09T11:41:27.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.611+0000 7f172f72a700 1 -- 172.21.15.6:0/1620746900 wait complete. 2023-10-09T11:41:27.614 INFO:tasks.ceph.mds.d.smithi118.stderr: -9008> 2023-10-09T11:40:58.076+0000 7f842dcca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:41:27.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:41:27.644 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:41:27.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.745+0000 7fafc8958700 1 Processor -- start 2023-10-09T11:41:27.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.745+0000 7fafc8958700 1 -- start start 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.745+0000 7fafc8958700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 0x7fafc40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc8958700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafc406d650 0x7fafc406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc8958700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b0ca0 con 0x7fafc415a2a0 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc8958700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc406ea90 con 0x7fafc406d650 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc8958700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40b00d0 con 0x7fafc40cf240 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fafc415a2a0 0x7fafc40ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47708/0 (socket says 172.21.15.6:47708) 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc259c700 1 -- 172.21.15.6:0/695069935 learned_addr learned my addr 172.21.15.6:0/695069935 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 --2- 172.21.15.6:0/695069935 >> v2:172.21.15.6:3300/0 conn(0x7fafc406d650 0x7fafc406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc1d9b700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 0x7fafc40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc159a700 1 -- 172.21.15.6:0/695069935 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842451260 0 0) 0x7fafc40b0ca0 con 0x7fafc415a2a0 2023-10-09T11:41:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc159a700 1 -- 172.21.15.6:0/695069935 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb0003570 con 0x7fafc415a2a0 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 -- 172.21.15.6:0/695069935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 msgr2=0x7fafc40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 0x7fafc40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 -- 172.21.15.6:0/695069935 >> v1:172.21.15.6:6789/0 conn(0x7fafc415a2a0 legacy=0x7fafc40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 -- 172.21.15.6:0/695069935 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40b0370 con 0x7fafc406d650 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc1d9b700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 0x7fafc40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc2d9d700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc406d650 0x7fafc406da90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009e60 tx=0x7fafb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee877d0a485666e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc159a700 1 -- 172.21.15.6:0/695069935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400e070 con 0x7fafc406d650 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc159a700 1 -- 172.21.15.6:0/695069935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400bb60 con 0x7fafc406d650 2023-10-09T11:41:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.746+0000 7fafc159a700 1 -- 172.21.15.6:0/695069935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4012430 con 0x7fafc406d650 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 -- 172.21.15.6:0/695069935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc406d650 msgr2=0x7fafc406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc406d650 0x7fafc406da90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009e60 tx=0x7fafb4009780 comp rx=0 tx=0).stop 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 -- 172.21.15.6:0/695069935 shutdown_connections 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc406d650 0x7fafc406da90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 --2- 172.21.15.6:0/695069935 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc40cf240 0x7fafc40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 -- 172.21.15.6:0/695069935 >> 172.21.15.6:0/695069935 conn(0x7fafc4067640 msgr2=0x7fafc4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 -- 172.21.15.6:0/695069935 shutdown_connections 2023-10-09T11:41:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.747+0000 7fafc8958700 1 -- 172.21.15.6:0/695069935 wait complete. 2023-10-09T11:41:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.748+0000 7fafc8958700 1 Processor -- start 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.748+0000 7fafc8958700 1 -- start start 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc406d650 0x7fafc416afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc415a2a0 0x7fafc415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40caa60 con 0x7fafc40cf240 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc416b500 con 0x7fafc406d650 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc8958700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40caef0 con 0x7fafc415a2a0 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44802/0 (socket says 172.21.15.6:44802) 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 -- 172.21.15.6:0/3759242400 learned_addr learned my addr 172.21.15.6:0/3759242400 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc2d9d700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc415a2a0 0x7fafc415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc259c700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc406d650 0x7fafc416afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 -- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc415a2a0 msgr2=0x7fafc415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc415a2a0 0x7fafc415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 -- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc406d650 msgr2=0x7fafc416afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc406d650 0x7fafc416afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 -- 172.21.15.6:0/3759242400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009a20 con 0x7fafc40cf240 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.749+0000 7fafc1d9b700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c830 tx=0x7fafac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.750+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011600 con 0x7fafc40cf240 2023-10-09T11:41:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.750+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac011760 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.750+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc40c9e50 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.750+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011b20 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.750+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc40ca410 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.751+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc40cabd0 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.751+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafac018360 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.751+0000 7fafba7fc700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 0x7fafa40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.751+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fafac084450 con 0x7fafc40cf240 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.752+0000 7fafc259c700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 0x7fafa40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.752+0000 7fafc259c700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 0x7fafa40694b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafbc007fd0 tx=0x7fafbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.756+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafac0516f0 con 0x7fafc40cf240 2023-10-09T11:41:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:27.995+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fafc40ae740 con 0x7fafc40cf240 2023-10-09T11:41:28.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.608+0000 7fafba7fc700 1 -- 172.21.15.6:0/3759242400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafac054d10 con 0x7fafc40cf240 2023-10-09T11:41:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 msgr2=0x7fafa40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 0x7fafa40694b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafbc007fd0 tx=0x7fafbc009040 comp rx=0 tx=0).stop 2023-10-09T11:41:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 msgr2=0x7fafc41558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c830 tx=0x7fafac008040 comp rx=0 tx=0).stop 2023-10-09T11:41:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 shutdown_connections 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa4067000 0x7fafa40694b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc415a2a0 0x7fafc415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc406d650 0x7fafc416afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 --2- 172.21.15.6:0/3759242400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafc40cf240 0x7fafc41558e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 >> 172.21.15.6:0/3759242400 conn(0x7fafc4067640 msgr2=0x7fafc40ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 shutdown_connections 2023-10-09T11:41:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.611+0000 7fafc8958700 1 -- 172.21.15.6:0/3759242400 wait complete. 2023-10-09T11:41:28.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.752+0000 7f393ca6c700 1 Processor -- start 2023-10-09T11:41:28.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.753+0000 7f393ca6c700 1 -- start start 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.753+0000 7f393ca6c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 0x7f39380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393ca6c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3938157ca0 0x7f393815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393ca6c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380d07c0 con 0x7f393806d120 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393ca6c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39380cfbb0 con 0x7f3938157ca0 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393ca6c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380cfe90 con 0x7f39381578d0 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3936d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f393806d120 0x7f393815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47724/0 (socket says 172.21.15.6:47724) 2023-10-09T11:41:28.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3936d9d700 1 -- 172.21.15.6:0/913925547 learned_addr learned my addr 172.21.15.6:0/913925547 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 --2- 172.21.15.6:0/913925547 >> v2:172.21.15.118:3300/0 conn(0x7f3938157ca0 0x7f393815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393659c700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 0x7f39380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393559a700 1 -- 172.21.15.6:0/913925547 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898920975 0 0) 0x7f39380d07c0 con 0x7f393806d120 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393559a700 1 -- 172.21.15.6:0/913925547 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003570 con 0x7f393806d120 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 -- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 msgr2=0x7f39380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 0x7f39380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 -- 172.21.15.6:0/913925547 >> v1:172.21.15.6:6789/0 conn(0x7f393806d120 legacy=0x7f393815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 -- 172.21.15.6:0/913925547 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380d0170 con 0x7f3938157ca0 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f393659c700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 0x7f39380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.754+0000 7f3935d9b700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3938157ca0 0x7f393815af00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39200098e0 tx=0x7f39200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bddec7b8e29c366d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393559a700 1 -- 172.21.15.6:0/913925547 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920011630 con 0x7f3938157ca0 2023-10-09T11:41:28.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393559a700 1 -- 172.21.15.6:0/913925547 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920011790 con 0x7f3938157ca0 2023-10-09T11:41:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393559a700 1 -- 172.21.15.6:0/913925547 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920011b30 con 0x7f3938157ca0 2023-10-09T11:41:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 -- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3938157ca0 msgr2=0x7f393815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3938157ca0 0x7f393815af00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39200098e0 tx=0x7f39200091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 -- 172.21.15.6:0/913925547 shutdown_connections 2023-10-09T11:41:28.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39381578d0 0x7f39380cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 --2- 172.21.15.6:0/913925547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3938157ca0 0x7f393815af00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 -- 172.21.15.6:0/913925547 >> 172.21.15.6:0/913925547 conn(0x7f393806bb90 msgr2=0x7f393806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 -- 172.21.15.6:0/913925547 shutdown_connections 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.755+0000 7f393ca6c700 1 -- 172.21.15.6:0/913925547 wait complete. 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.756+0000 7f393ca6c700 1 Processor -- start 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.756+0000 7f393ca6c700 1 -- start start 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39381578d0 0x7f393816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3938157ca0 0x7f393816aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b4910 con 0x7f393806d120 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b3d40 con 0x7f39381578d0 2023-10-09T11:41:28.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393ca6c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b3fe0 con 0x7f3938157ca0 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44818/0 (socket says 172.21.15.6:44818) 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f393659c700 1 -- 172.21.15.6:0/1739593064 learned_addr learned my addr 172.21.15.6:0/1739593064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f3935d9b700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39381578d0 0x7f393816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.757+0000 7f3936d9d700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3938157ca0 0x7f393816aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 -- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3938157ca0 msgr2=0x7f393816aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3938157ca0 0x7f393816aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 -- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39381578d0 msgr2=0x7f393816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39381578d0 0x7f393816a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 -- 172.21.15.6:0/1739593064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930009420 con 0x7f393806d120 2023-10-09T11:41:28.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393659c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f393000ec80 tx=0x7f39300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000c920 con 0x7f393806d120 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000ca80 con 0x7f393806d120 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3920009420 con 0x7f393806d120 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000ce00 con 0x7f393806d120 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.758+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380b45a0 con 0x7f393806d120 2023-10-09T11:41:28.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.759+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938067ac0 con 0x7f393806d120 2023-10-09T11:41:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.759+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3930013680 con 0x7f393806d120 2023-10-09T11:41:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.760+0000 7f392e7fc700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.760+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f3930084c70 con 0x7f393806d120 2023-10-09T11:41:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.760+0000 7f3935d9b700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:28.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.760+0000 7f3935d9b700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 0x7f39180693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39200091e0 tx=0x7f3920017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:28.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.764+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3930051e90 con 0x7f393806d120 2023-10-09T11:41:28.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:28.959+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f39380d0450 con 0x7f393806d120 2023-10-09T11:41:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.610+0000 7f392e7fc700 1 -- 172.21.15.6:0/1739593064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) v1 ==== 181+0+0 (secure 0 0 0) 0x7f39300170d0 con 0x7f393806d120 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 msgr2=0x7f39180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 0x7f39180693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39200091e0 tx=0x7f3920017000 comp rx=0 tx=0).stop 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 msgr2=0x7f39381547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f393000ec80 tx=0x7f39300091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 shutdown_connections 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3918066f30 0x7f39180693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3938157ca0 0x7f393816aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393806d120 0x7f39381547b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 --2- 172.21.15.6:0/1739593064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39381578d0 0x7f393816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 >> 172.21.15.6:0/1739593064 conn(0x7f393806bb90 msgr2=0x7f39381566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 shutdown_connections 2023-10-09T11:41:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.614+0000 7f393ca6c700 1 -- 172.21.15.6:0/1739593064 wait complete. 2023-10-09T11:41:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:41:29.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:41:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.756+0000 7f219304b700 1 Processor -- start 2023-10-09T11:41:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.756+0000 7f219304b700 1 -- start start 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c1578d0 0x7f218c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f218c157ca0 0x7f218c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f218c06d120 0x7f218c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c06dac0 con 0x7f218c06d120 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c0d07c0 con 0x7f218c157ca0 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f219304b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c0cfbb0 con 0x7f218c1578d0 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.757+0000 7f21915e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f218c06d120 0x7f218c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f218c06d120 0x7f218c06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44820/0 (socket says 172.21.15.6:44820) 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 -- 172.21.15.6:0/3314753131 learned_addr learned my addr 172.21.15.6:0/3314753131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f218bfff700 1 --2- 172.21.15.6:0/3314753131 >> v2:172.21.15.118:3300/0 conn(0x7f218c157ca0 0x7f218c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f2190de7700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c1578d0 0x7f218c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 -- 172.21.15.6:0/3314753131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c1578d0 msgr2=0x7f218c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c1578d0 0x7f218c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 -- 172.21.15.6:0/3314753131 >> v2:172.21.15.118:3300/0 conn(0x7f218c157ca0 msgr2=0x7f218c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 --2- 172.21.15.6:0/3314753131 >> v2:172.21.15.118:3300/0 conn(0x7f218c157ca0 0x7f218c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 -- 172.21.15.6:0/3314753131 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0cfe90 con 0x7f218c06d120 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f21915e8700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c06d580 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f218c06cb70 tx=0x7f2184009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6874ed0a871a97ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f218b7fe700 1 -- 172.21.15.6:0/3314753131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218400e070 con 0x7f218c06d120 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f218b7fe700 1 -- 172.21.15.6:0/3314753131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218400b970 con 0x7f218c06d120 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.758+0000 7f218b7fe700 1 -- 172.21.15.6:0/3314753131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840092e0 con 0x7f218c06d120 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 -- 172.21.15.6:0/3314753131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 msgr2=0x7f218c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c06d580 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f218c06cb70 tx=0x7f2184009840 comp rx=0 tx=0).stop 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 -- 172.21.15.6:0/3314753131 shutdown_connections 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c06d580 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 --2- 172.21.15.6:0/3314753131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c1578d0 0x7f218c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 --2- 172.21.15.6:0/3314753131 >> v2:172.21.15.118:3300/0 conn(0x7f218c157ca0 0x7f218c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 -- 172.21.15.6:0/3314753131 >> 172.21.15.6:0/3314753131 conn(0x7f218c06bb90 msgr2=0x7f218c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 -- 172.21.15.6:0/3314753131 shutdown_connections 2023-10-09T11:41:29.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.759+0000 7f219304b700 1 -- 172.21.15.6:0/3314753131 wait complete. 2023-10-09T11:41:29.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.760+0000 7f219304b700 1 Processor -- start 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.760+0000 7f219304b700 1 -- start start 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f218c1578d0 0x7f218c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c157ca0 0x7f218c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c14faf0 con 0x7f218c06d120 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c14c020 con 0x7f218c1578d0 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f219304b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c154c90 con 0x7f218c157ca0 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44836/0 (socket says 172.21.15.6:44836) 2023-10-09T11:41:29.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 -- 172.21.15.6:0/551931067 learned_addr learned my addr 172.21.15.6:0/551931067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f218bfff700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f218c1578d0 0x7f218c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f21915e8700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c157ca0 0x7f218c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 -- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c157ca0 msgr2=0x7f218c150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c157ca0 0x7f218c150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 -- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f218c1578d0 msgr2=0x7f218c150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f218c1578d0 0x7f218c150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 -- 172.21.15.6:0/551931067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184009ae0 con 0x7f218c06d120 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.761+0000 7f2190de7700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ec80 tx=0x7f217c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.762+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00c850 con 0x7f218c06d120 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.762+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00c9d0 con 0x7f218c06d120 2023-10-09T11:41:29.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.762+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c14eb00 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.762+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00cd90 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.762+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c154360 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.763+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c067ac0 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.763+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f217c013680 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.763+0000 7f2188ff9700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.763+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f217c084660 con 0x7f218c06d120 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.764+0000 7f218bfff700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:29.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.764+0000 7f218bfff700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 0x7f21780693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b3c30 tx=0x7f21800091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:29.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.768+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f217c051a30 con 0x7f218c06d120 2023-10-09T11:41:29.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:29.963+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f218c0d0170 con 0x7f218c06d120 2023-10-09T11:41:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.971+0000 7f2188ff9700 1 -- 172.21.15.6:0/551931067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) v1 ==== 169+0+0 (secure 0 0 0) 0x7f217c055050 con 0x7f218c06d120 2023-10-09T11:41:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 msgr2=0x7f21780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 0x7f21780693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b3c30 tx=0x7f21800091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 msgr2=0x7f218c14e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ec80 tx=0x7f217c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 shutdown_connections 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f218c157ca0 0x7f218c150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f218c06d120 0x7f218c14e5c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 --2- 172.21.15.6:0/551931067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f218c1578d0 0x7f218c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.974+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 >> 172.21.15.6:0/551931067 conn(0x7f218c06bb90 msgr2=0x7f218c068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.975+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 shutdown_connections 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:30.975+0000 7f219304b700 1 -- 172.21.15.6:0/551931067 wait complete. 2023-10-09T11:41:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:41:30.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:41:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 Processor -- start 2023-10-09T11:41:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 -- start start 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efeb0157ca0 0x7efeb015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00d07c0 con 0x7efeb006d120 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00cfbb0 con 0x7efeb0157ca0 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.114+0000 7efeb5115700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00cfe90 con 0x7efeb01578d0 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efeb0157ca0 0x7efeb015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efeb0157ca0 0x7efeb015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44848/0 (socket says 172.21.15.6:44848) 2023-10-09T11:41:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 -- 172.21.15.6:0/277336126 learned_addr learned my addr 172.21.15.6:0/277336126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeaed9d700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 -- 172.21.15.6:0/277336126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 msgr2=0x7efeb00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 -- 172.21.15.6:0/277336126 >> v1:172.21.15.118:6789/0 conn(0x7efeb006d120 legacy=0x7efeb015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 -- 172.21.15.6:0/277336126 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00d0170 con 0x7efeb0157ca0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeae59c700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0157ca0 0x7efeb015af00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe980099b0 tx=0x7efe98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e3aa7120096a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeadd9b700 1 -- 172.21.15.6:0/277336126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98009ea0 con 0x7efeb0157ca0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeadd9b700 1 -- 172.21.15.6:0/277336126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800b860 con 0x7efeb0157ca0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.115+0000 7efeadd9b700 1 -- 172.21.15.6:0/277336126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800bc00 con 0x7efeb0157ca0 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 -- 172.21.15.6:0/277336126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0157ca0 msgr2=0x7efeb015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0157ca0 0x7efeb015af00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe980099b0 tx=0x7efe98009250 comp rx=0 tx=0).stop 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 -- 172.21.15.6:0/277336126 shutdown_connections 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 --2- 172.21.15.6:0/277336126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb0157ca0 0x7efeb015af00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 -- 172.21.15.6:0/277336126 >> 172.21.15.6:0/277336126 conn(0x7efeb006bb90 msgr2=0x7efeb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 -- 172.21.15.6:0/277336126 shutdown_connections 2023-10-09T11:41:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.116+0000 7efeb5115700 1 -- 172.21.15.6:0/277336126 wait complete. 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.117+0000 7efeb5115700 1 Processor -- start 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.117+0000 7efeb5115700 1 -- start start 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb016de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 0x7efeb016e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0145dd0 con 0x7efeb006d120 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00ac270 con 0x7efeb0157ca0 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01454a0 con 0x7efeb01578d0 2023-10-09T11:41:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44858/0 (socket says 172.21.15.6:44858) 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 -- 172.21.15.6:0/663401510 learned_addr learned my addr 172.21.15.6:0/663401510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaf59e700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 0x7efeb016e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeae59c700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb016de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 -- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 msgr2=0x7efeb016de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb016de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 -- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 msgr2=0x7efeb016e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 0x7efeb016e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 -- 172.21.15.6:0/663401510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980094f0 con 0x7efeb006d120 2023-10-09T11:41:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaf59e700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 0x7efeb016e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeae59c700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb016de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeaed9d700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efea800ec80 tx=0x7efea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800c9d0 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800cb30 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0145780 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.118+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8013470 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.119+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb016a6c0 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.119+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0148330 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.120+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efea8013820 con 0x7efeb006d120 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.120+0000 7efea6ffd700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 0x7efe900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.120+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efea80846c0 con 0x7efeb006d120 2023-10-09T11:41:31.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.120+0000 7efeae59c700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 0x7efe900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.121+0000 7efeae59c700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 0x7efe900693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efe980099b0 tx=0x7efe98017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.125+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efea8051b90 con 0x7efeb006d120 2023-10-09T11:41:31.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.318+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efeb00d0450 con 0x7efeb006d120 2023-10-09T11:41:31.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.322+0000 7efea6ffd700 1 -- 172.21.15.6:0/663401510 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7efea80551b0 con 0x7efeb006d120 2023-10-09T11:41:31.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 msgr2=0x7efe900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 0x7efe900693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efe980099b0 tx=0x7efe98017000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 msgr2=0x7efeb016a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efea800ec80 tx=0x7efea80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 shutdown_connections 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efe90066f30 0x7efe900693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0157ca0 0x7efeb016e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb006d120 0x7efeb016a100 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 --2- 172.21.15.6:0/663401510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efeb01578d0 0x7efeb016de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 >> 172.21.15.6:0/663401510 conn(0x7efeb006bb90 msgr2=0x7efeb0068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 shutdown_connections 2023-10-09T11:41:31.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.324+0000 7efeb5115700 1 -- 172.21.15.6:0/663401510 wait complete. 2023-10-09T11:41:31.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-09T11:41:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.454+0000 7f052e3ac700 1 Processor -- start 2023-10-09T11:41:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.454+0000 7f052e3ac700 1 -- start start 2023-10-09T11:41:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052e3ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0528159b40 0x7f05280cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052e3ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280cee10 con 0x7f0528159f10 2023-10-09T11:41:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052e3ac700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280cd040 con 0x7f0528068e90 2023-10-09T11:41:31.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052e3ac700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05280cd320 con 0x7f0528159b40 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052cba9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0528159f10 0x7f0528068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47738/0 (socket says 172.21.15.6:47738) 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052cba9700 1 -- 172.21.15.6:0/1666992777 learned_addr learned my addr 172.21.15.6:0/1666992777 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.455+0000 7f052d3aa700 1 --2- 172.21.15.6:0/1666992777 >> v2:172.21.15.118:3300/0 conn(0x7f0528159b40 0x7f05280cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303708010 0 0) 0x7f05280cee10 con 0x7f0528159f10 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0510003570 con 0x7f0528159f10 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213922428 0 0) 0x7f0510003570 con 0x7f0528159f10 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f052d3aa700 1 -- 172.21.15.6:0/1666992777 >> v1:172.21.15.118:6789/0 conn(0x7f0528068e90 legacy=0x7f05280cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f052d3aa700 1 -- 172.21.15.6:0/1666992777 >> v1:172.21.15.6:6789/0 conn(0x7f0528159f10 legacy=0x7f0528068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f052d3aa700 1 -- 172.21.15.6:0/1666992777 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280ce7c0 con 0x7f0528159b40 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f052d3aa700 1 --2- 172.21.15.6:0/1666992777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159b40 0x7f05280cc600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f05200098e0 tx=0x7f05200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9e7da32c1e1a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c001470 con 0x7f0528159b40 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520011420 con 0x7f0528159b40 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.456+0000 7f0527fff700 1 -- 172.21.15.6:0/1666992777 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200117c0 con 0x7f0528159b40 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 -- 172.21.15.6:0/1666992777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159b40 msgr2=0x7f05280cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1666992777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159b40 0x7f05280cc600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f05200098e0 tx=0x7f05200091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 -- 172.21.15.6:0/1666992777 shutdown_connections 2023-10-09T11:41:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1666992777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159b40 0x7f05280cc600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 -- 172.21.15.6:0/1666992777 >> 172.21.15.6:0/1666992777 conn(0x7f05280cd660 msgr2=0x7f05280cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 -- 172.21.15.6:0/1666992777 shutdown_connections 2023-10-09T11:41:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.457+0000 7f052e3ac700 1 -- 172.21.15.6:0/1666992777 wait complete. 2023-10-09T11:41:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.458+0000 7f052e3ac700 1 Processor -- start 2023-10-09T11:41:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.458+0000 7f052e3ac700 1 -- start start 2023-10-09T11:41:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0528068e90 0x7f052816a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159f10 0x7f05280c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528155d10 con 0x7f0528159b40 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528157c20 con 0x7f0528159f10 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052e3ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052815bac0 con 0x7f0528068e90 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44866/0 (socket says 172.21.15.6:44866) 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 -- 172.21.15.6:0/1730495914 learned_addr learned my addr 172.21.15.6:0/1730495914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052dbab700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159f10 0x7f05280c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052d3aa700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0528068e90 0x7f052816a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 -- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0528068e90 msgr2=0x7f052816a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0528068e90 0x7f052816a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 -- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159f10 msgr2=0x7f05280c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159f10 0x7f05280c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 -- 172.21.15.6:0/1730495914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009420 con 0x7f0528159b40 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f052cba9700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f051c00cbc0 tx=0x7f051c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c007150 con 0x7f0528159b40 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0072b0 con 0x7f0528159b40 2023-10-09T11:41:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.459+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c007670 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.460+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052816aff0 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.460+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052816b630 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.460+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052816b9b0 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.461+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f051c004a40 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.461+0000 7f05257fa700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 0x7f05140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.461+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f051c083570 con 0x7f0528159b40 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.461+0000 7f052d3aa700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 0x7f05140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.462+0000 7f052d3aa700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 0x7f05140693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f05200030c0 tx=0x7f0520017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.466+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f051c050a40 con 0x7f0528159b40 2023-10-09T11:41:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.740+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f052815bc00 con 0x7f0528159b40 2023-10-09T11:41:31.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.972+0000 7f05257fa700 1 -- 172.21.15.6:0/1730495914 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v281) v1 ==== 137+0+0 (secure 0 0 0) 0x7f051c0180d0 con 0x7f0528159b40 2023-10-09T11:41:31.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 msgr2=0x7f05140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 0x7f05140693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f05200030c0 tx=0x7f0520017000 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 msgr2=0x7f05281557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f051c00cbc0 tx=0x7f051c001ab0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 shutdown_connections 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0514066f30 0x7f05140693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0528159f10 0x7f05280c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0528068e90 0x7f052816a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 --2- 172.21.15.6:0/1730495914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0528159b40 0x7f05281557d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 >> 172.21.15.6:0/1730495914 conn(0x7f05280cd660 msgr2=0x7f05280b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 shutdown_connections 2023-10-09T11:41:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:31.975+0000 7f052e3ac700 1 -- 172.21.15.6:0/1730495914 wait complete. 2023-10-09T11:41:31.989 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-09T11:41:31.989 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-09T11:41:31.989 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T11:41:31.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-09T11:41:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.107+0000 7f1f77996700 1 Processor -- start 2023-10-09T11:41:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.108+0000 7f1f77996700 1 -- start start 2023-10-09T11:41:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.108+0000 7f1f77996700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ce1f0 0x7f1f700aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.108+0000 7f1f77996700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f700ce5c0 0x7f1f7015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f77996700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7015dfb0 con 0x7f1f700ac570 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f77996700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700acec0 con 0x7f1f700ce5c0 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f77996700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700ad1a0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f700ce5c0 0x7f1f7015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f700ce5c0 0x7f1f7015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44874/0 (socket says 172.21.15.6:44874) 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 -- 172.21.15.6:0/4228459824 learned_addr learned my addr 172.21.15.6:0/4228459824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f75732700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ce1f0 0x7f1f700aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 -- 172.21.15.6:0/4228459824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ce1f0 msgr2=0x7f1f700aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ce1f0 0x7f1f700aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 -- 172.21.15.6:0/4228459824 >> v1:172.21.15.118:6789/0 conn(0x7f1f700ac570 legacy=0x7f1f7006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 -- 172.21.15.6:0/4228459824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7015dc40 con 0x7f1f700ce5c0 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f74f31700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce5c0 0x7f1f7015e440 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1f600099b0 tx=0x7f1f60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b45fecf13b6318 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f67fff700 1 -- 172.21.15.6:0/4228459824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60009ea0 con 0x7f1f700ce5c0 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f67fff700 1 -- 172.21.15.6:0/4228459824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6000b860 con 0x7f1f700ce5c0 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.109+0000 7f1f67fff700 1 -- 172.21.15.6:0/4228459824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000bc00 con 0x7f1f700ce5c0 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 -- 172.21.15.6:0/4228459824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce5c0 msgr2=0x7f1f7015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce5c0 0x7f1f7015e440 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1f600099b0 tx=0x7f1f60009250 comp rx=0 tx=0).stop 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 -- 172.21.15.6:0/4228459824 shutdown_connections 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ce1f0 0x7f1f700aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 --2- 172.21.15.6:0/4228459824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce5c0 0x7f1f7015e440 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 -- 172.21.15.6:0/4228459824 >> 172.21.15.6:0/4228459824 conn(0x7f1f7006cca0 msgr2=0x7f1f7006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 -- 172.21.15.6:0/4228459824 shutdown_connections 2023-10-09T11:41:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.110+0000 7f1f77996700 1 -- 172.21.15.6:0/4228459824 wait complete. 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.111+0000 7f1f77996700 1 Processor -- start 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.111+0000 7f1f77996700 1 -- start start 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ac570 0x7f1f7015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 0x7f1f701557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700ad930 con 0x7f1f700ce1f0 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700adc10 con 0x7f1f700ce5c0 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f77996700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700adef0 con 0x7f1f700ac570 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44888/0 (socket says 172.21.15.6:44888) 2023-10-09T11:41:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 -- 172.21.15.6:0/3463007094 learned_addr learned my addr 172.21.15.6:0/3463007094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f75732700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ac570 0x7f1f7015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f75f33700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 0x7f1f701557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 -- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ac570 msgr2=0x7f1f7015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ac570 0x7f1f7015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 -- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 msgr2=0x7f1f701557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 0x7f1f701557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f74f31700 1 -- 172.21.15.6:0/3463007094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600094f0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.112+0000 7f1f75f33700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 0x7f1f701557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f74f31700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1f7006cc70 tx=0x7f1f60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000bbe0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f60011420 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f700ae1d0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600117e0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.113+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f700ad510 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.114+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f700aea50 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.114+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f60011b90 con 0x7f1f700ce1f0 2023-10-09T11:41:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.115+0000 7f1f657fa700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 0x7f1f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.115+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f60085bd0 con 0x7f1f700ce1f0 2023-10-09T11:41:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.115+0000 7f1f75732700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 0x7f1f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.115+0000 7f1f75732700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 0x7f1f540693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d40 tx=0x7f1f6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.119+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f700aea50 con 0x7f1f700ce1f0 2023-10-09T11:41:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.390+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f1f700aea50 con 0x7f1f700ce1f0 2023-10-09T11:41:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.979+0000 7f1f657fa700 1 -- 172.21.15.6:0/3463007094 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v282) v1 ==== 131+0+0 (secure 0 0 0) 0x7f1f700aea50 con 0x7f1f700ce1f0 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 msgr2=0x7f1f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 0x7f1f540693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d40 tx=0x7f1f6c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 msgr2=0x7f1f700c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1f7006cc70 tx=0x7f1f60017000 comp rx=0 tx=0).stop 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 shutdown_connections 2023-10-09T11:41:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f54066f30 0x7f1f540693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f700ce5c0 0x7f1f701557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f700ac570 0x7f1f7015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 --2- 172.21.15.6:0/3463007094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f700ce1f0 0x7f1f700c28a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 >> 172.21.15.6:0/3463007094 conn(0x7f1f7006cca0 msgr2=0x7f1f70159850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 shutdown_connections 2023-10-09T11:41:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:32.981+0000 7f1f77996700 1 -- 172.21.15.6:0/3463007094 wait complete. 2023-10-09T11:41:32.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:41:33.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.120+0000 7fe9e27b5700 1 Processor -- start 2023-10-09T11:41:33.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.120+0000 7fe9e27b5700 1 -- start start 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e27b5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e27b5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9dc06d530 0x7fe9dc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e27b5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc06d990 con 0x7fe9dc0d0b80 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e27b5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc15a690 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e27b5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0cf2d0 con 0x7fe9dc06d530 2023-10-09T11:41:33.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44898/0 (socket says 172.21.15.6:44898) 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 -- 172.21.15.6:0/3896516557 learned_addr learned my addr 172.21.15.6:0/3896516557 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e1fb4700 1 --2- 172.21.15.6:0/3896516557 >> v2:172.21.15.118:3300/0 conn(0x7fe9dc06d530 0x7fe9dc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 -- 172.21.15.6:0/3896516557 >> v2:172.21.15.118:3300/0 conn(0x7fe9dc06d530 msgr2=0x7fe9dc15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 --2- 172.21.15.6:0/3896516557 >> v2:172.21.15.118:3300/0 conn(0x7fe9dc06d530 0x7fe9dc15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 -- 172.21.15.6:0/3896516557 >> v1:172.21.15.118:6789/0 conn(0x7fe9dc0d0b80 legacy=0x7fe9dc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.121+0000 7fe9e0fb2700 1 -- 172.21.15.6:0/3896516557 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0d0480 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e0fb2700 1 --2- 172.21.15.6:0/3896516557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ce9b0 tx=0x7fe9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3332f54de235a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9dbfff700 1 -- 172.21.15.6:0/3896516557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000b820 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9dbfff700 1 -- 172.21.15.6:0/3896516557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d000b980 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9dbfff700 1 -- 172.21.15.6:0/3896516557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000bd20 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 -- 172.21.15.6:0/3896516557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 msgr2=0x7fe9dc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/3896516557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0ce9b0 tx=0x7fe9d0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 -- 172.21.15.6:0/3896516557 shutdown_connections 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/3896516557 >> v2:172.21.15.118:3300/0 conn(0x7fe9dc06d530 0x7fe9dc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/3896516557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc06cff0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 -- 172.21.15.6:0/3896516557 >> 172.21.15.6:0/3896516557 conn(0x7fe9dc063230 msgr2=0x7fe9dc063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 -- 172.21.15.6:0/3896516557 shutdown_connections 2023-10-09T11:41:33.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.122+0000 7fe9e27b5700 1 -- 172.21.15.6:0/3896516557 wait complete. 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.123+0000 7fe9e27b5700 1 Processor -- start 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.123+0000 7fe9e27b5700 1 -- start start 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 0x7fe9dc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc0d0b80 0x7fe9dc1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc153da0 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1584a0 con 0x7fe9dc0d0b80 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e27b5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1575b0 con 0x7fe9dc06d530 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e1fb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e1fb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44902/0 (socket says 172.21.15.6:44902) 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.124+0000 7fe9e1fb4700 1 -- 172.21.15.6:0/2627340138 learned_addr learned my addr 172.21.15.6:0/2627340138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e0fb2700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc0d0b80 0x7fe9dc1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e17b3700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 0x7fe9dc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 -- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 msgr2=0x7fe9dc153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 0x7fe9dc153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 -- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc0d0b80 msgr2=0x7fe9dc1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc0d0b80 0x7fe9dc1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 -- 172.21.15.6:0/2627340138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00094f0 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e17b3700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 0x7fe9dc153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e1fb4700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c8b0 tx=0x7fe9d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4011660 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40117c0 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc157890 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4011b40 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.125+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc157e50 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.126+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc158630 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.127+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9d40193f0 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.127+0000 7fe9d97fa700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 0x7fe9c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.127+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe9d4084550 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.127+0000 7fe9e17b3700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 0x7fe9c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.128+0000 7fe9e17b3700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 0x7fe9c8069410 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc001410 tx=0x7fe9cc0096a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.131+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9d4055550 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.327+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe9dc067750 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.330+0000 7fe9d97fa700 1 -- 172.21.15.6:0/2627340138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe9dc067750 con 0x7fe9dc0d0f50 2023-10-09T11:41:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.332+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 msgr2=0x7fe9c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.332+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 0x7fe9c8069410 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc001410 tx=0x7fe9cc0096a0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.332+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 msgr2=0x7fe9dc155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.332+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c8b0 tx=0x7fe9d4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 shutdown_connections 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe9c8066f60 0x7fe9c8069410 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9dc0d0f50 0x7fe9dc155bc0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9dc06d530 0x7fe9dc153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 --2- 172.21.15.6:0/2627340138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc0d0b80 0x7fe9dc1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 >> 172.21.15.6:0/2627340138 conn(0x7fe9dc063230 msgr2=0x7fe9dc0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 shutdown_connections 2023-10-09T11:41:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.333+0000 7fe9e27b5700 1 -- 172.21.15.6:0/2627340138 wait complete. 2023-10-09T11:41:33.346 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:33.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:33.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:33.425 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:33.425 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:41:33.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.542+0000 7f16fab94700 1 Processor -- start 2023-10-09T11:41:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.542+0000 7f16fab94700 1 -- start start 2023-10-09T11:41:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16fab94700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f4159b40 0x7f16f40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16fab94700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16f4068e90 0x7f16f40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16fab94700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40cee10 con 0x7f16f4159f10 2023-10-09T11:41:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16fab94700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40cd040 con 0x7f16f4159b40 2023-10-09T11:41:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16fab94700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40cd320 con 0x7f16f4068e90 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16f9b92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f4159b40 0x7f16f40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16f9b92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16f4159b40 0x7f16f40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49650/0 (socket says 172.21.15.6:49650) 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.543+0000 7f16f9b92700 1 -- 172.21.15.6:0/3616203788 learned_addr learned my addr 172.21.15.6:0/3616203788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f9b92700 1 -- 172.21.15.6:0/3616203788 >> v2:172.21.15.118:3300/0 conn(0x7f16f4068e90 msgr2=0x7f16f40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f9b92700 1 --2- 172.21.15.6:0/3616203788 >> v2:172.21.15.118:3300/0 conn(0x7f16f4068e90 0x7f16f40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f9b92700 1 -- 172.21.15.6:0/3616203788 >> v1:172.21.15.118:6789/0 conn(0x7f16f4159f10 legacy=0x7f16f4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f9b92700 1 -- 172.21.15.6:0/3616203788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40ce7c0 con 0x7f16f4159b40 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f9b92700 1 --2- 172.21.15.6:0/3616203788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4159b40 0x7f16f40cc600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16f40cae10 tx=0x7f16ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1180a600e422d2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f8b90700 1 -- 172.21.15.6:0/3616203788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00b820 con 0x7f16f4159b40 2023-10-09T11:41:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f8b90700 1 -- 172.21.15.6:0/3616203788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00b980 con 0x7f16f4159b40 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16f8b90700 1 -- 172.21.15.6:0/3616203788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00bd20 con 0x7f16f4159b40 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16fab94700 1 -- 172.21.15.6:0/3616203788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4159b40 msgr2=0x7f16f40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.544+0000 7f16fab94700 1 --2- 172.21.15.6:0/3616203788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4159b40 0x7f16f40cc600 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f16f40cae10 tx=0x7f16ec009250 comp rx=0 tx=0).stop 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 -- 172.21.15.6:0/3616203788 shutdown_connections 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 --2- 172.21.15.6:0/3616203788 >> v2:172.21.15.118:3300/0 conn(0x7f16f4068e90 0x7f16f40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 --2- 172.21.15.6:0/3616203788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4159b40 0x7f16f40cc600 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 -- 172.21.15.6:0/3616203788 >> 172.21.15.6:0/3616203788 conn(0x7f16f40cd660 msgr2=0x7f16f40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 -- 172.21.15.6:0/3616203788 shutdown_connections 2023-10-09T11:41:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.545+0000 7f16fab94700 1 -- 172.21.15.6:0/3616203788 wait complete. 2023-10-09T11:41:33.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.546+0000 7f16fab94700 1 Processor -- start 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.546+0000 7f16fab94700 1 -- start start 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.546+0000 7f16fab94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.546+0000 7f16fab94700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16f4159b40 0x7f16f4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16f4159f10 0x7f16f4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4158f00 con 0x7f16f4068e90 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41591e0 con 0x7f16f4159f10 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40c91c0 con 0x7f16f4159b40 2023-10-09T11:41:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49660/0 (socket says 172.21.15.6:49660) 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 -- 172.21.15.6:0/2287934181 learned_addr learned my addr 172.21.15.6:0/2287934181 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 -- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16f4159b40 msgr2=0x7f16f4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16f4159b40 0x7f16f4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 -- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16f4159f10 msgr2=0x7f16f4156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16f4159f10 0x7f16f4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 -- 172.21.15.6:0/2287934181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0094f0 con 0x7f16f4068e90 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f9b92700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f16ec003080 tx=0x7f16ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec011e20 con 0x7f16f4068e90 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec01f070 con 0x7f16f4068e90 2023-10-09T11:41:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40c94a0 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec01a8a0 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.547+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41414b0 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.548+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f406c4f0 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.549+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16ec01ac90 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.549+0000 7f16f1ffb700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 0x7f16e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.549+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f16ec021070 con 0x7f16f4068e90 2023-10-09T11:41:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.549+0000 7f16f9391700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 0x7f16e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.550+0000 7f16f9391700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 0x7f16e00693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16f4157c70 tx=0x7f16e8006c40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.554+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16ec053ac0 con 0x7f16f4068e90 2023-10-09T11:41:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.791+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16f40ceaa0 con 0x7f16f4068e90 2023-10-09T11:41:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.792+0000 7f16f1ffb700 1 -- 172.21.15.6:0/2287934181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f16ec02b090 con 0x7f16f4068e90 2023-10-09T11:41:33.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:33.793 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6085,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1900613388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":1900613388},{"type":"v1","addr":"172.21.15.6:6837","nonce":1900613388}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6321,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3586057714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3586057714},{"type":"v1","addr":"172.21.15.6:6836","nonce":3586057714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/3899395545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3899395545},{"type":"v1","addr":"172.21.15.118:6834","nonce":3899395545}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/3365683498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":3365683498},{"type":"v1","addr":"172.21.15.118:6835","nonce":3365683498}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-10-09T11:41:33.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 msgr2=0x7f16e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 0x7f16e00693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16f4157c70 tx=0x7f16e8006c40 comp rx=0 tx=0).stop 2023-10-09T11:41:33.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 msgr2=0x7f16f4140f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f16ec003080 tx=0x7f16ec016000 comp rx=0 tx=0).stop 2023-10-09T11:41:33.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 shutdown_connections 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f16e0066f30 0x7f16e00693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16f4159f10 0x7f16f4156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f4068e90 0x7f16f4140f70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 --2- 172.21.15.6:0/2287934181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16f4159b40 0x7f16f4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 >> 172.21.15.6:0/2287934181 conn(0x7f16f40cd660 msgr2=0x7f16f406f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 shutdown_connections 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.794+0000 7f16fab94700 1 -- 172.21.15.6:0/2287934181 wait complete. 2023-10-09T11:41:33.797 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-10-09T11:41:33.810 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:41:33.810 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:41:33.810 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:41:33.810 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:33.811 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:41:33.811 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:41:33.811 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:41:33.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:33.811 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:41:33.811 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:41:33.812 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:41:33.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:33.812 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:41:33.812 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:41:33.812 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:41:33.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:41:33.819 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:41:33.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:41:33.820 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:41:33.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:41:33.821 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:41:33.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:41:33.823 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:41:33.823 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:41:33.861 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:41:33.862 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:33.863 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:41:33.863 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:33.864 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:41:33.864 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:33.865 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:41:33.865 DEBUG:teuthology.parallel:result is None 2023-10-09T11:41:33.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:41:33.937 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:41:33.938 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:41:33.943 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:41:33.943 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:41:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.990+0000 7fe8e6fc6700 1 Processor -- start 2023-10-09T11:41:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.990+0000 7fe8e6fc6700 1 -- start start 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e6fc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8e015a2a0 0x7fe8e00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e6fc6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e006dd60 0x7fe8e00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e6fc6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00b0ca0 con 0x7fe8e00ceb30 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e6fc6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e006e160 con 0x7fe8e015a2a0 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e6fc6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e006ea90 con 0x7fe8e006dd60 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8e015a2a0 0x7fe8e00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8dffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe8e00ceb30 0x7fe8e006d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49892/0 (socket says 172.21.15.6:49892) 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8dffff700 1 -- 172.21.15.6:0/2012670841 learned_addr learned my addr 172.21.15.6:0/2012670841 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e5563700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e006dd60 0x7fe8e00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 -- 172.21.15.6:0/2012670841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e006dd60 msgr2=0x7fe8e00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e006dd60 0x7fe8e00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 -- 172.21.15.6:0/2012670841 >> v1:172.21.15.6:6789/0 conn(0x7fe8e00ceb30 legacy=0x7fe8e006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 -- 172.21.15.6:0/2012670841 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00b00d0 con 0x7fe8e015a2a0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8df7fe700 1 -- 172.21.15.6:0/2012670841 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888879090 0 0) 0x7fe8e00b0ca0 con 0x7fe8e00ceb30 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.991+0000 7fe8e4d62700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e015a2a0 0x7fe8e00b1130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098e0 tx=0x7fe8d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652ffc714e0e7bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8df7fe700 1 -- 172.21.15.6:0/2012670841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400b640 con 0x7fe8e015a2a0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8df7fe700 1 -- 172.21.15.6:0/2012670841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400b7a0 con 0x7fe8e015a2a0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8df7fe700 1 -- 172.21.15.6:0/2012670841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400bb40 con 0x7fe8e015a2a0 2023-10-09T11:41:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/2012670841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e015a2a0 msgr2=0x7fe8e00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e015a2a0 0x7fe8e00b1130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098e0 tx=0x7fe8d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/2012670841 shutdown_connections 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e006dd60 0x7fe8e00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/2012670841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e015a2a0 0x7fe8e00b1130 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/2012670841 >> 172.21.15.6:0/2012670841 conn(0x7fe8e0067640 msgr2=0x7fe8e0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/2012670841 shutdown_connections 2023-10-09T11:41:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.992+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/2012670841 wait complete. 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.993+0000 7fe8e6fc6700 1 Processor -- start 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.993+0000 7fe8e6fc6700 1 -- start start 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e00ceb30 0x7fe8e016e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 0x7fe8e00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e016e7d0 con 0x7fe8e006dd60 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e015bcd0 con 0x7fe8e00ceb30 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e6fc6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0155f90 con 0x7fe8e015a2a0 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e4d62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e4d62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49688/0 (socket says 172.21.15.6:49688) 2023-10-09T11:41:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e4d62700 1 -- 172.21.15.6:0/3812090241 learned_addr learned my addr 172.21.15.6:0/3812090241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8e5563700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 0x7fe8e00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.994+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e00ceb30 0x7fe8e016e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 -- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 msgr2=0x7fe8e00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 0x7fe8e00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 -- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e00ceb30 msgr2=0x7fe8e016e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e00ceb30 0x7fe8e016e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 -- 172.21.15.6:0/3812090241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009420 con 0x7fe8e006dd60 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e5563700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 0x7fe8e00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e4d62700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009f80 tx=0x7fe8d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400bb20 con 0x7fe8e006dd60 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4000c90 con 0x7fe8e006dd60 2023-10-09T11:41:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011630 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e015b0c0 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.995+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e015b680 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.996+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e015bfb0 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.996+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8d40119a0 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.997+0000 7fe8dcff9700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.997+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe8d4085550 con 0x7fe8e006dd60 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.997+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:33.997+0000 7fe8dffff700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007fd0 tx=0x7fe8cc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:34.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:34.001+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d4052ac0 con 0x7fe8e006dd60 2023-10-09T11:41:34.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:34.211+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe8e006e4e0 con 0x7fe8e006dd60 2023-10-09T11:41:34.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:34.619 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:41:35.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:34.999+0000 7fe8dcff9700 1 -- 172.21.15.6:0/3812090241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe8d40560e0 con 0x7fe8e006dd60 2023-10-09T11:41:35.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 msgr2=0x7fe8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc007fd0 tx=0x7fe8cc007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 msgr2=0x7fe8e015c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009f80 tx=0x7fe8d4017000 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 shutdown_connections 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8e015a2a0 0x7fe8e00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8e006dd60 0x7fe8e015c160 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 --2- 172.21.15.6:0/3812090241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e00ceb30 0x7fe8e016e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 >> 172.21.15.6:0/3812090241 conn(0x7fe8e0067640 msgr2=0x7fe8e00ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 shutdown_connections 2023-10-09T11:41:35.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.001+0000 7fe8e6fc6700 1 -- 172.21.15.6:0/3812090241 wait complete. 2023-10-09T11:41:35.004 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:41:35.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:41:35.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.133+0000 7f6e2c34d700 1 Processor -- start 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.133+0000 7f6e2c34d700 1 -- start start 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 0x7f6e2415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 0x7f6e240b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e240b3170 0x7f6e2406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240b35d0 con 0x7f6e240b3170 2023-10-09T11:41:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e24069d10 con 0x7f6e2406c190 2023-10-09T11:41:35.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2c34d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415c130 con 0x7f6e24157a60 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e240b3170 0x7f6e2406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e240b3170 0x7f6e2406a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49698/0 (socket says 172.21.15.6:49698) 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 -- 172.21.15.6:0/1138995549 learned_addr learned my addr 172.21.15.6:0/1138995549 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a0e9700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 0x7f6e2415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e298e8700 1 --2- 172.21.15.6:0/1138995549 >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 0x7f6e240b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 -- 172.21.15.6:0/1138995549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 msgr2=0x7f6e2415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 0x7f6e2415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 -- 172.21.15.6:0/1138995549 >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 msgr2=0x7f6e240b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 --2- 172.21.15.6:0/1138995549 >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 0x7f6e240b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a8ea700 1 -- 172.21.15.6:0/1138995549 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2415c410 con 0x7f6e240b3170 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e298e8700 1 --2- 172.21.15.6:0/1138995549 >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 0x7f6e240b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.134+0000 7f6e2a0e9700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 0x7f6e2415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2a8ea700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e240b3170 0x7f6e2406a1a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6e240693b0 tx=0x7f6e14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cc4fbd91df55f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e290e7700 1 -- 172.21.15.6:0/1138995549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e070 con 0x7f6e240b3170 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e290e7700 1 -- 172.21.15.6:0/1138995549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400ba50 con 0x7f6e240b3170 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e290e7700 1 -- 172.21.15.6:0/1138995549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140092e0 con 0x7f6e240b3170 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1138995549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e240b3170 msgr2=0x7f6e2406a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e240b3170 0x7f6e2406a1a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6e240693b0 tx=0x7f6e14009840 comp rx=0 tx=0).stop 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1138995549 shutdown_connections 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e240b3170 0x7f6e2406a1a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1138995549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e24157a60 0x7f6e2415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1138995549 >> v2:172.21.15.118:3300/0 conn(0x7f6e2406c190 0x7f6e240b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1138995549 >> 172.21.15.6:0/1138995549 conn(0x7f6e2406cca0 msgr2=0x7f6e2406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1138995549 shutdown_connections 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.135+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1138995549 wait complete. 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 Processor -- start 2023-10-09T11:41:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 -- start start 2023-10-09T11:41:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e240b3170 0x7f6e24167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e24157a60 0x7f6e241587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240a7190 con 0x7f6e2406c190 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415a450 con 0x7f6e24157a60 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2c34d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e241684b0 con 0x7f6e240b3170 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2a0e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2a0e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49702/0 (socket says 172.21.15.6:49702) 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.137+0000 7f6e2a0e9700 1 -- 172.21.15.6:0/1339644237 learned_addr learned my addr 172.21.15.6:0/1339644237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a8ea700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e24157a60 0x7f6e241587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 -- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e240b3170 msgr2=0x7f6e24167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e240b3170 0x7f6e24167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 -- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e24157a60 msgr2=0x7f6e241587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e24157a60 0x7f6e241587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 -- 172.21.15.6:0/1339644237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009ae0 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2a0e9700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d860 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c009610 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c009770 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24159840 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c009b10 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.138+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24159e00 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.139+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24068900 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.139+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e1c014430 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.140+0000 7f6e227fc700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.140+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6e1c084610 con 0x7f6e2406c190 2023-10-09T11:41:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.140+0000 7f6e298e8700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.140+0000 7f6e298e8700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 0x7f6e100693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.144+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e1c051bd0 con 0x7f6e2406c190 2023-10-09T11:41:35.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.417+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e2415a730 con 0x7f6e2406c190 2023-10-09T11:41:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.418+0000 7f6e227fc700 1 -- 172.21.15.6:0/1339644237 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6e1c0551f0 con 0x7f6e2406c190 2023-10-09T11:41:35.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:35.419 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:35.419 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:41:35.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.420 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:41:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.422 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:41:35.424 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.425 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:41:35.427 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:41:35.428 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.430 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:41:35.431 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:41:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:41:35.434 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 msgr2=0x7f6e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 0x7f6e100693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18008040 comp rx=0 tx=0).stop 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 msgr2=0x7f6e2416af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d860 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 shutdown_connections 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6e10066f30 0x7f6e100693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e24157a60 0x7f6e241587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e2406c190 0x7f6e2416af00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 --2- 172.21.15.6:0/1339644237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6e240b3170 0x7f6e24167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 >> 172.21.15.6:0/1339644237 conn(0x7f6e2406cca0 msgr2=0x7f6e241535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 shutdown_connections 2023-10-09T11:41:35.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.420+0000 7f6e2c34d700 1 -- 172.21.15.6:0/1339644237 wait complete. 2023-10-09T11:41:35.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:35.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 Processor -- start 2023-10-09T11:41:35.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 -- start start 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f141578d0 0x7f9f140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140d07c0 con 0x7f9f1406d120 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f140cfbb0 con 0x7f9f141578d0 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.555+0000 7f9f19051700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cfe90 con 0x7f9f14157ca0 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f141578d0 0x7f9f140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f1359e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9f1406d120 0x7f9f1415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:51548/0 (socket says 172.21.15.6:51548) 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f141578d0 0x7f9f140cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:49444/0 (socket says 172.21.15.6:49444) 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f1359e700 1 -- 172.21.15.6:0/428869530 learned_addr learned my addr 172.21.15.6:0/428869530 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f1259c700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 -- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 msgr2=0x7f9f1415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 -- 172.21.15.6:0/428869530 >> v1:172.21.15.118:6789/0 conn(0x7f9f1406d120 legacy=0x7f9f1415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f11d9b700 1 -- 172.21.15.6:0/428869530 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900927112 0 0) 0x7f9f140d07c0 con 0x7f9f1406d120 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.556+0000 7f9f12d9d700 1 -- 172.21.15.6:0/428869530 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140d0170 con 0x7f9f141578d0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f12d9d700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f141578d0 0x7f9f140cf4f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9f040098e0 tx=0x7f9f040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d425318f5b202c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f11d9b700 1 -- 172.21.15.6:0/428869530 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400b640 con 0x7f9f141578d0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f11d9b700 1 -- 172.21.15.6:0/428869530 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400b7a0 con 0x7f9f141578d0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f11d9b700 1 -- 172.21.15.6:0/428869530 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400bb40 con 0x7f9f141578d0 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 -- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f141578d0 msgr2=0x7f9f140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f141578d0 0x7f9f140cf4f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9f040098e0 tx=0x7f9f040091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 -- 172.21.15.6:0/428869530 shutdown_connections 2023-10-09T11:41:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f141578d0 0x7f9f140cf4f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 --2- 172.21.15.6:0/428869530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 -- 172.21.15.6:0/428869530 >> 172.21.15.6:0/428869530 conn(0x7f9f1406bb90 msgr2=0x7f9f1406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 -- 172.21.15.6:0/428869530 shutdown_connections 2023-10-09T11:41:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.557+0000 7f9f19051700 1 -- 172.21.15.6:0/428869530 wait complete. 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 Processor -- start 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 -- start start 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1406d120 0x7f9f140cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c5cc0 con 0x7f9f141578d0 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c5fa0 con 0x7f9f1406d120 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f19051700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140c6280 con 0x7f9f14157ca0 2023-10-09T11:41:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f1259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f1259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49714/0 (socket says 172.21.15.6:49714) 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.559+0000 7f9f1259c700 1 -- 172.21.15.6:0/1229248172 learned_addr learned my addr 172.21.15.6:0/1229248172 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f12d9d700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1406d120 0x7f9f140cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1359e700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 -- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 msgr2=0x7f9f1415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 -- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1406d120 msgr2=0x7f9f140cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1406d120 0x7f9f140cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 -- 172.21.15.6:0/1229248172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04009420 con 0x7f9f141578d0 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f1259c700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e930 tx=0x7f9efc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00eed0 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00c850 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f140c6560 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00cbf0 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.560+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f140c87f0 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.561+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f14067ac0 con 0x7f9f141578d0 2023-10-09T11:41:35.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.562+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9efc013470 con 0x7f9f141578d0 2023-10-09T11:41:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.562+0000 7f9f0affd700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 0x7f9ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.562+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9efc084410 con 0x7f9f141578d0 2023-10-09T11:41:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.562+0000 7f9f12d9d700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 0x7f9ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.562+0000 7f9f12d9d700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 0x7f9ef40693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f14156cc0 tx=0x7f9f04017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.566+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9efc0519d0 con 0x7f9f141578d0 2023-10-09T11:41:35.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.760+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f140d0450 con 0x7f9f141578d0 2023-10-09T11:41:35.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.760+0000 7f9f0affd700 1 -- 172.21.15.6:0/1229248172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+12089 (secure 0 0 0) 0x7f9efc054ff0 con 0x7f9f141578d0 2023-10-09T11:41:35.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:35.762 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":111,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:34.988782+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 msgr2=0x7f9ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 0x7f9ef40693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f14156cc0 tx=0x7f9f04017000 comp rx=0 tx=0).stop 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 msgr2=0x7f9f14069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00e930 tx=0x7f9efc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 shutdown_connections 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ef4066f30 0x7f9ef40693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f14157ca0 0x7f9f1415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f1406d120 0x7f9f140cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 --2- 172.21.15.6:0/1229248172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f141578d0 0x7f9f14069ca0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 >> 172.21.15.6:0/1229248172 conn(0x7f9f1406bb90 msgr2=0x7f9f14155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 shutdown_connections 2023-10-09T11:41:35.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.762+0000 7f9f19051700 1 -- 172.21.15.6:0/1229248172 wait complete. 2023-10-09T11:41:35.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:41:35.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:35.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.896+0000 7fee2a28d700 1 Processor -- start 2023-10-09T11:41:35.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.896+0000 7fee2a28d700 1 -- start start 2023-10-09T11:41:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee2a28d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee24157fe0 0x7fee240b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee2a28d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fee241583b0 0x7fee240b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee2a28d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee240b2890 con 0x7fee240ceb30 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee2a28d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee240b4070 con 0x7fee24157fe0 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee2a28d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee240b4350 con 0x7fee241583b0 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee23fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee24157fe0 0x7fee240b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee23fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee24157fe0 0x7fee240b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49720/0 (socket says 172.21.15.6:49720) 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.897+0000 7fee23fff700 1 -- 172.21.15.6:0/1342782046 learned_addr learned my addr 172.21.15.6:0/1342782046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee237fe700 1 --2- 172.21.15.6:0/1342782046 >> v2:172.21.15.118:3300/0 conn(0x7fee241583b0 0x7fee240b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee23fff700 1 -- 172.21.15.6:0/1342782046 >> v2:172.21.15.118:3300/0 conn(0x7fee241583b0 msgr2=0x7fee240b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee23fff700 1 --2- 172.21.15.6:0/1342782046 >> v2:172.21.15.118:3300/0 conn(0x7fee241583b0 0x7fee240b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee23fff700 1 -- 172.21.15.6:0/1342782046 >> v1:172.21.15.118:6789/0 conn(0x7fee240ceb30 legacy=0x7fee240cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee23fff700 1 -- 172.21.15.6:0/1342782046 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240b4630 con 0x7fee24157fe0 2023-10-09T11:41:35.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee23fff700 1 --2- 172.21.15.6:0/1342782046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee24157fe0 0x7fee240b34c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fee2404c150 tx=0x7fee14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35906d3c63a6433b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee22ffd700 1 -- 172.21.15.6:0/1342782046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400b860 con 0x7fee24157fe0 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee22ffd700 1 -- 172.21.15.6:0/1342782046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1400b9c0 con 0x7fee24157fe0 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.898+0000 7fee22ffd700 1 -- 172.21.15.6:0/1342782046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400bd60 con 0x7fee24157fe0 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 -- 172.21.15.6:0/1342782046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee24157fe0 msgr2=0x7fee240b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 --2- 172.21.15.6:0/1342782046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee24157fe0 0x7fee240b34c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fee2404c150 tx=0x7fee14009250 comp rx=0 tx=0).stop 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 -- 172.21.15.6:0/1342782046 shutdown_connections 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 --2- 172.21.15.6:0/1342782046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee24157fe0 0x7fee240b34c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 --2- 172.21.15.6:0/1342782046 >> v2:172.21.15.118:3300/0 conn(0x7fee241583b0 0x7fee240b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 -- 172.21.15.6:0/1342782046 >> 172.21.15.6:0/1342782046 conn(0x7fee24067640 msgr2=0x7fee24067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 -- 172.21.15.6:0/1342782046 shutdown_connections 2023-10-09T11:41:35.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.899+0000 7fee2a28d700 1 -- 172.21.15.6:0/1342782046 wait complete. 2023-10-09T11:41:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.900+0000 7fee2a28d700 1 Processor -- start 2023-10-09T11:41:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.900+0000 7fee2a28d700 1 -- start start 2023-10-09T11:41:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee240ceb30 0x7fee2414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee24157fe0 0x7fee2415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241522a0 con 0x7fee241583b0 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24152580 con 0x7fee24157fe0 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee24152860 con 0x7fee240ceb30 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49724/0 (socket says 172.21.15.6:49724) 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 -- 172.21.15.6:0/501739635 learned_addr learned my addr 172.21.15.6:0/501739635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee23fff700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee240ceb30 0x7fee2414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee237fe700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee24157fe0 0x7fee2415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 -- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee240ceb30 msgr2=0x7fee2414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee240ceb30 0x7fee2414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 -- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee24157fe0 msgr2=0x7fee2415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee24157fe0 0x7fee2415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 -- 172.21.15.6:0/501739635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140094f0 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2882a700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c810 tx=0x7fee1c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c012630 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0127b0 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c012b70 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.901+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee24152b40 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.902+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2414ad40 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.902+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee24153060 con 0x7fee241583b0 2023-10-09T11:41:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.903+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee1c003030 con 0x7fee241583b0 2023-10-09T11:41:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.903+0000 7fee1bfff700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 0x7fee040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.903+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fee1c084160 con 0x7fee241583b0 2023-10-09T11:41:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.903+0000 7fee23fff700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 0x7fee040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.904+0000 7fee23fff700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 0x7fee040693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee2404c150 tx=0x7fee14017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:35.907+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee24153060 con 0x7fee241583b0 2023-10-09T11:41:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.100+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee24153060 con 0x7fee241583b0 2023-10-09T11:41:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.100+0000 7fee1bfff700 1 -- 172.21.15.6:0/501739635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee24153060 con 0x7fee241583b0 2023-10-09T11:41:36.102 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 msgr2=0x7fee040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 0x7fee040693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee2404c150 tx=0x7fee14017000 comp rx=0 tx=0).stop 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 msgr2=0x7fee24153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c810 tx=0x7fee1c001650 comp rx=0 tx=0).stop 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 shutdown_connections 2023-10-09T11:41:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee04066f30 0x7fee040693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee241583b0 0x7fee24153340 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee240ceb30 0x7fee2414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 --2- 172.21.15.6:0/501739635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee24157fe0 0x7fee2415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 >> 172.21.15.6:0/501739635 conn(0x7fee24067640 msgr2=0x7fee240cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 shutdown_connections 2023-10-09T11:41:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.102+0000 7fee2a28d700 1 -- 172.21.15.6:0/501739635 wait complete. 2023-10-09T11:41:36.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:41:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.233+0000 7fb98d984700 1 Processor -- start 2023-10-09T11:41:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.233+0000 7fb98d984700 1 -- start start 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d984700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb988159b40 0x7fb9880cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d984700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb988068e90 0x7fb9880cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d984700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880cee10 con 0x7fb988159f10 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d984700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880cd040 con 0x7fb988159b40 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d984700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880cd320 con 0x7fb988068e90 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98c982700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb988159b40 0x7fb9880cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb987fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb988159f10 0x7fb988068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49900/0 (socket says 172.21.15.6:49900) 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb987fff700 1 -- 172.21.15.6:0/829855879 learned_addr learned my addr 172.21.15.6:0/829855879 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.234+0000 7fb98d183700 1 --2- 172.21.15.6:0/829855879 >> v2:172.21.15.118:3300/0 conn(0x7fb988068e90 0x7fb9880cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98c982700 1 -- 172.21.15.6:0/829855879 >> v2:172.21.15.118:3300/0 conn(0x7fb988068e90 msgr2=0x7fb9880cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98c982700 1 --2- 172.21.15.6:0/829855879 >> v2:172.21.15.118:3300/0 conn(0x7fb988068e90 0x7fb9880cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98c982700 1 -- 172.21.15.6:0/829855879 >> v1:172.21.15.6:6789/0 conn(0x7fb988159f10 legacy=0x7fb988068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98c982700 1 -- 172.21.15.6:0/829855879 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880ce7c0 con 0x7fb988159b40 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb9877fe700 1 -- 172.21.15.6:0/829855879 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873118516 0 0) 0x7fb9880cee10 con 0x7fb988159f10 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98c982700 1 --2- 172.21.15.6:0/829855879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb9880cc600 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb9880cae10 tx=0x7fb980009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e6fb575163cd88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb9877fe700 1 -- 172.21.15.6:0/829855879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000e070 con 0x7fb988159b40 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb9877fe700 1 -- 172.21.15.6:0/829855879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98000bb60 con 0x7fb988159b40 2023-10-09T11:41:36.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb9877fe700 1 -- 172.21.15.6:0/829855879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980012430 con 0x7fb988159b40 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 -- 172.21.15.6:0/829855879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 msgr2=0x7fb9880cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 --2- 172.21.15.6:0/829855879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb9880cc600 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb9880cae10 tx=0x7fb980009780 comp rx=0 tx=0).stop 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 -- 172.21.15.6:0/829855879 shutdown_connections 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 --2- 172.21.15.6:0/829855879 >> v2:172.21.15.118:3300/0 conn(0x7fb988068e90 0x7fb9880cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 --2- 172.21.15.6:0/829855879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb9880cc600 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 -- 172.21.15.6:0/829855879 >> 172.21.15.6:0/829855879 conn(0x7fb9880cd660 msgr2=0x7fb9880cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.235+0000 7fb98d984700 1 -- 172.21.15.6:0/829855879 shutdown_connections 2023-10-09T11:41:36.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.236+0000 7fb98d984700 1 -- 172.21.15.6:0/829855879 wait complete. 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 Processor -- start 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 -- start start 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb988068e90 0x7fb988155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb988159f10 0x7fb988144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9881452c0 con 0x7fb988159b40 2023-10-09T11:41:36.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98816e9f0 con 0x7fb988068e90 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.237+0000 7fb98d984700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb988156640 con 0x7fb988159f10 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49748/0 (socket says 172.21.15.6:49748) 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 -- 172.21.15.6:0/1059048044 learned_addr learned my addr 172.21.15.6:0/1059048044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb98c982700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb988068e90 0x7fb988155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb98d183700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb988159f10 0x7fb988144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 -- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb988159f10 msgr2=0x7fb988144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb988159f10 0x7fb988144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 -- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb988068e90 msgr2=0x7fb988155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb988068e90 0x7fb988155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 -- 172.21.15.6:0/1059048044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980009a20 con 0x7fb988159b40 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb987fff700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c5b0 tx=0x7fb978001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978005b30 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978005c90 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98816dc70 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978007300 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.238+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98816df10 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.239+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9880ceaa0 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.240+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb97801b3b0 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.240+0000 7fb984ff9700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 0x7fb968069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.240+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb9780836b0 con 0x7fb988159b40 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.240+0000 7fb98c982700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 0x7fb968069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.241+0000 7fb98c982700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 0x7fb968069460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb980009fd0 tx=0x7fb980019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.245+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb978050bd0 con 0x7fb988159b40 2023-10-09T11:41:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.440+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb988071b10 con 0x7fb988159b40 2023-10-09T11:41:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.440+0000 7fb984ff9700 1 -- 172.21.15.6:0/1059048044 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb978017060 con 0x7fb988159b40 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:41:36.442 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 msgr2=0x7fb968069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 0x7fb968069460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb980009fd0 tx=0x7fb980019000 comp rx=0 tx=0).stop 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 msgr2=0x7fb98816afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c5b0 tx=0x7fb978001070 comp rx=0 tx=0).stop 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 shutdown_connections 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb968066fb0 0x7fb968069460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb988159f10 0x7fb988144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb988068e90 0x7fb988155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 --2- 172.21.15.6:0/1059048044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb988159b40 0x7fb98816afb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 >> 172.21.15.6:0/1059048044 conn(0x7fb9880cd660 msgr2=0x7fb9880b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 shutdown_connections 2023-10-09T11:41:36.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.442+0000 7fb98d984700 1 -- 172.21.15.6:0/1059048044 wait complete. 2023-10-09T11:41:36.456 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:41:36.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:41:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.578+0000 7f117c9da700 1 Processor -- start 2023-10-09T11:41:36.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.578+0000 7f117c9da700 1 -- start start 2023-10-09T11:41:36.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117c9da700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f117815a2a0 0x7f11780b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117c9da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11780cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117c9da700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11780b0ca0 con 0x7f117806d650 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117c9da700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117806ea90 con 0x7f117815a2a0 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117c9da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780cf4c0 con 0x7f11780ceb30 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f1176d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f117806d650 0x7f117806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49916/0 (socket says 172.21.15.6:49916) 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f1176d9d700 1 -- 172.21.15.6:0/2174928570 learned_addr learned my addr 172.21.15.6:0/2174928570 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> v2:172.21.15.118:3300/0 conn(0x7f117815a2a0 0x7f11780b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f1175d9b700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11780cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482669671 0 0) 0x7f11780b0ca0 con 0x7f117806d650 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1164003570 con 0x7f117806d650 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089694250 0 0) 0x7f1164003570 con 0x7f117806d650 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 msgr2=0x7f11780cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11780cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 >> v2:172.21.15.118:3300/0 conn(0x7f117815a2a0 msgr2=0x7f11780b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 --2- 172.21.15.6:0/2174928570 >> v2:172.21.15.118:3300/0 conn(0x7f117815a2a0 0x7f11780b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780b00d0 con 0x7f117806d650 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f1168001470 con 0x7f117806d650 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 >> v1:172.21.15.6:6789/0 conn(0x7f117806d650 legacy=0x7f117806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1164003a60 0x7f1164003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1164004810 0x7f1164004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117806ea90 con 0x7f1164003a60 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780cf4c0 con 0x7f1164004810 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.579+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116400ba60 con 0x7f11780ceb30 2023-10-09T11:41:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> v2:172.21.15.118:3300/0 conn(0x7f117815a2a0 0x7f11780b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1164003a60 0x7f1164003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f1176d9d700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f1175d9b700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1164004810 0x7f1164004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 -- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 msgr2=0x7f11640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11780ceb30 0x7f11640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 -- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1164004810 msgr2=0x7f1164004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1164004810 0x7f1164004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 -- 172.21.15.6:0/2174928570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164003570 con 0x7f1164003a60 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117659c700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1164003a60 0x7f1164003e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f117000e3f0 tx=0x7f117000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d897ccf04c2e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000eca0 con 0x7f1164003a60 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000f040 con 0x7f1164003a60 2023-10-09T11:41:36.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.580+0000 7f117559a700 1 -- 172.21.15.6:0/2174928570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170014480 con 0x7f1164003a60 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 -- 172.21.15.6:0/2174928570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1164003a60 msgr2=0x7f1164003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 --2- 172.21.15.6:0/2174928570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1164003a60 0x7f1164003e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f117000e3f0 tx=0x7f117000b040 comp rx=0 tx=0).stop 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f1176d9d700 1 -- 172.21.15.6:0/2174928570 reap_dead start 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 -- 172.21.15.6:0/2174928570 shutdown_connections 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 -- 172.21.15.6:0/2174928570 >> 172.21.15.6:0/2174928570 conn(0x7f1178067640 msgr2=0x7f1178067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 -- 172.21.15.6:0/2174928570 shutdown_connections 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.581+0000 7f117c9da700 1 -- 172.21.15.6:0/2174928570 wait complete. 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.582+0000 7f117c9da700 1 Processor -- start 2023-10-09T11:41:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.582+0000 7f117c9da700 1 -- start start 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 0x7f1178145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117815a670 0x7f117815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117815b030 con 0x7f11780c7d50 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780c94d0 con 0x7f117815a670 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1178155180 con 0x7f1164003a60 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49778/0 (socket says 172.21.15.6:49778) 2023-10-09T11:41:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 -- 172.21.15.6:0/2904258920 learned_addr learned my addr 172.21.15.6:0/2904258920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117659c700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 0x7f1178145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1176d9d700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117815a670 0x7f117815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 -- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 msgr2=0x7f1178145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 0x7f1178145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 -- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117815a670 msgr2=0x7f117815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117815a670 0x7f117815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 -- 172.21.15.6:0/2904258920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780c88c0 con 0x7f11780c7d50 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117659c700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 0x7f1178145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f1175d9b700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1160011d40 tx=0x7f11600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000fa60 con 0x7f11780c7d50 2023-10-09T11:41:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000fbc0 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11780c8ba0 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160014440 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.583+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11780c9160 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.584+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178069e40 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.585+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1160014a80 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.585+0000 7f116e7fc700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 0x7f11580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.585+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1160018030 con 0x7f11780c7d50 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.585+0000 7f117659c700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 0x7f11580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.586+0000 7f117659c700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 0x7f11580693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f117000e3f0 tx=0x7f1170019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:36.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.590+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1160052480 con 0x7f11780c7d50 2023-10-09T11:41:36.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:36.783+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f11780c9610 con 0x7f11780c7d50 2023-10-09T11:41:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.011+0000 7f116e7fc700 1 -- 172.21.15.6:0/2904258920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1160022020 con 0x7f11780c7d50 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 msgr2=0x7f11580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 0x7f11580693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f117000e3f0 tx=0x7f1170019000 comp rx=0 tx=0).stop 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 msgr2=0x7f11780c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1160011d40 tx=0x7f11600091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 shutdown_connections 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1158066f30 0x7f11580693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117815a670 0x7f117815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1164003a60 0x7f1178145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 --2- 172.21.15.6:0/2904258920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11780c7d50 0x7f11780c81c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 >> 172.21.15.6:0/2904258920 conn(0x7f1178067640 msgr2=0x7f1178156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 shutdown_connections 2023-10-09T11:41:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.015+0000 7f117c9da700 1 -- 172.21.15.6:0/2904258920 wait complete. 2023-10-09T11:41:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:41:37.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:41:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.153+0000 7faa2b3a6700 1 Processor -- start 2023-10-09T11:41:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.153+0000 7faa2b3a6700 1 -- start start 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.153+0000 7faa2b3a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa24068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.153+0000 7faa2b3a6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa240cca80 con 0x7faa240cbea0 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa2b3a6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa240cedd0 con 0x7faa24157b90 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa2b3a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa240cc4c0 con 0x7faa241577c0 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa29943700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa240cbea0 0x7faa240cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49932/0 (socket says 172.21.15.6:49932) 2023-10-09T11:41:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa29943700 1 -- 172.21.15.6:0/2724314510 learned_addr learned my addr 172.21.15.6:0/2724314510 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191231366 0 0) 0x7faa240cca80 con 0x7faa240cbea0 2023-10-09T11:41:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa0c003570 con 0x7faa240cbea0 2023-10-09T11:41:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa29142700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa24068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101557765 0 0) 0x7faa0c003570 con 0x7faa240cbea0 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 msgr2=0x7faa24068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa24068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 >> v1:172.21.15.118:6789/0 conn(0x7faa24157b90 legacy=0x7faa240cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa240cc7a0 con 0x7faa240cbea0 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7faa140017f0 con 0x7faa240cbea0 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 >> v1:172.21.15.6:6789/0 conn(0x7faa240cbea0 legacy=0x7faa240cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa0c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c004010 0x7faa0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004d50 0x7faa0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240cc4c0 con 0x7faa0c004010 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c00bbf0 con 0x7faa0c004d50 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.154+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c00bdb0 con 0x7faa241577c0 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa29142700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa0c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c004010 0x7faa0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa29943700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004d50 0x7faa0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 -- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 msgr2=0x7faa0c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa241577c0 0x7faa0c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 -- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004d50 msgr2=0x7faa0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004d50 0x7faa0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 -- 172.21.15.6:0/2724314510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c003570 con 0x7faa0c004010 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa28941700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c004010 0x7faa0c004810 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7faa18001880 tx=0x7faa18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c08cd38fb90d211 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18012420 con 0x7faa0c004010 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18012580 con 0x7faa0c004010 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.155+0000 7faa23fff700 1 -- 172.21.15.6:0/2724314510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18012920 con 0x7faa0c004010 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 -- 172.21.15.6:0/2724314510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c004010 msgr2=0x7faa0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/2724314510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c004010 0x7faa0c004810 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7faa18001880 tx=0x7faa18007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa29943700 1 -- 172.21.15.6:0/2724314510 reap_dead start 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 -- 172.21.15.6:0/2724314510 shutdown_connections 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 -- 172.21.15.6:0/2724314510 >> 172.21.15.6:0/2724314510 conn(0x7faa240d0df0 msgr2=0x7faa240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 -- 172.21.15.6:0/2724314510 shutdown_connections 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.156+0000 7faa2b3a6700 1 -- 172.21.15.6:0/2724314510 wait complete. 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.157+0000 7faa2b3a6700 1 Processor -- start 2023-10-09T11:41:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.157+0000 7faa2b3a6700 1 -- start start 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004010 0x7faa240c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa24148900 0x7faa2416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240ca9e0 con 0x7faa2416a570 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa240b4ad0 con 0x7faa0c004010 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa2b3a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa240cac30 con 0x7faa24148900 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49800/0 (socket says 172.21.15.6:49800) 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 -- 172.21.15.6:0/3340458368 learned_addr learned my addr 172.21.15.6:0/3340458368 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29142700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004010 0x7faa240c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa28941700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa24148900 0x7faa2416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 -- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa24148900 msgr2=0x7faa2416a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa24148900 0x7faa2416a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 -- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004010 msgr2=0x7faa240c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004010 0x7faa240c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 -- 172.21.15.6:0/3340458368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa240caf10 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.158+0000 7faa29943700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7faa240682c0 tx=0x7faa140021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.159+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400ac30 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.159+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400ad90 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.159+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa24148d70 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.159+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14013640 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.159+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2416dd00 con 0x7faa2416a570 2023-10-09T11:41:37.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.160+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa24067a50 con 0x7faa2416a570 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.160+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa14013a70 con 0x7faa2416a570 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.161+0000 7faa217fa700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 0x7faa100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.161+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5223+0+0 (secure 0 0 0) 0x7faa14084d30 con 0x7faa2416a570 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.161+0000 7faa29142700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 0x7faa100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.161+0000 7faa29142700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 0x7faa100693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa1c006f00 tx=0x7faa1c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:37.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.165+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa140520e0 con 0x7faa2416a570 2023-10-09T11:41:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:37.358+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faa240b4c10 con 0x7faa2416a570 2023-10-09T11:41:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.014+0000 7faa217fa700 1 -- 172.21.15.6:0/3340458368 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) v1 ==== 170+0+0 (secure 0 0 0) 0x7faa14055700 con 0x7faa2416a570 2023-10-09T11:41:38.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.026+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 msgr2=0x7faa100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.026+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 0x7faa100693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faa1c006f00 tx=0x7faa1c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.026+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 msgr2=0x7faa2416d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.026+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7faa240682c0 tx=0x7faa140021d0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 shutdown_connections 2023-10-09T11:41:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faa10066f30 0x7faa100693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa2416a570 0x7faa2416d600 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa0c004010 0x7faa240c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 --2- 172.21.15.6:0/3340458368 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa24148900 0x7faa2416a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.027+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 >> 172.21.15.6:0/3340458368 conn(0x7faa240d0df0 msgr2=0x7faa240c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.028+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 shutdown_connections 2023-10-09T11:41:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.028+0000 7faa2b3a6700 1 -- 172.21.15.6:0/3340458368 wait complete. 2023-10-09T11:41:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:41:38.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:41:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.168+0000 7fefe0760700 1 Processor -- start 2023-10-09T11:41:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.168+0000 7fefe0760700 1 -- start start 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefe0760700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd81578d0 0x7fefd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefe0760700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefd8157ca0 0x7fefd815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefe0760700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80d07c0 con 0x7fefd806d120 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefe0760700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80cfbb0 con 0x7fefd8157ca0 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefe0760700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80cfe90 con 0x7fefd81578d0 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefd8157ca0 0x7fefd815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefd8157ca0 0x7fefd815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49802/0 (socket says 172.21.15.6:49802) 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 -- 172.21.15.6:0/1385500131 learned_addr learned my addr 172.21.15.6:0/1385500131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefde4fc700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd81578d0 0x7fefd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 -- 172.21.15.6:0/1385500131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd81578d0 msgr2=0x7fefd80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd81578d0 0x7fefd80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 -- 172.21.15.6:0/1385500131 >> v1:172.21.15.118:6789/0 conn(0x7fefd806d120 legacy=0x7fefd815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.169+0000 7fefddcfb700 1 -- 172.21.15.6:0/1385500131 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80d0170 con 0x7fefd8157ca0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefddcfb700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd815af00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fefc80099b0 tx=0x7fefc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e6e7f4ff73bda3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefdd4fa700 1 -- 172.21.15.6:0/1385500131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800b820 con 0x7fefd8157ca0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefdd4fa700 1 -- 172.21.15.6:0/1385500131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800b980 con 0x7fefd8157ca0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefdd4fa700 1 -- 172.21.15.6:0/1385500131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800bd20 con 0x7fefd8157ca0 2023-10-09T11:41:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 -- 172.21.15.6:0/1385500131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 msgr2=0x7fefd815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd815af00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fefc80099b0 tx=0x7fefc8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 -- 172.21.15.6:0/1385500131 shutdown_connections 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd81578d0 0x7fefd80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 --2- 172.21.15.6:0/1385500131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd815af00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 -- 172.21.15.6:0/1385500131 >> 172.21.15.6:0/1385500131 conn(0x7fefd806bb90 msgr2=0x7fefd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 -- 172.21.15.6:0/1385500131 shutdown_connections 2023-10-09T11:41:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.170+0000 7fefe0760700 1 -- 172.21.15.6:0/1385500131 wait complete. 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.171+0000 7fefe0760700 1 Processor -- start 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 -- start start 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd806d120 0x7fefd8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd81578d0 0x7fefd814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd814f490 con 0x7fefd8157ca0 2023-10-09T11:41:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8150ed0 con 0x7fefd81578d0 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefe0760700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd81511b0 con 0x7fefd806d120 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefdecfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefdecfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49804/0 (socket says 172.21.15.6:49804) 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefdecfd700 1 -- 172.21.15.6:0/3357015965 learned_addr learned my addr 172.21.15.6:0/3357015965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefddcfb700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd81578d0 0x7fefd814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.172+0000 7fefde4fc700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd806d120 0x7fefd8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 -- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd806d120 msgr2=0x7fefd8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd806d120 0x7fefd8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 -- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd81578d0 msgr2=0x7fefd814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd81578d0 0x7fefd814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 -- 172.21.15.6:0/3357015965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80094f0 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefdecfd700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c930 tx=0x7fefd00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0012630 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00127d0 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8151490 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0012b90 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.173+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd806a430 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.174+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd806a6b0 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.175+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefd001a3b0 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.175+0000 7fefce7fc700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.175+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fefd0084180 con 0x7fefd8157ca0 2023-10-09T11:41:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.175+0000 7fefde4fc700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.176+0000 7fefde4fc700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fefd400acb0 tx=0x7fefd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.180+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd0054ee0 con 0x7fefd8157ca0 2023-10-09T11:41:38.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:38.417+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fefd81516d0 con 0x7fefd8157ca0 2023-10-09T11:41:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.037+0000 7fefce7fc700 1 -- 172.21.15.6:0/3357015965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7fefd81516d0 con 0x7fefd8157ca0 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 msgr2=0x7fefbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fefd400acb0 tx=0x7fefd4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 msgr2=0x7fefd814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c930 tx=0x7fefd00026e0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 shutdown_connections 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd8157ca0 0x7fefd814eea0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fefd806d120 0x7fefd8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 --2- 172.21.15.6:0/3357015965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefd81578d0 0x7fefd814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 >> 172.21.15.6:0/3357015965 conn(0x7fefd806bb90 msgr2=0x7fefd8068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 shutdown_connections 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.048+0000 7fefe0760700 1 -- 172.21.15.6:0/3357015965 wait complete. 2023-10-09T11:41:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T11:41:39.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.182+0000 7fb273084700 1 Processor -- start 2023-10-09T11:41:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.182+0000 7fb273084700 1 -- start start 2023-10-09T11:41:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb273084700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb26c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb273084700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c0d07c0 con 0x7fb26c06d120 2023-10-09T11:41:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb273084700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c0cfbb0 con 0x7fb26c1578d0 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb273084700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0cfe90 con 0x7fb26c157ca0 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb271621700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb26c06d120 0x7fb26c15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49938/0 (socket says 172.21.15.6:49938) 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.183+0000 7fb271621700 1 -- 172.21.15.6:0/1269900776 learned_addr learned my addr 172.21.15.6:0/1269900776 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100813734 0 0) 0x7fb26c0d07c0 con 0x7fb26c06d120 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26bfff700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb26c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003570 con 0x7fb26c06d120 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3419923182 0 0) 0x7fb258003570 con 0x7fb26c06d120 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 msgr2=0x7fb26c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb26c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 >> v1:172.21.15.118:6789/0 conn(0x7fb26c1578d0 legacy=0x7fb26c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0d0170 con 0x7fb26c06d120 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fb254001470 con 0x7fb26c06d120 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 >> v1:172.21.15.6:6789/0 conn(0x7fb26c06d120 legacy=0x7fb26c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb258003a90 0x7fb258003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb258004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb258004d50 0x7fb2580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0cfe90 con 0x7fb258003a90 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25800bb70 con 0x7fb258004d50 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25800bd30 con 0x7fb26c157ca0 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb258003a90 0x7fb258003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb26bfff700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb258004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb271621700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb258004d50 0x7fb2580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 -- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 msgr2=0x7fb258004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb26c157ca0 0x7fb258004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 -- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb258004d50 msgr2=0x7fb2580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb258004d50 0x7fb2580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb270e20700 1 -- 172.21.15.6:0/1269900776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258003570 con 0x7fb258003a90 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.184+0000 7fb271621700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb258004d50 0x7fb2580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb270e20700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb258003a90 0x7fb258003ea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb2640018b0 tx=0x7fb264007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbdb0ad36415cf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264012420 con 0x7fb258003a90 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb264012580 con 0x7fb258003a90 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb26b7fe700 1 -- 172.21.15.6:0/1269900776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264012920 con 0x7fb258003a90 2023-10-09T11:41:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 -- 172.21.15.6:0/1269900776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb258003a90 msgr2=0x7fb258003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 --2- 172.21.15.6:0/1269900776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb258003a90 0x7fb258003ea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb2640018b0 tx=0x7fb264007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb271621700 1 -- 172.21.15.6:0/1269900776 reap_dead start 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 -- 172.21.15.6:0/1269900776 shutdown_connections 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 -- 172.21.15.6:0/1269900776 >> 172.21.15.6:0/1269900776 conn(0x7fb26c06bb90 msgr2=0x7fb26c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 -- 172.21.15.6:0/1269900776 shutdown_connections 2023-10-09T11:41:39.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.185+0000 7fb273084700 1 -- 172.21.15.6:0/1269900776 wait complete. 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.186+0000 7fb273084700 1 Processor -- start 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 -- start start 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb258003a90 0x7fb26c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb26c0b6980 0x7fb26c1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0b44f0 con 0x7fb26c153520 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0b47d0 con 0x7fb26c0b6980 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb273084700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0b4ab0 con 0x7fb258003a90 2023-10-09T11:41:39.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb271621700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb271621700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49820/0 (socket says 172.21.15.6:49820) 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.187+0000 7fb271621700 1 -- 172.21.15.6:0/2472946508 learned_addr learned my addr 172.21.15.6:0/2472946508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb26bfff700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb26c0b6980 0x7fb26c1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb270e20700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb258003a90 0x7fb26c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 -- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb258003a90 msgr2=0x7fb26c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb258003a90 0x7fb26c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 -- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb26c0b6980 msgr2=0x7fb26c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb26c0b6980 0x7fb26c1601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 -- 172.21.15.6:0/2472946508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0b4d90 con 0x7fb26c153520 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb271621700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb26c068510 tx=0x7fb26c15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400ee70 con 0x7fb26c153520 2023-10-09T11:41:39.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400c7b0 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c16a380 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400cb70 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.188+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c0b42a0 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.189+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c067ac0 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.189+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb25401d460 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.190+0000 7fb268ff9700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.190+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb254084430 con 0x7fb26c153520 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.190+0000 7fb270e20700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.190+0000 7fb270e20700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 0x7fb24c0693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb264001010 tx=0x7fb264015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.194+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2540516a0 con 0x7fb26c153520 2023-10-09T11:41:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.388+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb26c0d0450 con 0x7fb26c153520 2023-10-09T11:41:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.389+0000 7fb268ff9700 1 -- 172.21.15.6:0/2472946508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fb254054cc0 con 0x7fb26c153520 2023-10-09T11:41:39.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:39.391 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":114,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:38.419126+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 msgr2=0x7fb24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 0x7fb24c0693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb264001010 tx=0x7fb264015000 comp rx=0 tx=0).stop 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 msgr2=0x7fb26c160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb26c068510 tx=0x7fb26c15b610 comp rx=0 tx=0).stop 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 shutdown_connections 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb24c066f30 0x7fb24c0693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26c153520 0x7fb26c160720 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb258003a90 0x7fb26c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 --2- 172.21.15.6:0/2472946508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb26c0b6980 0x7fb26c1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 >> 172.21.15.6:0/2472946508 conn(0x7fb26c06bb90 msgr2=0x7fb26c15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 shutdown_connections 2023-10-09T11:41:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.391+0000 7fb273084700 1 -- 172.21.15.6:0/2472946508 wait complete. 2023-10-09T11:41:39.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.522+0000 7f5dcb641700 1 Processor -- start 2023-10-09T11:41:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.522+0000 7f5dcb641700 1 -- start start 2023-10-09T11:41:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dcb641700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 0x7f5dc40b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dcb641700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dc41583b0 0x7f5dc40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dcb641700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc40b2890 con 0x7f5dc40ceb30 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dcb641700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40b4070 con 0x7f5dc41583b0 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dcb641700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b4350 con 0x7f5dc4157fe0 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dc8bdc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dc41583b0 0x7f5dc40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dc8bdc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dc41583b0 0x7f5dc40b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49828/0 (socket says 172.21.15.6:49828) 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.523+0000 7f5dc8bdc700 1 -- 172.21.15.6:0/1325811766 learned_addr learned my addr 172.21.15.6:0/1325811766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc93dd700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 0x7f5dc40b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc8bdc700 1 -- 172.21.15.6:0/1325811766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 msgr2=0x7f5dc40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc8bdc700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 0x7f5dc40b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc8bdc700 1 -- 172.21.15.6:0/1325811766 >> v1:172.21.15.118:6789/0 conn(0x7f5dc40ceb30 legacy=0x7f5dc40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc8bdc700 1 -- 172.21.15.6:0/1325811766 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40b4630 con 0x7f5dc41583b0 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc93dd700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 0x7f5dc40b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc8bdc700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc41583b0 0x7f5dc40b3a00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5db80099b0 tx=0x7f5db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe1d1448560a58e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc3fff700 1 -- 172.21.15.6:0/1325811766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800b820 con 0x7f5dc41583b0 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc3fff700 1 -- 172.21.15.6:0/1325811766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800b980 con 0x7f5dc41583b0 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dc3fff700 1 -- 172.21.15.6:0/1325811766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800bd40 con 0x7f5dc41583b0 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.524+0000 7f5dcb641700 1 -- 172.21.15.6:0/1325811766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc41583b0 msgr2=0x7f5dc40b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc41583b0 0x7f5dc40b3a00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5db80099b0 tx=0x7f5db8009250 comp rx=0 tx=0).stop 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 -- 172.21.15.6:0/1325811766 shutdown_connections 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc4157fe0 0x7f5dc40b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 --2- 172.21.15.6:0/1325811766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc41583b0 0x7f5dc40b3a00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 -- 172.21.15.6:0/1325811766 >> 172.21.15.6:0/1325811766 conn(0x7f5dc4067640 msgr2=0x7f5dc4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 -- 172.21.15.6:0/1325811766 shutdown_connections 2023-10-09T11:41:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.525+0000 7f5dcb641700 1 -- 172.21.15.6:0/1325811766 wait complete. 2023-10-09T11:41:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.526+0000 7f5dcb641700 1 Processor -- start 2023-10-09T11:41:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.526+0000 7f5dcb641700 1 -- start start 2023-10-09T11:41:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dc4157fe0 0x7f5dc414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc41583b0 0x7f5dc41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40cd750 con 0x7f5dc40ceb30 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40ccb40 con 0x7f5dc4157fe0 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dcb641700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40cce20 con 0x7f5dc41583b0 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49838/0 (socket says 172.21.15.6:49838) 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 -- 172.21.15.6:0/133880108 learned_addr learned my addr 172.21.15.6:0/133880108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc8bdc700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dc4157fe0 0x7f5dc414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc9bde700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc41583b0 0x7f5dc41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 -- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc41583b0 msgr2=0x7f5dc41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc41583b0 0x7f5dc41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 -- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dc4157fe0 msgr2=0x7f5dc414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dc4157fe0 0x7f5dc414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 -- 172.21.15.6:0/133880108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80094f0 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc93dd700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5db400c830 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011600 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.527+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4011760 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.528+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011b20 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.528+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc40cd100 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.528+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc40ce110 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.528+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4069e40 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.529+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5db4018360 con 0x7f5dc40ceb30 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.529+0000 7f5dc17fa700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 0x7f5db00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.529+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5db40844c0 con 0x7f5dc40ceb30 2023-10-09T11:41:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.529+0000 7f5dc8bdc700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 0x7f5db00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.530+0000 7f5dc8bdc700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 0x7f5db00693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5db80099b0 tx=0x7f5db8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.533+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5db4051730 con 0x7f5dc40ceb30 2023-10-09T11:41:39.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.725+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dc404bb80 con 0x7f5dc40ceb30 2023-10-09T11:41:39.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.726+0000 7f5dc17fa700 1 -- 172.21.15.6:0/133880108 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f5db4054d50 con 0x7f5dc40ceb30 2023-10-09T11:41:39.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:39.728 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":114,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:38.419126+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:39.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 msgr2=0x7f5db00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 0x7f5db00693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5db80099b0 tx=0x7f5db8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 msgr2=0x7f5dc40cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5db400c830 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 shutdown_connections 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5db0066f30 0x7f5db00693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5dc41583b0 0x7f5dc41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc40ceb30 0x7f5dc40cdbd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 --2- 172.21.15.6:0/133880108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dc4157fe0 0x7f5dc414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 >> 172.21.15.6:0/133880108 conn(0x7f5dc4067640 msgr2=0x7f5dc4152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 shutdown_connections 2023-10-09T11:41:39.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.728+0000 7f5dcb641700 1 -- 172.21.15.6:0/133880108 wait complete. 2023-10-09T11:41:39.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:41:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.862+0000 7face036f700 1 Processor -- start 2023-10-09T11:41:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.862+0000 7face036f700 1 -- start start 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.862+0000 7face036f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 0x7facd80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7face036f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 0x7facd815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7face036f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80d07c0 con 0x7facd806d120 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7face036f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd80cfbb0 con 0x7facd81578d0 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7face036f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd80cfe90 con 0x7facd8157ca0 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facde90c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7facd806d120 0x7facd815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49946/0 (socket says 172.21.15.6:49946) 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facde90c700 1 -- 172.21.15.6:0/59802601 learned_addr learned my addr 172.21.15.6:0/59802601 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facde10b700 1 --2- 172.21.15.6:0/59802601 >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 0x7facd80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 --2- 172.21.15.6:0/59802601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 0x7facd815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491803896 0 0) 0x7facd80d07c0 con 0x7facd806d120 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc4003570 con 0x7facd806d120 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 -- 172.21.15.6:0/59802601 >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 msgr2=0x7facd80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974018638 0 0) 0x7facc4003570 con 0x7facd806d120 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 --2- 172.21.15.6:0/59802601 >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 0x7facd80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 -- 172.21.15.6:0/59802601 >> v1:172.21.15.6:6789/0 conn(0x7facd806d120 legacy=0x7facd815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 -- 172.21.15.6:0/59802601 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80d0170 con 0x7facd8157ca0 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facde10b700 1 --2- 172.21.15.6:0/59802601 >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 0x7facd80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.863+0000 7facdd90a700 1 --2- 172.21.15.6:0/59802601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 0x7facd815af00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facc80098e0 tx=0x7facc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eec55e880478223 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd00017f0 con 0x7facd8157ca0 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8011420 con 0x7facd8157ca0 2023-10-09T11:41:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7facdd109700 1 -- 172.21.15.6:0/59802601 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80117a0 con 0x7facd8157ca0 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 -- 172.21.15.6:0/59802601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 msgr2=0x7facd815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 --2- 172.21.15.6:0/59802601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 0x7facd815af00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7facc80098e0 tx=0x7facc80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 -- 172.21.15.6:0/59802601 shutdown_connections 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 --2- 172.21.15.6:0/59802601 >> v2:172.21.15.118:3300/0 conn(0x7facd81578d0 0x7facd80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 --2- 172.21.15.6:0/59802601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd8157ca0 0x7facd815af00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 -- 172.21.15.6:0/59802601 >> 172.21.15.6:0/59802601 conn(0x7facd806bb90 msgr2=0x7facd806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 -- 172.21.15.6:0/59802601 shutdown_connections 2023-10-09T11:41:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.864+0000 7face036f700 1 -- 172.21.15.6:0/59802601 wait complete. 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.865+0000 7face036f700 1 Processor -- start 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.865+0000 7face036f700 1 -- start start 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 0x7facd8159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 0x7facd8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd816ac70 con 0x7facd806d120 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd816af50 con 0x7facd8157ca0 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7face036f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd816b230 con 0x7facd81578d0 2023-10-09T11:41:39.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49852/0 (socket says 172.21.15.6:49852) 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 -- 172.21.15.6:0/3857434945 learned_addr learned my addr 172.21.15.6:0/3857434945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facdd90a700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 0x7facd8159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde90c700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 0x7facd8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 -- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 msgr2=0x7facd8159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 0x7facd8159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 -- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 msgr2=0x7facd8069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 0x7facd8069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde10b700 1 -- 172.21.15.6:0/3857434945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009420 con 0x7facd806d120 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facdd90a700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 0x7facd8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.866+0000 7facde90c700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 0x7facd8069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7facde10b700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7facd400ec80 tx=0x7facd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400c9d0 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400cb30 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8009420 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400ceb0 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.867+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd80cd780 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.868+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd8067ac0 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.868+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facd4013680 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.869+0000 7facce7fc700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 0x7facbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.869+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7facd4084980 con 0x7facd806d120 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.869+0000 7facdd90a700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 0x7facbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.869+0000 7facdd90a700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 0x7facbc0693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7facd806e850 tx=0x7facc8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:39.873+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facd4051bf0 con 0x7facd806d120 2023-10-09T11:41:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:40.112+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7facd816b6d0 con 0x7facd806d120 2023-10-09T11:41:41.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.044+0000 7facce7fc700 1 -- 172.21.15.6:0/3857434945 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7facd4055210 con 0x7facd806d120 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 msgr2=0x7facbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 0x7facbc0693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7facd806e850 tx=0x7facc8016000 comp rx=0 tx=0).stop 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 msgr2=0x7facd80cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7facd400ec80 tx=0x7facd40091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 shutdown_connections 2023-10-09T11:41:41.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facbc066f30 0x7facbc0693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facd8157ca0 0x7facd8069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facd806d120 0x7facd80cd240 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 --2- 172.21.15.6:0/3857434945 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facd81578d0 0x7facd8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 >> 172.21.15.6:0/3857434945 conn(0x7facd806bb90 msgr2=0x7facd806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 shutdown_connections 2023-10-09T11:41:41.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.046+0000 7face036f700 1 -- 172.21.15.6:0/3857434945 wait complete. 2023-10-09T11:41:41.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:41:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.188+0000 7f6f729c3700 1 Processor -- start 2023-10-09T11:41:41.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 -- start start 2023-10-09T11:41:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c069440 0x7f6f6c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0cb880 con 0x7f6f6c156420 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c06aa10 con 0x7f6f6c0cd090 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f729c3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cac70 con 0x7f6f6c069440 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.189+0000 7f6f70f60700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49860/0 (socket says 172.21.15.6:49860) 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 -- 172.21.15.6:0/1584947846 learned_addr learned my addr 172.21.15.6:0/1584947846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f6b7fe700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c069440 0x7f6f6c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 -- 172.21.15.6:0/1584947846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c069440 msgr2=0x7f6f6c0698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c069440 0x7f6f6c0698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 -- 172.21.15.6:0/1584947846 >> v1:172.21.15.118:6789/0 conn(0x7f6f6c156420 legacy=0x7f6f6c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 -- 172.21.15.6:0/1584947846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0caf50 con 0x7f6f6c0cd090 2023-10-09T11:41:41.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f70f60700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009f20 tx=0x7f6f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c0f335863d131e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f6affd700 1 -- 172.21.15.6:0/1584947846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400e070 con 0x7f6f6c0cd090 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f6affd700 1 -- 172.21.15.6:0/1584947846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400ba80 con 0x7f6f6c0cd090 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.190+0000 7f6f6affd700 1 -- 172.21.15.6:0/1584947846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f640092e0 con 0x7f6f6c0cd090 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 -- 172.21.15.6:0/1584947846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0cd090 msgr2=0x7f6f6c0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009f20 tx=0x7f6f64009840 comp rx=0 tx=0).stop 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 -- 172.21.15.6:0/1584947846 shutdown_connections 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0cd090 0x7f6f6c0c71d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 --2- 172.21.15.6:0/1584947846 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c069440 0x7f6f6c0698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 -- 172.21.15.6:0/1584947846 >> 172.21.15.6:0/1584947846 conn(0x7f6f6c06c660 msgr2=0x7f6f6c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 -- 172.21.15.6:0/1584947846 shutdown_connections 2023-10-09T11:41:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.191+0000 7f6f729c3700 1 -- 172.21.15.6:0/1584947846 wait complete. 2023-10-09T11:41:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.192+0000 7f6f729c3700 1 Processor -- start 2023-10-09T11:41:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.192+0000 7f6f729c3700 1 -- start start 2023-10-09T11:41:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c0cd090 0x7f6f6c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c156420 0x7f6f6c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c154f40 con 0x7f6f6c069440 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c154350 con 0x7f6f6c156420 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0c6830 con 0x7f6f6c0cd090 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49866/0 (socket says 172.21.15.6:49866) 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 -- 172.21.15.6:0/704252803 learned_addr learned my addr 172.21.15.6:0/704252803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6b7fe700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c0cd090 0x7f6f6c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f70f60700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c156420 0x7f6f6c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 -- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c0cd090 msgr2=0x7f6f6c151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c0cd090 0x7f6f6c151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 -- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c156420 msgr2=0x7f6f6c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:41.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c156420 0x7f6f6c158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 -- 172.21.15.6:0/704252803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64009ae0 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f6bfff700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400c4e0 tx=0x7f6f5400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54011590 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54011710 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.193+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c154610 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.194+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54011ad0 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.194+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c154bd0 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.194+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c067bc0 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.195+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f5401b3b0 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.195+0000 7f6f63fff700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.195+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f54083930 con 0x7f6f6c069440 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.195+0000 7f6f6b7fe700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:41.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.196+0000 7f6f6b7fe700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c006fd0 tx=0x7f6f5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:41.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.200+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f54050ba0 con 0x7f6f6c069440 2023-10-09T11:41:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:41.438+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f6c0cb230 con 0x7f6f6c069440 2023-10-09T11:41:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.045+0000 7f6f63fff700 1 -- 172.21.15.6:0/704252803 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f54017070 con 0x7f6f6c069440 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 msgr2=0x7f6f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c006fd0 tx=0x7f6f5c008040 comp rx=0 tx=0).stop 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 msgr2=0x7f6f6c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400c4e0 tx=0x7f6f5400c7f0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 shutdown_connections 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c156420 0x7f6f6c158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c069440 0x7f6f6c151210 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 --2- 172.21.15.6:0/704252803 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f6c0cd090 0x7f6f6c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 >> 172.21.15.6:0/704252803 conn(0x7f6f6c06c660 msgr2=0x7f6f6c0c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 shutdown_connections 2023-10-09T11:41:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.047+0000 7f6f729c3700 1 -- 172.21.15.6:0/704252803 wait complete. 2023-10-09T11:41:42.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:42.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.182+0000 7fa454851700 1 Processor -- start 2023-10-09T11:41:42.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.182+0000 7fa454851700 1 -- start start 2023-10-09T11:41:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa454851700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa450068e90 0x7fa450164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa454851700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500cee10 con 0x7fa450159f10 2023-10-09T11:41:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa454851700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4500cd040 con 0x7fa450159b40 2023-10-09T11:41:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa454851700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4500cd320 con 0x7fa450068e90 2023-10-09T11:41:42.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa450068e90 0x7fa450164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa450159f10 0x7fa450068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49954/0 (socket says 172.21.15.6:49954) 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44effd700 1 -- 172.21.15.6:0/3826776139 learned_addr learned my addr 172.21.15.6:0/3826776139 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44ffff700 1 -- 172.21.15.6:0/3826776139 >> v1:172.21.15.118:6789/0 conn(0x7fa450159b40 legacy=0x7fa4500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44ffff700 1 -- 172.21.15.6:0/3826776139 >> v1:172.21.15.6:6789/0 conn(0x7fa450159f10 legacy=0x7fa450068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44e7fc700 1 -- 172.21.15.6:0/3826776139 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846462255 0 0) 0x7fa4500cee10 con 0x7fa450159f10 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.183+0000 7fa44ffff700 1 -- 172.21.15.6:0/3826776139 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500ce7c0 con 0x7fa450068e90 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa44ffff700 1 --2- 172.21.15.6:0/3826776139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450068e90 0x7fa450164c70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa448009e60 tx=0x7fa448009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5372112381c285 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa44e7fc700 1 -- 172.21.15.6:0/3826776139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800e070 con 0x7fa450068e90 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa44e7fc700 1 -- 172.21.15.6:0/3826776139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800bc30 con 0x7fa450068e90 2023-10-09T11:41:42.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa44e7fc700 1 -- 172.21.15.6:0/3826776139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448012430 con 0x7fa450068e90 2023-10-09T11:41:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 -- 172.21.15.6:0/3826776139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450068e90 msgr2=0x7fa450164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 --2- 172.21.15.6:0/3826776139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450068e90 0x7fa450164c70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa448009e60 tx=0x7fa448009780 comp rx=0 tx=0).stop 2023-10-09T11:41:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 -- 172.21.15.6:0/3826776139 shutdown_connections 2023-10-09T11:41:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 --2- 172.21.15.6:0/3826776139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450068e90 0x7fa450164c70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 -- 172.21.15.6:0/3826776139 >> 172.21.15.6:0/3826776139 conn(0x7fa4500cd660 msgr2=0x7fa4500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 -- 172.21.15.6:0/3826776139 shutdown_connections 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.184+0000 7fa454851700 1 -- 172.21.15.6:0/3826776139 wait complete. 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 Processor -- start 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 -- start start 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa450068e90 0x7fa450154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450159b40 0x7fa4500c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500c9ef0 con 0x7fa450159f10 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45015aaf0 con 0x7fa450159b40 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa454851700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4500c9650 con 0x7fa450068e90 2023-10-09T11:41:42.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa44ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa44ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49888/0 (socket says 172.21.15.6:49888) 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.186+0000 7fa44ffff700 1 -- 172.21.15.6:0/880675300 learned_addr learned my addr 172.21.15.6:0/880675300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44effd700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450159b40 0x7fa4500c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44f7fe700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa450068e90 0x7fa450154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 -- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa450068e90 msgr2=0x7fa450154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa450068e90 0x7fa450154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 -- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450159b40 msgr2=0x7fa4500c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450159b40 0x7fa4500c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 -- 172.21.15.6:0/880675300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009a20 con 0x7fa450159f10 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa44ffff700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa448013000 tx=0x7fa448019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44801b420 con 0x7fa450159f10 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44801b580 con 0x7fa450159f10 2023-10-09T11:41:42.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4500c9930 con 0x7fa450159f10 2023-10-09T11:41:42.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44801b920 con 0x7fa450159f10 2023-10-09T11:41:42.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.187+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4500c9360 con 0x7fa450159f10 2023-10-09T11:41:42.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.188+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa450063e90 con 0x7fa450159f10 2023-10-09T11:41:42.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.189+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa44801bc90 con 0x7fa450159f10 2023-10-09T11:41:42.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.189+0000 7fa4377fe700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.189+0000 7fa44f7fe700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.189+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa448086380 con 0x7fa450159f10 2023-10-09T11:41:42.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.190+0000 7fa44f7fe700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 0x7fa43c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa440003a80 tx=0x7fa440007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.194+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4480535f0 con 0x7fa450159f10 2023-10-09T11:41:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.430+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4500ceaa0 con 0x7fa450159f10 2023-10-09T11:41:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.430+0000 7fa4377fe700 1 -- 172.21.15.6:0/880675300 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa448056c10 con 0x7fa450159f10 2023-10-09T11:41:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:42.432 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 msgr2=0x7fa43c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 0x7fa43c0693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa440003a80 tx=0x7fa440007ec0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 msgr2=0x7fa4501475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa448013000 tx=0x7fa448019000 comp rx=0 tx=0).stop 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 shutdown_connections 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa43c066f30 0x7fa43c0693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa450159f10 0x7fa4501475f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa450068e90 0x7fa450154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 --2- 172.21.15.6:0/880675300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa450159b40 0x7fa4500c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 >> 172.21.15.6:0/880675300 conn(0x7fa4500cd660 msgr2=0x7fa4500c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 shutdown_connections 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.432+0000 7fa454851700 1 -- 172.21.15.6:0/880675300 wait complete. 2023-10-09T11:41:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:42.446 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.563+0000 7f0779303700 1 Processor -- start 2023-10-09T11:41:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.563+0000 7f0779303700 1 -- start start 2023-10-09T11:41:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f0779303700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f07740cf240 0x7f0774162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f0779303700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07740b2890 con 0x7f07740b3bd0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f0779303700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07740b4070 con 0x7f0774157fe0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f0779303700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07740b4350 con 0x7f07740cf240 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f07727fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07740b3bd0 0x7f07740ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49970/0 (socket says 172.21.15.6:49970) 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.564+0000 7f07727fc700 1 -- 172.21.15.6:0/996919106 learned_addr learned my addr 172.21.15.6:0/996919106 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f07737fe700 1 --2- 172.21.15.6:0/996919106 >> v2:172.21.15.118:3300/0 conn(0x7f07740cf240 0x7f0774162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628608632 0 0) 0x7f07740b2890 con 0x7f07740b3bd0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0760003570 con 0x7f07740b3bd0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376799378 0 0) 0x7f0760003570 con 0x7f07740b3bd0 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 >> v2:172.21.15.118:3300/0 conn(0x7f07740cf240 msgr2=0x7f0774162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 --2- 172.21.15.6:0/996919106 >> v2:172.21.15.118:3300/0 conn(0x7f07740cf240 0x7f0774162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 >> v1:172.21.15.118:6789/0 conn(0x7f0774157fe0 legacy=0x7f07740b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740b4630 con 0x7f07740b3bd0 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f075c001470 con 0x7f07740b3bd0 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 >> v1:172.21.15.6:6789/0 conn(0x7f07740b3bd0 legacy=0x7f07740ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f0760003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0760004810 0x7f0760004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07600051c0 0x7f076000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740b4350 con 0x7f07600051c0 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076000c160 con 0x7f0760003a60 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076000c320 con 0x7f0760004810 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f0772ffd700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f0760003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f07737fe700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07600051c0 0x7f076000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.565+0000 7f07727fc700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0760004810 0x7f0760004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 -- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0760004810 msgr2=0x7f0760004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0760004810 0x7f0760004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 -- 172.21.15.6:0/996919106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07600051c0 msgr2=0x7f076000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07600051c0 0x7f076000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 -- 172.21.15.6:0/996919106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760003570 con 0x7f0760003a60 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f07737fe700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07600051c0 0x7f076000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f07737fe700 1 -- 172.21.15.6:0/996919106 reap_dead start 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0772ffd700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f0760003e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f076c0018e0 tx=0x7f076c007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a7a81a2f7c090fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c012420 con 0x7f0760003a60 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0125a0 con 0x7f0760003a60 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0771ffb700 1 -- 172.21.15.6:0/996919106 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c012960 con 0x7f0760003a60 2023-10-09T11:41:42.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0779303700 1 -- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 msgr2=0x7f0760003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0779303700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f0760003e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f076c0018e0 tx=0x7f076c007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0779303700 1 -- 172.21.15.6:0/996919106 shutdown_connections 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0779303700 1 --2- 172.21.15.6:0/996919106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f0760003e70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.566+0000 7f0779303700 1 -- 172.21.15.6:0/996919106 >> 172.21.15.6:0/996919106 conn(0x7f0774067640 msgr2=0x7f0774067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.567+0000 7f0779303700 1 -- 172.21.15.6:0/996919106 shutdown_connections 2023-10-09T11:41:42.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.567+0000 7f0779303700 1 -- 172.21.15.6:0/996919106 wait complete. 2023-10-09T11:41:42.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.568+0000 7f0779303700 1 Processor -- start 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.568+0000 7f0779303700 1 -- start start 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.568+0000 7f0779303700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f07740c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077406dd80 0x7f0774153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740c8920 con 0x7f077406e570 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07740c7d50 con 0x7f0760003a60 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0774153bc0 con 0x7f077406dd80 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49894/0 (socket says 172.21.15.6:49894) 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 -- 172.21.15.6:0/1579391041 learned_addr learned my addr 172.21.15.6:0/1579391041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:42.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0772ffd700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f07740c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07727fc700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077406dd80 0x7f0774153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 -- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077406dd80 msgr2=0x7f0774153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077406dd80 0x7f0774153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 -- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 msgr2=0x7f07740c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f07740c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 -- 172.21.15.6:0/1579391041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740c7ff0 con 0x7f077406e570 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0772ffd700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f07740c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f07737fe700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f07640094d0 tx=0x7f076400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076401c070 con 0x7f077406e570 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400f040 con 0x7f077406e570 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400e040 con 0x7f077406e570 2023-10-09T11:41:42.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07740c82d0 con 0x7f077406e570 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.569+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077406e9e0 con 0x7f077406e570 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.570+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07740c8a90 con 0x7f077406e570 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.571+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0764003020 con 0x7f077406e570 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.571+0000 7f076affd700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.571+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0764084830 con 0x7f077406e570 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.571+0000 7f0772ffd700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.572+0000 7f0772ffd700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f076c0016c0 tx=0x7f076c015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.575+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0764055530 con 0x7f077406e570 2023-10-09T11:41:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.770+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f077404bb80 con 0x7f077406e570 2023-10-09T11:41:42.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.771+0000 7f076affd700 1 -- 172.21.15.6:0/1579391041 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f0764084030 con 0x7f077406e570 2023-10-09T11:41:42.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:42.772 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":115,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:40.022509+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 msgr2=0x7f07540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f076c0016c0 tx=0x7f076c015000 comp rx=0 tx=0).stop 2023-10-09T11:41:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 msgr2=0x7f07740c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f07640094d0 tx=0x7f076400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 shutdown_connections 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077406e570 0x7f07740c95d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0760003a60 0x7f07740c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.772+0000 7f0779303700 1 --2- 172.21.15.6:0/1579391041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077406dd80 0x7f0774153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.773+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 >> 172.21.15.6:0/1579391041 conn(0x7f0774067640 msgr2=0x7f07740cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.773+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 shutdown_connections 2023-10-09T11:41:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.773+0000 7f0779303700 1 -- 172.21.15.6:0/1579391041 wait complete. 2023-10-09T11:41:42.786 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:41:42.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.904+0000 7fea3d46b700 1 Processor -- start 2023-10-09T11:41:42.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.904+0000 7fea3d46b700 1 -- start start 2023-10-09T11:41:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea3d46b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 0x7fea3806a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea3d46b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea380cc700 0x7fea380c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea3d46b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380af720 con 0x7fea3806a9b0 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea3d46b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea380c7bd0 con 0x7fea380cc700 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea3d46b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea380af950 con 0x7fea38156a50 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea36ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 0x7fea3806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea367fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fea3806a9b0 0x7fea380cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:51640/0 (socket says 172.21.15.6:51640) 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea377fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea380cc700 0x7fea380c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.905+0000 7fea367fc700 1 -- 172.21.15.6:0/1256452388 learned_addr learned my addr 172.21.15.6:0/1256452388 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea36ffd700 1 -- 172.21.15.6:0/1256452388 >> v2:172.21.15.118:3300/0 conn(0x7fea380cc700 msgr2=0x7fea380c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea36ffd700 1 --2- 172.21.15.6:0/1256452388 >> v2:172.21.15.118:3300/0 conn(0x7fea380cc700 0x7fea380c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea36ffd700 1 -- 172.21.15.6:0/1256452388 >> v1:172.21.15.118:6789/0 conn(0x7fea3806a9b0 legacy=0x7fea380cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea36ffd700 1 -- 172.21.15.6:0/1256452388 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380afc30 con 0x7fea38156a50 2023-10-09T11:41:42.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea36ffd700 1 --2- 172.21.15.6:0/1256452388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 0x7fea3806a470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e60 tx=0x7fea30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5511b08ca4ae750 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea35ffb700 1 -- 172.21.15.6:0/1256452388 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000e070 con 0x7fea38156a50 2023-10-09T11:41:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea35ffb700 1 -- 172.21.15.6:0/1256452388 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000bb60 con 0x7fea38156a50 2023-10-09T11:41:42.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea35ffb700 1 -- 172.21.15.6:0/1256452388 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30012430 con 0x7fea38156a50 2023-10-09T11:41:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea3d46b700 1 -- 172.21.15.6:0/1256452388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 msgr2=0x7fea3806a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea3d46b700 1 --2- 172.21.15.6:0/1256452388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 0x7fea3806a470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e60 tx=0x7fea30009780 comp rx=0 tx=0).stop 2023-10-09T11:41:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea3d46b700 1 -- 172.21.15.6:0/1256452388 shutdown_connections 2023-10-09T11:41:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.906+0000 7fea3d46b700 1 --2- 172.21.15.6:0/1256452388 >> v2:172.21.15.118:3300/0 conn(0x7fea380cc700 0x7fea380c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.907+0000 7fea3d46b700 1 --2- 172.21.15.6:0/1256452388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea38156a50 0x7fea3806a470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.907+0000 7fea3d46b700 1 -- 172.21.15.6:0/1256452388 >> 172.21.15.6:0/1256452388 conn(0x7fea3806cca0 msgr2=0x7fea3806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.907+0000 7fea3d46b700 1 -- 172.21.15.6:0/1256452388 shutdown_connections 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.907+0000 7fea3d46b700 1 -- 172.21.15.6:0/1256452388 wait complete. 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.908+0000 7fea3d46b700 1 Processor -- start 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.908+0000 7fea3d46b700 1 -- start start 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea3806a9b0 0x7fea381690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea380cc700 0x7fea380c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38169870 con 0x7fea38156a50 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38169630 con 0x7fea3806a9b0 2023-10-09T11:41:42.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c6f30 con 0x7fea380cc700 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49898/0 (socket says 172.21.15.6:49898) 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 -- 172.21.15.6:0/361253240 learned_addr learned my addr 172.21.15.6:0/361253240 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea36ffd700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea3806a9b0 0x7fea381690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea367fc700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea380cc700 0x7fea380c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 -- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea380cc700 msgr2=0x7fea380c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea380cc700 0x7fea380c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 -- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea3806a9b0 msgr2=0x7fea381690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea3806a9b0 0x7fea381690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 -- 172.21.15.6:0/361253240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009a20 con 0x7fea38156a50 2023-10-09T11:41:42.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea377fe700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ea20 tx=0x7fea280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800ee60 con 0x7fea38156a50 2023-10-09T11:41:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800c7f0 con 0x7fea38156a50 2023-10-09T11:41:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea380c7210 con 0x7fea38156a50 2023-10-09T11:41:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800cbb0 con 0x7fea38156a50 2023-10-09T11:41:42.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.909+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea380c77d0 con 0x7fea38156a50 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.910+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea38169a20 con 0x7fea38156a50 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.911+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea28013470 con 0x7fea38156a50 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.911+0000 7fea2effd700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.911+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea280846e0 con 0x7fea38156a50 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.911+0000 7fea36ffd700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.912+0000 7fea36ffd700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea300097c0 tx=0x7fea30019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:42.915+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea38169a20 con 0x7fea38156a50 2023-10-09T11:41:43.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.105+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea380c6c80 con 0x7fea18066f30 2023-10-09T11:41:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.113+0000 7fea2effd700 1 -- 172.21.15.6:0/361253240 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282326 (secure 0 0 0) 0x7fea380c6c80 con 0x7fea18066f30 2023-10-09T11:41:43.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 msgr2=0x7fea180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 0x7fea180693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fea300097c0 tx=0x7fea30019000 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 msgr2=0x7fea38153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ea20 tx=0x7fea280091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 shutdown_connections 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea18066f30 0x7fea180693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea38156a50 0x7fea38153090 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea3806a9b0 0x7fea381690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 --2- 172.21.15.6:0/361253240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fea380cc700 0x7fea380c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 >> 172.21.15.6:0/361253240 conn(0x7fea3806cca0 msgr2=0x7fea380c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 shutdown_connections 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.116+0000 7fea3d46b700 1 -- 172.21.15.6:0/361253240 wait complete. 2023-10-09T11:41:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:41:43.130 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-10-09T11:41:42.219087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556571,"statfs":{"total":1600000000,"available":1593929374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.209829"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014645+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:29.759587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025689+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013958+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:09.873464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014800+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018726+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017844+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021674+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012457+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014440+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019545+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011734+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.024462+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:05.789587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021461+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019151+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022478+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019265+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:05.145751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011918+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019748+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:55.127701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022129+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020941+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017891+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014067+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021425+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013357+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021185+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.026213+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:12.456262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018909+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014861+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:04.071873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020279+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:39.268358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022285+0000","last_change":"2023-10-09T11:41:38.022285+0000","last_active":"2023-10-09T11:41:38.022285+0000","last_peered":"2023-10-09T11:41:38.022285+0000","last_clean":"2023-10-09T11:41:38.022285+0000","last_became_active":"2023-10-09T11:41:38.021933+0000","last_became_peered":"2023-10-09T11:41:38.021933+0000","last_unstale":"2023-10-09T11:41:38.022285+0000","last_undegraded":"2023-10-09T11:41:38.022285+0000","last_fullsized":"2023-10-09T11:41:38.022285+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.329794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017954+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021884+0000","last_change":"2023-10-09T11:41:38.021884+0000","last_active":"2023-10-09T11:41:38.021884+0000","last_peered":"2023-10-09T11:41:38.021884+0000","last_clean":"2023-10-09T11:41:38.021884+0000","last_became_active":"2023-10-09T11:41:38.021661+0000","last_became_peered":"2023-10-09T11:41:38.021661+0000","last_unstale":"2023-10-09T11:41:38.021884+0000","last_undegraded":"2023-10-09T11:41:38.021884+0000","last_fullsized":"2023-10-09T11:41:38.021884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:01.516396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014202+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:12.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027892+0000","last_change":"2023-10-09T11:41:38.027892+0000","last_active":"2023-10-09T11:41:38.027892+0000","last_peered":"2023-10-09T11:41:38.027892+0000","last_clean":"2023-10-09T11:41:38.027892+0000","last_became_active":"2023-10-09T11:41:38.027650+0000","last_became_peered":"2023-10-09T11:41:38.027650+0000","last_unstale":"2023-10-09T11:41:38.027892+0000","last_undegraded":"2023-10-09T11:41:38.027892+0000","last_fullsized":"2023-10-09T11:41:38.027892+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011294+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018919+0000","last_change":"2023-10-09T11:41:38.018919+0000","last_active":"2023-10-09T11:41:38.018919+0000","last_peered":"2023-10-09T11:41:38.018919+0000","last_clean":"2023-10-09T11:41:38.018919+0000","last_became_active":"2023-10-09T11:41:38.018647+0000","last_became_peered":"2023-10-09T11:41:38.018647+0000","last_unstale":"2023-10-09T11:41:38.018919+0000","last_undegraded":"2023-10-09T11:41:38.018919+0000","last_fullsized":"2023-10-09T11:41:38.018919+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:13.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022626+0000","last_change":"2023-10-09T11:41:38.022626+0000","last_active":"2023-10-09T11:41:38.022626+0000","last_peered":"2023-10-09T11:41:38.022626+0000","last_clean":"2023-10-09T11:41:38.022626+0000","last_became_active":"2023-10-09T11:41:38.021978+0000","last_became_peered":"2023-10-09T11:41:38.021978+0000","last_unstale":"2023-10-09T11:41:38.022626+0000","last_undegraded":"2023-10-09T11:41:38.022626+0000","last_fullsized":"2023-10-09T11:41:38.022626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:14.381028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017423+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027649+0000","last_change":"2023-10-09T11:41:38.027649+0000","last_active":"2023-10-09T11:41:38.027649+0000","last_peered":"2023-10-09T11:41:38.027649+0000","last_clean":"2023-10-09T11:41:38.027649+0000","last_became_active":"2023-10-09T11:41:38.027070+0000","last_became_peered":"2023-10-09T11:41:38.027070+0000","last_unstale":"2023-10-09T11:41:38.027649+0000","last_undegraded":"2023-10-09T11:41:38.027649+0000","last_fullsized":"2023-10-09T11:41:38.027649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018558+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021051+0000","last_change":"2023-10-09T11:41:38.021051+0000","last_active":"2023-10-09T11:41:38.021051+0000","last_peered":"2023-10-09T11:41:38.021051+0000","last_clean":"2023-10-09T11:41:38.021051+0000","last_became_active":"2023-10-09T11:41:38.020811+0000","last_became_peered":"2023-10-09T11:41:38.020811+0000","last_unstale":"2023-10-09T11:41:38.021051+0000","last_undegraded":"2023-10-09T11:41:38.021051+0000","last_fullsized":"2023-10-09T11:41:38.021051+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018205+0000","last_change":"2023-10-09T11:41:38.018205+0000","last_active":"2023-10-09T11:41:38.018205+0000","last_peered":"2023-10-09T11:41:38.018205+0000","last_clean":"2023-10-09T11:41:38.018205+0000","last_became_active":"2023-10-09T11:41:38.016831+0000","last_became_peered":"2023-10-09T11:41:38.016831+0000","last_unstale":"2023-10-09T11:41:38.018205+0000","last_undegraded":"2023-10-09T11:41:38.018205+0000","last_fullsized":"2023-10-09T11:41:38.018205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021750+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015417+0000","last_change":"2023-10-09T11:41:38.015417+0000","last_active":"2023-10-09T11:41:38.015417+0000","last_peered":"2023-10-09T11:41:38.015417+0000","last_clean":"2023-10-09T11:41:38.015417+0000","last_became_active":"2023-10-09T11:41:38.015109+0000","last_became_peered":"2023-10-09T11:41:38.015109+0000","last_unstale":"2023-10-09T11:41:38.015417+0000","last_undegraded":"2023-10-09T11:41:38.015417+0000","last_fullsized":"2023-10-09T11:41:38.015417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:46.822110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012069+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017513+0000","last_change":"2023-10-09T11:41:38.017513+0000","last_active":"2023-10-09T11:41:38.017513+0000","last_peered":"2023-10-09T11:41:38.017513+0000","last_clean":"2023-10-09T11:41:38.017513+0000","last_became_active":"2023-10-09T11:41:38.017235+0000","last_became_peered":"2023-10-09T11:41:38.017235+0000","last_unstale":"2023-10-09T11:41:38.017513+0000","last_undegraded":"2023-10-09T11:41:38.017513+0000","last_fullsized":"2023-10-09T11:41:38.017513+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013579+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021249+0000","last_change":"2023-10-09T11:41:38.021249+0000","last_active":"2023-10-09T11:41:38.021249+0000","last_peered":"2023-10-09T11:41:38.021249+0000","last_clean":"2023-10-09T11:41:38.021249+0000","last_became_active":"2023-10-09T11:41:38.020987+0000","last_became_peered":"2023-10-09T11:41:38.020987+0000","last_unstale":"2023-10-09T11:41:38.021249+0000","last_undegraded":"2023-10-09T11:41:38.021249+0000","last_fullsized":"2023-10-09T11:41:38.021249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017747+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.016091+0000","last_change":"2023-10-09T11:41:38.016091+0000","last_active":"2023-10-09T11:41:38.016091+0000","last_peered":"2023-10-09T11:41:38.016091+0000","last_clean":"2023-10-09T11:41:38.016091+0000","last_became_active":"2023-10-09T11:41:38.015871+0000","last_became_peered":"2023-10-09T11:41:38.015871+0000","last_unstale":"2023-10-09T11:41:38.016091+0000","last_undegraded":"2023-10-09T11:41:38.016091+0000","last_fullsized":"2023-10-09T11:41:38.016091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017560+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015122+0000","last_change":"2023-10-09T11:41:38.015122+0000","last_active":"2023-10-09T11:41:38.015122+0000","last_peered":"2023-10-09T11:41:38.015122+0000","last_clean":"2023-10-09T11:41:38.015122+0000","last_became_active":"2023-10-09T11:41:38.014732+0000","last_became_peered":"2023-10-09T11:41:38.014732+0000","last_unstale":"2023-10-09T11:41:38.015122+0000","last_undegraded":"2023-10-09T11:41:38.015122+0000","last_fullsized":"2023-10-09T11:41:38.015122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:48.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014408+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:40.530128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017653+0000","last_change":"2023-10-09T11:41:38.017653+0000","last_active":"2023-10-09T11:41:38.017653+0000","last_peered":"2023-10-09T11:41:38.017653+0000","last_clean":"2023-10-09T11:41:38.017653+0000","last_became_active":"2023-10-09T11:41:38.017397+0000","last_became_peered":"2023-10-09T11:41:38.017397+0000","last_unstale":"2023-10-09T11:41:38.017653+0000","last_undegraded":"2023-10-09T11:41:38.017653+0000","last_fullsized":"2023-10-09T11:41:38.017653+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:31.032015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011430+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017434+0000","last_change":"2023-10-09T11:41:38.017434+0000","last_active":"2023-10-09T11:41:38.017434+0000","last_peered":"2023-10-09T11:41:38.017434+0000","last_clean":"2023-10-09T11:41:38.017434+0000","last_became_active":"2023-10-09T11:41:38.016881+0000","last_became_peered":"2023-10-09T11:41:38.016881+0000","last_unstale":"2023-10-09T11:41:38.017434+0000","last_undegraded":"2023-10-09T11:41:38.017434+0000","last_fullsized":"2023-10-09T11:41:38.017434+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019595+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:19.260253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020930+0000","last_change":"2023-10-09T11:41:38.020930+0000","last_active":"2023-10-09T11:41:38.020930+0000","last_peered":"2023-10-09T11:41:38.020930+0000","last_clean":"2023-10-09T11:41:38.020930+0000","last_became_active":"2023-10-09T11:41:38.020688+0000","last_became_peered":"2023-10-09T11:41:38.020688+0000","last_unstale":"2023-10-09T11:41:38.020930+0000","last_undegraded":"2023-10-09T11:41:38.020930+0000","last_fullsized":"2023-10-09T11:41:38.020930+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:36.669315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014019+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.013821+0000","last_change":"2023-10-09T11:41:38.013821+0000","last_active":"2023-10-09T11:41:38.013821+0000","last_peered":"2023-10-09T11:41:38.013821+0000","last_clean":"2023-10-09T11:41:38.013821+0000","last_became_active":"2023-10-09T11:41:38.013452+0000","last_became_peered":"2023-10-09T11:41:38.013452+0000","last_unstale":"2023-10-09T11:41:38.013821+0000","last_undegraded":"2023-10-09T11:41:38.013821+0000","last_fullsized":"2023-10-09T11:41:38.013821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015401+0000","last_change":"2023-10-09T11:41:38.015401+0000","last_active":"2023-10-09T11:41:38.015401+0000","last_peered":"2023-10-09T11:41:38.015401+0000","last_clean":"2023-10-09T11:41:38.015401+0000","last_became_active":"2023-10-09T11:41:38.015189+0000","last_became_peered":"2023-10-09T11:41:38.015189+0000","last_unstale":"2023-10-09T11:41:38.015401+0000","last_undegraded":"2023-10-09T11:41:38.015401+0000","last_fullsized":"2023-10-09T11:41:38.015401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018343+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.019813+0000","last_change":"2023-10-09T11:41:38.019813+0000","last_active":"2023-10-09T11:41:38.019813+0000","last_peered":"2023-10-09T11:41:38.019813+0000","last_clean":"2023-10-09T11:41:38.019813+0000","last_became_active":"2023-10-09T11:41:38.019579+0000","last_became_peered":"2023-10-09T11:41:38.019579+0000","last_unstale":"2023-10-09T11:41:38.019813+0000","last_undegraded":"2023-10-09T11:41:38.019813+0000","last_fullsized":"2023-10-09T11:41:38.019813+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019863+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:23.657794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027229+0000","last_change":"2023-10-09T11:41:38.027229+0000","last_active":"2023-10-09T11:41:38.027229+0000","last_peered":"2023-10-09T11:41:38.027229+0000","last_clean":"2023-10-09T11:41:38.027229+0000","last_became_active":"2023-10-09T11:41:38.026311+0000","last_became_peered":"2023-10-09T11:41:38.026311+0000","last_unstale":"2023-10-09T11:41:38.027229+0000","last_undegraded":"2023-10-09T11:41:38.027229+0000","last_fullsized":"2023-10-09T11:41:38.027229+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018660+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:43.382274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015308+0000","last_change":"2023-10-09T11:41:38.015308+0000","last_active":"2023-10-09T11:41:38.015308+0000","last_peered":"2023-10-09T11:41:38.015308+0000","last_clean":"2023-10-09T11:41:38.015308+0000","last_became_active":"2023-10-09T11:41:38.015070+0000","last_became_peered":"2023-10-09T11:41:38.015070+0000","last_unstale":"2023-10-09T11:41:38.015308+0000","last_undegraded":"2023-10-09T11:41:38.015308+0000","last_fullsized":"2023-10-09T11:41:38.015308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018718+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:41.717636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014367+0000","last_change":"2023-10-09T11:41:38.014367+0000","last_active":"2023-10-09T11:41:38.014367+0000","last_peered":"2023-10-09T11:41:38.014367+0000","last_clean":"2023-10-09T11:41:38.014367+0000","last_became_active":"2023-10-09T11:41:38.014122+0000","last_became_peered":"2023-10-09T11:41:38.014122+0000","last_unstale":"2023-10-09T11:41:38.014367+0000","last_undegraded":"2023-10-09T11:41:38.014367+0000","last_fullsized":"2023-10-09T11:41:38.014367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013646+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.026542+0000","last_change":"2023-10-09T11:41:38.026542+0000","last_active":"2023-10-09T11:41:38.026542+0000","last_peered":"2023-10-09T11:41:38.026542+0000","last_clean":"2023-10-09T11:41:38.026542+0000","last_became_active":"2023-10-09T11:41:38.026285+0000","last_became_peered":"2023-10-09T11:41:38.026285+0000","last_unstale":"2023-10-09T11:41:38.026542+0000","last_undegraded":"2023-10-09T11:41:38.026542+0000","last_fullsized":"2023-10-09T11:41:38.026542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014875+0000","last_change":"2023-10-09T11:41:38.014875+0000","last_active":"2023-10-09T11:41:38.014875+0000","last_peered":"2023-10-09T11:41:38.014875+0000","last_clean":"2023-10-09T11:41:38.014875+0000","last_became_active":"2023-10-09T11:41:38.014371+0000","last_became_peered":"2023-10-09T11:41:38.014371+0000","last_unstale":"2023-10-09T11:41:38.014875+0000","last_undegraded":"2023-10-09T11:41:38.014875+0000","last_fullsized":"2023-10-09T11:41:38.014875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014398+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:13.130473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027494+0000","last_change":"2023-10-09T11:41:38.027494+0000","last_active":"2023-10-09T11:41:38.027494+0000","last_peered":"2023-10-09T11:41:38.027494+0000","last_clean":"2023-10-09T11:41:38.027494+0000","last_became_active":"2023-10-09T11:41:38.026728+0000","last_became_peered":"2023-10-09T11:41:38.026728+0000","last_unstale":"2023-10-09T11:41:38.027494+0000","last_undegraded":"2023-10-09T11:41:38.027494+0000","last_fullsized":"2023-10-09T11:41:38.027494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013676+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:09.419461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.023342+0000","last_change":"2023-10-09T11:41:38.023342+0000","last_active":"2023-10-09T11:41:38.023342+0000","last_peered":"2023-10-09T11:41:38.023342+0000","last_clean":"2023-10-09T11:41:38.023342+0000","last_became_active":"2023-10-09T11:41:38.020743+0000","last_became_peered":"2023-10-09T11:41:38.020743+0000","last_unstale":"2023-10-09T11:41:38.023342+0000","last_undegraded":"2023-10-09T11:41:38.023342+0000","last_fullsized":"2023-10-09T11:41:38.023342+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013189+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020414+0000","last_change":"2023-10-09T11:41:38.020414+0000","last_active":"2023-10-09T11:41:38.020414+0000","last_peered":"2023-10-09T11:41:38.020414+0000","last_clean":"2023-10-09T11:41:38.020414+0000","last_became_active":"2023-10-09T11:41:38.020197+0000","last_became_peered":"2023-10-09T11:41:38.020197+0000","last_unstale":"2023-10-09T11:41:38.020414+0000","last_undegraded":"2023-10-09T11:41:38.020414+0000","last_fullsized":"2023-10-09T11:41:38.020414+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:07.301979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019167+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:08.663307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018380+0000","last_change":"2023-10-09T11:41:38.018380+0000","last_active":"2023-10-09T11:41:38.018380+0000","last_peered":"2023-10-09T11:41:38.018380+0000","last_clean":"2023-10-09T11:41:38.018380+0000","last_became_active":"2023-10-09T11:41:38.018141+0000","last_became_peered":"2023-10-09T11:41:38.018141+0000","last_unstale":"2023-10-09T11:41:38.018380+0000","last_undegraded":"2023-10-09T11:41:38.018380+0000","last_fullsized":"2023-10-09T11:41:38.018380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:05.219675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011267+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018063+0000","last_change":"2023-10-09T11:41:38.018063+0000","last_active":"2023-10-09T11:41:38.018063+0000","last_peered":"2023-10-09T11:41:38.018063+0000","last_clean":"2023-10-09T11:41:38.018063+0000","last_became_active":"2023-10-09T11:41:38.017768+0000","last_became_peered":"2023-10-09T11:41:38.017768+0000","last_unstale":"2023-10-09T11:41:38.018063+0000","last_undegraded":"2023-10-09T11:41:38.018063+0000","last_fullsized":"2023-10-09T11:41:38.018063+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019351+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:28.948064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018141+0000","last_change":"2023-10-09T11:41:38.018141+0000","last_active":"2023-10-09T11:41:38.018141+0000","last_peered":"2023-10-09T11:41:38.018141+0000","last_clean":"2023-10-09T11:41:38.018141+0000","last_became_active":"2023-10-09T11:41:38.017497+0000","last_became_peered":"2023-10-09T11:41:38.017497+0000","last_unstale":"2023-10-09T11:41:38.018141+0000","last_undegraded":"2023-10-09T11:41:38.018141+0000","last_fullsized":"2023-10-09T11:41:38.018141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:29.649576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012936+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027098+0000","last_change":"2023-10-09T11:41:38.027098+0000","last_active":"2023-10-09T11:41:38.027098+0000","last_peered":"2023-10-09T11:41:38.027098+0000","last_clean":"2023-10-09T11:41:38.027098+0000","last_became_active":"2023-10-09T11:41:38.025975+0000","last_became_peered":"2023-10-09T11:41:38.025975+0000","last_unstale":"2023-10-09T11:41:38.027098+0000","last_undegraded":"2023-10-09T11:41:38.027098+0000","last_fullsized":"2023-10-09T11:41:38.027098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:06.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025311+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:41.445246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022601+0000","last_change":"2023-10-09T11:41:38.022601+0000","last_active":"2023-10-09T11:41:38.022601+0000","last_peered":"2023-10-09T11:41:38.022601+0000","last_clean":"2023-10-09T11:41:38.022601+0000","last_became_active":"2023-10-09T11:41:38.022412+0000","last_became_peered":"2023-10-09T11:41:38.022412+0000","last_unstale":"2023-10-09T11:41:38.022601+0000","last_undegraded":"2023-10-09T11:41:38.022601+0000","last_fullsized":"2023-10-09T11:41:38.022601+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":241,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T11:41:37.011329+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:41:37.011329+0000","last_peered":"2023-10-09T11:41:37.011329+0000","last_clean":"2023-10-09T11:41:37.011329+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:41:37.011329+0000","last_undegraded":"2023-10-09T11:41:37.011329+0000","last_fullsized":"2023-10-09T11:41:37.011329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194141,"statfs":{"total":200000000,"available":198800618,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.878,"15min":0.878},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65800000000000003,"5min":1.048,"15min":1.048},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":1.079,"15min":1.079},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73399999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76600000000000001,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57999999999999996,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.298,"15min":5.298},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.67400000000000004},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":1.617,"15min":1.617},"last":0.58999999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.69699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":5.46,"15min":5.46},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.873,"15min":0.873},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36199999999999999,"15min":0.39900000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.623,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39400000000000002,"15min":0.442},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":2.004,"15min":2.004},"last":0.27300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.308}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45000000000000001,"15min":0.48199999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":1.909,"15min":1.909},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.432,"15min":0.46500000000000002},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.625},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83799999999999997,"5min":1.869,"15min":1.869},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.952,"15min":1.952},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":1.782,"15min":1.782},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.819,"15min":1.819},"last":0.70199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194142,"statfs":{"total":200000000,"available":198801629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.45600000000000002,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.379},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.22,"15min":0.22},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.26800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4289999999999998,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.57299999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2999999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.66000000000000003,"15min":0.70399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.379,"5min":3.976,"15min":3.976},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71399999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3410000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55500000000000005,"5min":0.622,"15min":0.622},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.379,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"min":{"1min":0.29699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61599999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.82399999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":11.055,"15min":11.055},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.376},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.39700000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63800000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68300000000000005,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1279999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35499999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.64800000000000002,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61199999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":1.034,"15min":1.034},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":1.335,"15min":1.335},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67800000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":1.405,"15min":1.405},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81000000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.75900000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.80900000000000005},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.70399999999999996},"min":{"1min":0.44400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":5.274,"15min":5.274},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.80800000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.65300000000000002,"15min":0.82699999999999996},"min":{"1min":0.45600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.71699999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.55200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.34499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.375},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79200000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53000000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44900000000000001,"15min":0.47699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.437,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.58099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.60199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69099999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T11:41:43.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.288+0000 7fafc0872700 1 Processor -- start 2023-10-09T11:41:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.288+0000 7fafc0872700 1 -- start start 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafc0872700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafbc159b40 0x7fafbc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafc0872700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0cee10 con 0x7fafbc068e90 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafc0872700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0cd040 con 0x7fafbc159f10 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafc0872700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc0cd320 con 0x7fafbc159b40 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafbbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fafbc068e90 0x7fafbc0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49798/0 (socket says 172.21.15.6:49798) 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafbbfff700 1 -- 172.21.15.6:0/2461232220 learned_addr learned my addr 172.21.15.6:0/2461232220 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:43.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/2461232220 >> v2:172.21.15.118:3300/0 conn(0x7fafbc159b40 0x7fafbc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149508224 0 0) 0x7fafbc0cee10 con 0x7fafbc068e90 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.289+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa4003570 con 0x7fafbc068e90 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070469749 0 0) 0x7fafbc0cd040 con 0x7fafbc159f10 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc0cee10 con 0x7fafbc159f10 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110570538 0 0) 0x7fafa4003570 con 0x7fafbc068e90 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 >> v2:172.21.15.118:3300/0 conn(0x7fafbc159b40 msgr2=0x7fafbc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 --2- 172.21.15.6:0/2461232220 >> v2:172.21.15.118:3300/0 conn(0x7fafbc159b40 0x7fafbc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 >> v1:172.21.15.118:6789/0 conn(0x7fafbc159f10 legacy=0x7fafbc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0ce7c0 con 0x7fafbc068e90 2023-10-09T11:41:43.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fafb40017f0 con 0x7fafbc068e90 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 >> v1:172.21.15.6:6789/0 conn(0x7fafbc068e90 legacy=0x7fafbc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa4003bf0 0x7fafa4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa4004810 0x7fafa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 0x7fafa400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0cd320 con 0x7fafa40051c0 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400c0b0 con 0x7fafa4003bf0 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400c270 con 0x7fafa4004810 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 0x7fafa400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa4003bf0 0x7fafa4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbaffd700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa4004810 0x7fafa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 -- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa4004810 msgr2=0x7fafa4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa4004810 0x7fafa4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 -- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa4003bf0 msgr2=0x7fafa4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa4003bf0 0x7fafa4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 -- 172.21.15.6:0/2461232220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4003570 con 0x7fafa40051c0 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa4003bf0 0x7fafa4003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.290+0000 7fafbbfff700 1 -- 172.21.15.6:0/2461232220 reap_dead start 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafbbfff700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 0x7fafa400ba60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a8c0 tx=0x7fafb4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c07f7d0ee1e564a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40070d0 con 0x7fafa40051c0 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4007230 con 0x7fafa40051c0 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafba7fc700 1 -- 172.21.15.6:0/2461232220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40075f0 con 0x7fafa40051c0 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 -- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 msgr2=0x7fafa400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 0x7fafa400ba60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a8c0 tx=0x7fafb4002190 comp rx=0 tx=0).stop 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 -- 172.21.15.6:0/2461232220 shutdown_connections 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 --2- 172.21.15.6:0/2461232220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa40051c0 0x7fafa400ba60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 -- 172.21.15.6:0/2461232220 >> 172.21.15.6:0/2461232220 conn(0x7fafbc0cd660 msgr2=0x7fafbc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 -- 172.21.15.6:0/2461232220 shutdown_connections 2023-10-09T11:41:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.291+0000 7fafc0872700 1 -- 172.21.15.6:0/2461232220 wait complete. 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.292+0000 7fafc0872700 1 Processor -- start 2023-10-09T11:41:43.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.292+0000 7fafc0872700 1 -- start start 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa40051c0 0x7fafbc15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafbc16e460 0x7fafbc0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0b54d0 con 0x7fafbc0b4b10 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc16b610 con 0x7fafbc16e460 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafc0872700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc16e8d0 con 0x7fafa40051c0 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32770/0 (socket says 172.21.15.6:32770) 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafbbfff700 1 -- 172.21.15.6:0/549362988 learned_addr learned my addr 172.21.15.6:0/549362988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafbaffd700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafbc16e460 0x7fafbc0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.293+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa40051c0 0x7fafbc15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 -- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa40051c0 msgr2=0x7fafbc15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa40051c0 0x7fafbc15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 -- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafbc16e460 msgr2=0x7fafbc0b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafbc16e460 0x7fafbc0b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 -- 172.21.15.6:0/549362988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0b3500 con 0x7fafbc0b4b10 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafbbfff700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a3b0 tx=0x7fafb4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4004dc0 con 0x7fafbc0b4b10 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb401d420 con 0x7fafbc0b4b10 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc15a970 con 0x7fafbc0b4b10 2023-10-09T11:41:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb401d7e0 con 0x7fafbc0b4b10 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.294+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc15af30 con 0x7fafbc0b4b10 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.295+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc16b780 con 0x7fafbc0b4b10 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.295+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafb401db50 con 0x7fafbc0b4b10 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.296+0000 7fafa37fe700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.296+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafb4085d70 con 0x7fafbc0b4b10 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.296+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.296+0000 7fafbb7fe700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fafac009170 tx=0x7fafac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.300+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafb4052f40 con 0x7fafbc0b4b10 2023-10-09T11:41:43.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.487+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafbc063e90 con 0x7fafa8066f30 2023-10-09T11:41:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.495+0000 7fafa37fe700 1 -- 172.21.15.6:0/549362988 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282326 (secure 0 0 0) 0x7fafbc063e90 con 0x7fafa8066f30 2023-10-09T11:41:43.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 msgr2=0x7fafa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fafac009170 tx=0x7fafac008040 comp rx=0 tx=0).stop 2023-10-09T11:41:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 msgr2=0x7fafbc0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a3b0 tx=0x7fafb4016000 comp rx=0 tx=0).stop 2023-10-09T11:41:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 shutdown_connections 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafbc0b4b10 0x7fafbc0b4f90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa40051c0 0x7fafbc15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 --2- 172.21.15.6:0/549362988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafbc16e460 0x7fafbc0b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 >> 172.21.15.6:0/549362988 conn(0x7fafbc0cd660 msgr2=0x7fafbc0cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 shutdown_connections 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.499+0000 7fafc0872700 1 -- 172.21.15.6:0/549362988 wait complete. 2023-10-09T11:41:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:41:43.512 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-10-09T11:41:42.219087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556571,"statfs":{"total":1600000000,"available":1593929374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.209829"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014645+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:29.759587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025689+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013958+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:09.873464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014800+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018726+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017844+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021674+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012457+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014440+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019545+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011734+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.024462+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:05.789587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021461+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019151+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022478+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019265+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:05.145751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011918+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019748+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:55.127701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022129+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020941+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017891+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014067+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021425+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013357+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021185+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.026213+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:12.456262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018909+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014861+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:04.071873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020279+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:39.268358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022285+0000","last_change":"2023-10-09T11:41:38.022285+0000","last_active":"2023-10-09T11:41:38.022285+0000","last_peered":"2023-10-09T11:41:38.022285+0000","last_clean":"2023-10-09T11:41:38.022285+0000","last_became_active":"2023-10-09T11:41:38.021933+0000","last_became_peered":"2023-10-09T11:41:38.021933+0000","last_unstale":"2023-10-09T11:41:38.022285+0000","last_undegraded":"2023-10-09T11:41:38.022285+0000","last_fullsized":"2023-10-09T11:41:38.022285+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.329794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017954+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021884+0000","last_change":"2023-10-09T11:41:38.021884+0000","last_active":"2023-10-09T11:41:38.021884+0000","last_peered":"2023-10-09T11:41:38.021884+0000","last_clean":"2023-10-09T11:41:38.021884+0000","last_became_active":"2023-10-09T11:41:38.021661+0000","last_became_peered":"2023-10-09T11:41:38.021661+0000","last_unstale":"2023-10-09T11:41:38.021884+0000","last_undegraded":"2023-10-09T11:41:38.021884+0000","last_fullsized":"2023-10-09T11:41:38.021884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:01.516396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014202+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:12.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027892+0000","last_change":"2023-10-09T11:41:38.027892+0000","last_active":"2023-10-09T11:41:38.027892+0000","last_peered":"2023-10-09T11:41:38.027892+0000","last_clean":"2023-10-09T11:41:38.027892+0000","last_became_active":"2023-10-09T11:41:38.027650+0000","last_became_peered":"2023-10-09T11:41:38.027650+0000","last_unstale":"2023-10-09T11:41:38.027892+0000","last_undegraded":"2023-10-09T11:41:38.027892+0000","last_fullsized":"2023-10-09T11:41:38.027892+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011294+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018919+0000","last_change":"2023-10-09T11:41:38.018919+0000","last_active":"2023-10-09T11:41:38.018919+0000","last_peered":"2023-10-09T11:41:38.018919+0000","last_clean":"2023-10-09T11:41:38.018919+0000","last_became_active":"2023-10-09T11:41:38.018647+0000","last_became_peered":"2023-10-09T11:41:38.018647+0000","last_unstale":"2023-10-09T11:41:38.018919+0000","last_undegraded":"2023-10-09T11:41:38.018919+0000","last_fullsized":"2023-10-09T11:41:38.018919+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:13.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022626+0000","last_change":"2023-10-09T11:41:38.022626+0000","last_active":"2023-10-09T11:41:38.022626+0000","last_peered":"2023-10-09T11:41:38.022626+0000","last_clean":"2023-10-09T11:41:38.022626+0000","last_became_active":"2023-10-09T11:41:38.021978+0000","last_became_peered":"2023-10-09T11:41:38.021978+0000","last_unstale":"2023-10-09T11:41:38.022626+0000","last_undegraded":"2023-10-09T11:41:38.022626+0000","last_fullsized":"2023-10-09T11:41:38.022626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:14.381028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017423+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027649+0000","last_change":"2023-10-09T11:41:38.027649+0000","last_active":"2023-10-09T11:41:38.027649+0000","last_peered":"2023-10-09T11:41:38.027649+0000","last_clean":"2023-10-09T11:41:38.027649+0000","last_became_active":"2023-10-09T11:41:38.027070+0000","last_became_peered":"2023-10-09T11:41:38.027070+0000","last_unstale":"2023-10-09T11:41:38.027649+0000","last_undegraded":"2023-10-09T11:41:38.027649+0000","last_fullsized":"2023-10-09T11:41:38.027649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018558+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021051+0000","last_change":"2023-10-09T11:41:38.021051+0000","last_active":"2023-10-09T11:41:38.021051+0000","last_peered":"2023-10-09T11:41:38.021051+0000","last_clean":"2023-10-09T11:41:38.021051+0000","last_became_active":"2023-10-09T11:41:38.020811+0000","last_became_peered":"2023-10-09T11:41:38.020811+0000","last_unstale":"2023-10-09T11:41:38.021051+0000","last_undegraded":"2023-10-09T11:41:38.021051+0000","last_fullsized":"2023-10-09T11:41:38.021051+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018205+0000","last_change":"2023-10-09T11:41:38.018205+0000","last_active":"2023-10-09T11:41:38.018205+0000","last_peered":"2023-10-09T11:41:38.018205+0000","last_clean":"2023-10-09T11:41:38.018205+0000","last_became_active":"2023-10-09T11:41:38.016831+0000","last_became_peered":"2023-10-09T11:41:38.016831+0000","last_unstale":"2023-10-09T11:41:38.018205+0000","last_undegraded":"2023-10-09T11:41:38.018205+0000","last_fullsized":"2023-10-09T11:41:38.018205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021750+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015417+0000","last_change":"2023-10-09T11:41:38.015417+0000","last_active":"2023-10-09T11:41:38.015417+0000","last_peered":"2023-10-09T11:41:38.015417+0000","last_clean":"2023-10-09T11:41:38.015417+0000","last_became_active":"2023-10-09T11:41:38.015109+0000","last_became_peered":"2023-10-09T11:41:38.015109+0000","last_unstale":"2023-10-09T11:41:38.015417+0000","last_undegraded":"2023-10-09T11:41:38.015417+0000","last_fullsized":"2023-10-09T11:41:38.015417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:46.822110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012069+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017513+0000","last_change":"2023-10-09T11:41:38.017513+0000","last_active":"2023-10-09T11:41:38.017513+0000","last_peered":"2023-10-09T11:41:38.017513+0000","last_clean":"2023-10-09T11:41:38.017513+0000","last_became_active":"2023-10-09T11:41:38.017235+0000","last_became_peered":"2023-10-09T11:41:38.017235+0000","last_unstale":"2023-10-09T11:41:38.017513+0000","last_undegraded":"2023-10-09T11:41:38.017513+0000","last_fullsized":"2023-10-09T11:41:38.017513+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013579+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021249+0000","last_change":"2023-10-09T11:41:38.021249+0000","last_active":"2023-10-09T11:41:38.021249+0000","last_peered":"2023-10-09T11:41:38.021249+0000","last_clean":"2023-10-09T11:41:38.021249+0000","last_became_active":"2023-10-09T11:41:38.020987+0000","last_became_peered":"2023-10-09T11:41:38.020987+0000","last_unstale":"2023-10-09T11:41:38.021249+0000","last_undegraded":"2023-10-09T11:41:38.021249+0000","last_fullsized":"2023-10-09T11:41:38.021249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017747+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.016091+0000","last_change":"2023-10-09T11:41:38.016091+0000","last_active":"2023-10-09T11:41:38.016091+0000","last_peered":"2023-10-09T11:41:38.016091+0000","last_clean":"2023-10-09T11:41:38.016091+0000","last_became_active":"2023-10-09T11:41:38.015871+0000","last_became_peered":"2023-10-09T11:41:38.015871+0000","last_unstale":"2023-10-09T11:41:38.016091+0000","last_undegraded":"2023-10-09T11:41:38.016091+0000","last_fullsized":"2023-10-09T11:41:38.016091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017560+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015122+0000","last_change":"2023-10-09T11:41:38.015122+0000","last_active":"2023-10-09T11:41:38.015122+0000","last_peered":"2023-10-09T11:41:38.015122+0000","last_clean":"2023-10-09T11:41:38.015122+0000","last_became_active":"2023-10-09T11:41:38.014732+0000","last_became_peered":"2023-10-09T11:41:38.014732+0000","last_unstale":"2023-10-09T11:41:38.015122+0000","last_undegraded":"2023-10-09T11:41:38.015122+0000","last_fullsized":"2023-10-09T11:41:38.015122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:48.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014408+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:40.530128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017653+0000","last_change":"2023-10-09T11:41:38.017653+0000","last_active":"2023-10-09T11:41:38.017653+0000","last_peered":"2023-10-09T11:41:38.017653+0000","last_clean":"2023-10-09T11:41:38.017653+0000","last_became_active":"2023-10-09T11:41:38.017397+0000","last_became_peered":"2023-10-09T11:41:38.017397+0000","last_unstale":"2023-10-09T11:41:38.017653+0000","last_undegraded":"2023-10-09T11:41:38.017653+0000","last_fullsized":"2023-10-09T11:41:38.017653+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:31.032015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011430+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017434+0000","last_change":"2023-10-09T11:41:38.017434+0000","last_active":"2023-10-09T11:41:38.017434+0000","last_peered":"2023-10-09T11:41:38.017434+0000","last_clean":"2023-10-09T11:41:38.017434+0000","last_became_active":"2023-10-09T11:41:38.016881+0000","last_became_peered":"2023-10-09T11:41:38.016881+0000","last_unstale":"2023-10-09T11:41:38.017434+0000","last_undegraded":"2023-10-09T11:41:38.017434+0000","last_fullsized":"2023-10-09T11:41:38.017434+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019595+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:19.260253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020930+0000","last_change":"2023-10-09T11:41:38.020930+0000","last_active":"2023-10-09T11:41:38.020930+0000","last_peered":"2023-10-09T11:41:38.020930+0000","last_clean":"2023-10-09T11:41:38.020930+0000","last_became_active":"2023-10-09T11:41:38.020688+0000","last_became_peered":"2023-10-09T11:41:38.020688+0000","last_unstale":"2023-10-09T11:41:38.020930+0000","last_undegraded":"2023-10-09T11:41:38.020930+0000","last_fullsized":"2023-10-09T11:41:38.020930+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:36.669315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014019+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.013821+0000","last_change":"2023-10-09T11:41:38.013821+0000","last_active":"2023-10-09T11:41:38.013821+0000","last_peered":"2023-10-09T11:41:38.013821+0000","last_clean":"2023-10-09T11:41:38.013821+0000","last_became_active":"2023-10-09T11:41:38.013452+0000","last_became_peered":"2023-10-09T11:41:38.013452+0000","last_unstale":"2023-10-09T11:41:38.013821+0000","last_undegraded":"2023-10-09T11:41:38.013821+0000","last_fullsized":"2023-10-09T11:41:38.013821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015401+0000","last_change":"2023-10-09T11:41:38.015401+0000","last_active":"2023-10-09T11:41:38.015401+0000","last_peered":"2023-10-09T11:41:38.015401+0000","last_clean":"2023-10-09T11:41:38.015401+0000","last_became_active":"2023-10-09T11:41:38.015189+0000","last_became_peered":"2023-10-09T11:41:38.015189+0000","last_unstale":"2023-10-09T11:41:38.015401+0000","last_undegraded":"2023-10-09T11:41:38.015401+0000","last_fullsized":"2023-10-09T11:41:38.015401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018343+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.019813+0000","last_change":"2023-10-09T11:41:38.019813+0000","last_active":"2023-10-09T11:41:38.019813+0000","last_peered":"2023-10-09T11:41:38.019813+0000","last_clean":"2023-10-09T11:41:38.019813+0000","last_became_active":"2023-10-09T11:41:38.019579+0000","last_became_peered":"2023-10-09T11:41:38.019579+0000","last_unstale":"2023-10-09T11:41:38.019813+0000","last_undegraded":"2023-10-09T11:41:38.019813+0000","last_fullsized":"2023-10-09T11:41:38.019813+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019863+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:23.657794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027229+0000","last_change":"2023-10-09T11:41:38.027229+0000","last_active":"2023-10-09T11:41:38.027229+0000","last_peered":"2023-10-09T11:41:38.027229+0000","last_clean":"2023-10-09T11:41:38.027229+0000","last_became_active":"2023-10-09T11:41:38.026311+0000","last_became_peered":"2023-10-09T11:41:38.026311+0000","last_unstale":"2023-10-09T11:41:38.027229+0000","last_undegraded":"2023-10-09T11:41:38.027229+0000","last_fullsized":"2023-10-09T11:41:38.027229+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018660+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:43.382274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015308+0000","last_change":"2023-10-09T11:41:38.015308+0000","last_active":"2023-10-09T11:41:38.015308+0000","last_peered":"2023-10-09T11:41:38.015308+0000","last_clean":"2023-10-09T11:41:38.015308+0000","last_became_active":"2023-10-09T11:41:38.015070+0000","last_became_peered":"2023-10-09T11:41:38.015070+0000","last_unstale":"2023-10-09T11:41:38.015308+0000","last_undegraded":"2023-10-09T11:41:38.015308+0000","last_fullsized":"2023-10-09T11:41:38.015308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018718+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:41.717636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014367+0000","last_change":"2023-10-09T11:41:38.014367+0000","last_active":"2023-10-09T11:41:38.014367+0000","last_peered":"2023-10-09T11:41:38.014367+0000","last_clean":"2023-10-09T11:41:38.014367+0000","last_became_active":"2023-10-09T11:41:38.014122+0000","last_became_peered":"2023-10-09T11:41:38.014122+0000","last_unstale":"2023-10-09T11:41:38.014367+0000","last_undegraded":"2023-10-09T11:41:38.014367+0000","last_fullsized":"2023-10-09T11:41:38.014367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013646+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.026542+0000","last_change":"2023-10-09T11:41:38.026542+0000","last_active":"2023-10-09T11:41:38.026542+0000","last_peered":"2023-10-09T11:41:38.026542+0000","last_clean":"2023-10-09T11:41:38.026542+0000","last_became_active":"2023-10-09T11:41:38.026285+0000","last_became_peered":"2023-10-09T11:41:38.026285+0000","last_unstale":"2023-10-09T11:41:38.026542+0000","last_undegraded":"2023-10-09T11:41:38.026542+0000","last_fullsized":"2023-10-09T11:41:38.026542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014875+0000","last_change":"2023-10-09T11:41:38.014875+0000","last_active":"2023-10-09T11:41:38.014875+0000","last_peered":"2023-10-09T11:41:38.014875+0000","last_clean":"2023-10-09T11:41:38.014875+0000","last_became_active":"2023-10-09T11:41:38.014371+0000","last_became_peered":"2023-10-09T11:41:38.014371+0000","last_unstale":"2023-10-09T11:41:38.014875+0000","last_undegraded":"2023-10-09T11:41:38.014875+0000","last_fullsized":"2023-10-09T11:41:38.014875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014398+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:13.130473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027494+0000","last_change":"2023-10-09T11:41:38.027494+0000","last_active":"2023-10-09T11:41:38.027494+0000","last_peered":"2023-10-09T11:41:38.027494+0000","last_clean":"2023-10-09T11:41:38.027494+0000","last_became_active":"2023-10-09T11:41:38.026728+0000","last_became_peered":"2023-10-09T11:41:38.026728+0000","last_unstale":"2023-10-09T11:41:38.027494+0000","last_undegraded":"2023-10-09T11:41:38.027494+0000","last_fullsized":"2023-10-09T11:41:38.027494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013676+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:09.419461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.023342+0000","last_change":"2023-10-09T11:41:38.023342+0000","last_active":"2023-10-09T11:41:38.023342+0000","last_peered":"2023-10-09T11:41:38.023342+0000","last_clean":"2023-10-09T11:41:38.023342+0000","last_became_active":"2023-10-09T11:41:38.020743+0000","last_became_peered":"2023-10-09T11:41:38.020743+0000","last_unstale":"2023-10-09T11:41:38.023342+0000","last_undegraded":"2023-10-09T11:41:38.023342+0000","last_fullsized":"2023-10-09T11:41:38.023342+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013189+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020414+0000","last_change":"2023-10-09T11:41:38.020414+0000","last_active":"2023-10-09T11:41:38.020414+0000","last_peered":"2023-10-09T11:41:38.020414+0000","last_clean":"2023-10-09T11:41:38.020414+0000","last_became_active":"2023-10-09T11:41:38.020197+0000","last_became_peered":"2023-10-09T11:41:38.020197+0000","last_unstale":"2023-10-09T11:41:38.020414+0000","last_undegraded":"2023-10-09T11:41:38.020414+0000","last_fullsized":"2023-10-09T11:41:38.020414+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:07.301979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019167+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:08.663307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018380+0000","last_change":"2023-10-09T11:41:38.018380+0000","last_active":"2023-10-09T11:41:38.018380+0000","last_peered":"2023-10-09T11:41:38.018380+0000","last_clean":"2023-10-09T11:41:38.018380+0000","last_became_active":"2023-10-09T11:41:38.018141+0000","last_became_peered":"2023-10-09T11:41:38.018141+0000","last_unstale":"2023-10-09T11:41:38.018380+0000","last_undegraded":"2023-10-09T11:41:38.018380+0000","last_fullsized":"2023-10-09T11:41:38.018380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:05.219675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011267+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018063+0000","last_change":"2023-10-09T11:41:38.018063+0000","last_active":"2023-10-09T11:41:38.018063+0000","last_peered":"2023-10-09T11:41:38.018063+0000","last_clean":"2023-10-09T11:41:38.018063+0000","last_became_active":"2023-10-09T11:41:38.017768+0000","last_became_peered":"2023-10-09T11:41:38.017768+0000","last_unstale":"2023-10-09T11:41:38.018063+0000","last_undegraded":"2023-10-09T11:41:38.018063+0000","last_fullsized":"2023-10-09T11:41:38.018063+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019351+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:28.948064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018141+0000","last_change":"2023-10-09T11:41:38.018141+0000","last_active":"2023-10-09T11:41:38.018141+0000","last_peered":"2023-10-09T11:41:38.018141+0000","last_clean":"2023-10-09T11:41:38.018141+0000","last_became_active":"2023-10-09T11:41:38.017497+0000","last_became_peered":"2023-10-09T11:41:38.017497+0000","last_unstale":"2023-10-09T11:41:38.018141+0000","last_undegraded":"2023-10-09T11:41:38.018141+0000","last_fullsized":"2023-10-09T11:41:38.018141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:29.649576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012936+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027098+0000","last_change":"2023-10-09T11:41:38.027098+0000","last_active":"2023-10-09T11:41:38.027098+0000","last_peered":"2023-10-09T11:41:38.027098+0000","last_clean":"2023-10-09T11:41:38.027098+0000","last_became_active":"2023-10-09T11:41:38.025975+0000","last_became_peered":"2023-10-09T11:41:38.025975+0000","last_unstale":"2023-10-09T11:41:38.027098+0000","last_undegraded":"2023-10-09T11:41:38.027098+0000","last_fullsized":"2023-10-09T11:41:38.027098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:06.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025311+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:41.445246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022601+0000","last_change":"2023-10-09T11:41:38.022601+0000","last_active":"2023-10-09T11:41:38.022601+0000","last_peered":"2023-10-09T11:41:38.022601+0000","last_clean":"2023-10-09T11:41:38.022601+0000","last_became_active":"2023-10-09T11:41:38.022412+0000","last_became_peered":"2023-10-09T11:41:38.022412+0000","last_unstale":"2023-10-09T11:41:38.022601+0000","last_undegraded":"2023-10-09T11:41:38.022601+0000","last_fullsized":"2023-10-09T11:41:38.022601+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":241,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T11:41:37.011329+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:41:37.011329+0000","last_peered":"2023-10-09T11:41:37.011329+0000","last_clean":"2023-10-09T11:41:37.011329+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:41:37.011329+0000","last_undegraded":"2023-10-09T11:41:37.011329+0000","last_fullsized":"2023-10-09T11:41:37.011329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194141,"statfs":{"total":200000000,"available":198800618,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.878,"15min":0.878},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65800000000000003,"5min":1.048,"15min":1.048},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":1.079,"15min":1.079},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73399999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76600000000000001,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57999999999999996,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.298,"15min":5.298},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.67400000000000004},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":1.617,"15min":1.617},"last":0.58999999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.69699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":5.46,"15min":5.46},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.873,"15min":0.873},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36199999999999999,"15min":0.39900000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.623,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39400000000000002,"15min":0.442},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":2.004,"15min":2.004},"last":0.27300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.308}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45000000000000001,"15min":0.48199999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":1.909,"15min":1.909},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.432,"15min":0.46500000000000002},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.625},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83799999999999997,"5min":1.869,"15min":1.869},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.952,"15min":1.952},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":1.782,"15min":1.782},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.819,"15min":1.819},"last":0.70199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194142,"statfs":{"total":200000000,"available":198801629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.45600000000000002,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.379},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.22,"15min":0.22},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.26800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4289999999999998,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.57299999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2999999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.66000000000000003,"15min":0.70399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.379,"5min":3.976,"15min":3.976},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71399999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3410000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55500000000000005,"5min":0.622,"15min":0.622},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.379,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"min":{"1min":0.29699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61599999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.82399999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":11.055,"15min":11.055},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.376},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.39700000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63800000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68300000000000005,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1279999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35499999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.64800000000000002,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61199999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":1.034,"15min":1.034},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":1.335,"15min":1.335},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67800000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":1.405,"15min":1.405},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81000000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.75900000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.80900000000000005},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.70399999999999996},"min":{"1min":0.44400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":5.274,"15min":5.274},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.80800000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.65300000000000002,"15min":0.82699999999999996},"min":{"1min":0.45600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.71699999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.55200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.34499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.375},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79200000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53000000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44900000000000001,"15min":0.47699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.437,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.58099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.60199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69099999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T11:41:43.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.669+0000 7fa67a764700 1 Processor -- start 2023-10-09T11:41:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.669+0000 7fa67a764700 1 -- start start 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa67a764700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa67415a2a0 0x7fa6740b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa67a764700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740b0ca0 con 0x7fa6740ceb30 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa67a764700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740b00d0 con 0x7fa67406dd60 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa67a764700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67406e160 con 0x7fa67415a2a0 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa6737fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa6740ceb30 0x7fa67406d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49802/0 (socket says 172.21.15.6:49802) 2023-10-09T11:41:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa6737fe700 1 -- 172.21.15.6:0/4216831067 learned_addr learned my addr 172.21.15.6:0/4216831067 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.670+0000 7fa673fff700 1 --2- 172.21.15.6:0/4216831067 >> v2:172.21.15.118:3300/0 conn(0x7fa67415a2a0 0x7fa6740b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958586866 0 0) 0x7fa6740b0ca0 con 0x7fa6740ceb30 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa660003570 con 0x7fa6740ceb30 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495427143 0 0) 0x7fa6740b00d0 con 0x7fa67406dd60 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6740b0ca0 con 0x7fa67406dd60 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737602613 0 0) 0x7fa660003570 con 0x7fa6740ceb30 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 >> v2:172.21.15.118:3300/0 conn(0x7fa67415a2a0 msgr2=0x7fa6740b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 --2- 172.21.15.6:0/4216831067 >> v2:172.21.15.118:3300/0 conn(0x7fa67415a2a0 0x7fa6740b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 >> v1:172.21.15.118:6789/0 conn(0x7fa67406dd60 legacy=0x7fa6740b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740b0370 con 0x7fa6740ceb30 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fa65c001470 con 0x7fa6740ceb30 2023-10-09T11:41:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 >> v1:172.21.15.6:6789/0 conn(0x7fa6740ceb30 legacy=0x7fa67406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 0x7fa660003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660004810 0x7fa660004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6600051c0 0x7fa66000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67406e160 con 0x7fa660003bf0 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000c0b0 con 0x7fa6600051c0 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000c270 con 0x7fa660004810 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 0x7fa660003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa6737fe700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660004810 0x7fa660004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa678d01700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6600051c0 0x7fa66000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 -- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660004810 msgr2=0x7fa660004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa660004810 0x7fa660004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 -- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6600051c0 msgr2=0x7fa66000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6600051c0 0x7fa66000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa673fff700 1 -- 172.21.15.6:0/4216831067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660003570 con 0x7fa660003bf0 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa678d01700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6600051c0 0x7fa66000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.671+0000 7fa678d01700 1 -- 172.21.15.6:0/4216831067 reap_dead start 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa673fff700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 0x7fa660003fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa664009c00 tx=0x7fa6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b5484acc67b91f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400e710 con 0x7fa660003bf0 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400e870 con 0x7fa660003bf0 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa672ffd700 1 -- 172.21.15.6:0/4216831067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400ec30 con 0x7fa660003bf0 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 -- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 msgr2=0x7fa660003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 0x7fa660003fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa664009c00 tx=0x7fa6640091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 -- 172.21.15.6:0/4216831067 shutdown_connections 2023-10-09T11:41:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 --2- 172.21.15.6:0/4216831067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660003bf0 0x7fa660003fe0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 -- 172.21.15.6:0/4216831067 >> 172.21.15.6:0/4216831067 conn(0x7fa674067640 msgr2=0x7fa674067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 -- 172.21.15.6:0/4216831067 shutdown_connections 2023-10-09T11:41:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.672+0000 7fa67a764700 1 -- 172.21.15.6:0/4216831067 wait complete. 2023-10-09T11:41:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.673+0000 7fa67a764700 1 Processor -- start 2023-10-09T11:41:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.673+0000 7fa67a764700 1 -- start start 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660003bf0 0x7fa6740acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 0x7fa67416e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674155ef0 con 0x7fa67416ea20 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740c9370 con 0x7fa660003bf0 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa67a764700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740ad430 con 0x7fa67416e070 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa678d01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa678d01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32792/0 (socket says 172.21.15.6:32792) 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa678d01700 1 -- 172.21.15.6:0/3674134507 learned_addr learned my addr 172.21.15.6:0/3674134507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa673fff700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660003bf0 0x7fa6740acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.674+0000 7fa6737fe700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 0x7fa67416e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 -- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 msgr2=0x7fa67416e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 0x7fa67416e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 -- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660003bf0 msgr2=0x7fa6740acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660003bf0 0x7fa6740acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 -- 172.21.15.6:0/3674134507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67416eea0 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa6737fe700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 0x7fa67416e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa678d01700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa674064d60 tx=0x7fa66c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0032e0 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c003440 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740c8a40 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c006df0 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.675+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6740c9000 con 0x7fa67416ea20 2023-10-09T11:41:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.676+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6740c9700 con 0x7fa67416ea20 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.676+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa66c0018f0 con 0x7fa67416ea20 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.677+0000 7fa66bfff700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.677+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa66c083ad0 con 0x7fa67416ea20 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.677+0000 7fa673fff700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.677+0000 7fa673fff700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 0x7fa6540693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa6640091e0 tx=0x7fa66401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.681+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6740c9700 con 0x7fa67416ea20 2023-10-09T11:41:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.871+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6740c94e0 con 0x7fa654066f30 2023-10-09T11:41:43.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.879+0000 7fa66bfff700 1 -- 172.21.15.6:0/3674134507 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282326 (secure 0 0 0) 0x7fa6740c94e0 con 0x7fa654066f30 2023-10-09T11:41:43.883 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 msgr2=0x7fa6540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 0x7fa6540693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa6640091e0 tx=0x7fa66401a000 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 msgr2=0x7fa6740a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa674064d60 tx=0x7fa66c009040 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 shutdown_connections 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa67416ea20 0x7fa6740a6480 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa660003bf0 0x7fa6740acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 --2- 172.21.15.6:0/3674134507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa67416e070 0x7fa67416e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 >> 172.21.15.6:0/3674134507 conn(0x7fa674067640 msgr2=0x7fa674158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:43.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 shutdown_connections 2023-10-09T11:41:43.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:43.882+0000 7fa67a764700 1 -- 172.21.15.6:0/3674134507 wait complete. 2023-10-09T11:41:43.887 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:41:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-10-09T11:41:42.219087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556571,"statfs":{"total":1600000000,"available":1593929374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.209829"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014645+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:29.759587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025689+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013958+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:16:09.873464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014800+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018726+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017844+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021674+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012457+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014440+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019545+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011734+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.024462+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:05.789587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021461+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019151+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022478+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019265+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020656+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:05.145751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011918+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019748+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:38:55.127701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.022129+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020941+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017891+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014067+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021425+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018194+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013357+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021185+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.026213+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:09:12.456262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018909+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014861+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:04.071873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020279+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:39.268358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022285+0000","last_change":"2023-10-09T11:41:38.022285+0000","last_active":"2023-10-09T11:41:38.022285+0000","last_peered":"2023-10-09T11:41:38.022285+0000","last_clean":"2023-10-09T11:41:38.022285+0000","last_became_active":"2023-10-09T11:41:38.021933+0000","last_became_peered":"2023-10-09T11:41:38.021933+0000","last_unstale":"2023-10-09T11:41:38.022285+0000","last_undegraded":"2023-10-09T11:41:38.022285+0000","last_fullsized":"2023-10-09T11:41:38.022285+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.329794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017954+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021884+0000","last_change":"2023-10-09T11:41:38.021884+0000","last_active":"2023-10-09T11:41:38.021884+0000","last_peered":"2023-10-09T11:41:38.021884+0000","last_clean":"2023-10-09T11:41:38.021884+0000","last_became_active":"2023-10-09T11:41:38.021661+0000","last_became_peered":"2023-10-09T11:41:38.021661+0000","last_unstale":"2023-10-09T11:41:38.021884+0000","last_undegraded":"2023-10-09T11:41:38.021884+0000","last_fullsized":"2023-10-09T11:41:38.021884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:01.516396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014202+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:12.638530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027892+0000","last_change":"2023-10-09T11:41:38.027892+0000","last_active":"2023-10-09T11:41:38.027892+0000","last_peered":"2023-10-09T11:41:38.027892+0000","last_clean":"2023-10-09T11:41:38.027892+0000","last_became_active":"2023-10-09T11:41:38.027650+0000","last_became_peered":"2023-10-09T11:41:38.027650+0000","last_unstale":"2023-10-09T11:41:38.027892+0000","last_undegraded":"2023-10-09T11:41:38.027892+0000","last_fullsized":"2023-10-09T11:41:38.027892+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011294+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018919+0000","last_change":"2023-10-09T11:41:38.018919+0000","last_active":"2023-10-09T11:41:38.018919+0000","last_peered":"2023-10-09T11:41:38.018919+0000","last_clean":"2023-10-09T11:41:38.018919+0000","last_became_active":"2023-10-09T11:41:38.018647+0000","last_became_peered":"2023-10-09T11:41:38.018647+0000","last_unstale":"2023-10-09T11:41:38.018919+0000","last_undegraded":"2023-10-09T11:41:38.018919+0000","last_fullsized":"2023-10-09T11:41:38.018919+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:13.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022626+0000","last_change":"2023-10-09T11:41:38.022626+0000","last_active":"2023-10-09T11:41:38.022626+0000","last_peered":"2023-10-09T11:41:38.022626+0000","last_clean":"2023-10-09T11:41:38.022626+0000","last_became_active":"2023-10-09T11:41:38.021978+0000","last_became_peered":"2023-10-09T11:41:38.021978+0000","last_unstale":"2023-10-09T11:41:38.022626+0000","last_undegraded":"2023-10-09T11:41:38.022626+0000","last_fullsized":"2023-10-09T11:41:38.022626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:14.381028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017423+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027649+0000","last_change":"2023-10-09T11:41:38.027649+0000","last_active":"2023-10-09T11:41:38.027649+0000","last_peered":"2023-10-09T11:41:38.027649+0000","last_clean":"2023-10-09T11:41:38.027649+0000","last_became_active":"2023-10-09T11:41:38.027070+0000","last_became_peered":"2023-10-09T11:41:38.027070+0000","last_unstale":"2023-10-09T11:41:38.027649+0000","last_undegraded":"2023-10-09T11:41:38.027649+0000","last_fullsized":"2023-10-09T11:41:38.027649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018558+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021051+0000","last_change":"2023-10-09T11:41:38.021051+0000","last_active":"2023-10-09T11:41:38.021051+0000","last_peered":"2023-10-09T11:41:38.021051+0000","last_clean":"2023-10-09T11:41:38.021051+0000","last_became_active":"2023-10-09T11:41:38.020811+0000","last_became_peered":"2023-10-09T11:41:38.020811+0000","last_unstale":"2023-10-09T11:41:38.021051+0000","last_undegraded":"2023-10-09T11:41:38.021051+0000","last_fullsized":"2023-10-09T11:41:38.021051+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018205+0000","last_change":"2023-10-09T11:41:38.018205+0000","last_active":"2023-10-09T11:41:38.018205+0000","last_peered":"2023-10-09T11:41:38.018205+0000","last_clean":"2023-10-09T11:41:38.018205+0000","last_became_active":"2023-10-09T11:41:38.016831+0000","last_became_peered":"2023-10-09T11:41:38.016831+0000","last_unstale":"2023-10-09T11:41:38.018205+0000","last_undegraded":"2023-10-09T11:41:38.018205+0000","last_fullsized":"2023-10-09T11:41:38.018205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.021750+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015417+0000","last_change":"2023-10-09T11:41:38.015417+0000","last_active":"2023-10-09T11:41:38.015417+0000","last_peered":"2023-10-09T11:41:38.015417+0000","last_clean":"2023-10-09T11:41:38.015417+0000","last_became_active":"2023-10-09T11:41:38.015109+0000","last_became_peered":"2023-10-09T11:41:38.015109+0000","last_unstale":"2023-10-09T11:41:38.015417+0000","last_undegraded":"2023-10-09T11:41:38.015417+0000","last_fullsized":"2023-10-09T11:41:38.015417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:46.822110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012069+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017513+0000","last_change":"2023-10-09T11:41:38.017513+0000","last_active":"2023-10-09T11:41:38.017513+0000","last_peered":"2023-10-09T11:41:38.017513+0000","last_clean":"2023-10-09T11:41:38.017513+0000","last_became_active":"2023-10-09T11:41:38.017235+0000","last_became_peered":"2023-10-09T11:41:38.017235+0000","last_unstale":"2023-10-09T11:41:38.017513+0000","last_undegraded":"2023-10-09T11:41:38.017513+0000","last_fullsized":"2023-10-09T11:41:38.017513+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013579+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.021249+0000","last_change":"2023-10-09T11:41:38.021249+0000","last_active":"2023-10-09T11:41:38.021249+0000","last_peered":"2023-10-09T11:41:38.021249+0000","last_clean":"2023-10-09T11:41:38.021249+0000","last_became_active":"2023-10-09T11:41:38.020987+0000","last_became_peered":"2023-10-09T11:41:38.020987+0000","last_unstale":"2023-10-09T11:41:38.021249+0000","last_undegraded":"2023-10-09T11:41:38.021249+0000","last_fullsized":"2023-10-09T11:41:38.021249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017747+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.016091+0000","last_change":"2023-10-09T11:41:38.016091+0000","last_active":"2023-10-09T11:41:38.016091+0000","last_peered":"2023-10-09T11:41:38.016091+0000","last_clean":"2023-10-09T11:41:38.016091+0000","last_became_active":"2023-10-09T11:41:38.015871+0000","last_became_peered":"2023-10-09T11:41:38.015871+0000","last_unstale":"2023-10-09T11:41:38.016091+0000","last_undegraded":"2023-10-09T11:41:38.016091+0000","last_fullsized":"2023-10-09T11:41:38.016091+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.017560+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015122+0000","last_change":"2023-10-09T11:41:38.015122+0000","last_active":"2023-10-09T11:41:38.015122+0000","last_peered":"2023-10-09T11:41:38.015122+0000","last_clean":"2023-10-09T11:41:38.015122+0000","last_became_active":"2023-10-09T11:41:38.014732+0000","last_became_peered":"2023-10-09T11:41:38.014732+0000","last_unstale":"2023-10-09T11:41:38.015122+0000","last_undegraded":"2023-10-09T11:41:38.015122+0000","last_fullsized":"2023-10-09T11:41:38.015122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:48.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014408+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:15:40.530128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017653+0000","last_change":"2023-10-09T11:41:38.017653+0000","last_active":"2023-10-09T11:41:38.017653+0000","last_peered":"2023-10-09T11:41:38.017653+0000","last_clean":"2023-10-09T11:41:38.017653+0000","last_became_active":"2023-10-09T11:41:38.017397+0000","last_became_peered":"2023-10-09T11:41:38.017397+0000","last_unstale":"2023-10-09T11:41:38.017653+0000","last_undegraded":"2023-10-09T11:41:38.017653+0000","last_fullsized":"2023-10-09T11:41:38.017653+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:31.032015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011430+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.017434+0000","last_change":"2023-10-09T11:41:38.017434+0000","last_active":"2023-10-09T11:41:38.017434+0000","last_peered":"2023-10-09T11:41:38.017434+0000","last_clean":"2023-10-09T11:41:38.017434+0000","last_became_active":"2023-10-09T11:41:38.016881+0000","last_became_peered":"2023-10-09T11:41:38.016881+0000","last_unstale":"2023-10-09T11:41:38.017434+0000","last_undegraded":"2023-10-09T11:41:38.017434+0000","last_fullsized":"2023-10-09T11:41:38.017434+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019595+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:19.260253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020930+0000","last_change":"2023-10-09T11:41:38.020930+0000","last_active":"2023-10-09T11:41:38.020930+0000","last_peered":"2023-10-09T11:41:38.020930+0000","last_clean":"2023-10-09T11:41:38.020930+0000","last_became_active":"2023-10-09T11:41:38.020688+0000","last_became_peered":"2023-10-09T11:41:38.020688+0000","last_unstale":"2023-10-09T11:41:38.020930+0000","last_undegraded":"2023-10-09T11:41:38.020930+0000","last_fullsized":"2023-10-09T11:41:38.020930+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:36.669315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014019+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.013821+0000","last_change":"2023-10-09T11:41:38.013821+0000","last_active":"2023-10-09T11:41:38.013821+0000","last_peered":"2023-10-09T11:41:38.013821+0000","last_clean":"2023-10-09T11:41:38.013821+0000","last_became_active":"2023-10-09T11:41:38.013452+0000","last_became_peered":"2023-10-09T11:41:38.013452+0000","last_unstale":"2023-10-09T11:41:38.013821+0000","last_undegraded":"2023-10-09T11:41:38.013821+0000","last_fullsized":"2023-10-09T11:41:38.013821+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011165+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015401+0000","last_change":"2023-10-09T11:41:38.015401+0000","last_active":"2023-10-09T11:41:38.015401+0000","last_peered":"2023-10-09T11:41:38.015401+0000","last_clean":"2023-10-09T11:41:38.015401+0000","last_became_active":"2023-10-09T11:41:38.015189+0000","last_became_peered":"2023-10-09T11:41:38.015189+0000","last_unstale":"2023-10-09T11:41:38.015401+0000","last_undegraded":"2023-10-09T11:41:38.015401+0000","last_fullsized":"2023-10-09T11:41:38.015401+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018343+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.019813+0000","last_change":"2023-10-09T11:41:38.019813+0000","last_active":"2023-10-09T11:41:38.019813+0000","last_peered":"2023-10-09T11:41:38.019813+0000","last_clean":"2023-10-09T11:41:38.019813+0000","last_became_active":"2023-10-09T11:41:38.019579+0000","last_became_peered":"2023-10-09T11:41:38.019579+0000","last_unstale":"2023-10-09T11:41:38.019813+0000","last_undegraded":"2023-10-09T11:41:38.019813+0000","last_fullsized":"2023-10-09T11:41:38.019813+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019863+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:43:23.657794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027229+0000","last_change":"2023-10-09T11:41:38.027229+0000","last_active":"2023-10-09T11:41:38.027229+0000","last_peered":"2023-10-09T11:41:38.027229+0000","last_clean":"2023-10-09T11:41:38.027229+0000","last_became_active":"2023-10-09T11:41:38.026311+0000","last_became_peered":"2023-10-09T11:41:38.026311+0000","last_unstale":"2023-10-09T11:41:38.027229+0000","last_undegraded":"2023-10-09T11:41:38.027229+0000","last_fullsized":"2023-10-09T11:41:38.027229+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018660+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:48:43.382274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.015308+0000","last_change":"2023-10-09T11:41:38.015308+0000","last_active":"2023-10-09T11:41:38.015308+0000","last_peered":"2023-10-09T11:41:38.015308+0000","last_clean":"2023-10-09T11:41:38.015308+0000","last_became_active":"2023-10-09T11:41:38.015070+0000","last_became_peered":"2023-10-09T11:41:38.015070+0000","last_unstale":"2023-10-09T11:41:38.015308+0000","last_undegraded":"2023-10-09T11:41:38.015308+0000","last_fullsized":"2023-10-09T11:41:38.015308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.018718+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:57:41.717636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014367+0000","last_change":"2023-10-09T11:41:38.014367+0000","last_active":"2023-10-09T11:41:38.014367+0000","last_peered":"2023-10-09T11:41:38.014367+0000","last_clean":"2023-10-09T11:41:38.014367+0000","last_became_active":"2023-10-09T11:41:38.014122+0000","last_became_peered":"2023-10-09T11:41:38.014122+0000","last_unstale":"2023-10-09T11:41:38.014367+0000","last_undegraded":"2023-10-09T11:41:38.014367+0000","last_fullsized":"2023-10-09T11:41:38.014367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013646+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.026542+0000","last_change":"2023-10-09T11:41:38.026542+0000","last_active":"2023-10-09T11:41:38.026542+0000","last_peered":"2023-10-09T11:41:38.026542+0000","last_clean":"2023-10-09T11:41:38.026542+0000","last_became_active":"2023-10-09T11:41:38.026285+0000","last_became_peered":"2023-10-09T11:41:38.026285+0000","last_unstale":"2023-10-09T11:41:38.026542+0000","last_undegraded":"2023-10-09T11:41:38.026542+0000","last_fullsized":"2023-10-09T11:41:38.026542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.020537+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.014875+0000","last_change":"2023-10-09T11:41:38.014875+0000","last_active":"2023-10-09T11:41:38.014875+0000","last_peered":"2023-10-09T11:41:38.014875+0000","last_clean":"2023-10-09T11:41:38.014875+0000","last_became_active":"2023-10-09T11:41:38.014371+0000","last_became_peered":"2023-10-09T11:41:38.014371+0000","last_unstale":"2023-10-09T11:41:38.014875+0000","last_undegraded":"2023-10-09T11:41:38.014875+0000","last_fullsized":"2023-10-09T11:41:38.014875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.014398+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:13.130473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027494+0000","last_change":"2023-10-09T11:41:38.027494+0000","last_active":"2023-10-09T11:41:38.027494+0000","last_peered":"2023-10-09T11:41:38.027494+0000","last_clean":"2023-10-09T11:41:38.027494+0000","last_became_active":"2023-10-09T11:41:38.026728+0000","last_became_peered":"2023-10-09T11:41:38.026728+0000","last_unstale":"2023-10-09T11:41:38.027494+0000","last_undegraded":"2023-10-09T11:41:38.027494+0000","last_fullsized":"2023-10-09T11:41:38.027494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013676+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:30:09.419461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.023342+0000","last_change":"2023-10-09T11:41:38.023342+0000","last_active":"2023-10-09T11:41:38.023342+0000","last_peered":"2023-10-09T11:41:38.023342+0000","last_clean":"2023-10-09T11:41:38.023342+0000","last_became_active":"2023-10-09T11:41:38.020743+0000","last_became_peered":"2023-10-09T11:41:38.020743+0000","last_unstale":"2023-10-09T11:41:38.023342+0000","last_undegraded":"2023-10-09T11:41:38.023342+0000","last_fullsized":"2023-10-09T11:41:38.023342+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.013189+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.020414+0000","last_change":"2023-10-09T11:41:38.020414+0000","last_active":"2023-10-09T11:41:38.020414+0000","last_peered":"2023-10-09T11:41:38.020414+0000","last_clean":"2023-10-09T11:41:38.020414+0000","last_became_active":"2023-10-09T11:41:38.020197+0000","last_became_peered":"2023-10-09T11:41:38.020197+0000","last_unstale":"2023-10-09T11:41:38.020414+0000","last_undegraded":"2023-10-09T11:41:38.020414+0000","last_fullsized":"2023-10-09T11:41:38.020414+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:07.301979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019167+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:41:08.663307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018380+0000","last_change":"2023-10-09T11:41:38.018380+0000","last_active":"2023-10-09T11:41:38.018380+0000","last_peered":"2023-10-09T11:41:38.018380+0000","last_clean":"2023-10-09T11:41:38.018380+0000","last_became_active":"2023-10-09T11:41:38.018141+0000","last_became_peered":"2023-10-09T11:41:38.018141+0000","last_unstale":"2023-10-09T11:41:38.018380+0000","last_undegraded":"2023-10-09T11:41:38.018380+0000","last_fullsized":"2023-10-09T11:41:38.018380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:05.219675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.011267+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018063+0000","last_change":"2023-10-09T11:41:38.018063+0000","last_active":"2023-10-09T11:41:38.018063+0000","last_peered":"2023-10-09T11:41:38.018063+0000","last_clean":"2023-10-09T11:41:38.018063+0000","last_became_active":"2023-10-09T11:41:38.017768+0000","last_became_peered":"2023-10-09T11:41:38.017768+0000","last_unstale":"2023-10-09T11:41:38.018063+0000","last_undegraded":"2023-10-09T11:41:38.018063+0000","last_fullsized":"2023-10-09T11:41:38.018063+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.019351+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:28.948064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.018141+0000","last_change":"2023-10-09T11:41:38.018141+0000","last_active":"2023-10-09T11:41:38.018141+0000","last_peered":"2023-10-09T11:41:38.018141+0000","last_clean":"2023-10-09T11:41:38.018141+0000","last_became_active":"2023-10-09T11:41:38.017497+0000","last_became_peered":"2023-10-09T11:41:38.017497+0000","last_unstale":"2023-10-09T11:41:38.018141+0000","last_undegraded":"2023-10-09T11:41:38.018141+0000","last_fullsized":"2023-10-09T11:41:38.018141+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:29.649576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.012936+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.027098+0000","last_change":"2023-10-09T11:41:38.027098+0000","last_active":"2023-10-09T11:41:38.027098+0000","last_peered":"2023-10-09T11:41:38.027098+0000","last_clean":"2023-10-09T11:41:38.027098+0000","last_became_active":"2023-10-09T11:41:38.025975+0000","last_became_peered":"2023-10-09T11:41:38.025975+0000","last_unstale":"2023-10-09T11:41:38.027098+0000","last_undegraded":"2023-10-09T11:41:38.027098+0000","last_fullsized":"2023-10-09T11:41:38.027098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:06.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:41:38.006644+0000","last_change":"2023-10-09T11:41:38.025311+0000","last_active":"2023-10-09T11:41:38.006644+0000","last_peered":"2023-10-09T11:41:38.006644+0000","last_clean":"2023-10-09T11:41:38.006644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:41:38.006644+0000","last_undegraded":"2023-10-09T11:41:38.006644+0000","last_fullsized":"2023-10-09T11:41:38.006644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:41.445246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-09T11:41:38.022601+0000","last_change":"2023-10-09T11:41:38.022601+0000","last_active":"2023-10-09T11:41:38.022601+0000","last_peered":"2023-10-09T11:41:38.022601+0000","last_clean":"2023-10-09T11:41:38.022601+0000","last_became_active":"2023-10-09T11:41:38.022412+0000","last_became_peered":"2023-10-09T11:41:38.022412+0000","last_unstale":"2023-10-09T11:41:38.022601+0000","last_undegraded":"2023-10-09T11:41:38.022601+0000","last_fullsized":"2023-10-09T11:41:38.022601+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":241,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T11:41:37.011329+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:41:37.011329+0000","last_peered":"2023-10-09T11:41:37.011329+0000","last_clean":"2023-10-09T11:41:37.011329+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:41:37.011329+0000","last_undegraded":"2023-10-09T11:41:37.011329+0000","last_fullsized":"2023-10-09T11:41:37.011329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1171,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194141,"statfs":{"total":200000000,"available":198800618,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.878,"15min":0.878},"last":0.751}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65800000000000003,"5min":1.048,"15min":1.048},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":1.079,"15min":1.079},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73399999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76600000000000001,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57999999999999996,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.298,"15min":5.298},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.67400000000000004},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":1.617,"15min":1.617},"last":0.58999999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.69699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":5.46,"15min":5.46},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.873,"15min":0.873},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36199999999999999,"15min":0.39900000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.623,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39400000000000002,"15min":0.442},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":2.004,"15min":2.004},"last":0.27300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.308}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45000000000000001,"15min":0.48199999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":1.909,"15min":1.909},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.432,"15min":0.46500000000000002},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.625},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83799999999999997,"5min":1.869,"15min":1.869},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.952,"15min":1.952},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":1.782,"15min":1.782},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.819,"15min":1.819},"last":0.70199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1170,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194142,"statfs":{"total":200000000,"available":198801629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.45600000000000002,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.379},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.22,"15min":0.22},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.26800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4289999999999998,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.57299999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2999999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.66000000000000003,"15min":0.70399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.379,"5min":3.976,"15min":3.976},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71399999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3410000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55500000000000005,"5min":0.622,"15min":0.622},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.379,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"min":{"1min":0.29699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61599999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.82399999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":11.055,"15min":11.055},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.376},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.39700000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.55600000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63800000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56899999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68300000000000005,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1279999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35499999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.64800000000000002,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61199999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.38}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":1.034,"15min":1.034},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":1.335,"15min":1.335},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67800000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":1.405,"15min":1.405},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81000000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384723,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.75900000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.80900000000000005},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.70399999999999996},"min":{"1min":0.44400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":5.274,"15min":5.274},"last":0.45900000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.80800000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.65300000000000002,"15min":0.82699999999999996},"min":{"1min":0.45600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.71699999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.55200000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.34499999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.375},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194717,"statfs":{"total":200000000,"available":199390986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79200000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53000000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44900000000000001,"15min":0.47699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.437,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.58099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.60199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.69099999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T11:41:43.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014645+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:47:29.759587+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.025689+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013958+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:16:09.873464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.020194+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014800+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018726+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017844+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021674+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-09T11:41:43.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.012457+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014440+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019545+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011734+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021656+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-09T11:41:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.024462+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:29:05.789587+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021461+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:42:59.739686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019151+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.022478+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-09T11:41:43.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019265+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.020656+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:49:05.145751+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011918+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019748+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:38:55.127701+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-09T11:41:43.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.022129+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.020941+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017891+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014067+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021425+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018194+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013357+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021185+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-09T11:41:43.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.026213+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:09:12.456262+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018909+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014861+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:32:04.071873+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.020279+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:32:39.268358+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017954+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014202+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:50:12.638530+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011294+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:39.984258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011537+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017423+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-09T11:41:43.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018558+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011165+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.021750+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.012069+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:22:41.261763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013579+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-09T11:41:43.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017747+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.017560+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014408+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:15:40.530128+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011430+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:41:16.048203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019595+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:54:19.260253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014019+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:03:17.365153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011165+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:53:30.656106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018343+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019863+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:43:23.657794+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018660+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:48:43.382274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.018718+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T14:57:41.717636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013646+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:21:12.005506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.020537+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.014398+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:46:13.130473+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-09T11:41:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013676+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:30:09.419461+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.013189+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019167+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T13:41:08.663307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.011267+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:57:12.336324+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.019351+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:27:28.948064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-09T11:41:43.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.012936+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:47:06.226206+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T11:41:43.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-09T11:41:43.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T11:41:38.006644+0000', 'last_change': '2023-10-09T11:41:38.025311+0000', 'last_active': '2023-10-09T11:41:38.006644+0000', 'last_peered': '2023-10-09T11:41:38.006644+0000', 'last_clean': '2023-10-09T11:41:38.006644+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T11:41:38.006644+0000', 'last_undegraded': '2023-10-09T11:41:38.006644+0000', 'last_fullsized': '2023-10-09T11:41:38.006644+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'last_clean_scrub_stamp': '2023-10-09T11:41:38.006644+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:03:41.445246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T11:41:43.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T11:41:44.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.054+0000 7f076e2a0700 1 Processor -- start 2023-10-09T11:41:44.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.054+0000 7f076e2a0700 1 -- start start 2023-10-09T11:41:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076e2a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0768157bb0 0x7f076815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076e2a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680cfdd0 con 0x7f076806d240 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076e2a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680d00b0 con 0x7f07681577e0 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076e2a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680d0390 con 0x7f0768157bb0 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f07677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0768157bb0 0x7f076815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076c83d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f076806d240 0x7f076806d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49808/0 (socket says 172.21.15.6:49808) 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f076c83d700 1 -- 172.21.15.6:0/1557846642 learned_addr learned my addr 172.21.15.6:0/1557846642 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f07677fe700 1 -- 172.21.15.6:0/1557846642 >> v1:172.21.15.118:6789/0 conn(0x7f07681577e0 legacy=0x7f07680cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f0766ffd700 1 -- 172.21.15.6:0/1557846642 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444029574 0 0) 0x7f07680d00b0 con 0x7f07681577e0 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f07677fe700 1 -- 172.21.15.6:0/1557846642 >> v1:172.21.15.6:6789/0 conn(0x7f076806d240 legacy=0x7f076806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f07677fe700 1 -- 172.21.15.6:0/1557846642 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680d0670 con 0x7f0768157bb0 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f07677fe700 1 --2- 172.21.15.6:0/1557846642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768157bb0 0x7f076815b070 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f07580098e0 tx=0x7f07580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbb54744a5e76b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f0766ffd700 1 -- 172.21.15.6:0/1557846642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758009e80 con 0x7f0768157bb0 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f0766ffd700 1 -- 172.21.15.6:0/1557846642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075800b760 con 0x7f0768157bb0 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.055+0000 7f0766ffd700 1 -- 172.21.15.6:0/1557846642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800bae0 con 0x7f0768157bb0 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 -- 172.21.15.6:0/1557846642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768157bb0 msgr2=0x7f076815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 --2- 172.21.15.6:0/1557846642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768157bb0 0x7f076815b070 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f07580098e0 tx=0x7f07580091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 -- 172.21.15.6:0/1557846642 shutdown_connections 2023-10-09T11:41:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 --2- 172.21.15.6:0/1557846642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768157bb0 0x7f076815b070 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 -- 172.21.15.6:0/1557846642 >> 172.21.15.6:0/1557846642 conn(0x7f076806bb90 msgr2=0x7f076806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 -- 172.21.15.6:0/1557846642 shutdown_connections 2023-10-09T11:41:44.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.056+0000 7f076e2a0700 1 -- 172.21.15.6:0/1557846642 wait complete. 2023-10-09T11:41:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.057+0000 7f076e2a0700 1 Processor -- start 2023-10-09T11:41:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.057+0000 7f076e2a0700 1 -- start start 2023-10-09T11:41:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07681577e0 0x7f07680abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 0x7f076815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076815ee10 con 0x7f076806d240 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076816a8b0 con 0x7f0768157bb0 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076e2a0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076815f010 con 0x7f07681577e0 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32814/0 (socket says 172.21.15.6:32814) 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 -- 172.21.15.6:0/2797757516 learned_addr learned my addr 172.21.15.6:0/2797757516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076c83d700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 0x7f076815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f07677fe700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07681577e0 0x7f07680abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 -- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07681577e0 msgr2=0x7f07680abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07681577e0 0x7f07680abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 -- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 msgr2=0x7f076815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 0x7f076815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f0767fff700 1 -- 172.21.15.6:0/2797757516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009420 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.058+0000 7f076c83d700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 0x7f076815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f0767fff700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c7e0 tx=0x7f075c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c012700 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c012880 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076815f2f0 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c012c40 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.059+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076815f8b0 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.060+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768067850 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.060+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f075c01b400 con 0x7f076806d240 2023-10-09T11:41:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.061+0000 7f074ffff700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.061+0000 7f07677fe700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.061+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f075c084130 con 0x7f076806d240 2023-10-09T11:41:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.061+0000 7f07677fe700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07580030c0 tx=0x7f0758016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.065+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f075c0513a0 con 0x7f076806d240 2023-10-09T11:41:44.338 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-09T11:41:44.336+0000 7f6e1a9c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:41:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.338+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f076804bb80 con 0x7f076806d240 2023-10-09T11:41:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.338+0000 7f074ffff700 1 -- 172.21.15.6:0/2797757516 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1449 (secure 0 0 0) 0x7f075c0549c0 con 0x7f076806d240 2023-10-09T11:41:44.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:44.340 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":358,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":115,"num_osds":8,"num_up_osds":8,"osd_up_since":1696851351,"num_in_osds":8,"osd_in_since":1696851348,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":6070626,"bytes_avail":1593929374,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":60,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6714}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-09T11:41:28.216750+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 msgr2=0x7f07540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07580030c0 tx=0x7f0758016000 comp rx=0 tx=0).stop 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 msgr2=0x7f07681565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f075c00c7e0 tx=0x7f075c007df0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 shutdown_connections 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0754066f30 0x7f07540693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0768157bb0 0x7f076815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076806d240 0x7f07681565b0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 --2- 172.21.15.6:0/2797757516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f07681577e0 0x7f07680abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 >> 172.21.15.6:0/2797757516 conn(0x7f076806bb90 msgr2=0x7f076806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 shutdown_connections 2023-10-09T11:41:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.340+0000 7f076e2a0700 1 -- 172.21.15.6:0/2797757516 wait complete. 2023-10-09T11:41:44.354 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T11:41:44.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.471+0000 7feaac224700 1 Processor -- start 2023-10-09T11:41:44.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.471+0000 7feaac224700 1 -- start start 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaac224700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feaa4157ca0 0x7feaa40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaac224700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 0x7feaa406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaac224700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40d07c0 con 0x7feaa41578d0 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaac224700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa406da50 con 0x7feaa4157ca0 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaac224700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40cfbb0 con 0x7feaa406d120 2023-10-09T11:41:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaa97bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feaa4157ca0 0x7feaa40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaa97bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feaa4157ca0 0x7feaa40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32818/0 (socket says 172.21.15.6:32818) 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaa97bf700 1 -- 172.21.15.6:0/2111927924 learned_addr learned my addr 172.21.15.6:0/2111927924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.472+0000 7feaaa7c1700 1 --2- 172.21.15.6:0/2111927924 >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 0x7feaa406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa97bf700 1 -- 172.21.15.6:0/2111927924 >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 msgr2=0x7feaa406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa97bf700 1 --2- 172.21.15.6:0/2111927924 >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 0x7feaa406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa97bf700 1 -- 172.21.15.6:0/2111927924 >> v1:172.21.15.118:6789/0 conn(0x7feaa41578d0 legacy=0x7feaa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa97bf700 1 -- 172.21.15.6:0/2111927924 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40cfe90 con 0x7feaa4157ca0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaaa7c1700 1 --2- 172.21.15.6:0/2111927924 >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 0x7feaa406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa97bf700 1 --2- 172.21.15.6:0/2111927924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa4157ca0 0x7feaa40cf4f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feaa4068300 tx=0x7fea98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8369ee4d31925a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa8fbe700 1 -- 172.21.15.6:0/2111927924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800b860 con 0x7feaa4157ca0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa8fbe700 1 -- 172.21.15.6:0/2111927924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9800b9c0 con 0x7feaa4157ca0 2023-10-09T11:41:44.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaa8fbe700 1 -- 172.21.15.6:0/2111927924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800bd60 con 0x7feaa4157ca0 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 -- 172.21.15.6:0/2111927924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa4157ca0 msgr2=0x7feaa40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 --2- 172.21.15.6:0/2111927924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa4157ca0 0x7feaa40cf4f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feaa4068300 tx=0x7fea98009250 comp rx=0 tx=0).stop 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 -- 172.21.15.6:0/2111927924 shutdown_connections 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 --2- 172.21.15.6:0/2111927924 >> v2:172.21.15.118:3300/0 conn(0x7feaa406d120 0x7feaa406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 --2- 172.21.15.6:0/2111927924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa4157ca0 0x7feaa40cf4f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.473+0000 7feaac224700 1 -- 172.21.15.6:0/2111927924 >> 172.21.15.6:0/2111927924 conn(0x7feaa406bb90 msgr2=0x7feaa406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.474+0000 7feaac224700 1 -- 172.21.15.6:0/2111927924 shutdown_connections 2023-10-09T11:41:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.474+0000 7feaac224700 1 -- 172.21.15.6:0/2111927924 wait complete. 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 Processor -- start 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 -- start start 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 0x7feaa40acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaa4157ca0 0x7feaa40b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40b21d0 con 0x7feaa41578d0 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa416d5e0 con 0x7feaa4157ca0 2023-10-09T11:41:44.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaac224700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa416dba0 con 0x7feaa406d120 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaa97bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.475+0000 7feaa97bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32830/0 (socket says 172.21.15.6:32830) 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 -- 172.21.15.6:0/3473690521 learned_addr learned my addr 172.21.15.6:0/3473690521 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaaa7c1700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaa4157ca0 0x7feaa40b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa9fc0700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 0x7feaa40acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 -- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 msgr2=0x7feaa40acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 0x7feaa40acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 -- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaa4157ca0 msgr2=0x7feaa40b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaa4157ca0 0x7feaa40b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 -- 172.21.15.6:0/3473690521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980094f0 con 0x7feaa41578d0 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa9fc0700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 0x7feaa40acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:44.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa97bf700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fea980090b0 tx=0x7fea98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98026480 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9801f070 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40b2400 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98026850 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.476+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa416d830 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.477+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa4067ac0 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.478+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea9801a430 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.478+0000 7feaa1ffb700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.478+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea98021070 con 0x7feaa41578d0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.478+0000 7feaa9fc0700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:44.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.479+0000 7feaa9fc0700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:44.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.483+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea98053570 con 0x7feaa41578d0 2023-10-09T11:41:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.670+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feaa416dce0 con 0x7fea90066f30 2023-10-09T11:41:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.678+0000 7feaa1ffb700 1 -- 172.21.15.6:0/3473690521 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285240 (secure 0 0 0) 0x7feaa416dce0 con 0x7fea90066f30 2023-10-09T11:41:44.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 msgr2=0x7fea900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c007e70 comp rx=0 tx=0).stop 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 msgr2=0x7feaa416e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fea980090b0 tx=0x7fea98017000 comp rx=0 tx=0).stop 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 shutdown_connections 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaa4157ca0 0x7feaa40b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feaa406d120 0x7feaa40acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 --2- 172.21.15.6:0/3473690521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaa41578d0 0x7feaa416e030 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 >> 172.21.15.6:0/3473690521 conn(0x7feaa406bb90 msgr2=0x7feaa4068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 shutdown_connections 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:44.681+0000 7feaac224700 1 -- 172.21.15.6:0/3473690521 wait complete. 2023-10-09T11:41:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:41:44.694 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-09T11:41:44.219398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556434,"statfs":{"total":1600000000,"available":1593789039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.208065"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.040398+0000","last_change":"2023-10-09T11:41:39.039282+0000","last_active":"2023-10-09T11:41:39.040398+0000","last_peered":"2023-10-09T11:41:39.040398+0000","last_clean":"2023-10-09T11:41:39.040398+0000","last_became_active":"2023-10-09T11:41:39.039051+0000","last_became_peered":"2023-10-09T11:41:39.039051+0000","last_unstale":"2023-10-09T11:41:39.040398+0000","last_undegraded":"2023-10-09T11:41:39.040398+0000","last_fullsized":"2023-10-09T11:41:39.040398+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:15.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032890+0000","last_change":"2023-10-09T11:41:39.032785+0000","last_active":"2023-10-09T11:41:39.032890+0000","last_peered":"2023-10-09T11:41:39.032890+0000","last_clean":"2023-10-09T11:41:39.032890+0000","last_became_active":"2023-10-09T11:41:39.031738+0000","last_became_peered":"2023-10-09T11:41:39.031738+0000","last_unstale":"2023-10-09T11:41:39.032890+0000","last_undegraded":"2023-10-09T11:41:39.032890+0000","last_fullsized":"2023-10-09T11:41:39.032890+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035802+0000","last_change":"2023-10-09T11:41:39.035275+0000","last_active":"2023-10-09T11:41:39.035802+0000","last_peered":"2023-10-09T11:41:39.035802+0000","last_clean":"2023-10-09T11:41:39.035802+0000","last_became_active":"2023-10-09T11:41:39.035030+0000","last_became_peered":"2023-10-09T11:41:39.035030+0000","last_unstale":"2023-10-09T11:41:39.035802+0000","last_undegraded":"2023-10-09T11:41:39.035802+0000","last_fullsized":"2023-10-09T11:41:39.035802+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:21.783738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.042958+0000","last_change":"2023-10-09T11:41:39.042893+0000","last_active":"2023-10-09T11:41:39.042958+0000","last_peered":"2023-10-09T11:41:39.042958+0000","last_clean":"2023-10-09T11:41:39.042958+0000","last_became_active":"2023-10-09T11:41:39.042666+0000","last_became_peered":"2023-10-09T11:41:39.042666+0000","last_unstale":"2023-10-09T11:41:39.042958+0000","last_undegraded":"2023-10-09T11:41:39.042958+0000","last_fullsized":"2023-10-09T11:41:39.042958+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036373+0000","last_change":"2023-10-09T11:41:39.033970+0000","last_active":"2023-10-09T11:41:39.036373+0000","last_peered":"2023-10-09T11:41:39.036373+0000","last_clean":"2023-10-09T11:41:39.036373+0000","last_became_active":"2023-10-09T11:41:39.033727+0000","last_became_peered":"2023-10-09T11:41:39.033727+0000","last_unstale":"2023-10-09T11:41:39.036373+0000","last_undegraded":"2023-10-09T11:41:39.036373+0000","last_fullsized":"2023-10-09T11:41:39.036373+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035448+0000","last_change":"2023-10-09T11:41:39.032502+0000","last_active":"2023-10-09T11:41:39.035448+0000","last_peered":"2023-10-09T11:41:39.035448+0000","last_clean":"2023-10-09T11:41:39.035448+0000","last_became_active":"2023-10-09T11:41:39.032276+0000","last_became_peered":"2023-10-09T11:41:39.032276+0000","last_unstale":"2023-10-09T11:41:39.035448+0000","last_undegraded":"2023-10-09T11:41:39.035448+0000","last_fullsized":"2023-10-09T11:41:39.035448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031593+0000","last_change":"2023-10-09T11:41:39.031544+0000","last_active":"2023-10-09T11:41:39.031593+0000","last_peered":"2023-10-09T11:41:39.031593+0000","last_clean":"2023-10-09T11:41:39.031593+0000","last_became_active":"2023-10-09T11:41:39.031415+0000","last_became_peered":"2023-10-09T11:41:39.031415+0000","last_unstale":"2023-10-09T11:41:39.031593+0000","last_undegraded":"2023-10-09T11:41:39.031593+0000","last_fullsized":"2023-10-09T11:41:39.031593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034348+0000","last_change":"2023-10-09T11:41:39.034292+0000","last_active":"2023-10-09T11:41:39.034348+0000","last_peered":"2023-10-09T11:41:39.034348+0000","last_clean":"2023-10-09T11:41:39.034348+0000","last_became_active":"2023-10-09T11:41:39.033979+0000","last_became_peered":"2023-10-09T11:41:39.033979+0000","last_unstale":"2023-10-09T11:41:39.034348+0000","last_undegraded":"2023-10-09T11:41:39.034348+0000","last_fullsized":"2023-10-09T11:41:39.034348+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033557+0000","last_change":"2023-10-09T11:41:39.033436+0000","last_active":"2023-10-09T11:41:39.033557+0000","last_peered":"2023-10-09T11:41:39.033557+0000","last_clean":"2023-10-09T11:41:39.033557+0000","last_became_active":"2023-10-09T11:41:39.033172+0000","last_became_peered":"2023-10-09T11:41:39.033172+0000","last_unstale":"2023-10-09T11:41:39.033557+0000","last_undegraded":"2023-10-09T11:41:39.033557+0000","last_fullsized":"2023-10-09T11:41:39.033557+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037862+0000","last_change":"2023-10-09T11:41:39.037795+0000","last_active":"2023-10-09T11:41:39.037862+0000","last_peered":"2023-10-09T11:41:39.037862+0000","last_clean":"2023-10-09T11:41:39.037862+0000","last_became_active":"2023-10-09T11:41:39.037448+0000","last_became_peered":"2023-10-09T11:41:39.037448+0000","last_unstale":"2023-10-09T11:41:39.037862+0000","last_undegraded":"2023-10-09T11:41:39.037862+0000","last_fullsized":"2023-10-09T11:41:39.037862+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036612+0000","last_change":"2023-10-09T11:41:39.036286+0000","last_active":"2023-10-09T11:41:39.036612+0000","last_peered":"2023-10-09T11:41:39.036612+0000","last_clean":"2023-10-09T11:41:39.036612+0000","last_became_active":"2023-10-09T11:41:39.035765+0000","last_became_peered":"2023-10-09T11:41:39.035765+0000","last_unstale":"2023-10-09T11:41:39.036612+0000","last_undegraded":"2023-10-09T11:41:39.036612+0000","last_fullsized":"2023-10-09T11:41:39.036612+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:09.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034278+0000","last_change":"2023-10-09T11:41:39.034034+0000","last_active":"2023-10-09T11:41:39.034278+0000","last_peered":"2023-10-09T11:41:39.034278+0000","last_clean":"2023-10-09T11:41:39.034278+0000","last_became_active":"2023-10-09T11:41:39.033790+0000","last_became_peered":"2023-10-09T11:41:39.033790+0000","last_unstale":"2023-10-09T11:41:39.034278+0000","last_undegraded":"2023-10-09T11:41:39.034278+0000","last_fullsized":"2023-10-09T11:41:39.034278+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031029+0000","last_change":"2023-10-09T11:41:39.030980+0000","last_active":"2023-10-09T11:41:39.031029+0000","last_peered":"2023-10-09T11:41:39.031029+0000","last_clean":"2023-10-09T11:41:39.031029+0000","last_became_active":"2023-10-09T11:41:39.030770+0000","last_became_peered":"2023-10-09T11:41:39.030770+0000","last_unstale":"2023-10-09T11:41:39.031029+0000","last_undegraded":"2023-10-09T11:41:39.031029+0000","last_fullsized":"2023-10-09T11:41:39.031029+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041452+0000","last_change":"2023-10-09T11:41:39.040858+0000","last_active":"2023-10-09T11:41:39.041452+0000","last_peered":"2023-10-09T11:41:39.041452+0000","last_clean":"2023-10-09T11:41:39.041452+0000","last_became_active":"2023-10-09T11:41:39.040490+0000","last_became_peered":"2023-10-09T11:41:39.040490+0000","last_unstale":"2023-10-09T11:41:39.041452+0000","last_undegraded":"2023-10-09T11:41:39.041452+0000","last_fullsized":"2023-10-09T11:41:39.041452+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:07.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041407+0000","last_change":"2023-10-09T11:41:39.041343+0000","last_active":"2023-10-09T11:41:39.041407+0000","last_peered":"2023-10-09T11:41:39.041407+0000","last_clean":"2023-10-09T11:41:39.041407+0000","last_became_active":"2023-10-09T11:41:39.038609+0000","last_became_peered":"2023-10-09T11:41:39.038609+0000","last_unstale":"2023-10-09T11:41:39.041407+0000","last_undegraded":"2023-10-09T11:41:39.041407+0000","last_fullsized":"2023-10-09T11:41:39.041407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035466+0000","last_change":"2023-10-09T11:41:39.035355+0000","last_active":"2023-10-09T11:41:39.035466+0000","last_peered":"2023-10-09T11:41:39.035466+0000","last_clean":"2023-10-09T11:41:39.035466+0000","last_became_active":"2023-10-09T11:41:39.035111+0000","last_became_peered":"2023-10-09T11:41:39.035111+0000","last_unstale":"2023-10-09T11:41:39.035466+0000","last_undegraded":"2023-10-09T11:41:39.035466+0000","last_fullsized":"2023-10-09T11:41:39.035466+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:42.723424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032856+0000","last_change":"2023-10-09T11:41:39.032496+0000","last_active":"2023-10-09T11:41:39.032856+0000","last_peered":"2023-10-09T11:41:39.032856+0000","last_clean":"2023-10-09T11:41:39.032856+0000","last_became_active":"2023-10-09T11:41:39.031127+0000","last_became_peered":"2023-10-09T11:41:39.031127+0000","last_unstale":"2023-10-09T11:41:39.032856+0000","last_undegraded":"2023-10-09T11:41:39.032856+0000","last_fullsized":"2023-10-09T11:41:39.032856+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041677+0000","last_change":"2023-10-09T11:41:39.038656+0000","last_active":"2023-10-09T11:41:39.041677+0000","last_peered":"2023-10-09T11:41:39.041677+0000","last_clean":"2023-10-09T11:41:39.041677+0000","last_became_active":"2023-10-09T11:41:39.038429+0000","last_became_peered":"2023-10-09T11:41:39.038429+0000","last_unstale":"2023-10-09T11:41:39.041677+0000","last_undegraded":"2023-10-09T11:41:39.041677+0000","last_fullsized":"2023-10-09T11:41:39.041677+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034359+0000","last_change":"2023-10-09T11:41:39.033739+0000","last_active":"2023-10-09T11:41:39.034359+0000","last_peered":"2023-10-09T11:41:39.034359+0000","last_clean":"2023-10-09T11:41:39.034359+0000","last_became_active":"2023-10-09T11:41:39.033473+0000","last_became_peered":"2023-10-09T11:41:39.033473+0000","last_unstale":"2023-10-09T11:41:39.034359+0000","last_undegraded":"2023-10-09T11:41:39.034359+0000","last_fullsized":"2023-10-09T11:41:39.034359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:22.964747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034514+0000","last_change":"2023-10-09T11:41:39.034354+0000","last_active":"2023-10-09T11:41:39.034514+0000","last_peered":"2023-10-09T11:41:39.034514+0000","last_clean":"2023-10-09T11:41:39.034514+0000","last_became_active":"2023-10-09T11:41:39.034108+0000","last_became_peered":"2023-10-09T11:41:39.034108+0000","last_unstale":"2023-10-09T11:41:39.034514+0000","last_undegraded":"2023-10-09T11:41:39.034514+0000","last_fullsized":"2023-10-09T11:41:39.034514+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027584+0000","last_change":"2023-10-09T11:41:39.027516+0000","last_active":"2023-10-09T11:41:39.027584+0000","last_peered":"2023-10-09T11:41:39.027584+0000","last_clean":"2023-10-09T11:41:39.027584+0000","last_became_active":"2023-10-09T11:41:39.027287+0000","last_became_peered":"2023-10-09T11:41:39.027287+0000","last_unstale":"2023-10-09T11:41:39.027584+0000","last_undegraded":"2023-10-09T11:41:39.027584+0000","last_fullsized":"2023-10-09T11:41:39.027584+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:17.070405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032874+0000","last_change":"2023-10-09T11:41:39.032641+0000","last_active":"2023-10-09T11:41:39.032874+0000","last_peered":"2023-10-09T11:41:39.032874+0000","last_clean":"2023-10-09T11:41:39.032874+0000","last_became_active":"2023-10-09T11:41:39.031442+0000","last_became_peered":"2023-10-09T11:41:39.031442+0000","last_unstale":"2023-10-09T11:41:39.032874+0000","last_undegraded":"2023-10-09T11:41:39.032874+0000","last_fullsized":"2023-10-09T11:41:39.032874+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032151+0000","last_change":"2023-10-09T11:41:39.031728+0000","last_active":"2023-10-09T11:41:39.032151+0000","last_peered":"2023-10-09T11:41:39.032151+0000","last_clean":"2023-10-09T11:41:39.032151+0000","last_became_active":"2023-10-09T11:41:39.031293+0000","last_became_peered":"2023-10-09T11:41:39.031293+0000","last_unstale":"2023-10-09T11:41:39.032151+0000","last_undegraded":"2023-10-09T11:41:39.032151+0000","last_fullsized":"2023-10-09T11:41:39.032151+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036656+0000","last_change":"2023-10-09T11:41:39.036552+0000","last_active":"2023-10-09T11:41:39.036656+0000","last_peered":"2023-10-09T11:41:39.036656+0000","last_clean":"2023-10-09T11:41:39.036656+0000","last_became_active":"2023-10-09T11:41:39.036334+0000","last_became_peered":"2023-10-09T11:41:39.036334+0000","last_unstale":"2023-10-09T11:41:39.036656+0000","last_undegraded":"2023-10-09T11:41:39.036656+0000","last_fullsized":"2023-10-09T11:41:39.036656+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:55.628790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036391+0000","last_change":"2023-10-09T11:41:39.034988+0000","last_active":"2023-10-09T11:41:39.036391+0000","last_peered":"2023-10-09T11:41:39.036391+0000","last_clean":"2023-10-09T11:41:39.036391+0000","last_became_active":"2023-10-09T11:41:39.034747+0000","last_became_peered":"2023-10-09T11:41:39.034747+0000","last_unstale":"2023-10-09T11:41:39.036391+0000","last_undegraded":"2023-10-09T11:41:39.036391+0000","last_fullsized":"2023-10-09T11:41:39.036391+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032139+0000","last_change":"2023-10-09T11:41:39.031647+0000","last_active":"2023-10-09T11:41:39.032139+0000","last_peered":"2023-10-09T11:41:39.032139+0000","last_clean":"2023-10-09T11:41:39.032139+0000","last_became_active":"2023-10-09T11:41:39.031403+0000","last_became_peered":"2023-10-09T11:41:39.031403+0000","last_unstale":"2023-10-09T11:41:39.032139+0000","last_undegraded":"2023-10-09T11:41:39.032139+0000","last_fullsized":"2023-10-09T11:41:39.032139+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:09.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033232+0000","last_change":"2023-10-09T11:41:39.033168+0000","last_active":"2023-10-09T11:41:39.033232+0000","last_peered":"2023-10-09T11:41:39.033232+0000","last_clean":"2023-10-09T11:41:39.033232+0000","last_became_active":"2023-10-09T11:41:39.032545+0000","last_became_peered":"2023-10-09T11:41:39.032545+0000","last_unstale":"2023-10-09T11:41:39.033232+0000","last_undegraded":"2023-10-09T11:41:39.033232+0000","last_fullsized":"2023-10-09T11:41:39.033232+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:12.421559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037141+0000","last_change":"2023-10-09T11:41:39.037006+0000","last_active":"2023-10-09T11:41:39.037141+0000","last_peered":"2023-10-09T11:41:39.037141+0000","last_clean":"2023-10-09T11:41:39.037141+0000","last_became_active":"2023-10-09T11:41:39.035064+0000","last_became_peered":"2023-10-09T11:41:39.035064+0000","last_unstale":"2023-10-09T11:41:39.037141+0000","last_undegraded":"2023-10-09T11:41:39.037141+0000","last_fullsized":"2023-10-09T11:41:39.037141+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034326+0000","last_change":"2023-10-09T11:41:39.034152+0000","last_active":"2023-10-09T11:41:39.034326+0000","last_peered":"2023-10-09T11:41:39.034326+0000","last_clean":"2023-10-09T11:41:39.034326+0000","last_became_active":"2023-10-09T11:41:39.033914+0000","last_became_peered":"2023-10-09T11:41:39.033914+0000","last_unstale":"2023-10-09T11:41:39.034326+0000","last_undegraded":"2023-10-09T11:41:39.034326+0000","last_fullsized":"2023-10-09T11:41:39.034326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:12.421559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035710+0000","last_change":"2023-10-09T11:41:39.035610+0000","last_active":"2023-10-09T11:41:39.035710+0000","last_peered":"2023-10-09T11:41:39.035710+0000","last_clean":"2023-10-09T11:41:39.035710+0000","last_became_active":"2023-10-09T11:41:39.035340+0000","last_became_peered":"2023-10-09T11:41:39.035340+0000","last_unstale":"2023-10-09T11:41:39.035710+0000","last_undegraded":"2023-10-09T11:41:39.035710+0000","last_fullsized":"2023-10-09T11:41:39.035710+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:03.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038135+0000","last_change":"2023-10-09T11:41:39.037745+0000","last_active":"2023-10-09T11:41:39.038135+0000","last_peered":"2023-10-09T11:41:39.038135+0000","last_clean":"2023-10-09T11:41:39.038135+0000","last_became_active":"2023-10-09T11:41:39.037519+0000","last_became_peered":"2023-10-09T11:41:39.037519+0000","last_unstale":"2023-10-09T11:41:39.038135+0000","last_undegraded":"2023-10-09T11:41:39.038135+0000","last_fullsized":"2023-10-09T11:41:39.038135+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038803+0000","last_change":"2023-10-09T11:41:39.038656+0000","last_active":"2023-10-09T11:41:39.038803+0000","last_peered":"2023-10-09T11:41:39.038803+0000","last_clean":"2023-10-09T11:41:39.038803+0000","last_became_active":"2023-10-09T11:41:39.038428+0000","last_became_peered":"2023-10-09T11:41:39.038428+0000","last_unstale":"2023-10-09T11:41:39.038803+0000","last_undegraded":"2023-10-09T11:41:39.038803+0000","last_fullsized":"2023-10-09T11:41:39.038803+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:44.397350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030591+0000","last_change":"2023-10-09T11:41:39.029959+0000","last_active":"2023-10-09T11:41:39.030591+0000","last_peered":"2023-10-09T11:41:39.030591+0000","last_clean":"2023-10-09T11:41:39.030591+0000","last_became_active":"2023-10-09T11:41:39.029700+0000","last_became_peered":"2023-10-09T11:41:39.029700+0000","last_unstale":"2023-10-09T11:41:39.030591+0000","last_undegraded":"2023-10-09T11:41:39.030591+0000","last_fullsized":"2023-10-09T11:41:39.030591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:44:16.413851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"114'4","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046542+0000","last_change":"2023-10-09T11:41:38.022285+0000","last_active":"2023-10-09T11:41:39.046542+0000","last_peered":"2023-10-09T11:41:39.046542+0000","last_clean":"2023-10-09T11:41:39.046542+0000","last_became_active":"2023-10-09T11:41:38.021933+0000","last_became_peered":"2023-10-09T11:41:38.021933+0000","last_unstale":"2023-10-09T11:41:39.046542+0000","last_undegraded":"2023-10-09T11:41:39.046542+0000","last_fullsized":"2023-10-09T11:41:39.046542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.329794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033171+0000","last_change":"2023-10-09T11:41:39.033109+0000","last_active":"2023-10-09T11:41:39.033171+0000","last_peered":"2023-10-09T11:41:39.033171+0000","last_clean":"2023-10-09T11:41:39.033171+0000","last_became_active":"2023-10-09T11:41:39.032902+0000","last_became_peered":"2023-10-09T11:41:39.032902+0000","last_unstale":"2023-10-09T11:41:39.033171+0000","last_undegraded":"2023-10-09T11:41:39.033171+0000","last_fullsized":"2023-10-09T11:41:39.033171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046256+0000","last_change":"2023-10-09T11:41:38.021884+0000","last_active":"2023-10-09T11:41:39.046256+0000","last_peered":"2023-10-09T11:41:39.046256+0000","last_clean":"2023-10-09T11:41:39.046256+0000","last_became_active":"2023-10-09T11:41:38.021661+0000","last_became_peered":"2023-10-09T11:41:38.021661+0000","last_unstale":"2023-10-09T11:41:39.046256+0000","last_undegraded":"2023-10-09T11:41:39.046256+0000","last_fullsized":"2023-10-09T11:41:39.046256+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:01.516396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036171+0000","last_change":"2023-10-09T11:41:39.036051+0000","last_active":"2023-10-09T11:41:39.036171+0000","last_peered":"2023-10-09T11:41:39.036171+0000","last_clean":"2023-10-09T11:41:39.036171+0000","last_became_active":"2023-10-09T11:41:39.035387+0000","last_became_peered":"2023-10-09T11:41:39.035387+0000","last_unstale":"2023-10-09T11:41:39.036171+0000","last_undegraded":"2023-10-09T11:41:39.036171+0000","last_fullsized":"2023-10-09T11:41:39.036171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:36:43.193661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047607+0000","last_change":"2023-10-09T11:41:38.027892+0000","last_active":"2023-10-09T11:41:39.047607+0000","last_peered":"2023-10-09T11:41:39.047607+0000","last_clean":"2023-10-09T11:41:39.047607+0000","last_became_active":"2023-10-09T11:41:38.027650+0000","last_became_peered":"2023-10-09T11:41:38.027650+0000","last_unstale":"2023-10-09T11:41:39.047607+0000","last_undegraded":"2023-10-09T11:41:39.047607+0000","last_fullsized":"2023-10-09T11:41:39.047607+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030441+0000","last_change":"2023-10-09T11:41:39.030297+0000","last_active":"2023-10-09T11:41:39.030441+0000","last_peered":"2023-10-09T11:41:39.030441+0000","last_clean":"2023-10-09T11:41:39.030441+0000","last_became_active":"2023-10-09T11:41:39.030030+0000","last_became_peered":"2023-10-09T11:41:39.030030+0000","last_unstale":"2023-10-09T11:41:39.030441+0000","last_undegraded":"2023-10-09T11:41:39.030441+0000","last_fullsized":"2023-10-09T11:41:39.030441+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045188+0000","last_change":"2023-10-09T11:41:38.018919+0000","last_active":"2023-10-09T11:41:39.045188+0000","last_peered":"2023-10-09T11:41:39.045188+0000","last_clean":"2023-10-09T11:41:39.045188+0000","last_became_active":"2023-10-09T11:41:38.018647+0000","last_became_peered":"2023-10-09T11:41:38.018647+0000","last_unstale":"2023-10-09T11:41:39.045188+0000","last_undegraded":"2023-10-09T11:41:39.045188+0000","last_fullsized":"2023-10-09T11:41:39.045188+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:13.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033649+0000","last_change":"2023-10-09T11:41:39.032847+0000","last_active":"2023-10-09T11:41:39.033649+0000","last_peered":"2023-10-09T11:41:39.033649+0000","last_clean":"2023-10-09T11:41:39.033649+0000","last_became_active":"2023-10-09T11:41:39.029574+0000","last_became_peered":"2023-10-09T11:41:39.029574+0000","last_unstale":"2023-10-09T11:41:39.033649+0000","last_undegraded":"2023-10-09T11:41:39.033649+0000","last_fullsized":"2023-10-09T11:41:39.033649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045443+0000","last_change":"2023-10-09T11:41:38.022626+0000","last_active":"2023-10-09T11:41:39.045443+0000","last_peered":"2023-10-09T11:41:39.045443+0000","last_clean":"2023-10-09T11:41:39.045443+0000","last_became_active":"2023-10-09T11:41:38.021978+0000","last_became_peered":"2023-10-09T11:41:38.021978+0000","last_unstale":"2023-10-09T11:41:39.045443+0000","last_undegraded":"2023-10-09T11:41:39.045443+0000","last_fullsized":"2023-10-09T11:41:39.045443+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:14.381028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033360+0000","last_change":"2023-10-09T11:41:39.033289+0000","last_active":"2023-10-09T11:41:39.033360+0000","last_peered":"2023-10-09T11:41:39.033360+0000","last_clean":"2023-10-09T11:41:39.033360+0000","last_became_active":"2023-10-09T11:41:39.032895+0000","last_became_peered":"2023-10-09T11:41:39.032895+0000","last_unstale":"2023-10-09T11:41:39.033360+0000","last_undegraded":"2023-10-09T11:41:39.033360+0000","last_fullsized":"2023-10-09T11:41:39.033360+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046649+0000","last_change":"2023-10-09T11:41:38.027649+0000","last_active":"2023-10-09T11:41:39.046649+0000","last_peered":"2023-10-09T11:41:39.046649+0000","last_clean":"2023-10-09T11:41:39.046649+0000","last_became_active":"2023-10-09T11:41:38.027070+0000","last_became_peered":"2023-10-09T11:41:38.027070+0000","last_unstale":"2023-10-09T11:41:39.046649+0000","last_undegraded":"2023-10-09T11:41:39.046649+0000","last_fullsized":"2023-10-09T11:41:39.046649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041277+0000","last_change":"2023-10-09T11:41:39.041187+0000","last_active":"2023-10-09T11:41:39.041277+0000","last_peered":"2023-10-09T11:41:39.041277+0000","last_clean":"2023-10-09T11:41:39.041277+0000","last_became_active":"2023-10-09T11:41:39.038401+0000","last_became_peered":"2023-10-09T11:41:39.038401+0000","last_unstale":"2023-10-09T11:41:39.041277+0000","last_undegraded":"2023-10-09T11:41:39.041277+0000","last_fullsized":"2023-10-09T11:41:39.041277+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035823+0000","last_change":"2023-10-09T11:41:38.021051+0000","last_active":"2023-10-09T11:41:39.035823+0000","last_peered":"2023-10-09T11:41:39.035823+0000","last_clean":"2023-10-09T11:41:39.035823+0000","last_became_active":"2023-10-09T11:41:38.020811+0000","last_became_peered":"2023-10-09T11:41:38.020811+0000","last_unstale":"2023-10-09T11:41:39.035823+0000","last_undegraded":"2023-10-09T11:41:39.035823+0000","last_fullsized":"2023-10-09T11:41:39.035823+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029530+0000","last_change":"2023-10-09T11:41:39.029466+0000","last_active":"2023-10-09T11:41:39.029530+0000","last_peered":"2023-10-09T11:41:39.029530+0000","last_clean":"2023-10-09T11:41:39.029530+0000","last_became_active":"2023-10-09T11:41:39.029227+0000","last_became_peered":"2023-10-09T11:41:39.029227+0000","last_unstale":"2023-10-09T11:41:39.029530+0000","last_undegraded":"2023-10-09T11:41:39.029530+0000","last_fullsized":"2023-10-09T11:41:39.029530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030226+0000","last_change":"2023-10-09T11:41:38.018205+0000","last_active":"2023-10-09T11:41:39.030226+0000","last_peered":"2023-10-09T11:41:39.030226+0000","last_clean":"2023-10-09T11:41:39.030226+0000","last_became_active":"2023-10-09T11:41:38.016831+0000","last_became_peered":"2023-10-09T11:41:38.016831+0000","last_unstale":"2023-10-09T11:41:39.030226+0000","last_undegraded":"2023-10-09T11:41:39.030226+0000","last_fullsized":"2023-10-09T11:41:39.030226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036757+0000","last_change":"2023-10-09T11:41:39.036690+0000","last_active":"2023-10-09T11:41:39.036757+0000","last_peered":"2023-10-09T11:41:39.036757+0000","last_clean":"2023-10-09T11:41:39.036757+0000","last_became_active":"2023-10-09T11:41:39.036398+0000","last_became_peered":"2023-10-09T11:41:39.036398+0000","last_unstale":"2023-10-09T11:41:39.036757+0000","last_undegraded":"2023-10-09T11:41:39.036757+0000","last_fullsized":"2023-10-09T11:41:39.036757+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030485+0000","last_change":"2023-10-09T11:41:38.015417+0000","last_active":"2023-10-09T11:41:39.030485+0000","last_peered":"2023-10-09T11:41:39.030485+0000","last_clean":"2023-10-09T11:41:39.030485+0000","last_became_active":"2023-10-09T11:41:38.015109+0000","last_became_peered":"2023-10-09T11:41:38.015109+0000","last_unstale":"2023-10-09T11:41:39.030485+0000","last_undegraded":"2023-10-09T11:41:39.030485+0000","last_fullsized":"2023-10-09T11:41:39.030485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:46.822110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029039+0000","last_change":"2023-10-09T11:41:39.028966+0000","last_active":"2023-10-09T11:41:39.029039+0000","last_peered":"2023-10-09T11:41:39.029039+0000","last_clean":"2023-10-09T11:41:39.029039+0000","last_became_active":"2023-10-09T11:41:39.028709+0000","last_became_peered":"2023-10-09T11:41:39.028709+0000","last_unstale":"2023-10-09T11:41:39.029039+0000","last_undegraded":"2023-10-09T11:41:39.029039+0000","last_fullsized":"2023-10-09T11:41:39.029039+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.026873+0000","last_change":"2023-10-09T11:41:38.017513+0000","last_active":"2023-10-09T11:41:39.026873+0000","last_peered":"2023-10-09T11:41:39.026873+0000","last_clean":"2023-10-09T11:41:39.026873+0000","last_became_active":"2023-10-09T11:41:38.017235+0000","last_became_peered":"2023-10-09T11:41:38.017235+0000","last_unstale":"2023-10-09T11:41:39.026873+0000","last_undegraded":"2023-10-09T11:41:39.026873+0000","last_fullsized":"2023-10-09T11:41:39.026873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.039376+0000","last_change":"2023-10-09T11:41:39.039315+0000","last_active":"2023-10-09T11:41:39.039376+0000","last_peered":"2023-10-09T11:41:39.039376+0000","last_clean":"2023-10-09T11:41:39.039376+0000","last_became_active":"2023-10-09T11:41:39.039155+0000","last_became_peered":"2023-10-09T11:41:39.039155+0000","last_unstale":"2023-10-09T11:41:39.039376+0000","last_undegraded":"2023-10-09T11:41:39.039376+0000","last_fullsized":"2023-10-09T11:41:39.039376+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"114'3","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044747+0000","last_change":"2023-10-09T11:41:38.021249+0000","last_active":"2023-10-09T11:41:39.044747+0000","last_peered":"2023-10-09T11:41:39.044747+0000","last_clean":"2023-10-09T11:41:39.044747+0000","last_became_active":"2023-10-09T11:41:38.020987+0000","last_became_peered":"2023-10-09T11:41:38.020987+0000","last_unstale":"2023-10-09T11:41:39.044747+0000","last_undegraded":"2023-10-09T11:41:39.044747+0000","last_fullsized":"2023-10-09T11:41:39.044747+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033343+0000","last_change":"2023-10-09T11:41:39.033280+0000","last_active":"2023-10-09T11:41:39.033343+0000","last_peered":"2023-10-09T11:41:39.033343+0000","last_clean":"2023-10-09T11:41:39.033343+0000","last_became_active":"2023-10-09T11:41:39.033023+0000","last_became_peered":"2023-10-09T11:41:39.033023+0000","last_unstale":"2023-10-09T11:41:39.033343+0000","last_undegraded":"2023-10-09T11:41:39.033343+0000","last_fullsized":"2023-10-09T11:41:39.033343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"114'6","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047336+0000","last_change":"2023-10-09T11:41:38.016091+0000","last_active":"2023-10-09T11:41:39.047336+0000","last_peered":"2023-10-09T11:41:39.047336+0000","last_clean":"2023-10-09T11:41:39.047336+0000","last_became_active":"2023-10-09T11:41:38.015871+0000","last_became_peered":"2023-10-09T11:41:38.015871+0000","last_unstale":"2023-10-09T11:41:39.047336+0000","last_undegraded":"2023-10-09T11:41:39.047336+0000","last_fullsized":"2023-10-09T11:41:39.047336+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035916+0000","last_change":"2023-10-09T11:41:39.035833+0000","last_active":"2023-10-09T11:41:39.035916+0000","last_peered":"2023-10-09T11:41:39.035916+0000","last_clean":"2023-10-09T11:41:39.035916+0000","last_became_active":"2023-10-09T11:41:39.035588+0000","last_became_peered":"2023-10-09T11:41:39.035588+0000","last_unstale":"2023-10-09T11:41:39.035916+0000","last_undegraded":"2023-10-09T11:41:39.035916+0000","last_fullsized":"2023-10-09T11:41:39.035916+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045099+0000","last_change":"2023-10-09T11:41:38.015122+0000","last_active":"2023-10-09T11:41:39.045099+0000","last_peered":"2023-10-09T11:41:39.045099+0000","last_clean":"2023-10-09T11:41:39.045099+0000","last_became_active":"2023-10-09T11:41:38.014732+0000","last_became_peered":"2023-10-09T11:41:38.014732+0000","last_unstale":"2023-10-09T11:41:39.045099+0000","last_undegraded":"2023-10-09T11:41:39.045099+0000","last_fullsized":"2023-10-09T11:41:39.045099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:48.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037083+0000","last_change":"2023-10-09T11:41:39.037036+0000","last_active":"2023-10-09T11:41:39.037083+0000","last_peered":"2023-10-09T11:41:39.037083+0000","last_clean":"2023-10-09T11:41:39.037083+0000","last_became_active":"2023-10-09T11:41:39.036707+0000","last_became_peered":"2023-10-09T11:41:39.036707+0000","last_unstale":"2023-10-09T11:41:39.037083+0000","last_undegraded":"2023-10-09T11:41:39.037083+0000","last_fullsized":"2023-10-09T11:41:39.037083+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:32.193128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024106+0000","last_change":"2023-10-09T11:41:38.017653+0000","last_active":"2023-10-09T11:41:39.024106+0000","last_peered":"2023-10-09T11:41:39.024106+0000","last_clean":"2023-10-09T11:41:39.024106+0000","last_became_active":"2023-10-09T11:41:38.017397+0000","last_became_peered":"2023-10-09T11:41:38.017397+0000","last_unstale":"2023-10-09T11:41:39.024106+0000","last_undegraded":"2023-10-09T11:41:39.024106+0000","last_fullsized":"2023-10-09T11:41:39.024106+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:31.032015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031636+0000","last_change":"2023-10-09T11:41:39.030603+0000","last_active":"2023-10-09T11:41:39.031636+0000","last_peered":"2023-10-09T11:41:39.031636+0000","last_clean":"2023-10-09T11:41:39.031636+0000","last_became_active":"2023-10-09T11:41:39.030196+0000","last_became_peered":"2023-10-09T11:41:39.030196+0000","last_unstale":"2023-10-09T11:41:39.031636+0000","last_undegraded":"2023-10-09T11:41:39.031636+0000","last_fullsized":"2023-10-09T11:41:39.031636+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.025349+0000","last_change":"2023-10-09T11:41:38.017434+0000","last_active":"2023-10-09T11:41:39.025349+0000","last_peered":"2023-10-09T11:41:39.025349+0000","last_clean":"2023-10-09T11:41:39.025349+0000","last_became_active":"2023-10-09T11:41:38.016881+0000","last_became_peered":"2023-10-09T11:41:38.016881+0000","last_unstale":"2023-10-09T11:41:39.025349+0000","last_undegraded":"2023-10-09T11:41:39.025349+0000","last_fullsized":"2023-10-09T11:41:39.025349+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028352+0000","last_change":"2023-10-09T11:41:39.028207+0000","last_active":"2023-10-09T11:41:39.028352+0000","last_peered":"2023-10-09T11:41:39.028352+0000","last_clean":"2023-10-09T11:41:39.028352+0000","last_became_active":"2023-10-09T11:41:39.027685+0000","last_became_peered":"2023-10-09T11:41:39.027685+0000","last_unstale":"2023-10-09T11:41:39.028352+0000","last_undegraded":"2023-10-09T11:41:39.028352+0000","last_fullsized":"2023-10-09T11:41:39.028352+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:42.885090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"114'8","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047364+0000","last_change":"2023-10-09T11:41:38.020930+0000","last_active":"2023-10-09T11:41:39.047364+0000","last_peered":"2023-10-09T11:41:39.047364+0000","last_clean":"2023-10-09T11:41:39.047364+0000","last_became_active":"2023-10-09T11:41:38.020688+0000","last_became_peered":"2023-10-09T11:41:38.020688+0000","last_unstale":"2023-10-09T11:41:39.047364+0000","last_undegraded":"2023-10-09T11:41:39.047364+0000","last_fullsized":"2023-10-09T11:41:39.047364+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:36.669315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038318+0000","last_change":"2023-10-09T11:41:39.038224+0000","last_active":"2023-10-09T11:41:39.038318+0000","last_peered":"2023-10-09T11:41:39.038318+0000","last_clean":"2023-10-09T11:41:39.038318+0000","last_became_active":"2023-10-09T11:41:39.037952+0000","last_became_peered":"2023-10-09T11:41:39.037952+0000","last_unstale":"2023-10-09T11:41:39.038318+0000","last_undegraded":"2023-10-09T11:41:39.038318+0000","last_fullsized":"2023-10-09T11:41:39.038318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044641+0000","last_change":"2023-10-09T11:41:38.013821+0000","last_active":"2023-10-09T11:41:39.044641+0000","last_peered":"2023-10-09T11:41:39.044641+0000","last_clean":"2023-10-09T11:41:39.044641+0000","last_became_active":"2023-10-09T11:41:38.013452+0000","last_became_peered":"2023-10-09T11:41:38.013452+0000","last_unstale":"2023-10-09T11:41:39.044641+0000","last_undegraded":"2023-10-09T11:41:39.044641+0000","last_fullsized":"2023-10-09T11:41:39.044641+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029136+0000","last_change":"2023-10-09T11:41:39.029021+0000","last_active":"2023-10-09T11:41:39.029136+0000","last_peered":"2023-10-09T11:41:39.029136+0000","last_clean":"2023-10-09T11:41:39.029136+0000","last_became_active":"2023-10-09T11:41:39.028716+0000","last_became_peered":"2023-10-09T11:41:39.028716+0000","last_unstale":"2023-10-09T11:41:39.029136+0000","last_undegraded":"2023-10-09T11:41:39.029136+0000","last_fullsized":"2023-10-09T11:41:39.029136+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.043681+0000","last_change":"2023-10-09T11:41:38.015401+0000","last_active":"2023-10-09T11:41:39.043681+0000","last_peered":"2023-10-09T11:41:39.043681+0000","last_clean":"2023-10-09T11:41:39.043681+0000","last_became_active":"2023-10-09T11:41:38.015189+0000","last_became_peered":"2023-10-09T11:41:38.015189+0000","last_unstale":"2023-10-09T11:41:39.043681+0000","last_undegraded":"2023-10-09T11:41:39.043681+0000","last_fullsized":"2023-10-09T11:41:39.043681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036640+0000","last_change":"2023-10-09T11:41:39.036423+0000","last_active":"2023-10-09T11:41:39.036640+0000","last_peered":"2023-10-09T11:41:39.036640+0000","last_clean":"2023-10-09T11:41:39.036640+0000","last_became_active":"2023-10-09T11:41:39.036068+0000","last_became_peered":"2023-10-09T11:41:39.036068+0000","last_unstale":"2023-10-09T11:41:39.036640+0000","last_undegraded":"2023-10-09T11:41:39.036640+0000","last_fullsized":"2023-10-09T11:41:39.036640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028683+0000","last_change":"2023-10-09T11:41:38.019813+0000","last_active":"2023-10-09T11:41:39.028683+0000","last_peered":"2023-10-09T11:41:39.028683+0000","last_clean":"2023-10-09T11:41:39.028683+0000","last_became_active":"2023-10-09T11:41:38.019579+0000","last_became_peered":"2023-10-09T11:41:38.019579+0000","last_unstale":"2023-10-09T11:41:39.028683+0000","last_undegraded":"2023-10-09T11:41:39.028683+0000","last_fullsized":"2023-10-09T11:41:39.028683+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041434+0000","last_change":"2023-10-09T11:41:39.040725+0000","last_active":"2023-10-09T11:41:39.041434+0000","last_peered":"2023-10-09T11:41:39.041434+0000","last_clean":"2023-10-09T11:41:39.041434+0000","last_became_active":"2023-10-09T11:41:39.040150+0000","last_became_peered":"2023-10-09T11:41:39.040150+0000","last_unstale":"2023-10-09T11:41:39.041434+0000","last_undegraded":"2023-10-09T11:41:39.041434+0000","last_fullsized":"2023-10-09T11:41:39.041434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:56.715281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047523+0000","last_change":"2023-10-09T11:41:38.027229+0000","last_active":"2023-10-09T11:41:39.047523+0000","last_peered":"2023-10-09T11:41:39.047523+0000","last_clean":"2023-10-09T11:41:39.047523+0000","last_became_active":"2023-10-09T11:41:38.026311+0000","last_became_peered":"2023-10-09T11:41:38.026311+0000","last_unstale":"2023-10-09T11:41:39.047523+0000","last_undegraded":"2023-10-09T11:41:39.047523+0000","last_fullsized":"2023-10-09T11:41:39.047523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030609+0000","last_change":"2023-10-09T11:41:39.030482+0000","last_active":"2023-10-09T11:41:39.030609+0000","last_peered":"2023-10-09T11:41:39.030609+0000","last_clean":"2023-10-09T11:41:39.030609+0000","last_became_active":"2023-10-09T11:41:39.030219+0000","last_became_peered":"2023-10-09T11:41:39.030219+0000","last_unstale":"2023-10-09T11:41:39.030609+0000","last_undegraded":"2023-10-09T11:41:39.030609+0000","last_fullsized":"2023-10-09T11:41:39.030609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:08.759568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024294+0000","last_change":"2023-10-09T11:41:38.015308+0000","last_active":"2023-10-09T11:41:39.024294+0000","last_peered":"2023-10-09T11:41:39.024294+0000","last_clean":"2023-10-09T11:41:39.024294+0000","last_became_active":"2023-10-09T11:41:38.015070+0000","last_became_peered":"2023-10-09T11:41:38.015070+0000","last_unstale":"2023-10-09T11:41:39.024294+0000","last_undegraded":"2023-10-09T11:41:39.024294+0000","last_fullsized":"2023-10-09T11:41:39.024294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036205+0000","last_change":"2023-10-09T11:41:39.036118+0000","last_active":"2023-10-09T11:41:39.036205+0000","last_peered":"2023-10-09T11:41:39.036205+0000","last_clean":"2023-10-09T11:41:39.036205+0000","last_became_active":"2023-10-09T11:41:39.035891+0000","last_became_peered":"2023-10-09T11:41:39.035891+0000","last_unstale":"2023-10-09T11:41:39.036205+0000","last_undegraded":"2023-10-09T11:41:39.036205+0000","last_fullsized":"2023-10-09T11:41:39.036205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:21.276927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024179+0000","last_change":"2023-10-09T11:41:38.014367+0000","last_active":"2023-10-09T11:41:39.024179+0000","last_peered":"2023-10-09T11:41:39.024179+0000","last_clean":"2023-10-09T11:41:39.024179+0000","last_became_active":"2023-10-09T11:41:38.014122+0000","last_became_peered":"2023-10-09T11:41:38.014122+0000","last_unstale":"2023-10-09T11:41:39.024179+0000","last_undegraded":"2023-10-09T11:41:39.024179+0000","last_fullsized":"2023-10-09T11:41:39.024179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037722+0000","last_change":"2023-10-09T11:41:39.037664+0000","last_active":"2023-10-09T11:41:39.037722+0000","last_peered":"2023-10-09T11:41:39.037722+0000","last_clean":"2023-10-09T11:41:39.037722+0000","last_became_active":"2023-10-09T11:41:39.037161+0000","last_became_peered":"2023-10-09T11:41:39.037161+0000","last_unstale":"2023-10-09T11:41:39.037722+0000","last_undegraded":"2023-10-09T11:41:39.037722+0000","last_fullsized":"2023-10-09T11:41:39.037722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028191+0000","last_change":"2023-10-09T11:41:38.026542+0000","last_active":"2023-10-09T11:41:39.028191+0000","last_peered":"2023-10-09T11:41:39.028191+0000","last_clean":"2023-10-09T11:41:39.028191+0000","last_became_active":"2023-10-09T11:41:38.026285+0000","last_became_peered":"2023-10-09T11:41:38.026285+0000","last_unstale":"2023-10-09T11:41:39.028191+0000","last_undegraded":"2023-10-09T11:41:39.028191+0000","last_fullsized":"2023-10-09T11:41:39.028191+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032120+0000","last_change":"2023-10-09T11:41:39.031577+0000","last_active":"2023-10-09T11:41:39.032120+0000","last_peered":"2023-10-09T11:41:39.032120+0000","last_clean":"2023-10-09T11:41:39.032120+0000","last_became_active":"2023-10-09T11:41:39.030979+0000","last_became_peered":"2023-10-09T11:41:39.030979+0000","last_unstale":"2023-10-09T11:41:39.032120+0000","last_undegraded":"2023-10-09T11:41:39.032120+0000","last_fullsized":"2023-10-09T11:41:39.032120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044009+0000","last_change":"2023-10-09T11:41:38.014875+0000","last_active":"2023-10-09T11:41:39.044009+0000","last_peered":"2023-10-09T11:41:39.044009+0000","last_clean":"2023-10-09T11:41:39.044009+0000","last_became_active":"2023-10-09T11:41:38.014371+0000","last_became_peered":"2023-10-09T11:41:38.014371+0000","last_unstale":"2023-10-09T11:41:39.044009+0000","last_undegraded":"2023-10-09T11:41:39.044009+0000","last_fullsized":"2023-10-09T11:41:39.044009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035107+0000","last_change":"2023-10-09T11:41:39.034970+0000","last_active":"2023-10-09T11:41:39.035107+0000","last_peered":"2023-10-09T11:41:39.035107+0000","last_clean":"2023-10-09T11:41:39.035107+0000","last_became_active":"2023-10-09T11:41:39.034561+0000","last_became_peered":"2023-10-09T11:41:39.034561+0000","last_unstale":"2023-10-09T11:41:39.035107+0000","last_undegraded":"2023-10-09T11:41:39.035107+0000","last_fullsized":"2023-10-09T11:41:39.035107+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:48.922825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027955+0000","last_change":"2023-10-09T11:41:38.027494+0000","last_active":"2023-10-09T11:41:39.027955+0000","last_peered":"2023-10-09T11:41:39.027955+0000","last_clean":"2023-10-09T11:41:39.027955+0000","last_became_active":"2023-10-09T11:41:38.026728+0000","last_became_peered":"2023-10-09T11:41:38.026728+0000","last_unstale":"2023-10-09T11:41:39.027955+0000","last_undegraded":"2023-10-09T11:41:39.027955+0000","last_fullsized":"2023-10-09T11:41:39.027955+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037514+0000","last_change":"2023-10-09T11:41:39.037445+0000","last_active":"2023-10-09T11:41:39.037514+0000","last_peered":"2023-10-09T11:41:39.037514+0000","last_clean":"2023-10-09T11:41:39.037514+0000","last_became_active":"2023-10-09T11:41:39.037227+0000","last_became_peered":"2023-10-09T11:41:39.037227+0000","last_unstale":"2023-10-09T11:41:39.037514+0000","last_undegraded":"2023-10-09T11:41:39.037514+0000","last_fullsized":"2023-10-09T11:41:39.037514+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:05.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027736+0000","last_change":"2023-10-09T11:41:38.023342+0000","last_active":"2023-10-09T11:41:39.027736+0000","last_peered":"2023-10-09T11:41:39.027736+0000","last_clean":"2023-10-09T11:41:39.027736+0000","last_became_active":"2023-10-09T11:41:38.020743+0000","last_became_peered":"2023-10-09T11:41:38.020743+0000","last_unstale":"2023-10-09T11:41:39.027736+0000","last_undegraded":"2023-10-09T11:41:39.027736+0000","last_fullsized":"2023-10-09T11:41:39.027736+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036418+0000","last_change":"2023-10-09T11:41:39.036263+0000","last_active":"2023-10-09T11:41:39.036418+0000","last_peered":"2023-10-09T11:41:39.036418+0000","last_clean":"2023-10-09T11:41:39.036418+0000","last_became_active":"2023-10-09T11:41:39.036049+0000","last_became_peered":"2023-10-09T11:41:39.036049+0000","last_unstale":"2023-10-09T11:41:39.036418+0000","last_undegraded":"2023-10-09T11:41:39.036418+0000","last_fullsized":"2023-10-09T11:41:39.036418+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030470+0000","last_change":"2023-10-09T11:41:38.020414+0000","last_active":"2023-10-09T11:41:39.030470+0000","last_peered":"2023-10-09T11:41:39.030470+0000","last_clean":"2023-10-09T11:41:39.030470+0000","last_became_active":"2023-10-09T11:41:38.020197+0000","last_became_peered":"2023-10-09T11:41:38.020197+0000","last_unstale":"2023-10-09T11:41:39.030470+0000","last_undegraded":"2023-10-09T11:41:39.030470+0000","last_fullsized":"2023-10-09T11:41:39.030470+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:07.301979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030551+0000","last_change":"2023-10-09T11:41:39.028358+0000","last_active":"2023-10-09T11:41:39.030551+0000","last_peered":"2023-10-09T11:41:39.030551+0000","last_clean":"2023-10-09T11:41:39.030551+0000","last_became_active":"2023-10-09T11:41:39.027978+0000","last_became_peered":"2023-10-09T11:41:39.027978+0000","last_unstale":"2023-10-09T11:41:39.030551+0000","last_undegraded":"2023-10-09T11:41:39.030551+0000","last_fullsized":"2023-10-09T11:41:39.030551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:01.412766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028284+0000","last_change":"2023-10-09T11:41:38.018380+0000","last_active":"2023-10-09T11:41:39.028284+0000","last_peered":"2023-10-09T11:41:39.028284+0000","last_clean":"2023-10-09T11:41:39.028284+0000","last_became_active":"2023-10-09T11:41:38.018141+0000","last_became_peered":"2023-10-09T11:41:38.018141+0000","last_unstale":"2023-10-09T11:41:39.028284+0000","last_undegraded":"2023-10-09T11:41:39.028284+0000","last_fullsized":"2023-10-09T11:41:39.028284+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:05.219675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034869+0000","last_change":"2023-10-09T11:41:39.034802+0000","last_active":"2023-10-09T11:41:39.034869+0000","last_peered":"2023-10-09T11:41:39.034869+0000","last_clean":"2023-10-09T11:41:39.034869+0000","last_became_active":"2023-10-09T11:41:39.034552+0000","last_became_peered":"2023-10-09T11:41:39.034552+0000","last_unstale":"2023-10-09T11:41:39.034869+0000","last_undegraded":"2023-10-09T11:41:39.034869+0000","last_fullsized":"2023-10-09T11:41:39.034869+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028145+0000","last_change":"2023-10-09T11:41:38.018063+0000","last_active":"2023-10-09T11:41:39.028145+0000","last_peered":"2023-10-09T11:41:39.028145+0000","last_clean":"2023-10-09T11:41:39.028145+0000","last_became_active":"2023-10-09T11:41:38.017768+0000","last_became_peered":"2023-10-09T11:41:38.017768+0000","last_unstale":"2023-10-09T11:41:39.028145+0000","last_undegraded":"2023-10-09T11:41:39.028145+0000","last_fullsized":"2023-10-09T11:41:39.028145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.026974+0000","last_change":"2023-10-09T11:41:39.026917+0000","last_active":"2023-10-09T11:41:39.026974+0000","last_peered":"2023-10-09T11:41:39.026974+0000","last_clean":"2023-10-09T11:41:39.026974+0000","last_became_active":"2023-10-09T11:41:39.026731+0000","last_became_peered":"2023-10-09T11:41:39.026731+0000","last_unstale":"2023-10-09T11:41:39.026974+0000","last_undegraded":"2023-10-09T11:41:39.026974+0000","last_fullsized":"2023-10-09T11:41:39.026974+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:18.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027147+0000","last_change":"2023-10-09T11:41:38.018141+0000","last_active":"2023-10-09T11:41:39.027147+0000","last_peered":"2023-10-09T11:41:39.027147+0000","last_clean":"2023-10-09T11:41:39.027147+0000","last_became_active":"2023-10-09T11:41:38.017497+0000","last_became_peered":"2023-10-09T11:41:38.017497+0000","last_unstale":"2023-10-09T11:41:39.027147+0000","last_undegraded":"2023-10-09T11:41:39.027147+0000","last_fullsized":"2023-10-09T11:41:39.027147+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:29.649576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037123+0000","last_change":"2023-10-09T11:41:39.036839+0000","last_active":"2023-10-09T11:41:39.037123+0000","last_peered":"2023-10-09T11:41:39.037123+0000","last_clean":"2023-10-09T11:41:39.037123+0000","last_became_active":"2023-10-09T11:41:39.034718+0000","last_became_peered":"2023-10-09T11:41:39.034718+0000","last_unstale":"2023-10-09T11:41:39.037123+0000","last_undegraded":"2023-10-09T11:41:39.037123+0000","last_fullsized":"2023-10-09T11:41:39.037123+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024638+0000","last_change":"2023-10-09T11:41:38.027098+0000","last_active":"2023-10-09T11:41:39.024638+0000","last_peered":"2023-10-09T11:41:39.024638+0000","last_clean":"2023-10-09T11:41:39.024638+0000","last_became_active":"2023-10-09T11:41:38.025975+0000","last_became_peered":"2023-10-09T11:41:38.025975+0000","last_unstale":"2023-10-09T11:41:39.024638+0000","last_undegraded":"2023-10-09T11:41:39.024638+0000","last_fullsized":"2023-10-09T11:41:39.024638+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:06.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038025+0000","last_change":"2023-10-09T11:41:39.037955+0000","last_active":"2023-10-09T11:41:39.038025+0000","last_peered":"2023-10-09T11:41:39.038025+0000","last_clean":"2023-10-09T11:41:39.038025+0000","last_became_active":"2023-10-09T11:41:39.037594+0000","last_became_peered":"2023-10-09T11:41:39.037594+0000","last_unstale":"2023-10-09T11:41:39.038025+0000","last_undegraded":"2023-10-09T11:41:39.038025+0000","last_fullsized":"2023-10-09T11:41:39.038025+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:42.034439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044176+0000","last_change":"2023-10-09T11:41:38.022601+0000","last_active":"2023-10-09T11:41:39.044176+0000","last_peered":"2023-10-09T11:41:39.044176+0000","last_clean":"2023-10-09T11:41:39.044176+0000","last_became_active":"2023-10-09T11:41:38.022412+0000","last_became_peered":"2023-10-09T11:41:38.022412+0000","last_unstale":"2023-10-09T11:41:39.044176+0000","last_undegraded":"2023-10-09T11:41:39.044176+0000","last_fullsized":"2023-10-09T11:41:39.044176+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":243,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028846+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:41:39.028846+0000","last_peered":"2023-10-09T11:41:39.028846+0000","last_clean":"2023-10-09T11:41:39.028846+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:41:39.028846+0000","last_undegraded":"2023-10-09T11:41:39.028846+0000","last_fullsized":"2023-10-09T11:41:39.028846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1190,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198781192,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.878,"15min":0.878},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65800000000000003,"5min":1.048,"15min":1.048},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":1.079,"15min":1.079},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73399999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":614,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76600000000000001,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57999999999999996,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.298,"15min":5.298},"last":0.435},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.67400000000000004},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":1.617,"15min":1.617},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.69699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":5.46,"15min":5.46},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.873,"15min":0.873},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36199999999999999,"15min":0.39900000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.623,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39400000000000002,"15min":0.442},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":2.004,"15min":2.004},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.28599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45000000000000001,"15min":0.48199999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":1.909,"15min":1.909},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.432,"15min":0.46500000000000002},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.625},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83799999999999997,"5min":1.869,"15min":1.869},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.952,"15min":1.952},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":1.782,"15min":1.782},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.819,"15min":1.819},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1189,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198781761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.45600000000000002,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.22,"15min":0.22},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.27400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.26800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4289999999999998,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.30299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.496},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2999999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.66000000000000003,"15min":0.70399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.379,"5min":3.976,"15min":3.976},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71399999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3410000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55500000000000005,"5min":0.622,"15min":0.622},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.379,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"min":{"1min":0.29699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61599999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.82399999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":11.055,"15min":11.055},"last":0.378}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.376},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.39700000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63800000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68300000000000005,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1279999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370114,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35499999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.64800000000000002,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.25},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61199999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.26700000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":1.034,"15min":1.034},"last":0.433},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":1.335,"15min":1.335},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67800000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":1.405,"15min":1.405},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81000000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.75900000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.80900000000000005},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.70399999999999996},"min":{"1min":0.44400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":5.274,"15min":5.274},"last":0.435}]},{"osd":3,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.80800000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.65300000000000002,"15min":0.82699999999999996},"min":{"1min":0.45600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.71699999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36499999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79200000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53000000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44900000000000001,"15min":0.47699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.58099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.60199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T11:41:47.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:41:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.834+0000 7f9efeeea700 1 Processor -- start 2023-10-09T11:41:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.834+0000 7f9efeeea700 1 -- start start 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efeeea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 0x7f9ef80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efeeea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ef806d120 0x7f9ef806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efeeea700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef806dac0 con 0x7f9ef8157ca0 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efeeea700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80d07c0 con 0x7f9ef806d120 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efeeea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80cfbb0 con 0x7f9ef81578d0 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efd487700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ef806d120 0x7f9ef806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efd487700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ef806d120 0x7f9ef806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32832/0 (socket says 172.21.15.6:32832) 2023-10-09T11:41:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.835+0000 7f9efd487700 1 -- 172.21.15.6:0/808145915 learned_addr learned my addr 172.21.15.6:0/808145915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efcc86700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 0x7f9ef80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efd487700 1 -- 172.21.15.6:0/808145915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 msgr2=0x7f9ef80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efd487700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 0x7f9ef80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efd487700 1 -- 172.21.15.6:0/808145915 >> v1:172.21.15.118:6789/0 conn(0x7f9ef8157ca0 legacy=0x7f9ef815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efd487700 1 -- 172.21.15.6:0/808145915 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80cfe90 con 0x7f9ef806d120 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efcc86700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 0x7f9ef80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9efd487700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef806d120 0x7f9ef806d580 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00099b0 tx=0x7f9ef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a95afa0085a7f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9ef77fe700 1 -- 172.21.15.6:0/808145915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000b860 con 0x7f9ef806d120 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9ef77fe700 1 -- 172.21.15.6:0/808145915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef000b9c0 con 0x7f9ef806d120 2023-10-09T11:41:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.836+0000 7f9ef77fe700 1 -- 172.21.15.6:0/808145915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000bd60 con 0x7f9ef806d120 2023-10-09T11:41:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 -- 172.21.15.6:0/808145915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef806d120 msgr2=0x7f9ef806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef806d120 0x7f9ef806d580 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00099b0 tx=0x7f9ef0009250 comp rx=0 tx=0).stop 2023-10-09T11:41:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 -- 172.21.15.6:0/808145915 shutdown_connections 2023-10-09T11:41:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef806d120 0x7f9ef806d580 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 --2- 172.21.15.6:0/808145915 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef81578d0 0x7f9ef80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 -- 172.21.15.6:0/808145915 >> 172.21.15.6:0/808145915 conn(0x7f9ef806bb90 msgr2=0x7f9ef806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 -- 172.21.15.6:0/808145915 shutdown_connections 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.837+0000 7f9efeeea700 1 -- 172.21.15.6:0/808145915 wait complete. 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.838+0000 7f9efeeea700 1 Processor -- start 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.838+0000 7f9efeeea700 1 -- start start 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ef806d120 0x7f9ef81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef8157ca0 0x7f9ef816e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef814b340 con 0x7f9ef81578d0 2023-10-09T11:41:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef816e570 con 0x7f9ef806d120 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efeeea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81535f0 con 0x7f9ef8157ca0 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32842/0 (socket says 172.21.15.6:32842) 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 -- 172.21.15.6:0/370476135 learned_addr learned my addr 172.21.15.6:0/370476135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efd487700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef8157ca0 0x7f9ef816e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9efcc86700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ef806d120 0x7f9ef81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 -- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef8157ca0 msgr2=0x7f9ef816e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef8157ca0 0x7f9ef816e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 -- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ef806d120 msgr2=0x7f9ef81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ef806d120 0x7f9ef81511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.839+0000 7f9ef7fff700 1 -- 172.21.15.6:0/370476135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00094f0 con 0x7f9ef81578d0 2023-10-09T11:41:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9ef7fff700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c910 tx=0x7f9ee8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8012630 con 0x7f9ef81578d0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80127b0 con 0x7f9ef81578d0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef81529c0 con 0x7f9ef81578d0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8012b70 con 0x7f9ef81578d0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.840+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef8152fa0 con 0x7f9ef81578d0 2023-10-09T11:41:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.841+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8067ac0 con 0x7f9ef81578d0 2023-10-09T11:41:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.841+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ee8003030 con 0x7f9ef81578d0 2023-10-09T11:41:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.842+0000 7f9ef4ff9700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.842+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ee8084360 con 0x7f9ef81578d0 2023-10-09T11:41:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.842+0000 7f9efcc86700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.842+0000 7f9efcc86700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 0x7f9ed80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006f00 tx=0x7f9ee0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:47.846+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ee80515d0 con 0x7f9ef81578d0 2023-10-09T11:41:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.034+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ef806dac0 con 0x7f9ed8066f30 2023-10-09T11:41:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.043+0000 7f9ef4ff9700 1 -- 172.21.15.6:0/370476135 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285240 (secure 0 0 0) 0x7f9ef806dac0 con 0x7f9ed8066f30 2023-10-09T11:41:48.046 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 msgr2=0x7f9ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 0x7f9ed80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0006f00 tx=0x7f9ee0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 msgr2=0x7f9ef8152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c910 tx=0x7f9ee8001710 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 shutdown_connections 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ef8157ca0 0x7f9ef816e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ef806d120 0x7f9ef81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 --2- 172.21.15.6:0/370476135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef81578d0 0x7f9ef8152370 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 >> 172.21.15.6:0/370476135 conn(0x7f9ef806bb90 msgr2=0x7f9ef8156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 shutdown_connections 2023-10-09T11:41:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.046+0000 7f9efeeea700 1 -- 172.21.15.6:0/370476135 wait complete. 2023-10-09T11:41:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:41:48.059 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-09T11:41:46.219858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6065,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556434,"statfs":{"total":1600000000,"available":1593789039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001694"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.040398+0000","last_change":"2023-10-09T11:41:39.039282+0000","last_active":"2023-10-09T11:41:39.040398+0000","last_peered":"2023-10-09T11:41:39.040398+0000","last_clean":"2023-10-09T11:41:39.040398+0000","last_became_active":"2023-10-09T11:41:39.039051+0000","last_became_peered":"2023-10-09T11:41:39.039051+0000","last_unstale":"2023-10-09T11:41:39.040398+0000","last_undegraded":"2023-10-09T11:41:39.040398+0000","last_fullsized":"2023-10-09T11:41:39.040398+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:15.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032890+0000","last_change":"2023-10-09T11:41:39.032785+0000","last_active":"2023-10-09T11:41:39.032890+0000","last_peered":"2023-10-09T11:41:39.032890+0000","last_clean":"2023-10-09T11:41:39.032890+0000","last_became_active":"2023-10-09T11:41:39.031738+0000","last_became_peered":"2023-10-09T11:41:39.031738+0000","last_unstale":"2023-10-09T11:41:39.032890+0000","last_undegraded":"2023-10-09T11:41:39.032890+0000","last_fullsized":"2023-10-09T11:41:39.032890+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035802+0000","last_change":"2023-10-09T11:41:39.035275+0000","last_active":"2023-10-09T11:41:39.035802+0000","last_peered":"2023-10-09T11:41:39.035802+0000","last_clean":"2023-10-09T11:41:39.035802+0000","last_became_active":"2023-10-09T11:41:39.035030+0000","last_became_peered":"2023-10-09T11:41:39.035030+0000","last_unstale":"2023-10-09T11:41:39.035802+0000","last_undegraded":"2023-10-09T11:41:39.035802+0000","last_fullsized":"2023-10-09T11:41:39.035802+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:21.783738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.042958+0000","last_change":"2023-10-09T11:41:39.042893+0000","last_active":"2023-10-09T11:41:39.042958+0000","last_peered":"2023-10-09T11:41:39.042958+0000","last_clean":"2023-10-09T11:41:39.042958+0000","last_became_active":"2023-10-09T11:41:39.042666+0000","last_became_peered":"2023-10-09T11:41:39.042666+0000","last_unstale":"2023-10-09T11:41:39.042958+0000","last_undegraded":"2023-10-09T11:41:39.042958+0000","last_fullsized":"2023-10-09T11:41:39.042958+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036373+0000","last_change":"2023-10-09T11:41:39.033970+0000","last_active":"2023-10-09T11:41:39.036373+0000","last_peered":"2023-10-09T11:41:39.036373+0000","last_clean":"2023-10-09T11:41:39.036373+0000","last_became_active":"2023-10-09T11:41:39.033727+0000","last_became_peered":"2023-10-09T11:41:39.033727+0000","last_unstale":"2023-10-09T11:41:39.036373+0000","last_undegraded":"2023-10-09T11:41:39.036373+0000","last_fullsized":"2023-10-09T11:41:39.036373+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035448+0000","last_change":"2023-10-09T11:41:39.032502+0000","last_active":"2023-10-09T11:41:39.035448+0000","last_peered":"2023-10-09T11:41:39.035448+0000","last_clean":"2023-10-09T11:41:39.035448+0000","last_became_active":"2023-10-09T11:41:39.032276+0000","last_became_peered":"2023-10-09T11:41:39.032276+0000","last_unstale":"2023-10-09T11:41:39.035448+0000","last_undegraded":"2023-10-09T11:41:39.035448+0000","last_fullsized":"2023-10-09T11:41:39.035448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031593+0000","last_change":"2023-10-09T11:41:39.031544+0000","last_active":"2023-10-09T11:41:39.031593+0000","last_peered":"2023-10-09T11:41:39.031593+0000","last_clean":"2023-10-09T11:41:39.031593+0000","last_became_active":"2023-10-09T11:41:39.031415+0000","last_became_peered":"2023-10-09T11:41:39.031415+0000","last_unstale":"2023-10-09T11:41:39.031593+0000","last_undegraded":"2023-10-09T11:41:39.031593+0000","last_fullsized":"2023-10-09T11:41:39.031593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034348+0000","last_change":"2023-10-09T11:41:39.034292+0000","last_active":"2023-10-09T11:41:39.034348+0000","last_peered":"2023-10-09T11:41:39.034348+0000","last_clean":"2023-10-09T11:41:39.034348+0000","last_became_active":"2023-10-09T11:41:39.033979+0000","last_became_peered":"2023-10-09T11:41:39.033979+0000","last_unstale":"2023-10-09T11:41:39.034348+0000","last_undegraded":"2023-10-09T11:41:39.034348+0000","last_fullsized":"2023-10-09T11:41:39.034348+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033557+0000","last_change":"2023-10-09T11:41:39.033436+0000","last_active":"2023-10-09T11:41:39.033557+0000","last_peered":"2023-10-09T11:41:39.033557+0000","last_clean":"2023-10-09T11:41:39.033557+0000","last_became_active":"2023-10-09T11:41:39.033172+0000","last_became_peered":"2023-10-09T11:41:39.033172+0000","last_unstale":"2023-10-09T11:41:39.033557+0000","last_undegraded":"2023-10-09T11:41:39.033557+0000","last_fullsized":"2023-10-09T11:41:39.033557+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:46:49.967030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037862+0000","last_change":"2023-10-09T11:41:39.037795+0000","last_active":"2023-10-09T11:41:39.037862+0000","last_peered":"2023-10-09T11:41:39.037862+0000","last_clean":"2023-10-09T11:41:39.037862+0000","last_became_active":"2023-10-09T11:41:39.037448+0000","last_became_peered":"2023-10-09T11:41:39.037448+0000","last_unstale":"2023-10-09T11:41:39.037862+0000","last_undegraded":"2023-10-09T11:41:39.037862+0000","last_fullsized":"2023-10-09T11:41:39.037862+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036612+0000","last_change":"2023-10-09T11:41:39.036286+0000","last_active":"2023-10-09T11:41:39.036612+0000","last_peered":"2023-10-09T11:41:39.036612+0000","last_clean":"2023-10-09T11:41:39.036612+0000","last_became_active":"2023-10-09T11:41:39.035765+0000","last_became_peered":"2023-10-09T11:41:39.035765+0000","last_unstale":"2023-10-09T11:41:39.036612+0000","last_undegraded":"2023-10-09T11:41:39.036612+0000","last_fullsized":"2023-10-09T11:41:39.036612+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:09.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034278+0000","last_change":"2023-10-09T11:41:39.034034+0000","last_active":"2023-10-09T11:41:39.034278+0000","last_peered":"2023-10-09T11:41:39.034278+0000","last_clean":"2023-10-09T11:41:39.034278+0000","last_became_active":"2023-10-09T11:41:39.033790+0000","last_became_peered":"2023-10-09T11:41:39.033790+0000","last_unstale":"2023-10-09T11:41:39.034278+0000","last_undegraded":"2023-10-09T11:41:39.034278+0000","last_fullsized":"2023-10-09T11:41:39.034278+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031029+0000","last_change":"2023-10-09T11:41:39.030980+0000","last_active":"2023-10-09T11:41:39.031029+0000","last_peered":"2023-10-09T11:41:39.031029+0000","last_clean":"2023-10-09T11:41:39.031029+0000","last_became_active":"2023-10-09T11:41:39.030770+0000","last_became_peered":"2023-10-09T11:41:39.030770+0000","last_unstale":"2023-10-09T11:41:39.031029+0000","last_undegraded":"2023-10-09T11:41:39.031029+0000","last_fullsized":"2023-10-09T11:41:39.031029+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:00.828310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041452+0000","last_change":"2023-10-09T11:41:39.040858+0000","last_active":"2023-10-09T11:41:39.041452+0000","last_peered":"2023-10-09T11:41:39.041452+0000","last_clean":"2023-10-09T11:41:39.041452+0000","last_became_active":"2023-10-09T11:41:39.040490+0000","last_became_peered":"2023-10-09T11:41:39.040490+0000","last_unstale":"2023-10-09T11:41:39.041452+0000","last_undegraded":"2023-10-09T11:41:39.041452+0000","last_fullsized":"2023-10-09T11:41:39.041452+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:55:07.764055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041407+0000","last_change":"2023-10-09T11:41:39.041343+0000","last_active":"2023-10-09T11:41:39.041407+0000","last_peered":"2023-10-09T11:41:39.041407+0000","last_clean":"2023-10-09T11:41:39.041407+0000","last_became_active":"2023-10-09T11:41:39.038609+0000","last_became_peered":"2023-10-09T11:41:39.038609+0000","last_unstale":"2023-10-09T11:41:39.041407+0000","last_undegraded":"2023-10-09T11:41:39.041407+0000","last_fullsized":"2023-10-09T11:41:39.041407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035466+0000","last_change":"2023-10-09T11:41:39.035355+0000","last_active":"2023-10-09T11:41:39.035466+0000","last_peered":"2023-10-09T11:41:39.035466+0000","last_clean":"2023-10-09T11:41:39.035466+0000","last_became_active":"2023-10-09T11:41:39.035111+0000","last_became_peered":"2023-10-09T11:41:39.035111+0000","last_unstale":"2023-10-09T11:41:39.035466+0000","last_undegraded":"2023-10-09T11:41:39.035466+0000","last_fullsized":"2023-10-09T11:41:39.035466+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:13:42.723424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032856+0000","last_change":"2023-10-09T11:41:39.032496+0000","last_active":"2023-10-09T11:41:39.032856+0000","last_peered":"2023-10-09T11:41:39.032856+0000","last_clean":"2023-10-09T11:41:39.032856+0000","last_became_active":"2023-10-09T11:41:39.031127+0000","last_became_peered":"2023-10-09T11:41:39.031127+0000","last_unstale":"2023-10-09T11:41:39.032856+0000","last_undegraded":"2023-10-09T11:41:39.032856+0000","last_fullsized":"2023-10-09T11:41:39.032856+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041677+0000","last_change":"2023-10-09T11:41:39.038656+0000","last_active":"2023-10-09T11:41:39.041677+0000","last_peered":"2023-10-09T11:41:39.041677+0000","last_clean":"2023-10-09T11:41:39.041677+0000","last_became_active":"2023-10-09T11:41:39.038429+0000","last_became_peered":"2023-10-09T11:41:39.038429+0000","last_unstale":"2023-10-09T11:41:39.041677+0000","last_undegraded":"2023-10-09T11:41:39.041677+0000","last_fullsized":"2023-10-09T11:41:39.041677+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034359+0000","last_change":"2023-10-09T11:41:39.033739+0000","last_active":"2023-10-09T11:41:39.034359+0000","last_peered":"2023-10-09T11:41:39.034359+0000","last_clean":"2023-10-09T11:41:39.034359+0000","last_became_active":"2023-10-09T11:41:39.033473+0000","last_became_peered":"2023-10-09T11:41:39.033473+0000","last_unstale":"2023-10-09T11:41:39.034359+0000","last_undegraded":"2023-10-09T11:41:39.034359+0000","last_fullsized":"2023-10-09T11:41:39.034359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:13:22.964747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034514+0000","last_change":"2023-10-09T11:41:39.034354+0000","last_active":"2023-10-09T11:41:39.034514+0000","last_peered":"2023-10-09T11:41:39.034514+0000","last_clean":"2023-10-09T11:41:39.034514+0000","last_became_active":"2023-10-09T11:41:39.034108+0000","last_became_peered":"2023-10-09T11:41:39.034108+0000","last_unstale":"2023-10-09T11:41:39.034514+0000","last_undegraded":"2023-10-09T11:41:39.034514+0000","last_fullsized":"2023-10-09T11:41:39.034514+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027584+0000","last_change":"2023-10-09T11:41:39.027516+0000","last_active":"2023-10-09T11:41:39.027584+0000","last_peered":"2023-10-09T11:41:39.027584+0000","last_clean":"2023-10-09T11:41:39.027584+0000","last_became_active":"2023-10-09T11:41:39.027287+0000","last_became_peered":"2023-10-09T11:41:39.027287+0000","last_unstale":"2023-10-09T11:41:39.027584+0000","last_undegraded":"2023-10-09T11:41:39.027584+0000","last_fullsized":"2023-10-09T11:41:39.027584+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:17.070405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032874+0000","last_change":"2023-10-09T11:41:39.032641+0000","last_active":"2023-10-09T11:41:39.032874+0000","last_peered":"2023-10-09T11:41:39.032874+0000","last_clean":"2023-10-09T11:41:39.032874+0000","last_became_active":"2023-10-09T11:41:39.031442+0000","last_became_peered":"2023-10-09T11:41:39.031442+0000","last_unstale":"2023-10-09T11:41:39.032874+0000","last_undegraded":"2023-10-09T11:41:39.032874+0000","last_fullsized":"2023-10-09T11:41:39.032874+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032151+0000","last_change":"2023-10-09T11:41:39.031728+0000","last_active":"2023-10-09T11:41:39.032151+0000","last_peered":"2023-10-09T11:41:39.032151+0000","last_clean":"2023-10-09T11:41:39.032151+0000","last_became_active":"2023-10-09T11:41:39.031293+0000","last_became_peered":"2023-10-09T11:41:39.031293+0000","last_unstale":"2023-10-09T11:41:39.032151+0000","last_undegraded":"2023-10-09T11:41:39.032151+0000","last_fullsized":"2023-10-09T11:41:39.032151+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036656+0000","last_change":"2023-10-09T11:41:39.036552+0000","last_active":"2023-10-09T11:41:39.036656+0000","last_peered":"2023-10-09T11:41:39.036656+0000","last_clean":"2023-10-09T11:41:39.036656+0000","last_became_active":"2023-10-09T11:41:39.036334+0000","last_became_peered":"2023-10-09T11:41:39.036334+0000","last_unstale":"2023-10-09T11:41:39.036656+0000","last_undegraded":"2023-10-09T11:41:39.036656+0000","last_fullsized":"2023-10-09T11:41:39.036656+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:50:55.628790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036391+0000","last_change":"2023-10-09T11:41:39.034988+0000","last_active":"2023-10-09T11:41:39.036391+0000","last_peered":"2023-10-09T11:41:39.036391+0000","last_clean":"2023-10-09T11:41:39.036391+0000","last_became_active":"2023-10-09T11:41:39.034747+0000","last_became_peered":"2023-10-09T11:41:39.034747+0000","last_unstale":"2023-10-09T11:41:39.036391+0000","last_undegraded":"2023-10-09T11:41:39.036391+0000","last_fullsized":"2023-10-09T11:41:39.036391+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:07.646593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032139+0000","last_change":"2023-10-09T11:41:39.031647+0000","last_active":"2023-10-09T11:41:39.032139+0000","last_peered":"2023-10-09T11:41:39.032139+0000","last_clean":"2023-10-09T11:41:39.032139+0000","last_became_active":"2023-10-09T11:41:39.031403+0000","last_became_peered":"2023-10-09T11:41:39.031403+0000","last_unstale":"2023-10-09T11:41:39.032139+0000","last_undegraded":"2023-10-09T11:41:39.032139+0000","last_fullsized":"2023-10-09T11:41:39.032139+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:09.119658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033232+0000","last_change":"2023-10-09T11:41:39.033168+0000","last_active":"2023-10-09T11:41:39.033232+0000","last_peered":"2023-10-09T11:41:39.033232+0000","last_clean":"2023-10-09T11:41:39.033232+0000","last_became_active":"2023-10-09T11:41:39.032545+0000","last_became_peered":"2023-10-09T11:41:39.032545+0000","last_unstale":"2023-10-09T11:41:39.033232+0000","last_undegraded":"2023-10-09T11:41:39.033232+0000","last_fullsized":"2023-10-09T11:41:39.033232+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:12.421559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037141+0000","last_change":"2023-10-09T11:41:39.037006+0000","last_active":"2023-10-09T11:41:39.037141+0000","last_peered":"2023-10-09T11:41:39.037141+0000","last_clean":"2023-10-09T11:41:39.037141+0000","last_became_active":"2023-10-09T11:41:39.035064+0000","last_became_peered":"2023-10-09T11:41:39.035064+0000","last_unstale":"2023-10-09T11:41:39.037141+0000","last_undegraded":"2023-10-09T11:41:39.037141+0000","last_fullsized":"2023-10-09T11:41:39.037141+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034326+0000","last_change":"2023-10-09T11:41:39.034152+0000","last_active":"2023-10-09T11:41:39.034326+0000","last_peered":"2023-10-09T11:41:39.034326+0000","last_clean":"2023-10-09T11:41:39.034326+0000","last_became_active":"2023-10-09T11:41:39.033914+0000","last_became_peered":"2023-10-09T11:41:39.033914+0000","last_unstale":"2023-10-09T11:41:39.034326+0000","last_undegraded":"2023-10-09T11:41:39.034326+0000","last_fullsized":"2023-10-09T11:41:39.034326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:12.421559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035710+0000","last_change":"2023-10-09T11:41:39.035610+0000","last_active":"2023-10-09T11:41:39.035710+0000","last_peered":"2023-10-09T11:41:39.035710+0000","last_clean":"2023-10-09T11:41:39.035710+0000","last_became_active":"2023-10-09T11:41:39.035340+0000","last_became_peered":"2023-10-09T11:41:39.035340+0000","last_unstale":"2023-10-09T11:41:39.035710+0000","last_undegraded":"2023-10-09T11:41:39.035710+0000","last_fullsized":"2023-10-09T11:41:39.035710+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:03.976110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038135+0000","last_change":"2023-10-09T11:41:39.037745+0000","last_active":"2023-10-09T11:41:39.038135+0000","last_peered":"2023-10-09T11:41:39.038135+0000","last_clean":"2023-10-09T11:41:39.038135+0000","last_became_active":"2023-10-09T11:41:39.037519+0000","last_became_peered":"2023-10-09T11:41:39.037519+0000","last_unstale":"2023-10-09T11:41:39.038135+0000","last_undegraded":"2023-10-09T11:41:39.038135+0000","last_fullsized":"2023-10-09T11:41:39.038135+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038803+0000","last_change":"2023-10-09T11:41:39.038656+0000","last_active":"2023-10-09T11:41:39.038803+0000","last_peered":"2023-10-09T11:41:39.038803+0000","last_clean":"2023-10-09T11:41:39.038803+0000","last_became_active":"2023-10-09T11:41:39.038428+0000","last_became_peered":"2023-10-09T11:41:39.038428+0000","last_unstale":"2023-10-09T11:41:39.038803+0000","last_undegraded":"2023-10-09T11:41:39.038803+0000","last_fullsized":"2023-10-09T11:41:39.038803+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:44.397350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030591+0000","last_change":"2023-10-09T11:41:39.029959+0000","last_active":"2023-10-09T11:41:39.030591+0000","last_peered":"2023-10-09T11:41:39.030591+0000","last_clean":"2023-10-09T11:41:39.030591+0000","last_became_active":"2023-10-09T11:41:39.029700+0000","last_became_peered":"2023-10-09T11:41:39.029700+0000","last_unstale":"2023-10-09T11:41:39.030591+0000","last_undegraded":"2023-10-09T11:41:39.030591+0000","last_fullsized":"2023-10-09T11:41:39.030591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:44:16.413851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"114'4","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046542+0000","last_change":"2023-10-09T11:41:38.022285+0000","last_active":"2023-10-09T11:41:39.046542+0000","last_peered":"2023-10-09T11:41:39.046542+0000","last_clean":"2023-10-09T11:41:39.046542+0000","last_became_active":"2023-10-09T11:41:38.021933+0000","last_became_peered":"2023-10-09T11:41:38.021933+0000","last_unstale":"2023-10-09T11:41:39.046542+0000","last_undegraded":"2023-10-09T11:41:39.046542+0000","last_fullsized":"2023-10-09T11:41:39.046542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:11.329794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033171+0000","last_change":"2023-10-09T11:41:39.033109+0000","last_active":"2023-10-09T11:41:39.033171+0000","last_peered":"2023-10-09T11:41:39.033171+0000","last_clean":"2023-10-09T11:41:39.033171+0000","last_became_active":"2023-10-09T11:41:39.032902+0000","last_became_peered":"2023-10-09T11:41:39.032902+0000","last_unstale":"2023-10-09T11:41:39.033171+0000","last_undegraded":"2023-10-09T11:41:39.033171+0000","last_fullsized":"2023-10-09T11:41:39.033171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:17.293974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046256+0000","last_change":"2023-10-09T11:41:38.021884+0000","last_active":"2023-10-09T11:41:39.046256+0000","last_peered":"2023-10-09T11:41:39.046256+0000","last_clean":"2023-10-09T11:41:39.046256+0000","last_became_active":"2023-10-09T11:41:38.021661+0000","last_became_peered":"2023-10-09T11:41:38.021661+0000","last_unstale":"2023-10-09T11:41:39.046256+0000","last_undegraded":"2023-10-09T11:41:39.046256+0000","last_fullsized":"2023-10-09T11:41:39.046256+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:01.516396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036171+0000","last_change":"2023-10-09T11:41:39.036051+0000","last_active":"2023-10-09T11:41:39.036171+0000","last_peered":"2023-10-09T11:41:39.036171+0000","last_clean":"2023-10-09T11:41:39.036171+0000","last_became_active":"2023-10-09T11:41:39.035387+0000","last_became_peered":"2023-10-09T11:41:39.035387+0000","last_unstale":"2023-10-09T11:41:39.036171+0000","last_undegraded":"2023-10-09T11:41:39.036171+0000","last_fullsized":"2023-10-09T11:41:39.036171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:36:43.193661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047607+0000","last_change":"2023-10-09T11:41:38.027892+0000","last_active":"2023-10-09T11:41:39.047607+0000","last_peered":"2023-10-09T11:41:39.047607+0000","last_clean":"2023-10-09T11:41:39.047607+0000","last_became_active":"2023-10-09T11:41:38.027650+0000","last_became_peered":"2023-10-09T11:41:38.027650+0000","last_unstale":"2023-10-09T11:41:39.047607+0000","last_undegraded":"2023-10-09T11:41:39.047607+0000","last_fullsized":"2023-10-09T11:41:39.047607+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030441+0000","last_change":"2023-10-09T11:41:39.030297+0000","last_active":"2023-10-09T11:41:39.030441+0000","last_peered":"2023-10-09T11:41:39.030441+0000","last_clean":"2023-10-09T11:41:39.030441+0000","last_became_active":"2023-10-09T11:41:39.030030+0000","last_became_peered":"2023-10-09T11:41:39.030030+0000","last_unstale":"2023-10-09T11:41:39.030441+0000","last_undegraded":"2023-10-09T11:41:39.030441+0000","last_fullsized":"2023-10-09T11:41:39.030441+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045188+0000","last_change":"2023-10-09T11:41:38.018919+0000","last_active":"2023-10-09T11:41:39.045188+0000","last_peered":"2023-10-09T11:41:39.045188+0000","last_clean":"2023-10-09T11:41:39.045188+0000","last_became_active":"2023-10-09T11:41:38.018647+0000","last_became_peered":"2023-10-09T11:41:38.018647+0000","last_unstale":"2023-10-09T11:41:39.045188+0000","last_undegraded":"2023-10-09T11:41:39.045188+0000","last_fullsized":"2023-10-09T11:41:39.045188+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:31:13.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033649+0000","last_change":"2023-10-09T11:41:39.032847+0000","last_active":"2023-10-09T11:41:39.033649+0000","last_peered":"2023-10-09T11:41:39.033649+0000","last_clean":"2023-10-09T11:41:39.033649+0000","last_became_active":"2023-10-09T11:41:39.029574+0000","last_became_peered":"2023-10-09T11:41:39.029574+0000","last_unstale":"2023-10-09T11:41:39.033649+0000","last_undegraded":"2023-10-09T11:41:39.033649+0000","last_fullsized":"2023-10-09T11:41:39.033649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045443+0000","last_change":"2023-10-09T11:41:38.022626+0000","last_active":"2023-10-09T11:41:39.045443+0000","last_peered":"2023-10-09T11:41:39.045443+0000","last_clean":"2023-10-09T11:41:39.045443+0000","last_became_active":"2023-10-09T11:41:38.021978+0000","last_became_peered":"2023-10-09T11:41:38.021978+0000","last_unstale":"2023-10-09T11:41:39.045443+0000","last_undegraded":"2023-10-09T11:41:39.045443+0000","last_fullsized":"2023-10-09T11:41:39.045443+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:14.381028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033360+0000","last_change":"2023-10-09T11:41:39.033289+0000","last_active":"2023-10-09T11:41:39.033360+0000","last_peered":"2023-10-09T11:41:39.033360+0000","last_clean":"2023-10-09T11:41:39.033360+0000","last_became_active":"2023-10-09T11:41:39.032895+0000","last_became_peered":"2023-10-09T11:41:39.032895+0000","last_unstale":"2023-10-09T11:41:39.033360+0000","last_undegraded":"2023-10-09T11:41:39.033360+0000","last_fullsized":"2023-10-09T11:41:39.033360+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:23.684701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.046649+0000","last_change":"2023-10-09T11:41:38.027649+0000","last_active":"2023-10-09T11:41:39.046649+0000","last_peered":"2023-10-09T11:41:39.046649+0000","last_clean":"2023-10-09T11:41:39.046649+0000","last_became_active":"2023-10-09T11:41:38.027070+0000","last_became_peered":"2023-10-09T11:41:38.027070+0000","last_unstale":"2023-10-09T11:41:39.046649+0000","last_undegraded":"2023-10-09T11:41:39.046649+0000","last_fullsized":"2023-10-09T11:41:39.046649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041277+0000","last_change":"2023-10-09T11:41:39.041187+0000","last_active":"2023-10-09T11:41:39.041277+0000","last_peered":"2023-10-09T11:41:39.041277+0000","last_clean":"2023-10-09T11:41:39.041277+0000","last_became_active":"2023-10-09T11:41:39.038401+0000","last_became_peered":"2023-10-09T11:41:39.038401+0000","last_unstale":"2023-10-09T11:41:39.041277+0000","last_undegraded":"2023-10-09T11:41:39.041277+0000","last_fullsized":"2023-10-09T11:41:39.041277+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:53.926151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035823+0000","last_change":"2023-10-09T11:41:38.021051+0000","last_active":"2023-10-09T11:41:39.035823+0000","last_peered":"2023-10-09T11:41:39.035823+0000","last_clean":"2023-10-09T11:41:39.035823+0000","last_became_active":"2023-10-09T11:41:38.020811+0000","last_became_peered":"2023-10-09T11:41:38.020811+0000","last_unstale":"2023-10-09T11:41:39.035823+0000","last_undegraded":"2023-10-09T11:41:39.035823+0000","last_fullsized":"2023-10-09T11:41:39.035823+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029530+0000","last_change":"2023-10-09T11:41:39.029466+0000","last_active":"2023-10-09T11:41:39.029530+0000","last_peered":"2023-10-09T11:41:39.029530+0000","last_clean":"2023-10-09T11:41:39.029530+0000","last_became_active":"2023-10-09T11:41:39.029227+0000","last_became_peered":"2023-10-09T11:41:39.029227+0000","last_unstale":"2023-10-09T11:41:39.029530+0000","last_undegraded":"2023-10-09T11:41:39.029530+0000","last_fullsized":"2023-10-09T11:41:39.029530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030226+0000","last_change":"2023-10-09T11:41:38.018205+0000","last_active":"2023-10-09T11:41:39.030226+0000","last_peered":"2023-10-09T11:41:39.030226+0000","last_clean":"2023-10-09T11:41:39.030226+0000","last_became_active":"2023-10-09T11:41:38.016831+0000","last_became_peered":"2023-10-09T11:41:38.016831+0000","last_unstale":"2023-10-09T11:41:39.030226+0000","last_undegraded":"2023-10-09T11:41:39.030226+0000","last_fullsized":"2023-10-09T11:41:39.030226+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:02.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036757+0000","last_change":"2023-10-09T11:41:39.036690+0000","last_active":"2023-10-09T11:41:39.036757+0000","last_peered":"2023-10-09T11:41:39.036757+0000","last_clean":"2023-10-09T11:41:39.036757+0000","last_became_active":"2023-10-09T11:41:39.036398+0000","last_became_peered":"2023-10-09T11:41:39.036398+0000","last_unstale":"2023-10-09T11:41:39.036757+0000","last_undegraded":"2023-10-09T11:41:39.036757+0000","last_fullsized":"2023-10-09T11:41:39.036757+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:11.518737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030485+0000","last_change":"2023-10-09T11:41:38.015417+0000","last_active":"2023-10-09T11:41:39.030485+0000","last_peered":"2023-10-09T11:41:39.030485+0000","last_clean":"2023-10-09T11:41:39.030485+0000","last_became_active":"2023-10-09T11:41:38.015109+0000","last_became_peered":"2023-10-09T11:41:38.015109+0000","last_unstale":"2023-10-09T11:41:39.030485+0000","last_undegraded":"2023-10-09T11:41:39.030485+0000","last_fullsized":"2023-10-09T11:41:39.030485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:46.822110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029039+0000","last_change":"2023-10-09T11:41:39.028966+0000","last_active":"2023-10-09T11:41:39.029039+0000","last_peered":"2023-10-09T11:41:39.029039+0000","last_clean":"2023-10-09T11:41:39.029039+0000","last_became_active":"2023-10-09T11:41:39.028709+0000","last_became_peered":"2023-10-09T11:41:39.028709+0000","last_unstale":"2023-10-09T11:41:39.029039+0000","last_undegraded":"2023-10-09T11:41:39.029039+0000","last_fullsized":"2023-10-09T11:41:39.029039+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.026873+0000","last_change":"2023-10-09T11:41:38.017513+0000","last_active":"2023-10-09T11:41:39.026873+0000","last_peered":"2023-10-09T11:41:39.026873+0000","last_clean":"2023-10-09T11:41:39.026873+0000","last_became_active":"2023-10-09T11:41:38.017235+0000","last_became_peered":"2023-10-09T11:41:38.017235+0000","last_unstale":"2023-10-09T11:41:39.026873+0000","last_undegraded":"2023-10-09T11:41:39.026873+0000","last_fullsized":"2023-10-09T11:41:39.026873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.039376+0000","last_change":"2023-10-09T11:41:39.039315+0000","last_active":"2023-10-09T11:41:39.039376+0000","last_peered":"2023-10-09T11:41:39.039376+0000","last_clean":"2023-10-09T11:41:39.039376+0000","last_became_active":"2023-10-09T11:41:39.039155+0000","last_became_peered":"2023-10-09T11:41:39.039155+0000","last_unstale":"2023-10-09T11:41:39.039376+0000","last_undegraded":"2023-10-09T11:41:39.039376+0000","last_fullsized":"2023-10-09T11:41:39.039376+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:48.823505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"114'3","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044747+0000","last_change":"2023-10-09T11:41:38.021249+0000","last_active":"2023-10-09T11:41:39.044747+0000","last_peered":"2023-10-09T11:41:39.044747+0000","last_clean":"2023-10-09T11:41:39.044747+0000","last_became_active":"2023-10-09T11:41:38.020987+0000","last_became_peered":"2023-10-09T11:41:38.020987+0000","last_unstale":"2023-10-09T11:41:39.044747+0000","last_undegraded":"2023-10-09T11:41:39.044747+0000","last_fullsized":"2023-10-09T11:41:39.044747+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.033343+0000","last_change":"2023-10-09T11:41:39.033280+0000","last_active":"2023-10-09T11:41:39.033343+0000","last_peered":"2023-10-09T11:41:39.033343+0000","last_clean":"2023-10-09T11:41:39.033343+0000","last_became_active":"2023-10-09T11:41:39.033023+0000","last_became_peered":"2023-10-09T11:41:39.033023+0000","last_unstale":"2023-10-09T11:41:39.033343+0000","last_undegraded":"2023-10-09T11:41:39.033343+0000","last_fullsized":"2023-10-09T11:41:39.033343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"114'6","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047336+0000","last_change":"2023-10-09T11:41:38.016091+0000","last_active":"2023-10-09T11:41:39.047336+0000","last_peered":"2023-10-09T11:41:39.047336+0000","last_clean":"2023-10-09T11:41:39.047336+0000","last_became_active":"2023-10-09T11:41:38.015871+0000","last_became_peered":"2023-10-09T11:41:38.015871+0000","last_unstale":"2023-10-09T11:41:39.047336+0000","last_undegraded":"2023-10-09T11:41:39.047336+0000","last_fullsized":"2023-10-09T11:41:39.047336+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:48.593361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035916+0000","last_change":"2023-10-09T11:41:39.035833+0000","last_active":"2023-10-09T11:41:39.035916+0000","last_peered":"2023-10-09T11:41:39.035916+0000","last_clean":"2023-10-09T11:41:39.035916+0000","last_became_active":"2023-10-09T11:41:39.035588+0000","last_became_peered":"2023-10-09T11:41:39.035588+0000","last_unstale":"2023-10-09T11:41:39.035916+0000","last_undegraded":"2023-10-09T11:41:39.035916+0000","last_fullsized":"2023-10-09T11:41:39.035916+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:58.863285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.045099+0000","last_change":"2023-10-09T11:41:38.015122+0000","last_active":"2023-10-09T11:41:39.045099+0000","last_peered":"2023-10-09T11:41:39.045099+0000","last_clean":"2023-10-09T11:41:39.045099+0000","last_became_active":"2023-10-09T11:41:38.014732+0000","last_became_peered":"2023-10-09T11:41:38.014732+0000","last_unstale":"2023-10-09T11:41:39.045099+0000","last_undegraded":"2023-10-09T11:41:39.045099+0000","last_fullsized":"2023-10-09T11:41:39.045099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:48.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037083+0000","last_change":"2023-10-09T11:41:39.037036+0000","last_active":"2023-10-09T11:41:39.037083+0000","last_peered":"2023-10-09T11:41:39.037083+0000","last_clean":"2023-10-09T11:41:39.037083+0000","last_became_active":"2023-10-09T11:41:39.036707+0000","last_became_peered":"2023-10-09T11:41:39.036707+0000","last_unstale":"2023-10-09T11:41:39.037083+0000","last_undegraded":"2023-10-09T11:41:39.037083+0000","last_fullsized":"2023-10-09T11:41:39.037083+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:32.193128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024106+0000","last_change":"2023-10-09T11:41:38.017653+0000","last_active":"2023-10-09T11:41:39.024106+0000","last_peered":"2023-10-09T11:41:39.024106+0000","last_clean":"2023-10-09T11:41:39.024106+0000","last_became_active":"2023-10-09T11:41:38.017397+0000","last_became_peered":"2023-10-09T11:41:38.017397+0000","last_unstale":"2023-10-09T11:41:39.024106+0000","last_undegraded":"2023-10-09T11:41:39.024106+0000","last_fullsized":"2023-10-09T11:41:39.024106+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:42:31.032015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.031636+0000","last_change":"2023-10-09T11:41:39.030603+0000","last_active":"2023-10-09T11:41:39.031636+0000","last_peered":"2023-10-09T11:41:39.031636+0000","last_clean":"2023-10-09T11:41:39.031636+0000","last_became_active":"2023-10-09T11:41:39.030196+0000","last_became_peered":"2023-10-09T11:41:39.030196+0000","last_unstale":"2023-10-09T11:41:39.031636+0000","last_undegraded":"2023-10-09T11:41:39.031636+0000","last_fullsized":"2023-10-09T11:41:39.031636+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:56:23.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.025349+0000","last_change":"2023-10-09T11:41:38.017434+0000","last_active":"2023-10-09T11:41:39.025349+0000","last_peered":"2023-10-09T11:41:39.025349+0000","last_clean":"2023-10-09T11:41:39.025349+0000","last_became_active":"2023-10-09T11:41:38.016881+0000","last_became_peered":"2023-10-09T11:41:38.016881+0000","last_unstale":"2023-10-09T11:41:39.025349+0000","last_undegraded":"2023-10-09T11:41:39.025349+0000","last_fullsized":"2023-10-09T11:41:39.025349+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028352+0000","last_change":"2023-10-09T11:41:39.028207+0000","last_active":"2023-10-09T11:41:39.028352+0000","last_peered":"2023-10-09T11:41:39.028352+0000","last_clean":"2023-10-09T11:41:39.028352+0000","last_became_active":"2023-10-09T11:41:39.027685+0000","last_became_peered":"2023-10-09T11:41:39.027685+0000","last_unstale":"2023-10-09T11:41:39.028352+0000","last_undegraded":"2023-10-09T11:41:39.028352+0000","last_fullsized":"2023-10-09T11:41:39.028352+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:44:42.885090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"114'8","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047364+0000","last_change":"2023-10-09T11:41:38.020930+0000","last_active":"2023-10-09T11:41:39.047364+0000","last_peered":"2023-10-09T11:41:39.047364+0000","last_clean":"2023-10-09T11:41:39.047364+0000","last_became_active":"2023-10-09T11:41:38.020688+0000","last_became_peered":"2023-10-09T11:41:38.020688+0000","last_unstale":"2023-10-09T11:41:39.047364+0000","last_undegraded":"2023-10-09T11:41:39.047364+0000","last_fullsized":"2023-10-09T11:41:39.047364+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:36.669315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038318+0000","last_change":"2023-10-09T11:41:39.038224+0000","last_active":"2023-10-09T11:41:39.038318+0000","last_peered":"2023-10-09T11:41:39.038318+0000","last_clean":"2023-10-09T11:41:39.038318+0000","last_became_active":"2023-10-09T11:41:39.037952+0000","last_became_peered":"2023-10-09T11:41:39.037952+0000","last_unstale":"2023-10-09T11:41:39.038318+0000","last_undegraded":"2023-10-09T11:41:39.038318+0000","last_fullsized":"2023-10-09T11:41:39.038318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044641+0000","last_change":"2023-10-09T11:41:38.013821+0000","last_active":"2023-10-09T11:41:39.044641+0000","last_peered":"2023-10-09T11:41:39.044641+0000","last_clean":"2023-10-09T11:41:39.044641+0000","last_became_active":"2023-10-09T11:41:38.013452+0000","last_became_peered":"2023-10-09T11:41:38.013452+0000","last_unstale":"2023-10-09T11:41:39.044641+0000","last_undegraded":"2023-10-09T11:41:39.044641+0000","last_fullsized":"2023-10-09T11:41:39.044641+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.029136+0000","last_change":"2023-10-09T11:41:39.029021+0000","last_active":"2023-10-09T11:41:39.029136+0000","last_peered":"2023-10-09T11:41:39.029136+0000","last_clean":"2023-10-09T11:41:39.029136+0000","last_became_active":"2023-10-09T11:41:39.028716+0000","last_became_peered":"2023-10-09T11:41:39.028716+0000","last_unstale":"2023-10-09T11:41:39.029136+0000","last_undegraded":"2023-10-09T11:41:39.029136+0000","last_fullsized":"2023-10-09T11:41:39.029136+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:28:02.522927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.043681+0000","last_change":"2023-10-09T11:41:38.015401+0000","last_active":"2023-10-09T11:41:39.043681+0000","last_peered":"2023-10-09T11:41:39.043681+0000","last_clean":"2023-10-09T11:41:39.043681+0000","last_became_active":"2023-10-09T11:41:38.015189+0000","last_became_peered":"2023-10-09T11:41:38.015189+0000","last_unstale":"2023-10-09T11:41:39.043681+0000","last_undegraded":"2023-10-09T11:41:39.043681+0000","last_fullsized":"2023-10-09T11:41:39.043681+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036640+0000","last_change":"2023-10-09T11:41:39.036423+0000","last_active":"2023-10-09T11:41:39.036640+0000","last_peered":"2023-10-09T11:41:39.036640+0000","last_clean":"2023-10-09T11:41:39.036640+0000","last_became_active":"2023-10-09T11:41:39.036068+0000","last_became_peered":"2023-10-09T11:41:39.036068+0000","last_unstale":"2023-10-09T11:41:39.036640+0000","last_undegraded":"2023-10-09T11:41:39.036640+0000","last_fullsized":"2023-10-09T11:41:39.036640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:12.367332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028683+0000","last_change":"2023-10-09T11:41:38.019813+0000","last_active":"2023-10-09T11:41:39.028683+0000","last_peered":"2023-10-09T11:41:39.028683+0000","last_clean":"2023-10-09T11:41:39.028683+0000","last_became_active":"2023-10-09T11:41:38.019579+0000","last_became_peered":"2023-10-09T11:41:38.019579+0000","last_unstale":"2023-10-09T11:41:39.028683+0000","last_undegraded":"2023-10-09T11:41:39.028683+0000","last_fullsized":"2023-10-09T11:41:39.028683+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:40.255232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.041434+0000","last_change":"2023-10-09T11:41:39.040725+0000","last_active":"2023-10-09T11:41:39.041434+0000","last_peered":"2023-10-09T11:41:39.041434+0000","last_clean":"2023-10-09T11:41:39.041434+0000","last_became_active":"2023-10-09T11:41:39.040150+0000","last_became_peered":"2023-10-09T11:41:39.040150+0000","last_unstale":"2023-10-09T11:41:39.041434+0000","last_undegraded":"2023-10-09T11:41:39.041434+0000","last_fullsized":"2023-10-09T11:41:39.041434+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:16:56.715281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.047523+0000","last_change":"2023-10-09T11:41:38.027229+0000","last_active":"2023-10-09T11:41:39.047523+0000","last_peered":"2023-10-09T11:41:39.047523+0000","last_clean":"2023-10-09T11:41:39.047523+0000","last_became_active":"2023-10-09T11:41:38.026311+0000","last_became_peered":"2023-10-09T11:41:38.026311+0000","last_unstale":"2023-10-09T11:41:39.047523+0000","last_undegraded":"2023-10-09T11:41:39.047523+0000","last_fullsized":"2023-10-09T11:41:39.047523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030609+0000","last_change":"2023-10-09T11:41:39.030482+0000","last_active":"2023-10-09T11:41:39.030609+0000","last_peered":"2023-10-09T11:41:39.030609+0000","last_clean":"2023-10-09T11:41:39.030609+0000","last_became_active":"2023-10-09T11:41:39.030219+0000","last_became_peered":"2023-10-09T11:41:39.030219+0000","last_unstale":"2023-10-09T11:41:39.030609+0000","last_undegraded":"2023-10-09T11:41:39.030609+0000","last_fullsized":"2023-10-09T11:41:39.030609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:08.759568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024294+0000","last_change":"2023-10-09T11:41:38.015308+0000","last_active":"2023-10-09T11:41:39.024294+0000","last_peered":"2023-10-09T11:41:39.024294+0000","last_clean":"2023-10-09T11:41:39.024294+0000","last_became_active":"2023-10-09T11:41:38.015070+0000","last_became_peered":"2023-10-09T11:41:38.015070+0000","last_unstale":"2023-10-09T11:41:39.024294+0000","last_undegraded":"2023-10-09T11:41:39.024294+0000","last_fullsized":"2023-10-09T11:41:39.024294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036205+0000","last_change":"2023-10-09T11:41:39.036118+0000","last_active":"2023-10-09T11:41:39.036205+0000","last_peered":"2023-10-09T11:41:39.036205+0000","last_clean":"2023-10-09T11:41:39.036205+0000","last_became_active":"2023-10-09T11:41:39.035891+0000","last_became_peered":"2023-10-09T11:41:39.035891+0000","last_unstale":"2023-10-09T11:41:39.036205+0000","last_undegraded":"2023-10-09T11:41:39.036205+0000","last_fullsized":"2023-10-09T11:41:39.036205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:21.276927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024179+0000","last_change":"2023-10-09T11:41:38.014367+0000","last_active":"2023-10-09T11:41:39.024179+0000","last_peered":"2023-10-09T11:41:39.024179+0000","last_clean":"2023-10-09T11:41:39.024179+0000","last_became_active":"2023-10-09T11:41:38.014122+0000","last_became_peered":"2023-10-09T11:41:38.014122+0000","last_unstale":"2023-10-09T11:41:39.024179+0000","last_undegraded":"2023-10-09T11:41:39.024179+0000","last_fullsized":"2023-10-09T11:41:39.024179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:10.998975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037722+0000","last_change":"2023-10-09T11:41:39.037664+0000","last_active":"2023-10-09T11:41:39.037722+0000","last_peered":"2023-10-09T11:41:39.037722+0000","last_clean":"2023-10-09T11:41:39.037722+0000","last_became_active":"2023-10-09T11:41:39.037161+0000","last_became_peered":"2023-10-09T11:41:39.037161+0000","last_unstale":"2023-10-09T11:41:39.037722+0000","last_undegraded":"2023-10-09T11:41:39.037722+0000","last_fullsized":"2023-10-09T11:41:39.037722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:44:45.050667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028191+0000","last_change":"2023-10-09T11:41:38.026542+0000","last_active":"2023-10-09T11:41:39.028191+0000","last_peered":"2023-10-09T11:41:39.028191+0000","last_clean":"2023-10-09T11:41:39.028191+0000","last_became_active":"2023-10-09T11:41:38.026285+0000","last_became_peered":"2023-10-09T11:41:38.026285+0000","last_unstale":"2023-10-09T11:41:39.028191+0000","last_undegraded":"2023-10-09T11:41:39.028191+0000","last_fullsized":"2023-10-09T11:41:39.028191+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:28:34.601034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.032120+0000","last_change":"2023-10-09T11:41:39.031577+0000","last_active":"2023-10-09T11:41:39.032120+0000","last_peered":"2023-10-09T11:41:39.032120+0000","last_clean":"2023-10-09T11:41:39.032120+0000","last_became_active":"2023-10-09T11:41:39.030979+0000","last_became_peered":"2023-10-09T11:41:39.030979+0000","last_unstale":"2023-10-09T11:41:39.032120+0000","last_undegraded":"2023-10-09T11:41:39.032120+0000","last_fullsized":"2023-10-09T11:41:39.032120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:50.237685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"114'2","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044009+0000","last_change":"2023-10-09T11:41:38.014875+0000","last_active":"2023-10-09T11:41:39.044009+0000","last_peered":"2023-10-09T11:41:39.044009+0000","last_clean":"2023-10-09T11:41:39.044009+0000","last_became_active":"2023-10-09T11:41:38.014371+0000","last_became_peered":"2023-10-09T11:41:38.014371+0000","last_unstale":"2023-10-09T11:41:39.044009+0000","last_undegraded":"2023-10-09T11:41:39.044009+0000","last_fullsized":"2023-10-09T11:41:39.044009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.977728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.035107+0000","last_change":"2023-10-09T11:41:39.034970+0000","last_active":"2023-10-09T11:41:39.035107+0000","last_peered":"2023-10-09T11:41:39.035107+0000","last_clean":"2023-10-09T11:41:39.035107+0000","last_became_active":"2023-10-09T11:41:39.034561+0000","last_became_peered":"2023-10-09T11:41:39.034561+0000","last_unstale":"2023-10-09T11:41:39.035107+0000","last_undegraded":"2023-10-09T11:41:39.035107+0000","last_fullsized":"2023-10-09T11:41:39.035107+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:48.922825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027955+0000","last_change":"2023-10-09T11:41:38.027494+0000","last_active":"2023-10-09T11:41:39.027955+0000","last_peered":"2023-10-09T11:41:39.027955+0000","last_clean":"2023-10-09T11:41:39.027955+0000","last_became_active":"2023-10-09T11:41:38.026728+0000","last_became_peered":"2023-10-09T11:41:38.026728+0000","last_unstale":"2023-10-09T11:41:39.027955+0000","last_undegraded":"2023-10-09T11:41:39.027955+0000","last_fullsized":"2023-10-09T11:41:39.027955+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:15.041672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037514+0000","last_change":"2023-10-09T11:41:39.037445+0000","last_active":"2023-10-09T11:41:39.037514+0000","last_peered":"2023-10-09T11:41:39.037514+0000","last_clean":"2023-10-09T11:41:39.037514+0000","last_became_active":"2023-10-09T11:41:39.037227+0000","last_became_peered":"2023-10-09T11:41:39.037227+0000","last_unstale":"2023-10-09T11:41:39.037514+0000","last_undegraded":"2023-10-09T11:41:39.037514+0000","last_fullsized":"2023-10-09T11:41:39.037514+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:23:05.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027736+0000","last_change":"2023-10-09T11:41:38.023342+0000","last_active":"2023-10-09T11:41:39.027736+0000","last_peered":"2023-10-09T11:41:39.027736+0000","last_clean":"2023-10-09T11:41:39.027736+0000","last_became_active":"2023-10-09T11:41:38.020743+0000","last_became_peered":"2023-10-09T11:41:38.020743+0000","last_unstale":"2023-10-09T11:41:39.027736+0000","last_undegraded":"2023-10-09T11:41:39.027736+0000","last_fullsized":"2023-10-09T11:41:39.027736+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.036418+0000","last_change":"2023-10-09T11:41:39.036263+0000","last_active":"2023-10-09T11:41:39.036418+0000","last_peered":"2023-10-09T11:41:39.036418+0000","last_clean":"2023-10-09T11:41:39.036418+0000","last_became_active":"2023-10-09T11:41:39.036049+0000","last_became_peered":"2023-10-09T11:41:39.036049+0000","last_unstale":"2023-10-09T11:41:39.036418+0000","last_undegraded":"2023-10-09T11:41:39.036418+0000","last_fullsized":"2023-10-09T11:41:39.036418+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:48.777991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030470+0000","last_change":"2023-10-09T11:41:38.020414+0000","last_active":"2023-10-09T11:41:39.030470+0000","last_peered":"2023-10-09T11:41:39.030470+0000","last_clean":"2023-10-09T11:41:39.030470+0000","last_became_active":"2023-10-09T11:41:38.020197+0000","last_became_peered":"2023-10-09T11:41:38.020197+0000","last_unstale":"2023-10-09T11:41:39.030470+0000","last_undegraded":"2023-10-09T11:41:39.030470+0000","last_fullsized":"2023-10-09T11:41:39.030470+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:07.301979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.030551+0000","last_change":"2023-10-09T11:41:39.028358+0000","last_active":"2023-10-09T11:41:39.030551+0000","last_peered":"2023-10-09T11:41:39.030551+0000","last_clean":"2023-10-09T11:41:39.030551+0000","last_became_active":"2023-10-09T11:41:39.027978+0000","last_became_peered":"2023-10-09T11:41:39.027978+0000","last_unstale":"2023-10-09T11:41:39.030551+0000","last_undegraded":"2023-10-09T11:41:39.030551+0000","last_fullsized":"2023-10-09T11:41:39.030551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:01.412766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028284+0000","last_change":"2023-10-09T11:41:38.018380+0000","last_active":"2023-10-09T11:41:39.028284+0000","last_peered":"2023-10-09T11:41:39.028284+0000","last_clean":"2023-10-09T11:41:39.028284+0000","last_became_active":"2023-10-09T11:41:38.018141+0000","last_became_peered":"2023-10-09T11:41:38.018141+0000","last_unstale":"2023-10-09T11:41:39.028284+0000","last_undegraded":"2023-10-09T11:41:39.028284+0000","last_fullsized":"2023-10-09T11:41:39.028284+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:05.219675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.034869+0000","last_change":"2023-10-09T11:41:39.034802+0000","last_active":"2023-10-09T11:41:39.034869+0000","last_peered":"2023-10-09T11:41:39.034869+0000","last_clean":"2023-10-09T11:41:39.034869+0000","last_became_active":"2023-10-09T11:41:39.034552+0000","last_became_peered":"2023-10-09T11:41:39.034552+0000","last_unstale":"2023-10-09T11:41:39.034869+0000","last_undegraded":"2023-10-09T11:41:39.034869+0000","last_fullsized":"2023-10-09T11:41:39.034869+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:02:05.046411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028145+0000","last_change":"2023-10-09T11:41:38.018063+0000","last_active":"2023-10-09T11:41:39.028145+0000","last_peered":"2023-10-09T11:41:39.028145+0000","last_clean":"2023-10-09T11:41:39.028145+0000","last_became_active":"2023-10-09T11:41:38.017768+0000","last_became_peered":"2023-10-09T11:41:38.017768+0000","last_unstale":"2023-10-09T11:41:39.028145+0000","last_undegraded":"2023-10-09T11:41:39.028145+0000","last_fullsized":"2023-10-09T11:41:39.028145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:20.261592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.026974+0000","last_change":"2023-10-09T11:41:39.026917+0000","last_active":"2023-10-09T11:41:39.026974+0000","last_peered":"2023-10-09T11:41:39.026974+0000","last_clean":"2023-10-09T11:41:39.026974+0000","last_became_active":"2023-10-09T11:41:39.026731+0000","last_became_peered":"2023-10-09T11:41:39.026731+0000","last_unstale":"2023-10-09T11:41:39.026974+0000","last_undegraded":"2023-10-09T11:41:39.026974+0000","last_fullsized":"2023-10-09T11:41:39.026974+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:18.014998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.027147+0000","last_change":"2023-10-09T11:41:38.018141+0000","last_active":"2023-10-09T11:41:39.027147+0000","last_peered":"2023-10-09T11:41:39.027147+0000","last_clean":"2023-10-09T11:41:39.027147+0000","last_became_active":"2023-10-09T11:41:38.017497+0000","last_became_peered":"2023-10-09T11:41:38.017497+0000","last_unstale":"2023-10-09T11:41:39.027147+0000","last_undegraded":"2023-10-09T11:41:39.027147+0000","last_fullsized":"2023-10-09T11:41:39.027147+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:29.649576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.037123+0000","last_change":"2023-10-09T11:41:39.036839+0000","last_active":"2023-10-09T11:41:39.037123+0000","last_peered":"2023-10-09T11:41:39.037123+0000","last_clean":"2023-10-09T11:41:39.037123+0000","last_became_active":"2023-10-09T11:41:39.034718+0000","last_became_peered":"2023-10-09T11:41:39.034718+0000","last_unstale":"2023-10-09T11:41:39.037123+0000","last_undegraded":"2023-10-09T11:41:39.037123+0000","last_fullsized":"2023-10-09T11:41:39.037123+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:31:15.893650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.024638+0000","last_change":"2023-10-09T11:41:38.027098+0000","last_active":"2023-10-09T11:41:39.024638+0000","last_peered":"2023-10-09T11:41:39.024638+0000","last_clean":"2023-10-09T11:41:39.024638+0000","last_became_active":"2023-10-09T11:41:38.025975+0000","last_became_peered":"2023-10-09T11:41:38.025975+0000","last_unstale":"2023-10-09T11:41:39.024638+0000","last_undegraded":"2023-10-09T11:41:39.024638+0000","last_fullsized":"2023-10-09T11:41:39.024638+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:19:06.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.038025+0000","last_change":"2023-10-09T11:41:39.037955+0000","last_active":"2023-10-09T11:41:39.038025+0000","last_peered":"2023-10-09T11:41:39.038025+0000","last_clean":"2023-10-09T11:41:39.038025+0000","last_became_active":"2023-10-09T11:41:39.037594+0000","last_became_peered":"2023-10-09T11:41:39.037594+0000","last_unstale":"2023-10-09T11:41:39.038025+0000","last_undegraded":"2023-10-09T11:41:39.038025+0000","last_fullsized":"2023-10-09T11:41:39.038025+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:38.006644+0000","last_clean_scrub_stamp":"2023-10-09T11:41:38.006644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:42.034439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"114'1","reported_seq":11,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.044176+0000","last_change":"2023-10-09T11:41:38.022601+0000","last_active":"2023-10-09T11:41:39.044176+0000","last_peered":"2023-10-09T11:41:39.044176+0000","last_clean":"2023-10-09T11:41:39.044176+0000","last_became_active":"2023-10-09T11:41:38.022412+0000","last_became_peered":"2023-10-09T11:41:38.022412+0000","last_unstale":"2023-10-09T11:41:39.044176+0000","last_undegraded":"2023-10-09T11:41:39.044176+0000","last_fullsized":"2023-10-09T11:41:39.044176+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:41:37.000113+0000","last_clean_scrub_stamp":"2023-10-09T11:41:37.000113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:51:47.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":243,"reported_epoch":114,"state":"active+clean","last_fresh":"2023-10-09T11:41:39.028846+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:41:39.028846+0000","last_peered":"2023-10-09T11:41:39.028846+0000","last_clean":"2023-10-09T11:41:39.028846+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:41:39.028846+0000","last_undegraded":"2023-10-09T11:41:39.028846+0000","last_fullsized":"2023-10-09T11:41:39.028846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1190,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198781192,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.35299999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":0.878,"15min":0.878},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65800000000000003,"5min":1.048,"15min":1.048},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":1.079,"15min":1.079},"last":0.46400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68000000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45600000000000002,"15min":0.442},"min":{"1min":0.311,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.46100000000000002},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73399999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.5,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":614,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.35399999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76600000000000001,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.497},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57999999999999996,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72199999999999998,"5min":5.298,"15min":5.298},"last":0.435},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.67400000000000004},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69399999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":1.617,"15min":1.617},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59099999999999997,"15min":0.69699999999999995},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":5.46,"15min":5.46},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74299999999999999,"5min":5.3949999999999996,"15min":5.3949999999999996},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66300000000000003,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48099999999999998,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71399999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50800000000000001,"15min":0.48999999999999999},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.873,"15min":0.873},"last":0.504}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36199999999999999,"15min":0.39900000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.623,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39400000000000002,"15min":0.442},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.56599999999999995,"5min":2.004,"15min":2.004},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58899999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.27100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.28599999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45000000000000001,"15min":0.48199999999999998},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":1.909,"15min":1.909},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.432,"15min":0.46500000000000002},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67000000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.625},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83799999999999997,"5min":1.869,"15min":1.869},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.55300000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.66600000000000004},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90600000000000003,"5min":1.952,"15min":1.952},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.47999999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":1.782,"15min":1.782},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.819,"15min":1.819},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1189,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194122,"statfs":{"total":200000000,"available":198781761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.45600000000000002,"15min":0.41699999999999998},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":6.8959999999999999,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.25,"5min":0.22,"15min":0.22},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.27400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.42299999999999999},"min":{"1min":0.26800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.45100000000000001,"15min":0.50900000000000001},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4289999999999998,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.30299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.496},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2999999999999998,"5min":3.9340000000000002,"15min":3.9340000000000002},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.66000000000000003,"15min":0.70399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.379,"5min":3.976,"15min":3.976},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71399999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.3410000000000002,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371638,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.32300000000000001},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55500000000000005,"5min":0.622,"15min":0.622},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.379,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58499999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.34000000000000002},"min":{"1min":0.29699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61599999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.82399999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.71199999999999997,"5min":11.055,"15min":11.055},"last":0.378}]},{"osd":3,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.41299999999999998,"15min":0.376},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.39700000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63800000000000001,"15min":0.60799999999999998},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68300000000000005,"15min":0.70899999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1279999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66400000000000003,"15min":0.65000000000000002},"min":{"1min":0.43099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370114,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35499999999999998,"15min":0.375},"min":{"1min":0.23699999999999999,"5min":0.19,"15min":0.19},"max":{"1min":0.64800000000000002,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.25},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61199999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.26700000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55700000000000005,"5min":1.034,"15min":1.034},"last":0.433},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72899999999999998,"5min":1.335,"15min":1.335},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67800000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69499999999999995,"5min":1.405,"15min":1.405},"last":0.373}]},{"osd":4,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80900000000000005,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81000000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86299999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.40100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.387,"15min":1.387},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 11:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93000000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194697,"statfs":{"total":200000000,"available":199370012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.75900000000000001},"min":{"1min":0.372,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":7.4210000000000003,"15min":7.4210000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.80900000000000005},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":7.4459999999999997,"15min":7.4459999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.53200000000000003},"min":{"1min":0.41899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55700000000000005,"15min":0.61699999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68100000000000005,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.70399999999999996},"min":{"1min":0.44400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":5.274,"15min":5.274},"last":0.435}]},{"osd":3,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.80800000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.749,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.65300000000000002,"15min":0.82699999999999996},"min":{"1min":0.45600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.71699999999999997,"5min":7.5460000000000003,"15min":7.5460000000000003},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36499999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78100000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194698,"statfs":{"total":200000000,"available":199371602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72799999999999998,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65500000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77900000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79200000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.29199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53000000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.46000000000000002,"15min":0.48599999999999999},"min":{"1min":0.30599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60899999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44900000000000001,"15min":0.47699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.58099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51100000000000001,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.60199999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]}]}],"pool_statfs":[]}} 2023-10-09T11:41:48.064 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:41:48.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:41:48.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.226+0000 7f53101ac700 1 Processor -- start 2023-10-09T11:41:48.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.226+0000 7f53101ac700 1 -- start start 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f53101ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5308157b90 0x7f53080cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f53101ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080cca80 con 0x7f53081577c0 2023-10-09T11:41:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f53101ac700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080cedd0 con 0x7f5308068f20 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f53101ac700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080cc4c0 con 0x7f5308157b90 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530df48700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f53081577c0 0x7f5308068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49822/0 (socket says 172.21.15.6:49822) 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530df48700 1 -- 172.21.15.6:0/4519557 learned_addr learned my addr 172.21.15.6:0/4519557 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89485908 0 0) 0x7f53080cca80 con 0x7f53081577c0 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530e749700 1 --2- 172.21.15.6:0/4519557 >> v2:172.21.15.118:3300/0 conn(0x7f5308157b90 0x7f53080cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003570 con 0x7f53081577c0 2023-10-09T11:41:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2777858549 0 0) 0x7f52f0003570 con 0x7f53081577c0 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 >> v2:172.21.15.118:3300/0 conn(0x7f5308157b90 msgr2=0x7f53080cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 --2- 172.21.15.6:0/4519557 >> v2:172.21.15.118:3300/0 conn(0x7f5308157b90 0x7f53080cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 >> v1:172.21.15.118:6789/0 conn(0x7f5308068f20 legacy=0x7f53080cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080cc7a0 con 0x7f53081577c0 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f52f8001470 con 0x7f53081577c0 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 >> v1:172.21.15.6:6789/0 conn(0x7f53081577c0 legacy=0x7f5308068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080cc4c0 con 0x7f52f0004810 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000c0d0 con 0x7f52f0003a60 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000c290 con 0x7f52f00051c0 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.227+0000 7f530d747700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530df48700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530e749700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 -- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52f00051c0 msgr2=0x7f52f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52f00051c0 0x7f52f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 -- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f0003a60 msgr2=0x7f52f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f0003a60 0x7f52f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 -- 172.21.15.6:0/4519557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0003570 con 0x7f52f0004810 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530e749700 1 -- 172.21.15.6:0/4519557 reap_dead start 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530d747700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f52f0004c80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f52fc001880 tx=0x7f52fc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da7b6dec51ad35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc012420 con 0x7f52f0004810 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0125a0 con 0x7f52f0004810 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.228+0000 7f530cf46700 1 -- 172.21.15.6:0/4519557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc012960 con 0x7f52f0004810 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 -- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 msgr2=0x7f52f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f52f0004c80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f52fc001880 tx=0x7f52fc007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:48.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 -- 172.21.15.6:0/4519557 shutdown_connections 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 --2- 172.21.15.6:0/4519557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f52f0004c80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 -- 172.21.15.6:0/4519557 >> 172.21.15.6:0/4519557 conn(0x7f53080d0df0 msgr2=0x7f53080d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 -- 172.21.15.6:0/4519557 shutdown_connections 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.229+0000 7f53101ac700 1 -- 172.21.15.6:0/4519557 wait complete. 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.230+0000 7f53101ac700 1 Processor -- start 2023-10-09T11:41:48.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.230+0000 7f53101ac700 1 -- start start 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 0x7f530806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5308158ff0 0x7f5308159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308149e70 con 0x7f52f0004810 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081599a0 con 0x7f5308158ff0 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530806dca0 con 0x7f530806e610 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32864/0 (socket says 172.21.15.6:32864) 2023-10-09T11:41:48.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 -- 172.21.15.6:0/1599208112 learned_addr learned my addr 172.21.15.6:0/1599208112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530d747700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 0x7f530806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530e749700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5308158ff0 0x7f5308159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 -- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 msgr2=0x7f530806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 0x7f530806ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 -- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5308158ff0 msgr2=0x7f5308159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5308158ff0 0x7f5308159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 -- 172.21.15.6:0/1599208112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530806d0d0 con 0x7f52f0004810 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530d747700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 0x7f530806ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f530df48700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f52f8000f60 tx=0x7f52f8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8018030 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800f5e0 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530806d370 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.231+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800f9a0 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.232+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530806d930 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.233+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308067a50 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.233+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52f801b070 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.233+0000 7f5305ffb700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.233+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52f8019070 con 0x7f52f0004810 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.234+0000 7f530d747700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.234+0000 7f530d747700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52fc001690 tx=0x7f52fc015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.238+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52f8051830 con 0x7f52f0004810 2023-10-09T11:41:48.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.508+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53080cea60 con 0x7f52f0004810 2023-10-09T11:41:48.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.512+0000 7f5305ffb700 1 -- 172.21.15.6:0/1599208112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f52f8054e50 con 0x7f52f0004810 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 msgr2=0x7f52f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52fc001690 tx=0x7f52fc015000 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 msgr2=0x7f5308149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f52f8000f60 tx=0x7f52f8001e50 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 shutdown_connections 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5308158ff0 0x7f5308159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f0004810 0x7f5308149930 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 --2- 172.21.15.6:0/1599208112 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f530806e610 0x7f530806ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 >> 172.21.15.6:0/1599208112 conn(0x7f53080d0df0 msgr2=0x7f53080c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 shutdown_connections 2023-10-09T11:41:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.514+0000 7f53101ac700 1 -- 172.21.15.6:0/1599208112 wait complete. 2023-10-09T11:41:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:41:48.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.645+0000 7f8d18214700 1 Processor -- start 2023-10-09T11:41:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.645+0000 7f8d18214700 1 -- start start 2023-10-09T11:41:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d18214700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d1006d830 0x7f8d100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d18214700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d100d07c0 con 0x7f8d10157ca0 2023-10-09T11:41:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d18214700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d100cfbb0 con 0x7f8d101578d0 2023-10-09T11:41:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d18214700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d100cfe90 con 0x7f8d1006d830 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d167b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d1006d830 0x7f8d100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d157af700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8d10157ca0 0x7f8d1006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49836/0 (socket says 172.21.15.6:49836) 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.646+0000 7f8d157af700 1 -- 172.21.15.6:0/3518815122 learned_addr learned my addr 172.21.15.6:0/3518815122 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d167b1700 1 -- 172.21.15.6:0/3518815122 >> v1:172.21.15.118:6789/0 conn(0x7f8d101578d0 legacy=0x7f8d1015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d167b1700 1 -- 172.21.15.6:0/3518815122 >> v1:172.21.15.6:6789/0 conn(0x7f8d10157ca0 legacy=0x7f8d1006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d167b1700 1 -- 172.21.15.6:0/3518815122 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100d0170 con 0x7f8d1006d830 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d14fae700 1 -- 172.21.15.6:0/3518815122 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969196474 0 0) 0x7f8d100d07c0 con 0x7f8d10157ca0 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d167b1700 1 --2- 172.21.15.6:0/3518815122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1006d830 0x7f8d100cf4f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8d080098e0 tx=0x7f8d080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4abad8c15c279 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d14fae700 1 -- 172.21.15.6:0/3518815122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08009e80 con 0x7f8d1006d830 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d14fae700 1 -- 172.21.15.6:0/3518815122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800b820 con 0x7f8d1006d830 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d14fae700 1 -- 172.21.15.6:0/3518815122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800bba0 con 0x7f8d1006d830 2023-10-09T11:41:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d18214700 1 -- 172.21.15.6:0/3518815122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1006d830 msgr2=0x7f8d100cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.647+0000 7f8d18214700 1 --2- 172.21.15.6:0/3518815122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1006d830 0x7f8d100cf4f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8d080098e0 tx=0x7f8d080091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.648+0000 7f8d18214700 1 -- 172.21.15.6:0/3518815122 shutdown_connections 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.648+0000 7f8d18214700 1 --2- 172.21.15.6:0/3518815122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1006d830 0x7f8d100cf4f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.648+0000 7f8d18214700 1 -- 172.21.15.6:0/3518815122 >> 172.21.15.6:0/3518815122 conn(0x7f8d1006bb90 msgr2=0x7f8d1006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.648+0000 7f8d18214700 1 -- 172.21.15.6:0/3518815122 shutdown_connections 2023-10-09T11:41:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.648+0000 7f8d18214700 1 -- 172.21.15.6:0/3518815122 wait complete. 2023-10-09T11:41:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 Processor -- start 2023-10-09T11:41:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 -- start start 2023-10-09T11:41:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d1006d830 0x7f8d10069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d101578d0 0x7f8d10155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10155a90 con 0x7f8d10157ca0 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1016a810 con 0x7f8d1006d830 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.649+0000 7f8d18214700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1016aaf0 con 0x7f8d101578d0 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32870/0 (socket says 172.21.15.6:32870) 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 -- 172.21.15.6:0/4110026009 learned_addr learned my addr 172.21.15.6:0/4110026009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d15fb0700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d1006d830 0x7f8d10069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d157af700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d101578d0 0x7f8d10155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 -- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d101578d0 msgr2=0x7f8d10155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d101578d0 0x7f8d10155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 -- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d1006d830 msgr2=0x7f8d10069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d1006d830 0x7f8d10069b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 -- 172.21.15.6:0/4110026009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009420 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d167b1700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8d080093f0 tx=0x7f8d08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800bb60 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d08020070 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1016add0 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.650+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0801b6a0 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.651+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1016b390 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.651+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1016b580 con 0x7f8d10157ca0 2023-10-09T11:41:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.652+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d08022030 con 0x7f8d10157ca0 2023-10-09T11:41:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.652+0000 7f8d0dffb700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 0x7f8cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.652+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d08086640 con 0x7f8d10157ca0 2023-10-09T11:41:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.652+0000 7f8d15fb0700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 0x7f8cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.653+0000 7f8d15fb0700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 0x7f8cfc0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d00007fd0 tx=0x7f8d000026a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.657+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d080538b0 con 0x7f8d10157ca0 2023-10-09T11:41:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.899+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d1016b580 con 0x7f8d10157ca0 2023-10-09T11:41:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.900+0000 7f8d0dffb700 1 -- 172.21.15.6:0/4110026009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8d08056ed0 con 0x7f8d10157ca0 2023-10-09T11:41:48.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:48.901 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 msgr2=0x7f8cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 0x7f8cfc0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d00007fd0 tx=0x7f8d000026a0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 msgr2=0x7f8d10155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8d080093f0 tx=0x7f8d08016000 comp rx=0 tx=0).stop 2023-10-09T11:41:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 shutdown_connections 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8cfc066f30 0x7f8cfc0693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d10157ca0 0x7f8d10155550 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d1006d830 0x7f8d10069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 --2- 172.21.15.6:0/4110026009 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d101578d0 0x7f8d10155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 >> 172.21.15.6:0/4110026009 conn(0x7f8d1006bb90 msgr2=0x7f8d101568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 shutdown_connections 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:48.902+0000 7f8d18214700 1 -- 172.21.15.6:0/4110026009 wait complete. 2023-10-09T11:41:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:49.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:41:38.419450+0000', 'modified': '2023-10-09T11:41:42.044145+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/2798220359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6835', 'nonce': 2798220359}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 2798220359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:41:49.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:41:49.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:41:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.438+0000 7f8c143dd700 1 Processor -- start 2023-10-09T11:41:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.438+0000 7f8c143dd700 1 -- start start 2023-10-09T11:41:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c143dd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c143dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c06d120 0x7f8c0c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c143dd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0d07c0 con 0x7f8c0c157ca0 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c143dd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c06daa0 con 0x7f8c0c1578d0 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c143dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0cfbb0 con 0x7f8c0c06d120 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.439+0000 7f8c12179700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32878/0 (socket says 172.21.15.6:32878) 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 -- 172.21.15.6:0/3106429962 learned_addr learned my addr 172.21.15.6:0/3106429962 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c1297a700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c06d120 0x7f8c0c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 -- 172.21.15.6:0/3106429962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c06d120 msgr2=0x7f8c0c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c06d120 0x7f8c0c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 -- 172.21.15.6:0/3106429962 >> v1:172.21.15.118:6789/0 conn(0x7f8c0c157ca0 legacy=0x7f8c0c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 -- 172.21.15.6:0/3106429962 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0cfe90 con 0x7f8c0c1578d0 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c12179700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0099b0 tx=0x7f8bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e3f4c04424a0df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c11177700 1 -- 172.21.15.6:0/3106429962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00b860 con 0x7f8c0c1578d0 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c11177700 1 -- 172.21.15.6:0/3106429962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00b9c0 con 0x7f8c0c1578d0 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.440+0000 7f8c11177700 1 -- 172.21.15.6:0/3106429962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00bd60 con 0x7f8c0c1578d0 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 -- 172.21.15.6:0/3106429962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c1578d0 msgr2=0x7f8c0c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0099b0 tx=0x7f8bfc009250 comp rx=0 tx=0).stop 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 -- 172.21.15.6:0/3106429962 shutdown_connections 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c06d120 0x7f8c0c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 --2- 172.21.15.6:0/3106429962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c1578d0 0x7f8c0c0cf4f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 -- 172.21.15.6:0/3106429962 >> 172.21.15.6:0/3106429962 conn(0x7f8c0c06bb90 msgr2=0x7f8c0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 -- 172.21.15.6:0/3106429962 shutdown_connections 2023-10-09T11:41:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.441+0000 7f8c143dd700 1 -- 172.21.15.6:0/3106429962 wait complete. 2023-10-09T11:41:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.442+0000 7f8c143dd700 1 Processor -- start 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.442+0000 7f8c143dd700 1 -- start start 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c1578d0 0x7f8c0c0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 0x7f8c0c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b53d0 con 0x7f8c0c06d120 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b56b0 con 0x7f8c0c157ca0 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b5990 con 0x7f8c0c1578d0 2023-10-09T11:41:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32880/0 (socket says 172.21.15.6:32880) 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 -- 172.21.15.6:0/2151040488 learned_addr learned my addr 172.21.15.6:0/2151040488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c1297a700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 0x7f8c0c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c11978700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c1578d0 0x7f8c0c0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 -- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c1578d0 msgr2=0x7f8c0c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c1578d0 0x7f8c0c0b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 -- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 msgr2=0x7f8c0c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 0x7f8c0c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 -- 172.21.15.6:0/2151040488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0094f0 con 0x7f8c0c06d120 2023-10-09T11:41:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c1297a700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 0x7f8c0c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c12179700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06fe20 tx=0x7f8bfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c0a7fc700 1 -- 172.21.15.6:0/2151040488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc024440 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c0a7fc700 1 -- 172.21.15.6:0/2151040488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0245c0 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c0b5c70 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c0a7fc700 1 -- 172.21.15.6:0/2151040488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc024980 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.443+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c155250 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.445+0000 7f8c0a7fc700 1 -- 172.21.15.6:0/2151040488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bfc01a420 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.445+0000 7f8c0a7fc700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.445+0000 7f8c0a7fc700 1 -- 172.21.15.6:0/2151040488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bfc086350 con 0x7f8c0c06d120 2023-10-09T11:41:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.445+0000 7f8c11978700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.446+0000 7f8c11978700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c1580c0 tx=0x7f8c00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.447+0000 7f8c1d6d5b80 1 Processor -- start 2023-10-09T11:41:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.447+0000 7f8c1d6d5b80 1 -- start start 2023-10-09T11:41:49.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d2f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d31fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d24da70 con 0x557c2d31ff60 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d24b270 con 0x557c2d2f6a50 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c2d247060 con 0x557c2d340d00 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32896/0 (socket says 172.21.15.6:32896) 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 -- 172.21.15.6:0/3872896079 learned_addr learned my addr 172.21.15.6:0/3872896079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c12179700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d2f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c11978700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d31fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 -- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 msgr2=0x557c2d31fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d31fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 -- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 msgr2=0x557c2d2f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d2f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c1297a700 1 -- 172.21.15.6:0/3872896079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c2d0e1270 con 0x557c2d31ff60 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.448+0000 7f8c11978700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d31fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1297a700 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8c04007520 tx=0x7f8c0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad1a8c969fd4747 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8bf37fe700 1 -- 172.21.15.6:0/3872896079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04007e30 con 0x557c2d31ff60 2023-10-09T11:41:49.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8bf37fe700 1 -- 172.21.15.6:0/3872896079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400f050 con 0x557c2d31ff60 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8bf37fe700 1 -- 172.21.15.6:0/3872896079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04014830 con 0x557c2d31ff60 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/3872896079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 msgr2=0x557c2d2f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8c04007520 tx=0x7f8c0400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/3872896079 shutdown_connections 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d2f2cf0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d2f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/3872896079 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d31fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/3872896079 >> 172.21.15.6:0/3872896079 conn(0x557c2d2f8370 msgr2=0x557c2d2f8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/3872896079 shutdown_connections 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.449+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/3872896079 wait complete. 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.450+0000 7f8c1d6d5b80 1 -- start start 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.450+0000 7f8c1d6d5b80 1 Processor -- start 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d31ff60 0x557c2d34cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d336090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d1f2890 con 0x557c2d2f6a50 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d20dea0 con 0x557c2d340d00 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c2d0c9e30 con 0x557c2d31ff60 2023-10-09T11:41:49.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1d6d5b80 10 client.0 _ll_register_callbacks cb 0x557c2d2ba110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32898/0 (socket says 172.21.15.6:32898) 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 -- 172.21.15.6:0/1193642884 learned_addr learned my addr 172.21.15.6:0/1193642884 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 -- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d31ff60 msgr2=0x557c2d34cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c1297a700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d336090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d31ff60 0x557c2d34cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 -- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 msgr2=0x557c2d336090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d336090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.451+0000 7f8c12179700 1 -- 172.21.15.6:0/1193642884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c04009da0 con 0x557c2d2f6a50 2023-10-09T11:41:49.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c12179700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc057210 tx=0x7f8bfc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e815cc24bdc7703f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc05e220 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bfc0860b0 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c2d2ebb70 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bfc02b550 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 10 client.6879 fetch_fsmap learned FSMap version 60 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x557c2d083fe0 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc082080 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8bfc0574e0 con 0x557c2d2f6a50 2023-10-09T11:41:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 10 client.6879 fetch_fsmap finished waiting for FSMap version 60 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 10 client.6879 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 20 client.6879 populate_metadata read hostname 'smithi006' 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f1c20 0x557c2d2f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 4 client.6879 mds_command: new command op to 6714 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 --> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c2d2c8aa0 con 0x557c2d2f1c20 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.452+0000 7f8c11978700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f1c20 0x557c2d2f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8bf0ff9700 10 client.6879 ms_handle_connect on v2:172.21.15.6:6835/2798220359 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c11978700 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f1c20 0x557c2d2f1ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af93faa57a3114b server_cookie=815c58efa639248 in_seq=0 out_seq=0 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/1193642884 <== mds.0 v2:172.21.15.6:6835/2798220359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557c2d2c8aa0 con 0x557c2d2f1c20 2023-10-09T11:41:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8bf0ff9700 10 client.6879 handle_command_reply: tid=0 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 client.6879 shutdown 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 msgr2=0x557c2d339300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc057210 tx=0x7f8bfc086040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 shutdown_connections 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f1c20 0x557c2d2f1ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d336090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d2f6a50 0x557c2d339300 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.453+0000 7f8bf0ff9700 0 client.6879 ms_handle_reset on v2:172.21.15.6:6835/2798220359 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.454+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1193642884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d31ff60 0x557c2d34cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.454+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 >> 172.21.15.6:0/1193642884 conn(0x557c2d2f8370 msgr2=0x557c2d2f2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.454+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 shutdown_connections 2023-10-09T11:41:49.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.454+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1193642884 wait complete. 2023-10-09T11:41:49.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.454+0000 7f8c1d6d5b80 20 client.6879 trim_cache size 0 max 16384 2023-10-09T11:41:49.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 Processor -- start 2023-10-09T11:41:49.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 -- start start 2023-10-09T11:41:49.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d2f6a50 0x557c2d3406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d33c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d2f5a90 con 0x557c2d31ff60 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d2f9c50 con 0x557c2d340d00 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c2d325b10 con 0x557c2d2f6a50 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c11978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c11978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32908/0 (socket says 172.21.15.6:32908) 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.471+0000 7f8c11978700 1 -- 172.21.15.6:0/1502894727 learned_addr learned my addr 172.21.15.6:0/1502894727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 -- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d2f6a50 msgr2=0x557c2d3406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d2f6a50 0x557c2d3406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 -- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 msgr2=0x557c2d33c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d33c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 -- 172.21.15.6:0/1502894727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c2d215780 con 0x557c2d31ff60 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c11978700 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8c00003ee0 tx=0x7f8c00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6be6a4ec65741 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8bf3fff700 1 -- 172.21.15.6:0/1502894727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00014db0 con 0x557c2d31ff60 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8bf3fff700 1 -- 172.21.15.6:0/1502894727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00024a70 con 0x557c2d31ff60 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8bf3fff700 1 -- 172.21.15.6:0/1502894727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00024be0 con 0x557c2d31ff60 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1502894727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 msgr2=0x557c2d33c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.472+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8c00003ee0 tx=0x7f8c00013000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1502894727 shutdown_connections 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d340d00 0x557c2d33c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d2f6a50 0x557c2d3406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/1502894727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d33c480 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1502894727 >> 172.21.15.6:0/1502894727 conn(0x557c2d2f8370 msgr2=0x557c2d33b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1502894727 shutdown_connections 2023-10-09T11:41:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/1502894727 wait complete. 2023-10-09T11:41:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 -- start start 2023-10-09T11:41:49.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.473+0000 7f8c1d6d5b80 1 Processor -- start 2023-10-09T11:41:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d3a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d33c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d2ef6e0 con 0x557c2d31ff60 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c2d3a4040 con 0x557c2d2f6a50 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c2d320fb0 con 0x557c2d340d00 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1d6d5b80 10 client.0 _ll_register_callbacks cb 0x557c2d2ba110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32922/0 (socket says 172.21.15.6:32922) 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 -- 172.21.15.6:0/2428405111 learned_addr learned my addr 172.21.15.6:0/2428405111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c12179700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d3a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c1297a700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d33c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 -- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 msgr2=0x557c2d33c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d33c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 -- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 msgr2=0x557c2d3a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.474+0000 7f8c11978700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d3a3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c11978700 1 -- 172.21.15.6:0/2428405111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0000f040 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1297a700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d33c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c11978700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8c00028000 tx=0x7f8c00023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2475dc1cd9b4de6f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0002d680 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c0001b040 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c0400f050 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c0002d9f0 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 10 client.6885 fetch_fsmap learned FSMap version 60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x557c2d1fc470 con 0x557c2d31ff60 2023-10-09T11:41:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400f050 con 0x557c2d31ff60 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8c0002db50 con 0x557c2d31ff60 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 10 client.6885 fetch_fsmap finished waiting for FSMap version 60 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 10 client.6885 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 20 client.6885 populate_metadata read hostname 'smithi006' 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f3960 0x557c2d33c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 4 client.6885 mds_command: new command op to 6714 tid=0[{"prefix": "status"}] 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 --> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c2d1e9e00 con 0x557c2d2f3960 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.475+0000 7f8c12179700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f3960 0x557c2d33c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8bf0ff9700 10 client.6885 ms_handle_connect on v2:172.21.15.6:6835/2798220359 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c12179700 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f3960 0x557c2d33c9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4b0772787ff750b server_cookie=cae14ed3f07aa5e0 in_seq=0 out_seq=0 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8bf0ff9700 1 -- 172.21.15.6:0/2428405111 <== mds.0 v2:172.21.15.6:6835/2798220359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557c2d1e9e00 con 0x557c2d2f3960 2023-10-09T11:41:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8bf0ff9700 10 client.6885 handle_command_reply: tid=0 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 client.6885 shutdown 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 msgr2=0x557c2d320330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8c00028000 tx=0x7f8c00023000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 shutdown_connections 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:6835/2798220359,v1:172.21.15.6:6837/2798220359] conn(0x557c2d2f3960 0x557c2d33c9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557c2d340d00 0x557c2d33c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8bf0ff9700 0 client.6885 ms_handle_reset on v2:172.21.15.6:6835/2798220359 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c2d2f6a50 0x557c2d3a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 --2- 172.21.15.6:0/2428405111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c2d31ff60 0x557c2d320330 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 >> 172.21.15.6:0/2428405111 conn(0x557c2d2f8370 msgr2=0x557c2d33ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 shutdown_connections 2023-10-09T11:41:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 1 -- 172.21.15.6:0/2428405111 wait complete. 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.476+0000 7f8c1d6d5b80 20 client.6885 trim_cache size 0 max 16384 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6714, 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:41:49.484 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.441719162, 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 60, 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 115, 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 115, 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 15.536657739000001 2023-10-09T11:41:49.485 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 msgr2=0x7f8bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 0x7f8bf80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c1580c0 tx=0x7f8c00009040 comp rx=0 tx=0).stop 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 msgr2=0x7f8c0c154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06fe20 tx=0x7f8bfc017000 comp rx=0 tx=0).stop 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 shutdown_connections 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8bf8066f30 0x7f8bf80693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c0c157ca0 0x7f8c0c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c0c06d120 0x7f8c0c154d10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 --2- 172.21.15.6:0/2151040488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c0c1578d0 0x7f8c0c0b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 >> 172.21.15.6:0/2151040488 conn(0x7f8c0c06bb90 msgr2=0x7f8c0c15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 shutdown_connections 2023-10-09T11:41:49.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.477+0000 7f8c143dd700 1 -- 172.21.15.6:0/2151040488 wait complete. 2023-10-09T11:41:49.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.608+0000 7ffb82546700 1 Processor -- start 2023-10-09T11:41:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.608+0000 7ffb82546700 1 -- start start 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb82546700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb7c0af270 0x7ffb7c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb82546700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c06aae0 con 0x7ffb7c0c3030 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb82546700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c069ed0 con 0x7ffb7c0aeea0 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb82546700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c06a1b0 con 0x7ffb7c0af270 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb80ae3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffb7c0c3030 0x7ffb7c0c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49840/0 (socket says 172.21.15.6:49840) 2023-10-09T11:41:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb80ae3700 1 -- 172.21.15.6:0/1575788777 learned_addr learned my addr 172.21.15.6:0/1575788777 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7b7fe700 1 --2- 172.21.15.6:0/1575788777 >> v2:172.21.15.118:3300/0 conn(0x7ffb7c0af270 0x7ffb7c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748823142 0 0) 0x7ffb7c06aae0 con 0x7ffb7c0c3030 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb68003570 con 0x7ffb7c0c3030 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221046795 0 0) 0x7ffb68003570 con 0x7ffb7c0c3030 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 >> v2:172.21.15.118:3300/0 conn(0x7ffb7c0af270 msgr2=0x7ffb7c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 --2- 172.21.15.6:0/1575788777 >> v2:172.21.15.118:3300/0 conn(0x7ffb7c0af270 0x7ffb7c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 >> v1:172.21.15.118:6789/0 conn(0x7ffb7c0aeea0 legacy=0x7ffb7c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c06a490 con 0x7ffb7c0c3030 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ffb740017f0 con 0x7ffb7c0c3030 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 >> v1:172.21.15.6:6789/0 conn(0x7ffb7c0c3030 legacy=0x7ffb7c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb68003a60 0x7ffb68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.609+0000 7ffb7affd700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb68004810 0x7ffb68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 0x7ffb6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c06a1b0 con 0x7ffb680051c0 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6800c0d0 con 0x7ffb68004810 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6800c290 con 0x7ffb68003a60 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 0x7ffb6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7b7fe700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb68004810 0x7ffb68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7bfff700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb68003a60 0x7ffb68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 -- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb68003a60 msgr2=0x7ffb68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb68003a60 0x7ffb68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 -- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb68004810 msgr2=0x7ffb68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb68004810 0x7ffb68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 -- 172.21.15.6:0/1575788777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68003570 con 0x7ffb680051c0 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 -- 172.21.15.6:0/1575788777 reap_dead start 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb80ae3700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 0x7ffb6800ba60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400a900 tx=0x7ffb7c069170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2323c621f6bb532c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740070d0 con 0x7ffb680051c0 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74007230 con 0x7ffb680051c0 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.610+0000 7ffb7affd700 1 -- 172.21.15.6:0/1575788777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740075f0 con 0x7ffb680051c0 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 -- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 msgr2=0x7ffb6800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 0x7ffb6800ba60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400a900 tx=0x7ffb7c069170 comp rx=0 tx=0).stop 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 -- 172.21.15.6:0/1575788777 shutdown_connections 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 --2- 172.21.15.6:0/1575788777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb680051c0 0x7ffb6800ba60 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 -- 172.21.15.6:0/1575788777 >> 172.21.15.6:0/1575788777 conn(0x7ffb7c06c660 msgr2=0x7ffb7c0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 -- 172.21.15.6:0/1575788777 shutdown_connections 2023-10-09T11:41:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.611+0000 7ffb82546700 1 -- 172.21.15.6:0/1575788777 wait complete. 2023-10-09T11:41:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.612+0000 7ffb82546700 1 Processor -- start 2023-10-09T11:41:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.612+0000 7ffb82546700 1 -- start start 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb680051c0 0x7ffb7c1723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb7c06e1f0 0x7ffb7c1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c171f60 con 0x7ffb7c0c5150 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c6270 con 0x7ffb680051c0 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb82546700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c64a0 con 0x7ffb7c06e1f0 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32938/0 (socket says 172.21.15.6:32938) 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 -- 172.21.15.6:0/1758136108 learned_addr learned my addr 172.21.15.6:0/1758136108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7bfff700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb680051c0 0x7ffb7c1723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb80ae3700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb7c06e1f0 0x7ffb7c1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 -- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb7c06e1f0 msgr2=0x7ffb7c1505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb7c06e1f0 0x7ffb7c1505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 -- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb680051c0 msgr2=0x7ffb7c1723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb680051c0 0x7ffb7c1723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.613+0000 7ffb7b7fe700 1 -- 172.21.15.6:0/1758136108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0c6780 con 0x7ffb7c0c5150 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb7b7fe700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c011b10 tx=0x7ffb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00f940 con 0x7ffb7c0c5150 2023-10-09T11:41:49.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00faa0 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00fe20 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c171910 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.614+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c06e640 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.615+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c172110 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.615+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb6c014650 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.615+0000 7ffb73fff700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.616+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb6c018030 con 0x7ffb7c0c5150 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.616+0000 7ffb7bfff700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.616+0000 7ffb7bfff700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 0x7ffb5c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb64007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:49.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.620+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb7c172110 con 0x7ffb7c0c5150 2023-10-09T11:41:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.856+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb7c172110 con 0x7ffb7c0c5150 2023-10-09T11:41:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.856+0000 7ffb73fff700 1 -- 172.21.15.6:0/1758136108 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb7c172110 con 0x7ffb7c0c5150 2023-10-09T11:41:49.857 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 msgr2=0x7ffb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 0x7ffb5c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb64007d30 comp rx=0 tx=0).stop 2023-10-09T11:41:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 msgr2=0x7ffb7c0c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c011b10 tx=0x7ffb6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 shutdown_connections 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffb5c066f30 0x7ffb5c0693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb7c06e1f0 0x7ffb7c1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb680051c0 0x7ffb7c1723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 --2- 172.21.15.6:0/1758136108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb7c0c5150 0x7ffb7c0c5d30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 >> 172.21.15.6:0/1758136108 conn(0x7ffb7c06c660 msgr2=0x7ffb7c152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 shutdown_connections 2023-10-09T11:41:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:49.858+0000 7ffb82546700 1 -- 172.21.15.6:0/1758136108 wait complete. 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:49.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:49.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:49.872 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:49.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:49.872 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:41:49.887 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42152sec preferred_lft 42152sec 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:41:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:49.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:49.891 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:49.950 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:41:49.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:49.952 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:41:50.008 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:41:50.008 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:50.008 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:41:50.008 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:41:50.009 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:50.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:41:50.009 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:41:50.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.110 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:41:50.125 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:41:50.125 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:41:50.125 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:50.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:41:50.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:50.190 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:50.245 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:41:50.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:50.246 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:50.300 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:41:50.300 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:50.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:50.381 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:50.381 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:50.400 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:50.401 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:50.422 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:41:50.423 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:41:50.423 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:41:50.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:50.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:50.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:41:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.649+0000 7f76253c1700 1 Processor -- start 2023-10-09T11:41:50.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.649+0000 7f76253c1700 1 -- start start 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f76253c1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f76200cf240 0x7f76200b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f76253c1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f762006d650 0x7f762006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f76253c1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200b0ca0 con 0x7f762015a2a0 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f76253c1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762006ea90 con 0x7f762006d650 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f76253c1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200b00d0 con 0x7f76200cf240 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f762006d650 0x7f762006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f762015a2a0 0x7f76200ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49844/0 (socket says 172.21.15.6:49844) 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761effd700 1 -- 172.21.15.6:0/1043278124 learned_addr learned my addr 172.21.15.6:0/1043278124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761e7fc700 1 --2- 172.21.15.6:0/1043278124 >> v2:172.21.15.118:3300/0 conn(0x7f76200cf240 0x7f76200b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 -- 172.21.15.6:0/1043278124 >> v2:172.21.15.118:3300/0 conn(0x7f76200cf240 msgr2=0x7f76200b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 --2- 172.21.15.6:0/1043278124 >> v2:172.21.15.118:3300/0 conn(0x7f76200cf240 0x7f76200b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 -- 172.21.15.6:0/1043278124 >> v1:172.21.15.6:6789/0 conn(0x7f762015a2a0 legacy=0x7f76200ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 -- 172.21.15.6:0/1043278124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200b0370 con 0x7f762006d650 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761dffb700 1 -- 172.21.15.6:0/1043278124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629478208 0 0) 0x7f76200b0ca0 con 0x7f762015a2a0 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761f7fe700 1 --2- 172.21.15.6:0/1043278124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762006d650 0x7f762006da20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f76200713b0 tx=0x7f7618009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40ec413fa9d9f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761dffb700 1 -- 172.21.15.6:0/1043278124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800e070 con 0x7f762006d650 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761dffb700 1 -- 172.21.15.6:0/1043278124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761800bc30 con 0x7f762006d650 2023-10-09T11:41:50.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.650+0000 7f761dffb700 1 -- 172.21.15.6:0/1043278124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618012430 con 0x7f762006d650 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 -- 172.21.15.6:0/1043278124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762006d650 msgr2=0x7f762006da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 --2- 172.21.15.6:0/1043278124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762006d650 0x7f762006da20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f76200713b0 tx=0x7f7618009780 comp rx=0 tx=0).stop 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 -- 172.21.15.6:0/1043278124 shutdown_connections 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 --2- 172.21.15.6:0/1043278124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f762006d650 0x7f762006da20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 --2- 172.21.15.6:0/1043278124 >> v2:172.21.15.118:3300/0 conn(0x7f76200cf240 0x7f76200b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 -- 172.21.15.6:0/1043278124 >> 172.21.15.6:0/1043278124 conn(0x7f7620067640 msgr2=0x7f7620067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 -- 172.21.15.6:0/1043278124 shutdown_connections 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.651+0000 7f76253c1700 1 -- 172.21.15.6:0/1043278124 wait complete. 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.652+0000 7f76253c1700 1 Processor -- start 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.652+0000 7f76253c1700 1 -- start start 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762006d650 0x7f7620155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f762015a2a0 0x7f7620157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200cbd10 con 0x7f76200cf240 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620155ee0 con 0x7f762006d650 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f76253c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200cb100 con 0x7f762015a2a0 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32950/0 (socket says 172.21.15.6:32950) 2023-10-09T11:41:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 -- 172.21.15.6:0/1026718184 learned_addr learned my addr 172.21.15.6:0/1026718184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761f7fe700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f762015a2a0 0x7f7620157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 -- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f762015a2a0 msgr2=0x7f7620157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761effd700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762006d650 0x7f7620155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f762015a2a0 0x7f7620157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 -- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762006d650 msgr2=0x7f7620155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762006d650 0x7f7620155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.653+0000 7f761e7fc700 1 -- 172.21.15.6:0/1026718184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009a20 con 0x7f76200cf240 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f761e7fc700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f760800d890 tx=0x7f7608008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608012630 con 0x7f76200cf240 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608012790 con 0x7f76200cf240 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76200cb3e0 con 0x7f76200cf240 2023-10-09T11:41:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608012b50 con 0x7f76200cf240 2023-10-09T11:41:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.654+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76200cb9a0 con 0x7f76200cf240 2023-10-09T11:41:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.655+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76200cbe80 con 0x7f76200cf240 2023-10-09T11:41:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.655+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f760801d400 con 0x7f76200cf240 2023-10-09T11:41:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.656+0000 7f7616ffd700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 0x7f76000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.656+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7608084a30 con 0x7f76200cf240 2023-10-09T11:41:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.656+0000 7f761effd700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 0x7f76000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.656+0000 7f761effd700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 0x7f76000693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f76200b1690 tx=0x7f7610009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.660+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7608051c00 con 0x7f76200cf240 2023-10-09T11:41:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.896+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f762004bb80 con 0x7f76200cf240 2023-10-09T11:41:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.897+0000 7f7616ffd700 1 -- 172.21.15.6:0/1026718184 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7608055220 con 0x7f76200cf240 2023-10-09T11:41:50.897 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:41:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 msgr2=0x7f76000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 0x7f76000693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f76200b1690 tx=0x7f7610009040 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 msgr2=0x7f762015b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f760800d890 tx=0x7f7608008040 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 shutdown_connections 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7600066f30 0x7f76000693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f762015a2a0 0x7f7620157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f762006d650 0x7f7620155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 --2- 172.21.15.6:0/1026718184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76200cf240 0x7f762015b060 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 >> 172.21.15.6:0/1026718184 conn(0x7f7620067640 msgr2=0x7f76200b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 shutdown_connections 2023-10-09T11:41:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:50.899+0000 7f76253c1700 1 -- 172.21.15.6:0/1026718184 wait complete. 2023-10-09T11:41:50.911 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:41:50.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:41:50.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:41:50.912 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:50.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.912 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:41:50.930 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:41:50.931 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42164sec preferred_lft 42164sec 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:41:50.932 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:41:50.933 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:41:50.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:50.934 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:41:50.999 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:41:51.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.001 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:41:51.060 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:41:51.060 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:41:51.060 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:41:51.060 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:41:51.060 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:41:51.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:41:51.061 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:41:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.167 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:41:51.181 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:41:51.181 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:41:51.182 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:51.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:41:51.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:51.246 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:51.301 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:41:51.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:41:51.301 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:51.355 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:41:51.355 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:41:51.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:51.435 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:51.435 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:51.454 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:41:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:41:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:41:51.475 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:41:51.476 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:41:51.477 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:41:51.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:51.478 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:51.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.666+0000 7fe88b59e700 1 Processor -- start 2023-10-09T11:41:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.666+0000 7fe88b59e700 1 -- start start 2023-10-09T11:41:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 0x7fe88c067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe88c0ce890 0x7fe88c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88b59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c067ff0 con 0x7fe88c0add30 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c0b37b0 con 0x7fe88c0ce890 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cf250 con 0x7fe88c067640 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe88c0ce890 0x7fe88c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe88c0ce890 0x7fe88c0ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32960/0 (socket says 172.21.15.6:32960) 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.667+0000 7fe88ad9d700 1 -- 172.21.15.6:0/21220820 learned_addr learned my addr 172.21.15.6:0/21220820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe889d9b700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 0x7fe88c067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88ad9d700 1 -- 172.21.15.6:0/21220820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 msgr2=0x7fe88c067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88ad9d700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 0x7fe88c067ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88ad9d700 1 -- 172.21.15.6:0/21220820 >> v1:172.21.15.118:6789/0 conn(0x7fe88c0add30 legacy=0x7fe88c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88ad9d700 1 -- 172.21.15.6:0/21220820 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0b17c0 con 0x7fe88c0ce890 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe889d9b700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 0x7fe88c067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88ad9d700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c0ce890 0x7fe88c0ced10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0099e0 tx=0x7fe87c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61799d38e89d080f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88959a700 1 -- 172.21.15.6:0/21220820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00b820 con 0x7fe88c0ce890 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88959a700 1 -- 172.21.15.6:0/21220820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00b980 con 0x7fe88c0ce890 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.668+0000 7fe88959a700 1 -- 172.21.15.6:0/21220820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00bd20 con 0x7fe88c0ce890 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 -- 172.21.15.6:0/21220820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c0ce890 msgr2=0x7fe88c0ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c0ce890 0x7fe88c0ced10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0099e0 tx=0x7fe87c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 -- 172.21.15.6:0/21220820 shutdown_connections 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c0ce890 0x7fe88c0ced10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 --2- 172.21.15.6:0/21220820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c067640 0x7fe88c067ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 -- 172.21.15.6:0/21220820 >> 172.21.15.6:0/21220820 conn(0x7fe88c06c620 msgr2=0x7fe88c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 -- 172.21.15.6:0/21220820 shutdown_connections 2023-10-09T11:41:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.669+0000 7fe88b59e700 1 -- 172.21.15.6:0/21220820 wait complete. 2023-10-09T11:41:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.670+0000 7fe88b59e700 1 Processor -- start 2023-10-09T11:41:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.670+0000 7fe88b59e700 1 -- start start 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c0add30 0x7fe88c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88c0ce890 0x7fe88c0aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0a85a0 con 0x7fe88c067640 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0a9120 con 0x7fe88c0ce890 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0a87f0 con 0x7fe88c0add30 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32974/0 (socket says 172.21.15.6:32974) 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 -- 172.21.15.6:0/1622029177 learned_addr learned my addr 172.21.15.6:0/1622029177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe889d9b700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c0add30 0x7fe88c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88ad9d700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88c0ce890 0x7fe88c0aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 -- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c0add30 msgr2=0x7fe88c15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c0add30 0x7fe88c15a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 -- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88c0ce890 msgr2=0x7fe88c0aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88c0ce890 0x7fe88c0aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 -- 172.21.15.6:0/1622029177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0094f0 con 0x7fe88c067640 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88a59c700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe88400cb40 tx=0x7fe8840017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400ce50 con 0x7fe88c067640 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884006ba0 con 0x7fe88c067640 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0a8ad0 con 0x7fe88c067640 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400a7a0 con 0x7fe88c067640 2023-10-09T11:41:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.671+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c0a9af0 con 0x7fe88c067640 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.672+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c0a9400 con 0x7fe88c067640 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.673+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe88400ab90 con 0x7fe88c067640 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.673+0000 7fe8827fc700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.673+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe884084280 con 0x7fe88c067640 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.673+0000 7fe889d9b700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.674+0000 7fe889d9b700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe88c068480 tx=0x7fe874008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.678+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8840514f0 con 0x7fe88c067640 2023-10-09T11:41:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.915+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe88c071b10 con 0x7fe88c067640 2023-10-09T11:41:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.915+0000 7fe8827fc700 1 -- 172.21.15.6:0/1622029177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe884054b10 con 0x7fe88c067640 2023-10-09T11:41:51.916 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 msgr2=0x7fe86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 0x7fe86c0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe88c068480 tx=0x7fe874008040 comp rx=0 tx=0).stop 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 msgr2=0x7fe88c0a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe88400cb40 tx=0x7fe8840017b0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 shutdown_connections 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe86c066f30 0x7fe86c0693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe88c0ce890 0x7fe88c0aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe88c067640 0x7fe88c0a95b0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 --2- 172.21.15.6:0/1622029177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe88c0add30 0x7fe88c15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 >> 172.21.15.6:0/1622029177 conn(0x7fe88c06c620 msgr2=0x7fe88c0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 shutdown_connections 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:51.917+0000 7fe88b59e700 1 -- 172.21.15.6:0/1622029177 wait complete. 2023-10-09T11:41:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:51.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T11:41:52.067 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":6714,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.022951932,"mdsmap_epoch":60,"osdmap_epoch":115,"osdmap_epoch_barrier":115,"uptime":18.117890358} 2023-10-09T11:41:52.068 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 6714, "mdsmap_epoch": 60, "osdmap_epoch": 115, "osdmap_epoch_barrier": 115, "rank_uptime": 13.022951932, "state": "up:active", "uptime": 18.117890358, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:41:52.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T11:41:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.190+0000 7fbd5ad49700 1 Processor -- start 2023-10-09T11:41:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.190+0000 7fbd5ad49700 1 -- start start 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 0x7fbd540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 0x7fbd5415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd5406d120 0x7fbd5406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5406dac0 con 0x7fbd5406d120 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540d07c0 con 0x7fbd541578d0 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd5ad49700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540cfbb0 con 0x7fbd54157ca0 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd5406d120 0x7fbd5406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd5406d120 0x7fbd5406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32978/0 (socket says 172.21.15.6:32978) 2023-10-09T11:41:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 -- 172.21.15.6:0/1845829469 learned_addr learned my addr 172.21.15.6:0/1845829469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd58ae5700 1 --2- 172.21.15.6:0/1845829469 >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 0x7fbd540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 -- 172.21.15.6:0/1845829469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 msgr2=0x7fbd5415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd53fff700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 0x7fbd5415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 0x7fbd5415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 -- 172.21.15.6:0/1845829469 >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 msgr2=0x7fbd540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 --2- 172.21.15.6:0/1845829469 >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 0x7fbd540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 -- 172.21.15.6:0/1845829469 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540cfe90 con 0x7fbd5406d120 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd58ae5700 1 --2- 172.21.15.6:0/1845829469 >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 0x7fbd540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd53fff700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 0x7fbd5415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.191+0000 7fbd592e6700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd5406d120 0x7fbd5406d580 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbd540646b0 tx=0x7fbd3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605bdc4bdc49fb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd537fe700 1 -- 172.21.15.6:0/1845829469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00b860 con 0x7fbd5406d120 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd537fe700 1 -- 172.21.15.6:0/1845829469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00b9c0 con 0x7fbd5406d120 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd537fe700 1 -- 172.21.15.6:0/1845829469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00bd60 con 0x7fbd5406d120 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 -- 172.21.15.6:0/1845829469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd5406d120 msgr2=0x7fbd5406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd5406d120 0x7fbd5406d580 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbd540646b0 tx=0x7fbd3c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 -- 172.21.15.6:0/1845829469 shutdown_connections 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd5406d120 0x7fbd5406d580 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/1845829469 >> v2:172.21.15.118:3300/0 conn(0x7fbd541578d0 0x7fbd540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/1845829469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd54157ca0 0x7fbd5415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 -- 172.21.15.6:0/1845829469 >> 172.21.15.6:0/1845829469 conn(0x7fbd5406bb90 msgr2=0x7fbd5406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 -- 172.21.15.6:0/1845829469 shutdown_connections 2023-10-09T11:41:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.192+0000 7fbd5ad49700 1 -- 172.21.15.6:0/1845829469 wait complete. 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.193+0000 7fbd5ad49700 1 Processor -- start 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.193+0000 7fbd5ad49700 1 -- start start 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd5406d120 0x7fbd541531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd541578d0 0x7fbd5414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540b5dc0 con 0x7fbd54157ca0 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540b5930 con 0x7fbd5406d120 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd5ad49700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5414e280 con 0x7fbd541578d0 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd592e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd592e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32992/0 (socket says 172.21.15.6:32992) 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd592e6700 1 -- 172.21.15.6:0/2854378475 learned_addr learned my addr 172.21.15.6:0/2854378475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd53fff700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd541578d0 0x7fbd5414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.194+0000 7fbd58ae5700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd5406d120 0x7fbd541531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 -- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd541578d0 msgr2=0x7fbd5414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd541578d0 0x7fbd5414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 -- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd5406d120 msgr2=0x7fbd541531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd5406d120 0x7fbd541531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 -- 172.21.15.6:0/2854378475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0094f0 con 0x7fbd54157ca0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd592e6700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c011e60 con 0x7fbd54157ca0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c01a630 con 0x7fbd54157ca0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540b4a90 con 0x7fbd54157ca0 2023-10-09T11:41:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c01aa10 con 0x7fbd54157ca0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.195+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540b5000 con 0x7fbd54157ca0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.196+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd540b5ae0 con 0x7fbd54157ca0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.197+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd3c02d440 con 0x7fbd54157ca0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.197+0000 7fbd50ff9700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 0x7fbd340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.197+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd3c0860e0 con 0x7fbd54157ca0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.197+0000 7fbd58ae5700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 0x7fbd340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.197+0000 7fbd58ae5700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 0x7fbd340693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fd0 tx=0x7fbd4c0077c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.201+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd540b5ae0 con 0x7fbd54157ca0 2023-10-09T11:41:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:52.395+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fbd540b5ae0 con 0x7fbd54157ca0 2023-10-09T11:41:53.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.076+0000 7fbd50ff9700 1 -- 172.21.15.6:0/2854378475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd540b5ae0 con 0x7fbd54157ca0 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 msgr2=0x7fbd340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 0x7fbd340693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c007fd0 tx=0x7fbd4c0077c0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 msgr2=0x7fbd540b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c017000 comp rx=0 tx=0).stop 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 shutdown_connections 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd34066f30 0x7fbd340693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd54157ca0 0x7fbd540b4550 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd5406d120 0x7fbd541531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 --2- 172.21.15.6:0/2854378475 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd541578d0 0x7fbd5414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 >> 172.21.15.6:0/2854378475 conn(0x7fbd5406bb90 msgr2=0x7fbd541581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.078+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 shutdown_connections 2023-10-09T11:41:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.079+0000 7fbd5ad49700 1 -- 172.21.15.6:0/2854378475 wait complete. 2023-10-09T11:41:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:41:53.094 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:41:53.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:53.354 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:41:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:client6562 2023-10-09T11:41:53.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:53.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client6562/osdmap') 2023-10-09T11:41:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 115 barrier 115 flags 0x588000 2023-10-09T11:41:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:41:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:41:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:41:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:41:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:41:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:41:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:795 bytes copied, 3.8283e-05 s, 20.8 MB/s 2023-10-09T11:41:53.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-09T11:41:53.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.672+0000 7f01e3235700 1 Processor -- start 2023-10-09T11:41:53.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.672+0000 7f01e3235700 1 -- start start 2023-10-09T11:41:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e3235700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 0x7f01dc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e3235700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01dc06d120 0x7f01dc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e3235700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0d07c0 con 0x7f01dc1578d0 2023-10-09T11:41:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e3235700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc06da50 con 0x7f01dc06d120 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e3235700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc0cfbb0 con 0x7f01dc157ca0 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01dc06d120 0x7f01dc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01dc06d120 0x7f01dc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42108/0 (socket says 172.21.15.6:42108) 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 -- 172.21.15.6:0/2040804466 learned_addr learned my addr 172.21.15.6:0/2040804466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01dbfff700 1 --2- 172.21.15.6:0/2040804466 >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 0x7f01dc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 -- 172.21.15.6:0/2040804466 >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 msgr2=0x7f01dc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 --2- 172.21.15.6:0/2040804466 >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 0x7f01dc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.673+0000 7f01e17d2700 1 -- 172.21.15.6:0/2040804466 >> v1:172.21.15.118:6789/0 conn(0x7f01dc1578d0 legacy=0x7f01dc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e17d2700 1 -- 172.21.15.6:0/2040804466 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0cfe90 con 0x7f01dc06d120 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01dbfff700 1 --2- 172.21.15.6:0/2040804466 >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 0x7f01dc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e17d2700 1 --2- 172.21.15.6:0/2040804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc06d120 0x7f01dc06d510 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f01dc068510 tx=0x7f01c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc0d99fd520d48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01db7fe700 1 -- 172.21.15.6:0/2040804466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400b860 con 0x7f01dc06d120 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01db7fe700 1 -- 172.21.15.6:0/2040804466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400b9c0 con 0x7f01dc06d120 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01db7fe700 1 -- 172.21.15.6:0/2040804466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400bd60 con 0x7f01dc06d120 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 -- 172.21.15.6:0/2040804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc06d120 msgr2=0x7f01dc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 --2- 172.21.15.6:0/2040804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc06d120 0x7f01dc06d510 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f01dc068510 tx=0x7f01c4009250 comp rx=0 tx=0).stop 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 -- 172.21.15.6:0/2040804466 shutdown_connections 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 --2- 172.21.15.6:0/2040804466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc06d120 0x7f01dc06d510 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 --2- 172.21.15.6:0/2040804466 >> v2:172.21.15.118:3300/0 conn(0x7f01dc157ca0 0x7f01dc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 -- 172.21.15.6:0/2040804466 >> 172.21.15.6:0/2040804466 conn(0x7f01dc06bb90 msgr2=0x7f01dc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 -- 172.21.15.6:0/2040804466 shutdown_connections 2023-10-09T11:41:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.674+0000 7f01e3235700 1 -- 172.21.15.6:0/2040804466 wait complete. 2023-10-09T11:41:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.676+0000 7f01e3235700 1 Processor -- start 2023-10-09T11:41:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.676+0000 7f01e3235700 1 -- start start 2023-10-09T11:41:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01dc06d120 0x7f01dc154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01dc157ca0 0x7f01dc159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0ad4e0 con 0x7f01dc1578d0 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0ad050 con 0x7f01dc157ca0 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc154ec0 con 0x7f01dc06d120 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42120/0 (socket says 172.21.15.6:42120) 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 -- 172.21.15.6:0/1053379874 learned_addr learned my addr 172.21.15.6:0/1053379874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e17d2700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01dc157ca0 0x7f01dc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e0fd1700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01dc06d120 0x7f01dc154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 -- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01dc06d120 msgr2=0x7f01dc154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01dc06d120 0x7f01dc154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 -- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01dc157ca0 msgr2=0x7f01dc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01dc157ca0 0x7f01dc159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 -- 172.21.15.6:0/1053379874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c40094f0 con 0x7f01dc1578d0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01dbfff700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00d890 tx=0x7f01cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0125f0 con 0x7f01dc1578d0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc012750 con 0x7f01dc1578d0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc012b10 con 0x7f01dc1578d0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.677+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc0aca00 con 0x7f01dc1578d0 2023-10-09T11:41:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.678+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc16a2e0 con 0x7f01dc1578d0 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.678+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc0ad1e0 con 0x7f01dc1578d0 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.679+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01cc014430 con 0x7f01dc1578d0 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.679+0000 7f01d8ff9700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 0x7f01bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.679+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01cc084870 con 0x7f01dc1578d0 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.679+0000 7f01e0fd1700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 0x7f01bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:53.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.680+0000 7f01e0fd1700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 0x7f01bc0693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d40016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.683+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01cc0554d0 con 0x7f01dc1578d0 2023-10-09T11:41:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:53.894+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f01dc0d0170 con 0x7f01dc1578d0 2023-10-09T11:41:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.078+0000 7f01d8ff9700 1 -- 172.21.15.6:0/1053379874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v117) v1 ==== 93+0+0 (secure 0 0 0) 0x7f01cc055060 con 0x7f01dc1578d0 2023-10-09T11:41:54.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 msgr2=0x7f01bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 0x7f01bc0693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d40016f0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 msgr2=0x7f01dc1593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00d890 tx=0x7f01cc008040 comp rx=0 tx=0).stop 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 shutdown_connections 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f01bc066f30 0x7f01bc0693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01dc157ca0 0x7f01dc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f01dc06d120 0x7f01dc154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 --2- 172.21.15.6:0/1053379874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01dc1578d0 0x7f01dc1593e0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 >> 172.21.15.6:0/1053379874 conn(0x7f01dc06bb90 msgr2=0x7f01dc155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 shutdown_connections 2023-10-09T11:41:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.080+0000 7f01e3235700 1 -- 172.21.15.6:0/1053379874 wait complete. 2023-10-09T11:41:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:pauserd,pausewr is set 2023-10-09T11:41:54.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-09T11:41:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 Processor -- start 2023-10-09T11:41:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 -- start start 2023-10-09T11:41:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca580b3bd0 0x7fca580ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca581583b0 0x7fca580cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b2890 con 0x7fca58157fe0 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580b4070 con 0x7fca581583b0 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.213+0000 7fca5eda2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580b4350 con 0x7fca580b3bd0 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca581583b0 0x7fca580cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca581583b0 0x7fca580cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42134/0 (socket says 172.21.15.6:42134) 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 -- 172.21.15.6:0/689707765 learned_addr learned my addr 172.21.15.6:0/689707765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca57fff700 1 --2- 172.21.15.6:0/689707765 >> v2:172.21.15.118:3300/0 conn(0x7fca580b3bd0 0x7fca580ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 -- 172.21.15.6:0/689707765 >> v2:172.21.15.118:3300/0 conn(0x7fca580b3bd0 msgr2=0x7fca580ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 --2- 172.21.15.6:0/689707765 >> v2:172.21.15.118:3300/0 conn(0x7fca580b3bd0 0x7fca580ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 -- 172.21.15.6:0/689707765 >> v1:172.21.15.118:6789/0 conn(0x7fca58157fe0 legacy=0x7fca580b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 -- 172.21.15.6:0/689707765 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580b4630 con 0x7fca581583b0 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca5d33f700 1 --2- 172.21.15.6:0/689707765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca581583b0 0x7fca580cf070 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fca5804c150 tx=0x7fca40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f2d8749ef987a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca577fe700 1 -- 172.21.15.6:0/689707765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40009e70 con 0x7fca581583b0 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca577fe700 1 -- 172.21.15.6:0/689707765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000b860 con 0x7fca581583b0 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.214+0000 7fca577fe700 1 -- 172.21.15.6:0/689707765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000bc00 con 0x7fca581583b0 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 -- 172.21.15.6:0/689707765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca581583b0 msgr2=0x7fca580cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 --2- 172.21.15.6:0/689707765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca581583b0 0x7fca580cf070 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fca5804c150 tx=0x7fca40009250 comp rx=0 tx=0).stop 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 -- 172.21.15.6:0/689707765 shutdown_connections 2023-10-09T11:41:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 --2- 172.21.15.6:0/689707765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca581583b0 0x7fca580cf070 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 --2- 172.21.15.6:0/689707765 >> v2:172.21.15.118:3300/0 conn(0x7fca580b3bd0 0x7fca580ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 -- 172.21.15.6:0/689707765 >> 172.21.15.6:0/689707765 conn(0x7fca58067640 msgr2=0x7fca58067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 -- 172.21.15.6:0/689707765 shutdown_connections 2023-10-09T11:41:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.215+0000 7fca5eda2700 1 -- 172.21.15.6:0/689707765 wait complete. 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.216+0000 7fca5eda2700 1 Processor -- start 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.216+0000 7fca5eda2700 1 -- start start 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca580b3bd0 0x7fca58136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca581583b0 0x7fca58149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5815a2d0 con 0x7fca58157fe0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58136ca0 con 0x7fca580b3bd0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca581593e0 con 0x7fca581583b0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42136/0 (socket says 172.21.15.6:42136) 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 -- 172.21.15.6:0/510319306 learned_addr learned my addr 172.21.15.6:0/510319306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5cb3e700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca580b3bd0 0x7fca58136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5d33f700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca581583b0 0x7fca58149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 -- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca581583b0 msgr2=0x7fca58149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca581583b0 0x7fca58149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 -- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca580b3bd0 msgr2=0x7fca58136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca580b3bd0 0x7fca58136420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400094f0 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca57fff700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e900 tx=0x7fca480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800eea0 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800c850 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800cc10 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.217+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca581596c0 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.218+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58159c80 con 0x7fca58157fe0 2023-10-09T11:41:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.218+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5815a480 con 0x7fca58157fe0 2023-10-09T11:41:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.220+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca48013470 con 0x7fca58157fe0 2023-10-09T11:41:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.220+0000 7fca54ff9700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 0x7fca380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.220+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca48084dc0 con 0x7fca58157fe0 2023-10-09T11:41:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.221+0000 7fca5cb3e700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 0x7fca380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.221+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=118+}) v3 -- 0x7fca3806ea50 con 0x7fca58157fe0 2023-10-09T11:41:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.221+0000 7fca5cb3e700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 0x7fca380693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca50007fd0 tx=0x7fca50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.224+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca48052010 con 0x7fca58157fe0 2023-10-09T11:41:54.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:54.428+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fca580b0de0 con 0x7fca58157fe0 2023-10-09T11:41:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.080+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(118..118 src has 1..118) v4 ==== 280+0+0 (secure 0 0 0) 0x7fca480563d0 con 0x7fca58157fe0 2023-10-09T11:41:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.080+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=119}) v3 -- 0x7fca3806f3d0 con 0x7fca58157fe0 2023-10-09T11:41:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.083+0000 7fca54ff9700 1 -- 172.21.15.6:0/510319306 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7fca48021070 con 0x7fca58157fe0 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 msgr2=0x7fca380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 0x7fca380693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca50007fd0 tx=0x7fca50009040 comp rx=0 tx=0).stop 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 msgr2=0x7fca5814b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e900 tx=0x7fca480091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 shutdown_connections 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca38066f30 0x7fca380693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca581583b0 0x7fca58149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca580b3bd0 0x7fca58136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 --2- 172.21.15.6:0/510319306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58157fe0 0x7fca5814b620 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 >> 172.21.15.6:0/510319306 conn(0x7fca58067640 msgr2=0x7fca5814a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 shutdown_connections 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.086+0000 7fca5eda2700 1 -- 172.21.15.6:0/510319306 wait complete. 2023-10-09T11:41:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:pauserd,pausewr is unset 2023-10-09T11:41:55.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.225+0000 7f592b59e700 1 Processor -- start 2023-10-09T11:41:55.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.225+0000 7f592b59e700 1 -- start start 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f592c159b40 0x7f592c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f592c068e90 0x7f592c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0cee10 con 0x7f592c159f10 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0cd040 con 0x7f592c159b40 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0cd320 con 0x7f592c068e90 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f592c159b40 0x7f592c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f592c159b40 0x7f592c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42144/0 (socket says 172.21.15.6:42144) 2023-10-09T11:41:55.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 -- 172.21.15.6:0/3366947875 learned_addr learned my addr 172.21.15.6:0/3366947875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f5929d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f592c159f10 0x7f592c068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37664/0 (socket says 172.21.15.6:37664) 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592ad9d700 1 --2- 172.21.15.6:0/3366947875 >> v2:172.21.15.118:3300/0 conn(0x7f592c068e90 0x7f592c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 -- 172.21.15.6:0/3366947875 >> v2:172.21.15.118:3300/0 conn(0x7f592c068e90 msgr2=0x7f592c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 --2- 172.21.15.6:0/3366947875 >> v2:172.21.15.118:3300/0 conn(0x7f592c068e90 0x7f592c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 -- 172.21.15.6:0/3366947875 >> v1:172.21.15.6:6789/0 conn(0x7f592c159f10 legacy=0x7f592c068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592a59c700 1 -- 172.21.15.6:0/3366947875 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0ce7c0 con 0x7f592c159b40 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.226+0000 7f592959a700 1 -- 172.21.15.6:0/3366947875 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568995841 0 0) 0x7f592c0cee10 con 0x7f592c159f10 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592a59c700 1 --2- 172.21.15.6:0/3366947875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159b40 0x7f592c0cc600 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cae10 tx=0x7f5924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b1a0f788c3968 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592959a700 1 -- 172.21.15.6:0/3366947875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400b860 con 0x7f592c159b40 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592959a700 1 -- 172.21.15.6:0/3366947875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400b9c0 con 0x7f592c159b40 2023-10-09T11:41:55.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592959a700 1 -- 172.21.15.6:0/3366947875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400bd60 con 0x7f592c159b40 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 -- 172.21.15.6:0/3366947875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159b40 msgr2=0x7f592c0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 --2- 172.21.15.6:0/3366947875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159b40 0x7f592c0cc600 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cae10 tx=0x7f5924009250 comp rx=0 tx=0).stop 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 -- 172.21.15.6:0/3366947875 shutdown_connections 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 --2- 172.21.15.6:0/3366947875 >> v2:172.21.15.118:3300/0 conn(0x7f592c068e90 0x7f592c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 --2- 172.21.15.6:0/3366947875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159b40 0x7f592c0cc600 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 -- 172.21.15.6:0/3366947875 >> 172.21.15.6:0/3366947875 conn(0x7f592c0cd660 msgr2=0x7f592c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 -- 172.21.15.6:0/3366947875 shutdown_connections 2023-10-09T11:41:55.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.227+0000 7f592b59e700 1 -- 172.21.15.6:0/3366947875 wait complete. 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.228+0000 7f592b59e700 1 Processor -- start 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.228+0000 7f592b59e700 1 -- start start 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f592c068e90 0x7f592c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c159b40 0x7f592c15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0b2680 con 0x7f592c159f10 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c16e150 con 0x7f592c159b40 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c16e430 con 0x7f592c068e90 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42156/0 (socket says 172.21.15.6:42156) 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592ad9d700 1 -- 172.21.15.6:0/3417932655 learned_addr learned my addr 172.21.15.6:0/3417932655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f5929d9b700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c159b40 0x7f592c15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.229+0000 7f592a59c700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f592c068e90 0x7f592c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 -- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f592c068e90 msgr2=0x7f592c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f592c068e90 0x7f592c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 -- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c159b40 msgr2=0x7f592c15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c159b40 0x7f592c15b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 -- 172.21.15.6:0/3417932655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240094f0 con 0x7f592c159f10 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592ad9d700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f591c007f30 tx=0x7f591c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00eb90 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00ecf0 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c16e710 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c014670 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.230+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c15b9a0 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.231+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0cb890 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.231+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f591c014a20 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.232+0000 7f59227fc700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 0x7f590c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.232+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f591c084bc0 con 0x7f592c159f10 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.232+0000 7f592a59c700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 0x7f590c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:55.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.232+0000 7f592a59c700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 0x7f590c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cae10 tx=0x7f5924017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:55.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.236+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f591c051e30 con 0x7f592c159f10 2023-10-09T11:41:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.429+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f592c0ceaa0 con 0x7f592c159f10 2023-10-09T11:41:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.430+0000 7f59227fc700 1 -- 172.21.15.6:0/3417932655 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f591c00ee60 con 0x7f592c159f10 2023-10-09T11:41:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:55.431 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":118,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:55.079547+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 msgr2=0x7f590c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 0x7f590c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cae10 tx=0x7f5924017000 comp rx=0 tx=0).stop 2023-10-09T11:41:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 msgr2=0x7f592c155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f591c007f30 tx=0x7f591c0098e0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 shutdown_connections 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f590c066f30 0x7f590c0693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f592c159f10 0x7f592c155630 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f592c068e90 0x7f592c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 --2- 172.21.15.6:0/3417932655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f592c159b40 0x7f592c15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.432+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 >> 172.21.15.6:0/3417932655 conn(0x7f592c0cd660 msgr2=0x7f592c0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.433+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 shutdown_connections 2023-10-09T11:41:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:55.433+0000 7f592b59e700 1 -- 172.21.15.6:0/3417932655 wait complete. 2023-10-09T11:41:55.445 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:41:55.445 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:41:55.445 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:41:55.446 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:41:55.446 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:41:55.446 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:41:55.446 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:41:55.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:55.701 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run.smithi006.stdout:client6562 2023-10-09T11:41:55.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:55.771 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client6562/osdmap') 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 115 barrier 115 flags 0x588000 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:41:55.849 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:41:55.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:41:55.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:41:55.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:41:55.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:41:55.850 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:41:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:41:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:41:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:795 bytes copied, 3.819e-05 s, 20.8 MB/s 2023-10-09T11:41:55.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.010+0000 7f220002a700 1 Processor -- start 2023-10-09T11:41:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.010+0000 7f220002a700 1 -- start start 2023-10-09T11:41:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f8159d40 0x7f21f80d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 0x7f21f80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80ce290 con 0x7f21f8159d40 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80cda30 con 0x7f21f815a110 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f220002a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cdcd0 con 0x7f21f80cb390 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f21fddc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f8159d40 0x7f21f80d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f21fddc6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21f8159d40 0x7f21f80d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42172/0 (socket says 172.21.15.6:42172) 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.011+0000 7f21fddc6700 1 -- 172.21.15.6:0/3134212215 learned_addr learned my addr 172.21.15.6:0/3134212215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fd5c5700 1 --2- 172.21.15.6:0/3134212215 >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 0x7f21f80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fe5c7700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 -- 172.21.15.6:0/3134212215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 msgr2=0x7f21f80b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 -- 172.21.15.6:0/3134212215 >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 msgr2=0x7f21f80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:56.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 --2- 172.21.15.6:0/3134212215 >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 0x7f21f80b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 -- 172.21.15.6:0/3134212215 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80cdfb0 con 0x7f21f8159d40 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fd5c5700 1 --2- 172.21.15.6:0/3134212215 >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 0x7f21f80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fddc6700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f8159d40 0x7f21f80d06d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f21f806e870 tx=0x7f21e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31722ea9b8e2ef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fcdc4700 1 -- 172.21.15.6:0/3134212215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800e070 con 0x7f21f8159d40 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fcdc4700 1 -- 172.21.15.6:0/3134212215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800ba50 con 0x7f21f8159d40 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f21fcdc4700 1 -- 172.21.15.6:0/3134212215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80092e0 con 0x7f21f8159d40 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f220002a700 1 -- 172.21.15.6:0/3134212215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f8159d40 msgr2=0x7f21f80d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.012+0000 7f220002a700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f8159d40 0x7f21f80d06d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f21f806e870 tx=0x7f21e8009840 comp rx=0 tx=0).stop 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 -- 172.21.15.6:0/3134212215 shutdown_connections 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 --2- 172.21.15.6:0/3134212215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f8159d40 0x7f21f80d06d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 --2- 172.21.15.6:0/3134212215 >> v2:172.21.15.118:3300/0 conn(0x7f21f815a110 0x7f21f80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 -- 172.21.15.6:0/3134212215 >> 172.21.15.6:0/3134212215 conn(0x7f21f806bb90 msgr2=0x7f21f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 -- 172.21.15.6:0/3134212215 shutdown_connections 2023-10-09T11:41:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.013+0000 7f220002a700 1 -- 172.21.15.6:0/3134212215 wait complete. 2023-10-09T11:41:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 Processor -- start 2023-10-09T11:41:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 -- start start 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 0x7f21f80c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f816b760 con 0x7f21f815a110 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80b6840 con 0x7f21f8159d40 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.014+0000 7f220002a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f816a730 con 0x7f21f80cb390 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42180/0 (socket says 172.21.15.6:42180) 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 -- 172.21.15.6:0/544272223 learned_addr learned my addr 172.21.15.6:0/544272223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fddc6700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fd5c5700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 0x7f21f80c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 -- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 msgr2=0x7f21f80b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 -- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 msgr2=0x7f21f80c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 0x7f21f80c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 -- 172.21.15.6:0/544272223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009ae0 con 0x7f21f815a110 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fd5c5700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 0x7f21f80c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21fe5c7700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f21f000d890 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00125f0 con 0x7f21f815a110 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0012770 con 0x7f21f815a110 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f816b920 con 0x7f21f815a110 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0012b30 con 0x7f21f815a110 2023-10-09T11:41:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.015+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f816ac80 con 0x7f21f815a110 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.016+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8067d30 con 0x7f21f815a110 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.017+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21f001e460 con 0x7f21f815a110 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.017+0000 7f21f5ffb700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.017+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21f0084b10 con 0x7f21f815a110 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.018+0000 7f21fddc6700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.018+0000 7f21fddc6700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009a60 tx=0x7f21e8018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.022+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21f0051ce0 con 0x7f21f815a110 2023-10-09T11:41:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.262+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21f80cb900 con 0x7f21f815a110 2023-10-09T11:41:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.263+0000 7f21f5ffb700 1 -- 172.21.15.6:0/544272223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f21f0055300 con 0x7f21f815a110 2023-10-09T11:41:56.263 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:56.263 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 msgr2=0x7f21e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009a60 tx=0x7f21e8018000 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 msgr2=0x7f21f80c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f21f000d890 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 shutdown_connections 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f815a110 0x7f21f80c7000 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80cb390 0x7f21f80b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 --2- 172.21.15.6:0/544272223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f8159d40 0x7f21f80c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 >> 172.21.15.6:0/544272223 conn(0x7f21f806bb90 msgr2=0x7f21f815fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 shutdown_connections 2023-10-09T11:41:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:56.265+0000 7f220002a700 1 -- 172.21.15.6:0/544272223 wait complete. 2023-10-09T11:41:56.267 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:56.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 118 2023-10-09T11:41:56.414 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-09T11:41:56.414 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:41:56.414 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:41:56.414 DEBUG:teuthology.orchestra.run.smithi006:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-09T11:41:56.414 DEBUG:teuthology.orchestra.run.smithi006:> os.fchmod(fd, 0O666) 2023-10-09T11:41:56.414 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(fd) 2023-10-09T11:41:56.415 DEBUG:teuthology.orchestra.run.smithi006:> os.close(fd) 2023-10-09T11:41:56.415 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:41:56.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:56.670 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:41:56.741 INFO:teuthology.orchestra.run.smithi006.stdout:client6562 2023-10-09T11:41:56.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:56.741 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client6562/osdmap') 2023-10-09T11:41:56.818 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 118 barrier 118 flags 0x588000 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:41:56.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:41:56.820 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:41:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:41:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:41:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:795 bytes copied, 3.9027e-05 s, 20.4 MB/s 2023-10-09T11:41:56.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:56.821 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-09T11:41:56.889 INFO:teuthology.orchestra.run.smithi006.stdout:client6562 2023-10-09T11:41:56.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:56.889 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/7857a25d-47fa-49eb-8e61-2818cdc55761.client6562/osdmap') 2023-10-09T11:41:56.966 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 118 barrier 118 flags 0x588000 2023-10-09T11:41:56.966 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd0 (1)172.21.15.6:6823 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd1 (1)172.21.15.6:6809 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd2 (1)172.21.15.6:6801 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd3 (1)172.21.15.6:6817 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd4 (1)172.21.15.118:6801 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd5 (1)172.21.15.118:6805 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd6 (1)172.21.15.118:6815 100% (exists, up) 100% -1 2023-10-09T11:41:56.967 INFO:teuthology.orchestra.run.smithi006.stdout:osd7 (1)172.21.15.118:6825 100% (exists, up) 100% -1 2023-10-09T11:41:56.968 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records in 2023-10-09T11:41:56.968 INFO:teuthology.orchestra.run.smithi006.stderr:1+1 records out 2023-10-09T11:41:56.968 INFO:teuthology.orchestra.run.smithi006.stderr:795 bytes copied, 3.7251e-05 s, 21.3 MB/s 2023-10-09T11:41:56.968 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:41:56.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:41:56.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:57.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:41:57.091 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:41:57.091 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:41:57.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:57.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:41:57.150 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:41:57.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:57.151 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:41:57.169 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:41:57.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:41:57.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:41:57.213 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:41:57.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:41:57.213 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:41:57.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.386+0000 7f26696bd700 1 Processor -- start 2023-10-09T11:41:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.386+0000 7f26696bd700 1 -- start start 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26640aeea0 0x7f26640c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26640af270 0x7f26640c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640c7d00 0x7f26640c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266406aae0 con 0x7f26640af270 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2664069ed0 con 0x7f26640aeea0 2023-10-09T11:41:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26696bd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266406a1b0 con 0x7f26640c7d00 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26640af270 0x7f26640c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26640af270 0x7f26640c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42194/0 (socket says 172.21.15.6:42194) 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.387+0000 7f26627fc700 1 -- 172.21.15.6:0/2081446047 learned_addr learned my addr 172.21.15.6:0/2081446047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f2662ffd700 1 --2- 172.21.15.6:0/2081446047 >> v2:172.21.15.118:3300/0 conn(0x7f26640aeea0 0x7f26640c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26637fe700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640c7d00 0x7f26640c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 -- 172.21.15.6:0/2081446047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640c7d00 msgr2=0x7f26640c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640c7d00 0x7f26640c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 -- 172.21.15.6:0/2081446047 >> v2:172.21.15.118:3300/0 conn(0x7f26640aeea0 msgr2=0x7f26640c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 --2- 172.21.15.6:0/2081446047 >> v2:172.21.15.118:3300/0 conn(0x7f26640aeea0 0x7f26640c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 -- 172.21.15.6:0/2081446047 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266406a490 con 0x7f26640af270 2023-10-09T11:41:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f26627fc700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640af270 0x7f26640c2e60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f266406f710 tx=0x7f264c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed5a2a13bfb0f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f2661ffb700 1 -- 172.21.15.6:0/2081446047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00b6d0 con 0x7f26640af270 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f2661ffb700 1 -- 172.21.15.6:0/2081446047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00b830 con 0x7f26640af270 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.388+0000 7f2661ffb700 1 -- 172.21.15.6:0/2081446047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00bbf0 con 0x7f26640af270 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 -- 172.21.15.6:0/2081446047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640af270 msgr2=0x7f26640c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640af270 0x7f26640c2e60 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f266406f710 tx=0x7f264c009250 comp rx=0 tx=0).stop 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 -- 172.21.15.6:0/2081446047 shutdown_connections 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640c7d00 0x7f26640c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 --2- 172.21.15.6:0/2081446047 >> v2:172.21.15.118:3300/0 conn(0x7f26640aeea0 0x7f26640c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 --2- 172.21.15.6:0/2081446047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640af270 0x7f26640c2e60 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 -- 172.21.15.6:0/2081446047 >> 172.21.15.6:0/2081446047 conn(0x7f266406c660 msgr2=0x7f26640cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 -- 172.21.15.6:0/2081446047 shutdown_connections 2023-10-09T11:41:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.389+0000 7f26696bd700 1 -- 172.21.15.6:0/2081446047 wait complete. 2023-10-09T11:41:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.390+0000 7f26696bd700 1 Processor -- start 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.390+0000 7f26696bd700 1 -- start start 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26640aeea0 0x7f2664150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640af270 0x7f266416d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26640b0950 con 0x7f26640c7d00 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26640c4360 con 0x7f26640aeea0 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26640b0370 con 0x7f26640af270 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42206/0 (socket says 172.21.15.6:42206) 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 -- 172.21.15.6:0/3572027096 learned_addr learned my addr 172.21.15.6:0/3572027096 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f2662ffd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26640aeea0 0x7f2664150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26627fc700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640af270 0x7f266416d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 -- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640af270 msgr2=0x7f266416d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640af270 0x7f266416d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 -- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26640aeea0 msgr2=0x7f2664150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26640aeea0 0x7f2664150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 -- 172.21.15.6:0/3572027096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0094f0 con 0x7f26640c7d00 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26637fe700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e900 tx=0x7f265c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c013680 con 0x7f26640c7d00 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0137e0 con 0x7f26640c7d00 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266416e330 con 0x7f26640c7d00 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c013ba0 con 0x7f26640c7d00 2023-10-09T11:41:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.391+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26641513a0 con 0x7f26640c7d00 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.392+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664067bc0 con 0x7f26640c7d00 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.393+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f265c0123d0 con 0x7f26640c7d00 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.393+0000 7f265affd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.393+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f265c0845b0 con 0x7f26640c7d00 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.393+0000 7f2662ffd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.394+0000 7f2662ffd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f265400f570 tx=0x7f265400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.397+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f265c051820 con 0x7f26640c7d00 2023-10-09T11:41:57.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.636+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f266406a770 con 0x7f26640c7d00 2023-10-09T11:41:57.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.636+0000 7f265affd700 1 -- 172.21.15.6:0/3572027096 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f265c054e40 con 0x7f26640c7d00 2023-10-09T11:41:57.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:57.637 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.638+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 msgr2=0x7f26440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.638+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f265400f570 tx=0x7f265400b040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 msgr2=0x7f266416dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e900 tx=0x7f265c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 shutdown_connections 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26640c7d00 0x7f266416dd00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26640aeea0 0x7f2664150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 --2- 172.21.15.6:0/3572027096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26640af270 0x7f266416d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 >> 172.21.15.6:0/3572027096 conn(0x7f266406c660 msgr2=0x7f2664152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 shutdown_connections 2023-10-09T11:41:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.639+0000 7f26696bd700 1 -- 172.21.15.6:0/3572027096 wait complete. 2023-10-09T11:41:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:57.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.769+0000 7f92f497b700 1 Processor -- start 2023-10-09T11:41:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.769+0000 7f92f497b700 1 -- start start 2023-10-09T11:41:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92f497b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92f0157ca0 0x7f92f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92f497b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00d07c0 con 0x7f92f006d120 2023-10-09T11:41:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92f497b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00cfbb0 con 0x7f92f01578d0 2023-10-09T11:41:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92f497b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f00cfe90 con 0x7f92f0157ca0 2023-10-09T11:41:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92eed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92f006d120 0x7f92f006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37668/0 (socket says 172.21.15.6:37668) 2023-10-09T11:41:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92eed9d700 1 -- 172.21.15.6:0/2913236391 learned_addr learned my addr 172.21.15.6:0/2913236391 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.770+0000 7f92edd9b700 1 --2- 172.21.15.6:0/2913236391 >> v2:172.21.15.118:3300/0 conn(0x7f92f0157ca0 0x7f92f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229096351 0 0) 0x7f92f00d07c0 con 0x7f92f006d120 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92dc003570 con 0x7f92f006d120 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2253117154 0 0) 0x7f92dc003570 con 0x7f92f006d120 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92edd9b700 1 -- 172.21.15.6:0/2913236391 >> v1:172.21.15.118:6789/0 conn(0x7f92f01578d0 legacy=0x7f92f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92edd9b700 1 -- 172.21.15.6:0/2913236391 >> v1:172.21.15.6:6789/0 conn(0x7f92f006d120 legacy=0x7f92f006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92edd9b700 1 -- 172.21.15.6:0/2913236391 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00d0170 con 0x7f92f0157ca0 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92edd9b700 1 --2- 172.21.15.6:0/2913236391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f0157ca0 0x7f92f00cf4f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92d80098e0 tx=0x7f92d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9dd95ce9dba0d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80017f0 con 0x7f92f0157ca0 2023-10-09T11:41:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8011420 con 0x7f92f0157ca0 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.771+0000 7f92ed59a700 1 -- 172.21.15.6:0/2913236391 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d80117c0 con 0x7f92f0157ca0 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 -- 172.21.15.6:0/2913236391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f0157ca0 msgr2=0x7f92f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 --2- 172.21.15.6:0/2913236391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f0157ca0 0x7f92f00cf4f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92d80098e0 tx=0x7f92d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 -- 172.21.15.6:0/2913236391 shutdown_connections 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 --2- 172.21.15.6:0/2913236391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f0157ca0 0x7f92f00cf4f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 -- 172.21.15.6:0/2913236391 >> 172.21.15.6:0/2913236391 conn(0x7f92f006bb90 msgr2=0x7f92f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 -- 172.21.15.6:0/2913236391 shutdown_connections 2023-10-09T11:41:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.772+0000 7f92f497b700 1 -- 172.21.15.6:0/2913236391 wait complete. 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.773+0000 7f92f497b700 1 Processor -- start 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.773+0000 7f92f497b700 1 -- start start 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f006d120 0x7f92f0145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 0x7f92f0069b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f016b0f0 con 0x7f92f0157ca0 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f016a520 con 0x7f92f006d120 2023-10-09T11:41:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f016a7c0 con 0x7f92f01578d0 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42220/0 (socket says 172.21.15.6:42220) 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 -- 172.21.15.6:0/1256352742 learned_addr learned my addr 172.21.15.6:0/1256352742 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92ee59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f006d120 0x7f92f0145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92edd9b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 0x7f92f0069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 -- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 msgr2=0x7f92f0069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 0x7f92f0069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 -- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f006d120 msgr2=0x7f92f0145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f006d120 0x7f92f0145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 -- 172.21.15.6:0/1256352742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8009420 con 0x7f92f0157ca0 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92edd9b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 0x7f92f0069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92eed9d700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f92e8001560 tx=0x7f92e8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004dc0 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e800a6a0 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800aa60 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f016aaa0 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.774+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f0158d10 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.775+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f0067ac0 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.776+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92e8007150 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.776+0000 7f92e67fc700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 0x7f92d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.776+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92e8083c70 con 0x7f92f0157ca0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.776+0000 7f92ee59c700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 0x7f92d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.777+0000 7f92ee59c700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 0x7f92d00693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f92f00ce9f0 tx=0x7f92e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.781+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92e8050f60 con 0x7f92f0157ca0 2023-10-09T11:41:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.975+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92f016b230 con 0x7f92f0157ca0 2023-10-09T11:41:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.976+0000 7f92e67fc700 1 -- 172.21.15.6:0/1256352742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f92e8018090 con 0x7f92f0157ca0 2023-10-09T11:41:57.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:57.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":118,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:55.079547+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 msgr2=0x7f92d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 0x7f92d00693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f92f00ce9f0 tx=0x7f92e0009040 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 msgr2=0x7f92f006a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f92e8001560 tx=0x7f92e8001640 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 shutdown_connections 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f92d0066f30 0x7f92d00693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92f0157ca0 0x7f92f006a0c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92f006d120 0x7f92f0145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 --2- 172.21.15.6:0/1256352742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92f01578d0 0x7f92f0069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 >> 172.21.15.6:0/1256352742 conn(0x7f92f006bb90 msgr2=0x7f92f006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 shutdown_connections 2023-10-09T11:41:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:57.978+0000 7f92f497b700 1 -- 172.21.15.6:0/1256352742 wait complete. 2023-10-09T11:41:57.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:41:36.814730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:41:37.390051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:41:57.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:41:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.112+0000 7f411ccfb700 1 Processor -- start 2023-10-09T11:41:58.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.112+0000 7f411ccfb700 1 -- start start 2023-10-09T11:41:58.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f411ccfb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f411806d830 0x7f41180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f411ccfb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180d07c0 con 0x7f4118157ca0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f411ccfb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180cfbb0 con 0x7f41181578d0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f411ccfb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41180cfe90 con 0x7f411806d830 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f4115d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4118157ca0 0x7f411806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37680/0 (socket says 172.21.15.6:37680) 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f4115d9b700 1 -- 172.21.15.6:0/3611248804 learned_addr learned my addr 172.21.15.6:0/3611248804 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f4116d9d700 1 --2- 172.21.15.6:0/3611248804 >> v2:172.21.15.118:3300/0 conn(0x7f411806d830 0x7f41180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.113+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147643443 0 0) 0x7f41180d07c0 con 0x7f4118157ca0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4100003570 con 0x7f4118157ca0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663478743 0 0) 0x7f4100003570 con 0x7f4118157ca0 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f4116d9d700 1 -- 172.21.15.6:0/3611248804 >> v1:172.21.15.118:6789/0 conn(0x7f41181578d0 legacy=0x7f411815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f4116d9d700 1 -- 172.21.15.6:0/3611248804 >> v1:172.21.15.6:6789/0 conn(0x7f4118157ca0 legacy=0x7f411806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f4116d9d700 1 -- 172.21.15.6:0/3611248804 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180d0170 con 0x7f411806d830 2023-10-09T11:41:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f4116d9d700 1 --2- 172.21.15.6:0/3611248804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f411806d830 0x7f41180cf4f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4110009e60 tx=0x7f4110009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ac5d5f4d9d5090 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000e070 con 0x7f411806d830 2023-10-09T11:41:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000b850 con 0x7f411806d830 2023-10-09T11:41:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.114+0000 7f411559a700 1 -- 172.21.15.6:0/3611248804 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c001470 con 0x7f411806d830 2023-10-09T11:41:58.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 -- 172.21.15.6:0/3611248804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f411806d830 msgr2=0x7f41180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 --2- 172.21.15.6:0/3611248804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f411806d830 0x7f41180cf4f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4110009e60 tx=0x7f4110009780 comp rx=0 tx=0).stop 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 -- 172.21.15.6:0/3611248804 shutdown_connections 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 --2- 172.21.15.6:0/3611248804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f411806d830 0x7f41180cf4f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 -- 172.21.15.6:0/3611248804 >> 172.21.15.6:0/3611248804 conn(0x7f411806bb90 msgr2=0x7f411806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 -- 172.21.15.6:0/3611248804 shutdown_connections 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.115+0000 7f411ccfb700 1 -- 172.21.15.6:0/3611248804 wait complete. 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.116+0000 7f411ccfb700 1 Processor -- start 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.116+0000 7f411ccfb700 1 -- start start 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.116+0000 7f411ccfb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41181578d0 0x7f41181594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118157ca0 0x7f4118154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180b5dc0 con 0x7f411806d830 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180b5850 con 0x7f4118157ca0 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4118169ec0 con 0x7f41181578d0 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42222/0 (socket says 172.21.15.6:42222) 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 -- 172.21.15.6:0/1983354896 learned_addr learned my addr 172.21.15.6:0/1983354896 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f4116d9d700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118157ca0 0x7f4118154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f4115d9b700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41181578d0 0x7f41181594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 -- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41181578d0 msgr2=0x7f41181594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41181578d0 0x7f41181594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 -- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118157ca0 msgr2=0x7f4118154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118157ca0 0x7f4118154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 -- 172.21.15.6:0/1983354896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009a20 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411659c700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f410800c810 tx=0x7f4108007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108012630 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108012790 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41180c6000 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108012b50 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.117+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41180c65c0 con 0x7f411806d830 2023-10-09T11:41:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.118+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411816a0d0 con 0x7f411806d830 2023-10-09T11:41:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.119+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f410801b400 con 0x7f411806d830 2023-10-09T11:41:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.119+0000 7f41067fc700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 0x7f40f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.119+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4108084030 con 0x7f411806d830 2023-10-09T11:41:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.119+0000 7f4115d9b700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 0x7f40f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.120+0000 7f4115d9b700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 0x7f40f80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f411816d3d0 tx=0x7f410c000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.123+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4108051360 con 0x7f411806d830 2023-10-09T11:41:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.315+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41180d0450 con 0x7f411806d830 2023-10-09T11:41:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.315+0000 7f41067fc700 1 -- 172.21.15.6:0/1983354896 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4108054980 con 0x7f411806d830 2023-10-09T11:41:58.316 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 msgr2=0x7f40f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 0x7f40f80693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f411816d3d0 tx=0x7f410c000bc0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 msgr2=0x7f41180b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f410800c810 tx=0x7f4108007f00 comp rx=0 tx=0).stop 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 shutdown_connections 2023-10-09T11:41:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f40f8066f30 0x7f40f80693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4118157ca0 0x7f4118154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411806d830 0x7f41180b5310 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 --2- 172.21.15.6:0/1983354896 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41181578d0 0x7f41181594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 >> 172.21.15.6:0/1983354896 conn(0x7f411806bb90 msgr2=0x7f41181568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 shutdown_connections 2023-10-09T11:41:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.317+0000 7f411ccfb700 1 -- 172.21.15.6:0/1983354896 wait complete. 2023-10-09T11:41:58.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:41:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.450+0000 7f84b62cb700 1 Processor -- start 2023-10-09T11:41:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.450+0000 7f84b62cb700 1 -- start start 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b62cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f84b00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b62cb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00cf2d0 con 0x7f84b006d700 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b62cb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b006dc00 con 0x7f84b00d02b0 2023-10-09T11:41:58.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b62cb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b015a690 con 0x7f84b00d0b80 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b5aca700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84b006d700 0x7f84b015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37692/0 (socket says 172.21.15.6:37692) 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b5aca700 1 -- 172.21.15.6:0/2973418592 learned_addr learned my addr 172.21.15.6:0/2973418592 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84b52c9700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f84b00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.451+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795960080 0 0) 0x7f84b00cf2d0 con 0x7f84b006d700 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8498003570 con 0x7f84b006d700 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593426456 0 0) 0x7f8498003570 con 0x7f84b006d700 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 msgr2=0x7f84b00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f84b00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 >> v1:172.21.15.118:6789/0 conn(0x7f84b00d02b0 legacy=0x7f84b006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00cf570 con 0x7f84b006d700 2023-10-09T11:41:58.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f84a0001470 con 0x7f84b006d700 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 >> v1:172.21.15.6:6789/0 conn(0x7f84b006d700 legacy=0x7f84b015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f8498003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f8498004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8498004d50 0x7f84980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b015a690 con 0x7f8498003a90 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849800bb10 con 0x7f8498004d50 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849800bcd0 con 0x7f84b00d0b80 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f8498003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b4ac8700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f8498004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b5aca700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8498004d50 0x7f84980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 -- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 msgr2=0x7f8498004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b00d0b80 0x7f8498004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 -- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8498004d50 msgr2=0x7f84980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8498004d50 0x7f84980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 -- 172.21.15.6:0/2973418592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498003570 con 0x7f8498003a90 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.452+0000 7f84b52c9700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f8498003e60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e210 tx=0x7f84a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f4df9f3b379cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800eac0 con 0x7f8498003a90 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800f040 con 0x7f8498003a90 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84affff700 1 -- 172.21.15.6:0/2973418592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800ee70 con 0x7f8498003a90 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 -- 172.21.15.6:0/2973418592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 msgr2=0x7f8498003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 --2- 172.21.15.6:0/2973418592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f8498003e60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e210 tx=0x7f84a800b040 comp rx=0 tx=0).stop 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b5aca700 1 -- 172.21.15.6:0/2973418592 reap_dead start 2023-10-09T11:41:58.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 -- 172.21.15.6:0/2973418592 shutdown_connections 2023-10-09T11:41:58.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 -- 172.21.15.6:0/2973418592 >> 172.21.15.6:0/2973418592 conn(0x7f84b0063230 msgr2=0x7f84b0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 -- 172.21.15.6:0/2973418592 shutdown_connections 2023-10-09T11:41:58.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.453+0000 7f84b62cb700 1 -- 172.21.15.6:0/2973418592 wait complete. 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.454+0000 7f84b62cb700 1 Processor -- start 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.454+0000 7f84b62cb700 1 -- start start 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 0x7f84b0069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 0x7f84b016d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b4f30 con 0x7f8498003a90 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b43b0 con 0x7f84b00b3eb0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b62cb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b4690 con 0x7f84b016d4b0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b52c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b52c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42248/0 (socket says 172.21.15.6:42248) 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b52c9700 1 -- 172.21.15.6:0/3640478957 learned_addr learned my addr 172.21.15.6:0/3640478957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b4ac8700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 0x7f84b0069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.455+0000 7f84b5aca700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 0x7f84b016d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 -- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 msgr2=0x7f84b016d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 0x7f84b016d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 -- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 msgr2=0x7f84b0069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 0x7f84b0069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 -- 172.21.15.6:0/3640478957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00b4970 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b4ac8700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 0x7f84b0069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b5aca700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 0x7f84b016d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b52c9700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f84a800afd0 tx=0x7f84a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8029450 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80295d0 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00b4c50 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8029990 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.456+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b016de90 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.457+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00676e0 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.458+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84a8003040 con 0x7f8498003a90 2023-10-09T11:41:58.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.458+0000 7f84ad7fa700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.458+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84a80868b0 con 0x7f8498003a90 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.458+0000 7f84b4ac8700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.458+0000 7f84b4ac8700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.462+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84a8053b20 con 0x7f8498003a90 2023-10-09T11:41:58.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.653+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84b00cf850 con 0x7f8498003a90 2023-10-09T11:41:58.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.654+0000 7f84ad7fa700 1 -- 172.21.15.6:0/3640478957 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v118) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84a80180a0 con 0x7f8498003a90 2023-10-09T11:41:58.654 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 msgr2=0x7f849c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 msgr2=0x7f84b0069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f84a800afd0 tx=0x7f84a801a000 comp rx=0 tx=0).stop 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 shutdown_connections 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f849c066f30 0x7f849c0693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f84b016d4b0 0x7f84b016d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8498003a90 0x7f84b0069a30 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 --2- 172.21.15.6:0/3640478957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84b00b3eb0 0x7f84b0069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 >> 172.21.15.6:0/3640478957 conn(0x7f84b0063230 msgr2=0x7f84b00b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 shutdown_connections 2023-10-09T11:41:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.656+0000 7f84b62cb700 1 -- 172.21.15.6:0/3640478957 wait complete. 2023-10-09T11:41:58.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:41:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.789+0000 7fba2f2b9700 1 Processor -- start 2023-10-09T11:41:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.789+0000 7fba2f2b9700 1 -- start start 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2f2b9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 0x7fba280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2f2b9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba2806d120 0x7fba2806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2f2b9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2806dac0 con 0x7fba281578d0 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2f2b9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba280d07c0 con 0x7fba2806d120 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2f2b9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280cfbb0 con 0x7fba28157ca0 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d856700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba2806d120 0x7fba2806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2c854700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 0x7fba280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d055700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fba281578d0 0x7fba2815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:32988/0 (socket says 172.21.15.6:32988) 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d055700 1 -- 172.21.15.6:0/4066193250 learned_addr learned my addr 172.21.15.6:0/4066193250 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d856700 1 -- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 msgr2=0x7fba280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d856700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 0x7fba280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d856700 1 -- 172.21.15.6:0/4066193250 >> v1:172.21.15.118:6789/0 conn(0x7fba281578d0 legacy=0x7fba2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba27fff700 1 -- 172.21.15.6:0/4066193250 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282438575 0 0) 0x7fba18001490 con 0x7fba281578d0 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2d856700 1 -- 172.21.15.6:0/4066193250 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280cfe90 con 0x7fba2806d120 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.790+0000 7fba2c854700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 0x7fba280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2d856700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba2806d120 0x7fba2806d580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fba200098e0 tx=0x7fba200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cddebce27d29d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba27fff700 1 -- 172.21.15.6:0/4066193250 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000b640 con 0x7fba2806d120 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba27fff700 1 -- 172.21.15.6:0/4066193250 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000b7a0 con 0x7fba2806d120 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba27fff700 1 -- 172.21.15.6:0/4066193250 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000bb40 con 0x7fba2806d120 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 -- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba2806d120 msgr2=0x7fba2806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba2806d120 0x7fba2806d580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fba200098e0 tx=0x7fba200091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 -- 172.21.15.6:0/4066193250 shutdown_connections 2023-10-09T11:41:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba2806d120 0x7fba2806d580 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/4066193250 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba28157ca0 0x7fba280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 -- 172.21.15.6:0/4066193250 >> 172.21.15.6:0/4066193250 conn(0x7fba2806bb90 msgr2=0x7fba2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 -- 172.21.15.6:0/4066193250 shutdown_connections 2023-10-09T11:41:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.791+0000 7fba2f2b9700 1 -- 172.21.15.6:0/4066193250 wait complete. 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.792+0000 7fba2f2b9700 1 Processor -- start 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.792+0000 7fba2f2b9700 1 -- start start 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba2806d120 0x7fba280b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba281578d0 0x7fba280b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba280b2670 con 0x7fba28157ca0 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba280b1a60 con 0x7fba281578d0 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2f2b9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280b1d40 con 0x7fba2806d120 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2d856700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2d856700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42258/0 (socket says 172.21.15.6:42258) 2023-10-09T11:41:58.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.793+0000 7fba2d856700 1 -- 172.21.15.6:0/1516671982 learned_addr learned my addr 172.21.15.6:0/1516671982 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d055700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba2806d120 0x7fba280b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2c854700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba281578d0 0x7fba280b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 -- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba2806d120 msgr2=0x7fba280b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba2806d120 0x7fba280b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 -- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba281578d0 msgr2=0x7fba280b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba281578d0 0x7fba280b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 -- 172.21.15.6:0/1516671982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c009420 con 0x7fba28157ca0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2d856700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fba2806fe20 tx=0x7fba20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000bb20 con 0x7fba28157ca0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20011420 con 0x7fba28157ca0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba20009420 con 0x7fba28157ca0 2023-10-09T11:41:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200117a0 con 0x7fba28157ca0 2023-10-09T11:41:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.794+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba280b2300 con 0x7fba28157ca0 2023-10-09T11:41:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.795+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba28147400 con 0x7fba28157ca0 2023-10-09T11:41:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.795+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba20011b10 con 0x7fba28157ca0 2023-10-09T11:41:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.796+0000 7fba257fa700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 0x7fba140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.796+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba20086010 con 0x7fba28157ca0 2023-10-09T11:41:58.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.796+0000 7fba2d055700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 0x7fba140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:58.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.796+0000 7fba2d055700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 0x7fba140693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba28155a70 tx=0x7fba18001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.800+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba28147400 con 0x7fba28157ca0 2023-10-09T11:41:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.993+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba28147400 con 0x7fba28157ca0 2023-10-09T11:41:58.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.993+0000 7fba257fa700 1 -- 172.21.15.6:0/1516671982 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v118) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba28147400 con 0x7fba28157ca0 2023-10-09T11:41:58.994 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:41:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.995+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 msgr2=0x7fba140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.995+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 0x7fba140693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba28155a70 tx=0x7fba18001a10 comp rx=0 tx=0).stop 2023-10-09T11:41:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.995+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 msgr2=0x7fba280b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.995+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fba2806fe20 tx=0x7fba20017000 comp rx=0 tx=0).stop 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 shutdown_connections 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fba14066f30 0x7fba140693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28157ca0 0x7fba280b0fc0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba2806d120 0x7fba280b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 --2- 172.21.15.6:0/1516671982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba281578d0 0x7fba280b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 >> 172.21.15.6:0/1516671982 conn(0x7fba2806bb90 msgr2=0x7fba28068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 shutdown_connections 2023-10-09T11:41:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:58.996+0000 7fba2f2b9700 1 -- 172.21.15.6:0/1516671982 wait complete. 2023-10-09T11:41:59.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.127+0000 7f79291de700 1 Processor -- start 2023-10-09T11:41:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.127+0000 7f79291de700 1 -- start start 2023-10-09T11:41:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79291de700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7924159b40 0x7f79240cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79291de700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f7924068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79291de700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79240cee10 con 0x7f79240ccb40 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79291de700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79240cd040 con 0x7f7924159b40 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79291de700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240cd320 con 0x7f7924159f10 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79237fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f7924068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f7923fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7924159b40 0x7f79240cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79289dd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f79240ccb40 0x7f792415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:32998/0 (socket says 172.21.15.6:32998) 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.128+0000 7f79289dd700 1 -- 172.21.15.6:0/3810695906 learned_addr learned my addr 172.21.15.6:0/3810695906 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7923fff700 1 -- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 msgr2=0x7f7924068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7923fff700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f7924068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7923fff700 1 -- 172.21.15.6:0/3810695906 >> v1:172.21.15.118:6789/0 conn(0x7f79240ccb40 legacy=0x7f792415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7923fff700 1 -- 172.21.15.6:0/3810695906 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240ce7c0 con 0x7f7924159b40 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f79237fe700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f7924068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7923fff700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240cc600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79140098e0 tx=0x7f79140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=206cff90a64975d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7922ffd700 1 -- 172.21.15.6:0/3810695906 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400b640 con 0x7f7924159b40 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7922ffd700 1 -- 172.21.15.6:0/3810695906 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400b7a0 con 0x7f7924159b40 2023-10-09T11:41:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.129+0000 7f7922ffd700 1 -- 172.21.15.6:0/3810695906 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400bb40 con 0x7f7924159b40 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 -- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 msgr2=0x7f79240cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240cc600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79140098e0 tx=0x7f79140091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 -- 172.21.15.6:0/3810695906 shutdown_connections 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240cc600 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 --2- 172.21.15.6:0/3810695906 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f7924068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 -- 172.21.15.6:0/3810695906 >> 172.21.15.6:0/3810695906 conn(0x7f79240cd660 msgr2=0x7f79240cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 -- 172.21.15.6:0/3810695906 shutdown_connections 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.130+0000 7f79291de700 1 -- 172.21.15.6:0/3810695906 wait complete. 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.131+0000 7f79291de700 1 Processor -- start 2023-10-09T11:41:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.131+0000 7f79291de700 1 -- start start 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f79240c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240c92f0 con 0x7f79240ccb40 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240c86b0 con 0x7f7924159b40 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79291de700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240c8950 con 0x7f7924159f10 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42272/0 (socket says 172.21.15.6:42272) 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 -- 172.21.15.6:0/3759683159 learned_addr learned my addr 172.21.15.6:0/3759683159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79289dd700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f79240c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f79237fe700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 -- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 msgr2=0x7f79240c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f79240c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 -- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 msgr2=0x7f79240c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.132+0000 7f7923fff700 1 -- 172.21.15.6:0/3759683159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009420 con 0x7f79240ccb40 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f7923fff700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f792406fe10 tx=0x7f7914017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791401bc40 con 0x7f79240ccb40 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791401bdc0 con 0x7f79240ccb40 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011670 con 0x7f79240ccb40 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7914009420 con 0x7f79240ccb40 2023-10-09T11:41:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.133+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240c8f10 con 0x7f79240ccb40 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.134+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79240cc0e0 con 0x7f79240ccb40 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.134+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7914011a20 con 0x7f79240ccb40 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.135+0000 7f791bfff700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 0x7f79040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.135+0000 7f79237fe700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 0x7f79040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.135+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7914085b50 con 0x7f79240ccb40 2023-10-09T11:41:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.135+0000 7f79237fe700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 0x7f79040693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f79240c60c0 tx=0x7f790c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.139+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7914052d20 con 0x7f79240ccb40 2023-10-09T11:41:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.375+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79240ceb00 con 0x7f79240ccb40 2023-10-09T11:41:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.376+0000 7f791bfff700 1 -- 172.21.15.6:0/3759683159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7914056340 con 0x7f79240ccb40 2023-10-09T11:41:59.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:59.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 msgr2=0x7f79040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 0x7f79040693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f79240c60c0 tx=0x7f790c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 msgr2=0x7f7924157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f792406fe10 tx=0x7f7914017000 comp rx=0 tx=0).stop 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 shutdown_connections 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7904066f30 0x7f79040693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7924159f10 0x7f79240c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79240ccb40 0x7f7924157540 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 --2- 172.21.15.6:0/3759683159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7924159b40 0x7f79240c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 >> 172.21.15.6:0/3759683159 conn(0x7f79240cd660 msgr2=0x7f79240c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 shutdown_connections 2023-10-09T11:41:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.378+0000 7f79291de700 1 -- 172.21.15.6:0/3759683159 wait complete. 2023-10-09T11:41:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:41:59.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:41:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.508+0000 7f8b88d8c700 1 Processor -- start 2023-10-09T11:41:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.508+0000 7f8b88d8c700 1 -- start start 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b88d8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b84068e90 0x7f8b84164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b88d8c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840cee10 con 0x7f8b84159b40 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b88d8c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840cd040 con 0x7f8b84159f10 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b88d8c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840cd320 con 0x7f8b84068e90 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b83fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b84068e90 0x7f8b84164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b837fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b84159b40 0x7f8b840cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37696/0 (socket says 172.21.15.6:37696) 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b837fe700 1 -- 172.21.15.6:0/2942957654 learned_addr learned my addr 172.21.15.6:0/2942957654 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b83fff700 1 -- 172.21.15.6:0/2942957654 >> v1:172.21.15.118:6789/0 conn(0x7f8b84159f10 legacy=0x7f8b84068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b83fff700 1 -- 172.21.15.6:0/2942957654 >> v1:172.21.15.6:6789/0 conn(0x7f8b84159b40 legacy=0x7f8b840cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.509+0000 7f8b83fff700 1 -- 172.21.15.6:0/2942957654 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840ce7c0 con 0x7f8b84068e90 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b83fff700 1 --2- 172.21.15.6:0/2942957654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b84164c70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009e60 tx=0x7f8b7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6facdf5bc21ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b827fc700 1 -- 172.21.15.6:0/2942957654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00e070 con 0x7f8b84068e90 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b827fc700 1 -- 172.21.15.6:0/2942957654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00bbf0 con 0x7f8b84068e90 2023-10-09T11:41:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b827fc700 1 -- 172.21.15.6:0/2942957654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c012430 con 0x7f8b84068e90 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 -- 172.21.15.6:0/2942957654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 msgr2=0x7f8b84164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/2942957654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b84164c70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009e60 tx=0x7f8b7c009780 comp rx=0 tx=0).stop 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 -- 172.21.15.6:0/2942957654 shutdown_connections 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/2942957654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b84164c70 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 -- 172.21.15.6:0/2942957654 >> 172.21.15.6:0/2942957654 conn(0x7f8b840cd660 msgr2=0x7f8b840cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 -- 172.21.15.6:0/2942957654 shutdown_connections 2023-10-09T11:41:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.510+0000 7f8b88d8c700 1 -- 172.21.15.6:0/2942957654 wait complete. 2023-10-09T11:41:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 Processor -- start 2023-10-09T11:41:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 -- start start 2023-10-09T11:41:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84159b40 0x7f8b8415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b84159f10 0x7f8b8416e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840c8c70 con 0x7f8b84068e90 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415cc60 con 0x7f8b84159b40 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b88d8c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415cf40 con 0x7f8b84159f10 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42294/0 (socket says 172.21.15.6:42294) 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.512+0000 7f8b837fe700 1 -- 172.21.15.6:0/1720039700 learned_addr learned my addr 172.21.15.6:0/1720039700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b82ffd700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84159b40 0x7f8b8415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 -- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b84159f10 msgr2=0x7f8b8416e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b84159f10 0x7f8b8416e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 -- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84159b40 msgr2=0x7f8b8415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84159b40 0x7f8b8415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 -- 172.21.15.6:0/1720039700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c009a20 con 0x7f8b84068e90 2023-10-09T11:41:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b837fe700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c7c0 tx=0x7f8b74007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74005b30 con 0x7f8b84068e90 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8415d220 con 0x7f8b84068e90 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841548f0 con 0x7f8b84068e90 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74004830 con 0x7f8b84068e90 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.513+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74005ea0 con 0x7f8b84068e90 2023-10-09T11:41:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.514+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84063e90 con 0x7f8b84068e90 2023-10-09T11:41:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.514+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b74004c70 con 0x7f8b84068e90 2023-10-09T11:41:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.515+0000 7f8b6b7fe700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 0x7f8b700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.515+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b740838c0 con 0x7f8b84068e90 2023-10-09T11:41:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.515+0000 7f8b82ffd700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 0x7f8b700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.515+0000 7f8b82ffd700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 0x7f8b700693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800a8a0 tx=0x7f8b78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.519+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b7404c5a0 con 0x7f8b84068e90 2023-10-09T11:41:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.712+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b840ceaa0 con 0x7f8b84068e90 2023-10-09T11:41:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.713+0000 7f8b6b7fe700 1 -- 172.21.15.6:0/1720039700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f8b74018020 con 0x7f8b84068e90 2023-10-09T11:41:59.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:41:59.714 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":118,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:55.079547+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:41:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 msgr2=0x7f8b700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 0x7f8b700693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800a8a0 tx=0x7f8b78008040 comp rx=0 tx=0).stop 2023-10-09T11:41:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 msgr2=0x7f8b841582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c7c0 tx=0x7f8b74007f70 comp rx=0 tx=0).stop 2023-10-09T11:41:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 shutdown_connections 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8b70066f30 0x7f8b700693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8b84159f10 0x7f8b8416e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b84068e90 0x7f8b841582b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 --2- 172.21.15.6:0/1720039700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84159b40 0x7f8b8415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.715+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 >> 172.21.15.6:0/1720039700 conn(0x7f8b840cd660 msgr2=0x7f8b840b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.716+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 shutdown_connections 2023-10-09T11:41:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.716+0000 7f8b88d8c700 1 -- 172.21.15.6:0/1720039700 wait complete. 2023-10-09T11:41:59.728 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:41:59.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:41:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.846+0000 7efdd222c700 1 Processor -- start 2023-10-09T11:41:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.846+0000 7efdd222c700 1 -- start start 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdd222c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efdcc157ca0 0x7efdcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdd222c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc0d07c0 con 0x7efdcc1578d0 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdd222c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc0cfbb0 con 0x7efdcc06d120 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdd222c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdcc0cfe90 con 0x7efdcc157ca0 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdcb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efdcc1578d0 0x7efdcc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37698/0 (socket says 172.21.15.6:37698) 2023-10-09T11:41:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.847+0000 7efdcb7fe700 1 -- 172.21.15.6:0/1257864343 learned_addr learned my addr 172.21.15.6:0/1257864343 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 --2- 172.21.15.6:0/1257864343 >> v2:172.21.15.118:3300/0 conn(0x7efdcc157ca0 0x7efdcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636360179 0 0) 0x7efdcc0d07c0 con 0x7efdcc1578d0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb4003570 con 0x7efdcc1578d0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3613972536 0 0) 0x7efdb4003570 con 0x7efdcc1578d0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 >> v2:172.21.15.118:3300/0 conn(0x7efdcc157ca0 msgr2=0x7efdcc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 --2- 172.21.15.6:0/1257864343 >> v2:172.21.15.118:3300/0 conn(0x7efdcc157ca0 0x7efdcc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 >> v1:172.21.15.118:6789/0 conn(0x7efdcc06d120 legacy=0x7efdcc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0d0170 con 0x7efdcc1578d0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7efdbc001470 con 0x7efdcc1578d0 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 >> v1:172.21.15.6:6789/0 conn(0x7efdcc1578d0 legacy=0x7efdcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdb4003a60 0x7efdb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 0x7efdb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb40051c0 0x7efdb400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0cfe90 con 0x7efdb4004810 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb400c0d0 con 0x7efdb40051c0 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb400c290 con 0x7efdb4003a60 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 0x7efdb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcb7fe700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdb4003a60 0x7efdb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcbfff700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb40051c0 0x7efdb400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 -- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdb4003a60 msgr2=0x7efdb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdb4003a60 0x7efdb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 -- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb40051c0 msgr2=0x7efdb400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:41:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb40051c0 0x7efdb400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcbfff700 1 -- 172.21.15.6:0/1257864343 reap_dead start 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.848+0000 7efdcaffd700 1 -- 172.21.15.6:0/1257864343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4003570 con 0x7efdb4004810 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdcaffd700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 0x7efdb4004c80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7efdcc1580c0 tx=0x7efdc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f1cf6d750e59af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000e710 con 0x7efdb4004810 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000e870 con 0x7efdb4004810 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdca7fc700 1 -- 172.21.15.6:0/1257864343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000ec30 con 0x7efdb4004810 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 -- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 msgr2=0x7efdb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 0x7efdb4004c80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7efdcc1580c0 tx=0x7efdc00091a0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 -- 172.21.15.6:0/1257864343 shutdown_connections 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 --2- 172.21.15.6:0/1257864343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb4004810 0x7efdb4004c80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 -- 172.21.15.6:0/1257864343 >> 172.21.15.6:0/1257864343 conn(0x7efdcc06bb90 msgr2=0x7efdcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:41:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 -- 172.21.15.6:0/1257864343 shutdown_connections 2023-10-09T11:41:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.849+0000 7efdd222c700 1 -- 172.21.15.6:0/1257864343 wait complete. 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 Processor -- start 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 -- start start 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb4004810 0x7efdcc153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdcc16a4e0 0x7efdcc0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0b51c0 con 0x7efdcc0c64e0 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0c6a80 con 0x7efdb4004810 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdd222c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0c6d60 con 0x7efdcc16a4e0 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42306/0 (socket says 172.21.15.6:42306) 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.851+0000 7efdcaffd700 1 -- 172.21.15.6:0/2989581099 learned_addr learned my addr 172.21.15.6:0/2989581099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcb7fe700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb4004810 0x7efdcc153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcbfff700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdcc16a4e0 0x7efdcc0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 -- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdcc16a4e0 msgr2=0x7efdcc0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdcc16a4e0 0x7efdcc0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 -- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb4004810 msgr2=0x7efdcc153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb4004810 0x7efdcc153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:41:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 -- 172.21.15.6:0/2989581099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0b4b70 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdcaffd700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c0a0 tx=0x7efdc001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0022070 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000e9e0 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000e710 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc0b51c0 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.852+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc0692d0 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.853+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc0b5010 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.853+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdc001c660 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.854+0000 7efdb37fe700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.854+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efdc0085b30 con 0x7efdcc0c64e0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.854+0000 7efdcb7fe700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:41:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.854+0000 7efdcb7fe700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 0x7efdb80693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000c00 tx=0x7efdbc001e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:41:59.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:41:59.858+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc0052e50 con 0x7efdcc0c64e0 2023-10-09T11:42:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.094+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdcc0b5350 con 0x7efdcc0c64e0 2023-10-09T11:42:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.094+0000 7efdb37fe700 1 -- 172.21.15.6:0/2989581099 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7efdc0056470 con 0x7efdcc0c64e0 2023-10-09T11:42:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:00.095 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 msgr2=0x7efdb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 0x7efdb80693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000c00 tx=0x7efdbc001e50 comp rx=0 tx=0).stop 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 msgr2=0x7efdcc0b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c0a0 tx=0x7efdc001a000 comp rx=0 tx=0).stop 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 shutdown_connections 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efdb8066f30 0x7efdb80693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdcc16a4e0 0x7efdcc0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdb4004810 0x7efdcc153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 --2- 172.21.15.6:0/2989581099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc0c64e0 0x7efdcc0b5650 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 >> 172.21.15.6:0/2989581099 conn(0x7efdcc06bb90 msgr2=0x7efdcc15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 shutdown_connections 2023-10-09T11:42:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.096+0000 7efdd222c700 1 -- 172.21.15.6:0/2989581099 wait complete. 2023-10-09T11:42:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:42:00.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.228+0000 7ff6c8306700 1 Processor -- start 2023-10-09T11:42:00.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.228+0000 7ff6c8306700 1 -- start start 2023-10-09T11:42:00.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c8306700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6c01578d0 0x7ff6c00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c8306700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c006d120 0x7ff6c006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c8306700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00d07c0 con 0x7ff6c0157ca0 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c8306700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c006daa0 con 0x7ff6c01578d0 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c8306700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00cfbb0 con 0x7ff6c006d120 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6c01578d0 0x7ff6c00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c58a1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6c0157ca0 0x7ff6c015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37702/0 (socket says 172.21.15.6:37702) 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c58a1700 1 -- 172.21.15.6:0/107969682 learned_addr learned my addr 172.21.15.6:0/107969682 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/107969682 >> v2:172.21.15.6:3300/0 conn(0x7ff6c01578d0 0x7ff6c00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42320/0 (socket says 172.21.15.6:42320) 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c68a3700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c006d120 0x7ff6c006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 -- 172.21.15.6:0/107969682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c006d120 msgr2=0x7ff6c006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c006d120 0x7ff6c006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 -- 172.21.15.6:0/107969682 >> v1:172.21.15.6:6789/0 conn(0x7ff6c0157ca0 legacy=0x7ff6c015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 -- 172.21.15.6:0/107969682 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00cfe90 con 0x7ff6c01578d0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c50a0700 1 -- 172.21.15.6:0/107969682 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154382271 0 0) 0x7ff6c00d07c0 con 0x7ff6c0157ca0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.229+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c01578d0 0x7ff6c00cf4f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009e60 tx=0x7ff6b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88da6dacd5455148 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c50a0700 1 -- 172.21.15.6:0/107969682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800e070 con 0x7ff6c01578d0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c50a0700 1 -- 172.21.15.6:0/107969682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800bb60 con 0x7ff6c01578d0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c50a0700 1 -- 172.21.15.6:0/107969682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8012430 con 0x7ff6c01578d0 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 -- 172.21.15.6:0/107969682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c01578d0 msgr2=0x7ff6c00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c01578d0 0x7ff6c00cf4f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009e60 tx=0x7ff6b8009780 comp rx=0 tx=0).stop 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 -- 172.21.15.6:0/107969682 shutdown_connections 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c006d120 0x7ff6c006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 --2- 172.21.15.6:0/107969682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c01578d0 0x7ff6c00cf4f0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 -- 172.21.15.6:0/107969682 >> 172.21.15.6:0/107969682 conn(0x7ff6c006bb90 msgr2=0x7ff6c006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 -- 172.21.15.6:0/107969682 shutdown_connections 2023-10-09T11:42:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.230+0000 7ff6c8306700 1 -- 172.21.15.6:0/107969682 wait complete. 2023-10-09T11:42:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.231+0000 7ff6c8306700 1 Processor -- start 2023-10-09T11:42:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.231+0000 7ff6c8306700 1 -- start start 2023-10-09T11:42:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 0x7ff6c00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 0x7ff6c0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00aa920 con 0x7ff6c006d120 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0154fc0 con 0x7ff6c01578d0 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c8306700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c016ab00 con 0x7ff6c0157ca0 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42330/0 (socket says 172.21.15.6:42330) 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 -- 172.21.15.6:0/3746648348 learned_addr learned my addr 172.21.15.6:0/3746648348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c68a3700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 0x7ff6c0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 -- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 msgr2=0x7ff6c0154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c58a1700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 0x7ff6c00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 0x7ff6c0154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 -- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 msgr2=0x7ff6c00b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 0x7ff6c00b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c60a2700 1 -- 172.21.15.6:0/3746648348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009a20 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c68a3700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 0x7ff6c0154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.232+0000 7ff6c58a1700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 0x7ff6c00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6c60a2700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006fe20 tx=0x7ff6b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8012e20 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8027470 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c016ade0 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8027830 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.233+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c016b3a0 con 0x7ff6c006d120 2023-10-09T11:42:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.234+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0067ac0 con 0x7ff6c006d120 2023-10-09T11:42:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.234+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6b8024070 con 0x7ff6c006d120 2023-10-09T11:42:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.234+0000 7ff6be7fc700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 0x7ff6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.235+0000 7ff6c58a1700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 0x7ff6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.235+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6b8087000 con 0x7ff6c006d120 2023-10-09T11:42:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.235+0000 7ff6c58a1700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 0x7ff6ac0693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff6c015cc40 tx=0x7ff6b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.239+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6b8054270 con 0x7ff6c006d120 2023-10-09T11:42:00.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.478+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6c00d0170 con 0x7ff6c006d120 2023-10-09T11:42:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.479+0000 7ff6be7fc700 1 -- 172.21.15.6:0/3746648348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ff6b8057890 con 0x7ff6c006d120 2023-10-09T11:42:00.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:00.480 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:41:38.419450+0000","modified":"2023-10-09T11:41:42.044145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/2798220359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2798220359},{"type":"v1","addr":"172.21.15.6:6837","nonce":2798220359}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T11:42:00.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.480+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 msgr2=0x7ff6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.480+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 0x7ff6ac0693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff6c015cc40 tx=0x7ff6b4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 msgr2=0x7ff6c016a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff6c006fe20 tx=0x7ff6b8019000 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 shutdown_connections 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff6ac066f30 0x7ff6ac0693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6c0157ca0 0x7ff6c0154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6c006d120 0x7ff6c016a520 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 --2- 172.21.15.6:0/3746648348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6c01578d0 0x7ff6c00b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 >> 172.21.15.6:0/3746648348 conn(0x7ff6c006bb90 msgr2=0x7ff6c0156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 shutdown_connections 2023-10-09T11:42:00.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.481+0000 7ff6c8306700 1 -- 172.21.15.6:0/3746648348 wait complete. 2023-10-09T11:42:00.483 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 60 2023-10-09T11:42:00.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.611+0000 7f81d4897700 1 Processor -- start 2023-10-09T11:42:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.611+0000 7f81d4897700 1 -- start start 2023-10-09T11:42:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81d4897700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 0x7f81d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81d4897700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00d07c0 con 0x7f81d006d120 2023-10-09T11:42:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81d4897700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00cfbb0 con 0x7f81d01578d0 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81d4897700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cfe90 con 0x7f81d0157ca0 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81ced9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81d006d120 0x7f81d015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37704/0 (socket says 172.21.15.6:37704) 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81ced9d700 1 -- 172.21.15.6:0/2197297092 learned_addr learned my addr 172.21.15.6:0/2197297092 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cdd9b700 1 --2- 172.21.15.6:0/2197297092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 0x7f81d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267480233 0 0) 0x7f81d00d07c0 con 0x7f81d006d120 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b8003570 con 0x7f81d006d120 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52927640 0 0) 0x7f81d00cfbb0 con 0x7f81d01578d0 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d00d07c0 con 0x7f81d01578d0 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341760355 0 0) 0x7f81b8003570 con 0x7f81d006d120 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cdd9b700 1 -- 172.21.15.6:0/2197297092 >> v1:172.21.15.118:6789/0 conn(0x7f81d01578d0 legacy=0x7f81d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cdd9b700 1 -- 172.21.15.6:0/2197297092 >> v1:172.21.15.6:6789/0 conn(0x7f81d006d120 legacy=0x7f81d015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.612+0000 7f81cdd9b700 1 -- 172.21.15.6:0/2197297092 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00d0170 con 0x7f81d0157ca0 2023-10-09T11:42:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81cdd9b700 1 --2- 172.21.15.6:0/2197297092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 0x7f81d00cf4f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009910 tx=0x7f81c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3e217be11b9232 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80017f0 con 0x7f81d0157ca0 2023-10-09T11:42:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4011420 con 0x7f81d0157ca0 2023-10-09T11:42:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81cd59a700 1 -- 172.21.15.6:0/2197297092 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40117c0 con 0x7f81d0157ca0 2023-10-09T11:42:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 -- 172.21.15.6:0/2197297092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 msgr2=0x7f81d00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 --2- 172.21.15.6:0/2197297092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 0x7f81d00cf4f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009910 tx=0x7f81c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 -- 172.21.15.6:0/2197297092 shutdown_connections 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 --2- 172.21.15.6:0/2197297092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d0157ca0 0x7f81d00cf4f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 -- 172.21.15.6:0/2197297092 >> 172.21.15.6:0/2197297092 conn(0x7f81d006bb90 msgr2=0x7f81d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 -- 172.21.15.6:0/2197297092 shutdown_connections 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.613+0000 7f81d4897700 1 -- 172.21.15.6:0/2197297092 wait complete. 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.614+0000 7f81d4897700 1 Processor -- start 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 -- start start 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d01578d0 0x7f81d00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 0x7f81d0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0152190 con 0x7f81d006d120 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00b20b0 con 0x7f81d0157ca0 2023-10-09T11:42:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81d4897700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00ab910 con 0x7f81d01578d0 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81ce59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81ce59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42334/0 (socket says 172.21.15.6:42334) 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.615+0000 7f81ce59c700 1 -- 172.21.15.6:0/4063154174 learned_addr learned my addr 172.21.15.6:0/4063154174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ced9d700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 0x7f81d0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81cdd9b700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d01578d0 0x7f81d00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 -- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d01578d0 msgr2=0x7f81d00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d01578d0 0x7f81d00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 -- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 msgr2=0x7f81d0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 0x7f81d0151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 -- 172.21.15.6:0/4063154174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009420 con 0x7f81d006d120 2023-10-09T11:42:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ced9d700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 0x7f81d0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81ce59c700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c790 tx=0x7f81c0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0010510 con 0x7f81d006d120 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0010670 con 0x7f81d006d120 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d00abbf0 con 0x7f81d006d120 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0010a10 con 0x7f81d006d120 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.616+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d00b1d40 con 0x7f81d006d120 2023-10-09T11:42:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.617+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d00b2390 con 0x7f81d006d120 2023-10-09T11:42:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.617+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81c001b400 con 0x7f81d006d120 2023-10-09T11:42:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.618+0000 7f81be7fc700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 0x7f81b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.618+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81c0084300 con 0x7f81d006d120 2023-10-09T11:42:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.618+0000 7f81cdd9b700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 0x7f81b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.618+0000 7f81cdd9b700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 0x7f81b00693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81c40030c0 tx=0x7f81c4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.622+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81c0051570 con 0x7f81d006d120 2023-10-09T11:42:00.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.816+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81d00ac0f0 con 0x7f81d006d120 2023-10-09T11:42:00.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.817+0000 7f81be7fc700 1 -- 172.21.15.6:0/4063154174 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f81c0054b90 con 0x7f81d006d120 2023-10-09T11:42:00.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:00.818 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":118,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:41:55.079547+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:41:36.814730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T11:41:37.390051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 msgr2=0x7f81b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 0x7f81b00693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81c40030c0 tx=0x7f81c4016000 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 msgr2=0x7f81d0152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c790 tx=0x7f81c0007e10 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 shutdown_connections 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f81b0066f30 0x7f81b00693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81d0157ca0 0x7f81d0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d006d120 0x7f81d0152340 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 --2- 172.21.15.6:0/4063154174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81d01578d0 0x7f81d00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 >> 172.21.15.6:0/4063154174 conn(0x7f81d006bb90 msgr2=0x7f81d0068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 shutdown_connections 2023-10-09T11:42:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.819+0000 7f81d4897700 1 -- 172.21.15.6:0/4063154174 wait complete. 2023-10-09T11:42:00.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:42:00.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.950+0000 7fd640225700 1 Processor -- start 2023-10-09T11:42:00.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 -- start start 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd6381578d0 0x7fd6380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd63806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6380d07c0 con 0x7fd638157ca0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63806daa0 con 0x7fd6381578d0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.951+0000 7fd640225700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380cfbb0 con 0x7fd63806d120 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63d7c0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd638157ca0 0x7fd63815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37706/0 (socket says 172.21.15.6:37706) 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63d7c0700 1 -- 172.21.15.6:0/879893998 learned_addr learned my addr 172.21.15.6:0/879893998 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/879893998 >> v2:172.21.15.118:3300/0 conn(0x7fd6381578d0 0x7fd6380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63e7c2700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd63806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434752444 0 0) 0x7fd6380d07c0 con 0x7fd638157ca0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd620003570 con 0x7fd638157ca0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639238981 0 0) 0x7fd620003570 con 0x7fd638157ca0 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 msgr2=0x7fd63806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd63806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 >> v2:172.21.15.118:3300/0 conn(0x7fd6381578d0 msgr2=0x7fd6380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 --2- 172.21.15.6:0/879893998 >> v2:172.21.15.118:3300/0 conn(0x7fd6381578d0 0x7fd6380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380cfe90 con 0x7fd638157ca0 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fd62c001470 con 0x7fd638157ca0 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 >> v1:172.21.15.6:6789/0 conn(0x7fd638157ca0 legacy=0x7fd63815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620003a60 0x7fd620003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd6200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63806daa0 con 0x7fd620003a60 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380cfbb0 con 0x7fd620004810 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62000ba60 con 0x7fd63806d120 2023-10-09T11:42:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620003a60 0x7fd620003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.952+0000 7fd63e7c2700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd6200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63d7c0700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 -- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 msgr2=0x7fd6200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd63806d120 0x7fd6200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 -- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd620004810 msgr2=0x7fd620004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd620004810 0x7fd620004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 -- 172.21.15.6:0/879893998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620003570 con 0x7fd620003a60 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620003a60 0x7fd620003e70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c30 tx=0x7fd6300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57642569821b7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000e710 con 0x7fd620003a60 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63000e870 con 0x7fd620003a60 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.953+0000 7fd63cfbf700 1 -- 172.21.15.6:0/879893998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000ec30 con 0x7fd620003a60 2023-10-09T11:42:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 -- 172.21.15.6:0/879893998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620003a60 msgr2=0x7fd620003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 --2- 172.21.15.6:0/879893998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620003a60 0x7fd620003e70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c30 tx=0x7fd6300091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd63e7c2700 1 -- 172.21.15.6:0/879893998 reap_dead start 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 -- 172.21.15.6:0/879893998 shutdown_connections 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 -- 172.21.15.6:0/879893998 >> 172.21.15.6:0/879893998 conn(0x7fd63806bb90 msgr2=0x7fd63806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 -- 172.21.15.6:0/879893998 shutdown_connections 2023-10-09T11:42:00.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.954+0000 7fd640225700 1 -- 172.21.15.6:0/879893998 wait complete. 2023-10-09T11:42:00.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.955+0000 7fd640225700 1 Processor -- start 2023-10-09T11:42:00.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.955+0000 7fd640225700 1 -- start start 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd620003a60 0x7fd6380ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6381538d0 0x7fd63816ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380b3ef0 con 0x7fd638153d40 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380b41d0 con 0x7fd6381538d0 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd640225700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380b44b0 con 0x7fd620003a60 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42348/0 (socket says 172.21.15.6:42348) 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 -- 172.21.15.6:0/741000572 learned_addr learned my addr 172.21.15.6:0/741000572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd620003a60 0x7fd6380ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63d7c0700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6381538d0 0x7fd63816ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 -- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd620003a60 msgr2=0x7fd6380ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd620003a60 0x7fd6380ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 -- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6381538d0 msgr2=0x7fd63816ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6381538d0 0x7fd63816ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 -- 172.21.15.6:0/741000572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380b4790 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd63e7c2700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd638063f70 tx=0x7fd62800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.956+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800e040 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.957+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62800f040 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.957+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6380b4a70 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.957+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800fd70 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.957+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6380ab7b0 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.958+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638067ac0 con 0x7fd638153d40 2023-10-09T11:42:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.958+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd628015640 con 0x7fd638153d40 2023-10-09T11:42:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.958+0000 7fd635ffb700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.959+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd628084cc0 con 0x7fd638153d40 2023-10-09T11:42:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.959+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.959+0000 7fd63dfc1700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 0x7fd6240693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd6300091e0 tx=0x7fd63001a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:00.963+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd628051f30 con 0x7fd638153d40 2023-10-09T11:42:01.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.198+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6380d0170 con 0x7fd638153d40 2023-10-09T11:42:01.199 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:42:01.199+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:42:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.204+0000 7fd635ffb700 1 -- 172.21.15.6:0/741000572 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd628055550 con 0x7fd638153d40 2023-10-09T11:42:01.206 INFO:tasks.ceph.mds.c.smithi006.stderr: -3435> 2023-10-09T11:41:44.336+0000 7f6e1a9c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 msgr2=0x7fd6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 0x7fd6240693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd6300091e0 tx=0x7fd63001a000 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 msgr2=0x7fd6380b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd638063f70 tx=0x7fd62800b040 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 shutdown_connections 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd638153d40 0x7fd6380b4f90 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd620003a60 0x7fd6380ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 --2- 172.21.15.6:0/741000572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6381538d0 0x7fd63816ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 >> 172.21.15.6:0/741000572 conn(0x7fd63806bb90 msgr2=0x7fd638154800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 shutdown_connections 2023-10-09T11:42:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.207+0000 7fd640225700 1 -- 172.21.15.6:0/741000572 wait complete. 2023-10-09T11:42:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:42:01.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:42:01.231 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:42:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.341+0000 7f35662da700 1 Processor -- start 2023-10-09T11:42:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.341+0000 7f35662da700 1 -- start start 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f35662da700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35601578d0 0x7f35600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f35662da700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f35662da700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600d07c0 con 0x7f356006d120 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f35662da700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600cfbb0 con 0x7f3560157ca0 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f35662da700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600cfe90 con 0x7f35601578d0 2023-10-09T11:42:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42368/0 (socket says 172.21.15.6:42368) 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355f7fe700 1 -- 172.21.15.6:0/714698846 learned_addr learned my addr 172.21.15.6:0/714698846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 --2- 172.21.15.6:0/714698846 >> v2:172.21.15.118:3300/0 conn(0x7f35601578d0 0x7f35600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 -- 172.21.15.6:0/714698846 >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 msgr2=0x7f356015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 --2- 172.21.15.6:0/714698846 >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 -- 172.21.15.6:0/714698846 >> v1:172.21.15.118:6789/0 conn(0x7f356006d120 legacy=0x7f356006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 -- 172.21.15.6:0/714698846 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600d0170 con 0x7f35601578d0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355f7fe700 1 --2- 172.21.15.6:0/714698846 >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.342+0000 7f355ffff700 1 --2- 172.21.15.6:0/714698846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600cf4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35600646b0 tx=0x7f35540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54162c1026f64979 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f355effd700 1 -- 172.21.15.6:0/714698846 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011630 con 0x7f35601578d0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f355effd700 1 -- 172.21.15.6:0/714698846 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554011790 con 0x7f35601578d0 2023-10-09T11:42:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f355effd700 1 -- 172.21.15.6:0/714698846 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554011b30 con 0x7f35601578d0 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 -- 172.21.15.6:0/714698846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 msgr2=0x7f35600cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 --2- 172.21.15.6:0/714698846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600cf4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35600646b0 tx=0x7f35540091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 -- 172.21.15.6:0/714698846 shutdown_connections 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 --2- 172.21.15.6:0/714698846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600cf4f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 --2- 172.21.15.6:0/714698846 >> v2:172.21.15.6:3300/0 conn(0x7f3560157ca0 0x7f356015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 -- 172.21.15.6:0/714698846 >> 172.21.15.6:0/714698846 conn(0x7f356006bb90 msgr2=0x7f356006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 -- 172.21.15.6:0/714698846 shutdown_connections 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.343+0000 7f35662da700 1 -- 172.21.15.6:0/714698846 wait complete. 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.344+0000 7f35662da700 1 Processor -- start 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.344+0000 7f35662da700 1 -- start start 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 0x7f3560154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b6000 con 0x7f3560157ca0 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b5110 con 0x7f35601578d0 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f35662da700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b53f0 con 0x7f356006d120 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f3564877700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f3564877700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42376/0 (socket says 172.21.15.6:42376) 2023-10-09T11:42:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f3564877700 1 -- 172.21.15.6:0/4254979536 learned_addr learned my addr 172.21.15.6:0/4254979536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f355ffff700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 0x7f3560154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.345+0000 7f355f7fe700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 -- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 msgr2=0x7f3560154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 0x7f3560154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 -- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 msgr2=0x7f35600b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 -- 172.21.15.6:0/4254979536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500094f0 con 0x7f3560157ca0 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f355ffff700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 0x7f3560154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f355f7fe700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3564877700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f355800c8e0 tx=0x7f3558001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800ce80 con 0x7f3560157ca0 2023-10-09T11:42:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800a7e0 con 0x7f3560157ca0 2023-10-09T11:42:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3554009420 con 0x7f3560157ca0 2023-10-09T11:42:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800ab80 con 0x7f3560157ca0 2023-10-09T11:42:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.346+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35600b59b0 con 0x7f3560157ca0 2023-10-09T11:42:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.347+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600b6170 con 0x7f3560157ca0 2023-10-09T11:42:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.347+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3558012420 con 0x7f3560157ca0 2023-10-09T11:42:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.348+0000 7f3547fff700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.348+0000 7f355ffff700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.348+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f3558084870 con 0x7f3560157ca0 2023-10-09T11:42:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.348+0000 7f355ffff700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35540093f0 tx=0x7f3554017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.352+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3558051a90 con 0x7f3560157ca0 2023-10-09T11:42:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:01.588+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35600d0450 con 0x7f3560157ca0 2023-10-09T11:42:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.203+0000 7f3547fff700 1 -- 172.21.15.6:0/4254979536 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f35580550b0 con 0x7f3560157ca0 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 msgr2=0x7f354c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35540093f0 tx=0x7f3554017000 comp rx=0 tx=0).stop 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 msgr2=0x7f35600cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f355800c8e0 tx=0x7f3558001710 comp rx=0 tx=0).stop 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 shutdown_connections 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3560157ca0 0x7f35600cd0f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f356006d120 0x7f3560154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 --2- 172.21.15.6:0/4254979536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35601578d0 0x7f35600b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 >> 172.21.15.6:0/4254979536 conn(0x7f356006bb90 msgr2=0x7f35601556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 shutdown_connections 2023-10-09T11:42:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.206+0000 7f35662da700 1 -- 172.21.15.6:0/4254979536 wait complete. 2023-10-09T11:42:02.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:42:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.388+0000 7f5d2e846700 1 Processor -- start 2023-10-09T11:42:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.388+0000 7f5d2e846700 1 -- start start 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2e846700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2e846700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d2806d120 0x7f5d2806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2e846700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2806dac0 con 0x7f5d281578d0 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2e846700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280d07c0 con 0x7f5d2806d120 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2e846700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280cfbb0 con 0x7f5d28157ca0 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d2806d120 0x7f5d2806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d2806d120 0x7f5d2806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42392/0 (socket says 172.21.15.6:42392) 2023-10-09T11:42:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 -- 172.21.15.6:0/1664241106 learned_addr learned my addr 172.21.15.6:0/1664241106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d277fe700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 -- 172.21.15.6:0/1664241106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 msgr2=0x7f5d280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 -- 172.21.15.6:0/1664241106 >> v1:172.21.15.118:6789/0 conn(0x7f5d281578d0 legacy=0x7f5d2815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 -- 172.21.15.6:0/1664241106 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280cfe90 con 0x7f5d2806d120 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d26ffd700 1 -- 172.21.15.6:0/1664241106 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809147355 0 0) 0x7f5d1c001110 con 0x7f5d281578d0 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d2cde3700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d2806d580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009f20 tx=0x7f5d20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da1412c74f8f92f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d26ffd700 1 -- 172.21.15.6:0/1664241106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000e070 con 0x7f5d2806d120 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.389+0000 7f5d26ffd700 1 -- 172.21.15.6:0/1664241106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000b9d0 con 0x7f5d2806d120 2023-10-09T11:42:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d26ffd700 1 -- 172.21.15.6:0/1664241106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200092e0 con 0x7f5d2806d120 2023-10-09T11:42:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 -- 172.21.15.6:0/1664241106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 msgr2=0x7f5d2806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d2806d580 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009f20 tx=0x7f5d20009840 comp rx=0 tx=0).stop 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 -- 172.21.15.6:0/1664241106 shutdown_connections 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d2806d580 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1664241106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 -- 172.21.15.6:0/1664241106 >> 172.21.15.6:0/1664241106 conn(0x7f5d2806bb90 msgr2=0x7f5d2806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 -- 172.21.15.6:0/1664241106 shutdown_connections 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.390+0000 7f5d2e846700 1 -- 172.21.15.6:0/1664241106 wait complete. 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.391+0000 7f5d2e846700 1 Processor -- start 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.391+0000 7f5d2e846700 1 -- start start 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d281578d0 0x7f5d280ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d2816db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280ad020 con 0x7f5d2806d120 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280ac410 con 0x7f5d281578d0 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2e846700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280ac6f0 con 0x7f5d28157ca0 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42400/0 (socket says 172.21.15.6:42400) 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 -- 172.21.15.6:0/1761175372 learned_addr learned my addr 172.21.15.6:0/1761175372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d277fe700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d281578d0 0x7f5d280ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d2cde3700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d2816db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 -- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 msgr2=0x7f5d2816db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d2816db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 -- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d281578d0 msgr2=0x7f5d280ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d281578d0 0x7f5d280ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.392+0000 7f5d27fff700 1 -- 172.21.15.6:0/1761175372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009ae0 con 0x7f5d2806d120 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d27fff700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c7e0 tx=0x7f5d1c007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c012630 con 0x7f5d2806d120 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0127b0 con 0x7f5d2806d120 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280ac9d0 con 0x7f5d2806d120 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c012b70 con 0x7f5d2806d120 2023-10-09T11:42:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.393+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28155c70 con 0x7f5d2806d120 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.394+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d28067ac0 con 0x7f5d2806d120 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.394+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d1c01b400 con 0x7f5d2806d120 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.394+0000 7f5d0ffff700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.395+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f5d1c083ff0 con 0x7f5d2806d120 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.395+0000 7f5d277fe700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.395+0000 7f5d277fe700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 0x7f5d140693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b33a0 tx=0x7f5d18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.399+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d1c051210 con 0x7f5d2806d120 2023-10-09T11:42:02.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:02.594+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d2806dac0 con 0x7f5d2806d120 2023-10-09T11:42:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.207+0000 7f5d0ffff700 1 -- 172.21.15.6:0/1761175372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5d2806dac0 con 0x7f5d2806d120 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 msgr2=0x7f5d140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 0x7f5d140693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b33a0 tx=0x7f5d18008040 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 msgr2=0x7f5d28155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c7e0 tx=0x7f5d1c007c60 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 shutdown_connections 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5d14066f30 0x7f5d140693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d28157ca0 0x7f5d2816db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d2806d120 0x7f5d28155730 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 --2- 172.21.15.6:0/1761175372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d281578d0 0x7f5d280ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 >> 172.21.15.6:0/1761175372 conn(0x7f5d2806bb90 msgr2=0x7f5d2815c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 shutdown_connections 2023-10-09T11:42:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.210+0000 7f5d2e846700 1 -- 172.21.15.6:0/1761175372 wait complete. 2023-10-09T11:42:03.212 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:42:03.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:42:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.351+0000 7f4c2920b700 1 Processor -- start 2023-10-09T11:42:03.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.351+0000 7f4c2920b700 1 -- start start 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c2920b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c240cddd0 0x7f4c240cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c2920b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240cb240 0x7f4c240cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c2920b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240cadb0 con 0x7f4c240b43c0 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c2920b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240cf000 con 0x7f4c240cddd0 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c2920b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240cf2e0 con 0x7f4c240cb240 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c240cddd0 0x7f4c240cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c240cddd0 0x7f4c240cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57500/0 (socket says 172.21.15.6:57500) 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 -- 172.21.15.6:0/847525379 learned_addr learned my addr 172.21.15.6:0/847525379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c28a0a700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240cb240 0x7f4c240cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 -- 172.21.15.6:0/847525379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240cb240 msgr2=0x7f4c240cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240cb240 0x7f4c240cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 -- 172.21.15.6:0/847525379 >> v1:172.21.15.118:6789/0 conn(0x7f4c240b43c0 legacy=0x7f4c240cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.352+0000 7f4c237fe700 1 -- 172.21.15.6:0/847525379 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240ca760 con 0x7f4c240cddd0 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c237fe700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cddd0 0x7f4c240cccc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4c140099b0 tx=0x7f4c14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9bd36c563d6cfa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c22ffd700 1 -- 172.21.15.6:0/847525379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400b860 con 0x7f4c240cddd0 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c22ffd700 1 -- 172.21.15.6:0/847525379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1400b9c0 con 0x7f4c240cddd0 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c22ffd700 1 -- 172.21.15.6:0/847525379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400bd60 con 0x7f4c240cddd0 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 -- 172.21.15.6:0/847525379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cddd0 msgr2=0x7f4c240cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cddd0 0x7f4c240cccc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4c140099b0 tx=0x7f4c14009250 comp rx=0 tx=0).stop 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 -- 172.21.15.6:0/847525379 shutdown_connections 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240cb240 0x7f4c240cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 --2- 172.21.15.6:0/847525379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cddd0 0x7f4c240cccc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 -- 172.21.15.6:0/847525379 >> 172.21.15.6:0/847525379 conn(0x7f4c24068110 msgr2=0x7f4c2406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 -- 172.21.15.6:0/847525379 shutdown_connections 2023-10-09T11:42:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.353+0000 7f4c2920b700 1 -- 172.21.15.6:0/847525379 wait complete. 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.354+0000 7f4c2920b700 1 Processor -- start 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 -- start start 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 0x7f4c2416bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c240cddd0 0x7f4c240c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c79b0 con 0x7f4c240cb240 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241697a0 con 0x7f4c240cddd0 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c2920b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24169a80 con 0x7f4c240b43c0 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57516/0 (socket says 172.21.15.6:57516) 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c237fe700 1 -- 172.21.15.6:0/3342669977 learned_addr learned my addr 172.21.15.6:0/3342669977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.355+0000 7f4c28a0a700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c240cddd0 0x7f4c240c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c23fff700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 0x7f4c2416bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 -- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 msgr2=0x7f4c2416bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 0x7f4c2416bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 -- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c240cddd0 msgr2=0x7f4c240c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c240cddd0 0x7f4c240c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 -- 172.21.15.6:0/3342669977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140094f0 con 0x7f4c240cb240 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c23fff700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 0x7f4c2416bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c237fe700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4c240632d0 tx=0x7f4c14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1401a450 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1401a5d0 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24169d60 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1401a990 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.356+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2415ad20 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.357+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c240b47f0 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.357+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c1401ad40 con 0x7f4c240cb240 2023-10-09T11:42:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.358+0000 7f4c1bfff700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.358+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f4c14085e50 con 0x7f4c240cb240 2023-10-09T11:42:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.358+0000 7f4c23fff700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.358+0000 7f4c23fff700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c007fd0 tx=0x7f4c0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:03.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.362+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c14053220 con 0x7f4c240cb240 2023-10-09T11:42:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:03.556+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c2415b000 con 0x7f4c240cb240 2023-10-09T11:42:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.213+0000 7f4c1bfff700 1 -- 172.21.15.6:0/3342669977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c14056840 con 0x7f4c240cb240 2023-10-09T11:42:04.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 msgr2=0x7f4c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c007fd0 tx=0x7f4c0c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 msgr2=0x7f4c2416c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4c240632d0 tx=0x7f4c14017000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 shutdown_connections 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c240cddd0 0x7f4c240c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c240b43c0 0x7f4c2416bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 --2- 172.21.15.6:0/3342669977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c240cb240 0x7f4c2416c110 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 >> 172.21.15.6:0/3342669977 conn(0x7f4c24068110 msgr2=0x7f4c24156330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 shutdown_connections 2023-10-09T11:42:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.217+0000 7f4c2920b700 1 -- 172.21.15.6:0/3342669977 wait complete. 2023-10-09T11:42:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:42:04.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:42:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.358+0000 7f2fc3cef700 1 Processor -- start 2023-10-09T11:42:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.358+0000 7f2fc3cef700 1 -- start start 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc3cef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fbc0cf240 0x7f2fbc162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc3cef700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b2890 con 0x7f2fbc0b3bd0 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc3cef700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b4070 con 0x7f2fbc157fe0 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc3cef700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b4350 con 0x7f2fbc0cf240 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc228c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fbc0cf240 0x7f2fbc162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc128a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2fbc0b3bd0 0x7f2fbc0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45382/0 (socket says 172.21.15.6:45382) 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc128a700 1 -- 172.21.15.6:0/479869860 learned_addr learned my addr 172.21.15.6:0/479869860 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc228c700 1 -- 172.21.15.6:0/479869860 >> v1:172.21.15.118:6789/0 conn(0x7f2fbc157fe0 legacy=0x7f2fbc0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc228c700 1 -- 172.21.15.6:0/479869860 >> v1:172.21.15.6:6789/0 conn(0x7f2fbc0b3bd0 legacy=0x7f2fbc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc228c700 1 -- 172.21.15.6:0/479869860 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0b4630 con 0x7f2fbc0cf240 2023-10-09T11:42:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc0a89700 1 -- 172.21.15.6:0/479869860 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802254288 0 0) 0x7f2fbc0b2890 con 0x7f2fbc0b3bd0 2023-10-09T11:42:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc228c700 1 --2- 172.21.15.6:0/479869860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc162cd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0098e0 tx=0x7f2fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920b8a381f12fd89 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc0a89700 1 -- 172.21.15.6:0/479869860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac009e80 con 0x7f2fbc0cf240 2023-10-09T11:42:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc0a89700 1 -- 172.21.15.6:0/479869860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00b860 con 0x7f2fbc0cf240 2023-10-09T11:42:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.359+0000 7f2fc0a89700 1 -- 172.21.15.6:0/479869860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00bbe0 con 0x7f2fbc0cf240 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 -- 172.21.15.6:0/479869860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc0cf240 msgr2=0x7f2fbc162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/479869860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc162cd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0098e0 tx=0x7f2fac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 -- 172.21.15.6:0/479869860 shutdown_connections 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/479869860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc162cd0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 -- 172.21.15.6:0/479869860 >> 172.21.15.6:0/479869860 conn(0x7f2fbc067640 msgr2=0x7f2fbc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 -- 172.21.15.6:0/479869860 shutdown_connections 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.360+0000 7f2fc3cef700 1 -- 172.21.15.6:0/479869860 wait complete. 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.361+0000 7f2fc3cef700 1 Processor -- start 2023-10-09T11:42:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.361+0000 7f2fc3cef700 1 -- start start 2023-10-09T11:42:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 0x7f2fbc148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc148e40 con 0x7f2fbc157fe0 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c6230 con 0x7f2fbc0cf240 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc3cef700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5620 con 0x7f2fbc0b3bd0 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57532/0 (socket says 172.21.15.6:57532) 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 -- 172.21.15.6:0/1211245067 learned_addr learned my addr 172.21.15.6:0/1211245067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc128a700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc1a8b700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 0x7f2fbc148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 -- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 msgr2=0x7f2fbc148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 0x7f2fbc148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 -- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fbc0cf240 msgr2=0x7f2fbc0c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc0c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 -- 172.21.15.6:0/1211245067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009420 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc1a8b700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 0x7f2fbc148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.362+0000 7f2fc228c700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2fac013000 tx=0x7f2fac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.363+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac01f070 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.363+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac011420 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.363+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c5900 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.363+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0117e0 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.363+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0c5ec0 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.364+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc069e40 con 0x7f2fbc157fe0 2023-10-09T11:42:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.364+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fac011b50 con 0x7f2fbc157fe0 2023-10-09T11:42:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.365+0000 7f2fb9ffb700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.365+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2fac085990 con 0x7f2fbc157fe0 2023-10-09T11:42:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.365+0000 7f2fc1a8b700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.365+0000 7f2fc1a8b700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007fd0 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.369+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fac052f00 con 0x7f2fbc157fe0 2023-10-09T11:42:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.560+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2fbc0cc6b0 con 0x7f2fbc157fe0 2023-10-09T11:42:04.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.565+0000 7f2fb9ffb700 1 -- 172.21.15.6:0/1211245067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2fac056520 con 0x7f2fbc157fe0 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 msgr2=0x7f2fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007fd0 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 msgr2=0x7f2fbc0c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2fac013000 tx=0x7f2fac017000 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 shutdown_connections 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fbc157fe0 0x7f2fbc0c9d90 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2fbc0b3bd0 0x7f2fbc148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 --2- 172.21.15.6:0/1211245067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fbc0cf240 0x7f2fbc0c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 >> 172.21.15.6:0/1211245067 conn(0x7f2fbc067640 msgr2=0x7f2fbc1536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 shutdown_connections 2023-10-09T11:42:04.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.567+0000 7f2fc3cef700 1 -- 172.21.15.6:0/1211245067 wait complete. 2023-10-09T11:42:04.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-09T11:42:04.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.697+0000 7fc996240700 1 Processor -- start 2023-10-09T11:42:04.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.697+0000 7fc996240700 1 -- start start 2023-10-09T11:42:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc996240700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9901578d0 0x7fc9900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc996240700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc99006d120 0x7fc99006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc996240700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900d07c0 con 0x7fc990157ca0 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc996240700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99006da50 con 0x7fc99006d120 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc996240700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9900cfbb0 con 0x7fc9901578d0 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc98ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc99006d120 0x7fc99006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc98effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc990157ca0 0x7fc99015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45390/0 (socket says 172.21.15.6:45390) 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc98ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc99006d120 0x7fc99006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57542/0 (socket says 172.21.15.6:57542) 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.698+0000 7fc98effd700 1 -- 172.21.15.6:0/3564592398 learned_addr learned my addr 172.21.15.6:0/3564592398 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/3564592398 >> v2:172.21.15.118:3300/0 conn(0x7fc9901578d0 0x7fc9900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98ffff700 1 -- 172.21.15.6:0/3564592398 >> v2:172.21.15.118:3300/0 conn(0x7fc9901578d0 msgr2=0x7fc9900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98ffff700 1 --2- 172.21.15.6:0/3564592398 >> v2:172.21.15.118:3300/0 conn(0x7fc9901578d0 0x7fc9900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98ffff700 1 -- 172.21.15.6:0/3564592398 >> v1:172.21.15.6:6789/0 conn(0x7fc990157ca0 legacy=0x7fc99015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98ffff700 1 -- 172.21.15.6:0/3564592398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900cfe90 con 0x7fc99006d120 2023-10-09T11:42:04.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98e7fc700 1 -- 172.21.15.6:0/3564592398 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190170241 0 0) 0x7fc9900d07c0 con 0x7fc990157ca0 2023-10-09T11:42:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98ffff700 1 --2- 172.21.15.6:0/3564592398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc99006d120 0x7fc99006d510 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc9900646b0 tx=0x7fc988009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84147352a52c6c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98e7fc700 1 -- 172.21.15.6:0/3564592398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800e070 con 0x7fc99006d120 2023-10-09T11:42:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98e7fc700 1 -- 172.21.15.6:0/3564592398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800bb60 con 0x7fc99006d120 2023-10-09T11:42:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.699+0000 7fc98e7fc700 1 -- 172.21.15.6:0/3564592398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988012430 con 0x7fc99006d120 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 -- 172.21.15.6:0/3564592398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc99006d120 msgr2=0x7fc99006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 --2- 172.21.15.6:0/3564592398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc99006d120 0x7fc99006d510 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc9900646b0 tx=0x7fc988009780 comp rx=0 tx=0).stop 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 -- 172.21.15.6:0/3564592398 shutdown_connections 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 --2- 172.21.15.6:0/3564592398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc99006d120 0x7fc99006d510 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 --2- 172.21.15.6:0/3564592398 >> v2:172.21.15.118:3300/0 conn(0x7fc9901578d0 0x7fc9900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 -- 172.21.15.6:0/3564592398 >> 172.21.15.6:0/3564592398 conn(0x7fc99006bb90 msgr2=0x7fc99006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 -- 172.21.15.6:0/3564592398 shutdown_connections 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.700+0000 7fc996240700 1 -- 172.21.15.6:0/3564592398 wait complete. 2023-10-09T11:42:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.701+0000 7fc996240700 1 Processor -- start 2023-10-09T11:42:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.701+0000 7fc996240700 1 -- start start 2023-10-09T11:42:04.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc99006d120 0x7fc9900af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990157ca0 0x7fc9900ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900b5640 con 0x7fc9901578d0 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ae180 con 0x7fc990157ca0 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc996240700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900b4d10 con 0x7fc99006d120 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57544/0 (socket says 172.21.15.6:57544) 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 -- 172.21.15.6:0/2829293061 learned_addr learned my addr 172.21.15.6:0/2829293061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98ffff700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990157ca0 0x7fc9900ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc99006d120 0x7fc9900af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 -- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc99006d120 msgr2=0x7fc9900af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc99006d120 0x7fc9900af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 -- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990157ca0 msgr2=0x7fc9900ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990157ca0 0x7fc9900ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 -- 172.21.15.6:0/2829293061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009a20 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.702+0000 7fc98effd700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c5e0 tx=0x7fc984000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.703+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984005b30 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.703+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984005c90 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.703+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984007300 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.703+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900b4ff0 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.703+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900adea0 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.704+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc990067ac0 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.704+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc98401b3b0 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.704+0000 7fc9777fe700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 0x7fc97c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.704+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc984083630 con 0x7fc9901578d0 2023-10-09T11:42:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.704+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 0x7fc97c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:04.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.705+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 0x7fc97c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc980009db0 tx=0x7fc9800091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:04.708 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:04.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.709+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc984050ba0 con 0x7fc9901578d0 2023-10-09T11:42:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:04.987+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fc9900d0170 con 0x7fc9901578d0 2023-10-09T11:42:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.215+0000 7fc9777fe700 1 -- 172.21.15.6:0/2829293061 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v313) v1 ==== 128+0+0 (secure 0 0 0) 0x7fc9840541c0 con 0x7fc9901578d0 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 msgr2=0x7fc97c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 0x7fc97c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc980009db0 tx=0x7fc9800091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 msgr2=0x7fc9900ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c5e0 tx=0x7fc984000fe0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 shutdown_connections 2023-10-09T11:42:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc97c066f30 0x7fc97c0693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990157ca0 0x7fc9900ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc99006d120 0x7fc9900af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 --2- 172.21.15.6:0/2829293061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9901578d0 0x7fc9900ad420 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 >> 172.21.15.6:0/2829293061 conn(0x7fc99006bb90 msgr2=0x7fc990069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 shutdown_connections 2023-10-09T11:42:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.217+0000 7fc996240700 1 -- 172.21.15.6:0/2829293061 wait complete. 2023-10-09T11:42:05.230 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-09T11:42:05.230 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T11:42:05.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-09T11:42:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.350+0000 7fc64793d700 1 Processor -- start 2023-10-09T11:42:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 -- start start 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc64006d120 0x7fc64006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64006dac0 con 0x7fc640157ca0 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6400d07c0 con 0x7fc64006d120 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc64793d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400cfbb0 con 0x7fc6401578d0 2023-10-09T11:42:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc644ed8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc640157ca0 0x7fc64015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45402/0 (socket says 172.21.15.6:45402) 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.351+0000 7fc644ed8700 1 -- 172.21.15.6:0/144402629 learned_addr learned my addr 172.21.15.6:0/144402629 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949816880 0 0) 0x7fc634001110 con 0x7fc640157ca0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc6456d9700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc645eda700 1 --2- 172.21.15.6:0/144402629 >> v2:172.21.15.118:3300/0 conn(0x7fc64006d120 0x7fc64006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc628003570 con 0x7fc640157ca0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137485656 0 0) 0x7fc628003570 con 0x7fc640157ca0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 msgr2=0x7fc6400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 >> v2:172.21.15.118:3300/0 conn(0x7fc64006d120 msgr2=0x7fc64006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 --2- 172.21.15.6:0/144402629 >> v2:172.21.15.118:3300/0 conn(0x7fc64006d120 0x7fc64006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400cfe90 con 0x7fc640157ca0 2023-10-09T11:42:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fc634001600 con 0x7fc640157ca0 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 >> v1:172.21.15.6:6789/0 conn(0x7fc640157ca0 legacy=0x7fc64015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc628003a60 0x7fc628003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc628004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400d07c0 con 0x7fc628004810 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400cfbb0 con 0x7fc628003a60 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62800ba60 con 0x7fc6401578d0 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc644ed8700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc628004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc6456d9700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc628003a60 0x7fc628003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc645eda700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc644ed8700 1 -- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 msgr2=0x7fc6280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.352+0000 7fc644ed8700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc644ed8700 1 -- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc628003a60 msgr2=0x7fc628003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc644ed8700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc628003a60 0x7fc628003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc644ed8700 1 -- 172.21.15.6:0/144402629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628003570 con 0x7fc628004810 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc645eda700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6401578d0 0x7fc6280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc644ed8700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc628004c80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c620 tx=0x7fc6400d0730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce545282ca9c4700 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400cde0 con 0x7fc628004810 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634005920 con 0x7fc628004810 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc63ffff700 1 -- 172.21.15.6:0/144402629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634005ce0 con 0x7fc628004810 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 -- 172.21.15.6:0/144402629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 msgr2=0x7fc628004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 --2- 172.21.15.6:0/144402629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc628004c80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c620 tx=0x7fc6400d0730 comp rx=0 tx=0).stop 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc645eda700 1 -- 172.21.15.6:0/144402629 reap_dead start 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 -- 172.21.15.6:0/144402629 shutdown_connections 2023-10-09T11:42:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 -- 172.21.15.6:0/144402629 >> 172.21.15.6:0/144402629 conn(0x7fc64006bb90 msgr2=0x7fc64006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 -- 172.21.15.6:0/144402629 shutdown_connections 2023-10-09T11:42:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.353+0000 7fc64793d700 1 -- 172.21.15.6:0/144402629 wait complete. 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.354+0000 7fc64793d700 1 Processor -- start 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 -- start start 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 0x7fc6400abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 0x7fc6400af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400aba80 con 0x7fc628004810 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400aae70 con 0x7fc6400b2160 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.355+0000 7fc64793d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400ab150 con 0x7fc64014bc80 2023-10-09T11:42:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57556/0 (socket says 172.21.15.6:57556) 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 -- 172.21.15.6:0/136468736 learned_addr learned my addr 172.21.15.6:0/136468736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc645eda700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 0x7fc6400af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc644ed8700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 0x7fc6400abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 -- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 msgr2=0x7fc6400abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 0x7fc6400abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 -- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 msgr2=0x7fc6400af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 0x7fc6400af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 -- 172.21.15.6:0/136468736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6400ab430 con 0x7fc628004810 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc645eda700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 0x7fc6400af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc644ed8700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 0x7fc6400abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc6456d9700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc630011d40 tx=0x7fc6300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000fac0 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000fc20 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630014440 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6400ab710 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.356+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400afa80 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.357+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400abd60 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.358+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc630014a80 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.358+0000 7fc63d7fa700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 0x7fc62c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.358+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc630018030 con 0x7fc628004810 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.358+0000 7fc644ed8700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 0x7fc62c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.358+0000 7fc644ed8700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 0x7fc62c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c540 tx=0x7fc634015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.362+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc630052460 con 0x7fc628004810 2023-10-09T11:42:05.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:05.633+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fc6400d0170 con 0x7fc628004810 2023-10-09T11:42:06.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.216+0000 7fc63d7fa700 1 -- 172.21.15.6:0/136468736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v314) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc630022020 con 0x7fc628004810 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 msgr2=0x7fc62c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 0x7fc62c0693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c540 tx=0x7fc634015000 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 msgr2=0x7fc6400aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc630011d40 tx=0x7fc6300091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 shutdown_connections 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc62c066f30 0x7fc62c0693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6400b2160 0x7fc6400af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc628004810 0x7fc6400aa890 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 --2- 172.21.15.6:0/136468736 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64014bc80 0x7fc6400abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 >> 172.21.15.6:0/136468736 conn(0x7fc64006bb90 msgr2=0x7fc640069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 shutdown_connections 2023-10-09T11:42:06.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.219+0000 7fc64793d700 1 -- 172.21.15.6:0/136468736 wait complete. 2023-10-09T11:42:06.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:42:06.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.357+0000 7f0c2866f700 1 Processor -- start 2023-10-09T11:42:06.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.357+0000 7f0c2866f700 1 -- start start 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.358+0000 7f0c2866f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c201578d0 0x7f0c200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.358+0000 7f0c2866f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0c20157ca0 0x7f0c2015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.358+0000 7f0c2866f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200d07c0 con 0x7f0c2006d120 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.358+0000 7f0c2866f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200cfbb0 con 0x7f0c201578d0 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.358+0000 7f0c2866f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200cfe90 con 0x7f0c20157ca0 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c201578d0 0x7f0c200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c26c0c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c2006d120 0x7f0c2006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45412/0 (socket says 172.21.15.6:45412) 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c26c0c700 1 -- 172.21.15.6:0/3464429524 learned_addr learned my addr 172.21.15.6:0/3464429524 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c25c0a700 1 --2- 172.21.15.6:0/3464429524 >> v2:172.21.15.118:3300/0 conn(0x7f0c20157ca0 0x7f0c2015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 -- 172.21.15.6:0/3464429524 >> v2:172.21.15.118:3300/0 conn(0x7f0c20157ca0 msgr2=0x7f0c2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 --2- 172.21.15.6:0/3464429524 >> v2:172.21.15.118:3300/0 conn(0x7f0c20157ca0 0x7f0c2015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 -- 172.21.15.6:0/3464429524 >> v1:172.21.15.6:6789/0 conn(0x7f0c2006d120 legacy=0x7f0c2006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 -- 172.21.15.6:0/3464429524 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200d0170 con 0x7f0c201578d0 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c2640b700 1 --2- 172.21.15.6:0/3464429524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c201578d0 0x7f0c200cf4f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0c20068510 tx=0x7f0c10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7df768b60452528 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c25409700 1 -- 172.21.15.6:0/3464429524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000e070 con 0x7f0c201578d0 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c25409700 1 -- 172.21.15.6:0/3464429524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000bb30 con 0x7f0c201578d0 2023-10-09T11:42:06.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.359+0000 7f0c25409700 1 -- 172.21.15.6:0/3464429524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10012430 con 0x7f0c201578d0 2023-10-09T11:42:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 -- 172.21.15.6:0/3464429524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c201578d0 msgr2=0x7f0c200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 --2- 172.21.15.6:0/3464429524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c201578d0 0x7f0c200cf4f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0c20068510 tx=0x7f0c10009780 comp rx=0 tx=0).stop 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 -- 172.21.15.6:0/3464429524 shutdown_connections 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 --2- 172.21.15.6:0/3464429524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c201578d0 0x7f0c200cf4f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 --2- 172.21.15.6:0/3464429524 >> v2:172.21.15.118:3300/0 conn(0x7f0c20157ca0 0x7f0c2015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 -- 172.21.15.6:0/3464429524 >> 172.21.15.6:0/3464429524 conn(0x7f0c2006bb90 msgr2=0x7f0c2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 -- 172.21.15.6:0/3464429524 shutdown_connections 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.360+0000 7f0c2866f700 1 -- 172.21.15.6:0/3464429524 wait complete. 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.361+0000 7f0c2866f700 1 Processor -- start 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.361+0000 7f0c2866f700 1 -- start start 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 0x7f0c200b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c20157ca0 0x7f0c2016a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2016afc0 con 0x7f0c2006d120 2023-10-09T11:42:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200c7cd0 con 0x7f0c201578d0 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200c8570 con 0x7f0c20157ca0 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57568/0 (socket says 172.21.15.6:57568) 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 -- 172.21.15.6:0/1415541821 learned_addr learned my addr 172.21.15.6:0/1415541821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c25c0a700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 0x7f0c200b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c26c0c700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c20157ca0 0x7f0c2016a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 -- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c20157ca0 msgr2=0x7f0c2016a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c20157ca0 0x7f0c2016a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 -- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 msgr2=0x7f0c200b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 0x7f0c200b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 -- 172.21.15.6:0/1415541821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009a20 con 0x7f0c2006d120 2023-10-09T11:42:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c25c0a700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 0x7f0c200b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2640b700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000b6c0 tx=0x7f0c10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10012e00 con 0x7f0c2006d120 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1001e430 con 0x7f0c2006d120 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200c6440 con 0x7f0c2006d120 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1001e5e0 con 0x7f0c2006d120 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.362+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c200c8200 con 0x7f0c2006d120 2023-10-09T11:42:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.363+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c200c7830 con 0x7f0c2006d120 2023-10-09T11:42:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.364+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c10024020 con 0x7f0c2006d120 2023-10-09T11:42:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.364+0000 7f0c1e7fc700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.364+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0c100863b0 con 0x7f0c2006d120 2023-10-09T11:42:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.364+0000 7f0c25c0a700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.365+0000 7f0c25c0a700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 0x7f0c0c0693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c2015d8e0 tx=0x7f0c14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.368+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c10053920 con 0x7f0c2006d120 2023-10-09T11:42:06.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.560+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0c200d0450 con 0x7f0c2006d120 2023-10-09T11:42:06.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.563+0000 7f0c1e7fc700 1 -- 172.21.15.6:0/1415541821 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c10056f40 con 0x7f0c2006d120 2023-10-09T11:42:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 msgr2=0x7f0c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 0x7f0c0c0693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c2015d8e0 tx=0x7f0c14008040 comp rx=0 tx=0).stop 2023-10-09T11:42:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 msgr2=0x7f0c200c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000b6c0 tx=0x7f0c10018000 comp rx=0 tx=0).stop 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 shutdown_connections 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0c0c066f30 0x7f0c0c0693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.565+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0c20157ca0 0x7f0c2016a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.566+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c2006d120 0x7f0c200c7290 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.566+0000 7f0c2866f700 1 --2- 172.21.15.6:0/1415541821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c201578d0 0x7f0c200b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.566+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 >> 172.21.15.6:0/1415541821 conn(0x7f0c2006bb90 msgr2=0x7f0c20155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.566+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 shutdown_connections 2023-10-09T11:42:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.566+0000 7f0c2866f700 1 -- 172.21.15.6:0/1415541821 wait complete. 2023-10-09T11:42:06.578 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:06.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:06.614 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:06.653 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:06.653 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:42:06.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:06.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.772+0000 7fcff3d59700 1 Processor -- start 2023-10-09T11:42:06.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 -- start start 2023-10-09T11:42:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfec1578d0 0x7fcfec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec06d120 0x7fcfec06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec0d07c0 con 0x7fcfec157ca0 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec06daa0 con 0x7fcfec1578d0 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff3d59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0cfbb0 con 0x7fcfec06d120 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.773+0000 7fcff1af5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfec1578d0 0x7fcfec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfec1578d0 0x7fcfec0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57584/0 (socket says 172.21.15.6:57584) 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 -- 172.21.15.6:0/4077382386 learned_addr learned my addr 172.21.15.6:0/4077382386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff22f6700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec06d120 0x7fcfec06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 -- 172.21.15.6:0/4077382386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec06d120 msgr2=0x7fcfec06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec06d120 0x7fcfec06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 -- 172.21.15.6:0/4077382386 >> v1:172.21.15.118:6789/0 conn(0x7fcfec157ca0 legacy=0x7fcfec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 -- 172.21.15.6:0/4077382386 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0cfe90 con 0x7fcfec1578d0 2023-10-09T11:42:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff1af5700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec1578d0 0x7fcfec0cf4f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009f20 tx=0x7fcfdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150f1c11d1bbaa75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff0af3700 1 -- 172.21.15.6:0/4077382386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00e070 con 0x7fcfec1578d0 2023-10-09T11:42:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff0af3700 1 -- 172.21.15.6:0/4077382386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc00b9d0 con 0x7fcfec1578d0 2023-10-09T11:42:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.774+0000 7fcff0af3700 1 -- 172.21.15.6:0/4077382386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0092e0 con 0x7fcfec1578d0 2023-10-09T11:42:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 -- 172.21.15.6:0/4077382386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec1578d0 msgr2=0x7fcfec0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec1578d0 0x7fcfec0cf4f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009f20 tx=0x7fcfdc009840 comp rx=0 tx=0).stop 2023-10-09T11:42:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 -- 172.21.15.6:0/4077382386 shutdown_connections 2023-10-09T11:42:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec06d120 0x7fcfec06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 --2- 172.21.15.6:0/4077382386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec1578d0 0x7fcfec0cf4f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 -- 172.21.15.6:0/4077382386 >> 172.21.15.6:0/4077382386 conn(0x7fcfec06bb90 msgr2=0x7fcfec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 -- 172.21.15.6:0/4077382386 shutdown_connections 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.775+0000 7fcff3d59700 1 -- 172.21.15.6:0/4077382386 wait complete. 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.776+0000 7fcff3d59700 1 Processor -- start 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.776+0000 7fcff3d59700 1 -- start start 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfec06d120 0x7fcfec152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec1578d0 0x7fcfec0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec16b9a0 con 0x7fcfec157ca0 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec06a070 con 0x7fcfec06d120 2023-10-09T11:42:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1531a0 con 0x7fcfec1578d0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57596/0 (socket says 172.21.15.6:57596) 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 -- 172.21.15.6:0/2998312779 learned_addr learned my addr 172.21.15.6:0/2998312779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff1af5700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfec06d120 0x7fcfec152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff12f4700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec1578d0 0x7fcfec0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 -- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec1578d0 msgr2=0x7fcfec0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec1578d0 0x7fcfec0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 -- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfec06d120 msgr2=0x7fcfec152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfec06d120 0x7fcfec152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 -- 172.21.15.6:0/2998312779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009ae0 con 0x7fcfec157ca0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff22f6700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400ea80 tx=0x7fcfe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400eec0 con 0x7fcfec157ca0 2023-10-09T11:42:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400c850 con 0x7fcfec157ca0 2023-10-09T11:42:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec069460 con 0x7fcfec157ca0 2023-10-09T11:42:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.777+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400cc10 con 0x7fcfec157ca0 2023-10-09T11:42:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.778+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec069a20 con 0x7fcfec157ca0 2023-10-09T11:42:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.779+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec067ac0 con 0x7fcfec157ca0 2023-10-09T11:42:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.779+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfe4013470 con 0x7fcfec157ca0 2023-10-09T11:42:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.779+0000 7fcfe9ffb700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.780+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcfe4084410 con 0x7fcfec157ca0 2023-10-09T11:42:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.780+0000 7fcff1af5700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.780+0000 7fcff1af5700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 0x7fcfd80693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009880 tx=0x7fcfdc018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:06.784+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe4051980 con 0x7fcfec157ca0 2023-10-09T11:42:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.019+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfec06e6b0 con 0x7fcfec157ca0 2023-10-09T11:42:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.020+0000 7fcfe9ffb700 1 -- 172.21.15.6:0/2998312779 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fcfe4017de0 con 0x7fcfec157ca0 2023-10-09T11:42:07.020 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:07.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2856902787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2856902787},{"type":"v1","addr":"172.21.15.118:6834","nonce":2856902787}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":5825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2200259478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2200259478},{"type":"v1","addr":"172.21.15.118:6835","nonce":2200259478}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6711,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/4073235784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4073235784},{"type":"v1","addr":"172.21.15.6:6836","nonce":4073235784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7011,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/228657095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":228657095},{"type":"v1","addr":"172.21.15.6:6837","nonce":228657095}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 msgr2=0x7fcfd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 0x7fcfd80693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009880 tx=0x7fcfdc018000 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 msgr2=0x7fcfec15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400ea80 tx=0x7fcfe40091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 shutdown_connections 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcfd8066f30 0x7fcfd80693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec157ca0 0x7fcfec15b810 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfec06d120 0x7fcfec152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 --2- 172.21.15.6:0/2998312779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcfec1578d0 0x7fcfec0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 >> 172.21.15.6:0/2998312779 conn(0x7fcfec06bb90 msgr2=0x7fcfec1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 shutdown_connections 2023-10-09T11:42:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.022+0000 7fcff3d59700 1 -- 172.21.15.6:0/2998312779 wait complete. 2023-10-09T11:42:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-10-09T11:42:07.034 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:42:07.035 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:42:07.035 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:42:07.035 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:07.035 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:42:07.035 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:42:07.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:42:07.036 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:07.036 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:42:07.036 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:42:07.036 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:42:07.036 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:07.036 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:42:07.036 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:42:07.036 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:42:07.037 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:07.044 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:42:07.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:42:07.044 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:42:07.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:42:07.047 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:42:07.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:42:07.047 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:42:07.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:42:07.086 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:42:07.087 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:07.087 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:42:07.088 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:07.089 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:42:07.090 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:07.090 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:42:07.090 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:07.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:42:07.162 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:42:07.162 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:42:07.175 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:42:07.175 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:42:07.175 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-10-09T11:42:07.175+0000 7f4e32410700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T11:42:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.216+0000 7f2dd19f2700 1 Processor -- start 2023-10-09T11:42:07.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.216+0000 7f2dd19f2700 1 -- start start 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dd19f2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dcc13fc10 0x7f2dcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dd19f2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0698b0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dd19f2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0692a0 con 0x7f2dcc13ffe0 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dd19f2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc06d180 con 0x7f2dcc13fc10 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dcaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dcc13fc10 0x7f2dcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dcb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2dcc0c8190 0x7f2dcc069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45430/0 (socket says 172.21.15.6:45430) 2023-10-09T11:42:07.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.217+0000 7f2dcb7fe700 1 -- 172.21.15.6:0/401834018 learned_addr learned my addr 172.21.15.6:0/401834018 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:07.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.218+0000 7f2dcaffd700 1 -- 172.21.15.6:0/401834018 >> v1:172.21.15.118:6789/0 conn(0x7f2dcc13ffe0 legacy=0x7f2dcc0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.218+0000 7f2dcaffd700 1 -- 172.21.15.6:0/401834018 >> v1:172.21.15.6:6789/0 conn(0x7f2dcc0c8190 legacy=0x7f2dcc069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.218+0000 7f2dcaffd700 1 -- 172.21.15.6:0/401834018 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc069540 con 0x7f2dcc13fc10 2023-10-09T11:42:07.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.218+0000 7f2dcaffd700 1 --2- 172.21.15.6:0/401834018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc13fc10 0x7f2dcc06c5a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0098e0 tx=0x7f2dbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9b27b5a02d63a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dc9ffb700 1 -- 172.21.15.6:0/401834018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc009e80 con 0x7f2dcc13fc10 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dc9ffb700 1 -- 172.21.15.6:0/401834018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc00b860 con 0x7f2dcc13fc10 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dc9ffb700 1 -- 172.21.15.6:0/401834018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00bbe0 con 0x7f2dcc13fc10 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 -- 172.21.15.6:0/401834018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc13fc10 msgr2=0x7f2dcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/401834018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc13fc10 0x7f2dcc06c5a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0098e0 tx=0x7f2dbc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 -- 172.21.15.6:0/401834018 shutdown_connections 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/401834018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc13fc10 0x7f2dcc06c5a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 -- 172.21.15.6:0/401834018 >> 172.21.15.6:0/401834018 conn(0x7f2dcc0c9ca0 msgr2=0x7f2dcc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 -- 172.21.15.6:0/401834018 shutdown_connections 2023-10-09T11:42:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.219+0000 7f2dd19f2700 1 -- 172.21.15.6:0/401834018 wait complete. 2023-10-09T11:42:07.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 Processor -- start 2023-10-09T11:42:07.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 -- start start 2023-10-09T11:42:07.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dcc13fc10 0x7f2dcc0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc13ffe0 0x7f2dcc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0ac190 con 0x7f2dcc0c8190 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0c6160 con 0x7f2dcc13ffe0 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dd19f2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0ab580 con 0x7f2dcc13fc10 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.221+0000 7f2dcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57642/0 (socket says 172.21.15.6:57642) 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 -- 172.21.15.6:0/2297356893 learned_addr learned my addr 172.21.15.6:0/2297356893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcb7fe700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc13ffe0 0x7f2dcc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dca7fc700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dcc13fc10 0x7f2dcc0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 -- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dcc13fc10 msgr2=0x7f2dcc0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dcc13fc10 0x7f2dcc0c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 -- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc13ffe0 msgr2=0x7f2dcc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:07.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc13ffe0 0x7f2dcc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:07.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 -- 172.21.15.6:0/2297356893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc009420 con 0x7f2dcc0c8190 2023-10-09T11:42:07.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.222+0000 7f2dcaffd700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06ebb0 tx=0x7f2dbc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.223+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00bbe0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.223+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0233f0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.223+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc0ab860 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.223+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0237b0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.223+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc0abe20 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.224+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc068080 con 0x7f2dcc0c8190 2023-10-09T11:42:07.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.224+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2dbc023ba0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.225+0000 7f2db2ffd700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 0x7f2db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:07.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.225+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2dbc0859b0 con 0x7f2dcc0c8190 2023-10-09T11:42:07.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.225+0000 7f2dca7fc700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 0x7f2db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:07.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.225+0000 7f2dca7fc700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 0x7f2db80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0ca850 tx=0x7f2dc0007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:07.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.231+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dbc052f20 con 0x7f2dcc0c8190 2023-10-09T11:42:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:07.442+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2dcc04bb80 con 0x7f2dcc0c8190 2023-10-09T11:42:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.235+0000 7f2db2ffd700 1 -- 172.21.15.6:0/2297356893 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2dbc056540 con 0x7f2dcc0c8190 2023-10-09T11:42:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 msgr2=0x7f2db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 0x7f2db80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0ca850 tx=0x7f2dc0007ec0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 msgr2=0x7f2dcc13eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06ebb0 tx=0x7f2dbc018000 comp rx=0 tx=0).stop 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 shutdown_connections 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2db8066f30 0x7f2db80693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc13ffe0 0x7f2dcc0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dcc0c8190 0x7f2dcc13eab0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 --2- 172.21.15.6:0/2297356893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dcc13fc10 0x7f2dcc0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 >> 172.21.15.6:0/2297356893 conn(0x7f2dcc0c9ca0 msgr2=0x7f2dcc0c31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 shutdown_connections 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.238+0000 7f2dd19f2700 1 -- 172.21.15.6:0/2297356893 wait complete. 2023-10-09T11:42:08.239 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:42:08.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:42:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.378+0000 7f3d24a4e700 1 Processor -- start 2023-10-09T11:42:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 -- start start 2023-10-09T11:42:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d200d07c0 con 0x7f3d2006d120 2023-10-09T11:42:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d200cfbb0 con 0x7f3d20157ca0 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.379+0000 7f3d24a4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200cfe90 con 0x7f3d201578d0 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1dd9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1dd9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:34336/0 (socket says 172.21.15.6:34336) 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1dd9b700 1 -- 172.21.15.6:0/4239848819 learned_addr learned my addr 172.21.15.6:0/4239848819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1ed9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3d2006d120 0x7f3d2015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:60358/0 (socket says 172.21.15.6:60358) 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 -- 172.21.15.6:0/4239848819 >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 msgr2=0x7f3d2015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 --2- 172.21.15.6:0/4239848819 >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 -- 172.21.15.6:0/4239848819 >> v1:172.21.15.118:6789/0 conn(0x7f3d2006d120 legacy=0x7f3d2015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 -- 172.21.15.6:0/4239848819 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200d0170 con 0x7f3d201578d0 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1dd9b700 1 --2- 172.21.15.6:0/4239848819 >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.380+0000 7f3d1e59c700 1 --2- 172.21.15.6:0/4239848819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d200cf4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009e60 tx=0x7f3d10009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5683b777e8f6d007 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d1d59a700 1 -- 172.21.15.6:0/4239848819 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000e070 con 0x7f3d201578d0 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d1d59a700 1 -- 172.21.15.6:0/4239848819 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000bb60 con 0x7f3d201578d0 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d1d59a700 1 -- 172.21.15.6:0/4239848819 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10012430 con 0x7f3d201578d0 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 -- 172.21.15.6:0/4239848819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 msgr2=0x7f3d200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/4239848819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d200cf4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009e60 tx=0x7f3d10009780 comp rx=0 tx=0).stop 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 -- 172.21.15.6:0/4239848819 shutdown_connections 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/4239848819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d200cf4f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/4239848819 >> v2:172.21.15.118:3300/0 conn(0x7f3d20157ca0 0x7f3d2015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 -- 172.21.15.6:0/4239848819 >> 172.21.15.6:0/4239848819 conn(0x7f3d2006bb90 msgr2=0x7f3d2006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 -- 172.21.15.6:0/4239848819 shutdown_connections 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.381+0000 7f3d24a4e700 1 -- 172.21.15.6:0/4239848819 wait complete. 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.382+0000 7f3d24a4e700 1 Processor -- start 2023-10-09T11:42:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.382+0000 7f3d24a4e700 1 -- start start 2023-10-09T11:42:08.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d2014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d20157ca0 0x7f3d2014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2015c910 con 0x7f3d2006d120 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2014d410 con 0x7f3d20157ca0 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d24a4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2016a660 con 0x7f3d201578d0 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57656/0 (socket says 172.21.15.6:57656) 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d1e59c700 1 -- 172.21.15.6:0/2921118088 learned_addr learned my addr 172.21.15.6:0/2921118088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d1dd9b700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d2014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.383+0000 7f3d1ed9d700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d20157ca0 0x7f3d2014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 -- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 msgr2=0x7f3d2014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d2014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 -- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d20157ca0 msgr2=0x7f3d2014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d20157ca0 0x7f3d2014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 -- 172.21.15.6:0/2921118088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080094f0 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d1e59c700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3d20068330 tx=0x7f3d10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10012d90 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10027470 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10009a20 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10027830 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.384+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2015c2c0 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.385+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d20067ac0 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.385+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d10024070 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.386+0000 7f3d167fc700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 0x7f3d00069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.386+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d100869b0 con 0x7f3d2006d120 2023-10-09T11:42:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.386+0000 7f3d1dd9b700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 0x7f3d00069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.386+0000 7f3d1dd9b700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 0x7f3d00069460 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3d201535b0 tx=0x7f3d08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.390+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d10053ed0 con 0x7f3d2006d120 2023-10-09T11:42:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.660+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d200d0450 con 0x7f3d2006d120 2023-10-09T11:42:08.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.660+0000 7f3d167fc700 1 -- 172.21.15.6:0/2921118088 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3d100574f0 con 0x7f3d2006d120 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:42:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:08.675 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 msgr2=0x7f3d00069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 0x7f3d00069460 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3d201535b0 tx=0x7f3d08008040 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 msgr2=0x7f3d2015cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3d20068330 tx=0x7f3d10019000 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 shutdown_connections 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3d00066fb0 0x7f3d00069460 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d20157ca0 0x7f3d2014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d2006d120 0x7f3d2015cda0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 --2- 172.21.15.6:0/2921118088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d201578d0 0x7f3d2014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 >> 172.21.15.6:0/2921118088 conn(0x7f3d2006bb90 msgr2=0x7f3d20156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 shutdown_connections 2023-10-09T11:42:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.662+0000 7f3d24a4e700 1 -- 172.21.15.6:0/2921118088 wait complete. 2023-10-09T11:42:08.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.796+0000 7f861b59e700 1 Processor -- start 2023-10-09T11:42:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.796+0000 7f861b59e700 1 -- start start 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f861c159f10 0x7f861c068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 0x7f861c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861b59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c069120 con 0x7f861c159b40 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c0cee10 con 0x7f861c159f10 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c0cd040 con 0x7f861c068cc0 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f861c159f10 0x7f861c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f861c159f10 0x7f861c068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57668/0 (socket says 172.21.15.6:57668) 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 -- 172.21.15.6:0/1252892687 learned_addr learned my addr 172.21.15.6:0/1252892687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861ad9d700 1 --2- 172.21.15.6:0/1252892687 >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 0x7f861c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 -- 172.21.15.6:0/1252892687 >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 msgr2=0x7f861c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 --2- 172.21.15.6:0/1252892687 >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 0x7f861c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 -- 172.21.15.6:0/1252892687 >> v1:172.21.15.118:6789/0 conn(0x7f861c159b40 legacy=0x7f861c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f8619d9b700 1 -- 172.21.15.6:0/1252892687 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c0cd320 con 0x7f861c159f10 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.797+0000 7f861ad9d700 1 --2- 172.21.15.6:0/1252892687 >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 0x7f861c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f8619d9b700 1 --2- 172.21.15.6:0/1252892687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159f10 0x7f861c068780 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f861c0cae10 tx=0x7f8604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c0a850dfecdc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861959a700 1 -- 172.21.15.6:0/1252892687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400b820 con 0x7f861c159f10 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861959a700 1 -- 172.21.15.6:0/1252892687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400b980 con 0x7f861c159f10 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861959a700 1 -- 172.21.15.6:0/1252892687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400bd20 con 0x7f861c159f10 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 -- 172.21.15.6:0/1252892687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159f10 msgr2=0x7f861c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 --2- 172.21.15.6:0/1252892687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159f10 0x7f861c068780 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f861c0cae10 tx=0x7f8604009250 comp rx=0 tx=0).stop 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 -- 172.21.15.6:0/1252892687 shutdown_connections 2023-10-09T11:42:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 --2- 172.21.15.6:0/1252892687 >> v2:172.21.15.118:3300/0 conn(0x7f861c068cc0 0x7f861c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 --2- 172.21.15.6:0/1252892687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159f10 0x7f861c068780 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 -- 172.21.15.6:0/1252892687 >> 172.21.15.6:0/1252892687 conn(0x7f861c0cd660 msgr2=0x7f861c0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 -- 172.21.15.6:0/1252892687 shutdown_connections 2023-10-09T11:42:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.798+0000 7f861b59e700 1 -- 172.21.15.6:0/1252892687 wait complete. 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.799+0000 7f861b59e700 1 Processor -- start 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.799+0000 7f861b59e700 1 -- start start 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f861c068cc0 0x7f861c16b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f861c159f10 0x7f861c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c16bad0 con 0x7f861c159b40 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c7d40 con 0x7f861c159f10 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c8020 con 0x7f861c068cc0 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57672/0 (socket says 172.21.15.6:57672) 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 -- 172.21.15.6:0/1938756805 learned_addr learned my addr 172.21.15.6:0/1938756805 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861ad9d700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f861c159f10 0x7f861c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f861a59c700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f861c068cc0 0x7f861c16b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 -- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f861c068cc0 msgr2=0x7f861c16b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f861c068cc0 0x7f861c16b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 -- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f861c159f10 msgr2=0x7f861c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.800+0000 7f8619d9b700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f861c159f10 0x7f861c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f8619d9b700 1 -- 172.21.15.6:0/1938756805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040094f0 con 0x7f861c159b40 2023-10-09T11:42:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f8619d9b700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f86040030c0 tx=0x7f8604016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604011d00 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604020070 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860401b6a0 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c0c8300 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.801+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c0c88c0 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.802+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c0c8ab0 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.802+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8604022030 con 0x7f861c159b40 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.803+0000 7f86127fc700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.803+0000 7f861a59c700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.803+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8604085e70 con 0x7f861c159b40 2023-10-09T11:42:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.803+0000 7f861a59c700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 0x7f85fc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8614003a30 tx=0x7f8614007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:08.807+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8604053430 con 0x7f861c159b40 2023-10-09T11:42:09.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.001+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f861c069120 con 0x7f861c159b40 2023-10-09T11:42:09.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.001+0000 7f86127fc700 1 -- 172.21.15.6:0/1938756805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+12097 (secure 0 0 0) 0x7f861c069120 con 0x7f861c159b40 2023-10-09T11:42:09.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:09.002 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":126,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:08.232250+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:09.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 msgr2=0x7f85fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 0x7f85fc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8614003a30 tx=0x7f8614007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 msgr2=0x7f861c157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f86040030c0 tx=0x7f8604016000 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 shutdown_connections 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f85fc066f30 0x7f85fc0693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f861c159f10 0x7f861c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f861c068cc0 0x7f861c16b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 --2- 172.21.15.6:0/1938756805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f861c159b40 0x7f861c157d50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 >> 172.21.15.6:0/1938756805 conn(0x7f861c0cd660 msgr2=0x7f861c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 shutdown_connections 2023-10-09T11:42:09.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.004+0000 7f861b59e700 1 -- 172.21.15.6:0/1938756805 wait complete. 2023-10-09T11:42:09.016 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:42:09.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:09.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.137+0000 7fc3fd9e8700 1 Processor -- start 2023-10-09T11:42:09.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.137+0000 7fc3fd9e8700 1 -- start start 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3fd9e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3fd9e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3f806dd60 0x7fc3f80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3fd9e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f80cf4e0 con 0x7fc3f80ceb30 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3fd9e8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f806ea90 con 0x7fc3f806dd60 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3fd9e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b0ca0 con 0x7fc3f815a2a0 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3f806dd60 0x7fc3f80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3f67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc3f80ceb30 0x7fc3f806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45432/0 (socket says 172.21.15.6:45432) 2023-10-09T11:42:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3f67fc700 1 -- 172.21.15.6:0/4244080045 learned_addr learned my addr 172.21.15.6:0/4244080045 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.138+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f77fe700 1 -- 172.21.15.6:0/4244080045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 msgr2=0x7fc3f80b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f77fe700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f80b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f77fe700 1 -- 172.21.15.6:0/4244080045 >> v1:172.21.15.6:6789/0 conn(0x7fc3f80ceb30 legacy=0x7fc3f806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f77fe700 1 -- 172.21.15.6:0/4244080045 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80b00d0 con 0x7fc3f806dd60 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f5ffb700 1 -- 172.21.15.6:0/4244080045 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373765129 0 0) 0x7fc3f80cf4e0 con 0x7fc3f80ceb30 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f77fe700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f806dd60 0x7fc3f80cefa0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e60 tx=0x7fc3e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3651356f41d23bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f5ffb700 1 -- 172.21.15.6:0/4244080045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800e070 con 0x7fc3f806dd60 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f5ffb700 1 -- 172.21.15.6:0/4244080045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800bc30 con 0x7fc3f806dd60 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3f5ffb700 1 -- 172.21.15.6:0/4244080045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8012430 con 0x7fc3f806dd60 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/4244080045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f806dd60 msgr2=0x7fc3f80cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f806dd60 0x7fc3f80cefa0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e60 tx=0x7fc3e8009780 comp rx=0 tx=0).stop 2023-10-09T11:42:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/4244080045 shutdown_connections 2023-10-09T11:42:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f806dd60 0x7fc3f80cefa0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/4244080045 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f80b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/4244080045 >> 172.21.15.6:0/4244080045 conn(0x7fc3f8067640 msgr2=0x7fc3f8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/4244080045 shutdown_connections 2023-10-09T11:42:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.139+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/4244080045 wait complete. 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 Processor -- start 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 -- start start 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 0x7fc3f80b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f8142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b2e50 con 0x7fc3f80ceb30 2023-10-09T11:42:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f816bb10 con 0x7fc3f806dd60 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.141+0000 7fc3fd9e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b3080 con 0x7fc3f815a2a0 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57678/0 (socket says 172.21.15.6:57678) 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3247161870 learned_addr learned my addr 172.21.15.6:0/3247161870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 0x7fc3f80b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f77fe700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f8142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 msgr2=0x7fc3f8142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f8142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 msgr2=0x7fc3f80b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 0x7fc3f80b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 -- 172.21.15.6:0/3247161870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8009a20 con 0x7fc3f80ceb30 2023-10-09T11:42:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 0x7fc3f80b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f77fe700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f8142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3f67fc700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c7e0 tx=0x7fc3e0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0005b30 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0005c90 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f80b3360 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0007300 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.142+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f80b3920 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.143+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f806a7e0 con 0x7fc3f80ceb30 2023-10-09T11:42:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.144+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3e001b400 con 0x7fc3f80ceb30 2023-10-09T11:42:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.144+0000 7fc3eeffd700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.144+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc3e0083d90 con 0x7fc3f80ceb30 2023-10-09T11:42:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.144+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.145+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8155930 tx=0x7fc3f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.149+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3e0051330 con 0x7fc3f80ceb30 2023-10-09T11:42:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.345+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3f8071b10 con 0x7fc3f80ceb30 2023-10-09T11:42:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.345+0000 7fc3eeffd700 1 -- 172.21.15.6:0/3247161870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3e0054950 con 0x7fc3f80ceb30 2023-10-09T11:42:09.346 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:42:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 msgr2=0x7fc3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8155930 tx=0x7fc3f0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 msgr2=0x7fc3f816b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c7e0 tx=0x7fc3e0007df0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 shutdown_connections 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3f815a2a0 0x7fc3f8142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3f806dd60 0x7fc3f80b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 --2- 172.21.15.6:0/3247161870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3f80ceb30 0x7fc3f816b5d0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 >> 172.21.15.6:0/3247161870 conn(0x7fc3f8067640 msgr2=0x7fc3f8158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.347+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 shutdown_connections 2023-10-09T11:42:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.348+0000 7fc3fd9e8700 1 -- 172.21.15.6:0/3247161870 wait complete. 2023-10-09T11:42:09.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:42:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.478+0000 7fe559f5b700 1 Processor -- start 2023-10-09T11:42:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.478+0000 7fe559f5b700 1 -- start start 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe559f5b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5541578d0 0x7fe5540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe559f5b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe554157ca0 0x7fe55415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe559f5b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540d07c0 con 0x7fe55406d120 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe559f5b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540cfbb0 con 0x7fe554157ca0 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe559f5b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540cfe90 con 0x7fe5541578d0 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe552ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe554157ca0 0x7fe55415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe553fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe55406d120 0x7fe55415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45448/0 (socket says 172.21.15.6:45448) 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.479+0000 7fe553fff700 1 -- 172.21.15.6:0/3687491036 learned_addr learned my addr 172.21.15.6:0/3687491036 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe5537fe700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5541578d0 0x7fe5540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe552ffd700 1 -- 172.21.15.6:0/3687491036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5541578d0 msgr2=0x7fe5540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe552ffd700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5541578d0 0x7fe5540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe552ffd700 1 -- 172.21.15.6:0/3687491036 >> v1:172.21.15.6:6789/0 conn(0x7fe55406d120 legacy=0x7fe55415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe552ffd700 1 -- 172.21.15.6:0/3687491036 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540d0170 con 0x7fe554157ca0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe5527fc700 1 -- 172.21.15.6:0/3687491036 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196707736 0 0) 0x7fe5540d07c0 con 0x7fe55406d120 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe552ffd700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe554157ca0 0x7fe55415af00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe5480098e0 tx=0x7fe5480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d014b438be3ab6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe5527fc700 1 -- 172.21.15.6:0/3687491036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548009e80 con 0x7fe554157ca0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe5527fc700 1 -- 172.21.15.6:0/3687491036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54800b860 con 0x7fe554157ca0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.480+0000 7fe5527fc700 1 -- 172.21.15.6:0/3687491036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800bbe0 con 0x7fe554157ca0 2023-10-09T11:42:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 -- 172.21.15.6:0/3687491036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe554157ca0 msgr2=0x7fe55415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe554157ca0 0x7fe55415af00 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe5480098e0 tx=0x7fe5480091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 -- 172.21.15.6:0/3687491036 shutdown_connections 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe5541578d0 0x7fe5540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 --2- 172.21.15.6:0/3687491036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe554157ca0 0x7fe55415af00 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 -- 172.21.15.6:0/3687491036 >> 172.21.15.6:0/3687491036 conn(0x7fe55406bb90 msgr2=0x7fe55406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 -- 172.21.15.6:0/3687491036 shutdown_connections 2023-10-09T11:42:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.481+0000 7fe559f5b700 1 -- 172.21.15.6:0/3687491036 wait complete. 2023-10-09T11:42:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.482+0000 7fe559f5b700 1 Processor -- start 2023-10-09T11:42:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.482+0000 7fe559f5b700 1 -- start start 2023-10-09T11:42:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55406d120 0x7fe5541551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe554157ca0 0x7fe554068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540acba0 con 0x7fe5541578d0 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554155720 con 0x7fe55406d120 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540abf90 con 0x7fe554157ca0 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57708/0 (socket says 172.21.15.6:57708) 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 -- 172.21.15.6:0/2846823695 learned_addr learned my addr 172.21.15.6:0/2846823695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe5537fe700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55406d120 0x7fe5541551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe553fff700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe554157ca0 0x7fe554068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 -- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe554157ca0 msgr2=0x7fe554068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe554157ca0 0x7fe554068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 -- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55406d120 msgr2=0x7fe5541551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55406d120 0x7fe5541551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 -- 172.21.15.6:0/2846823695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009420 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe552ffd700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe55406fe20 tx=0x7fe548017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800bbe0 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548000d10 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548011690 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5540ac270 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.483+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540ac830 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.485+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55406c960 con 0x7fe5541578d0 2023-10-09T11:42:09.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.485+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe548011a40 con 0x7fe5541578d0 2023-10-09T11:42:09.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.485+0000 7fe53b7fe700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.485+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe548085a30 con 0x7fe5541578d0 2023-10-09T11:42:09.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.485+0000 7fe5537fe700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.486+0000 7fe5537fe700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 0x7fe5400693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe544006fd0 tx=0x7fe544008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.490+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe548052ff0 con 0x7fe5541578d0 2023-10-09T11:42:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.686+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5540d0450 con 0x7fe5541578d0 2023-10-09T11:42:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.687+0000 7fe53b7fe700 1 -- 172.21.15.6:0/2846823695 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe548056610 con 0x7fe5541578d0 2023-10-09T11:42:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:42:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:42:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:42:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 msgr2=0x7fe5400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 0x7fe5400693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe544006fd0 tx=0x7fe544008040 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 msgr2=0x7fe554068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe55406fe20 tx=0x7fe548017000 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 shutdown_connections 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe540066f30 0x7fe5400693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe554157ca0 0x7fe554068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe55406d120 0x7fe5541551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 --2- 172.21.15.6:0/2846823695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5541578d0 0x7fe554068880 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 >> 172.21.15.6:0/2846823695 conn(0x7fe55406bb90 msgr2=0x7fe55415aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 shutdown_connections 2023-10-09T11:42:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.689+0000 7fe559f5b700 1 -- 172.21.15.6:0/2846823695 wait complete. 2023-10-09T11:42:09.701 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:42:09.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:42:09.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.824+0000 7f1777cc2700 1 Processor -- start 2023-10-09T11:42:09.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.825+0000 7f1777cc2700 1 -- start start 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.825+0000 7f1777cc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f177006d830 0x7f17700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.825+0000 7f1777cc2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700d07c0 con 0x7f1770157ca0 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.825+0000 7f1777cc2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700cfbb0 con 0x7f17701578d0 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.825+0000 7f1777cc2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700cfe90 con 0x7f177006d830 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177625f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f177006d830 0x7f17700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177525d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1770157ca0 0x7f177006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45462/0 (socket says 172.21.15.6:45462) 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177525d700 1 -- 172.21.15.6:0/2802706429 learned_addr learned my addr 172.21.15.6:0/2802706429 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177625f700 1 -- 172.21.15.6:0/2802706429 >> v1:172.21.15.118:6789/0 conn(0x7f17701578d0 legacy=0x7f177015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177625f700 1 -- 172.21.15.6:0/2802706429 >> v1:172.21.15.6:6789/0 conn(0x7f1770157ca0 legacy=0x7f177006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f1774a5c700 1 -- 172.21.15.6:0/2802706429 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094202151 0 0) 0x7f17700d07c0 con 0x7f1770157ca0 2023-10-09T11:42:09.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177625f700 1 -- 172.21.15.6:0/2802706429 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700d0170 con 0x7f177006d830 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f177625f700 1 --2- 172.21.15.6:0/2802706429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177006d830 0x7f17700cf4f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e60 tx=0x7f1760009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c366f4682d55c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f1774a5c700 1 -- 172.21.15.6:0/2802706429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000e070 con 0x7f177006d830 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f1774a5c700 1 -- 172.21.15.6:0/2802706429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000bc30 con 0x7f177006d830 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.826+0000 7f1774a5c700 1 -- 172.21.15.6:0/2802706429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760012430 con 0x7f177006d830 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 -- 172.21.15.6:0/2802706429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177006d830 msgr2=0x7f17700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 --2- 172.21.15.6:0/2802706429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177006d830 0x7f17700cf4f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e60 tx=0x7f1760009780 comp rx=0 tx=0).stop 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 -- 172.21.15.6:0/2802706429 shutdown_connections 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 --2- 172.21.15.6:0/2802706429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177006d830 0x7f17700cf4f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 -- 172.21.15.6:0/2802706429 >> 172.21.15.6:0/2802706429 conn(0x7f177006bb90 msgr2=0x7f177006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 -- 172.21.15.6:0/2802706429 shutdown_connections 2023-10-09T11:42:09.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.827+0000 7f1777cc2700 1 -- 172.21.15.6:0/2802706429 wait complete. 2023-10-09T11:42:09.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.828+0000 7f1777cc2700 1 Processor -- start 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.828+0000 7f1777cc2700 1 -- start start 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177006d830 0x7f1770145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1770157ca0 0x7f1770069a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700b5b00 con 0x7f17701578d0 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17701464f0 con 0x7f177006d830 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1777cc2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700b5f90 con 0x7f1770157ca0 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57736/0 (socket says 172.21.15.6:57736) 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 -- 172.21.15.6:0/1603274360 learned_addr learned my addr 172.21.15.6:0/1603274360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:09.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f1775a5e700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177006d830 0x7f1770145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177625f700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1770157ca0 0x7f1770069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 -- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1770157ca0 msgr2=0x7f1770069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1770157ca0 0x7f1770069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 -- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177006d830 msgr2=0x7f1770145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177006d830 0x7f1770145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 -- 172.21.15.6:0/1603274360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009a20 con 0x7f17701578d0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.829+0000 7f177525d700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f176400c610 tx=0x7f1764000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.830+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764005b30 con 0x7f17701578d0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.830+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764005c90 con 0x7f17701578d0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.830+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17700b4ef0 con 0x7f17701578d0 2023-10-09T11:42:09.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.830+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764007300 con 0x7f17701578d0 2023-10-09T11:42:09.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.830+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700b54b0 con 0x7f17701578d0 2023-10-09T11:42:09.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.831+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17700b5c70 con 0x7f17701578d0 2023-10-09T11:42:09.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.831+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f176401b3b0 con 0x7f17701578d0 2023-10-09T11:42:09.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.832+0000 7f176dffb700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 0x7f175c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.832+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1764083670 con 0x7f17701578d0 2023-10-09T11:42:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.832+0000 7f1775a5e700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 0x7f175c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.832+0000 7f1775a5e700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 0x7f175c0693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1768003aa0 tx=0x7f1768000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:09.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:09.836+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1764050c30 con 0x7f17701578d0 2023-10-09T11:42:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.028+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f17700d0450 con 0x7f17701578d0 2023-10-09T11:42:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.242+0000 7f176dffb700 1 -- 172.21.15.6:0/1603274360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1764054250 con 0x7f17701578d0 2023-10-09T11:42:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.247+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 msgr2=0x7f175c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.247+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 0x7f175c0693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1768003aa0 tx=0x7f1768000bc0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.247+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 msgr2=0x7f17700b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.247+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f176400c610 tx=0x7f1764000fe0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 shutdown_connections 2023-10-09T11:42:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f175c066f30 0x7f175c0693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1770157ca0 0x7f1770069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f177006d830 0x7f1770145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 --2- 172.21.15.6:0/1603274360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17701578d0 0x7f17700b45a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 >> 172.21.15.6:0/1603274360 conn(0x7f177006bb90 msgr2=0x7f177006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 shutdown_connections 2023-10-09T11:42:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.248+0000 7f1777cc2700 1 -- 172.21.15.6:0/1603274360 wait complete. 2023-10-09T11:42:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:42:10.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:42:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.391+0000 7f6ee0959700 1 Processor -- start 2023-10-09T11:42:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.391+0000 7f6ee0959700 1 -- start start 2023-10-09T11:42:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ee0959700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6edc068f20 0x7f6edc0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ee0959700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc157b90 0x7f6edc0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ee0959700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0cca80 con 0x7f6edc1577c0 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ee0959700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc0cedd0 con 0x7f6edc068f20 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ee0959700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cc210 con 0x7f6edc157b90 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ed9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6edc068f20 0x7f6edc0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ed9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6edc068f20 0x7f6edc0cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57742/0 (socket says 172.21.15.6:57742) 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6ed9d9b700 1 -- 172.21.15.6:0/528810416 learned_addr learned my addr 172.21.15.6:0/528810416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.392+0000 7f6edad9d700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc157b90 0x7f6edc0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed9d9b700 1 -- 172.21.15.6:0/528810416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc157b90 msgr2=0x7f6edc0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed9d9b700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc157b90 0x7f6edc0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed9d9b700 1 -- 172.21.15.6:0/528810416 >> v1:172.21.15.118:6789/0 conn(0x7f6edc1577c0 legacy=0x7f6edc068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed9d9b700 1 -- 172.21.15.6:0/528810416 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0cc4c0 con 0x7f6edc068f20 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed9d9b700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc068f20 0x7f6edc0cb790 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00099b0 tx=0x7f6ed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2405c472dd3208d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed959a700 1 -- 172.21.15.6:0/528810416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0009ea0 con 0x7f6edc068f20 2023-10-09T11:42:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed959a700 1 -- 172.21.15.6:0/528810416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000b860 con 0x7f6edc068f20 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.393+0000 7f6ed959a700 1 -- 172.21.15.6:0/528810416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000bc00 con 0x7f6edc068f20 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 -- 172.21.15.6:0/528810416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc068f20 msgr2=0x7f6edc0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc068f20 0x7f6edc0cb790 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00099b0 tx=0x7f6ed0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 -- 172.21.15.6:0/528810416 shutdown_connections 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc157b90 0x7f6edc0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 --2- 172.21.15.6:0/528810416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc068f20 0x7f6edc0cb790 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 -- 172.21.15.6:0/528810416 >> 172.21.15.6:0/528810416 conn(0x7f6edc0d0df0 msgr2=0x7f6edc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 -- 172.21.15.6:0/528810416 shutdown_connections 2023-10-09T11:42:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.394+0000 7f6ee0959700 1 -- 172.21.15.6:0/528810416 wait complete. 2023-10-09T11:42:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.395+0000 7f6ee0959700 1 Processor -- start 2023-10-09T11:42:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.395+0000 7f6ee0959700 1 -- start start 2023-10-09T11:42:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 0x7f6edc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc1577c0 0x7f6edc159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc16b240 con 0x7f6edc157b90 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc15bad0 con 0x7f6edc1577c0 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ee0959700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc16a630 con 0x7f6edc068f20 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6eda59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 0x7f6edc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57756/0 (socket says 172.21.15.6:57756) 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6ed9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc1577c0 0x7f6edc159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6eda59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 0x7f6edc15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:60442/0 (socket says 172.21.15.6:60442) 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 -- 172.21.15.6:0/1062904749 learned_addr learned my addr 172.21.15.6:0/1062904749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 -- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 msgr2=0x7f6edc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 0x7f6edc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 -- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc1577c0 msgr2=0x7f6edc159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc1577c0 0x7f6edc159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 -- 172.21.15.6:0/1062904749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00094f0 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6edad9d700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009df0 tx=0x7f6ed400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.396+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400caa0 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.397+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400f040 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.397+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400ce70 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.397+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc16a910 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.397+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc16aed0 con 0x7f6edc157b90 2023-10-09T11:42:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.397+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc067a50 con 0x7f6edc157b90 2023-10-09T11:42:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.398+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ed4014690 con 0x7f6edc157b90 2023-10-09T11:42:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.398+0000 7f6eca7fc700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 0x7f6ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.398+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6ed4084c60 con 0x7f6edc157b90 2023-10-09T11:42:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.398+0000 7f6eda59c700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 0x7f6ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.399+0000 7f6eda59c700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 0x7f6ebc0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0039f0 tx=0x7f6ecc007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.403+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ed4055b40 con 0x7f6edc157b90 2023-10-09T11:42:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:10.595+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6edc0cc7a0 con 0x7f6edc157b90 2023-10-09T11:42:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.247+0000 7f6eca7fc700 1 -- 172.21.15.6:0/1062904749 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6ed40556d0 con 0x7f6edc157b90 2023-10-09T11:42:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.253+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 msgr2=0x7f6ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.253+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 0x7f6ebc0693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0039f0 tx=0x7f6ecc007ec0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.253+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 msgr2=0x7f6edc159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.253+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009df0 tx=0x7f6ed400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:11.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 shutdown_connections 2023-10-09T11:42:11.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6ebc066f30 0x7f6ebc0693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6edc157b90 0x7f6edc159640 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc068f20 0x7f6edc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 --2- 172.21.15.6:0/1062904749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc1577c0 0x7f6edc159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.255+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 >> 172.21.15.6:0/1062904749 conn(0x7f6edc0d0df0 msgr2=0x7f6edc068810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.256+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 shutdown_connections 2023-10-09T11:42:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.256+0000 7f6ee0959700 1 -- 172.21.15.6:0/1062904749 wait complete. 2023-10-09T11:42:11.261 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:42:11.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:42:11.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.399+0000 7feb98225700 1 Processor -- start 2023-10-09T11:42:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.399+0000 7feb98225700 1 -- start start 2023-10-09T11:42:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb98225700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feb90157ca0 0x7feb900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb98225700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb9006d120 0x7feb9006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb98225700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900d07c0 con 0x7feb901578d0 2023-10-09T11:42:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb98225700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9006da50 con 0x7feb9006d120 2023-10-09T11:42:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb98225700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900cfbb0 con 0x7feb90157ca0 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb95fc1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feb901578d0 0x7feb9015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45478/0 (socket says 172.21.15.6:45478) 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb95fc1700 1 -- 172.21.15.6:0/216796451 learned_addr learned my addr 172.21.15.6:0/216796451 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 --2- 172.21.15.6:0/216796451 >> v2:172.21.15.6:3300/0 conn(0x7feb9006d120 0x7feb9006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb957c0700 1 --2- 172.21.15.6:0/216796451 >> v2:172.21.15.118:3300/0 conn(0x7feb90157ca0 0x7feb900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 -- 172.21.15.6:0/216796451 >> v2:172.21.15.118:3300/0 conn(0x7feb90157ca0 msgr2=0x7feb900cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 --2- 172.21.15.6:0/216796451 >> v2:172.21.15.118:3300/0 conn(0x7feb90157ca0 0x7feb900cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 -- 172.21.15.6:0/216796451 >> v1:172.21.15.6:6789/0 conn(0x7feb901578d0 legacy=0x7feb9015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 -- 172.21.15.6:0/216796451 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900cfe90 con 0x7feb9006d120 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb967c2700 1 --2- 172.21.15.6:0/216796451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb9006d120 0x7feb9006d510 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7feb90068510 tx=0x7feb88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38fc3c818c148e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb94fbf700 1 -- 172.21.15.6:0/216796451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800e070 con 0x7feb9006d120 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.400+0000 7feb94fbf700 1 -- 172.21.15.6:0/216796451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8800bc30 con 0x7feb9006d120 2023-10-09T11:42:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb94fbf700 1 -- 172.21.15.6:0/216796451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88012430 con 0x7feb9006d120 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 -- 172.21.15.6:0/216796451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb9006d120 msgr2=0x7feb9006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 --2- 172.21.15.6:0/216796451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb9006d120 0x7feb9006d510 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7feb90068510 tx=0x7feb88009780 comp rx=0 tx=0).stop 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 -- 172.21.15.6:0/216796451 shutdown_connections 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 --2- 172.21.15.6:0/216796451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb9006d120 0x7feb9006d510 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 --2- 172.21.15.6:0/216796451 >> v2:172.21.15.118:3300/0 conn(0x7feb90157ca0 0x7feb900cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 -- 172.21.15.6:0/216796451 >> 172.21.15.6:0/216796451 conn(0x7feb9006bb90 msgr2=0x7feb9006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 -- 172.21.15.6:0/216796451 shutdown_connections 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.401+0000 7feb98225700 1 -- 172.21.15.6:0/216796451 wait complete. 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.402+0000 7feb98225700 1 Processor -- start 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.402+0000 7feb98225700 1 -- start start 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb9006d120 0x7feb90154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb901578d0 0x7feb900b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9016b300 con 0x7feb90157ca0 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900ac240 con 0x7feb901578d0 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb98225700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb90154d80 con 0x7feb9006d120 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57768/0 (socket says 172.21.15.6:57768) 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 -- 172.21.15.6:0/3596955238 learned_addr learned my addr 172.21.15.6:0/3596955238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb957c0700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb901578d0 0x7feb900b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb95fc1700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb9006d120 0x7feb90154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 -- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb9006d120 msgr2=0x7feb90154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb9006d120 0x7feb90154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 -- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb901578d0 msgr2=0x7feb900b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb901578d0 0x7feb900b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.403+0000 7feb967c2700 1 -- 172.21.15.6:0/3596955238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009a20 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb967c2700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feb88013000 tx=0x7feb88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88027470 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88027630 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880279f0 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb900b68b0 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.404+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900ac7c0 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.405+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90067ac0 con 0x7feb90157ca0 2023-10-09T11:42:11.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.405+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb88024070 con 0x7feb90157ca0 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.406+0000 7feb85ffb700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.406+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5605+0+0 (secure 0 0 0) 0x7feb88086cf0 con 0x7feb90157ca0 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.406+0000 7feb95fc1700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 0x7feb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.406+0000 7feb95fc1700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb90156000 tx=0x7feb8c007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:11.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.411+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb88053f20 con 0x7feb90157ca0 2023-10-09T11:42:11.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:11.652+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feb900d0170 con 0x7feb90157ca0 2023-10-09T11:42:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.264+0000 7feb85ffb700 1 -- 172.21.15.6:0/3596955238 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7feb8802c0c0 con 0x7feb90157ca0 2023-10-09T11:42:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.269+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 msgr2=0x7feb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.269+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb90156000 tx=0x7feb8c007eb0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.269+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 msgr2=0x7feb900b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.269+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feb88013000 tx=0x7feb88019000 comp rx=0 tx=0).stop 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 shutdown_connections 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb74066f30 0x7feb740693e0 secure :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb90156000 tx=0x7feb8c007eb0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb90157ca0 0x7feb900b6230 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb9006d120 0x7feb90154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 --2- 172.21.15.6:0/3596955238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb901578d0 0x7feb900b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.270+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 >> 172.21.15.6:0/3596955238 conn(0x7feb9006bb90 msgr2=0x7feb901583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.272+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 shutdown_connections 2023-10-09T11:42:12.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.272+0000 7feb98225700 1 -- 172.21.15.6:0/3596955238 wait complete. 2023-10-09T11:42:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T11:42:12.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:12.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.408+0000 7f7b66e97700 1 Processor -- start 2023-10-09T11:42:12.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.408+0000 7f7b66e97700 1 -- start start 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b66e97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 0x7f7b600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b66e97700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b60157ca0 0x7f7b6015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b66e97700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b600d07c0 con 0x7f7b6006d120 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b66e97700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b600cfbb0 con 0x7f7b60157ca0 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b66e97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600cfe90 con 0x7f7b601578d0 2023-10-09T11:42:12.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b60157ca0 0x7f7b6015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b60157ca0 0x7f7b6015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57772/0 (socket says 172.21.15.6:57772) 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 -- 172.21.15.6:0/1293454762 learned_addr learned my addr 172.21.15.6:0/1293454762 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b64c33700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 0x7f7b600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 -- 172.21.15.6:0/1293454762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 msgr2=0x7f7b600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 0x7f7b600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 -- 172.21.15.6:0/1293454762 >> v1:172.21.15.118:6789/0 conn(0x7f7b6006d120 legacy=0x7f7b6015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 -- 172.21.15.6:0/1293454762 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600d0170 con 0x7f7b60157ca0 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b64c33700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 0x7f7b600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.409+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b60157ca0 0x7f7b6015af00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7b540099b0 tx=0x7f7b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7fdd8f2956ec5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b5f7fe700 1 -- 172.21.15.6:0/1293454762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400b820 con 0x7f7b60157ca0 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b5f7fe700 1 -- 172.21.15.6:0/1293454762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400b980 con 0x7f7b60157ca0 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b5f7fe700 1 -- 172.21.15.6:0/1293454762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400bd20 con 0x7f7b60157ca0 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 -- 172.21.15.6:0/1293454762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b60157ca0 msgr2=0x7f7b6015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b60157ca0 0x7f7b6015af00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7b540099b0 tx=0x7f7b54009250 comp rx=0 tx=0).stop 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 -- 172.21.15.6:0/1293454762 shutdown_connections 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b601578d0 0x7f7b600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 --2- 172.21.15.6:0/1293454762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b60157ca0 0x7f7b6015af00 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 -- 172.21.15.6:0/1293454762 >> 172.21.15.6:0/1293454762 conn(0x7f7b6006bb90 msgr2=0x7f7b6006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 -- 172.21.15.6:0/1293454762 shutdown_connections 2023-10-09T11:42:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.410+0000 7f7b66e97700 1 -- 172.21.15.6:0/1293454762 wait complete. 2023-10-09T11:42:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.411+0000 7f7b66e97700 1 Processor -- start 2023-10-09T11:42:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.411+0000 7f7b66e97700 1 -- start start 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 0x7f7b60154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 0x7f7b600c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600c67d0 con 0x7f7b6006d120 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600cae90 con 0x7f7b601578d0 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b66e97700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600c5bc0 con 0x7f7b60157ca0 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b64c33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b64c33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57788/0 (socket says 172.21.15.6:57788) 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.412+0000 7f7b64c33700 1 -- 172.21.15.6:0/923642813 learned_addr learned my addr 172.21.15.6:0/923642813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 -- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 msgr2=0x7f7b600c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b65434700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 0x7f7b600c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 0x7f7b60154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 0x7f7b600c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 -- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 msgr2=0x7f7b60154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 0x7f7b60154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 -- 172.21.15.6:0/923642813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540094f0 con 0x7f7b6006d120 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b65434700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 0x7f7b600c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 0x7f7b60154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b64c33700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800a430 tx=0x7f7b58007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800d650 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5800d7b0 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b600c5ea0 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800db50 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.413+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b600c6460 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.414+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b60067ac0 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.414+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b58015440 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.415+0000 7f7b5cff9700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 0x7f7b4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.415+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b58084df0 con 0x7f7b6006d120 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.415+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 0x7f7b4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.415+0000 7f7b5ffff700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 0x7f7b4c0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7b540099b0 tx=0x7f7b54016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.419+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b5804e5a0 con 0x7f7b6006d120 2023-10-09T11:42:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.615+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b600d0450 con 0x7f7b6006d120 2023-10-09T11:42:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.616+0000 7f7b5cff9700 1 -- 172.21.15.6:0/923642813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f7b5801a090 con 0x7f7b6006d120 2023-10-09T11:42:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:12.617 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":129,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:11.653654+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 msgr2=0x7f7b4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 0x7f7b4c0693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7b540099b0 tx=0x7f7b54016000 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 msgr2=0x7f7b600ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800a430 tx=0x7f7b58007910 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 shutdown_connections 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7b4c066f30 0x7f7b4c0693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b60157ca0 0x7f7b600c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b6006d120 0x7f7b600ca950 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 --2- 172.21.15.6:0/923642813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b601578d0 0x7f7b60154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 >> 172.21.15.6:0/923642813 conn(0x7f7b6006bb90 msgr2=0x7f7b6006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 shutdown_connections 2023-10-09T11:42:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.618+0000 7f7b66e97700 1 -- 172.21.15.6:0/923642813 wait complete. 2023-10-09T11:42:12.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.749+0000 7fd287a94700 1 Processor -- start 2023-10-09T11:42:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 -- start start 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 0x7fd2800cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 0x7fd28006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28006dac0 con 0x7fd2801578d0 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800d07c0 con 0x7fd28006d120 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.750+0000 7fd287a94700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800cfbb0 con 0x7fd280157ca0 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd285830700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2801578d0 0x7fd28015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45488/0 (socket says 172.21.15.6:45488) 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd285830700 1 -- 172.21.15.6:0/341079186 learned_addr learned my addr 172.21.15.6:0/341079186 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 --2- 172.21.15.6:0/341079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 0x7fd2800cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd286031700 1 --2- 172.21.15.6:0/341079186 >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 0x7fd28006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28482e700 1 -- 172.21.15.6:0/341079186 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535452034 0 0) 0x7fd270001110 con 0x7fd2801578d0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28482e700 1 -- 172.21.15.6:0/341079186 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd268003570 con 0x7fd2801578d0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 -- 172.21.15.6:0/341079186 >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 msgr2=0x7fd28006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 --2- 172.21.15.6:0/341079186 >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 0x7fd28006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 -- 172.21.15.6:0/341079186 >> v1:172.21.15.6:6789/0 conn(0x7fd2801578d0 legacy=0x7fd28015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 -- 172.21.15.6:0/341079186 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800cfe90 con 0x7fd280157ca0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd286031700 1 --2- 172.21.15.6:0/341079186 >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 0x7fd28006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28502f700 1 --2- 172.21.15.6:0/341079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 0x7fd2800cf4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2740098e0 tx=0x7fd2740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ee787c1296f41a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28482e700 1 -- 172.21.15.6:0/341079186 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011630 con 0x7fd280157ca0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28482e700 1 -- 172.21.15.6:0/341079186 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011790 con 0x7fd280157ca0 2023-10-09T11:42:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.751+0000 7fd28482e700 1 -- 172.21.15.6:0/341079186 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011b30 con 0x7fd280157ca0 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 -- 172.21.15.6:0/341079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 msgr2=0x7fd2800cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 --2- 172.21.15.6:0/341079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 0x7fd2800cf4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2740098e0 tx=0x7fd2740091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 -- 172.21.15.6:0/341079186 shutdown_connections 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 --2- 172.21.15.6:0/341079186 >> v2:172.21.15.118:3300/0 conn(0x7fd28006d120 0x7fd28006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 --2- 172.21.15.6:0/341079186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd280157ca0 0x7fd2800cf4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 -- 172.21.15.6:0/341079186 >> 172.21.15.6:0/341079186 conn(0x7fd28006bb90 msgr2=0x7fd28006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 -- 172.21.15.6:0/341079186 shutdown_connections 2023-10-09T11:42:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.752+0000 7fd287a94700 1 -- 172.21.15.6:0/341079186 wait complete. 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.753+0000 7fd287a94700 1 Processor -- start 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.753+0000 7fd287a94700 1 -- start start 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2801578d0 0x7fd28016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd280157ca0 0x7fd28016ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800ab730 con 0x7fd28006d120 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28016c020 con 0x7fd280157ca0 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd287a94700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800aab40 con 0x7fd2801578d0 2023-10-09T11:42:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57800/0 (socket says 172.21.15.6:57800) 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 -- 172.21.15.6:0/376320 learned_addr learned my addr 172.21.15.6:0/376320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd28502f700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2801578d0 0x7fd28016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd286031700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd280157ca0 0x7fd28016ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 -- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2801578d0 msgr2=0x7fd28016a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2801578d0 0x7fd28016a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 -- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd280157ca0 msgr2=0x7fd28016ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd280157ca0 0x7fd28016ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 -- 172.21.15.6:0/376320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009a20 con 0x7fd28006d120 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.754+0000 7fd285830700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c7c0 tx=0x7fd270007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.755+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270005b30 con 0x7fd28006d120 2023-10-09T11:42:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.755+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270005cb0 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.755+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd274009420 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.755+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270007320 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.755+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28016b470 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.756+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28006fc00 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.756+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd27001b3b0 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.756+0000 7fd27dffb700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.756+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2700837e0 con 0x7fd28006d120 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.757+0000 7fd28502f700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.757+0000 7fd28502f700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 0x7fd26c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd2740091e0 tx=0x7fd274017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:12.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.761+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd270050b10 con 0x7fd28006d120 2023-10-09T11:42:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.954+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd28006dac0 con 0x7fd28006d120 2023-10-09T11:42:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.954+0000 7fd27dffb700 1 -- 172.21.15.6:0/376320 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fd28006dac0 con 0x7fd28006d120 2023-10-09T11:42:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:12.955 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":129,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:11.653654+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 msgr2=0x7fd26c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 0x7fd26c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd2740091e0 tx=0x7fd274017000 comp rx=0 tx=0).stop 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 msgr2=0x7fd2800b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c7c0 tx=0x7fd270007c70 comp rx=0 tx=0).stop 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 shutdown_connections 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd280157ca0 0x7fd28016ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006d120 0x7fd2800b20a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 --2- 172.21.15.6:0/376320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd2801578d0 0x7fd28016a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 >> 172.21.15.6:0/376320 conn(0x7fd28006bb90 msgr2=0x7fd280070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 shutdown_connections 2023-10-09T11:42:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:12.957+0000 7fd287a94700 1 -- 172.21.15.6:0/376320 wait complete. 2023-10-09T11:42:12.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:42:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.091+0000 7fd778ec4700 1 Processor -- start 2023-10-09T11:42:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.091+0000 7fd778ec4700 1 -- start start 2023-10-09T11:42:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd778ec4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd778ec4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd774157ca0 0x7fd77415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd778ec4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740d07c0 con 0x7fd77406d120 2023-10-09T11:42:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd778ec4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740cfbb0 con 0x7fd774157ca0 2023-10-09T11:42:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd778ec4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740cfe90 con 0x7fd7741578d0 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.092+0000 7fd771d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd774157ca0 0x7fd77415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd772d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd77406d120 0x7fd77415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45494/0 (socket says 172.21.15.6:45494) 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd774157ca0 0x7fd77415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57816/0 (socket says 172.21.15.6:57816) 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd772d9d700 1 -- 172.21.15.6:0/54422534 learned_addr learned my addr 172.21.15.6:0/54422534 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77259c700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 -- 172.21.15.6:0/54422534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 msgr2=0x7fd7740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 -- 172.21.15.6:0/54422534 >> v1:172.21.15.6:6789/0 conn(0x7fd77406d120 legacy=0x7fd77415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77159a700 1 -- 172.21.15.6:0/54422534 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577211650 0 0) 0x7fd7740d07c0 con 0x7fd77406d120 2023-10-09T11:42:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 -- 172.21.15.6:0/54422534 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740d0170 con 0x7fd774157ca0 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77259c700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd771d9b700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd774157ca0 0x7fd77415af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098e0 tx=0x7fd75c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f88c8f13c89735 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77159a700 1 -- 172.21.15.6:0/54422534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c009e80 con 0x7fd774157ca0 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77159a700 1 -- 172.21.15.6:0/54422534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00b860 con 0x7fd774157ca0 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.093+0000 7fd77159a700 1 -- 172.21.15.6:0/54422534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00bbe0 con 0x7fd774157ca0 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 -- 172.21.15.6:0/54422534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd774157ca0 msgr2=0x7fd77415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd774157ca0 0x7fd77415af00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098e0 tx=0x7fd75c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 -- 172.21.15.6:0/54422534 shutdown_connections 2023-10-09T11:42:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 --2- 172.21.15.6:0/54422534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd774157ca0 0x7fd77415af00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 -- 172.21.15.6:0/54422534 >> 172.21.15.6:0/54422534 conn(0x7fd77406bb90 msgr2=0x7fd77406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 -- 172.21.15.6:0/54422534 shutdown_connections 2023-10-09T11:42:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.094+0000 7fd778ec4700 1 -- 172.21.15.6:0/54422534 wait complete. 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.095+0000 7fd778ec4700 1 Processor -- start 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.095+0000 7fd778ec4700 1 -- start start 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 0x7fd77416a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77416a2c0 con 0x7fd77406d120 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740ac750 con 0x7fd774157ca0 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740aca30 con 0x7fd7741578d0 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57822/0 (socket says 172.21.15.6:57822) 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 -- 172.21.15.6:0/1726809261 learned_addr learned my addr 172.21.15.6:0/1726809261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd771d9b700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd772d9d700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 0x7fd77416a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 -- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 msgr2=0x7fd7740b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 -- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 msgr2=0x7fd77416a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 0x7fd77416a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 -- 172.21.15.6:0/1726809261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009420 con 0x7fd77406d120 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd771d9b700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd772d9d700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 0x7fd77416a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd77259c700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e8d0 tx=0x7fd76c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00ee70 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c00c5e0 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740acd10 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00c980 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.096+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740ac3e0 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.097+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77416a6f0 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.098+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd76c013410 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.098+0000 7fd76a7fc700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 0x7fd7540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.098+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd76c084340 con 0x7fd77406d120 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.098+0000 7fd771d9b700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 0x7fd7540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.099+0000 7fd771d9b700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 0x7fd7540693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd75c003080 tx=0x7fd75c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.102+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd77416a6f0 con 0x7fd77406d120 2023-10-09T11:42:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:13.342+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd77416a6f0 con 0x7fd77406d120 2023-10-09T11:42:14.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.281+0000 7fd76a7fc700 1 -- 172.21.15.6:0/1726809261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd77416a6f0 con 0x7fd77406d120 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 msgr2=0x7fd7540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 0x7fd7540693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd75c003080 tx=0x7fd75c017000 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 msgr2=0x7fd774068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e8d0 tx=0x7fd76c008040 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 shutdown_connections 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd754066f30 0x7fd7540693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd774157ca0 0x7fd77416a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd77406d120 0x7fd774068ba0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 --2- 172.21.15.6:0/1726809261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7741578d0 0x7fd7740b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 >> 172.21.15.6:0/1726809261 conn(0x7fd77406bb90 msgr2=0x7fd77406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 shutdown_connections 2023-10-09T11:42:14.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.284+0000 7fd778ec4700 1 -- 172.21.15.6:0/1726809261 wait complete. 2023-10-09T11:42:14.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:42:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.428+0000 7f4b6d3a3700 1 Processor -- start 2023-10-09T11:42:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.428+0000 7f4b6d3a3700 1 -- start start 2023-10-09T11:42:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b6d3a3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b680cf240 0x7f4b680b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b6d3a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6806d650 0x7f4b6806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b6d3a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b680b0ca0 con 0x7f4b6815a2a0 2023-10-09T11:42:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b6d3a3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6806ea90 con 0x7f4b680cf240 2023-10-09T11:42:14.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b6d3a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680b00d0 con 0x7f4b6806d650 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b66ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b6815a2a0 0x7f4b680ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42290/0 (socket says 172.21.15.6:42290) 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b66ffd700 1 -- 172.21.15.6:0/1650871628 learned_addr learned my addr 172.21.15.6:0/1650871628 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1650871628 >> v2:172.21.15.6:3300/0 conn(0x7f4b680cf240 0x7f4b680b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b667fc700 1 -- 172.21.15.6:0/1650871628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6806d650 msgr2=0x7f4b6806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b677fe700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6806d650 0x7f4b6806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6806d650 0x7f4b6806da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b65ffb700 1 -- 172.21.15.6:0/1650871628 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174851958 0 0) 0x7f4b680b0ca0 con 0x7f4b6815a2a0 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b667fc700 1 -- 172.21.15.6:0/1650871628 >> v1:172.21.15.6:6789/0 conn(0x7f4b6815a2a0 legacy=0x7f4b680ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.429+0000 7f4b667fc700 1 -- 172.21.15.6:0/1650871628 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680b0370 con 0x7f4b680cf240 2023-10-09T11:42:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b680cf240 0x7f4b680b1130 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3afcd70c71db0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b65ffb700 1 -- 172.21.15.6:0/1650871628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50009e80 con 0x7f4b680cf240 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b65ffb700 1 -- 172.21.15.6:0/1650871628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5000b860 con 0x7f4b680cf240 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b65ffb700 1 -- 172.21.15.6:0/1650871628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000bbe0 con 0x7f4b680cf240 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1650871628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b680cf240 msgr2=0x7f4b680b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b680cf240 0x7f4b680b1130 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b500091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1650871628 shutdown_connections 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b6806d650 0x7f4b6806da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1650871628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b680cf240 0x7f4b680b1130 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1650871628 >> 172.21.15.6:0/1650871628 conn(0x7f4b68067640 msgr2=0x7f4b68067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1650871628 shutdown_connections 2023-10-09T11:42:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.430+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1650871628 wait complete. 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.431+0000 7f4b6d3a3700 1 Processor -- start 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 -- start start 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b680cf240 0x7f4b68150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 0x7f4b680ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6815d250 con 0x7f4b6806d650 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6815dd30 con 0x7f4b6815a2a0 2023-10-09T11:42:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b6d3a3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6815e240 con 0x7f4b680cf240 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54132/0 (socket says 172.21.15.6:54132) 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.432+0000 7f4b66ffd700 1 -- 172.21.15.6:0/1812362611 learned_addr learned my addr 172.21.15.6:0/1812362611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b677fe700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 0x7f4b680ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b680cf240 0x7f4b68150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 -- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b680cf240 msgr2=0x7f4b68150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b680cf240 0x7f4b68150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 -- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 msgr2=0x7f4b680ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 0x7f4b680ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 -- 172.21.15.6:0/1812362611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009420 con 0x7f4b6806d650 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b677fe700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 0x7f4b680ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b66ffd700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000cca0 tx=0x7f4b60001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000aad0 con 0x7f4b6806d650 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000ac30 con 0x7f4b6806d650 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6815d490 con 0x7f4b6806d650 2023-10-09T11:42:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b600070f0 con 0x7f4b6806d650 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.433+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6815dad0 con 0x7f4b6806d650 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.434+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b68069e40 con 0x7f4b6806d650 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.434+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b60007500 con 0x7f4b6806d650 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.435+0000 7f4b5effd700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 0x7f4b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.435+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b60084930 con 0x7f4b6806d650 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.435+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 0x7f4b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.435+0000 7f4b667fc700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 0x7f4b480693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b50017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.439+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b60051c20 con 0x7f4b6806d650 2023-10-09T11:42:14.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:14.677+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b6804bb80 con 0x7f4b6806d650 2023-10-09T11:42:15.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.284+0000 7f4b5effd700 1 -- 172.21.15.6:0/1812362611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b60055240 con 0x7f4b6806d650 2023-10-09T11:42:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.286+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 msgr2=0x7f4b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.286+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 0x7f4b480693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098e0 tx=0x7f4b50017000 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.286+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 msgr2=0x7f4b681513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.286+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000cca0 tx=0x7f4b60001a30 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.286+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 shutdown_connections 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b48066f30 0x7f4b480693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b6815a2a0 0x7f4b680ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b6806d650 0x7f4b681513a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 --2- 172.21.15.6:0/1812362611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b680cf240 0x7f4b68150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 >> 172.21.15.6:0/1812362611 conn(0x7f4b68067640 msgr2=0x7f4b6806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 shutdown_connections 2023-10-09T11:42:15.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.287+0000 7f4b6d3a3700 1 -- 172.21.15.6:0/1812362611 wait complete. 2023-10-09T11:42:15.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 Processor -- start 2023-10-09T11:42:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 -- start start 2023-10-09T11:42:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facf81578d0 0x7facf80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facf806d120 0x7facf806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80d07c0 con 0x7facf8157ca0 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf806da50 con 0x7facf806d120 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.421+0000 7facfd5e9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf80cfbb0 con 0x7facf81578d0 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facf806d120 0x7facf806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7facf8157ca0 0x7facf815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42298/0 (socket says 172.21.15.6:42298) 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf67fc700 1 -- 172.21.15.6:0/194426086 learned_addr learned my addr 172.21.15.6:0/194426086 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf6ffd700 1 --2- 172.21.15.6:0/194426086 >> v2:172.21.15.118:3300/0 conn(0x7facf81578d0 0x7facf80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 -- 172.21.15.6:0/194426086 >> v2:172.21.15.118:3300/0 conn(0x7facf81578d0 msgr2=0x7facf80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 --2- 172.21.15.6:0/194426086 >> v2:172.21.15.118:3300/0 conn(0x7facf81578d0 0x7facf80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 -- 172.21.15.6:0/194426086 >> v1:172.21.15.6:6789/0 conn(0x7facf8157ca0 legacy=0x7facf815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 -- 172.21.15.6:0/194426086 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80cfe90 con 0x7facf806d120 2023-10-09T11:42:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf77fe700 1 --2- 172.21.15.6:0/194426086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf806d510 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7facf80646b0 tx=0x7facf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a6e7c718dc2408 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf5ffb700 1 -- 172.21.15.6:0/194426086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000b6b0 con 0x7facf806d120 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf5ffb700 1 -- 172.21.15.6:0/194426086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000b810 con 0x7facf806d120 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.422+0000 7facf5ffb700 1 -- 172.21.15.6:0/194426086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000bbb0 con 0x7facf806d120 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 -- 172.21.15.6:0/194426086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 msgr2=0x7facf806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 --2- 172.21.15.6:0/194426086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf806d510 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7facf80646b0 tx=0x7facf00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 -- 172.21.15.6:0/194426086 shutdown_connections 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 --2- 172.21.15.6:0/194426086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf806d510 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 --2- 172.21.15.6:0/194426086 >> v2:172.21.15.118:3300/0 conn(0x7facf81578d0 0x7facf80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 -- 172.21.15.6:0/194426086 >> 172.21.15.6:0/194426086 conn(0x7facf806bb90 msgr2=0x7facf806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 -- 172.21.15.6:0/194426086 shutdown_connections 2023-10-09T11:42:15.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.423+0000 7facfd5e9700 1 -- 172.21.15.6:0/194426086 wait complete. 2023-10-09T11:42:15.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.424+0000 7facfd5e9700 1 Processor -- start 2023-10-09T11:42:15.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.424+0000 7facfd5e9700 1 -- start start 2023-10-09T11:42:15.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 0x7facf80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8157ca0 0x7facf80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8153f40 con 0x7facf806d120 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf80b4760 con 0x7facf8157ca0 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facfd5e9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf80b4de0 con 0x7facf81578d0 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54164/0 (socket says 172.21.15.6:54164) 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 -- 172.21.15.6:0/1667896281 learned_addr learned my addr 172.21.15.6:0/1667896281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf77fe700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8157ca0 0x7facf80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf67fc700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 0x7facf80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 -- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 msgr2=0x7facf80b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 0x7facf80b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 -- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8157ca0 msgr2=0x7facf80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8157ca0 0x7facf80b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 -- 172.21.15.6:0/1667896281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009420 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf67fc700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 0x7facf80b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.425+0000 7facf6ffd700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7face800e190 tx=0x7face8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.426+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800ed80 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.426+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8014420 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.426+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf80b50c0 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.426+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80147e0 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.426+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf80b4a40 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.427+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf80ceb10 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.427+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face8014b90 con 0x7facf806d120 2023-10-09T11:42:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.427+0000 7faceeffd700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.427+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7face8084cb0 con 0x7facf806d120 2023-10-09T11:42:15.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.427+0000 7facf67fc700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.428+0000 7facf67fc700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 0x7facd80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7facf81580c0 tx=0x7face0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.432+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face8051f20 con 0x7facf806d120 2023-10-09T11:42:15.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.668+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facf80d0170 con 0x7facf806d120 2023-10-09T11:42:15.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.669+0000 7faceeffd700 1 -- 172.21.15.6:0/1667896281 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7face8009a60 con 0x7facf806d120 2023-10-09T11:42:15.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:15.669 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 msgr2=0x7facd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 0x7facd80693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7facf81580c0 tx=0x7face0009040 comp rx=0 tx=0).stop 2023-10-09T11:42:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 msgr2=0x7facf81595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7face800e190 tx=0x7face8009920 comp rx=0 tx=0).stop 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 shutdown_connections 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8157ca0 0x7facf80b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf806d120 0x7facf81595f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 --2- 172.21.15.6:0/1667896281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf81578d0 0x7facf80b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 >> 172.21.15.6:0/1667896281 conn(0x7facf806bb90 msgr2=0x7facf8156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 shutdown_connections 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.671+0000 7facfd5e9700 1 -- 172.21.15.6:0/1667896281 wait complete. 2023-10-09T11:42:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:15.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.801+0000 7f9f47431700 1 Processor -- start 2023-10-09T11:42:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.801+0000 7f9f47431700 1 -- start start 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f47431700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f401578d0 0x7f9f400cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f47431700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400d07c0 con 0x7f9f40157ca0 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f47431700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400cfbb0 con 0x7f9f4006d120 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f47431700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400cfe90 con 0x7f9f401578d0 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f449cc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f40157ca0 0x7f9f4015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42310/0 (socket says 172.21.15.6:42310) 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.802+0000 7f9f449cc700 1 -- 172.21.15.6:0/1053134257 learned_addr learned my addr 172.21.15.6:0/1053134257 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f451cd700 1 --2- 172.21.15.6:0/1053134257 >> v2:172.21.15.118:3300/0 conn(0x7f9f401578d0 0x7f9f400cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593063445 0 0) 0x7f9f400d07c0 con 0x7f9f40157ca0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f28003570 con 0x7f9f40157ca0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745043025 0 0) 0x7f9f400cfbb0 con 0x7f9f4006d120 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f400d07c0 con 0x7f9f4006d120 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357599370 0 0) 0x7f9f28003570 con 0x7f9f40157ca0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 >> v2:172.21.15.118:3300/0 conn(0x7f9f401578d0 msgr2=0x7f9f400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 --2- 172.21.15.6:0/1053134257 >> v2:172.21.15.118:3300/0 conn(0x7f9f401578d0 0x7f9f400cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 >> v1:172.21.15.118:6789/0 conn(0x7f9f4006d120 legacy=0x7f9f4006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400d0170 con 0x7f9f40157ca0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f9f34001470 con 0x7f9f40157ca0 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 >> v1:172.21.15.6:6789/0 conn(0x7f9f40157ca0 legacy=0x7f9f4015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f28004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f28004810 0x7f9f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f28005210 0x7f9f2800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cfe90 con 0x7f9f28003c40 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800c130 con 0x7f9f28005210 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800c2c0 con 0x7f9f28004810 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f451cd700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f28004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f459ce700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f28005210 0x7f9f2800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.803+0000 7f9f449cc700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f28004810 0x7f9f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 -- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f28004810 msgr2=0x7f9f28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f28004810 0x7f9f28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 -- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f28005210 msgr2=0x7f9f2800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f28005210 0x7f9f2800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f459ce700 1 -- 172.21.15.6:0/1053134257 reap_dead start 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 -- 172.21.15.6:0/1053134257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28003570 con 0x7f9f28003c40 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f449cc700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f28004810 0x7f9f28004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f451cd700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f28004030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9f30006f00 tx=0x7f9f300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f32ed0df439447 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000e710 con 0x7f9f28003c40 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000e870 con 0x7f9f28003c40 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f3ffff700 1 -- 172.21.15.6:0/1053134257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000ec30 con 0x7f9f28003c40 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f47431700 1 -- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 msgr2=0x7f9f28004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f47431700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f28004030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9f30006f00 tx=0x7f9f300091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f47431700 1 -- 172.21.15.6:0/1053134257 shutdown_connections 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f47431700 1 --2- 172.21.15.6:0/1053134257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f28004030 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.804+0000 7f9f47431700 1 -- 172.21.15.6:0/1053134257 >> 172.21.15.6:0/1053134257 conn(0x7f9f4006bb90 msgr2=0x7f9f4006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.805+0000 7f9f47431700 1 -- 172.21.15.6:0/1053134257 shutdown_connections 2023-10-09T11:42:15.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.805+0000 7f9f47431700 1 -- 172.21.15.6:0/1053134257 wait complete. 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.806+0000 7f9f47431700 1 Processor -- start 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.806+0000 7f9f47431700 1 -- start start 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4016a8c0 0x7f9f4015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 0x7f9f4015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c8c80 con 0x7f9f28003c40 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400c6580 con 0x7f9f4016a8c0 2023-10-09T11:42:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4016ee70 con 0x7f9f4016ad30 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54188/0 (socket says 172.21.15.6:54188) 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 -- 172.21.15.6:0/89077609 learned_addr learned my addr 172.21.15.6:0/89077609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f449cc700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4016a8c0 0x7f9f4015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f459ce700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 0x7f9f4015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 -- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 msgr2=0x7f9f4015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 0x7f9f4015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 -- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4016a8c0 msgr2=0x7f9f4015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4016a8c0 0x7f9f4015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 -- 172.21.15.6:0/89077609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400c5c50 con 0x7f9f28003c40 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f459ce700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 0x7f9f4015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f451cd700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9f280057b0 tx=0x7f9f3001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30022070 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000e9e0 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f400c5f30 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300276c0 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.807+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f40154540 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.808+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f40067ac0 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.809+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f3001c450 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.809+0000 7f9f3d7fa700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 0x7f9f2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.809+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f30086040 con 0x7f9f28003c40 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.809+0000 7f9f449cc700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 0x7f9f2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.809+0000 7f9f449cc700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 0x7f9f2c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9f4015d5b0 tx=0x7f9f34007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:15.813+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f300532b0 con 0x7f9f28003c40 2023-10-09T11:42:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.005+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f400d0450 con 0x7f9f28003c40 2023-10-09T11:42:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.006+0000 7f9f3d7fa700 1 -- 172.21.15.6:0/89077609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+15317 (secure 0 0 0) 0x7f9f300568d0 con 0x7f9f28003c40 2023-10-09T11:42:16.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:16.007 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":130,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:13.246568+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.008+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 msgr2=0x7f9f2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.008+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 0x7f9f2c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9f4015d5b0 tx=0x7f9f34007040 comp rx=0 tx=0).stop 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 msgr2=0x7f9f40154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9f280057b0 tx=0x7f9f3001a000 comp rx=0 tx=0).stop 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 shutdown_connections 2023-10-09T11:42:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9f2c066f30 0x7f9f2c0693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f4016ad30 0x7f9f4015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f28003c40 0x7f9f40154000 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 --2- 172.21.15.6:0/89077609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f4016a8c0 0x7f9f4015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 >> 172.21.15.6:0/89077609 conn(0x7f9f4006bb90 msgr2=0x7f9f40068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 shutdown_connections 2023-10-09T11:42:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.009+0000 7f9f47431700 1 -- 172.21.15.6:0/89077609 wait complete. 2023-10-09T11:42:16.021 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:42:16.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.139+0000 7fe49f339700 1 Processor -- start 2023-10-09T11:42:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.139+0000 7fe49f339700 1 -- start start 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49f339700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe498156420 0x7fe4980cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49f339700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4980c71d0 0x7fe4980c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49f339700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4980cb880 con 0x7fe4980cc250 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49f339700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4980c7bb0 con 0x7fe498156420 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49f339700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49806aa10 con 0x7fe4980c71d0 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49d0d5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe498156420 0x7fe4980cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49d0d5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe498156420 0x7fe4980cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54196/0 (socket says 172.21.15.6:54196) 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49d0d5700 1 -- 172.21.15.6:0/10955113 learned_addr learned my addr 172.21.15.6:0/10955113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.140+0000 7fe49c8d4700 1 --1- 172.21.15.6:0/10955113 >> v1:172.21.15.6:6789/0 conn(0x7fe4980cc250 0x7fe498069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42312/0 (socket says 172.21.15.6:42312) 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d8d6700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4980c71d0 0x7fe4980c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d0d5700 1 -- 172.21.15.6:0/10955113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4980c71d0 msgr2=0x7fe4980c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d0d5700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4980c71d0 0x7fe4980c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d0d5700 1 -- 172.21.15.6:0/10955113 >> v1:172.21.15.6:6789/0 conn(0x7fe4980cc250 legacy=0x7fe498069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d0d5700 1 -- 172.21.15.6:0/10955113 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4980cac70 con 0x7fe498156420 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49d0d5700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe498156420 0x7fe4980cbd10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe4900099b0 tx=0x7fe490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22eb3a6ff6e6db7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe497fff700 1 -- 172.21.15.6:0/10955113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000b860 con 0x7fe498156420 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe497fff700 1 -- 172.21.15.6:0/10955113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000b9c0 con 0x7fe498156420 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe497fff700 1 -- 172.21.15.6:0/10955113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000bd60 con 0x7fe498156420 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49f339700 1 -- 172.21.15.6:0/10955113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe498156420 msgr2=0x7fe4980cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.141+0000 7fe49f339700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe498156420 0x7fe4980cbd10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe4900099b0 tx=0x7fe490009250 comp rx=0 tx=0).stop 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 -- 172.21.15.6:0/10955113 shutdown_connections 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe4980c71d0 0x7fe4980c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 --2- 172.21.15.6:0/10955113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe498156420 0x7fe4980cbd10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 -- 172.21.15.6:0/10955113 >> 172.21.15.6:0/10955113 conn(0x7fe49806c660 msgr2=0x7fe4980cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 -- 172.21.15.6:0/10955113 shutdown_connections 2023-10-09T11:42:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.142+0000 7fe49f339700 1 -- 172.21.15.6:0/10955113 wait complete. 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.143+0000 7fe49f339700 1 Processor -- start 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.143+0000 7fe49f339700 1 -- start start 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4980c71d0 0x7fe49816a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe498156420 0x7fe4981567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe498158960 con 0x7fe4980cc250 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49816ad80 con 0x7fe4980c71d0 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe498157d50 con 0x7fe498156420 2023-10-09T11:42:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54208/0 (socket says 172.21.15.6:54208) 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 -- 172.21.15.6:0/1954256056 learned_addr learned my addr 172.21.15.6:0/1954256056 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49d0d5700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4980c71d0 0x7fe49816a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49d8d6700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe498156420 0x7fe4981567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 -- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe498156420 msgr2=0x7fe4981567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe498156420 0x7fe4981567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 -- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4980c71d0 msgr2=0x7fe49816a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4980c71d0 0x7fe49816a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 -- 172.21.15.6:0/1954256056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900094f0 con 0x7fe4980cc250 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49c8d4700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00c7f0 tx=0x7fe48c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c005a70 con 0x7fe4980cc250 2023-10-09T11:42:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c005bf0 con 0x7fe4980cc250 2023-10-09T11:42:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe498158030 con 0x7fe4980cc250 2023-10-09T11:42:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.144+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0070d0 con 0x7fe4980cc250 2023-10-09T11:42:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.145+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4981585f0 con 0x7fe4980cc250 2023-10-09T11:42:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.146+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe498158b10 con 0x7fe4980cc250 2023-10-09T11:42:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.146+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe48c007480 con 0x7fe4980cc250 2023-10-09T11:42:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.146+0000 7fe4957fa700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 0x7fe4840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.146+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe48c0839e0 con 0x7fe4980cc250 2023-10-09T11:42:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.146+0000 7fe49d0d5700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 0x7fe4840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.147+0000 7fe49d0d5700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 0x7fe4840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4900099b0 tx=0x7fe490017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.151+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe498158b10 con 0x7fe4980cc250 2023-10-09T11:42:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.339+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe498158b10 con 0x7fe484066f30 2023-10-09T11:42:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.347+0000 7fe4957fa700 1 -- 172.21.15.6:0/1954256056 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285653 (secure 0 0 0) 0x7fe498158b10 con 0x7fe484066f30 2023-10-09T11:42:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 msgr2=0x7fe4840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 0x7fe4840693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4900099b0 tx=0x7fe490017000 comp rx=0 tx=0).stop 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 msgr2=0x7fe4980c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00c7f0 tx=0x7fe48c007f70 comp rx=0 tx=0).stop 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 shutdown_connections 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe484066f30 0x7fe4840693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe498156420 0x7fe4981567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4980c71d0 0x7fe49816a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 --2- 172.21.15.6:0/1954256056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4980cc250 0x7fe4980c63f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 >> 172.21.15.6:0/1954256056 conn(0x7fe49806c660 msgr2=0x7fe4980b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 shutdown_connections 2023-10-09T11:42:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.350+0000 7fe49f339700 1 -- 172.21.15.6:0/1954256056 wait complete. 2023-10-09T11:42:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:42:16.362 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-10-09T11:42:16.225291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555816,"statfs":{"total":1600000000,"available":1593156130,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.984634"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259596+0000","last_change":"2023-10-09T11:42:12.259596+0000","last_active":"2023-10-09T11:42:12.259596+0000","last_peered":"2023-10-09T11:42:12.259596+0000","last_clean":"2023-10-09T11:42:12.259596+0000","last_became_active":"2023-10-09T11:42:12.258681+0000","last_became_peered":"2023-10-09T11:42:12.258681+0000","last_unstale":"2023-10-09T11:42:12.259596+0000","last_undegraded":"2023-10-09T11:42:12.259596+0000","last_fullsized":"2023-10-09T11:42:12.259596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.263308+0000","last_change":"2023-10-09T11:42:12.263308+0000","last_active":"2023-10-09T11:42:12.263308+0000","last_peered":"2023-10-09T11:42:12.263308+0000","last_clean":"2023-10-09T11:42:12.263308+0000","last_became_active":"2023-10-09T11:42:12.262840+0000","last_became_peered":"2023-10-09T11:42:12.262840+0000","last_unstale":"2023-10-09T11:42:12.263308+0000","last_undegraded":"2023-10-09T11:42:12.263308+0000","last_fullsized":"2023-10-09T11:42:12.263308+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:37.822960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254188+0000","last_change":"2023-10-09T11:42:12.254188+0000","last_active":"2023-10-09T11:42:12.254188+0000","last_peered":"2023-10-09T11:42:12.254188+0000","last_clean":"2023-10-09T11:42:12.254188+0000","last_became_active":"2023-10-09T11:42:12.253768+0000","last_became_peered":"2023-10-09T11:42:12.253768+0000","last_unstale":"2023-10-09T11:42:12.254188+0000","last_undegraded":"2023-10-09T11:42:12.254188+0000","last_fullsized":"2023-10-09T11:42:12.254188+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:01.115578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258586+0000","last_change":"2023-10-09T11:42:12.258586+0000","last_active":"2023-10-09T11:42:12.258586+0000","last_peered":"2023-10-09T11:42:12.258586+0000","last_clean":"2023-10-09T11:42:12.258586+0000","last_became_active":"2023-10-09T11:42:12.258226+0000","last_became_peered":"2023-10-09T11:42:12.258226+0000","last_unstale":"2023-10-09T11:42:12.258586+0000","last_undegraded":"2023-10-09T11:42:12.258586+0000","last_fullsized":"2023-10-09T11:42:12.258586+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:48.322830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255664+0000","last_change":"2023-10-09T11:42:12.255664+0000","last_active":"2023-10-09T11:42:12.255664+0000","last_peered":"2023-10-09T11:42:12.255664+0000","last_clean":"2023-10-09T11:42:12.255664+0000","last_became_active":"2023-10-09T11:42:12.255392+0000","last_became_peered":"2023-10-09T11:42:12.255392+0000","last_unstale":"2023-10-09T11:42:12.255664+0000","last_undegraded":"2023-10-09T11:42:12.255664+0000","last_fullsized":"2023-10-09T11:42:12.255664+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:50.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256245+0000","last_change":"2023-10-09T11:42:12.256245+0000","last_active":"2023-10-09T11:42:12.256245+0000","last_peered":"2023-10-09T11:42:12.256245+0000","last_clean":"2023-10-09T11:42:12.256245+0000","last_became_active":"2023-10-09T11:42:12.255682+0000","last_became_peered":"2023-10-09T11:42:12.255682+0000","last_unstale":"2023-10-09T11:42:12.256245+0000","last_undegraded":"2023-10-09T11:42:12.256245+0000","last_fullsized":"2023-10-09T11:42:12.256245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:07.798608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255819+0000","last_change":"2023-10-09T11:42:12.255819+0000","last_active":"2023-10-09T11:42:12.255819+0000","last_peered":"2023-10-09T11:42:12.255819+0000","last_clean":"2023-10-09T11:42:12.255819+0000","last_became_active":"2023-10-09T11:42:12.255587+0000","last_became_peered":"2023-10-09T11:42:12.255587+0000","last_unstale":"2023-10-09T11:42:12.255819+0000","last_undegraded":"2023-10-09T11:42:12.255819+0000","last_fullsized":"2023-10-09T11:42:12.255819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:43.635511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256246+0000","last_change":"2023-10-09T11:42:12.256246+0000","last_active":"2023-10-09T11:42:12.256246+0000","last_peered":"2023-10-09T11:42:12.256246+0000","last_clean":"2023-10-09T11:42:12.256246+0000","last_became_active":"2023-10-09T11:42:12.255903+0000","last_became_peered":"2023-10-09T11:42:12.255903+0000","last_unstale":"2023-10-09T11:42:12.256246+0000","last_undegraded":"2023-10-09T11:42:12.256246+0000","last_fullsized":"2023-10-09T11:42:12.256246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259238+0000","last_change":"2023-10-09T11:42:12.259238+0000","last_active":"2023-10-09T11:42:12.259238+0000","last_peered":"2023-10-09T11:42:12.259238+0000","last_clean":"2023-10-09T11:42:12.259238+0000","last_became_active":"2023-10-09T11:42:12.258980+0000","last_became_peered":"2023-10-09T11:42:12.258980+0000","last_unstale":"2023-10-09T11:42:12.259238+0000","last_undegraded":"2023-10-09T11:42:12.259238+0000","last_fullsized":"2023-10-09T11:42:12.259238+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:54.930691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261700+0000","last_change":"2023-10-09T11:42:12.261700+0000","last_active":"2023-10-09T11:42:12.261700+0000","last_peered":"2023-10-09T11:42:12.261700+0000","last_clean":"2023-10-09T11:42:12.261700+0000","last_became_active":"2023-10-09T11:42:12.260689+0000","last_became_peered":"2023-10-09T11:42:12.260689+0000","last_unstale":"2023-10-09T11:42:12.261700+0000","last_undegraded":"2023-10-09T11:42:12.261700+0000","last_fullsized":"2023-10-09T11:42:12.261700+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:18.080127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259727+0000","last_change":"2023-10-09T11:42:12.259727+0000","last_active":"2023-10-09T11:42:12.259727+0000","last_peered":"2023-10-09T11:42:12.259727+0000","last_clean":"2023-10-09T11:42:12.259727+0000","last_became_active":"2023-10-09T11:42:12.259310+0000","last_became_peered":"2023-10-09T11:42:12.259310+0000","last_unstale":"2023-10-09T11:42:12.259727+0000","last_undegraded":"2023-10-09T11:42:12.259727+0000","last_fullsized":"2023-10-09T11:42:12.259727+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:15.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259975+0000","last_change":"2023-10-09T11:42:12.259975+0000","last_active":"2023-10-09T11:42:12.259975+0000","last_peered":"2023-10-09T11:42:12.259975+0000","last_clean":"2023-10-09T11:42:12.259975+0000","last_became_active":"2023-10-09T11:42:12.259435+0000","last_became_peered":"2023-10-09T11:42:12.259435+0000","last_unstale":"2023-10-09T11:42:12.259975+0000","last_undegraded":"2023-10-09T11:42:12.259975+0000","last_fullsized":"2023-10-09T11:42:12.259975+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254744+0000","last_change":"2023-10-09T11:42:12.254744+0000","last_active":"2023-10-09T11:42:12.254744+0000","last_peered":"2023-10-09T11:42:12.254744+0000","last_clean":"2023-10-09T11:42:12.254744+0000","last_became_active":"2023-10-09T11:42:12.254498+0000","last_became_peered":"2023-10-09T11:42:12.254498+0000","last_unstale":"2023-10-09T11:42:12.254744+0000","last_undegraded":"2023-10-09T11:42:12.254744+0000","last_fullsized":"2023-10-09T11:42:12.254744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:57.902859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261961+0000","last_change":"2023-10-09T11:42:12.261961+0000","last_active":"2023-10-09T11:42:12.261961+0000","last_peered":"2023-10-09T11:42:12.261961+0000","last_clean":"2023-10-09T11:42:12.261961+0000","last_became_active":"2023-10-09T11:42:12.261177+0000","last_became_peered":"2023-10-09T11:42:12.261177+0000","last_unstale":"2023-10-09T11:42:12.261961+0000","last_undegraded":"2023-10-09T11:42:12.261961+0000","last_fullsized":"2023-10-09T11:42:12.261961+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255335+0000","last_change":"2023-10-09T11:42:12.255335+0000","last_active":"2023-10-09T11:42:12.255335+0000","last_peered":"2023-10-09T11:42:12.255335+0000","last_clean":"2023-10-09T11:42:12.255335+0000","last_became_active":"2023-10-09T11:42:12.255113+0000","last_became_peered":"2023-10-09T11:42:12.255113+0000","last_unstale":"2023-10-09T11:42:12.255335+0000","last_undegraded":"2023-10-09T11:42:12.255335+0000","last_fullsized":"2023-10-09T11:42:12.255335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:54.342939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260946+0000","last_change":"2023-10-09T11:42:12.260946+0000","last_active":"2023-10-09T11:42:12.260946+0000","last_peered":"2023-10-09T11:42:12.260946+0000","last_clean":"2023-10-09T11:42:12.260946+0000","last_became_active":"2023-10-09T11:42:12.260706+0000","last_became_peered":"2023-10-09T11:42:12.260706+0000","last_unstale":"2023-10-09T11:42:12.260946+0000","last_undegraded":"2023-10-09T11:42:12.260946+0000","last_fullsized":"2023-10-09T11:42:12.260946+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256543+0000","last_change":"2023-10-09T11:42:12.256543+0000","last_active":"2023-10-09T11:42:12.256543+0000","last_peered":"2023-10-09T11:42:12.256543+0000","last_clean":"2023-10-09T11:42:12.256543+0000","last_became_active":"2023-10-09T11:42:12.256132+0000","last_became_peered":"2023-10-09T11:42:12.256132+0000","last_unstale":"2023-10-09T11:42:12.256543+0000","last_undegraded":"2023-10-09T11:42:12.256543+0000","last_fullsized":"2023-10-09T11:42:12.256543+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:43.635511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.265026+0000","last_change":"2023-10-09T11:42:12.265026+0000","last_active":"2023-10-09T11:42:12.265026+0000","last_peered":"2023-10-09T11:42:12.265026+0000","last_clean":"2023-10-09T11:42:12.265026+0000","last_became_active":"2023-10-09T11:42:12.262156+0000","last_became_peered":"2023-10-09T11:42:12.262156+0000","last_unstale":"2023-10-09T11:42:12.265026+0000","last_undegraded":"2023-10-09T11:42:12.265026+0000","last_fullsized":"2023-10-09T11:42:12.265026+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.488955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262276+0000","last_change":"2023-10-09T11:42:12.262276+0000","last_active":"2023-10-09T11:42:12.262276+0000","last_peered":"2023-10-09T11:42:12.262276+0000","last_clean":"2023-10-09T11:42:12.262276+0000","last_became_active":"2023-10-09T11:42:12.261477+0000","last_became_peered":"2023-10-09T11:42:12.261477+0000","last_unstale":"2023-10-09T11:42:12.262276+0000","last_undegraded":"2023-10-09T11:42:12.262276+0000","last_fullsized":"2023-10-09T11:42:12.262276+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255326+0000","last_change":"2023-10-09T11:42:12.255326+0000","last_active":"2023-10-09T11:42:12.255326+0000","last_peered":"2023-10-09T11:42:12.255326+0000","last_clean":"2023-10-09T11:42:12.255326+0000","last_became_active":"2023-10-09T11:42:12.254738+0000","last_became_peered":"2023-10-09T11:42:12.254738+0000","last_unstale":"2023-10-09T11:42:12.255326+0000","last_undegraded":"2023-10-09T11:42:12.255326+0000","last_fullsized":"2023-10-09T11:42:12.255326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:22.121824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259569+0000","last_change":"2023-10-09T11:42:12.259569+0000","last_active":"2023-10-09T11:42:12.259569+0000","last_peered":"2023-10-09T11:42:12.259569+0000","last_clean":"2023-10-09T11:42:12.259569+0000","last_became_active":"2023-10-09T11:42:12.258939+0000","last_became_peered":"2023-10-09T11:42:12.258939+0000","last_unstale":"2023-10-09T11:42:12.259569+0000","last_undegraded":"2023-10-09T11:42:12.259569+0000","last_fullsized":"2023-10-09T11:42:12.259569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:18.679916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258532+0000","last_change":"2023-10-09T11:42:12.258532+0000","last_active":"2023-10-09T11:42:12.258532+0000","last_peered":"2023-10-09T11:42:12.258532+0000","last_clean":"2023-10-09T11:42:12.258532+0000","last_became_active":"2023-10-09T11:42:12.258210+0000","last_became_peered":"2023-10-09T11:42:12.258210+0000","last_unstale":"2023-10-09T11:42:12.258532+0000","last_undegraded":"2023-10-09T11:42:12.258532+0000","last_fullsized":"2023-10-09T11:42:12.258532+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256570+0000","last_change":"2023-10-09T11:42:12.256570+0000","last_active":"2023-10-09T11:42:12.256570+0000","last_peered":"2023-10-09T11:42:12.256570+0000","last_clean":"2023-10-09T11:42:12.256570+0000","last_became_active":"2023-10-09T11:42:12.255399+0000","last_became_peered":"2023-10-09T11:42:12.255399+0000","last_unstale":"2023-10-09T11:42:12.256570+0000","last_undegraded":"2023-10-09T11:42:12.256570+0000","last_fullsized":"2023-10-09T11:42:12.256570+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:34.908835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260935+0000","last_change":"2023-10-09T11:42:12.260935+0000","last_active":"2023-10-09T11:42:12.260935+0000","last_peered":"2023-10-09T11:42:12.260935+0000","last_clean":"2023-10-09T11:42:12.260935+0000","last_became_active":"2023-10-09T11:42:12.260709+0000","last_became_peered":"2023-10-09T11:42:12.260709+0000","last_unstale":"2023-10-09T11:42:12.260935+0000","last_undegraded":"2023-10-09T11:42:12.260935+0000","last_fullsized":"2023-10-09T11:42:12.260935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255791+0000","last_change":"2023-10-09T11:42:12.255791+0000","last_active":"2023-10-09T11:42:12.255791+0000","last_peered":"2023-10-09T11:42:12.255791+0000","last_clean":"2023-10-09T11:42:12.255791+0000","last_became_active":"2023-10-09T11:42:12.255090+0000","last_became_peered":"2023-10-09T11:42:12.255090+0000","last_unstale":"2023-10-09T11:42:12.255791+0000","last_undegraded":"2023-10-09T11:42:12.255791+0000","last_fullsized":"2023-10-09T11:42:12.255791+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:41.483239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259749+0000","last_change":"2023-10-09T11:42:12.259749+0000","last_active":"2023-10-09T11:42:12.259749+0000","last_peered":"2023-10-09T11:42:12.259749+0000","last_clean":"2023-10-09T11:42:12.259749+0000","last_became_active":"2023-10-09T11:42:12.258982+0000","last_became_peered":"2023-10-09T11:42:12.258982+0000","last_unstale":"2023-10-09T11:42:12.259749+0000","last_undegraded":"2023-10-09T11:42:12.259749+0000","last_fullsized":"2023-10-09T11:42:12.259749+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261246+0000","last_change":"2023-10-09T11:42:12.261246+0000","last_active":"2023-10-09T11:42:12.261246+0000","last_peered":"2023-10-09T11:42:12.261246+0000","last_clean":"2023-10-09T11:42:12.261246+0000","last_became_active":"2023-10-09T11:42:12.261018+0000","last_became_peered":"2023-10-09T11:42:12.261018+0000","last_unstale":"2023-10-09T11:42:12.261246+0000","last_undegraded":"2023-10-09T11:42:12.261246+0000","last_fullsized":"2023-10-09T11:42:12.261246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:15.199560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260036+0000","last_change":"2023-10-09T11:42:12.260036+0000","last_active":"2023-10-09T11:42:12.260036+0000","last_peered":"2023-10-09T11:42:12.260036+0000","last_clean":"2023-10-09T11:42:12.260036+0000","last_became_active":"2023-10-09T11:42:12.259508+0000","last_became_peered":"2023-10-09T11:42:12.259508+0000","last_unstale":"2023-10-09T11:42:12.260036+0000","last_undegraded":"2023-10-09T11:42:12.260036+0000","last_fullsized":"2023-10-09T11:42:12.260036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262342+0000","last_change":"2023-10-09T11:42:12.262342+0000","last_active":"2023-10-09T11:42:12.262342+0000","last_peered":"2023-10-09T11:42:12.262342+0000","last_clean":"2023-10-09T11:42:12.262342+0000","last_became_active":"2023-10-09T11:42:12.261881+0000","last_became_peered":"2023-10-09T11:42:12.261881+0000","last_unstale":"2023-10-09T11:42:12.262342+0000","last_undegraded":"2023-10-09T11:42:12.262342+0000","last_fullsized":"2023-10-09T11:42:12.262342+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:56.958340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255341+0000","last_change":"2023-10-09T11:42:12.255341+0000","last_active":"2023-10-09T11:42:12.255341+0000","last_peered":"2023-10-09T11:42:12.255341+0000","last_clean":"2023-10-09T11:42:12.255341+0000","last_became_active":"2023-10-09T11:42:12.255069+0000","last_became_peered":"2023-10-09T11:42:12.255069+0000","last_unstale":"2023-10-09T11:42:12.255341+0000","last_undegraded":"2023-10-09T11:42:12.255341+0000","last_fullsized":"2023-10-09T11:42:12.255341+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:16.907311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259903+0000","last_change":"2023-10-09T11:42:12.259903+0000","last_active":"2023-10-09T11:42:12.259903+0000","last_peered":"2023-10-09T11:42:12.259903+0000","last_clean":"2023-10-09T11:42:12.259903+0000","last_became_active":"2023-10-09T11:42:12.259320+0000","last_became_peered":"2023-10-09T11:42:12.259320+0000","last_unstale":"2023-10-09T11:42:12.259903+0000","last_undegraded":"2023-10-09T11:42:12.259903+0000","last_fullsized":"2023-10-09T11:42:12.259903+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257996+0000","last_change":"2023-10-09T11:42:12.257996+0000","last_active":"2023-10-09T11:42:12.257996+0000","last_peered":"2023-10-09T11:42:12.257996+0000","last_clean":"2023-10-09T11:42:12.257996+0000","last_became_active":"2023-10-09T11:42:12.257723+0000","last_became_peered":"2023-10-09T11:42:12.257723+0000","last_unstale":"2023-10-09T11:42:12.257996+0000","last_undegraded":"2023-10-09T11:42:12.257996+0000","last_fullsized":"2023-10-09T11:42:12.257996+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:51.879121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.250201+0000","last_change":"2023-10-09T11:42:12.250201+0000","last_active":"2023-10-09T11:42:12.250201+0000","last_peered":"2023-10-09T11:42:12.250201+0000","last_clean":"2023-10-09T11:42:12.250201+0000","last_became_active":"2023-10-09T11:42:12.249900+0000","last_became_peered":"2023-10-09T11:42:12.249900+0000","last_unstale":"2023-10-09T11:42:12.250201+0000","last_undegraded":"2023-10-09T11:42:12.250201+0000","last_fullsized":"2023-10-09T11:42:12.250201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:47.611984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"129'4","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.269903+0000","last_change":"2023-10-09T11:42:11.256208+0000","last_active":"2023-10-09T11:42:12.269903+0000","last_peered":"2023-10-09T11:42:12.269903+0000","last_clean":"2023-10-09T11:42:12.269903+0000","last_became_active":"2023-10-09T11:42:11.255999+0000","last_became_peered":"2023-10-09T11:42:11.255999+0000","last_unstale":"2023-10-09T11:42:12.269903+0000","last_undegraded":"2023-10-09T11:42:12.269903+0000","last_fullsized":"2023-10-09T11:42:12.269903+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:48.554756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258475+0000","last_change":"2023-10-09T11:42:12.258475+0000","last_active":"2023-10-09T11:42:12.258475+0000","last_peered":"2023-10-09T11:42:12.258475+0000","last_clean":"2023-10-09T11:42:12.258475+0000","last_became_active":"2023-10-09T11:42:12.258253+0000","last_became_peered":"2023-10-09T11:42:12.258253+0000","last_unstale":"2023-10-09T11:42:12.258475+0000","last_undegraded":"2023-10-09T11:42:12.258475+0000","last_fullsized":"2023-10-09T11:42:12.258475+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:37.822960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258672+0000","last_change":"2023-10-09T11:42:11.257658+0000","last_active":"2023-10-09T11:42:12.258672+0000","last_peered":"2023-10-09T11:42:12.258672+0000","last_clean":"2023-10-09T11:42:12.258672+0000","last_became_active":"2023-10-09T11:42:11.257213+0000","last_became_peered":"2023-10-09T11:42:11.257213+0000","last_unstale":"2023-10-09T11:42:12.258672+0000","last_undegraded":"2023-10-09T11:42:12.258672+0000","last_fullsized":"2023-10-09T11:42:12.258672+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:36.817468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256390+0000","last_change":"2023-10-09T11:42:12.256390+0000","last_active":"2023-10-09T11:42:12.256390+0000","last_peered":"2023-10-09T11:42:12.256390+0000","last_clean":"2023-10-09T11:42:12.256390+0000","last_became_active":"2023-10-09T11:42:12.256009+0000","last_became_peered":"2023-10-09T11:42:12.256009+0000","last_unstale":"2023-10-09T11:42:12.256390+0000","last_undegraded":"2023-10-09T11:42:12.256390+0000","last_fullsized":"2023-10-09T11:42:12.256390+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:33.290021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272149+0000","last_change":"2023-10-09T11:42:11.251107+0000","last_active":"2023-10-09T11:42:12.272149+0000","last_peered":"2023-10-09T11:42:12.272149+0000","last_clean":"2023-10-09T11:42:12.272149+0000","last_became_active":"2023-10-09T11:42:11.249923+0000","last_became_peered":"2023-10-09T11:42:11.249923+0000","last_unstale":"2023-10-09T11:42:12.272149+0000","last_undegraded":"2023-10-09T11:42:12.272149+0000","last_fullsized":"2023-10-09T11:42:12.272149+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:31.091666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257295+0000","last_change":"2023-10-09T11:42:12.257295+0000","last_active":"2023-10-09T11:42:12.257295+0000","last_peered":"2023-10-09T11:42:12.257295+0000","last_clean":"2023-10-09T11:42:12.257295+0000","last_became_active":"2023-10-09T11:42:12.257095+0000","last_became_peered":"2023-10-09T11:42:12.257095+0000","last_unstale":"2023-10-09T11:42:12.257295+0000","last_undegraded":"2023-10-09T11:42:12.257295+0000","last_fullsized":"2023-10-09T11:42:12.257295+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:53.844738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272111+0000","last_change":"2023-10-09T11:42:11.253238+0000","last_active":"2023-10-09T11:42:12.272111+0000","last_peered":"2023-10-09T11:42:12.272111+0000","last_clean":"2023-10-09T11:42:12.272111+0000","last_became_active":"2023-10-09T11:42:11.252581+0000","last_became_peered":"2023-10-09T11:42:11.252581+0000","last_unstale":"2023-10-09T11:42:12.272111+0000","last_undegraded":"2023-10-09T11:42:12.272111+0000","last_fullsized":"2023-10-09T11:42:12.272111+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:44.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259846+0000","last_change":"2023-10-09T11:42:12.259846+0000","last_active":"2023-10-09T11:42:12.259846+0000","last_peered":"2023-10-09T11:42:12.259846+0000","last_clean":"2023-10-09T11:42:12.259846+0000","last_became_active":"2023-10-09T11:42:12.259612+0000","last_became_peered":"2023-10-09T11:42:12.259612+0000","last_unstale":"2023-10-09T11:42:12.259846+0000","last_undegraded":"2023-10-09T11:42:12.259846+0000","last_fullsized":"2023-10-09T11:42:12.259846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:04.099641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.248914+0000","last_change":"2023-10-09T11:42:11.251676+0000","last_active":"2023-10-09T11:42:12.248914+0000","last_peered":"2023-10-09T11:42:12.248914+0000","last_clean":"2023-10-09T11:42:12.248914+0000","last_became_active":"2023-10-09T11:42:11.251234+0000","last_became_peered":"2023-10-09T11:42:11.251234+0000","last_unstale":"2023-10-09T11:42:12.248914+0000","last_undegraded":"2023-10-09T11:42:12.248914+0000","last_fullsized":"2023-10-09T11:42:12.248914+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:06.176883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258846+0000","last_change":"2023-10-09T11:42:12.258846+0000","last_active":"2023-10-09T11:42:12.258846+0000","last_peered":"2023-10-09T11:42:12.258846+0000","last_clean":"2023-10-09T11:42:12.258846+0000","last_became_active":"2023-10-09T11:42:12.258578+0000","last_became_peered":"2023-10-09T11:42:12.258578+0000","last_unstale":"2023-10-09T11:42:12.258846+0000","last_undegraded":"2023-10-09T11:42:12.258846+0000","last_fullsized":"2023-10-09T11:42:12.258846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.488955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254402+0000","last_change":"2023-10-09T11:42:11.253344+0000","last_active":"2023-10-09T11:42:12.254402+0000","last_peered":"2023-10-09T11:42:12.254402+0000","last_clean":"2023-10-09T11:42:12.254402+0000","last_became_active":"2023-10-09T11:42:11.253121+0000","last_became_peered":"2023-10-09T11:42:11.253121+0000","last_unstale":"2023-10-09T11:42:12.254402+0000","last_undegraded":"2023-10-09T11:42:12.254402+0000","last_fullsized":"2023-10-09T11:42:12.254402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:57.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261876+0000","last_change":"2023-10-09T11:42:12.261876+0000","last_active":"2023-10-09T11:42:12.261876+0000","last_peered":"2023-10-09T11:42:12.261876+0000","last_clean":"2023-10-09T11:42:12.261876+0000","last_became_active":"2023-10-09T11:42:12.261211+0000","last_became_peered":"2023-10-09T11:42:12.261211+0000","last_unstale":"2023-10-09T11:42:12.261876+0000","last_undegraded":"2023-10-09T11:42:12.261876+0000","last_fullsized":"2023-10-09T11:42:12.261876+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:16.802790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258430+0000","last_change":"2023-10-09T11:42:11.258375+0000","last_active":"2023-10-09T11:42:11.258430+0000","last_peered":"2023-10-09T11:42:11.258430+0000","last_clean":"2023-10-09T11:42:11.258430+0000","last_became_active":"2023-10-09T11:42:11.258154+0000","last_became_peered":"2023-10-09T11:42:11.258154+0000","last_unstale":"2023-10-09T11:42:11.258430+0000","last_undegraded":"2023-10-09T11:42:11.258430+0000","last_fullsized":"2023-10-09T11:42:11.258430+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:18.539367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255896+0000","last_change":"2023-10-09T11:42:12.255896+0000","last_active":"2023-10-09T11:42:12.255896+0000","last_peered":"2023-10-09T11:42:12.255896+0000","last_clean":"2023-10-09T11:42:12.255896+0000","last_became_active":"2023-10-09T11:42:12.255639+0000","last_became_peered":"2023-10-09T11:42:12.255639+0000","last_unstale":"2023-10-09T11:42:12.255896+0000","last_undegraded":"2023-10-09T11:42:12.255896+0000","last_fullsized":"2023-10-09T11:42:12.255896+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:33.439982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.259874+0000","last_change":"2023-10-09T11:42:11.259812+0000","last_active":"2023-10-09T11:42:11.259874+0000","last_peered":"2023-10-09T11:42:11.259874+0000","last_clean":"2023-10-09T11:42:11.259874+0000","last_became_active":"2023-10-09T11:42:11.259445+0000","last_became_peered":"2023-10-09T11:42:11.259445+0000","last_unstale":"2023-10-09T11:42:11.259874+0000","last_undegraded":"2023-10-09T11:42:11.259874+0000","last_fullsized":"2023-10-09T11:42:11.259874+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:00.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.250677+0000","last_change":"2023-10-09T11:42:12.250677+0000","last_active":"2023-10-09T11:42:12.250677+0000","last_peered":"2023-10-09T11:42:12.250677+0000","last_clean":"2023-10-09T11:42:12.250677+0000","last_became_active":"2023-10-09T11:42:12.250446+0000","last_became_peered":"2023-10-09T11:42:12.250446+0000","last_unstale":"2023-10-09T11:42:12.250677+0000","last_undegraded":"2023-10-09T11:42:12.250677+0000","last_fullsized":"2023-10-09T11:42:12.250677+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:17.100884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253478+0000","last_change":"2023-10-09T11:42:11.253378+0000","last_active":"2023-10-09T11:42:11.253478+0000","last_peered":"2023-10-09T11:42:11.253478+0000","last_clean":"2023-10-09T11:42:11.253478+0000","last_became_active":"2023-10-09T11:42:11.252911+0000","last_became_peered":"2023-10-09T11:42:11.252911+0000","last_unstale":"2023-10-09T11:42:11.253478+0000","last_undegraded":"2023-10-09T11:42:11.253478+0000","last_fullsized":"2023-10-09T11:42:11.253478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:44.595712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261128+0000","last_change":"2023-10-09T11:42:12.261128+0000","last_active":"2023-10-09T11:42:12.261128+0000","last_peered":"2023-10-09T11:42:12.261128+0000","last_clean":"2023-10-09T11:42:12.261128+0000","last_became_active":"2023-10-09T11:42:12.260595+0000","last_became_peered":"2023-10-09T11:42:12.260595+0000","last_unstale":"2023-10-09T11:42:12.261128+0000","last_undegraded":"2023-10-09T11:42:12.261128+0000","last_fullsized":"2023-10-09T11:42:12.261128+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:01.453249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.257784+0000","last_change":"2023-10-09T11:42:11.255018+0000","last_active":"2023-10-09T11:42:11.257784+0000","last_peered":"2023-10-09T11:42:11.257784+0000","last_clean":"2023-10-09T11:42:11.257784+0000","last_became_active":"2023-10-09T11:42:11.254306+0000","last_became_peered":"2023-10-09T11:42:11.254306+0000","last_unstale":"2023-10-09T11:42:11.257784+0000","last_undegraded":"2023-10-09T11:42:11.257784+0000","last_fullsized":"2023-10-09T11:42:11.257784+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:00.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258177+0000","last_change":"2023-10-09T11:42:12.258177+0000","last_active":"2023-10-09T11:42:12.258177+0000","last_peered":"2023-10-09T11:42:12.258177+0000","last_clean":"2023-10-09T11:42:12.258177+0000","last_became_active":"2023-10-09T11:42:12.257948+0000","last_became_peered":"2023-10-09T11:42:12.257948+0000","last_unstale":"2023-10-09T11:42:12.258177+0000","last_undegraded":"2023-10-09T11:42:12.258177+0000","last_fullsized":"2023-10-09T11:42:12.258177+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272252+0000","last_change":"2023-10-09T11:42:11.260396+0000","last_active":"2023-10-09T11:42:12.272252+0000","last_peered":"2023-10-09T11:42:12.272252+0000","last_clean":"2023-10-09T11:42:12.272252+0000","last_became_active":"2023-10-09T11:42:11.259933+0000","last_became_peered":"2023-10-09T11:42:11.259933+0000","last_unstale":"2023-10-09T11:42:12.272252+0000","last_undegraded":"2023-10-09T11:42:12.272252+0000","last_fullsized":"2023-10-09T11:42:12.272252+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:36.817468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260498+0000","last_change":"2023-10-09T11:42:12.260498+0000","last_active":"2023-10-09T11:42:12.260498+0000","last_peered":"2023-10-09T11:42:12.260498+0000","last_clean":"2023-10-09T11:42:12.260498+0000","last_became_active":"2023-10-09T11:42:12.260295+0000","last_became_peered":"2023-10-09T11:42:12.260295+0000","last_unstale":"2023-10-09T11:42:12.260498+0000","last_undegraded":"2023-10-09T11:42:12.260498+0000","last_fullsized":"2023-10-09T11:42:12.260498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:16.329498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272397+0000","last_change":"2023-10-09T11:42:11.261115+0000","last_active":"2023-10-09T11:42:12.272397+0000","last_peered":"2023-10-09T11:42:12.272397+0000","last_clean":"2023-10-09T11:42:12.272397+0000","last_became_active":"2023-10-09T11:42:11.260183+0000","last_became_peered":"2023-10-09T11:42:11.260183+0000","last_unstale":"2023-10-09T11:42:12.272397+0000","last_undegraded":"2023-10-09T11:42:12.272397+0000","last_fullsized":"2023-10-09T11:42:12.272397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:57.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259071+0000","last_change":"2023-10-09T11:42:12.259071+0000","last_active":"2023-10-09T11:42:12.259071+0000","last_peered":"2023-10-09T11:42:12.259071+0000","last_clean":"2023-10-09T11:42:12.259071+0000","last_became_active":"2023-10-09T11:42:12.258846+0000","last_became_peered":"2023-10-09T11:42:12.258846+0000","last_unstale":"2023-10-09T11:42:12.259071+0000","last_undegraded":"2023-10-09T11:42:12.259071+0000","last_fullsized":"2023-10-09T11:42:12.259071+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:53.844738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271701+0000","last_change":"2023-10-09T11:42:11.257510+0000","last_active":"2023-10-09T11:42:12.271701+0000","last_peered":"2023-10-09T11:42:12.271701+0000","last_clean":"2023-10-09T11:42:12.271701+0000","last_became_active":"2023-10-09T11:42:11.255747+0000","last_became_peered":"2023-10-09T11:42:11.255747+0000","last_unstale":"2023-10-09T11:42:12.271701+0000","last_undegraded":"2023-10-09T11:42:12.271701+0000","last_fullsized":"2023-10-09T11:42:12.271701+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:26.535447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260794+0000","last_change":"2023-10-09T11:42:12.260794+0000","last_active":"2023-10-09T11:42:12.260794+0000","last_peered":"2023-10-09T11:42:12.260794+0000","last_clean":"2023-10-09T11:42:12.260794+0000","last_became_active":"2023-10-09T11:42:12.260563+0000","last_became_peered":"2023-10-09T11:42:12.260563+0000","last_unstale":"2023-10-09T11:42:12.260794+0000","last_undegraded":"2023-10-09T11:42:12.260794+0000","last_fullsized":"2023-10-09T11:42:12.260794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:49.933302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.260464+0000","last_change":"2023-10-09T11:42:11.260416+0000","last_active":"2023-10-09T11:42:11.260464+0000","last_peered":"2023-10-09T11:42:11.260464+0000","last_clean":"2023-10-09T11:42:11.260464+0000","last_became_active":"2023-10-09T11:42:11.260273+0000","last_became_peered":"2023-10-09T11:42:11.260273+0000","last_unstale":"2023-10-09T11:42:11.260464+0000","last_undegraded":"2023-10-09T11:42:11.260464+0000","last_fullsized":"2023-10-09T11:42:11.260464+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.638125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260321+0000","last_change":"2023-10-09T11:42:12.260321+0000","last_active":"2023-10-09T11:42:12.260321+0000","last_peered":"2023-10-09T11:42:12.260321+0000","last_clean":"2023-10-09T11:42:12.260321+0000","last_became_active":"2023-10-09T11:42:12.260076+0000","last_became_peered":"2023-10-09T11:42:12.260076+0000","last_unstale":"2023-10-09T11:42:12.260321+0000","last_undegraded":"2023-10-09T11:42:12.260321+0000","last_fullsized":"2023-10-09T11:42:12.260321+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:01.115578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271896+0000","last_change":"2023-10-09T11:42:11.255683+0000","last_active":"2023-10-09T11:42:12.271896+0000","last_peered":"2023-10-09T11:42:12.271896+0000","last_clean":"2023-10-09T11:42:12.271896+0000","last_became_active":"2023-10-09T11:42:11.255453+0000","last_became_peered":"2023-10-09T11:42:11.255453+0000","last_unstale":"2023-10-09T11:42:12.271896+0000","last_undegraded":"2023-10-09T11:42:12.271896+0000","last_fullsized":"2023-10-09T11:42:12.271896+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:26.154531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262870+0000","last_change":"2023-10-09T11:42:12.262870+0000","last_active":"2023-10-09T11:42:12.262870+0000","last_peered":"2023-10-09T11:42:12.262870+0000","last_clean":"2023-10-09T11:42:12.262870+0000","last_became_active":"2023-10-09T11:42:12.262451+0000","last_became_peered":"2023-10-09T11:42:12.262451+0000","last_unstale":"2023-10-09T11:42:12.262870+0000","last_undegraded":"2023-10-09T11:42:12.262870+0000","last_fullsized":"2023-10-09T11:42:12.262870+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:20.339273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254794+0000","last_change":"2023-10-09T11:42:11.260421+0000","last_active":"2023-10-09T11:42:12.254794+0000","last_peered":"2023-10-09T11:42:12.254794+0000","last_clean":"2023-10-09T11:42:12.254794+0000","last_became_active":"2023-10-09T11:42:11.259192+0000","last_became_peered":"2023-10-09T11:42:11.259192+0000","last_unstale":"2023-10-09T11:42:12.254794+0000","last_undegraded":"2023-10-09T11:42:12.254794+0000","last_fullsized":"2023-10-09T11:42:12.254794+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:40.477747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262720+0000","last_change":"2023-10-09T11:42:12.262720+0000","last_active":"2023-10-09T11:42:12.262720+0000","last_peered":"2023-10-09T11:42:12.262720+0000","last_clean":"2023-10-09T11:42:12.262720+0000","last_became_active":"2023-10-09T11:42:12.262477+0000","last_became_peered":"2023-10-09T11:42:12.262477+0000","last_unstale":"2023-10-09T11:42:12.262720+0000","last_undegraded":"2023-10-09T11:42:12.262720+0000","last_fullsized":"2023-10-09T11:42:12.262720+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:42.111918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271409+0000","last_change":"2023-10-09T11:42:11.256817+0000","last_active":"2023-10-09T11:42:12.271409+0000","last_peered":"2023-10-09T11:42:12.271409+0000","last_clean":"2023-10-09T11:42:12.271409+0000","last_became_active":"2023-10-09T11:42:11.256575+0000","last_became_peered":"2023-10-09T11:42:11.256575+0000","last_unstale":"2023-10-09T11:42:12.271409+0000","last_undegraded":"2023-10-09T11:42:12.271409+0000","last_fullsized":"2023-10-09T11:42:12.271409+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:41.348039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261624+0000","last_change":"2023-10-09T11:42:12.261624+0000","last_active":"2023-10-09T11:42:12.261624+0000","last_peered":"2023-10-09T11:42:12.261624+0000","last_clean":"2023-10-09T11:42:12.261624+0000","last_became_active":"2023-10-09T11:42:12.261368+0000","last_became_peered":"2023-10-09T11:42:12.261368+0000","last_unstale":"2023-10-09T11:42:12.261624+0000","last_undegraded":"2023-10-09T11:42:12.261624+0000","last_fullsized":"2023-10-09T11:42:12.261624+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:18.679916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.252011+0000","last_change":"2023-10-09T11:42:11.256558+0000","last_active":"2023-10-09T11:42:12.252011+0000","last_peered":"2023-10-09T11:42:12.252011+0000","last_clean":"2023-10-09T11:42:12.252011+0000","last_became_active":"2023-10-09T11:42:11.256330+0000","last_became_peered":"2023-10-09T11:42:11.256330+0000","last_unstale":"2023-10-09T11:42:12.252011+0000","last_undegraded":"2023-10-09T11:42:12.252011+0000","last_fullsized":"2023-10-09T11:42:12.252011+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:13.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259065+0000","last_change":"2023-10-09T11:42:12.259065+0000","last_active":"2023-10-09T11:42:12.259065+0000","last_peered":"2023-10-09T11:42:12.259065+0000","last_clean":"2023-10-09T11:42:12.259065+0000","last_became_active":"2023-10-09T11:42:12.258798+0000","last_became_peered":"2023-10-09T11:42:12.258798+0000","last_unstale":"2023-10-09T11:42:12.259065+0000","last_undegraded":"2023-10-09T11:42:12.259065+0000","last_fullsized":"2023-10-09T11:42:12.259065+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:48.750122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253028+0000","last_change":"2023-10-09T11:42:11.252556+0000","last_active":"2023-10-09T11:42:11.253028+0000","last_peered":"2023-10-09T11:42:11.253028+0000","last_clean":"2023-10-09T11:42:11.253028+0000","last_became_active":"2023-10-09T11:42:11.252200+0000","last_became_peered":"2023-10-09T11:42:11.252200+0000","last_unstale":"2023-10-09T11:42:11.253028+0000","last_undegraded":"2023-10-09T11:42:11.253028+0000","last_fullsized":"2023-10-09T11:42:11.253028+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.305210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.263490+0000","last_change":"2023-10-09T11:42:12.263490+0000","last_active":"2023-10-09T11:42:12.263490+0000","last_peered":"2023-10-09T11:42:12.263490+0000","last_clean":"2023-10-09T11:42:12.263490+0000","last_became_active":"2023-10-09T11:42:12.263271+0000","last_became_peered":"2023-10-09T11:42:12.263271+0000","last_unstale":"2023-10-09T11:42:12.263490+0000","last_undegraded":"2023-10-09T11:42:12.263490+0000","last_fullsized":"2023-10-09T11:42:12.263490+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272397+0000","last_change":"2023-10-09T11:42:11.254513+0000","last_active":"2023-10-09T11:42:12.272397+0000","last_peered":"2023-10-09T11:42:12.272397+0000","last_clean":"2023-10-09T11:42:12.272397+0000","last_became_active":"2023-10-09T11:42:11.254117+0000","last_became_peered":"2023-10-09T11:42:11.254117+0000","last_unstale":"2023-10-09T11:42:12.272397+0000","last_undegraded":"2023-10-09T11:42:12.272397+0000","last_fullsized":"2023-10-09T11:42:12.272397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:58.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258435+0000","last_change":"2023-10-09T11:42:12.258435+0000","last_active":"2023-10-09T11:42:12.258435+0000","last_peered":"2023-10-09T11:42:12.258435+0000","last_clean":"2023-10-09T11:42:12.258435+0000","last_became_active":"2023-10-09T11:42:12.258186+0000","last_became_peered":"2023-10-09T11:42:12.258186+0000","last_unstale":"2023-10-09T11:42:12.258435+0000","last_undegraded":"2023-10-09T11:42:12.258435+0000","last_fullsized":"2023-10-09T11:42:12.258435+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:33.649527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.248728+0000","last_change":"2023-10-09T11:42:11.248217+0000","last_active":"2023-10-09T11:42:11.248728+0000","last_peered":"2023-10-09T11:42:11.248728+0000","last_clean":"2023-10-09T11:42:11.248728+0000","last_became_active":"2023-10-09T11:42:11.247978+0000","last_became_peered":"2023-10-09T11:42:11.247978+0000","last_unstale":"2023-10-09T11:42:11.248728+0000","last_undegraded":"2023-10-09T11:42:11.248728+0000","last_fullsized":"2023-10-09T11:42:11.248728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:31.968067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255349+0000","last_change":"2023-10-09T11:42:12.255349+0000","last_active":"2023-10-09T11:42:12.255349+0000","last_peered":"2023-10-09T11:42:12.255349+0000","last_clean":"2023-10-09T11:42:12.255349+0000","last_became_active":"2023-10-09T11:42:12.255134+0000","last_became_peered":"2023-10-09T11:42:12.255134+0000","last_unstale":"2023-10-09T11:42:12.255349+0000","last_undegraded":"2023-10-09T11:42:12.255349+0000","last_fullsized":"2023-10-09T11:42:12.255349+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:49.933302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258144+0000","last_change":"2023-10-09T11:42:11.257335+0000","last_active":"2023-10-09T11:42:11.258144+0000","last_peered":"2023-10-09T11:42:11.258144+0000","last_clean":"2023-10-09T11:42:11.258144+0000","last_became_active":"2023-10-09T11:42:11.255090+0000","last_became_peered":"2023-10-09T11:42:11.255090+0000","last_unstale":"2023-10-09T11:42:11.258144+0000","last_undegraded":"2023-10-09T11:42:11.258144+0000","last_fullsized":"2023-10-09T11:42:11.258144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:26.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262052+0000","last_change":"2023-10-09T11:42:12.262052+0000","last_active":"2023-10-09T11:42:12.262052+0000","last_peered":"2023-10-09T11:42:12.262052+0000","last_clean":"2023-10-09T11:42:12.262052+0000","last_became_active":"2023-10-09T11:42:12.261801+0000","last_became_peered":"2023-10-09T11:42:12.261801+0000","last_unstale":"2023-10-09T11:42:12.262052+0000","last_undegraded":"2023-10-09T11:42:12.262052+0000","last_fullsized":"2023-10-09T11:42:12.262052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:41.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.259283+0000","last_change":"2023-10-09T11:42:11.256608+0000","last_active":"2023-10-09T11:42:11.259283+0000","last_peered":"2023-10-09T11:42:11.259283+0000","last_clean":"2023-10-09T11:42:11.259283+0000","last_became_active":"2023-10-09T11:42:11.255394+0000","last_became_peered":"2023-10-09T11:42:11.255394+0000","last_unstale":"2023-10-09T11:42:11.259283+0000","last_undegraded":"2023-10-09T11:42:11.259283+0000","last_fullsized":"2023-10-09T11:42:11.259283+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:21.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.264788+0000","last_change":"2023-10-09T11:42:12.264788+0000","last_active":"2023-10-09T11:42:12.264788+0000","last_peered":"2023-10-09T11:42:12.264788+0000","last_clean":"2023-10-09T11:42:12.264788+0000","last_became_active":"2023-10-09T11:42:12.261813+0000","last_became_peered":"2023-10-09T11:42:12.261813+0000","last_unstale":"2023-10-09T11:42:12.264788+0000","last_undegraded":"2023-10-09T11:42:12.264788+0000","last_fullsized":"2023-10-09T11:42:12.264788+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:01.650318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272524+0000","last_change":"2023-10-09T11:42:11.255148+0000","last_active":"2023-10-09T11:42:12.272524+0000","last_peered":"2023-10-09T11:42:12.272524+0000","last_clean":"2023-10-09T11:42:12.272524+0000","last_became_active":"2023-10-09T11:42:11.254675+0000","last_became_peered":"2023-10-09T11:42:11.254675+0000","last_unstale":"2023-10-09T11:42:12.272524+0000","last_undegraded":"2023-10-09T11:42:12.272524+0000","last_fullsized":"2023-10-09T11:42:12.272524+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:21.572165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260110+0000","last_change":"2023-10-09T11:42:12.260110+0000","last_active":"2023-10-09T11:42:12.260110+0000","last_peered":"2023-10-09T11:42:12.260110+0000","last_clean":"2023-10-09T11:42:12.260110+0000","last_became_active":"2023-10-09T11:42:12.259722+0000","last_became_peered":"2023-10-09T11:42:12.259722+0000","last_unstale":"2023-10-09T11:42:12.260110+0000","last_undegraded":"2023-10-09T11:42:12.260110+0000","last_fullsized":"2023-10-09T11:42:12.260110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:41.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253745+0000","last_change":"2023-10-09T11:42:11.253504+0000","last_active":"2023-10-09T11:42:11.253745+0000","last_peered":"2023-10-09T11:42:11.253745+0000","last_clean":"2023-10-09T11:42:11.253745+0000","last_became_active":"2023-10-09T11:42:11.253269+0000","last_became_peered":"2023-10-09T11:42:11.253269+0000","last_unstale":"2023-10-09T11:42:11.253745+0000","last_undegraded":"2023-10-09T11:42:11.253745+0000","last_fullsized":"2023-10-09T11:42:11.253745+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:52.018572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261540+0000","last_change":"2023-10-09T11:42:12.261540+0000","last_active":"2023-10-09T11:42:12.261540+0000","last_peered":"2023-10-09T11:42:12.261540+0000","last_clean":"2023-10-09T11:42:12.261540+0000","last_became_active":"2023-10-09T11:42:12.260437+0000","last_became_peered":"2023-10-09T11:42:12.260437+0000","last_unstale":"2023-10-09T11:42:12.261540+0000","last_undegraded":"2023-10-09T11:42:12.261540+0000","last_fullsized":"2023-10-09T11:42:12.261540+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:03.494547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.260876+0000","last_change":"2023-10-09T11:42:11.260807+0000","last_active":"2023-10-09T11:42:11.260876+0000","last_peered":"2023-10-09T11:42:11.260876+0000","last_clean":"2023-10-09T11:42:11.260876+0000","last_became_active":"2023-10-09T11:42:11.259549+0000","last_became_peered":"2023-10-09T11:42:11.259549+0000","last_unstale":"2023-10-09T11:42:11.260876+0000","last_undegraded":"2023-10-09T11:42:11.260876+0000","last_fullsized":"2023-10-09T11:42:11.260876+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:33.903343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259809+0000","last_change":"2023-10-09T11:42:12.259809+0000","last_active":"2023-10-09T11:42:12.259809+0000","last_peered":"2023-10-09T11:42:12.259809+0000","last_clean":"2023-10-09T11:42:12.259809+0000","last_became_active":"2023-10-09T11:42:12.259581+0000","last_became_peered":"2023-10-09T11:42:12.259581+0000","last_unstale":"2023-10-09T11:42:12.259809+0000","last_undegraded":"2023-10-09T11:42:12.259809+0000","last_fullsized":"2023-10-09T11:42:12.259809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:22.577656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258641+0000","last_change":"2023-10-09T11:42:11.258582+0000","last_active":"2023-10-09T11:42:11.258641+0000","last_peered":"2023-10-09T11:42:11.258641+0000","last_clean":"2023-10-09T11:42:11.258641+0000","last_became_active":"2023-10-09T11:42:11.258290+0000","last_became_peered":"2023-10-09T11:42:11.258290+0000","last_unstale":"2023-10-09T11:42:11.258641+0000","last_undegraded":"2023-10-09T11:42:11.258641+0000","last_fullsized":"2023-10-09T11:42:11.258641+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:00.447758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256667+0000","last_change":"2023-10-09T11:42:12.256667+0000","last_active":"2023-10-09T11:42:12.256667+0000","last_peered":"2023-10-09T11:42:12.256667+0000","last_clean":"2023-10-09T11:42:12.256667+0000","last_became_active":"2023-10-09T11:42:12.256415+0000","last_became_peered":"2023-10-09T11:42:12.256415+0000","last_unstale":"2023-10-09T11:42:12.256667+0000","last_undegraded":"2023-10-09T11:42:12.256667+0000","last_fullsized":"2023-10-09T11:42:12.256667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:16.329498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.255854+0000","last_change":"2023-10-09T11:42:11.255781+0000","last_active":"2023-10-09T11:42:11.255854+0000","last_peered":"2023-10-09T11:42:11.255854+0000","last_clean":"2023-10-09T11:42:11.255854+0000","last_became_active":"2023-10-09T11:42:11.255541+0000","last_became_peered":"2023-10-09T11:42:11.255541+0000","last_unstale":"2023-10-09T11:42:11.255854+0000","last_undegraded":"2023-10-09T11:42:11.255854+0000","last_fullsized":"2023-10-09T11:42:11.255854+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.418224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255244+0000","last_change":"2023-10-09T11:42:12.255244+0000","last_active":"2023-10-09T11:42:12.255244+0000","last_peered":"2023-10-09T11:42:12.255244+0000","last_clean":"2023-10-09T11:42:12.255244+0000","last_became_active":"2023-10-09T11:42:12.255006+0000","last_became_peered":"2023-10-09T11:42:12.255006+0000","last_unstale":"2023-10-09T11:42:12.255244+0000","last_undegraded":"2023-10-09T11:42:12.255244+0000","last_fullsized":"2023-10-09T11:42:12.255244+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:19.583147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253697+0000","last_change":"2023-10-09T11:42:11.253144+0000","last_active":"2023-10-09T11:42:11.253697+0000","last_peered":"2023-10-09T11:42:11.253697+0000","last_clean":"2023-10-09T11:42:11.253697+0000","last_became_active":"2023-10-09T11:42:11.252651+0000","last_became_peered":"2023-10-09T11:42:11.252651+0000","last_unstale":"2023-10-09T11:42:11.253697+0000","last_undegraded":"2023-10-09T11:42:11.253697+0000","last_fullsized":"2023-10-09T11:42:11.253697+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:34.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261811+0000","last_change":"2023-10-09T11:42:12.261811+0000","last_active":"2023-10-09T11:42:12.261811+0000","last_peered":"2023-10-09T11:42:12.261811+0000","last_clean":"2023-10-09T11:42:12.261811+0000","last_became_active":"2023-10-09T11:42:12.260880+0000","last_became_peered":"2023-10-09T11:42:12.260880+0000","last_unstale":"2023-10-09T11:42:12.261811+0000","last_undegraded":"2023-10-09T11:42:12.261811+0000","last_fullsized":"2023-10-09T11:42:12.261811+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.250508+0000","last_change":"2023-10-09T11:42:11.250389+0000","last_active":"2023-10-09T11:42:11.250508+0000","last_peered":"2023-10-09T11:42:11.250508+0000","last_clean":"2023-10-09T11:42:11.250508+0000","last_became_active":"2023-10-09T11:42:11.250129+0000","last_became_peered":"2023-10-09T11:42:11.250129+0000","last_unstale":"2023-10-09T11:42:11.250508+0000","last_undegraded":"2023-10-09T11:42:11.250508+0000","last_fullsized":"2023-10-09T11:42:11.250508+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:55.913081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257527+0000","last_change":"2023-10-09T11:42:12.257527+0000","last_active":"2023-10-09T11:42:12.257527+0000","last_peered":"2023-10-09T11:42:12.257527+0000","last_clean":"2023-10-09T11:42:12.257527+0000","last_became_active":"2023-10-09T11:42:12.257213+0000","last_became_peered":"2023-10-09T11:42:12.257213+0000","last_unstale":"2023-10-09T11:42:12.257527+0000","last_undegraded":"2023-10-09T11:42:12.257527+0000","last_fullsized":"2023-10-09T11:42:12.257527+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:27.767940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.261008+0000","last_change":"2023-10-09T11:42:11.260953+0000","last_active":"2023-10-09T11:42:11.261008+0000","last_peered":"2023-10-09T11:42:11.261008+0000","last_clean":"2023-10-09T11:42:11.261008+0000","last_became_active":"2023-10-09T11:42:11.259858+0000","last_became_peered":"2023-10-09T11:42:11.259858+0000","last_unstale":"2023-10-09T11:42:11.261008+0000","last_undegraded":"2023-10-09T11:42:11.261008+0000","last_fullsized":"2023-10-09T11:42:11.261008+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:31.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260191+0000","last_change":"2023-10-09T11:42:12.260191+0000","last_active":"2023-10-09T11:42:12.260191+0000","last_peered":"2023-10-09T11:42:12.260191+0000","last_clean":"2023-10-09T11:42:12.260191+0000","last_became_active":"2023-10-09T11:42:12.259815+0000","last_became_peered":"2023-10-09T11:42:12.259815+0000","last_unstale":"2023-10-09T11:42:12.260191+0000","last_undegraded":"2023-10-09T11:42:12.260191+0000","last_fullsized":"2023-10-09T11:42:12.260191+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253013+0000","last_change":"2023-10-09T11:42:11.252422+0000","last_active":"2023-10-09T11:42:11.253013+0000","last_peered":"2023-10-09T11:42:11.253013+0000","last_clean":"2023-10-09T11:42:11.253013+0000","last_became_active":"2023-10-09T11:42:11.251921+0000","last_became_peered":"2023-10-09T11:42:11.251921+0000","last_unstale":"2023-10-09T11:42:11.253013+0000","last_undegraded":"2023-10-09T11:42:11.253013+0000","last_fullsized":"2023-10-09T11:42:11.253013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:29.521111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":253,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.255915+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:42:11.255915+0000","last_peered":"2023-10-09T11:42:11.255915+0000","last_clean":"2023-10-09T11:42:11.255915+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:42:11.255915+0000","last_undegraded":"2023-10-09T11:42:11.255915+0000","last_fullsized":"2023-10-09T11:42:11.255915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1268,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194043,"statfs":{"total":200000000,"available":198700551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.745},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.79200000000000004,"15min":0.878},"last":0.505}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69999999999999996,"5min":0.72699999999999998,"15min":0.88900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.90200000000000002},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":1.048},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.079},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.42899999999999999},"min":{"1min":0.33400000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.87,"15min":0.92700000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291437,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53500000000000003,"15min":0.61599999999999999},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":3.7589999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.376}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.67400000000000004},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72999999999999998,"5min":0.77900000000000003,"15min":5.298},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64800000000000002,"5min":0.73399999999999999,"15min":5.3540000000000001},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":1.6060000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":1.617},"last":0.434}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":5.46},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":5.3949999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.80600000000000005},"last":1.617},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76000000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64700000000000002,"5min":0.72599999999999998,"15min":0.80000000000000004},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":4.0339999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.40200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":692,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34200000000000003,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46700000000000003,"5min":0.623,"15min":1.9370000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.37,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.66500000000000004,"15min":2.004},"last":0.28699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.501,"5min":0.64000000000000001,"15min":2.2589999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40799999999999997,"15min":0.40899999999999997},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57299999999999995,"5min":0.77000000000000002,"15min":1.909},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41399999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51000000000000001,"5min":0.78200000000000003,"15min":2.0369999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":0.872,"15min":1.869},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.93000000000000005,"15min":1.9790000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.91400000000000003,"15min":2.1960000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.66000000000000003},"min":{"1min":0.46000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":1.952},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.94999999999999996,"15min":2.2280000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.86299999999999999,"15min":1.782},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":1.819},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194051,"statfs":{"total":200000000,"available":198708913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45000000000000001,"15min":0.41499999999999998},"min":{"1min":0.23899999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22},"max":{"1min":0.53300000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.309}]},{"osd":2,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.223},"max":{"1min":0.63400000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.376},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42199999999999999,"15min":0.5},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55900000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":2.194,"15min":2.194},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.86799999999999999,"5min":1.508,"15min":1.508},"last":0.439},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85499999999999998,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63400000000000001,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":2.379,"15min":3.976},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.93300000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.95999999999999996,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.593,"15min":1.593},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68899999999999995,"15min":0.76700000000000002},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.91600000000000004,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36699999999999999,"15min":0.32600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.622,"15min":0.622},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38400000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.61899999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41699999999999998,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":11.055},"last":0.315}]},{"osd":3,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.39900000000000002},"min":{"1min":0.307,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.627,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.999,"15min":0.999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.96499999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93100000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199289901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.442,"5min":0.64800000000000002,"15min":1.3069999999999999},"last":0.254},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.55400000000000005,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51100000000000001,"5min":0.57399999999999995,"15min":1.034},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.72899999999999998,"15min":1.335},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.68999999999999995,"15min":1.1200000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61399999999999999,"5min":0.69499999999999995,"15min":1.405},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73599999999999999,"5min":0.91100000000000003,"15min":0.98399999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":1.387,"15min":1.387},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.96399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.3819999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":1.0109999999999999},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54600000000000004,"15min":0.73699999999999999},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":7.4210000000000003},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":5.274},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.80400000000000005},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":7.5460000000000003},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":692,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199290931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":1.2729999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.379,"5min":0.31,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.751,"15min":0.75600000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":1.1839999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.67900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.745}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68600000000000005,"5min":0.84199999999999997,"15min":0.96399999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.86899999999999999,"15min":0.98899999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.88500000000000001},"last":0.441}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.747,"15min":0.78000000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.43099999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81499999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.81499999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T11:42:16.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:42:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.522+0000 7ff61258d700 1 Processor -- start 2023-10-09T11:42:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.522+0000 7ff61258d700 1 -- start start 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff61258d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff60c157ca0 0x7ff60c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff61258d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0d07c0 con 0x7ff60c1578d0 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff61258d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0cfbb0 con 0x7ff60c06d120 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff61258d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0cfe90 con 0x7ff60c157ca0 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff60b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff60c157ca0 0x7ff60c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff60bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff60c1578d0 0x7ff60c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42320/0 (socket says 172.21.15.6:42320) 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff60b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff60c157ca0 0x7ff60c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54210/0 (socket says 172.21.15.6:54210) 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.523+0000 7ff60bfff700 1 -- 172.21.15.6:0/3005228063 learned_addr learned my addr 172.21.15.6:0/3005228063 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3005228063 >> v1:172.21.15.118:6789/0 conn(0x7ff60c06d120 legacy=0x7ff60c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3005228063 >> v1:172.21.15.6:6789/0 conn(0x7ff60c1578d0 legacy=0x7ff60c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3005228063 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0d0170 con 0x7ff60c157ca0 2023-10-09T11:42:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60b7fe700 1 --2- 172.21.15.6:0/3005228063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c157ca0 0x7ff60c0cf4f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0098e0 tx=0x7ff5fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4630ad27b2ae9283 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60affd700 1 -- 172.21.15.6:0/3005228063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc009e80 con 0x7ff60c157ca0 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60affd700 1 -- 172.21.15.6:0/3005228063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00b820 con 0x7ff60c157ca0 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.524+0000 7ff60affd700 1 -- 172.21.15.6:0/3005228063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bba0 con 0x7ff60c157ca0 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 -- 172.21.15.6:0/3005228063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c157ca0 msgr2=0x7ff60c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 --2- 172.21.15.6:0/3005228063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c157ca0 0x7ff60c0cf4f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0098e0 tx=0x7ff5fc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 -- 172.21.15.6:0/3005228063 shutdown_connections 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 --2- 172.21.15.6:0/3005228063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c157ca0 0x7ff60c0cf4f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 -- 172.21.15.6:0/3005228063 >> 172.21.15.6:0/3005228063 conn(0x7ff60c06bb90 msgr2=0x7ff60c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 -- 172.21.15.6:0/3005228063 shutdown_connections 2023-10-09T11:42:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.525+0000 7ff61258d700 1 -- 172.21.15.6:0/3005228063 wait complete. 2023-10-09T11:42:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.526+0000 7ff61258d700 1 Processor -- start 2023-10-09T11:42:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.526+0000 7ff61258d700 1 -- start start 2023-10-09T11:42:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff60c06d120 0x7ff60c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff60c157ca0 0x7ff60c1467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1450c0 con 0x7ff60c1578d0 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1444b0 con 0x7ff60c06d120 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff61258d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c144790 con 0x7ff60c157ca0 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54216/0 (socket says 172.21.15.6:54216) 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3271548230 learned_addr learned my addr 172.21.15.6:0/3271548230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60bfff700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff60c06d120 0x7ff60c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff610b2a700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff60c157ca0 0x7ff60c1467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff60c157ca0 msgr2=0x7ff60c1467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff60c157ca0 0x7ff60c1467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff60c06d120 msgr2=0x7ff60c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff60c06d120 0x7ff60c1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 -- 172.21.15.6:0/3271548230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009420 con 0x7ff60c1578d0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff60b7fe700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0030c0 tx=0x7ff5fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.527+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00b990 con 0x7ff60c1578d0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.528+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc020070 con 0x7ff60c1578d0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.528+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c144a70 con 0x7ff60c1578d0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.528+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc01b450 con 0x7ff60c1578d0 2023-10-09T11:42:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.528+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c143ca0 con 0x7ff60c1578d0 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.528+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c145230 con 0x7ff60c1578d0 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.529+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5fc022030 con 0x7ff60c1578d0 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.529+0000 7ff603fff700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 0x7ff5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.529+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5fc086370 con 0x7ff60c1578d0 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.529+0000 7ff60bfff700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 0x7ff5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.530+0000 7ff60bfff700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 0x7ff5ec0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4007130 tx=0x7ff5f4007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.534+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5fc0535e0 con 0x7ff60c1578d0 2023-10-09T11:42:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.723+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff60c145200 con 0x7ff5ec066f30 2023-10-09T11:42:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.731+0000 7ff603fff700 1 -- 172.21.15.6:0/3271548230 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285653 (secure 0 0 0) 0x7ff60c145200 con 0x7ff5ec066f30 2023-10-09T11:42:16.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 msgr2=0x7ff5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 0x7ff5ec0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4007130 tx=0x7ff5f4007eb0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 msgr2=0x7ff60c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0030c0 tx=0x7ff5fc016000 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 shutdown_connections 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5ec066f30 0x7ff5ec0693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff60c157ca0 0x7ff60c1467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff60c06d120 0x7ff60c1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 --2- 172.21.15.6:0/3271548230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff60c1578d0 0x7ff60c0b6150 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 >> 172.21.15.6:0/3271548230 conn(0x7ff60c06bb90 msgr2=0x7ff60c069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 shutdown_connections 2023-10-09T11:42:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.735+0000 7ff61258d700 1 -- 172.21.15.6:0/3271548230 wait complete. 2023-10-09T11:42:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:42:16.747 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-10-09T11:42:16.225291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555816,"statfs":{"total":1600000000,"available":1593156130,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.984634"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259596+0000","last_change":"2023-10-09T11:42:12.259596+0000","last_active":"2023-10-09T11:42:12.259596+0000","last_peered":"2023-10-09T11:42:12.259596+0000","last_clean":"2023-10-09T11:42:12.259596+0000","last_became_active":"2023-10-09T11:42:12.258681+0000","last_became_peered":"2023-10-09T11:42:12.258681+0000","last_unstale":"2023-10-09T11:42:12.259596+0000","last_undegraded":"2023-10-09T11:42:12.259596+0000","last_fullsized":"2023-10-09T11:42:12.259596+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.263308+0000","last_change":"2023-10-09T11:42:12.263308+0000","last_active":"2023-10-09T11:42:12.263308+0000","last_peered":"2023-10-09T11:42:12.263308+0000","last_clean":"2023-10-09T11:42:12.263308+0000","last_became_active":"2023-10-09T11:42:12.262840+0000","last_became_peered":"2023-10-09T11:42:12.262840+0000","last_unstale":"2023-10-09T11:42:12.263308+0000","last_undegraded":"2023-10-09T11:42:12.263308+0000","last_fullsized":"2023-10-09T11:42:12.263308+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:37.822960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254188+0000","last_change":"2023-10-09T11:42:12.254188+0000","last_active":"2023-10-09T11:42:12.254188+0000","last_peered":"2023-10-09T11:42:12.254188+0000","last_clean":"2023-10-09T11:42:12.254188+0000","last_became_active":"2023-10-09T11:42:12.253768+0000","last_became_peered":"2023-10-09T11:42:12.253768+0000","last_unstale":"2023-10-09T11:42:12.254188+0000","last_undegraded":"2023-10-09T11:42:12.254188+0000","last_fullsized":"2023-10-09T11:42:12.254188+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:01.115578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258586+0000","last_change":"2023-10-09T11:42:12.258586+0000","last_active":"2023-10-09T11:42:12.258586+0000","last_peered":"2023-10-09T11:42:12.258586+0000","last_clean":"2023-10-09T11:42:12.258586+0000","last_became_active":"2023-10-09T11:42:12.258226+0000","last_became_peered":"2023-10-09T11:42:12.258226+0000","last_unstale":"2023-10-09T11:42:12.258586+0000","last_undegraded":"2023-10-09T11:42:12.258586+0000","last_fullsized":"2023-10-09T11:42:12.258586+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:48.322830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255664+0000","last_change":"2023-10-09T11:42:12.255664+0000","last_active":"2023-10-09T11:42:12.255664+0000","last_peered":"2023-10-09T11:42:12.255664+0000","last_clean":"2023-10-09T11:42:12.255664+0000","last_became_active":"2023-10-09T11:42:12.255392+0000","last_became_peered":"2023-10-09T11:42:12.255392+0000","last_unstale":"2023-10-09T11:42:12.255664+0000","last_undegraded":"2023-10-09T11:42:12.255664+0000","last_fullsized":"2023-10-09T11:42:12.255664+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:50.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256245+0000","last_change":"2023-10-09T11:42:12.256245+0000","last_active":"2023-10-09T11:42:12.256245+0000","last_peered":"2023-10-09T11:42:12.256245+0000","last_clean":"2023-10-09T11:42:12.256245+0000","last_became_active":"2023-10-09T11:42:12.255682+0000","last_became_peered":"2023-10-09T11:42:12.255682+0000","last_unstale":"2023-10-09T11:42:12.256245+0000","last_undegraded":"2023-10-09T11:42:12.256245+0000","last_fullsized":"2023-10-09T11:42:12.256245+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:08:07.798608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255819+0000","last_change":"2023-10-09T11:42:12.255819+0000","last_active":"2023-10-09T11:42:12.255819+0000","last_peered":"2023-10-09T11:42:12.255819+0000","last_clean":"2023-10-09T11:42:12.255819+0000","last_became_active":"2023-10-09T11:42:12.255587+0000","last_became_peered":"2023-10-09T11:42:12.255587+0000","last_unstale":"2023-10-09T11:42:12.255819+0000","last_undegraded":"2023-10-09T11:42:12.255819+0000","last_fullsized":"2023-10-09T11:42:12.255819+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:43.635511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256246+0000","last_change":"2023-10-09T11:42:12.256246+0000","last_active":"2023-10-09T11:42:12.256246+0000","last_peered":"2023-10-09T11:42:12.256246+0000","last_clean":"2023-10-09T11:42:12.256246+0000","last_became_active":"2023-10-09T11:42:12.255903+0000","last_became_peered":"2023-10-09T11:42:12.255903+0000","last_unstale":"2023-10-09T11:42:12.256246+0000","last_undegraded":"2023-10-09T11:42:12.256246+0000","last_fullsized":"2023-10-09T11:42:12.256246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259238+0000","last_change":"2023-10-09T11:42:12.259238+0000","last_active":"2023-10-09T11:42:12.259238+0000","last_peered":"2023-10-09T11:42:12.259238+0000","last_clean":"2023-10-09T11:42:12.259238+0000","last_became_active":"2023-10-09T11:42:12.258980+0000","last_became_peered":"2023-10-09T11:42:12.258980+0000","last_unstale":"2023-10-09T11:42:12.259238+0000","last_undegraded":"2023-10-09T11:42:12.259238+0000","last_fullsized":"2023-10-09T11:42:12.259238+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:54.930691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261700+0000","last_change":"2023-10-09T11:42:12.261700+0000","last_active":"2023-10-09T11:42:12.261700+0000","last_peered":"2023-10-09T11:42:12.261700+0000","last_clean":"2023-10-09T11:42:12.261700+0000","last_became_active":"2023-10-09T11:42:12.260689+0000","last_became_peered":"2023-10-09T11:42:12.260689+0000","last_unstale":"2023-10-09T11:42:12.261700+0000","last_undegraded":"2023-10-09T11:42:12.261700+0000","last_fullsized":"2023-10-09T11:42:12.261700+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:18.080127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259727+0000","last_change":"2023-10-09T11:42:12.259727+0000","last_active":"2023-10-09T11:42:12.259727+0000","last_peered":"2023-10-09T11:42:12.259727+0000","last_clean":"2023-10-09T11:42:12.259727+0000","last_became_active":"2023-10-09T11:42:12.259310+0000","last_became_peered":"2023-10-09T11:42:12.259310+0000","last_unstale":"2023-10-09T11:42:12.259727+0000","last_undegraded":"2023-10-09T11:42:12.259727+0000","last_fullsized":"2023-10-09T11:42:12.259727+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:15.624102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259975+0000","last_change":"2023-10-09T11:42:12.259975+0000","last_active":"2023-10-09T11:42:12.259975+0000","last_peered":"2023-10-09T11:42:12.259975+0000","last_clean":"2023-10-09T11:42:12.259975+0000","last_became_active":"2023-10-09T11:42:12.259435+0000","last_became_peered":"2023-10-09T11:42:12.259435+0000","last_unstale":"2023-10-09T11:42:12.259975+0000","last_undegraded":"2023-10-09T11:42:12.259975+0000","last_fullsized":"2023-10-09T11:42:12.259975+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254744+0000","last_change":"2023-10-09T11:42:12.254744+0000","last_active":"2023-10-09T11:42:12.254744+0000","last_peered":"2023-10-09T11:42:12.254744+0000","last_clean":"2023-10-09T11:42:12.254744+0000","last_became_active":"2023-10-09T11:42:12.254498+0000","last_became_peered":"2023-10-09T11:42:12.254498+0000","last_unstale":"2023-10-09T11:42:12.254744+0000","last_undegraded":"2023-10-09T11:42:12.254744+0000","last_fullsized":"2023-10-09T11:42:12.254744+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:17:57.902859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261961+0000","last_change":"2023-10-09T11:42:12.261961+0000","last_active":"2023-10-09T11:42:12.261961+0000","last_peered":"2023-10-09T11:42:12.261961+0000","last_clean":"2023-10-09T11:42:12.261961+0000","last_became_active":"2023-10-09T11:42:12.261177+0000","last_became_peered":"2023-10-09T11:42:12.261177+0000","last_unstale":"2023-10-09T11:42:12.261961+0000","last_undegraded":"2023-10-09T11:42:12.261961+0000","last_fullsized":"2023-10-09T11:42:12.261961+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255335+0000","last_change":"2023-10-09T11:42:12.255335+0000","last_active":"2023-10-09T11:42:12.255335+0000","last_peered":"2023-10-09T11:42:12.255335+0000","last_clean":"2023-10-09T11:42:12.255335+0000","last_became_active":"2023-10-09T11:42:12.255113+0000","last_became_peered":"2023-10-09T11:42:12.255113+0000","last_unstale":"2023-10-09T11:42:12.255335+0000","last_undegraded":"2023-10-09T11:42:12.255335+0000","last_fullsized":"2023-10-09T11:42:12.255335+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:54.342939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260946+0000","last_change":"2023-10-09T11:42:12.260946+0000","last_active":"2023-10-09T11:42:12.260946+0000","last_peered":"2023-10-09T11:42:12.260946+0000","last_clean":"2023-10-09T11:42:12.260946+0000","last_became_active":"2023-10-09T11:42:12.260706+0000","last_became_peered":"2023-10-09T11:42:12.260706+0000","last_unstale":"2023-10-09T11:42:12.260946+0000","last_undegraded":"2023-10-09T11:42:12.260946+0000","last_fullsized":"2023-10-09T11:42:12.260946+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256543+0000","last_change":"2023-10-09T11:42:12.256543+0000","last_active":"2023-10-09T11:42:12.256543+0000","last_peered":"2023-10-09T11:42:12.256543+0000","last_clean":"2023-10-09T11:42:12.256543+0000","last_became_active":"2023-10-09T11:42:12.256132+0000","last_became_peered":"2023-10-09T11:42:12.256132+0000","last_unstale":"2023-10-09T11:42:12.256543+0000","last_undegraded":"2023-10-09T11:42:12.256543+0000","last_fullsized":"2023-10-09T11:42:12.256543+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:39:43.635511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.265026+0000","last_change":"2023-10-09T11:42:12.265026+0000","last_active":"2023-10-09T11:42:12.265026+0000","last_peered":"2023-10-09T11:42:12.265026+0000","last_clean":"2023-10-09T11:42:12.265026+0000","last_became_active":"2023-10-09T11:42:12.262156+0000","last_became_peered":"2023-10-09T11:42:12.262156+0000","last_unstale":"2023-10-09T11:42:12.265026+0000","last_undegraded":"2023-10-09T11:42:12.265026+0000","last_fullsized":"2023-10-09T11:42:12.265026+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.488955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262276+0000","last_change":"2023-10-09T11:42:12.262276+0000","last_active":"2023-10-09T11:42:12.262276+0000","last_peered":"2023-10-09T11:42:12.262276+0000","last_clean":"2023-10-09T11:42:12.262276+0000","last_became_active":"2023-10-09T11:42:12.261477+0000","last_became_peered":"2023-10-09T11:42:12.261477+0000","last_unstale":"2023-10-09T11:42:12.262276+0000","last_undegraded":"2023-10-09T11:42:12.262276+0000","last_fullsized":"2023-10-09T11:42:12.262276+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255326+0000","last_change":"2023-10-09T11:42:12.255326+0000","last_active":"2023-10-09T11:42:12.255326+0000","last_peered":"2023-10-09T11:42:12.255326+0000","last_clean":"2023-10-09T11:42:12.255326+0000","last_became_active":"2023-10-09T11:42:12.254738+0000","last_became_peered":"2023-10-09T11:42:12.254738+0000","last_unstale":"2023-10-09T11:42:12.255326+0000","last_undegraded":"2023-10-09T11:42:12.255326+0000","last_fullsized":"2023-10-09T11:42:12.255326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:22.121824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259569+0000","last_change":"2023-10-09T11:42:12.259569+0000","last_active":"2023-10-09T11:42:12.259569+0000","last_peered":"2023-10-09T11:42:12.259569+0000","last_clean":"2023-10-09T11:42:12.259569+0000","last_became_active":"2023-10-09T11:42:12.258939+0000","last_became_peered":"2023-10-09T11:42:12.258939+0000","last_unstale":"2023-10-09T11:42:12.259569+0000","last_undegraded":"2023-10-09T11:42:12.259569+0000","last_fullsized":"2023-10-09T11:42:12.259569+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:18.679916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258532+0000","last_change":"2023-10-09T11:42:12.258532+0000","last_active":"2023-10-09T11:42:12.258532+0000","last_peered":"2023-10-09T11:42:12.258532+0000","last_clean":"2023-10-09T11:42:12.258532+0000","last_became_active":"2023-10-09T11:42:12.258210+0000","last_became_peered":"2023-10-09T11:42:12.258210+0000","last_unstale":"2023-10-09T11:42:12.258532+0000","last_undegraded":"2023-10-09T11:42:12.258532+0000","last_fullsized":"2023-10-09T11:42:12.258532+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256570+0000","last_change":"2023-10-09T11:42:12.256570+0000","last_active":"2023-10-09T11:42:12.256570+0000","last_peered":"2023-10-09T11:42:12.256570+0000","last_clean":"2023-10-09T11:42:12.256570+0000","last_became_active":"2023-10-09T11:42:12.255399+0000","last_became_peered":"2023-10-09T11:42:12.255399+0000","last_unstale":"2023-10-09T11:42:12.256570+0000","last_undegraded":"2023-10-09T11:42:12.256570+0000","last_fullsized":"2023-10-09T11:42:12.256570+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:34.908835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260935+0000","last_change":"2023-10-09T11:42:12.260935+0000","last_active":"2023-10-09T11:42:12.260935+0000","last_peered":"2023-10-09T11:42:12.260935+0000","last_clean":"2023-10-09T11:42:12.260935+0000","last_became_active":"2023-10-09T11:42:12.260709+0000","last_became_peered":"2023-10-09T11:42:12.260709+0000","last_unstale":"2023-10-09T11:42:12.260935+0000","last_undegraded":"2023-10-09T11:42:12.260935+0000","last_fullsized":"2023-10-09T11:42:12.260935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255791+0000","last_change":"2023-10-09T11:42:12.255791+0000","last_active":"2023-10-09T11:42:12.255791+0000","last_peered":"2023-10-09T11:42:12.255791+0000","last_clean":"2023-10-09T11:42:12.255791+0000","last_became_active":"2023-10-09T11:42:12.255090+0000","last_became_peered":"2023-10-09T11:42:12.255090+0000","last_unstale":"2023-10-09T11:42:12.255791+0000","last_undegraded":"2023-10-09T11:42:12.255791+0000","last_fullsized":"2023-10-09T11:42:12.255791+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:41.483239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259749+0000","last_change":"2023-10-09T11:42:12.259749+0000","last_active":"2023-10-09T11:42:12.259749+0000","last_peered":"2023-10-09T11:42:12.259749+0000","last_clean":"2023-10-09T11:42:12.259749+0000","last_became_active":"2023-10-09T11:42:12.258982+0000","last_became_peered":"2023-10-09T11:42:12.258982+0000","last_unstale":"2023-10-09T11:42:12.259749+0000","last_undegraded":"2023-10-09T11:42:12.259749+0000","last_fullsized":"2023-10-09T11:42:12.259749+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261246+0000","last_change":"2023-10-09T11:42:12.261246+0000","last_active":"2023-10-09T11:42:12.261246+0000","last_peered":"2023-10-09T11:42:12.261246+0000","last_clean":"2023-10-09T11:42:12.261246+0000","last_became_active":"2023-10-09T11:42:12.261018+0000","last_became_peered":"2023-10-09T11:42:12.261018+0000","last_unstale":"2023-10-09T11:42:12.261246+0000","last_undegraded":"2023-10-09T11:42:12.261246+0000","last_fullsized":"2023-10-09T11:42:12.261246+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:15.199560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260036+0000","last_change":"2023-10-09T11:42:12.260036+0000","last_active":"2023-10-09T11:42:12.260036+0000","last_peered":"2023-10-09T11:42:12.260036+0000","last_clean":"2023-10-09T11:42:12.260036+0000","last_became_active":"2023-10-09T11:42:12.259508+0000","last_became_peered":"2023-10-09T11:42:12.259508+0000","last_unstale":"2023-10-09T11:42:12.260036+0000","last_undegraded":"2023-10-09T11:42:12.260036+0000","last_fullsized":"2023-10-09T11:42:12.260036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:00:15.640726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262342+0000","last_change":"2023-10-09T11:42:12.262342+0000","last_active":"2023-10-09T11:42:12.262342+0000","last_peered":"2023-10-09T11:42:12.262342+0000","last_clean":"2023-10-09T11:42:12.262342+0000","last_became_active":"2023-10-09T11:42:12.261881+0000","last_became_peered":"2023-10-09T11:42:12.261881+0000","last_unstale":"2023-10-09T11:42:12.262342+0000","last_undegraded":"2023-10-09T11:42:12.262342+0000","last_fullsized":"2023-10-09T11:42:12.262342+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:56.958340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255341+0000","last_change":"2023-10-09T11:42:12.255341+0000","last_active":"2023-10-09T11:42:12.255341+0000","last_peered":"2023-10-09T11:42:12.255341+0000","last_clean":"2023-10-09T11:42:12.255341+0000","last_became_active":"2023-10-09T11:42:12.255069+0000","last_became_peered":"2023-10-09T11:42:12.255069+0000","last_unstale":"2023-10-09T11:42:12.255341+0000","last_undegraded":"2023-10-09T11:42:12.255341+0000","last_fullsized":"2023-10-09T11:42:12.255341+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:16.907311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259903+0000","last_change":"2023-10-09T11:42:12.259903+0000","last_active":"2023-10-09T11:42:12.259903+0000","last_peered":"2023-10-09T11:42:12.259903+0000","last_clean":"2023-10-09T11:42:12.259903+0000","last_became_active":"2023-10-09T11:42:12.259320+0000","last_became_peered":"2023-10-09T11:42:12.259320+0000","last_unstale":"2023-10-09T11:42:12.259903+0000","last_undegraded":"2023-10-09T11:42:12.259903+0000","last_fullsized":"2023-10-09T11:42:12.259903+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:25.118425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257996+0000","last_change":"2023-10-09T11:42:12.257996+0000","last_active":"2023-10-09T11:42:12.257996+0000","last_peered":"2023-10-09T11:42:12.257996+0000","last_clean":"2023-10-09T11:42:12.257996+0000","last_became_active":"2023-10-09T11:42:12.257723+0000","last_became_peered":"2023-10-09T11:42:12.257723+0000","last_unstale":"2023-10-09T11:42:12.257996+0000","last_undegraded":"2023-10-09T11:42:12.257996+0000","last_fullsized":"2023-10-09T11:42:12.257996+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:23:51.879121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.250201+0000","last_change":"2023-10-09T11:42:12.250201+0000","last_active":"2023-10-09T11:42:12.250201+0000","last_peered":"2023-10-09T11:42:12.250201+0000","last_clean":"2023-10-09T11:42:12.250201+0000","last_became_active":"2023-10-09T11:42:12.249900+0000","last_became_peered":"2023-10-09T11:42:12.249900+0000","last_unstale":"2023-10-09T11:42:12.250201+0000","last_undegraded":"2023-10-09T11:42:12.250201+0000","last_fullsized":"2023-10-09T11:42:12.250201+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:09:47.611984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"129'4","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.269903+0000","last_change":"2023-10-09T11:42:11.256208+0000","last_active":"2023-10-09T11:42:12.269903+0000","last_peered":"2023-10-09T11:42:12.269903+0000","last_clean":"2023-10-09T11:42:12.269903+0000","last_became_active":"2023-10-09T11:42:11.255999+0000","last_became_peered":"2023-10-09T11:42:11.255999+0000","last_unstale":"2023-10-09T11:42:12.269903+0000","last_undegraded":"2023-10-09T11:42:12.269903+0000","last_fullsized":"2023-10-09T11:42:12.269903+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:27:48.554756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258475+0000","last_change":"2023-10-09T11:42:12.258475+0000","last_active":"2023-10-09T11:42:12.258475+0000","last_peered":"2023-10-09T11:42:12.258475+0000","last_clean":"2023-10-09T11:42:12.258475+0000","last_became_active":"2023-10-09T11:42:12.258253+0000","last_became_peered":"2023-10-09T11:42:12.258253+0000","last_unstale":"2023-10-09T11:42:12.258475+0000","last_undegraded":"2023-10-09T11:42:12.258475+0000","last_fullsized":"2023-10-09T11:42:12.258475+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:37.822960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258672+0000","last_change":"2023-10-09T11:42:11.257658+0000","last_active":"2023-10-09T11:42:12.258672+0000","last_peered":"2023-10-09T11:42:12.258672+0000","last_clean":"2023-10-09T11:42:12.258672+0000","last_became_active":"2023-10-09T11:42:11.257213+0000","last_became_peered":"2023-10-09T11:42:11.257213+0000","last_unstale":"2023-10-09T11:42:12.258672+0000","last_undegraded":"2023-10-09T11:42:12.258672+0000","last_fullsized":"2023-10-09T11:42:12.258672+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:36.817468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256390+0000","last_change":"2023-10-09T11:42:12.256390+0000","last_active":"2023-10-09T11:42:12.256390+0000","last_peered":"2023-10-09T11:42:12.256390+0000","last_clean":"2023-10-09T11:42:12.256390+0000","last_became_active":"2023-10-09T11:42:12.256009+0000","last_became_peered":"2023-10-09T11:42:12.256009+0000","last_unstale":"2023-10-09T11:42:12.256390+0000","last_undegraded":"2023-10-09T11:42:12.256390+0000","last_fullsized":"2023-10-09T11:42:12.256390+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:42:33.290021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272149+0000","last_change":"2023-10-09T11:42:11.251107+0000","last_active":"2023-10-09T11:42:12.272149+0000","last_peered":"2023-10-09T11:42:12.272149+0000","last_clean":"2023-10-09T11:42:12.272149+0000","last_became_active":"2023-10-09T11:42:11.249923+0000","last_became_peered":"2023-10-09T11:42:11.249923+0000","last_unstale":"2023-10-09T11:42:12.272149+0000","last_undegraded":"2023-10-09T11:42:12.272149+0000","last_fullsized":"2023-10-09T11:42:12.272149+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:31.091666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257295+0000","last_change":"2023-10-09T11:42:12.257295+0000","last_active":"2023-10-09T11:42:12.257295+0000","last_peered":"2023-10-09T11:42:12.257295+0000","last_clean":"2023-10-09T11:42:12.257295+0000","last_became_active":"2023-10-09T11:42:12.257095+0000","last_became_peered":"2023-10-09T11:42:12.257095+0000","last_unstale":"2023-10-09T11:42:12.257295+0000","last_undegraded":"2023-10-09T11:42:12.257295+0000","last_fullsized":"2023-10-09T11:42:12.257295+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:53.844738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272111+0000","last_change":"2023-10-09T11:42:11.253238+0000","last_active":"2023-10-09T11:42:12.272111+0000","last_peered":"2023-10-09T11:42:12.272111+0000","last_clean":"2023-10-09T11:42:12.272111+0000","last_became_active":"2023-10-09T11:42:11.252581+0000","last_became_peered":"2023-10-09T11:42:11.252581+0000","last_unstale":"2023-10-09T11:42:12.272111+0000","last_undegraded":"2023-10-09T11:42:12.272111+0000","last_fullsized":"2023-10-09T11:42:12.272111+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:44.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259846+0000","last_change":"2023-10-09T11:42:12.259846+0000","last_active":"2023-10-09T11:42:12.259846+0000","last_peered":"2023-10-09T11:42:12.259846+0000","last_clean":"2023-10-09T11:42:12.259846+0000","last_became_active":"2023-10-09T11:42:12.259612+0000","last_became_peered":"2023-10-09T11:42:12.259612+0000","last_unstale":"2023-10-09T11:42:12.259846+0000","last_undegraded":"2023-10-09T11:42:12.259846+0000","last_fullsized":"2023-10-09T11:42:12.259846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:04.099641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.248914+0000","last_change":"2023-10-09T11:42:11.251676+0000","last_active":"2023-10-09T11:42:12.248914+0000","last_peered":"2023-10-09T11:42:12.248914+0000","last_clean":"2023-10-09T11:42:12.248914+0000","last_became_active":"2023-10-09T11:42:11.251234+0000","last_became_peered":"2023-10-09T11:42:11.251234+0000","last_unstale":"2023-10-09T11:42:12.248914+0000","last_undegraded":"2023-10-09T11:42:12.248914+0000","last_fullsized":"2023-10-09T11:42:12.248914+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:37:06.176883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258846+0000","last_change":"2023-10-09T11:42:12.258846+0000","last_active":"2023-10-09T11:42:12.258846+0000","last_peered":"2023-10-09T11:42:12.258846+0000","last_clean":"2023-10-09T11:42:12.258846+0000","last_became_active":"2023-10-09T11:42:12.258578+0000","last_became_peered":"2023-10-09T11:42:12.258578+0000","last_unstale":"2023-10-09T11:42:12.258846+0000","last_undegraded":"2023-10-09T11:42:12.258846+0000","last_fullsized":"2023-10-09T11:42:12.258846+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:14.488955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254402+0000","last_change":"2023-10-09T11:42:11.253344+0000","last_active":"2023-10-09T11:42:12.254402+0000","last_peered":"2023-10-09T11:42:12.254402+0000","last_clean":"2023-10-09T11:42:12.254402+0000","last_became_active":"2023-10-09T11:42:11.253121+0000","last_became_peered":"2023-10-09T11:42:11.253121+0000","last_unstale":"2023-10-09T11:42:12.254402+0000","last_undegraded":"2023-10-09T11:42:12.254402+0000","last_fullsized":"2023-10-09T11:42:12.254402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:57.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261876+0000","last_change":"2023-10-09T11:42:12.261876+0000","last_active":"2023-10-09T11:42:12.261876+0000","last_peered":"2023-10-09T11:42:12.261876+0000","last_clean":"2023-10-09T11:42:12.261876+0000","last_became_active":"2023-10-09T11:42:12.261211+0000","last_became_peered":"2023-10-09T11:42:12.261211+0000","last_unstale":"2023-10-09T11:42:12.261876+0000","last_undegraded":"2023-10-09T11:42:12.261876+0000","last_fullsized":"2023-10-09T11:42:12.261876+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:16.802790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258430+0000","last_change":"2023-10-09T11:42:11.258375+0000","last_active":"2023-10-09T11:42:11.258430+0000","last_peered":"2023-10-09T11:42:11.258430+0000","last_clean":"2023-10-09T11:42:11.258430+0000","last_became_active":"2023-10-09T11:42:11.258154+0000","last_became_peered":"2023-10-09T11:42:11.258154+0000","last_unstale":"2023-10-09T11:42:11.258430+0000","last_undegraded":"2023-10-09T11:42:11.258430+0000","last_fullsized":"2023-10-09T11:42:11.258430+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:18.539367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255896+0000","last_change":"2023-10-09T11:42:12.255896+0000","last_active":"2023-10-09T11:42:12.255896+0000","last_peered":"2023-10-09T11:42:12.255896+0000","last_clean":"2023-10-09T11:42:12.255896+0000","last_became_active":"2023-10-09T11:42:12.255639+0000","last_became_peered":"2023-10-09T11:42:12.255639+0000","last_unstale":"2023-10-09T11:42:12.255896+0000","last_undegraded":"2023-10-09T11:42:12.255896+0000","last_fullsized":"2023-10-09T11:42:12.255896+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:33.439982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.259874+0000","last_change":"2023-10-09T11:42:11.259812+0000","last_active":"2023-10-09T11:42:11.259874+0000","last_peered":"2023-10-09T11:42:11.259874+0000","last_clean":"2023-10-09T11:42:11.259874+0000","last_became_active":"2023-10-09T11:42:11.259445+0000","last_became_peered":"2023-10-09T11:42:11.259445+0000","last_unstale":"2023-10-09T11:42:11.259874+0000","last_undegraded":"2023-10-09T11:42:11.259874+0000","last_fullsized":"2023-10-09T11:42:11.259874+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:00.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.250677+0000","last_change":"2023-10-09T11:42:12.250677+0000","last_active":"2023-10-09T11:42:12.250677+0000","last_peered":"2023-10-09T11:42:12.250677+0000","last_clean":"2023-10-09T11:42:12.250677+0000","last_became_active":"2023-10-09T11:42:12.250446+0000","last_became_peered":"2023-10-09T11:42:12.250446+0000","last_unstale":"2023-10-09T11:42:12.250677+0000","last_undegraded":"2023-10-09T11:42:12.250677+0000","last_fullsized":"2023-10-09T11:42:12.250677+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:27:17.100884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253478+0000","last_change":"2023-10-09T11:42:11.253378+0000","last_active":"2023-10-09T11:42:11.253478+0000","last_peered":"2023-10-09T11:42:11.253478+0000","last_clean":"2023-10-09T11:42:11.253478+0000","last_became_active":"2023-10-09T11:42:11.252911+0000","last_became_peered":"2023-10-09T11:42:11.252911+0000","last_unstale":"2023-10-09T11:42:11.253478+0000","last_undegraded":"2023-10-09T11:42:11.253478+0000","last_fullsized":"2023-10-09T11:42:11.253478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:17:44.595712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261128+0000","last_change":"2023-10-09T11:42:12.261128+0000","last_active":"2023-10-09T11:42:12.261128+0000","last_peered":"2023-10-09T11:42:12.261128+0000","last_clean":"2023-10-09T11:42:12.261128+0000","last_became_active":"2023-10-09T11:42:12.260595+0000","last_became_peered":"2023-10-09T11:42:12.260595+0000","last_unstale":"2023-10-09T11:42:12.261128+0000","last_undegraded":"2023-10-09T11:42:12.261128+0000","last_fullsized":"2023-10-09T11:42:12.261128+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:01.453249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.257784+0000","last_change":"2023-10-09T11:42:11.255018+0000","last_active":"2023-10-09T11:42:11.257784+0000","last_peered":"2023-10-09T11:42:11.257784+0000","last_clean":"2023-10-09T11:42:11.257784+0000","last_became_active":"2023-10-09T11:42:11.254306+0000","last_became_peered":"2023-10-09T11:42:11.254306+0000","last_unstale":"2023-10-09T11:42:11.257784+0000","last_undegraded":"2023-10-09T11:42:11.257784+0000","last_fullsized":"2023-10-09T11:42:11.257784+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:00.644826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258177+0000","last_change":"2023-10-09T11:42:12.258177+0000","last_active":"2023-10-09T11:42:12.258177+0000","last_peered":"2023-10-09T11:42:12.258177+0000","last_clean":"2023-10-09T11:42:12.258177+0000","last_became_active":"2023-10-09T11:42:12.257948+0000","last_became_peered":"2023-10-09T11:42:12.257948+0000","last_unstale":"2023-10-09T11:42:12.258177+0000","last_undegraded":"2023-10-09T11:42:12.258177+0000","last_fullsized":"2023-10-09T11:42:12.258177+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:58.237646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272252+0000","last_change":"2023-10-09T11:42:11.260396+0000","last_active":"2023-10-09T11:42:12.272252+0000","last_peered":"2023-10-09T11:42:12.272252+0000","last_clean":"2023-10-09T11:42:12.272252+0000","last_became_active":"2023-10-09T11:42:11.259933+0000","last_became_peered":"2023-10-09T11:42:11.259933+0000","last_unstale":"2023-10-09T11:42:12.272252+0000","last_undegraded":"2023-10-09T11:42:12.272252+0000","last_fullsized":"2023-10-09T11:42:12.272252+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:36.817468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260498+0000","last_change":"2023-10-09T11:42:12.260498+0000","last_active":"2023-10-09T11:42:12.260498+0000","last_peered":"2023-10-09T11:42:12.260498+0000","last_clean":"2023-10-09T11:42:12.260498+0000","last_became_active":"2023-10-09T11:42:12.260295+0000","last_became_peered":"2023-10-09T11:42:12.260295+0000","last_unstale":"2023-10-09T11:42:12.260498+0000","last_undegraded":"2023-10-09T11:42:12.260498+0000","last_fullsized":"2023-10-09T11:42:12.260498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:16.329498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272397+0000","last_change":"2023-10-09T11:42:11.261115+0000","last_active":"2023-10-09T11:42:12.272397+0000","last_peered":"2023-10-09T11:42:12.272397+0000","last_clean":"2023-10-09T11:42:12.272397+0000","last_became_active":"2023-10-09T11:42:11.260183+0000","last_became_peered":"2023-10-09T11:42:11.260183+0000","last_unstale":"2023-10-09T11:42:12.272397+0000","last_undegraded":"2023-10-09T11:42:12.272397+0000","last_fullsized":"2023-10-09T11:42:12.272397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:57.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259071+0000","last_change":"2023-10-09T11:42:12.259071+0000","last_active":"2023-10-09T11:42:12.259071+0000","last_peered":"2023-10-09T11:42:12.259071+0000","last_clean":"2023-10-09T11:42:12.259071+0000","last_became_active":"2023-10-09T11:42:12.258846+0000","last_became_peered":"2023-10-09T11:42:12.258846+0000","last_unstale":"2023-10-09T11:42:12.259071+0000","last_undegraded":"2023-10-09T11:42:12.259071+0000","last_fullsized":"2023-10-09T11:42:12.259071+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:12:53.844738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271701+0000","last_change":"2023-10-09T11:42:11.257510+0000","last_active":"2023-10-09T11:42:12.271701+0000","last_peered":"2023-10-09T11:42:12.271701+0000","last_clean":"2023-10-09T11:42:12.271701+0000","last_became_active":"2023-10-09T11:42:11.255747+0000","last_became_peered":"2023-10-09T11:42:11.255747+0000","last_unstale":"2023-10-09T11:42:12.271701+0000","last_undegraded":"2023-10-09T11:42:12.271701+0000","last_fullsized":"2023-10-09T11:42:12.271701+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:50:26.535447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260794+0000","last_change":"2023-10-09T11:42:12.260794+0000","last_active":"2023-10-09T11:42:12.260794+0000","last_peered":"2023-10-09T11:42:12.260794+0000","last_clean":"2023-10-09T11:42:12.260794+0000","last_became_active":"2023-10-09T11:42:12.260563+0000","last_became_peered":"2023-10-09T11:42:12.260563+0000","last_unstale":"2023-10-09T11:42:12.260794+0000","last_undegraded":"2023-10-09T11:42:12.260794+0000","last_fullsized":"2023-10-09T11:42:12.260794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:49.933302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.260464+0000","last_change":"2023-10-09T11:42:11.260416+0000","last_active":"2023-10-09T11:42:11.260464+0000","last_peered":"2023-10-09T11:42:11.260464+0000","last_clean":"2023-10-09T11:42:11.260464+0000","last_became_active":"2023-10-09T11:42:11.260273+0000","last_became_peered":"2023-10-09T11:42:11.260273+0000","last_unstale":"2023-10-09T11:42:11.260464+0000","last_undegraded":"2023-10-09T11:42:11.260464+0000","last_fullsized":"2023-10-09T11:42:11.260464+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:27.638125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260321+0000","last_change":"2023-10-09T11:42:12.260321+0000","last_active":"2023-10-09T11:42:12.260321+0000","last_peered":"2023-10-09T11:42:12.260321+0000","last_clean":"2023-10-09T11:42:12.260321+0000","last_became_active":"2023-10-09T11:42:12.260076+0000","last_became_peered":"2023-10-09T11:42:12.260076+0000","last_unstale":"2023-10-09T11:42:12.260321+0000","last_undegraded":"2023-10-09T11:42:12.260321+0000","last_fullsized":"2023-10-09T11:42:12.260321+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:01.115578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271896+0000","last_change":"2023-10-09T11:42:11.255683+0000","last_active":"2023-10-09T11:42:12.271896+0000","last_peered":"2023-10-09T11:42:12.271896+0000","last_clean":"2023-10-09T11:42:12.271896+0000","last_became_active":"2023-10-09T11:42:11.255453+0000","last_became_peered":"2023-10-09T11:42:11.255453+0000","last_unstale":"2023-10-09T11:42:12.271896+0000","last_undegraded":"2023-10-09T11:42:12.271896+0000","last_fullsized":"2023-10-09T11:42:12.271896+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:26.154531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262870+0000","last_change":"2023-10-09T11:42:12.262870+0000","last_active":"2023-10-09T11:42:12.262870+0000","last_peered":"2023-10-09T11:42:12.262870+0000","last_clean":"2023-10-09T11:42:12.262870+0000","last_became_active":"2023-10-09T11:42:12.262451+0000","last_became_peered":"2023-10-09T11:42:12.262451+0000","last_unstale":"2023-10-09T11:42:12.262870+0000","last_undegraded":"2023-10-09T11:42:12.262870+0000","last_fullsized":"2023-10-09T11:42:12.262870+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:20.339273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.254794+0000","last_change":"2023-10-09T11:42:11.260421+0000","last_active":"2023-10-09T11:42:12.254794+0000","last_peered":"2023-10-09T11:42:12.254794+0000","last_clean":"2023-10-09T11:42:12.254794+0000","last_became_active":"2023-10-09T11:42:11.259192+0000","last_became_peered":"2023-10-09T11:42:11.259192+0000","last_unstale":"2023-10-09T11:42:12.254794+0000","last_undegraded":"2023-10-09T11:42:12.254794+0000","last_fullsized":"2023-10-09T11:42:12.254794+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:40.477747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262720+0000","last_change":"2023-10-09T11:42:12.262720+0000","last_active":"2023-10-09T11:42:12.262720+0000","last_peered":"2023-10-09T11:42:12.262720+0000","last_clean":"2023-10-09T11:42:12.262720+0000","last_became_active":"2023-10-09T11:42:12.262477+0000","last_became_peered":"2023-10-09T11:42:12.262477+0000","last_unstale":"2023-10-09T11:42:12.262720+0000","last_undegraded":"2023-10-09T11:42:12.262720+0000","last_fullsized":"2023-10-09T11:42:12.262720+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:42.111918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.271409+0000","last_change":"2023-10-09T11:42:11.256817+0000","last_active":"2023-10-09T11:42:12.271409+0000","last_peered":"2023-10-09T11:42:12.271409+0000","last_clean":"2023-10-09T11:42:12.271409+0000","last_became_active":"2023-10-09T11:42:11.256575+0000","last_became_peered":"2023-10-09T11:42:11.256575+0000","last_unstale":"2023-10-09T11:42:12.271409+0000","last_undegraded":"2023-10-09T11:42:12.271409+0000","last_fullsized":"2023-10-09T11:42:12.271409+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:07:41.348039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261624+0000","last_change":"2023-10-09T11:42:12.261624+0000","last_active":"2023-10-09T11:42:12.261624+0000","last_peered":"2023-10-09T11:42:12.261624+0000","last_clean":"2023-10-09T11:42:12.261624+0000","last_became_active":"2023-10-09T11:42:12.261368+0000","last_became_peered":"2023-10-09T11:42:12.261368+0000","last_unstale":"2023-10-09T11:42:12.261624+0000","last_undegraded":"2023-10-09T11:42:12.261624+0000","last_fullsized":"2023-10-09T11:42:12.261624+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:06:18.679916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"129'1","reported_seq":10,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.252011+0000","last_change":"2023-10-09T11:42:11.256558+0000","last_active":"2023-10-09T11:42:12.252011+0000","last_peered":"2023-10-09T11:42:12.252011+0000","last_clean":"2023-10-09T11:42:12.252011+0000","last_became_active":"2023-10-09T11:42:11.256330+0000","last_became_peered":"2023-10-09T11:42:11.256330+0000","last_unstale":"2023-10-09T11:42:12.252011+0000","last_undegraded":"2023-10-09T11:42:12.252011+0000","last_fullsized":"2023-10-09T11:42:12.252011+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:04:13.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259065+0000","last_change":"2023-10-09T11:42:12.259065+0000","last_active":"2023-10-09T11:42:12.259065+0000","last_peered":"2023-10-09T11:42:12.259065+0000","last_clean":"2023-10-09T11:42:12.259065+0000","last_became_active":"2023-10-09T11:42:12.258798+0000","last_became_peered":"2023-10-09T11:42:12.258798+0000","last_unstale":"2023-10-09T11:42:12.259065+0000","last_undegraded":"2023-10-09T11:42:12.259065+0000","last_fullsized":"2023-10-09T11:42:12.259065+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:48.750122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253028+0000","last_change":"2023-10-09T11:42:11.252556+0000","last_active":"2023-10-09T11:42:11.253028+0000","last_peered":"2023-10-09T11:42:11.253028+0000","last_clean":"2023-10-09T11:42:11.253028+0000","last_became_active":"2023-10-09T11:42:11.252200+0000","last_became_peered":"2023-10-09T11:42:11.252200+0000","last_unstale":"2023-10-09T11:42:11.253028+0000","last_undegraded":"2023-10-09T11:42:11.253028+0000","last_fullsized":"2023-10-09T11:42:11.253028+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.305210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.263490+0000","last_change":"2023-10-09T11:42:12.263490+0000","last_active":"2023-10-09T11:42:12.263490+0000","last_peered":"2023-10-09T11:42:12.263490+0000","last_clean":"2023-10-09T11:42:12.263490+0000","last_became_active":"2023-10-09T11:42:12.263271+0000","last_became_peered":"2023-10-09T11:42:12.263271+0000","last_unstale":"2023-10-09T11:42:12.263490+0000","last_undegraded":"2023-10-09T11:42:12.263490+0000","last_fullsized":"2023-10-09T11:42:12.263490+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272397+0000","last_change":"2023-10-09T11:42:11.254513+0000","last_active":"2023-10-09T11:42:12.272397+0000","last_peered":"2023-10-09T11:42:12.272397+0000","last_clean":"2023-10-09T11:42:12.272397+0000","last_became_active":"2023-10-09T11:42:11.254117+0000","last_became_peered":"2023-10-09T11:42:11.254117+0000","last_unstale":"2023-10-09T11:42:12.272397+0000","last_undegraded":"2023-10-09T11:42:12.272397+0000","last_fullsized":"2023-10-09T11:42:12.272397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:58.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.258435+0000","last_change":"2023-10-09T11:42:12.258435+0000","last_active":"2023-10-09T11:42:12.258435+0000","last_peered":"2023-10-09T11:42:12.258435+0000","last_clean":"2023-10-09T11:42:12.258435+0000","last_became_active":"2023-10-09T11:42:12.258186+0000","last_became_peered":"2023-10-09T11:42:12.258186+0000","last_unstale":"2023-10-09T11:42:12.258435+0000","last_undegraded":"2023-10-09T11:42:12.258435+0000","last_fullsized":"2023-10-09T11:42:12.258435+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:33.649527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.248728+0000","last_change":"2023-10-09T11:42:11.248217+0000","last_active":"2023-10-09T11:42:11.248728+0000","last_peered":"2023-10-09T11:42:11.248728+0000","last_clean":"2023-10-09T11:42:11.248728+0000","last_became_active":"2023-10-09T11:42:11.247978+0000","last_became_peered":"2023-10-09T11:42:11.247978+0000","last_unstale":"2023-10-09T11:42:11.248728+0000","last_undegraded":"2023-10-09T11:42:11.248728+0000","last_fullsized":"2023-10-09T11:42:11.248728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:31.968067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255349+0000","last_change":"2023-10-09T11:42:12.255349+0000","last_active":"2023-10-09T11:42:12.255349+0000","last_peered":"2023-10-09T11:42:12.255349+0000","last_clean":"2023-10-09T11:42:12.255349+0000","last_became_active":"2023-10-09T11:42:12.255134+0000","last_became_peered":"2023-10-09T11:42:12.255134+0000","last_unstale":"2023-10-09T11:42:12.255349+0000","last_undegraded":"2023-10-09T11:42:12.255349+0000","last_fullsized":"2023-10-09T11:42:12.255349+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:49.933302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258144+0000","last_change":"2023-10-09T11:42:11.257335+0000","last_active":"2023-10-09T11:42:11.258144+0000","last_peered":"2023-10-09T11:42:11.258144+0000","last_clean":"2023-10-09T11:42:11.258144+0000","last_became_active":"2023-10-09T11:42:11.255090+0000","last_became_peered":"2023-10-09T11:42:11.255090+0000","last_unstale":"2023-10-09T11:42:11.258144+0000","last_undegraded":"2023-10-09T11:42:11.258144+0000","last_fullsized":"2023-10-09T11:42:11.258144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:08:26.767714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.262052+0000","last_change":"2023-10-09T11:42:12.262052+0000","last_active":"2023-10-09T11:42:12.262052+0000","last_peered":"2023-10-09T11:42:12.262052+0000","last_clean":"2023-10-09T11:42:12.262052+0000","last_became_active":"2023-10-09T11:42:12.261801+0000","last_became_peered":"2023-10-09T11:42:12.261801+0000","last_unstale":"2023-10-09T11:42:12.262052+0000","last_undegraded":"2023-10-09T11:42:12.262052+0000","last_fullsized":"2023-10-09T11:42:12.262052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:41.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.259283+0000","last_change":"2023-10-09T11:42:11.256608+0000","last_active":"2023-10-09T11:42:11.259283+0000","last_peered":"2023-10-09T11:42:11.259283+0000","last_clean":"2023-10-09T11:42:11.259283+0000","last_became_active":"2023-10-09T11:42:11.255394+0000","last_became_peered":"2023-10-09T11:42:11.255394+0000","last_unstale":"2023-10-09T11:42:11.259283+0000","last_undegraded":"2023-10-09T11:42:11.259283+0000","last_fullsized":"2023-10-09T11:42:11.259283+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:21.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.264788+0000","last_change":"2023-10-09T11:42:12.264788+0000","last_active":"2023-10-09T11:42:12.264788+0000","last_peered":"2023-10-09T11:42:12.264788+0000","last_clean":"2023-10-09T11:42:12.264788+0000","last_became_active":"2023-10-09T11:42:12.261813+0000","last_became_peered":"2023-10-09T11:42:12.261813+0000","last_unstale":"2023-10-09T11:42:12.264788+0000","last_undegraded":"2023-10-09T11:42:12.264788+0000","last_fullsized":"2023-10-09T11:42:12.264788+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:01.650318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.272524+0000","last_change":"2023-10-09T11:42:11.255148+0000","last_active":"2023-10-09T11:42:12.272524+0000","last_peered":"2023-10-09T11:42:12.272524+0000","last_clean":"2023-10-09T11:42:12.272524+0000","last_became_active":"2023-10-09T11:42:11.254675+0000","last_became_peered":"2023-10-09T11:42:11.254675+0000","last_unstale":"2023-10-09T11:42:12.272524+0000","last_undegraded":"2023-10-09T11:42:12.272524+0000","last_fullsized":"2023-10-09T11:42:12.272524+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:21.572165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260110+0000","last_change":"2023-10-09T11:42:12.260110+0000","last_active":"2023-10-09T11:42:12.260110+0000","last_peered":"2023-10-09T11:42:12.260110+0000","last_clean":"2023-10-09T11:42:12.260110+0000","last_became_active":"2023-10-09T11:42:12.259722+0000","last_became_peered":"2023-10-09T11:42:12.259722+0000","last_unstale":"2023-10-09T11:42:12.260110+0000","last_undegraded":"2023-10-09T11:42:12.260110+0000","last_fullsized":"2023-10-09T11:42:12.260110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:46:41.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253745+0000","last_change":"2023-10-09T11:42:11.253504+0000","last_active":"2023-10-09T11:42:11.253745+0000","last_peered":"2023-10-09T11:42:11.253745+0000","last_clean":"2023-10-09T11:42:11.253745+0000","last_became_active":"2023-10-09T11:42:11.253269+0000","last_became_peered":"2023-10-09T11:42:11.253269+0000","last_unstale":"2023-10-09T11:42:11.253745+0000","last_undegraded":"2023-10-09T11:42:11.253745+0000","last_fullsized":"2023-10-09T11:42:11.253745+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:51:52.018572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261540+0000","last_change":"2023-10-09T11:42:12.261540+0000","last_active":"2023-10-09T11:42:12.261540+0000","last_peered":"2023-10-09T11:42:12.261540+0000","last_clean":"2023-10-09T11:42:12.261540+0000","last_became_active":"2023-10-09T11:42:12.260437+0000","last_became_peered":"2023-10-09T11:42:12.260437+0000","last_unstale":"2023-10-09T11:42:12.261540+0000","last_undegraded":"2023-10-09T11:42:12.261540+0000","last_fullsized":"2023-10-09T11:42:12.261540+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:03.494547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.260876+0000","last_change":"2023-10-09T11:42:11.260807+0000","last_active":"2023-10-09T11:42:11.260876+0000","last_peered":"2023-10-09T11:42:11.260876+0000","last_clean":"2023-10-09T11:42:11.260876+0000","last_became_active":"2023-10-09T11:42:11.259549+0000","last_became_peered":"2023-10-09T11:42:11.259549+0000","last_unstale":"2023-10-09T11:42:11.260876+0000","last_undegraded":"2023-10-09T11:42:11.260876+0000","last_fullsized":"2023-10-09T11:42:11.260876+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:33.903343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.259809+0000","last_change":"2023-10-09T11:42:12.259809+0000","last_active":"2023-10-09T11:42:12.259809+0000","last_peered":"2023-10-09T11:42:12.259809+0000","last_clean":"2023-10-09T11:42:12.259809+0000","last_became_active":"2023-10-09T11:42:12.259581+0000","last_became_peered":"2023-10-09T11:42:12.259581+0000","last_unstale":"2023-10-09T11:42:12.259809+0000","last_undegraded":"2023-10-09T11:42:12.259809+0000","last_fullsized":"2023-10-09T11:42:12.259809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:22.577656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.258641+0000","last_change":"2023-10-09T11:42:11.258582+0000","last_active":"2023-10-09T11:42:11.258641+0000","last_peered":"2023-10-09T11:42:11.258641+0000","last_clean":"2023-10-09T11:42:11.258641+0000","last_became_active":"2023-10-09T11:42:11.258290+0000","last_became_peered":"2023-10-09T11:42:11.258290+0000","last_unstale":"2023-10-09T11:42:11.258641+0000","last_undegraded":"2023-10-09T11:42:11.258641+0000","last_fullsized":"2023-10-09T11:42:11.258641+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:00.447758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.256667+0000","last_change":"2023-10-09T11:42:12.256667+0000","last_active":"2023-10-09T11:42:12.256667+0000","last_peered":"2023-10-09T11:42:12.256667+0000","last_clean":"2023-10-09T11:42:12.256667+0000","last_became_active":"2023-10-09T11:42:12.256415+0000","last_became_peered":"2023-10-09T11:42:12.256415+0000","last_unstale":"2023-10-09T11:42:12.256667+0000","last_undegraded":"2023-10-09T11:42:12.256667+0000","last_fullsized":"2023-10-09T11:42:12.256667+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:16.329498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.255854+0000","last_change":"2023-10-09T11:42:11.255781+0000","last_active":"2023-10-09T11:42:11.255854+0000","last_peered":"2023-10-09T11:42:11.255854+0000","last_clean":"2023-10-09T11:42:11.255854+0000","last_became_active":"2023-10-09T11:42:11.255541+0000","last_became_peered":"2023-10-09T11:42:11.255541+0000","last_unstale":"2023-10-09T11:42:11.255854+0000","last_undegraded":"2023-10-09T11:42:11.255854+0000","last_fullsized":"2023-10-09T11:42:11.255854+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:11.418224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.255244+0000","last_change":"2023-10-09T11:42:12.255244+0000","last_active":"2023-10-09T11:42:12.255244+0000","last_peered":"2023-10-09T11:42:12.255244+0000","last_clean":"2023-10-09T11:42:12.255244+0000","last_became_active":"2023-10-09T11:42:12.255006+0000","last_became_peered":"2023-10-09T11:42:12.255006+0000","last_unstale":"2023-10-09T11:42:12.255244+0000","last_undegraded":"2023-10-09T11:42:12.255244+0000","last_fullsized":"2023-10-09T11:42:12.255244+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:32:19.583147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253697+0000","last_change":"2023-10-09T11:42:11.253144+0000","last_active":"2023-10-09T11:42:11.253697+0000","last_peered":"2023-10-09T11:42:11.253697+0000","last_clean":"2023-10-09T11:42:11.253697+0000","last_became_active":"2023-10-09T11:42:11.252651+0000","last_became_peered":"2023-10-09T11:42:11.252651+0000","last_unstale":"2023-10-09T11:42:11.253697+0000","last_undegraded":"2023-10-09T11:42:11.253697+0000","last_fullsized":"2023-10-09T11:42:11.253697+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:16:34.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.261811+0000","last_change":"2023-10-09T11:42:12.261811+0000","last_active":"2023-10-09T11:42:12.261811+0000","last_peered":"2023-10-09T11:42:12.261811+0000","last_clean":"2023-10-09T11:42:12.261811+0000","last_became_active":"2023-10-09T11:42:12.260880+0000","last_became_peered":"2023-10-09T11:42:12.260880+0000","last_unstale":"2023-10-09T11:42:12.261811+0000","last_undegraded":"2023-10-09T11:42:12.261811+0000","last_fullsized":"2023-10-09T11:42:12.261811+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:35.628286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.250508+0000","last_change":"2023-10-09T11:42:11.250389+0000","last_active":"2023-10-09T11:42:11.250508+0000","last_peered":"2023-10-09T11:42:11.250508+0000","last_clean":"2023-10-09T11:42:11.250508+0000","last_became_active":"2023-10-09T11:42:11.250129+0000","last_became_peered":"2023-10-09T11:42:11.250129+0000","last_unstale":"2023-10-09T11:42:11.250508+0000","last_undegraded":"2023-10-09T11:42:11.250508+0000","last_fullsized":"2023-10-09T11:42:11.250508+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:55.913081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.257527+0000","last_change":"2023-10-09T11:42:12.257527+0000","last_active":"2023-10-09T11:42:12.257527+0000","last_peered":"2023-10-09T11:42:12.257527+0000","last_clean":"2023-10-09T11:42:12.257527+0000","last_became_active":"2023-10-09T11:42:12.257213+0000","last_became_peered":"2023-10-09T11:42:12.257213+0000","last_unstale":"2023-10-09T11:42:12.257527+0000","last_undegraded":"2023-10-09T11:42:12.257527+0000","last_fullsized":"2023-10-09T11:42:12.257527+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:27.767940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.261008+0000","last_change":"2023-10-09T11:42:11.260953+0000","last_active":"2023-10-09T11:42:11.261008+0000","last_peered":"2023-10-09T11:42:11.261008+0000","last_clean":"2023-10-09T11:42:11.261008+0000","last_became_active":"2023-10-09T11:42:11.259858+0000","last_became_peered":"2023-10-09T11:42:11.259858+0000","last_unstale":"2023-10-09T11:42:11.261008+0000","last_undegraded":"2023-10-09T11:42:11.261008+0000","last_fullsized":"2023-10-09T11:42:11.261008+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:31.516208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-09T11:42:12.260191+0000","last_change":"2023-10-09T11:42:12.260191+0000","last_active":"2023-10-09T11:42:12.260191+0000","last_peered":"2023-10-09T11:42:12.260191+0000","last_clean":"2023-10-09T11:42:12.260191+0000","last_became_active":"2023-10-09T11:42:12.259815+0000","last_became_peered":"2023-10-09T11:42:12.259815+0000","last_unstale":"2023-10-09T11:42:12.260191+0000","last_undegraded":"2023-10-09T11:42:12.260191+0000","last_fullsized":"2023-10-09T11:42:12.260191+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:11.240516+0000","last_clean_scrub_stamp":"2023-10-09T11:42:11.240516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:54:28.167713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.253013+0000","last_change":"2023-10-09T11:42:11.252422+0000","last_active":"2023-10-09T11:42:11.253013+0000","last_peered":"2023-10-09T11:42:11.253013+0000","last_clean":"2023-10-09T11:42:11.253013+0000","last_became_active":"2023-10-09T11:42:11.251921+0000","last_became_peered":"2023-10-09T11:42:11.251921+0000","last_unstale":"2023-10-09T11:42:11.253013+0000","last_undegraded":"2023-10-09T11:42:11.253013+0000","last_fullsized":"2023-10-09T11:42:11.253013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:10.235024+0000","last_clean_scrub_stamp":"2023-10-09T11:42:10.235024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:29.521111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":253,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-09T11:42:11.255915+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:42:11.255915+0000","last_peered":"2023-10-09T11:42:11.255915+0000","last_clean":"2023-10-09T11:42:11.255915+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:42:11.255915+0000","last_undegraded":"2023-10-09T11:42:11.255915+0000","last_fullsized":"2023-10-09T11:42:11.255915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1268,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194043,"statfs":{"total":200000000,"available":198700551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.745},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.79200000000000004,"15min":0.878},"last":0.505}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69999999999999996,"5min":0.72699999999999998,"15min":0.88900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.90200000000000002},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":1.048},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.079},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.42899999999999999},"min":{"1min":0.33400000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.62}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.87,"15min":0.92700000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291437,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53500000000000003,"15min":0.61599999999999999},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":3.7589999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.376}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.67400000000000004},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72999999999999998,"5min":0.77900000000000003,"15min":5.298},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64800000000000002,"5min":0.73399999999999999,"15min":5.3540000000000001},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":1.6060000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":1.617},"last":0.434}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":5.46},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":5.3949999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.80600000000000005},"last":1.617},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76000000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64700000000000002,"5min":0.72599999999999998,"15min":0.80000000000000004},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":4.0339999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.40200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":692,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34200000000000003,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46700000000000003,"5min":0.623,"15min":1.9370000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.37,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.66500000000000004,"15min":2.004},"last":0.28699999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.501,"5min":0.64000000000000001,"15min":2.2589999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40799999999999997,"15min":0.40899999999999997},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57299999999999995,"5min":0.77000000000000002,"15min":1.909},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41399999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51000000000000001,"5min":0.78200000000000003,"15min":2.0369999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":0.872,"15min":1.869},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.93000000000000005,"15min":1.9790000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.91400000000000003,"15min":2.1960000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.66000000000000003},"min":{"1min":0.46000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":1.952},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.94999999999999996,"15min":2.2280000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.86299999999999999,"15min":1.782},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":1.819},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194051,"statfs":{"total":200000000,"available":198708913,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45000000000000001,"15min":0.41499999999999998},"min":{"1min":0.23899999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22},"max":{"1min":0.53300000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.309}]},{"osd":2,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.223},"max":{"1min":0.63400000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.376},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42199999999999999,"15min":0.5},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55900000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":2.194,"15min":2.194},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.86799999999999999,"5min":1.508,"15min":1.508},"last":0.439},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85499999999999998,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.47799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63400000000000001,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":2.379,"15min":3.976},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.93300000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.95999999999999996,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.593,"15min":1.593},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68899999999999995,"15min":0.76700000000000002},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.91600000000000004,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36699999999999999,"15min":0.32600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.622,"15min":0.622},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38400000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.61899999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41699999999999998,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":11.055},"last":0.315}]},{"osd":3,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.39900000000000002},"min":{"1min":0.307,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.627,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.29999999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.999,"15min":0.999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.96499999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93100000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199289901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.442,"5min":0.64800000000000002,"15min":1.3069999999999999},"last":0.254},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.55400000000000005,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51100000000000001,"5min":0.57399999999999995,"15min":1.034},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.72899999999999998,"15min":1.335},"last":0.313}]},{"osd":2,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.68999999999999995,"15min":1.1200000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61399999999999999,"5min":0.69499999999999995,"15min":1.405},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73599999999999999,"5min":0.91100000000000003,"15min":0.98399999999999999},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":1.387,"15min":1.387},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.96399999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.3819999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":1.0109999999999999},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":691,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199291507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54600000000000004,"15min":0.73699999999999999},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":7.4210000000000003},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":5.274},"last":0.44700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.80400000000000005},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":7.5460000000000003},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40000000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":692,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194620,"statfs":{"total":200000000,"available":199290931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":1.2729999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.379,"5min":0.31,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.751,"15min":0.75600000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":1.1839999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.67900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.745}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68600000000000005,"5min":0.84199999999999997,"15min":0.96399999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.86899999999999999,"15min":0.98899999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.88500000000000001},"last":0.441}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.747,"15min":0.78000000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.43099999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81499999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.81499999999999995}]}]}],"pool_statfs":[]}} 2023-10-09T11:42:16.753 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:42:16.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:42:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.913+0000 7f7bcc641700 1 Processor -- start 2023-10-09T11:42:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.913+0000 7f7bcc641700 1 -- start start 2023-10-09T11:42:16.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bcc641700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bc4068f20 0x7f7bc40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bcc641700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 0x7f7bc40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bcc641700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40cca80 con 0x7f7bc41577c0 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bcc641700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40cedd0 con 0x7f7bc4068f20 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bcc641700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40cc210 con 0x7f7bc4157b90 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.914+0000 7f7bc9bdc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bc4068f20 0x7f7bc40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bc4068f20 0x7f7bc40cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54222/0 (socket says 172.21.15.6:54222) 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 -- 172.21.15.6:0/3380492794 learned_addr learned my addr 172.21.15.6:0/3380492794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bcabde700 1 --2- 172.21.15.6:0/3380492794 >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 0x7f7bc40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 -- 172.21.15.6:0/3380492794 >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 msgr2=0x7f7bc40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3380492794 >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 0x7f7bc40cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 -- 172.21.15.6:0/3380492794 >> v1:172.21.15.118:6789/0 conn(0x7f7bc41577c0 legacy=0x7f7bc4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:16.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 -- 172.21.15.6:0/3380492794 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40cc4c0 con 0x7f7bc4068f20 2023-10-09T11:42:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bcabde700 1 --2- 172.21.15.6:0/3380492794 >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 0x7f7bc40cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3380492794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40cb790 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7bc415a4a0 tx=0x7f7bb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3019a79e883143f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc93db700 1 -- 172.21.15.6:0/3380492794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800b820 con 0x7f7bc4068f20 2023-10-09T11:42:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc93db700 1 -- 172.21.15.6:0/3380492794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800b980 con 0x7f7bc4068f20 2023-10-09T11:42:16.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.915+0000 7f7bc93db700 1 -- 172.21.15.6:0/3380492794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800bd20 con 0x7f7bc4068f20 2023-10-09T11:42:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 -- 172.21.15.6:0/3380492794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 msgr2=0x7f7bc40cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3380492794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40cb790 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7bc415a4a0 tx=0x7f7bb8009250 comp rx=0 tx=0).stop 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 -- 172.21.15.6:0/3380492794 shutdown_connections 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3380492794 >> v2:172.21.15.118:3300/0 conn(0x7f7bc4157b90 0x7f7bc40cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3380492794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40cb790 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 -- 172.21.15.6:0/3380492794 >> 172.21.15.6:0/3380492794 conn(0x7f7bc40d0df0 msgr2=0x7f7bc40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 -- 172.21.15.6:0/3380492794 shutdown_connections 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.916+0000 7f7bcc641700 1 -- 172.21.15.6:0/3380492794 wait complete. 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.917+0000 7f7bcc641700 1 Processor -- start 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.917+0000 7f7bcc641700 1 -- start start 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 0x7f7bc406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 0x7f7bc4158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4158950 con 0x7f7bc4068f20 2023-10-09T11:42:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40c83e0 con 0x7f7bc41577c0 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcc641700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc406ed30 con 0x7f7bc4157b90 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54230/0 (socket says 172.21.15.6:54230) 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 -- 172.21.15.6:0/3171188124 learned_addr learned my addr 172.21.15.6:0/3171188124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 0x7f7bc406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 -- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 msgr2=0x7f7bc4158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcabde700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 0x7f7bc4158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 0x7f7bc4158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 -- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 msgr2=0x7f7bc406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 0x7f7bc406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 -- 172.21.15.6:0/3171188124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80094f0 con 0x7f7bc4068f20 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 0x7f7bc406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bcabde700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 0x7f7bc4158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.918+0000 7f7bca3dd700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c950 tx=0x7f7bbc002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.919+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00a7e0 con 0x7f7bc4068f20 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.919+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00a940 con 0x7f7bc4068f20 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.919+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00ad00 con 0x7f7bc4068f20 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.919+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4158020 con 0x7f7bc4068f20 2023-10-09T11:42:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.919+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc41585e0 con 0x7f7bc4068f20 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.920+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4067a50 con 0x7f7bc4068f20 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.920+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bbc012630 con 0x7f7bc4068f20 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.921+0000 7f7bc27fc700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.921+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.921+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bbc084a90 con 0x7f7bc4068f20 2023-10-09T11:42:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.921+0000 7f7bc9bdc700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 0x7f7bb00693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7bc415a4a0 tx=0x7f7bb8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:16.925+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bbc051db0 con 0x7f7bc4068f20 2023-10-09T11:42:17.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.198+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7bc40cc7a0 con 0x7f7bc4068f20 2023-10-09T11:42:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.202+0000 7f7bc27fc700 1 -- 172.21.15.6:0/3171188124 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7bbc00ae60 con 0x7f7bc4068f20 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 msgr2=0x7f7bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 0x7f7bb00693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7bc415a4a0 tx=0x7f7bb8016000 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 msgr2=0x7f7bc40c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00c950 tx=0x7f7bbc002760 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 shutdown_connections 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bc4157b90 0x7f7bc4158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc4068f20 0x7f7bc40c7ea0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 --2- 172.21.15.6:0/3171188124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bc41577c0 0x7f7bc406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 >> 172.21.15.6:0/3171188124 conn(0x7f7bc40d0df0 msgr2=0x7f7bc4156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 shutdown_connections 2023-10-09T11:42:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.204+0000 7f7bcc641700 1 -- 172.21.15.6:0/3171188124 wait complete. 2023-10-09T11:42:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:42:17.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.334+0000 7fe153cf7700 1 Processor -- start 2023-10-09T11:42:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.334+0000 7fe153cf7700 1 -- start start 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe153cf7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe14c06c190 0x7fe14c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe153cf7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe14c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe153cf7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c069d10 con 0x7fe14c157a60 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe153cf7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0b35f0 con 0x7fe14c06c190 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe153cf7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c15c130 con 0x7fe14c0b3170 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe151a93700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe14c157a60 0x7fe14c15b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42336/0 (socket says 172.21.15.6:42336) 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe151a93700 1 -- 172.21.15.6:0/2438025247 learned_addr learned my addr 172.21.15.6:0/2438025247 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe151292700 1 --2- 172.21.15.6:0/2438025247 >> v2:172.21.15.118:3300/0 conn(0x7fe14c06c190 0x7fe14c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.335+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169400166 0 0) 0x7fe14c069d10 con 0x7fe14c157a60 2023-10-09T11:42:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe134003570 con 0x7fe14c157a60 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe14c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 482216307 0 0) 0x7fe134003570 con 0x7fe14c157a60 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 msgr2=0x7fe14c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe14c06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 >> v2:172.21.15.118:3300/0 conn(0x7fe14c06c190 msgr2=0x7fe14c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 --2- 172.21.15.6:0/2438025247 >> v2:172.21.15.118:3300/0 conn(0x7fe14c06c190 0x7fe14c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c15c410 con 0x7fe14c157a60 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fe13c001470 con 0x7fe14c157a60 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 >> v1:172.21.15.6:6789/0 conn(0x7fe14c157a60 legacy=0x7fe14c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe134003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe134003fe0 0x7fe134004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe134004d50 0x7fe1340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b35f0 con 0x7fe134004d50 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c15c130 con 0x7fe134003fe0 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13400ba90 con 0x7fe14c0b3170 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe134004d50 0x7fe1340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe151a93700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe134003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe151292700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe134003fe0 0x7fe134004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 -- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 msgr2=0x7fe134003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c0b3170 0x7fe134003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 -- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe134003fe0 msgr2=0x7fe134004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe134003fe0 0x7fe134004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 -- 172.21.15.6:0/2438025247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134003570 con 0x7fe134004d50 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe151292700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe134003fe0 0x7fe134004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.336+0000 7fe152294700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe134004d50 0x7fe1340051c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e210 tx=0x7fe14400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b14cd58192c139 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ea60 con 0x7fe134004d50 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400f040 con 0x7fe134004d50 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe150a91700 1 -- 172.21.15.6:0/2438025247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ee10 con 0x7fe134004d50 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 -- 172.21.15.6:0/2438025247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe134004d50 msgr2=0x7fe1340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2438025247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe134004d50 0x7fe1340051c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e210 tx=0x7fe14400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe152294700 1 -- 172.21.15.6:0/2438025247 reap_dead start 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 -- 172.21.15.6:0/2438025247 shutdown_connections 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 -- 172.21.15.6:0/2438025247 >> 172.21.15.6:0/2438025247 conn(0x7fe14c06cca0 msgr2=0x7fe14c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 -- 172.21.15.6:0/2438025247 shutdown_connections 2023-10-09T11:42:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.337+0000 7fe153cf7700 1 -- 172.21.15.6:0/2438025247 wait complete. 2023-10-09T11:42:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.338+0000 7fe153cf7700 1 Processor -- start 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.338+0000 7fe153cf7700 1 -- start start 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 0x7fe14c0ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 0x7fe14c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b22f0 con 0x7fe14c0b2780 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b1750 con 0x7fe14c0ab710 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe153cf7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b19c0 con 0x7fe14c1443d0 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54242/0 (socket says 172.21.15.6:54242) 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 -- 172.21.15.6:0/2077479818 learned_addr learned my addr 172.21.15.6:0/2077479818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 -- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 msgr2=0x7fe14c0ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151a93700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 0x7fe14c0ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe152294700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 0x7fe14c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 0x7fe14c0ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 -- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 msgr2=0x7fe14c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 0x7fe14c1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151292700 1 -- 172.21.15.6:0/2077479818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0b1ca0 con 0x7fe14c0b2780 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe152294700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 0x7fe14c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.339+0000 7fe151a93700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 0x7fe14c0ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe151292700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe140011990 tx=0x7fe140008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000f6d0 con 0x7fe14c0b2780 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14000f830 con 0x7fe14c0b2780 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0b1f80 con 0x7fe14c0b2780 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000fbd0 con 0x7fe14c0b2780 2023-10-09T11:42:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.340+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c1447a0 con 0x7fe14c0b2780 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.341+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c068900 con 0x7fe14c0b2780 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.341+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe140015460 con 0x7fe14c0b2780 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.342+0000 7fe149ffb700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 0x7fe1380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.342+0000 7fe151a93700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 0x7fe1380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.342+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe140084d80 con 0x7fe14c0b2780 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.342+0000 7fe151a93700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 0x7fe1380693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0079e0 tx=0x7fe13c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.346+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe140051f50 con 0x7fe14c0b2780 2023-10-09T11:42:17.570 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-10-09T11:42:17.570+0000 7f4e2c404700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.581+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe14c15c6f0 con 0x7fe14c0b2780 2023-10-09T11:42:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.582+0000 7fe149ffb700 1 -- 172.21.15.6:0/2077479818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe140055570 con 0x7fe14c0b2780 2023-10-09T11:42:17.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:17.582 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 msgr2=0x7fe1380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 0x7fe1380693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0079e0 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 msgr2=0x7fe14c145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe140011990 tx=0x7fe140008040 comp rx=0 tx=0).stop 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 shutdown_connections 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe138066f30 0x7fe1380693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c0ab710 0x7fe14c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe14c1443d0 0x7fe14c0ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 --2- 172.21.15.6:0/2077479818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe14c0b2780 0x7fe14c145090 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 >> 172.21.15.6:0/2077479818 conn(0x7fe14c06cca0 msgr2=0x7fe14c153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 shutdown_connections 2023-10-09T11:42:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:17.584+0000 7fe153cf7700 1 -- 172.21.15.6:0/2077479818 wait complete. 2023-10-09T11:42:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:17.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:42:11.653965+0000', 'modified': '2023-10-09T11:42:15.280223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7101}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7101': {'gid': 7101, 'name': 'd', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1187699477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1187699477}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1187699477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:42:17.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:42:17.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:42:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.119+0000 7f1e95865700 1 Processor -- start 2023-10-09T11:42:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.119+0000 7f1e95865700 1 -- start start 2023-10-09T11:42:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e95865700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e901578d0 0x7f1e900cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e95865700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 0x7f1e9015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e95865700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e900d07c0 con 0x7f1e9006d120 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e95865700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900cfbb0 con 0x7f1e901578d0 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e95865700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900cfe90 con 0x7f1e90157ca0 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e8effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e901578d0 0x7f1e900cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e8effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e901578d0 0x7f1e900cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54256/0 (socket says 172.21.15.6:54256) 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e8f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1e9006d120 0x7f1e9015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42348/0 (socket says 172.21.15.6:42348) 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.120+0000 7f1e8effd700 1 -- 172.21.15.6:0/367466174 learned_addr learned my addr 172.21.15.6:0/367466174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8effd700 1 -- 172.21.15.6:0/367466174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 msgr2=0x7f1e9015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 0x7f1e9015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8effd700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 0x7f1e9015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8effd700 1 -- 172.21.15.6:0/367466174 >> v1:172.21.15.6:6789/0 conn(0x7f1e9006d120 legacy=0x7f1e9015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8dffb700 1 -- 172.21.15.6:0/367466174 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473651636 0 0) 0x7f1e900d07c0 con 0x7f1e9006d120 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8effd700 1 -- 172.21.15.6:0/367466174 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900d0170 con 0x7f1e901578d0 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 0x7f1e9015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8effd700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e901578d0 0x7f1e900cf4f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009f20 tx=0x7f1e80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729b32b70bd20bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8dffb700 1 -- 172.21.15.6:0/367466174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e901578d0 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8dffb700 1 -- 172.21.15.6:0/367466174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000ba80 con 0x7f1e901578d0 2023-10-09T11:42:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.121+0000 7f1e8dffb700 1 -- 172.21.15.6:0/367466174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800092e0 con 0x7f1e901578d0 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 -- 172.21.15.6:0/367466174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e901578d0 msgr2=0x7f1e900cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e901578d0 0x7f1e900cf4f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009f20 tx=0x7f1e80009840 comp rx=0 tx=0).stop 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 -- 172.21.15.6:0/367466174 shutdown_connections 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e901578d0 0x7f1e900cf4f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 --2- 172.21.15.6:0/367466174 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e90157ca0 0x7f1e9015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 -- 172.21.15.6:0/367466174 >> 172.21.15.6:0/367466174 conn(0x7f1e9006bb90 msgr2=0x7f1e9006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 -- 172.21.15.6:0/367466174 shutdown_connections 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.122+0000 7f1e95865700 1 -- 172.21.15.6:0/367466174 wait complete. 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.123+0000 7f1e95865700 1 Processor -- start 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.123+0000 7f1e95865700 1 -- start start 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9006d120 0x7f1e900c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e901578d0 0x7f1e90154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90154a00 con 0x7f1e90157ca0 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900c6df0 con 0x7f1e9006d120 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e95865700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900b50c0 con 0x7f1e901578d0 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54266/0 (socket says 172.21.15.6:54266) 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/526118298 learned_addr learned my addr 172.21.15.6:0/526118298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e901578d0 0x7f1e90154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8effd700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9006d120 0x7f1e900c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e901578d0 msgr2=0x7f1e90154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e901578d0 0x7f1e90154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9006d120 msgr2=0x7f1e900c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9006d120 0x7f1e900c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/526118298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009ae0 con 0x7f1e90157ca0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c5e0 tx=0x7f1e88007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.124+0000 7f1e86ffd700 1 -- 172.21.15.6:0/526118298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88005a70 con 0x7f1e90157ca0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.125+0000 7f1e86ffd700 1 -- 172.21.15.6:0/526118298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88005bd0 con 0x7f1e90157ca0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.125+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900c6b10 con 0x7f1e90157ca0 2023-10-09T11:42:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.125+0000 7f1e86ffd700 1 -- 172.21.15.6:0/526118298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880070d0 con 0x7f1e90157ca0 2023-10-09T11:42:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.125+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900b4d50 con 0x7f1e90157ca0 2023-10-09T11:42:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.126+0000 7f1e86ffd700 1 -- 172.21.15.6:0/526118298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e88007440 con 0x7f1e90157ca0 2023-10-09T11:42:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.127+0000 7f1e86ffd700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.127+0000 7f1e86ffd700 1 -- 172.21.15.6:0/526118298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e88083a30 con 0x7f1e90157ca0 2023-10-09T11:42:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.127+0000 7f1e8effd700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.127+0000 7f1e8effd700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 0x7f1e700693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009880 tx=0x7f1e80018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.128+0000 7f1e9eb5db80 1 Processor -- start 2023-10-09T11:42:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 -- start start 2023-10-09T11:42:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b14596a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b14569cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b144c4a70 con 0x555b1456da50 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b144c2270 con 0x555b145b7d00 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b144be060 con 0x555b14596f60 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54280/0 (socket says 172.21.15.6:54280) 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.129+0000 7f1e8effd700 1 -- 172.21.15.6:0/1542870889 learned_addr learned my addr 172.21.15.6:0/1542870889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b14569cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 -- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 msgr2=0x555b14569cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b14569cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 -- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 msgr2=0x555b14596a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b14596a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b14596a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 -- 172.21.15.6:0/1542870889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b14358270 con 0x555b1456da50 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b14596a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e8effd700 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000bef0 tx=0x7f1e80020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dcd80e8c693709 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e6ffff700 1 -- 172.21.15.6:0/1542870889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80007cf0 con 0x555b1456da50 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e6ffff700 1 -- 172.21.15.6:0/1542870889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80007e50 con 0x555b1456da50 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.130+0000 7f1e6ffff700 1 -- 172.21.15.6:0/1542870889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800276b0 con 0x555b1456da50 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/1542870889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 msgr2=0x555b1456de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000bef0 tx=0x7f1e80020040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/1542870889 shutdown_connections 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b14569cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b1456de20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/1542870889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b14596a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/1542870889 >> 172.21.15.6:0/1542870889 conn(0x555b1456f370 msgr2=0x555b1456f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/1542870889 shutdown_connections 2023-10-09T11:42:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/1542870889 wait complete. 2023-10-09T11:42:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.131+0000 7f1e9eb5db80 1 -- start start 2023-10-09T11:42:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 Processor -- start 2023-10-09T11:42:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b1459ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b14469890 con 0x555b1456da50 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b14484ea0 con 0x555b145b7d00 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b14340e30 con 0x555b14596f60 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e9eb5db80 10 client.0 _ll_register_callbacks cb 0x555b14531110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.132+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54294/0 (socket says 172.21.15.6:54294) 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 -- 172.21.15.6:0/3601269310 learned_addr learned my addr 172.21.15.6:0/3601269310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b1459ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 -- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 msgr2=0x555b145c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 -- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 msgr2=0x555b1459ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b1459ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 -- 172.21.15.6:0/3601269310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900d0170 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b1459ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e8effd700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1e800073d0 tx=0x7f1e8002b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c3d8428c474632 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80027a20 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e80027b80 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b14562b70 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e8001e430 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e9eb5db80 10 client.7248 fetch_fsmap learned FSMap version 68 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x555b142fafe0 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.133+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b14562b70 con 0x555b1456da50 2023-10-09T11:42:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e8001e590 con 0x555b1456da50 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 10 client.7248 fetch_fsmap finished waiting for FSMap version 68 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 10 client.7248 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 20 client.7248 populate_metadata read hostname 'smithi006' 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145ac020 0x555b145ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 4 client.7248 mds_command: new command op to 7101 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 --> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b1453faa0 con 0x555b145ac020 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145ac020 0x555b145ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e6d7fa700 10 client.7248 ms_handle_connect on v2:172.21.15.118:6833/1187699477 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.134+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145ac020 0x555b145ac3f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0c3eabe39c3c704 server_cookie=a3cc076c40c91e6c in_seq=0 out_seq=0 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/3601269310 <== mds.0 v2:172.21.15.118:6833/1187699477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555b1453faa0 con 0x555b145ac020 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e6d7fa700 10 client.7248 handle_command_reply: tid=0 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 client.7248 shutdown 2023-10-09T11:42:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 msgr2=0x555b145b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1e800073d0 tx=0x7f1e8002b040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 shutdown_connections 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b145b7d00 0x555b1459ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145ac020 0x555b145ac3f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145b00c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/3601269310 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 >> 172.21.15.6:0/3601269310 conn(0x555b1456f370 msgr2=0x555b1456a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e6d7fa700 0 client.7248 ms_handle_reset on v2:172.21.15.118:6833/1187699477 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 shutdown_connections 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/3601269310 wait complete. 2023-10-09T11:42:18.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.135+0000 7f1e9eb5db80 20 client.7248 trim_cache size 0 max 16384 2023-10-09T11:42:18.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.152+0000 7f1e9eb5db80 1 Processor -- start 2023-10-09T11:42:18.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.152+0000 7f1e9eb5db80 1 -- start start 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b14596f60 0x555b145ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b145b7d00 0x555b145b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b145b0df0 con 0x555b1456da50 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b14596c50 con 0x555b14596f60 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b145b2440 con 0x555b145b7d00 2023-10-09T11:42:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54302/0 (socket says 172.21.15.6:54302) 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 -- 172.21.15.6:0/57593432 learned_addr learned my addr 172.21.15.6:0/57593432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8e7fc700 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b14596f60 0x555b145ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b145b7d00 0x555b145b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 -- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b145b7d00 msgr2=0x555b145b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b145b7d00 0x555b145b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 -- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b14596f60 msgr2=0x555b145ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b14596f60 0x555b145ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.153+0000 7f1e8effd700 1 -- 172.21.15.6:0/57593432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b1448c780 con 0x555b1456da50 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e8effd700 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009930 tx=0x7f1e80034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7375a1ba91ed729 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e84ff9700 1 -- 172.21.15.6:0/57593432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8002c070 con 0x555b1456da50 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e84ff9700 1 -- 172.21.15.6:0/57593432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80007cd0 con 0x555b1456da50 2023-10-09T11:42:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e84ff9700 1 -- 172.21.15.6:0/57593432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8001eaa0 con 0x555b1456da50 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/57593432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 msgr2=0x555b145ac3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009930 tx=0x7f1e80034040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/57593432 shutdown_connections 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b145b7d00 0x555b145b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b1456da50 0x555b145ac3f0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/57593432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b14596f60 0x555b145ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/57593432 >> 172.21.15.6:0/57593432 conn(0x555b1456f370 msgr2=0x555b145664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/57593432 shutdown_connections 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.154+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/57593432 wait complete. 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.155+0000 7f1e9eb5db80 1 -- start start 2023-10-09T11:42:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.155+0000 7f1e9eb5db80 1 Processor -- start 2023-10-09T11:42:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 0x555b14618ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b145b61c0 con 0x555b145b7d00 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b14619bf0 con 0x555b1456da50 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b1461d730 con 0x555b14596f60 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e9eb5db80 10 client.0 _ll_register_callbacks cb 0x555b14531110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 0x555b14618ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54310/0 (socket says 172.21.15.6:54310) 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8e7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/448922448 learned_addr learned my addr 172.21.15.6:0/448922448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 msgr2=0x555b145695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 msgr2=0x555b14618ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 0x555b14618ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 -- 172.21.15.6:0/448922448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b142fafe0 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8effd700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 0x555b14618ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e8f7fe700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1e88054850 tx=0x7f1e88081e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3544655d681341 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880548c0 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.156+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e8806a040 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b14460e00 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e88070510 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 10 client.7254 fetch_fsmap learned FSMap version 68 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x555b14473470 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8805f020 con 0x555b145b7d00 2023-10-09T11:42:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e8805b3d0 con 0x555b145b7d00 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 10 client.7254 fetch_fsmap finished waiting for FSMap version 68 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 10 client.7254 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 20 client.7254 populate_metadata read hostname 'smithi006' 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145aab20 0x555b145aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 4 client.7254 mds_command: new command op to 7101 tid=0[{"prefix": "status"}] 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 --> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555b14460b20 con 0x555b145aab20 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e8effd700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145aab20 0x555b145aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e6d7fa700 10 client.7254 ms_handle_connect on v2:172.21.15.118:6833/1187699477 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.157+0000 7f1e8effd700 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145aab20 0x555b145aaef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9574bb33efc8e49 server_cookie=8aa0d9be61edc64f in_seq=0 out_seq=0 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e6d7fa700 1 -- 172.21.15.6:0/448922448 <== mds.0 v2:172.21.15.118:6833/1187699477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x555b14460b20 con 0x555b145aab20 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e6d7fa700 10 client.7254 handle_command_reply: tid=0 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 client.7254 shutdown 2023-10-09T11:42:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 msgr2=0x555b14569b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1e88054850 tx=0x7f1e88081e10 comp rx=0 tx=0).stop 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 shutdown_connections 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:6833/1187699477,v1:172.21.15.118:6835/1187699477] conn(0x555b145aab20 0x555b145aaef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b145b7d00 0x555b14569b10 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e6d7fa700 0 client.7254 ms_handle_reset on v2:172.21.15.118:6833/1187699477 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b1456da50 0x555b14618ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 --2- 172.21.15.6:0/448922448 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555b14596f60 0x555b145695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 >> 172.21.15.6:0/448922448 conn(0x555b1456f370 msgr2=0x555b145664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 shutdown_connections 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 1 -- 172.21.15.6:0/448922448 wait complete. 2023-10-09T11:42:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e9eb5db80 20 client.7254 trim_cache size 0 max 16384 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7101, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8957387309999998, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 68, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 130, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 130, 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.981826531999999 2023-10-09T11:42:18.165 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 msgr2=0x7f1e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 0x7f1e700693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009880 tx=0x7f1e80018000 comp rx=0 tx=0).stop 2023-10-09T11:42:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 msgr2=0x7f1e9015eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.158+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c5e0 tx=0x7f1e88007d60 comp rx=0 tx=0).stop 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 shutdown_connections 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e70066f30 0x7f1e700693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e90157ca0 0x7f1e9015eef0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9006d120 0x7f1e900c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 --2- 172.21.15.6:0/526118298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e901578d0 0x7f1e90154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 >> 172.21.15.6:0/526118298 conn(0x7f1e9006bb90 msgr2=0x7f1e9006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 shutdown_connections 2023-10-09T11:42:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.159+0000 7f1e95865700 1 -- 172.21.15.6:0/526118298 wait complete. 2023-10-09T11:42:18.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:18.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.289+0000 7ff35867c700 1 Processor -- start 2023-10-09T11:42:18.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.289+0000 7ff35867c700 1 -- start start 2023-10-09T11:42:18.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.290+0000 7ff35867c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.290+0000 7ff35867c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff35006d120 0x7ff35006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.290+0000 7ff35867c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35006dac0 con 0x7ff350157ca0 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.290+0000 7ff35867c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500d07c0 con 0x7ff35006d120 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.290+0000 7ff35867c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500cfbb0 con 0x7ff3501578d0 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356418700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff35006d120 0x7ff35006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355c17700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff350157ca0 0x7ff35015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:34904/0 (socket says 172.21.15.6:34904) 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff35006d120 0x7ff35006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:40628/0 (socket says 172.21.15.6:40628) 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356418700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:38448/0 (socket says 172.21.15.6:38448) 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355c17700 1 -- 172.21.15.6:0/3598498662 learned_addr learned my addr 172.21.15.6:0/3598498662 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 -- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 msgr2=0x7ff3500cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 -- 172.21.15.6:0/3598498662 >> v1:172.21.15.118:6789/0 conn(0x7ff350157ca0 legacy=0x7ff35015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 -- 172.21.15.6:0/3598498662 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500cfe90 con 0x7ff35006d120 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355416700 1 -- 172.21.15.6:0/3598498662 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003882685 0 0) 0x7ff344001110 con 0x7ff350157ca0 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356418700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff356c19700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff35006d580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3480098e0 tx=0x7ff3480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7257dc6d83337daf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355416700 1 -- 172.21.15.6:0/3598498662 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800b640 con 0x7ff35006d120 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355416700 1 -- 172.21.15.6:0/3598498662 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34800b7a0 con 0x7ff35006d120 2023-10-09T11:42:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.291+0000 7ff355416700 1 -- 172.21.15.6:0/3598498662 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800bb40 con 0x7ff35006d120 2023-10-09T11:42:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 -- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 msgr2=0x7ff35006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff35006d580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3480098e0 tx=0x7ff3480091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 -- 172.21.15.6:0/3598498662 shutdown_connections 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff35006d580 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 --2- 172.21.15.6:0/3598498662 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 -- 172.21.15.6:0/3598498662 >> 172.21.15.6:0/3598498662 conn(0x7ff35006bb90 msgr2=0x7ff35006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 -- 172.21.15.6:0/3598498662 shutdown_connections 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.292+0000 7ff35867c700 1 -- 172.21.15.6:0/3598498662 wait complete. 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.293+0000 7ff35867c700 1 Processor -- start 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.293+0000 7ff35867c700 1 -- start start 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 0x7ff350154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 0x7ff350068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501551e0 con 0x7ff3501578d0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350169f10 con 0x7ff350157ca0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500accf0 con 0x7ff35006d120 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54314/0 (socket says 172.21.15.6:54314) 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 -- 172.21.15.6:0/3499686928 learned_addr learned my addr 172.21.15.6:0/3499686928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff356c19700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 0x7ff350068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff356418700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 0x7ff350154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 -- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 msgr2=0x7ff350154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 0x7ff350154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 -- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 msgr2=0x7ff350068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 0x7ff350068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 -- 172.21.15.6:0/3499686928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009a20 con 0x7ff3501578d0 2023-10-09T11:42:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff356c19700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 0x7ff350068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff356418700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 0x7ff350154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff355c17700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c5b0 tx=0x7ff344001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344005b30 con 0x7ff3501578d0 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344005c90 con 0x7ff3501578d0 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff348009420 con 0x7ff3501578d0 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.294+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344007300 con 0x7ff3501578d0 2023-10-09T11:42:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.295+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500ac730 con 0x7ff3501578d0 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.296+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350067ac0 con 0x7ff3501578d0 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.296+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff34401b3b0 con 0x7ff3501578d0 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.296+0000 7ff34e7fc700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.296+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff344083800 con 0x7ff3501578d0 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.296+0000 7ff356418700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.297+0000 7ff356418700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff350069950 tx=0x7ff34000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.301+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff344050a70 con 0x7ff3501578d0 2023-10-09T11:42:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.541+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff35006dac0 con 0x7ff3501578d0 2023-10-09T11:42:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.542+0000 7ff34e7fc700 1 -- 172.21.15.6:0/3499686928 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff35006dac0 con 0x7ff3501578d0 2023-10-09T11:42:18.542 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 msgr2=0x7ff33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff350069950 tx=0x7ff34000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 msgr2=0x7ff3500b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c5b0 tx=0x7ff344001070 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 shutdown_connections 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff350157ca0 0x7ff350068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff35006d120 0x7ff350154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 --2- 172.21.15.6:0/3499686928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500b56d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 >> 172.21.15.6:0/3499686928 conn(0x7ff35006bb90 msgr2=0x7ff35006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 shutdown_connections 2023-10-09T11:42:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:18.544+0000 7ff35867c700 1 -- 172.21.15.6:0/3499686928 wait complete. 2023-10-09T11:42:18.556 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:18.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:18.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:18.557 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:18.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.557 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:42:18.572 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:18.572 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:18.572 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:18.572 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:42:18.573 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42123sec preferred_lft 42123sec 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.574 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:18.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.575 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:18.636 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:42:18.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.637 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:18.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:42:18.694 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:42:18.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.795 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:42:18.809 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:42:18.809 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:42:18.809 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:18.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:18.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:42:18.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:18.874 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:18.929 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:42:18.929 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:18.929 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:18.984 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:42:18.984 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:18.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:19.065 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:19.065 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:19.084 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:19.084 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:19.084 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:42:19.084 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:42:19.084 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:42:19.085 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:19.085 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:19.085 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:19.106 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:19.106 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:19.106 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:42:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:42:19.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:19.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:19.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:42:19.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.333+0000 7f517c7c7700 1 Processor -- start 2023-10-09T11:42:19.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.333+0000 7f517c7c7700 1 -- start start 2023-10-09T11:42:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.334+0000 7f517c7c7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5174157fe0 0x7f51740b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.334+0000 7f517c7c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f51740b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.334+0000 7f517c7c7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740b2890 con 0x7f51741583b0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.334+0000 7f517c7c7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51740b4070 con 0x7f5174157fe0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.334+0000 7f517c7c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51740b4350 con 0x7f51740cf240 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179d62700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51741583b0 0x7f51740ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42352/0 (socket says 172.21.15.6:42352) 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179d62700 1 -- 172.21.15.6:0/3533629919 learned_addr learned my addr 172.21.15.6:0/3533629919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f517a563700 1 --2- 172.21.15.6:0/3533629919 >> v2:172.21.15.118:3300/0 conn(0x7f5174157fe0 0x7f51740b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f517ad64700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f51740b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856515670 0 0) 0x7f51740b2890 con 0x7f51741583b0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c003570 con 0x7f51741583b0 2023-10-09T11:42:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1576105844 0 0) 0x7f515c003570 con 0x7f51741583b0 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 msgr2=0x7f51740b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f51740b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 >> v2:172.21.15.118:3300/0 conn(0x7f5174157fe0 msgr2=0x7f51740b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 --2- 172.21.15.6:0/3533629919 >> v2:172.21.15.118:3300/0 conn(0x7f5174157fe0 0x7f51740b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740b4630 con 0x7f51741583b0 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f5168001470 con 0x7f51741583b0 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 >> v1:172.21.15.6:6789/0 conn(0x7f51741583b0 legacy=0x7f51740ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f515c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f515c003fe0 0x7f515c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51740b4070 con 0x7f515c004d50 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51740b4350 con 0x7f515c003fe0 2023-10-09T11:42:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c00bb40 con 0x7f51740cf240 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f517ad64700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f5179d62700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f515c003fe0 0x7f515c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.335+0000 7f517a563700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f515c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 -- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 msgr2=0x7f515c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51740cf240 0x7f515c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 -- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f515c003fe0 msgr2=0x7f515c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f515c003fe0 0x7f515c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 -- 172.21.15.6:0/3533629919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c003570 con 0x7f515c004d50 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f51640094d0 tx=0x7f516400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df2939629dc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400ea00 con 0x7f515c004d50 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516400f040 con 0x7f515c004d50 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f5179561700 1 -- 172.21.15.6:0/3533629919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400ed90 con 0x7f515c004d50 2023-10-09T11:42:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517c7c7700 1 -- 172.21.15.6:0/3533629919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c004d50 msgr2=0x7f515c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517c7c7700 1 --2- 172.21.15.6:0/3533629919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f51640094d0 tx=0x7f516400b040 comp rx=0 tx=0).stop 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.336+0000 7f517ad64700 1 -- 172.21.15.6:0/3533629919 reap_dead start 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.337+0000 7f517c7c7700 1 -- 172.21.15.6:0/3533629919 shutdown_connections 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.337+0000 7f517c7c7700 1 -- 172.21.15.6:0/3533629919 >> 172.21.15.6:0/3533629919 conn(0x7f5174067640 msgr2=0x7f5174067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.337+0000 7f517c7c7700 1 -- 172.21.15.6:0/3533629919 shutdown_connections 2023-10-09T11:42:19.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.337+0000 7f517c7c7700 1 -- 172.21.15.6:0/3533629919 wait complete. 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 Processor -- start 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 -- start start 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f515c004d50 0x7f517414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f517415e490 0x7f517415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517415ee20 con 0x7f5174168750 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517415c950 con 0x7f517415e490 2023-10-09T11:42:19.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.338+0000 7f517c7c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517415bd40 con 0x7f515c004d50 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54334/0 (socket says 172.21.15.6:54334) 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 -- 172.21.15.6:0/4006968091 learned_addr learned my addr 172.21.15.6:0/4006968091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f517a563700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f515c004d50 0x7f517414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f517ad64700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f517415e490 0x7f517415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 -- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f515c004d50 msgr2=0x7f517414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f515c004d50 0x7f517414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 -- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f517415e490 msgr2=0x7f517415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f517415e490 0x7f517415e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 -- 172.21.15.6:0/4006968091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517415c020 con 0x7f5174168750 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f5179d62700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f51680079e0 tx=0x7f5168001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:19.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168018030 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5168007740 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517415c300 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800fad0 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.339+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51741518c0 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.340+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5174069e40 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.341+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f516801b070 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.341+0000 7f51727fc700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.341+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5168019070 con 0x7f5174168750 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.341+0000 7f517a563700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:19.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.341+0000 7f517a563700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 0x7f51600693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f516c006f00 tx=0x7f516c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:19.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.345+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51680515c0 con 0x7f5174168750 2023-10-09T11:42:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.583+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f51740cc6b0 con 0x7f5174168750 2023-10-09T11:42:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.583+0000 7f51727fc700 1 -- 172.21.15.6:0/4006968091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5168054be0 con 0x7f5174168750 2023-10-09T11:42:19.584 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 msgr2=0x7f51600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 0x7f51600693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f516c006f00 tx=0x7f516c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 msgr2=0x7f5174168bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f51680079e0 tx=0x7f5168001e90 comp rx=0 tx=0).stop 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 shutdown_connections 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f517415e490 0x7f517415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f515c004d50 0x7f517414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 --2- 172.21.15.6:0/4006968091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5174168750 0x7f5174168bc0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 >> 172.21.15.6:0/4006968091 conn(0x7f5174067640 msgr2=0x7f51740ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 shutdown_connections 2023-10-09T11:42:19.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:19.585+0000 7f517c7c7700 1 -- 172.21.15.6:0/4006968091 wait complete. 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:42:19.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:19.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.598 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:19.617 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42135sec preferred_lft 42135sec 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:42:19.618 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:42:19.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.620 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:42:19.684 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:42:19.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.685 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:42:19.742 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:42:19.742 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:42:19.742 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:42:19.742 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:42:19.742 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:42:19.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:42:19.743 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:42:19.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.846 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:42:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:42:19.860 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:42:19.860 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:19.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:19.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:42:19.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:19.925 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:19.980 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:42:19.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:42:19.980 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:20.034 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:42:20.034 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:42:20.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:20.114 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:20.114 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:20.132 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:20.132 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:20.133 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:20.153 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:42:20.153 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:42:20.154 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:42:20.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:42:20.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:20.155 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:20.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.344+0000 7f18fa11f700 1 Processor -- start 2023-10-09T11:42:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.344+0000 7f18fa11f700 1 -- start start 2023-10-09T11:42:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18fa11f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18f40ce5c0 0x7f18f40aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18fa11f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18f40ac570 0x7f18f406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18fa11f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f415dfb0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18fa11f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f40acec0 con 0x7f18f40ac570 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18fa11f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f40ad1a0 con 0x7f18f40ce5c0 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18f37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18f40ce1f0 0x7f18f415e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42368/0 (socket says 172.21.15.6:42368) 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18f3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18f40ac570 0x7f18f406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.345+0000 7f18f37fe700 1 -- 172.21.15.6:0/1026684716 learned_addr learned my addr 172.21.15.6:0/1026684716 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f2ffd700 1 --2- 172.21.15.6:0/1026684716 >> v2:172.21.15.118:3300/0 conn(0x7f18f40ce5c0 0x7f18f40aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f27fc700 1 -- 172.21.15.6:0/1026684716 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327546635 0 0) 0x7f18f415dfb0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f27fc700 1 -- 172.21.15.6:0/1026684716 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18dc003570 con 0x7f18f40ce1f0 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f3fff700 1 -- 172.21.15.6:0/1026684716 >> v2:172.21.15.118:3300/0 conn(0x7f18f40ce5c0 msgr2=0x7f18f40aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f3fff700 1 --2- 172.21.15.6:0/1026684716 >> v2:172.21.15.118:3300/0 conn(0x7f18f40ce5c0 0x7f18f40aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f3fff700 1 -- 172.21.15.6:0/1026684716 >> v1:172.21.15.6:6789/0 conn(0x7f18f40ce1f0 legacy=0x7f18f415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f3fff700 1 -- 172.21.15.6:0/1026684716 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f415dc40 con 0x7f18f40ac570 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f3fff700 1 --2- 172.21.15.6:0/1026684716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ac570 0x7f18f406e230 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f18f406f590 tx=0x7f18ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21979d3bcb498b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f27fc700 1 -- 172.21.15.6:0/1026684716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00e070 con 0x7f18f40ac570 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f27fc700 1 -- 172.21.15.6:0/1026684716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec00bab0 con 0x7f18f40ac570 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.346+0000 7f18f27fc700 1 -- 172.21.15.6:0/1026684716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00be70 con 0x7f18f40ac570 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 -- 172.21.15.6:0/1026684716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ac570 msgr2=0x7f18f406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1026684716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ac570 0x7f18f406e230 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f18f406f590 tx=0x7f18ec009780 comp rx=0 tx=0).stop 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 -- 172.21.15.6:0/1026684716 shutdown_connections 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1026684716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ac570 0x7f18f406e230 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1026684716 >> v2:172.21.15.118:3300/0 conn(0x7f18f40ce5c0 0x7f18f40aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 -- 172.21.15.6:0/1026684716 >> 172.21.15.6:0/1026684716 conn(0x7f18f406cca0 msgr2=0x7f18f406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 -- 172.21.15.6:0/1026684716 shutdown_connections 2023-10-09T11:42:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.347+0000 7f18fa11f700 1 -- 172.21.15.6:0/1026684716 wait complete. 2023-10-09T11:42:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.348+0000 7f18fa11f700 1 Processor -- start 2023-10-09T11:42:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.348+0000 7f18fa11f700 1 -- start start 2023-10-09T11:42:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18f40ac570 0x7f18f415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18f40ce5c0 0x7f18f40adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40b2010 con 0x7f18f40ce1f0 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40b1400 con 0x7f18f40ac570 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40b16e0 con 0x7f18f40ce5c0 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54348/0 (socket says 172.21.15.6:54348) 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 -- 172.21.15.6:0/1868935400 learned_addr learned my addr 172.21.15.6:0/1868935400 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f37fe700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18f40ac570 0x7f18f415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f3fff700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18f40ce5c0 0x7f18f40adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 -- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18f40ce5c0 msgr2=0x7f18f40adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18f40ce5c0 0x7f18f40adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 -- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18f40ac570 msgr2=0x7f18f415c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18f40ac570 0x7f18f415c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 -- 172.21.15.6:0/1868935400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec009a20 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18f2ffd700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f18e800ec80 tx=0x7f18e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800c850 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800c9b0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f40b19c0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800cd50 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.349+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f415ca10 con 0x7f18f40ce1f0 2023-10-09T11:42:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.350+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f40b2180 con 0x7f18f40ce1f0 2023-10-09T11:42:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.351+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18e8013680 con 0x7f18f40ce1f0 2023-10-09T11:42:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.351+0000 7f18db7fe700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.351+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18e8084760 con 0x7f18f40ce1f0 2023-10-09T11:42:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.351+0000 7f18f37fe700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.352+0000 7f18f37fe700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 0x7f18e00693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007fd0 tx=0x7f18e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.356+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e80519d0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.595+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18f40ac9d0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.596+0000 7f18db7fe700 1 -- 172.21.15.6:0/1868935400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f18e8054ff0 con 0x7f18f40ce1f0 2023-10-09T11:42:20.596 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:20.596 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 msgr2=0x7f18e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 0x7f18e00693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007fd0 tx=0x7f18e4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 msgr2=0x7f18f40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f18e800ec80 tx=0x7f18e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 shutdown_connections 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18e0066f30 0x7f18e00693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18f40ce5c0 0x7f18f40adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18f40ac570 0x7f18f415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 --2- 172.21.15.6:0/1868935400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18f40ce1f0 0x7f18f40b24a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 >> 172.21.15.6:0/1868935400 conn(0x7f18f406cca0 msgr2=0x7f18f4155630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 shutdown_connections 2023-10-09T11:42:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.598+0000 7f18fa11f700 1 -- 172.21.15.6:0/1868935400 wait complete. 2023-10-09T11:42:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:20.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:42:20.745 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4708620840000002,"mdsmap_epoch":68,"osdmap_epoch":130,"osdmap_epoch_barrier":130,"uptime":13.556948504999999} 2023-10-09T11:42:20.746 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 68, "osdmap_epoch": 130, "osdmap_epoch_barrier": 130, "rank_uptime": 8.470862084, "state": "up:active", "uptime": 13.556948505, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:42:20.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T11:42:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.869+0000 7f3503d38700 1 Processor -- start 2023-10-09T11:42:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.869+0000 7f3503d38700 1 -- start start 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3503d38700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34fc06dd60 0x7f34fc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3503d38700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0b0ca0 con 0x7f34fc0cf240 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3503d38700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0b00d0 con 0x7f34fc15a2a0 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3503d38700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc06ea90 con 0x7f34fc06dd60 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35012d3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34fc0cf240 0x7f34fc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42376/0 (socket says 172.21.15.6:42376) 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35012d3700 1 -- 172.21.15.6:0/4287300662 learned_addr learned my addr 172.21.15.6:0/4287300662 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35022d5700 1 --2- 172.21.15.6:0/4287300662 >> v2:172.21.15.118:3300/0 conn(0x7f34fc06dd60 0x7f34fc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206626485 0 0) 0x7f34fc0b0ca0 con 0x7f34fc0cf240 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e8003570 con 0x7f34fc0cf240 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923822155 0 0) 0x7f34fc0b00d0 con 0x7f34fc15a2a0 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0b0ca0 con 0x7f34fc15a2a0 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35022d5700 1 -- 172.21.15.6:0/4287300662 >> v1:172.21.15.118:6789/0 conn(0x7f34fc15a2a0 legacy=0x7f34fc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35022d5700 1 -- 172.21.15.6:0/4287300662 >> v1:172.21.15.6:6789/0 conn(0x7f34fc0cf240 legacy=0x7f34fc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.870+0000 7f35022d5700 1 -- 172.21.15.6:0/4287300662 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0b0370 con 0x7f34fc06dd60 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f35022d5700 1 --2- 172.21.15.6:0/4287300662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc0b1130 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009e60 tx=0x7f34f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2473ad01bafb41d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400e070 con 0x7f34fc06dd60 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f400bab0 con 0x7f34fc06dd60 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3500ad2700 1 -- 172.21.15.6:0/4287300662 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400be70 con 0x7f34fc06dd60 2023-10-09T11:42:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 -- 172.21.15.6:0/4287300662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 msgr2=0x7f34fc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 --2- 172.21.15.6:0/4287300662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc0b1130 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009e60 tx=0x7f34f4009780 comp rx=0 tx=0).stop 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 -- 172.21.15.6:0/4287300662 shutdown_connections 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 --2- 172.21.15.6:0/4287300662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc0b1130 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 -- 172.21.15.6:0/4287300662 >> 172.21.15.6:0/4287300662 conn(0x7f34fc067640 msgr2=0x7f34fc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 -- 172.21.15.6:0/4287300662 shutdown_connections 2023-10-09T11:42:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.871+0000 7f3503d38700 1 -- 172.21.15.6:0/4287300662 wait complete. 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.872+0000 7f3503d38700 1 Processor -- start 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.872+0000 7f3503d38700 1 -- start start 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 0x7f34fc0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0b2e20 con 0x7f34fc0cf240 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc15c9a0 con 0x7f34fc06dd60 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f3503d38700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0cbd90 con 0x7f34fc15a2a0 2023-10-09T11:42:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f35012d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f35012d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54356/0 (socket says 172.21.15.6:54356) 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.873+0000 7f35012d3700 1 -- 172.21.15.6:0/2978487606 learned_addr learned my addr 172.21.15.6:0/2978487606 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35022d5700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 0x7f34fc0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f3501ad4700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 -- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 msgr2=0x7f34fc0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 0x7f34fc0ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 -- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 msgr2=0x7f34fc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 -- 172.21.15.6:0/2978487606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4009a20 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f3501ad4700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35022d5700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 0x7f34fc0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f35012d3700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0058d0 tx=0x7f34ec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec005b30 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec005c90 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc0b24f0 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0072e0 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.874+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc0b2ab0 con 0x7f34fc0cf240 2023-10-09T11:42:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.875+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc0b00d0 con 0x7f34fc0cf240 2023-10-09T11:42:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.876+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34ec0076d0 con 0x7f34fc0cf240 2023-10-09T11:42:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.876+0000 7f34f1ffb700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.876+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34ec0839f0 con 0x7f34fc0cf240 2023-10-09T11:42:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.876+0000 7f3501ad4700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.877+0000 7f3501ad4700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 0x7f34e00693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f34f8000c00 tx=0x7f34f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:20.880+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34ec04b5a0 con 0x7f34fc0cf240 2023-10-09T11:42:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.075+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f34fc0b2f60 con 0x7f34fc0cf240 2023-10-09T11:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.959+0000 7f34f1ffb700 1 -- 172.21.15.6:0/2978487606 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7f34ec017020 con 0x7f34fc0cf240 2023-10-09T11:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 msgr2=0x7f34e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 0x7f34e00693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f34f8000c00 tx=0x7f34f8009040 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 msgr2=0x7f34fc15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0058d0 tx=0x7f34ec007e10 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 shutdown_connections 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34e0066f30 0x7f34e00693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34fc15a2a0 0x7f34fc0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34fc06dd60 0x7f34fc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 --2- 172.21.15.6:0/2978487606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34fc0cf240 0x7f34fc15d0e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.961+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 >> 172.21.15.6:0/2978487606 conn(0x7f34fc067640 msgr2=0x7f34fc156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.962+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 shutdown_connections 2023-10-09T11:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:21.962+0000 7f3503d38700 1 -- 172.21.15.6:0/2978487606 wait complete. 2023-10-09T11:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T11:42:21.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:42:22.116 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:42:22.116 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:42:22.116 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-09T11:42:22.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:22.117 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-09T11:42:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:16+0 records in 2023-10-09T11:42:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:16+0 records out 2023-10-09T11:42:22.234 INFO:teuthology.orchestra.run.smithi006.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0986023 s, 170 MB/s 2023-10-09T11:42:22.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:22.235 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-09T11:42:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:17+0 records in 2023-10-09T11:42:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:17+0 records out 2023-10-09T11:42:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0991035 s, 180 MB/s 2023-10-09T11:42:22.352 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T11:42:22.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.471+0000 7fde14b68700 1 Processor -- start 2023-10-09T11:42:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.471+0000 7fde14b68700 1 -- start start 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde100aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde100ce5c0 0x7fde1015e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde100ac570 0x7fde1006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1015dfb0 con 0x7fde100ac570 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde100acec0 con 0x7fde100ce5c0 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde14b68700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100ad1a0 con 0x7fde100ce1f0 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde100ac570 0x7fde1006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde100ac570 0x7fde1006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54358/0 (socket says 172.21.15.6:54358) 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 -- 172.21.15.6:0/1583762359 learned_addr learned my addr 172.21.15.6:0/1583762359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0e59c700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde100aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0dd9b700 1 --2- 172.21.15.6:0/1583762359 >> v2:172.21.15.118:3300/0 conn(0x7fde100ce5c0 0x7fde1015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 -- 172.21.15.6:0/1583762359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 msgr2=0x7fde100aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde100aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 -- 172.21.15.6:0/1583762359 >> v2:172.21.15.118:3300/0 conn(0x7fde100ce5c0 msgr2=0x7fde1015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/1583762359 >> v2:172.21.15.118:3300/0 conn(0x7fde100ce5c0 0x7fde1015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 -- 172.21.15.6:0/1583762359 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1015dc40 con 0x7fde100ac570 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ac570 0x7fde1006e230 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fde10071580 tx=0x7fde00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa4d61dcd3a0b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:22.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.472+0000 7fde0d59a700 1 -- 172.21.15.6:0/1583762359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000b860 con 0x7fde100ac570 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde0d59a700 1 -- 172.21.15.6:0/1583762359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000b9c0 con 0x7fde100ac570 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde0d59a700 1 -- 172.21.15.6:0/1583762359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000bd60 con 0x7fde100ac570 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 -- 172.21.15.6:0/1583762359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ac570 msgr2=0x7fde1006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ac570 0x7fde1006e230 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fde10071580 tx=0x7fde00009250 comp rx=0 tx=0).stop 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 -- 172.21.15.6:0/1583762359 shutdown_connections 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ac570 0x7fde1006e230 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 --2- 172.21.15.6:0/1583762359 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde100aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 --2- 172.21.15.6:0/1583762359 >> v2:172.21.15.118:3300/0 conn(0x7fde100ce5c0 0x7fde1015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 -- 172.21.15.6:0/1583762359 >> 172.21.15.6:0/1583762359 conn(0x7fde1006cca0 msgr2=0x7fde1006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 -- 172.21.15.6:0/1583762359 shutdown_connections 2023-10-09T11:42:22.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.473+0000 7fde14b68700 1 -- 172.21.15.6:0/1583762359 wait complete. 2023-10-09T11:42:22.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.474+0000 7fde14b68700 1 Processor -- start 2023-10-09T11:42:22.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.474+0000 7fde14b68700 1 -- start start 2023-10-09T11:42:22.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde100ac570 0x7fde101561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde1015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1015d090 con 0x7fde100ce5c0 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1015c480 con 0x7fde100ac570 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde14b68700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1015c760 con 0x7fde100ce1f0 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54372/0 (socket says 172.21.15.6:54372) 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 -- 172.21.15.6:0/2139983914 learned_addr learned my addr 172.21.15.6:0/2139983914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0dd9b700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde1015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0e59c700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde100ac570 0x7fde101561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 -- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 msgr2=0x7fde1015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde1015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 -- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde100ac570 msgr2=0x7fde101561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde100ac570 0x7fde101561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.475+0000 7fde0ed9d700 1 -- 172.21.15.6:0/2139983914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000094f0 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde0ed9d700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fde1006cc70 tx=0x7fde00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00011ea0 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0001a630 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0001aa10 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1015ca40 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.476+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde10156710 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.477+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1015d200 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.477+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde0002d440 con 0x7fde100ce5c0 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.478+0000 7fde067fc700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:22.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.478+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde000860e0 con 0x7fde100ce5c0 2023-10-09T11:42:22.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.478+0000 7fde0e59c700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:22.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.478+0000 7fde0e59c700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde08009fd0 tx=0x7fde08009880 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:22.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.482+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde00053350 con 0x7fde100ce5c0 2023-10-09T11:42:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.677+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fde1015e980 con 0x7fde100ce5c0 2023-10-09T11:42:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.678+0000 7fde067fc700 1 -- 172.21.15.6:0/2139983914 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v131) v1 ==== 81+0+32234 (secure 0 0 0) 0x7fde00006d70 con 0x7fde100ce5c0 2023-10-09T11:42:22.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 131, 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:21.947243+0000", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:22.681 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:22.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:22.684 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:22.687 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:22.688 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:22.689 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:22.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:22.692 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:22.693 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:22.696 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "131", 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:22.697 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:22.698 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:22.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:22.700 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:22.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.702 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.703 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:22.704 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:22.707 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.708 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:22.709 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.711 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.712 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:22.713 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.715 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.716 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:22.717 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.718 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.720 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.721 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.725 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.726 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.728 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:22.730 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.732 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.734 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.735 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:22.740 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:22.746 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:22.747 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.749 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:22.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.751 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:22.753 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:22.755 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.756 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.757 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:22.758 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:22.759 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:22.760 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:22.762 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:22.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:22.763 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 msgr2=0x7fddf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde08009fd0 tx=0x7fde08009880 comp rx=0 tx=0).stop 2023-10-09T11:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 msgr2=0x7fde100b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fde1006cc70 tx=0x7fde00017000 comp rx=0 tx=0).stop 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 shutdown_connections 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde100ce5c0 0x7fde100b1d80 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde100ac570 0x7fde101561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 --2- 172.21.15.6:0/2139983914 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde100ce1f0 0x7fde1015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 >> 172.21.15.6:0/2139983914 conn(0x7fde1006cca0 msgr2=0x7fde10159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 shutdown_connections 2023-10-09T11:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:22.681+0000 7fde14b68700 1 -- 172.21.15.6:0/2139983914 wait complete. 2023-10-09T11:42:22.766 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:42:27.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.897+0000 7f9d2f566700 1 Processor -- start 2023-10-09T11:42:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.897+0000 7f9d2f566700 1 -- start start 2023-10-09T11:42:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2f566700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d28157fe0 0x7f9d280b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2f566700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d280b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2f566700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d280b2890 con 0x7f9d280ceb30 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2f566700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280b4070 con 0x7f9d28157fe0 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2f566700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280b4350 con 0x7f9d281583b0 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2d302700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d28157fe0 0x7f9d280b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2db03700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d280ceb30 0x7f9d280cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60976/0 (socket says 172.21.15.6:60976) 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2db03700 1 -- 172.21.15.6:0/210153718 learned_addr learned my addr 172.21.15.6:0/210153718 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.898+0000 7f9d2d302700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d28157fe0 0x7f9d280b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36634/0 (socket says 172.21.15.6:36634) 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d280b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2d302700 1 -- 172.21.15.6:0/210153718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 msgr2=0x7f9d280b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2d302700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d280b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2d302700 1 -- 172.21.15.6:0/210153718 >> v1:172.21.15.6:6789/0 conn(0x7f9d280ceb30 legacy=0x7f9d280cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2d302700 1 -- 172.21.15.6:0/210153718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280b4630 con 0x7f9d28157fe0 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d27fff700 1 -- 172.21.15.6:0/210153718 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971768262 0 0) 0x7f9d280b2890 con 0x7f9d280ceb30 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d280b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d2d302700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28157fe0 0x7f9d280b34c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9d200098e0 tx=0x7f9d200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e9e5363be77c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d27fff700 1 -- 172.21.15.6:0/210153718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20009e80 con 0x7f9d28157fe0 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d27fff700 1 -- 172.21.15.6:0/210153718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000b860 con 0x7f9d28157fe0 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.899+0000 7f9d27fff700 1 -- 172.21.15.6:0/210153718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000bbe0 con 0x7f9d28157fe0 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 -- 172.21.15.6:0/210153718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28157fe0 msgr2=0x7f9d280b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28157fe0 0x7f9d280b34c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9d200098e0 tx=0x7f9d200091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 -- 172.21.15.6:0/210153718 shutdown_connections 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d28157fe0 0x7f9d280b34c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 --2- 172.21.15.6:0/210153718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d280b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 -- 172.21.15.6:0/210153718 >> 172.21.15.6:0/210153718 conn(0x7f9d28067640 msgr2=0x7f9d28067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 -- 172.21.15.6:0/210153718 shutdown_connections 2023-10-09T11:42:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.900+0000 7f9d2f566700 1 -- 172.21.15.6:0/210153718 wait complete. 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.901+0000 7f9d2f566700 1 Processor -- start 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.901+0000 7f9d2f566700 1 -- start start 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 0x7f9d280c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d281552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c6710 con 0x7f9d280ceb30 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c5b00 con 0x7f9d28157fe0 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2f566700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c5de0 con 0x7f9d281583b0 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36636/0 (socket says 172.21.15.6:36636) 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 -- 172.21.15.6:0/46917254 learned_addr learned my addr 172.21.15.6:0/46917254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2db03700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d281552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 0x7f9d280c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 -- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 msgr2=0x7f9d281552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d281552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 -- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 msgr2=0x7f9d280c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 0x7f9d280c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20009420 con 0x7f9d280ceb30 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 0x7f9d280c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d2d302700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000b3c0 tx=0x7f9d20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000bbe0 con 0x7f9d280ceb30 2023-10-09T11:42:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.902+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20011420 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.903+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d280c60c0 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.903+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200117e0 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.903+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2814de80 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.903+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d28069e40 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.904+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d20011b90 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.904+0000 7f9d257fa700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 0x7f9d140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.904+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d20085fe0 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.904+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 0x7f9d140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.905+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f9d1406ea50 con 0x7f9d280ceb30 2023-10-09T11:42:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.905+0000 7f9d2cb01700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 0x7f9d140693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d280c5000 tx=0x7f9d1c006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:27.909+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d2005ae60 con 0x7f9d280ceb30 2023-10-09T11:42:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.107+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9d280cc6b0 con 0x7f9d280ceb30 2023-10-09T11:42:28.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.108+0000 7f9d257fa700 1 -- 172.21.15.6:0/46917254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f9d20015070 con 0x7f9d280ceb30 2023-10-09T11:42:28.110 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:28.110 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:28.111 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 132, 2023-10-09T11:42:28.111 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:28.111 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:28.111 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:25.928912+0000", 2023-10-09T11:42:28.111 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:28.112 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:28.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:28.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:28.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:28.112 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:28.113 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:28.113 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:28.113 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:28.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.113 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:28.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.115 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:28.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:28.117 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.119 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:28.121 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:28.123 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.124 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.126 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.127 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.128 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:28.130 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "132", 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.131 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.132 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.134 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.135 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.136 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.140 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:28.141 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:28.142 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.143 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.145 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.145 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.145 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.145 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.145 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:28.146 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.148 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.151 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.154 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:28.155 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.156 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.159 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.162 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.163 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.164 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.165 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:28.170 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.171 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:28.172 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.176 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.176 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.178 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.179 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:28.180 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.182 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:28.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:28.186 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.187 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:28.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.193 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.194 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:28.195 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:28.197 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.198 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:28.200 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:28.201 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:28.202 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.203 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 msgr2=0x7f9d140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 0x7f9d140693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d280c5000 tx=0x7f9d1c006f90 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 msgr2=0x7f9d2814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000b3c0 tx=0x7f9d20017000 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 shutdown_connections 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d14066f30 0x7f9d140693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d281583b0 0x7f9d281552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d280ceb30 0x7f9d2814d940 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 --2- 172.21.15.6:0/46917254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d28157fe0 0x7f9d280c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 >> 172.21.15.6:0/46917254 conn(0x7f9d28067640 msgr2=0x7f9d28156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 shutdown_connections 2023-10-09T11:42:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.110+0000 7f9d2f566700 1 -- 172.21.15.6:0/46917254 wait complete. 2023-10-09T11:42:28.206 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-09T11:42:28.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:28.206 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-09T11:42:28.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:42:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T11:42:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:42:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:42:28.461 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.233865 s, 224 MB/s 2023-10-09T11:42:28.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.577+0000 7f51a87e8700 1 Processor -- start 2023-10-09T11:42:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.577+0000 7f51a87e8700 1 -- start start 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a87e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f51a00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a87e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00d07c0 con 0x7f51a0157ca0 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a87e8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a00cfbb0 con 0x7f51a01578d0 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a87e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00cfe90 con 0x7f51a006d830 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a5d83700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51a0157ca0 0x7f51a006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60988/0 (socket says 172.21.15.6:60988) 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.578+0000 7f51a5d83700 1 -- 172.21.15.6:0/1419282021 learned_addr learned my addr 172.21.15.6:0/1419282021 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a6d85700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f51a00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532217273 0 0) 0x7f51a00d07c0 con 0x7f51a0157ca0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5188003570 con 0x7f51a0157ca0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583001231 0 0) 0x7f51a00cfbb0 con 0x7f51a01578d0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a00d07c0 con 0x7f51a01578d0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80523673 0 0) 0x7f5188003570 con 0x7f51a0157ca0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 msgr2=0x7f51a00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f51a00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 >> v1:172.21.15.118:6789/0 conn(0x7f51a01578d0 legacy=0x7f51a015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00d0170 con 0x7f51a0157ca0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f5194001470 con 0x7f51a0157ca0 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 >> v1:172.21.15.6:6789/0 conn(0x7f51a0157ca0 legacy=0x7f51a006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f5188003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f5188004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5188004d50 0x7f51880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00cfe90 con 0x7f5188004180 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518800bba0 con 0x7f5188004d50 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518800bd60 con 0x7f51a006d830 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a5d83700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f5188004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a6584700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f5188003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.579+0000 7f51a6d85700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5188004d50 0x7f51880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 -- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 msgr2=0x7f5188003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a006d830 0x7f5188003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 -- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5188004d50 msgr2=0x7f51880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5188004d50 0x7f51880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 -- 172.21.15.6:0/1419282021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188003570 con 0x7f5188004180 2023-10-09T11:42:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5d83700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f5188004810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f519400c2a0 tx=0x7f51a015b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c942e19366dd5d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400cbd0 con 0x7f5188004180 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400cd30 con 0x7f5188004180 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a5582700 1 -- 172.21.15.6:0/1419282021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400cea0 con 0x7f5188004180 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a87e8700 1 -- 172.21.15.6:0/1419282021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 msgr2=0x7f5188004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a87e8700 1 --2- 172.21.15.6:0/1419282021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f5188004810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f519400c2a0 tx=0x7f51a015b610 comp rx=0 tx=0).stop 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.580+0000 7f51a6d85700 1 -- 172.21.15.6:0/1419282021 reap_dead start 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.581+0000 7f51a87e8700 1 -- 172.21.15.6:0/1419282021 shutdown_connections 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.581+0000 7f51a87e8700 1 -- 172.21.15.6:0/1419282021 >> 172.21.15.6:0/1419282021 conn(0x7f51a006bb90 msgr2=0x7f51a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.581+0000 7f51a87e8700 1 -- 172.21.15.6:0/1419282021 shutdown_connections 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.581+0000 7f51a87e8700 1 -- 172.21.15.6:0/1419282021 wait complete. 2023-10-09T11:42:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 Processor -- start 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 -- start start 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a00cc4d0 0x7f51a016b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a015c650 0x7f51a015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00ca820 con 0x7f5188004180 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a015d010 con 0x7f51a015c650 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a87e8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00cdb70 con 0x7f51a00cc4d0 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a6584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a6584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36656/0 (socket says 172.21.15.6:36656) 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.582+0000 7f51a6584700 1 -- 172.21.15.6:0/2640741286 learned_addr learned my addr 172.21.15.6:0/2640741286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6d85700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a015c650 0x7f51a015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a5d83700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a00cc4d0 0x7f51a016b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 -- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a00cc4d0 msgr2=0x7f51a016b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a00cc4d0 0x7f51a016b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 -- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a015c650 msgr2=0x7f51a015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a015c650 0x7f51a015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00cd6e0 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a6584700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f519000ecf0 tx=0x7f51900017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000c910 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000ca70 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a016b660 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000ce30 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.583+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a00ccdb0 con 0x7f5188004180 2023-10-09T11:42:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.584+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a00cd9c0 con 0x7f5188004180 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.584+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5190014690 con 0x7f5188004180 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.585+0000 7f519e7fc700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.585+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5190084b40 con 0x7f5188004180 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.585+0000 7f51a5d83700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.585+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f518c06ea50 con 0x7f5188004180 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.585+0000 7f51a5d83700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 0x7f518c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5194007c60 tx=0x7f5194015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.589+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5190051e30 con 0x7f5188004180 2023-10-09T11:42:28.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.785+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f51a00d0450 con 0x7f5188004180 2023-10-09T11:42:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.786+0000 7f519e7fc700 1 -- 172.21.15.6:0/2640741286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f5190055450 con 0x7f5188004180 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 132, 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:25.928912+0000", 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.792 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.793 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.794 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.795 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.796 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:28.797 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.798 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.799 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.800 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.801 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:28.803 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:28.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:28.805 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:28.806 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "132", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:28.807 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:28.808 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:28.810 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:28.811 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:28.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.817 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.818 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:28.824 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.825 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.827 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.828 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.831 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.832 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.836 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:28.838 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.844 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.847 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.849 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.850 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:28.851 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.853 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:28.857 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:28.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:28.862 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:28.864 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.865 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:28.867 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:28.869 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.870 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:28.871 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:28.872 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:28.874 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:28.875 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 msgr2=0x7f518c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 0x7f518c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5194007c60 tx=0x7f5194015000 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 msgr2=0x7f51a016a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f519000ecf0 tx=0x7f51900017e0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 shutdown_connections 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f518c066f30 0x7f518c0693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51a015c650 0x7f51a015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5188004180 0x7f51a016a220 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 --2- 172.21.15.6:0/2640741286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51a00cc4d0 0x7f51a016b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 >> 172.21.15.6:0/2640741286 conn(0x7f51a006bb90 msgr2=0x7f51a0156970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 shutdown_connections 2023-10-09T11:42:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.788+0000 7f51a87e8700 1 -- 172.21.15.6:0/2640741286 wait complete. 2023-10-09T11:42:28.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.996+0000 7f0e6dffb700 1 Processor -- start 2023-10-09T11:42:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.996+0000 7f0e6dffb700 1 -- start start 2023-10-09T11:42:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.996+0000 7f0e6dffb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e681578d0 0x7f0e680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e6dffb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0e6806d120 0x7f0e6806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e6dffb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680d07c0 con 0x7f0e68157ca0 2023-10-09T11:42:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e6dffb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6806da50 con 0x7f0e681578d0 2023-10-09T11:42:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e6dffb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680cfbb0 con 0x7f0e6806d120 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e681578d0 0x7f0e680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e681578d0 0x7f0e680cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36660/0 (socket says 172.21.15.6:36660) 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 -- 172.21.15.6:0/2537761198 learned_addr learned my addr 172.21.15.6:0/2537761198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e67fff700 1 --2- 172.21.15.6:0/2537761198 >> v2:172.21.15.118:3300/0 conn(0x7f0e6806d120 0x7f0e6806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 -- 172.21.15.6:0/2537761198 >> v2:172.21.15.118:3300/0 conn(0x7f0e6806d120 msgr2=0x7f0e6806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 --2- 172.21.15.6:0/2537761198 >> v2:172.21.15.118:3300/0 conn(0x7f0e6806d120 0x7f0e6806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 -- 172.21.15.6:0/2537761198 >> v1:172.21.15.118:6789/0 conn(0x7f0e68157ca0 legacy=0x7f0e6815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 -- 172.21.15.6:0/2537761198 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680cfe90 con 0x7f0e681578d0 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e677fe700 1 --2- 172.21.15.6:0/2537761198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e681578d0 0x7f0e680cf4f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0e68068300 tx=0x7f0e58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2932878343f3e26c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e667fc700 1 -- 172.21.15.6:0/2537761198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58009e70 con 0x7f0e681578d0 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e667fc700 1 -- 172.21.15.6:0/2537761198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800b860 con 0x7f0e681578d0 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.997+0000 7f0e667fc700 1 -- 172.21.15.6:0/2537761198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800bc00 con 0x7f0e681578d0 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 -- 172.21.15.6:0/2537761198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e681578d0 msgr2=0x7f0e680cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/2537761198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e681578d0 0x7f0e680cf4f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0e68068300 tx=0x7f0e58009250 comp rx=0 tx=0).stop 2023-10-09T11:42:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 -- 172.21.15.6:0/2537761198 shutdown_connections 2023-10-09T11:42:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/2537761198 >> v2:172.21.15.118:3300/0 conn(0x7f0e6806d120 0x7f0e6806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/2537761198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e681578d0 0x7f0e680cf4f0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 -- 172.21.15.6:0/2537761198 >> 172.21.15.6:0/2537761198 conn(0x7f0e6806bb90 msgr2=0x7f0e6806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 -- 172.21.15.6:0/2537761198 shutdown_connections 2023-10-09T11:42:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.998+0000 7f0e6dffb700 1 -- 172.21.15.6:0/2537761198 wait complete. 2023-10-09T11:42:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.999+0000 7f0e6dffb700 1 Processor -- start 2023-10-09T11:42:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:28.999+0000 7f0e6dffb700 1 -- start start 2023-10-09T11:42:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e68157ca0 0x7f0e681476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e68147be0 0x7f0e680b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68148060 con 0x7f0e6806d120 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b18d0 con 0x7f0e68147be0 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e6dffb700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680b1bb0 con 0x7f0e68157ca0 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36676/0 (socket says 172.21.15.6:36676) 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 -- 172.21.15.6:0/3164646917 learned_addr learned my addr 172.21.15.6:0/3164646917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e66ffd700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e68157ca0 0x7f0e681476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e67fff700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e68147be0 0x7f0e680b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 -- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e68157ca0 msgr2=0x7f0e681476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e68157ca0 0x7f0e681476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 -- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e68147be0 msgr2=0x7f0e680b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e68147be0 0x7f0e680b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.000+0000 7f0e677fe700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580094f0 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e677fe700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806fe20 tx=0x7f0e58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800bbe0 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58011420 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e680b1e90 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e580117c0 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.001+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e680b2450 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.002+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e680abdb0 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.002+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e58011bf0 con 0x7f0e6806d120 2023-10-09T11:42:29.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.003+0000 7f0e4f7fe700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 0x7f0e540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.003+0000 7f0e66ffd700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 0x7f0e540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.003+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e58085e50 con 0x7f0e6806d120 2023-10-09T11:42:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.003+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f0e5406ea50 con 0x7f0e6806d120 2023-10-09T11:42:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.003+0000 7f0e66ffd700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 0x7f0e540693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0e6814b740 tx=0x7f0e5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.007+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e580530c0 con 0x7f0e6806d120 2023-10-09T11:42:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.244+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e680d0170 con 0x7f0e6806d120 2023-10-09T11:42:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.245+0000 7f0e4f7fe700 1 -- 172.21.15.6:0/3164646917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f0e58015020 con 0x7f0e6806d120 2023-10-09T11:42:29.246 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:29.247 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 msgr2=0x7f0e540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 0x7f0e540693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0e6814b740 tx=0x7f0e5c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 msgr2=0x7f0e68159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806fe20 tx=0x7f0e58017000 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 shutdown_connections 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0e54066f30 0x7f0e540693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e68147be0 0x7f0e680b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e6806d120 0x7f0e68159890 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 --2- 172.21.15.6:0/3164646917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e68157ca0 0x7f0e681476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 >> 172.21.15.6:0/3164646917 conn(0x7f0e6806bb90 msgr2=0x7f0e68156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 shutdown_connections 2023-10-09T11:42:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.247+0000 7f0e6dffb700 1 -- 172.21.15.6:0/3164646917 wait complete. 2023-10-09T11:42:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:29.261 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:42:29.415 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.141585473999999,"mdsmap_epoch":68,"osdmap_epoch":132,"osdmap_epoch_barrier":132,"uptime":22.227674739000001} 2023-10-09T11:42:29.415 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 68, "osdmap_epoch": 132, "osdmap_epoch_barrier": 132, "rank_uptime": 17.141585474, "state": "up:active", "uptime": 22.227674739, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:42:29.415 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:42:29.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:29.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T11:42:29.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:29.433 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T11:42:29.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:29.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.650+0000 7f7a48e24700 1 Processor -- start 2023-10-09T11:42:29.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.650+0000 7f7a48e24700 1 -- start start 2023-10-09T11:42:29.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a48e24700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a440cf240 0x7f7a440b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a48e24700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7a4406d650 0x7f7a4406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a48e24700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440b0ca0 con 0x7f7a4415a2a0 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a48e24700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4406ea90 con 0x7f7a440cf240 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a48e24700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440b00d0 con 0x7f7a4406d650 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a41d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a440cf240 0x7f7a440b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a41d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a440cf240 0x7f7a440b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36684/0 (socket says 172.21.15.6:36684) 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a41d9b700 1 -- 172.21.15.6:0/2221845699 learned_addr learned my addr 172.21.15.6:0/2221845699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.651+0000 7f7a42d9d700 1 --2- 172.21.15.6:0/2221845699 >> v2:172.21.15.118:3300/0 conn(0x7f7a4406d650 0x7f7a4406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a41d9b700 1 -- 172.21.15.6:0/2221845699 >> v2:172.21.15.118:3300/0 conn(0x7f7a4406d650 msgr2=0x7f7a4406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a41d9b700 1 --2- 172.21.15.6:0/2221845699 >> v2:172.21.15.118:3300/0 conn(0x7f7a4406d650 0x7f7a4406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a41d9b700 1 -- 172.21.15.6:0/2221845699 >> v1:172.21.15.118:6789/0 conn(0x7f7a4415a2a0 legacy=0x7f7a440ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a41d9b700 1 -- 172.21.15.6:0/2221845699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440b0370 con 0x7f7a440cf240 2023-10-09T11:42:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a4159a700 1 -- 172.21.15.6:0/2221845699 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290463934 0 0) 0x7f7a440b0ca0 con 0x7f7a4415a2a0 2023-10-09T11:42:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a41d9b700 1 --2- 172.21.15.6:0/2221845699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a440cf240 0x7f7a440b1130 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406a680 tx=0x7f7a2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d209b7062f7a61ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a4159a700 1 -- 172.21.15.6:0/2221845699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c009e70 con 0x7f7a440cf240 2023-10-09T11:42:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a4159a700 1 -- 172.21.15.6:0/2221845699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00b860 con 0x7f7a440cf240 2023-10-09T11:42:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a4159a700 1 -- 172.21.15.6:0/2221845699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00bc00 con 0x7f7a440cf240 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a48e24700 1 -- 172.21.15.6:0/2221845699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a440cf240 msgr2=0x7f7a440b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.652+0000 7f7a48e24700 1 --2- 172.21.15.6:0/2221845699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a440cf240 0x7f7a440b1130 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406a680 tx=0x7f7a2c009250 comp rx=0 tx=0).stop 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 -- 172.21.15.6:0/2221845699 shutdown_connections 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 --2- 172.21.15.6:0/2221845699 >> v2:172.21.15.118:3300/0 conn(0x7f7a4406d650 0x7f7a4406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 --2- 172.21.15.6:0/2221845699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a440cf240 0x7f7a440b1130 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 -- 172.21.15.6:0/2221845699 >> 172.21.15.6:0/2221845699 conn(0x7f7a44067640 msgr2=0x7f7a44067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 -- 172.21.15.6:0/2221845699 shutdown_connections 2023-10-09T11:42:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.653+0000 7f7a48e24700 1 -- 172.21.15.6:0/2221845699 wait complete. 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 Processor -- start 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 -- start start 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a440cf240 0x7f7a4415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a4415a2a0 0x7f7a44151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44150760 con 0x7f7a4406d650 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4414fcf0 con 0x7f7a440cf240 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.654+0000 7f7a48e24700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415d7c0 con 0x7f7a4415a2a0 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36688/0 (socket says 172.21.15.6:36688) 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 -- 172.21.15.6:0/1470312689 learned_addr learned my addr 172.21.15.6:0/1470312689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a42d9d700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a4415a2a0 0x7f7a44151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a41d9b700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a440cf240 0x7f7a4415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 -- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a4415a2a0 msgr2=0x7f7a44151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a4415a2a0 0x7f7a44151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 -- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a440cf240 msgr2=0x7f7a4415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a440cf240 0x7f7a4415d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0094f0 con 0x7f7a4406d650 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a4259c700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c910 tx=0x7f7a3c001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c012630 con 0x7f7a4406d650 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0127b0 con 0x7f7a4406d650 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a44153a20 con 0x7f7a4406d650 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c012b70 con 0x7f7a4406d650 2023-10-09T11:42:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.655+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a44150c80 con 0x7f7a4406d650 2023-10-09T11:42:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.656+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a44069e40 con 0x7f7a4406d650 2023-10-09T11:42:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a3c003030 con 0x7f7a4406d650 2023-10-09T11:42:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a3a7fc700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 0x7f7a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a3c0844a0 con 0x7f7a4406d650 2023-10-09T11:42:29.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a41d9b700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 0x7f7a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:29.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f7a2406ea50 con 0x7f7a4406d650 2023-10-09T11:42:29.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.657+0000 7f7a41d9b700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 0x7f7a240693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406f960 tx=0x7f7a2c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:29.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.661+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a3c051710 con 0x7f7a4406d650 2023-10-09T11:42:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.856+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7a4404bb80 con 0x7f7a4406d650 2023-10-09T11:42:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.857+0000 7f7a3a7fc700 1 -- 172.21.15.6:0/1470312689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f7a3c054d30 con 0x7f7a4406d650 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 132, 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:25.928912+0000", 2023-10-09T11:42:29.859 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:29.860 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:29.861 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:29.862 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:29.863 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:29.864 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:29.865 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.867 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:29.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:29.869 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:29.870 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:29.871 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:29.872 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:29.873 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:29.874 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:29.875 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:29.876 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "132", 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:29.877 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:29.878 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:29.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:29.881 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.882 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:29.883 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.887 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:29.888 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.891 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:29.892 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.894 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.898 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.899 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.900 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.901 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.903 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:29.905 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.908 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:29.909 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.918 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:29.920 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.921 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.923 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.925 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:29.928 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.929 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:29.933 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:29.934 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.935 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.936 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:29.937 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:29.939 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:29.940 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:29.941 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:29.942 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:29.943 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 msgr2=0x7f7a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 0x7f7a240693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a4406f960 tx=0x7f7a2c017000 comp rx=0 tx=0).stop 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 msgr2=0x7f7a4414f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c910 tx=0x7f7a3c001700 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 shutdown_connections 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7a24066f30 0x7f7a240693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a4415a2a0 0x7f7a44151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a4406d650 0x7f7a4414f7b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 --2- 172.21.15.6:0/1470312689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a440cf240 0x7f7a4415d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 >> 172.21.15.6:0/1470312689 conn(0x7f7a44067640 msgr2=0x7f7a44158160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 shutdown_connections 2023-10-09T11:42:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:29.859+0000 7f7a48e24700 1 -- 172.21.15.6:0/1470312689 wait complete. 2023-10-09T11:42:29.947 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:42:34.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:34.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:42:34.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.079+0000 7f3ab54ff700 1 Processor -- start 2023-10-09T11:42:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.079+0000 7f3ab54ff700 1 -- start start 2023-10-09T11:42:35.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3ab54ff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ab01578d0 0x7f3ab00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3ab54ff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00d07c0 con 0x7f3ab006d120 2023-10-09T11:42:35.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3ab54ff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00cfbb0 con 0x7f3ab0157ca0 2023-10-09T11:42:35.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3ab54ff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00cfe90 con 0x7f3ab01578d0 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ab01578d0 0x7f3ab00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ab01578d0 0x7f3ab00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36500/0 (socket says 172.21.15.6:36500) 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 -- 172.21.15.6:0/989881541 learned_addr learned my addr 172.21.15.6:0/989881541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaf7fe700 1 --1- 172.21.15.6:0/989881541 >> v1:172.21.15.6:6789/0 conn(0x7f3ab006d120 0x7f3ab006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58184/0 (socket says 172.21.15.6:58184) 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 -- 172.21.15.6:0/989881541 >> v1:172.21.15.118:6789/0 conn(0x7f3ab0157ca0 legacy=0x7f3ab015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 -- 172.21.15.6:0/989881541 >> v1:172.21.15.6:6789/0 conn(0x7f3ab006d120 legacy=0x7f3ab006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aadffb700 1 -- 172.21.15.6:0/989881541 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023117671 0 0) 0x7f3ab00d07c0 con 0x7f3ab006d120 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.080+0000 7f3aaeffd700 1 -- 172.21.15.6:0/989881541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00d0170 con 0x7f3ab01578d0 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3aaeffd700 1 --2- 172.21.15.6:0/989881541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01578d0 0x7f3ab00cf4f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009f20 tx=0x7f3aa8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b18584e8a5353 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3aadffb700 1 -- 172.21.15.6:0/989881541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800e070 con 0x7f3ab01578d0 2023-10-09T11:42:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3aadffb700 1 -- 172.21.15.6:0/989881541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800ba80 con 0x7f3ab01578d0 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3aadffb700 1 -- 172.21.15.6:0/989881541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80092e0 con 0x7f3ab01578d0 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 -- 172.21.15.6:0/989881541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01578d0 msgr2=0x7f3ab00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/989881541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01578d0 0x7f3ab00cf4f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009f20 tx=0x7f3aa8009840 comp rx=0 tx=0).stop 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 -- 172.21.15.6:0/989881541 shutdown_connections 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/989881541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab01578d0 0x7f3ab00cf4f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 -- 172.21.15.6:0/989881541 >> 172.21.15.6:0/989881541 conn(0x7f3ab006bb90 msgr2=0x7f3ab006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 -- 172.21.15.6:0/989881541 shutdown_connections 2023-10-09T11:42:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.081+0000 7f3ab54ff700 1 -- 172.21.15.6:0/989881541 wait complete. 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 Processor -- start 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 -- start start 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ab006d120 0x7f3ab00cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ab01578d0 0x7f3ab016e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b5360 con 0x7f3ab0157ca0 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab016ea20 con 0x7f3ab006d120 2023-10-09T11:42:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.083+0000 7f3ab54ff700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cdc40 con 0x7f3ab01578d0 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36506/0 (socket says 172.21.15.6:36506) 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 -- 172.21.15.6:0/4223275002 learned_addr learned my addr 172.21.15.6:0/4223275002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaeffd700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ab006d120 0x7f3ab00cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aae7fc700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ab01578d0 0x7f3ab016e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 -- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ab01578d0 msgr2=0x7f3ab016e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ab01578d0 0x7f3ab016e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 -- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ab006d120 msgr2=0x7f3ab00cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ab006d120 0x7f3ab00cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa8009ae0 con 0x7f3ab0157ca0 2023-10-09T11:42:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aaf7fe700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c5e0 tx=0x7f3aa0007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0005a70 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0005bd0 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00b4d10 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00070d0 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.084+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab0152fa0 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.085+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab00b4b70 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.086+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3aa0007440 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.086+0000 7f3aa6ffd700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.086+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3aa0083990 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.086+0000 7f3aaeffd700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.086+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f3a9006ea50 con 0x7f3ab0157ca0 2023-10-09T11:42:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.087+0000 7f3aaeffd700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009880 tx=0x7f3aa8018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.091+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa0017070 con 0x7f3ab0157ca0 2023-10-09T11:42:35.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.286+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3ab00d0450 con 0x7f3ab0157ca0 2023-10-09T11:42:35.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.287+0000 7f3aa6ffd700 1 -- 172.21.15.6:0/4223275002 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f3ab00b4b70 con 0x7f3ab0157ca0 2023-10-09T11:42:35.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:35.289 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:35.289 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 132, 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:25.928912+0000", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:35.290 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:35.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:35.295 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:35.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:35.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:35.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:35.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:35.303 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:35.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.306 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:35.307 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:35.308 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "132", 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:35.310 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:35.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:35.312 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:35.313 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.314 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:35.317 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.319 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:35.320 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.322 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:35.323 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.327 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.329 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.330 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:35.331 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.333 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.334 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:35.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.341 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:35.343 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.346 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.347 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.348 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.352 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.354 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.355 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.360 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:35.361 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:35.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:35.367 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.369 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.371 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:35.372 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.373 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:35.374 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:35.375 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:35.376 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:35.377 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 msgr2=0x7f3a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 0x7f3a900693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009880 tx=0x7f3aa8018000 comp rx=0 tx=0).stop 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 msgr2=0x7f3ab0152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c5e0 tx=0x7f3aa0007d60 comp rx=0 tx=0).stop 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 shutdown_connections 2023-10-09T11:42:35.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3a90066f30 0x7f3a900693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ab0157ca0 0x7f3ab0152a60 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ab006d120 0x7f3ab00cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 --2- 172.21.15.6:0/4223275002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ab01578d0 0x7f3ab016e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 >> 172.21.15.6:0/4223275002 conn(0x7f3ab006bb90 msgr2=0x7f3ab015a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 shutdown_connections 2023-10-09T11:42:35.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:35.290+0000 7f3ab54ff700 1 -- 172.21.15.6:0/4223275002 wait complete. 2023-10-09T11:42:35.381 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:42:40.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.513+0000 7f3732b1a700 1 Processor -- start 2023-10-09T11:42:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.513+0000 7f3732b1a700 1 -- start start 2023-10-09T11:42:40.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f372c157860 0x7f372c06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f372c06a020 0x7f372c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c0cdb60 0x7f372c0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c0cb9d0 con 0x7f372c06a020 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c15b2d0 con 0x7f372c157860 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732b1a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c15a840 con 0x7f372c0cdb60 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3731317700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f372c06a020 0x7f372c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3731317700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f372c06a020 0x7f372c15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36520/0 (socket says 172.21.15.6:36520) 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3731317700 1 -- 172.21.15.6:0/3586579460 learned_addr learned my addr 172.21.15.6:0/3586579460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3732319700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c0cdb60 0x7f372c0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.514+0000 7f3731b18700 1 --2- 172.21.15.6:0/3586579460 >> v2:172.21.15.118:3300/0 conn(0x7f372c157860 0x7f372c06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 -- 172.21.15.6:0/3586579460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c0cdb60 msgr2=0x7f372c0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c0cdb60 0x7f372c0cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 -- 172.21.15.6:0/3586579460 >> v2:172.21.15.118:3300/0 conn(0x7f372c157860 msgr2=0x7f372c06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 --2- 172.21.15.6:0/3586579460 >> v2:172.21.15.118:3300/0 conn(0x7f372c157860 0x7f372c06dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 -- 172.21.15.6:0/3586579460 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0cbec0 con 0x7f372c06a020 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3731317700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c15a300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f372c068620 tx=0x7f3720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d27d8d15178409e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3730b16700 1 -- 172.21.15.6:0/3586579460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000b640 con 0x7f372c06a020 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3730b16700 1 -- 172.21.15.6:0/3586579460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372000b7a0 con 0x7f372c06a020 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.515+0000 7f3730b16700 1 -- 172.21.15.6:0/3586579460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000bb60 con 0x7f372c06a020 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 -- 172.21.15.6:0/3586579460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 msgr2=0x7f372c15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c15a300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f372c068620 tx=0x7f3720009250 comp rx=0 tx=0).stop 2023-10-09T11:42:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 -- 172.21.15.6:0/3586579460 shutdown_connections 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c0cdb60 0x7f372c0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 --2- 172.21.15.6:0/3586579460 >> v2:172.21.15.118:3300/0 conn(0x7f372c157860 0x7f372c06dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 --2- 172.21.15.6:0/3586579460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c15a300 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 -- 172.21.15.6:0/3586579460 >> 172.21.15.6:0/3586579460 conn(0x7f372c063230 msgr2=0x7f372c063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 -- 172.21.15.6:0/3586579460 shutdown_connections 2023-10-09T11:42:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.516+0000 7f3732b1a700 1 -- 172.21.15.6:0/3586579460 wait complete. 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.517+0000 7f3732b1a700 1 Processor -- start 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.517+0000 7f3732b1a700 1 -- start start 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c0cdb60 0x7f372c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c157860 0x7f372c14b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c154cf0 con 0x7f372c06a020 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c155b00 con 0x7f372c0cdb60 2023-10-09T11:42:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732b1a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c14aa40 con 0x7f372c157860 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36524/0 (socket says 172.21.15.6:36524) 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 -- 172.21.15.6:0/776751561 learned_addr learned my addr 172.21.15.6:0/776751561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3732319700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c157860 0x7f372c14b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731317700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c0cdb60 0x7f372c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 -- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c157860 msgr2=0x7f372c14b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c157860 0x7f372c14b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 -- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c0cdb60 msgr2=0x7f372c14d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c0cdb60 0x7f372c14d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 -- 172.21.15.6:0/776751561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200094f0 con 0x7f372c06a020 2023-10-09T11:42:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3731b18700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f372400ecb0 tx=0x7f37240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372400c9d0 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.518+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372400cb30 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.519+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c154ef0 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.519+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724013470 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.519+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c1554b0 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.520+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0690d0 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.520+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3724013820 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.521+0000 7f3729ffb700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 0x7f37180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.521+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3724084830 con 0x7f372c06a020 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.521+0000 7f3731317700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 0x7f37180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.521+0000 7f3731317700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 0x7f37180693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f372c068620 tx=0x7f3720017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.525+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3724051aa0 con 0x7f372c06a020 2023-10-09T11:42:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.719+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f372c071b10 con 0x7f372c06a020 2023-10-09T11:42:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.720+0000 7f3729ffb700 1 -- 172.21.15.6:0/776751561 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v133) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f3724084020 con 0x7f372c06a020 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 133, 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:35.931169+0000", 2023-10-09T11:42:40.722 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:40.723 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.724 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:40.725 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:40.726 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:40.727 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:40.728 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:40.729 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:40.730 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:40.732 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:40.733 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:40.734 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:40.735 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:40.736 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:40.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:40.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:40.739 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:40.740 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "133", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:40.741 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:40.742 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:40.743 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:40.744 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.745 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.747 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.748 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.752 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.756 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:40.758 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.759 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.761 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.765 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.766 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:40.768 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:40.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.773 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.777 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.782 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:40.784 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:40.785 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.786 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.791 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.792 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:40.793 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:40.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:40.797 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:40.798 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.799 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.804 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:40.805 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:40.806 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:40.807 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:40.808 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 msgr2=0x7f37180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 0x7f37180693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f372c068620 tx=0x7f3720017000 comp rx=0 tx=0).stop 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 msgr2=0x7f372c14a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f372400ecb0 tx=0x7f37240091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 shutdown_connections 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3718066f30 0x7f37180693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f372c157860 0x7f372c14b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f372c06a020 0x7f372c14a500 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 --2- 172.21.15.6:0/776751561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f372c0cdb60 0x7f372c14d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 >> 172.21.15.6:0/776751561 conn(0x7f372c063230 msgr2=0x7f372c1569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 shutdown_connections 2023-10-09T11:42:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.722+0000 7f3732b1a700 1 -- 172.21.15.6:0/776751561 wait complete. 2023-10-09T11:42:40.811 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T11:42:40.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:42:40.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.930+0000 7f456945c700 1 Processor -- start 2023-10-09T11:42:40.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.930+0000 7f456945c700 1 -- start start 2023-10-09T11:42:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f456945c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45640af270 0x7f45640c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f456945c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456406aae0 con 0x7f45640c3030 2023-10-09T11:42:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f456945c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564069ed0 con 0x7f45640aeea0 2023-10-09T11:42:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f456945c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456406a1b0 con 0x7f45640af270 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45640af270 0x7f45640c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45640af270 0x7f45640c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36540/0 (socket says 172.21.15.6:36540) 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45637fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45640c3030 0x7f45640c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58186/0 (socket says 172.21.15.6:58186) 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 -- 172.21.15.6:0/4035683082 learned_addr learned my addr 172.21.15.6:0/4035683082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 -- 172.21.15.6:0/4035683082 >> v1:172.21.15.118:6789/0 conn(0x7f45640aeea0 legacy=0x7f45640c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 -- 172.21.15.6:0/4035683082 >> v1:172.21.15.6:6789/0 conn(0x7f45640c3030 legacy=0x7f45640c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f45627fc700 1 -- 172.21.15.6:0/4035683082 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456406a490 con 0x7f45640af270 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.931+0000 7f4561ffb700 1 -- 172.21.15.6:0/4035683082 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250081705 0 0) 0x7f456406aae0 con 0x7f45640c3030 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f45627fc700 1 --2- 172.21.15.6:0/4035683082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f45640c7d00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f454c0099b0 tx=0x7f454c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2aa881569168be server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f4561ffb700 1 -- 172.21.15.6:0/4035683082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00b8b0 con 0x7f45640af270 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f4561ffb700 1 -- 172.21.15.6:0/4035683082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c00ba10 con 0x7f45640af270 2023-10-09T11:42:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f4561ffb700 1 -- 172.21.15.6:0/4035683082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00bdb0 con 0x7f45640af270 2023-10-09T11:42:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f456945c700 1 -- 172.21.15.6:0/4035683082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 msgr2=0x7f45640c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.932+0000 7f456945c700 1 --2- 172.21.15.6:0/4035683082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f45640c7d00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f454c0099b0 tx=0x7f454c009250 comp rx=0 tx=0).stop 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.933+0000 7f456945c700 1 -- 172.21.15.6:0/4035683082 shutdown_connections 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.933+0000 7f456945c700 1 --2- 172.21.15.6:0/4035683082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f45640c7d00 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.933+0000 7f456945c700 1 -- 172.21.15.6:0/4035683082 >> 172.21.15.6:0/4035683082 conn(0x7f456406c660 msgr2=0x7f45640cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.933+0000 7f456945c700 1 -- 172.21.15.6:0/4035683082 shutdown_connections 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.933+0000 7f456945c700 1 -- 172.21.15.6:0/4035683082 wait complete. 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.934+0000 7f456945c700 1 Processor -- start 2023-10-09T11:42:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.934+0000 7f456945c700 1 -- start start 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45640aeea0 0x7f456414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45640c3030 0x7f4564158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641585d0 con 0x7f45640af270 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641539b0 con 0x7f45640aeea0 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f456945c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4564157d30 con 0x7f45640c3030 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36546/0 (socket says 172.21.15.6:36546) 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 -- 172.21.15.6:0/825473030 learned_addr learned my addr 172.21.15.6:0/825473030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45637fe700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45640c3030 0x7f4564158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f4562ffd700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45640aeea0 0x7f456414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 -- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45640c3030 msgr2=0x7f4564158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45640c3030 0x7f4564158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 -- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45640aeea0 msgr2=0x7f456414f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45640aeea0 0x7f456414f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 -- 172.21.15.6:0/825473030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0094f0 con 0x7f45640af270 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f45627fc700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.935+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00bb80 con 0x7f45640af270 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.936+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c020070 con 0x7f45640af270 2023-10-09T11:42:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.936+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4564158010 con 0x7f45640af270 2023-10-09T11:42:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.936+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c01b450 con 0x7f45640af270 2023-10-09T11:42:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.936+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4564153640 con 0x7f45640af270 2023-10-09T11:42:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.937+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564067bc0 con 0x7f45640af270 2023-10-09T11:42:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.937+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f454c022030 con 0x7f45640af270 2023-10-09T11:42:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.937+0000 7f455affd700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.938+0000 7f4562ffd700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.938+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f454c086350 con 0x7f45640af270 2023-10-09T11:42:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.938+0000 7f4562ffd700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 0x7f45440693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f455c007fd0 tx=0x7f455c0026a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:40.942+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f454c053520 con 0x7f45640af270 2023-10-09T11:42:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.138+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4564067bc0 con 0x7f45640af270 2023-10-09T11:42:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.139+0000 7f455affd700 1 -- 172.21.15.6:0/825473030 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v133) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f454c05c070 con 0x7f45640af270 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 133, 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:42:35.931169+0000", 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:42:41.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:42:41.142 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 17, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:42:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:41.144 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:41.145 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:41.146 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:41.147 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:41.149 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 16, 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:42:41.150 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.058517+0000", 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:41.153 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:42:41.154 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "129", 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:41.155 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:41.158 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 17, 2023-10-09T11:42:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:42:10.625524+0000", 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:42:41.160 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:42:41.161 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "133", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:42:41.162 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:42:41.163 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:42:41.164 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.166 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:42:41.167 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:42:41.171 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.173 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.174 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:42:41.175 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:42:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:42:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:42:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:42:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:42:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:42:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:42:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:42:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:42:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:42:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:42:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:42:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:42:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:42:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:41.226 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 msgr2=0x7f45440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 0x7f45440693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f455c007fd0 tx=0x7f455c0026a0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 msgr2=0x7f456415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c016000 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 shutdown_connections 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4544066f30 0x7f45440693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45640c3030 0x7f4564158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45640aeea0 0x7f456414f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 --2- 172.21.15.6:0/825473030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45640af270 0x7f456415c760 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 >> 172.21.15.6:0/825473030 conn(0x7f456406c660 msgr2=0x7f45640cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 shutdown_connections 2023-10-09T11:42:41.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.141+0000 7f456945c700 1 -- 172.21.15.6:0/825473030 wait complete. 2023-10-09T11:42:41.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.346+0000 7f3818cc0700 1 Processor -- start 2023-10-09T11:42:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.346+0000 7f3818cc0700 1 -- start start 2023-10-09T11:42:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3818cc0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3814159b40 0x7f38140cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3818cc0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38140cee10 con 0x7f3814159f10 2023-10-09T11:42:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3818cc0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38140cd040 con 0x7f3814068e90 2023-10-09T11:42:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3818cc0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38140cd320 con 0x7f3814159b40 2023-10-09T11:42:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3812ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3814159f10 0x7f3814068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58194/0 (socket says 172.21.15.6:58194) 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f3812ffd700 1 -- 172.21.15.6:0/3074545111 learned_addr learned my addr 172.21.15.6:0/3074545111 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f38137fe700 1 --2- 172.21.15.6:0/3074545111 >> v2:172.21.15.118:3300/0 conn(0x7f3814159b40 0x7f38140cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051944688 0 0) 0x7f38140cee10 con 0x7f3814159f10 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.347+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc003570 con 0x7f3814159f10 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933148797 0 0) 0x7f37fc003570 con 0x7f3814159f10 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 >> v2:172.21.15.118:3300/0 conn(0x7f3814159b40 msgr2=0x7f38140cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 --2- 172.21.15.6:0/3074545111 >> v2:172.21.15.118:3300/0 conn(0x7f3814159b40 0x7f38140cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 >> v1:172.21.15.118:6789/0 conn(0x7f3814068e90 legacy=0x7f38140cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140ce7c0 con 0x7f3814159f10 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f3808001470 con 0x7f3814159f10 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 >> v1:172.21.15.6:6789/0 conn(0x7f3814159f10 legacy=0x7f3814068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc003a60 0x7f37fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 0x7f37fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc0051c0 0x7f37fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140cd320 con 0x7f37fc004810 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc00c0d0 con 0x7f37fc0051c0 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc00c290 con 0x7f37fc003a60 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 0x7f37fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f38137fe700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc003a60 0x7f37fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3813fff700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc0051c0 0x7f37fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 -- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc003a60 msgr2=0x7f37fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc003a60 0x7f37fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 -- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc0051c0 msgr2=0x7f37fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc0051c0 0x7f37fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 -- 172.21.15.6:0/3074545111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc003570 con 0x7f37fc004810 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3813fff700 1 -- 172.21.15.6:0/3074545111 reap_dead start 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.348+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 0x7f37fc004c80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3c0 tx=0x7f3808001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b4e32d8cc231f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800cc90 con 0x7f37fc004810 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380800cdf0 con 0x7f37fc004810 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f38127fc700 1 -- 172.21.15.6:0/3074545111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808005b50 con 0x7f37fc004810 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 -- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 msgr2=0x7f37fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 0x7f37fc004c80 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3c0 tx=0x7f3808001e50 comp rx=0 tx=0).stop 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 -- 172.21.15.6:0/3074545111 shutdown_connections 2023-10-09T11:42:41.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3074545111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37fc004810 0x7f37fc004c80 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 -- 172.21.15.6:0/3074545111 >> 172.21.15.6:0/3074545111 conn(0x7f38140cd660 msgr2=0x7f38140cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 -- 172.21.15.6:0/3074545111 shutdown_connections 2023-10-09T11:42:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.349+0000 7f3818cc0700 1 -- 172.21.15.6:0/3074545111 wait complete. 2023-10-09T11:42:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.350+0000 7f3818cc0700 1 Processor -- start 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.350+0000 7f3818cc0700 1 -- start start 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc004810 0x7f381416e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 0x7f3814144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38141452c0 con 0x7f38140b5ae0 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140b6490 con 0x7f3814148a30 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3818cc0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3814149d90 con 0x7f37fc004810 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3813fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3813fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36572/0 (socket says 172.21.15.6:36572) 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3813fff700 1 -- 172.21.15.6:0/3495716509 learned_addr learned my addr 172.21.15.6:0/3495716509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f38137fe700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc004810 0x7f381416e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.351+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 0x7f3814144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 -- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc004810 msgr2=0x7f381416e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc004810 0x7f381416e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 -- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 msgr2=0x7f3814144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 0x7f3814144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 -- 172.21.15.6:0/3495716509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814149180 con 0x7f38140b5ae0 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3812ffd700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 0x7f3814144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3813fff700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3814069290 tx=0x7f380c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c004140 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c006db0 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3814149460 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00c820 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.352+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3814149a20 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.353+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3814149f00 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.353+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f380c00cc10 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.354+0000 7f37fb7fe700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 0x7f38000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.354+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f380c083c30 con 0x7f38140b5ae0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.354+0000 7f38137fe700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 0x7f38000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:41.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.354+0000 7f38137fe700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 0x7f38000693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f381416de50 tx=0x7f38040091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:41.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.358+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f380c04c5a0 con 0x7f38140b5ae0 2023-10-09T11:42:41.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.594+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38140ceaa0 con 0x7f38140b5ae0 2023-10-09T11:42:41.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.595+0000 7f37fb7fe700 1 -- 172.21.15.6:0/3495716509 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f380c050f20 con 0x7f38140b5ae0 2023-10-09T11:42:41.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:41.597 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 msgr2=0x7f38000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 0x7f38000693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f381416de50 tx=0x7f38040091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 msgr2=0x7f38140b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3814069290 tx=0x7f380c001640 comp rx=0 tx=0).stop 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 shutdown_connections 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3800066f30 0x7f38000693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38140b5ae0 0x7f38140b5f50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37fc004810 0x7f381416e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 --2- 172.21.15.6:0/3495716509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814148a30 0x7f3814144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 >> 172.21.15.6:0/3495716509 conn(0x7f38140cd660 msgr2=0x7f381406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 shutdown_connections 2023-10-09T11:42:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:41.597+0000 7f3818cc0700 1 -- 172.21.15.6:0/3495716509 wait complete. 2023-10-09T11:42:41.600 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:41.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:42:41.756 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.483402506000001,"mdsmap_epoch":68,"osdmap_epoch":133,"osdmap_epoch_barrier":132,"uptime":34.569491380999999} 2023-10-09T11:42:41.756 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 68, "osdmap_epoch": 133, "osdmap_epoch_barrier": 132, "rank_uptime": 29.483402506, "state": "up:active", "uptime": 34.569491381, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:42:41.756 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:42:41.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:41.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T11:42:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:42:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:42:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.271055 s, 193 MB/s 2023-10-09T11:42:42.045 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:42.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:42.082 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:42.125 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:42.125 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:42:42.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:42.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:42:42.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:42:42.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:42.194 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:42:42.209 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:42:42.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:42:42.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:42:42.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:42:42.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:42:42.244 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:42:42.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.417+0000 7f58fb91d700 1 Processor -- start 2023-10-09T11:42:42.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.417+0000 7f58fb91d700 1 -- start start 2023-10-09T11:42:42.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58fb91d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f415daa0 0x7f58f415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58fb91d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cae00 0x7f58f4159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58fb91d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f406d350 con 0x7f58f40cb2a0 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58fb91d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40c9ac0 con 0x7f58f415daa0 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58fb91d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415e3b0 con 0x7f58f40cae00 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f415daa0 0x7f58f415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f9eba700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f58f40cb2a0 0x7f58f4159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58204/0 (socket says 172.21.15.6:58204) 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f415daa0 0x7f58f415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36578/0 (socket says 172.21.15.6:36578) 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f9eba700 1 -- 172.21.15.6:0/2711954463 learned_addr learned my addr 172.21.15.6:0/2711954463 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f8eb8700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cae00 0x7f58f4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 -- 172.21.15.6:0/2711954463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cae00 msgr2=0x7f58f4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cae00 0x7f58f4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 -- 172.21.15.6:0/2711954463 >> v1:172.21.15.6:6789/0 conn(0x7f58f40cb2a0 legacy=0x7f58f4159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f3fff700 1 -- 172.21.15.6:0/2711954463 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244503400 0 0) 0x7f58f406d350 con 0x7f58f40cb2a0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 -- 172.21.15.6:0/2711954463 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f406c740 con 0x7f58f415daa0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f96b9700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f415daa0 0x7f58f415de70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009e60 tx=0x7f58e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521630531525cbca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f3fff700 1 -- 172.21.15.6:0/2711954463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400e070 con 0x7f58f415daa0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f3fff700 1 -- 172.21.15.6:0/2711954463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400bb60 con 0x7f58f415daa0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.418+0000 7f58f3fff700 1 -- 172.21.15.6:0/2711954463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4012430 con 0x7f58f415daa0 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 -- 172.21.15.6:0/2711954463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f415daa0 msgr2=0x7f58f415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f415daa0 0x7f58f415de70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009e60 tx=0x7f58e4009780 comp rx=0 tx=0).stop 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 -- 172.21.15.6:0/2711954463 shutdown_connections 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f415daa0 0x7f58f415de70 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2711954463 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cae00 0x7f58f4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 -- 172.21.15.6:0/2711954463 >> 172.21.15.6:0/2711954463 conn(0x7f58f40c9ca0 msgr2=0x7f58f40ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:42.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 -- 172.21.15.6:0/2711954463 shutdown_connections 2023-10-09T11:42:42.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.419+0000 7f58fb91d700 1 -- 172.21.15.6:0/2711954463 wait complete. 2023-10-09T11:42:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.420+0000 7f58fb91d700 1 Processor -- start 2023-10-09T11:42:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.420+0000 7f58fb91d700 1 -- start start 2023-10-09T11:42:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cb2a0 0x7f58f415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f415daa0 0x7f58f416a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415aa90 con 0x7f58f40cae00 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40affd0 con 0x7f58f415daa0 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58fb91d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40b02b0 con 0x7f58f40cb2a0 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58f96b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58f96b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36588/0 (socket says 172.21.15.6:36588) 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58f96b9700 1 -- 172.21.15.6:0/2608975330 learned_addr learned my addr 172.21.15.6:0/2608975330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58f8eb8700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cb2a0 0x7f58f415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.421+0000 7f58f9eba700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f415daa0 0x7f58f416a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 -- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cb2a0 msgr2=0x7f58f415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cb2a0 0x7f58f415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 -- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f415daa0 msgr2=0x7f58f416a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f415daa0 0x7f58f416a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 -- 172.21.15.6:0/2608975330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4009a20 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f96b9700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b6c0 tx=0x7f58e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4012cb0 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e4012e10 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f416ab20 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40276c0 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.422+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f416b0e0 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.423+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f4068080 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.423+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58e4024070 con 0x7f58f40cae00 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.424+0000 7f58f17fa700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.424+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58e4086a30 con 0x7f58f40cae00 2023-10-09T11:42:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.424+0000 7f58f8eb8700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.424+0000 7f58f8eb8700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f58f406ccf0 tx=0x7f58e80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.428+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58e4053ca0 con 0x7f58f40cae00 2023-10-09T11:42:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.664+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f415e190 con 0x7f58f40cae00 2023-10-09T11:42:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.664+0000 7f58f17fa700 1 -- 172.21.15.6:0/2608975330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f58e402c090 con 0x7f58f40cae00 2023-10-09T11:42:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:42.666 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.666+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 msgr2=0x7f58e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.666+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 0x7f58e00693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f58f406ccf0 tx=0x7f58e80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.666+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 msgr2=0x7f58f40b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.666+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b6c0 tx=0x7f58e4019000 comp rx=0 tx=0).stop 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 shutdown_connections 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f58e0066f30 0x7f58e00693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f415daa0 0x7f58f416a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f40cae00 0x7f58f40b2190 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 --2- 172.21.15.6:0/2608975330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58f40cb2a0 0x7f58f415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 >> 172.21.15.6:0/2608975330 conn(0x7f58f40c9ca0 msgr2=0x7f58f40c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 shutdown_connections 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.667+0000 7f58fb91d700 1 -- 172.21.15.6:0/2608975330 wait complete. 2023-10-09T11:42:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:42.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.797+0000 7f6d85074700 1 Processor -- start 2023-10-09T11:42:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.797+0000 7f6d85074700 1 -- start start 2023-10-09T11:42:42.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d85074700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6d800ce5c0 0x7f6d800aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d85074700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d800ac570 0x7f6d8006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d85074700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8015dfb0 con 0x7f6d800ce1f0 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d85074700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d800acec0 con 0x7f6d800ac570 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d85074700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d800ad1a0 con 0x7f6d800ce5c0 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d7f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d800ac570 0x7f6d8006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d7ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6d800ce1f0 0x7f6d8015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58214/0 (socket says 172.21.15.6:58214) 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d7ed9d700 1 -- 172.21.15.6:0/3569993603 learned_addr learned my addr 172.21.15.6:0/3569993603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.798+0000 7f6d7e59c700 1 --2- 172.21.15.6:0/3569993603 >> v2:172.21.15.118:3300/0 conn(0x7f6d800ce5c0 0x7f6d800aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7f59e700 1 -- 172.21.15.6:0/3569993603 >> v2:172.21.15.118:3300/0 conn(0x7f6d800ce5c0 msgr2=0x7f6d800aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7f59e700 1 --2- 172.21.15.6:0/3569993603 >> v2:172.21.15.118:3300/0 conn(0x7f6d800ce5c0 0x7f6d800aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7f59e700 1 -- 172.21.15.6:0/3569993603 >> v1:172.21.15.6:6789/0 conn(0x7f6d800ce1f0 legacy=0x7f6d8015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7dd9b700 1 -- 172.21.15.6:0/3569993603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601108618 0 0) 0x7f6d8015dfb0 con 0x7f6d800ce1f0 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7f59e700 1 -- 172.21.15.6:0/3569993603 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8015dc40 con 0x7f6d800ac570 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7f59e700 1 --2- 172.21.15.6:0/3569993603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ac570 0x7f6d8006e230 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006f590 tx=0x7f6d70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74ee90b9e13ad2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7dd9b700 1 -- 172.21.15.6:0/3569993603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000e070 con 0x7f6d800ac570 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7dd9b700 1 -- 172.21.15.6:0/3569993603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7000bb60 con 0x7f6d800ac570 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d7dd9b700 1 -- 172.21.15.6:0/3569993603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70012430 con 0x7f6d800ac570 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 -- 172.21.15.6:0/3569993603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ac570 msgr2=0x7f6d8006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 --2- 172.21.15.6:0/3569993603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ac570 0x7f6d8006e230 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006f590 tx=0x7f6d70009780 comp rx=0 tx=0).stop 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 -- 172.21.15.6:0/3569993603 shutdown_connections 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 --2- 172.21.15.6:0/3569993603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ac570 0x7f6d8006e230 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 --2- 172.21.15.6:0/3569993603 >> v2:172.21.15.118:3300/0 conn(0x7f6d800ce5c0 0x7f6d800aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.799+0000 7f6d85074700 1 -- 172.21.15.6:0/3569993603 >> 172.21.15.6:0/3569993603 conn(0x7f6d8006cca0 msgr2=0x7f6d8006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.800+0000 7f6d85074700 1 -- 172.21.15.6:0/3569993603 shutdown_connections 2023-10-09T11:42:42.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.800+0000 7f6d85074700 1 -- 172.21.15.6:0/3569993603 wait complete. 2023-10-09T11:42:42.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 Processor -- start 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 -- start start 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d800ac570 0x7f6d8015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d800ce5c0 0x7f6d8013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800b1b20 con 0x7f6d800ce1f0 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800b25e0 con 0x7f6d800ac570 2023-10-09T11:42:42.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.801+0000 7f6d85074700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800b1d40 con 0x7f6d800ce5c0 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36618/0 (socket says 172.21.15.6:36618) 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 -- 172.21.15.6:0/777832705 learned_addr learned my addr 172.21.15.6:0/777832705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7f59e700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d800ce5c0 0x7f6d8013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7ed9d700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d800ac570 0x7f6d8015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 -- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d800ce5c0 msgr2=0x7f6d8013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d800ce5c0 0x7f6d8013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 -- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d800ac570 msgr2=0x7f6d8015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d800ac570 0x7f6d8015ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 -- 172.21.15.6:0/777832705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009a20 con 0x7f6d800ce1f0 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d7e59c700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800ec80 tx=0x7f6d680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800c850 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6800c9d0 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d800b2020 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800cd90 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.802+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8015b3c0 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.803+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8015b5e0 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.804+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d68013680 con 0x7f6d800ce1f0 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.804+0000 7f6d76ffd700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.804+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d68084880 con 0x7f6d800ce1f0 2023-10-09T11:42:42.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.804+0000 7f6d7ed9d700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:42.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.804+0000 7f6d7ed9d700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 0x7f6d600693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d800ab550 tx=0x7f6d78007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:42.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:42.808+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d68051af0 con 0x7f6d800ce1f0 2023-10-09T11:42:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.008+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d80068930 con 0x7f6d800ce1f0 2023-10-09T11:42:43.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.008+0000 7f6d76ffd700 1 -- 172.21.15.6:0/777832705 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f6d68055110 con 0x7f6d800ce1f0 2023-10-09T11:42:43.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:43.010 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":133,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:35.931169+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 msgr2=0x7f6d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 0x7f6d600693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6d800ab550 tx=0x7f6d78007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 msgr2=0x7f6d800b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800ec80 tx=0x7f6d680091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 shutdown_connections 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d800ce5c0 0x7f6d8013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d800ac570 0x7f6d8015ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 --2- 172.21.15.6:0/777832705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800ce1f0 0x7f6d800b15e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 >> 172.21.15.6:0/777832705 conn(0x7f6d8006cca0 msgr2=0x7f6d8006e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 shutdown_connections 2023-10-09T11:42:43.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.011+0000 7f6d85074700 1 -- 172.21.15.6:0/777832705 wait complete. 2023-10-09T11:42:43.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:42:10.058517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:42:10.625524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:42:43.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:43.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.145+0000 7f4b6095f700 1 Processor -- start 2023-10-09T11:42:43.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.145+0000 7f4b6095f700 1 -- start start 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b6095f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b6095f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c157ca0 0x7f4b5c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b6095f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0d07c0 con 0x7f4b5c06d120 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b6095f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cfbb0 con 0x7f4b5c157ca0 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b6095f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cfe90 con 0x7f4b5c1578d0 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b59d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c157ca0 0x7f4b5c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b59d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c157ca0 0x7f4b5c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36626/0 (socket says 172.21.15.6:36626) 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b59d9b700 1 -- 172.21.15.6:0/2921918732 learned_addr learned my addr 172.21.15.6:0/2921918732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.146+0000 7f4b5a59c700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b59d9b700 1 -- 172.21.15.6:0/2921918732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 msgr2=0x7f4b5c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b59d9b700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b59d9b700 1 -- 172.21.15.6:0/2921918732 >> v1:172.21.15.118:6789/0 conn(0x7f4b5c06d120 legacy=0x7f4b5c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b59d9b700 1 -- 172.21.15.6:0/2921918732 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0d0170 con 0x7f4b5c157ca0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b59d9b700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c15af00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4b440099b0 tx=0x7f4b44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3286fcc92e60a43a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b5959a700 1 -- 172.21.15.6:0/2921918732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44009ea0 con 0x7f4b5c157ca0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b5959a700 1 -- 172.21.15.6:0/2921918732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400b860 con 0x7f4b5c157ca0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b5959a700 1 -- 172.21.15.6:0/2921918732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400bc00 con 0x7f4b5c157ca0 2023-10-09T11:42:43.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 -- 172.21.15.6:0/2921918732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c157ca0 msgr2=0x7f4b5c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c15af00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4b440099b0 tx=0x7f4b44009250 comp rx=0 tx=0).stop 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 -- 172.21.15.6:0/2921918732 shutdown_connections 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 --2- 172.21.15.6:0/2921918732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c15af00 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.147+0000 7f4b6095f700 1 -- 172.21.15.6:0/2921918732 >> 172.21.15.6:0/2921918732 conn(0x7f4b5c06bb90 msgr2=0x7f4b5c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.148+0000 7f4b6095f700 1 -- 172.21.15.6:0/2921918732 shutdown_connections 2023-10-09T11:42:43.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.148+0000 7f4b6095f700 1 -- 172.21.15.6:0/2921918732 wait complete. 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 Processor -- start 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 -- start start 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c16abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0ad8f0 con 0x7f4b5c06d120 2023-10-09T11:42:43.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0af330 con 0x7f4b5c157ca0 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b6095f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c16b100 con 0x7f4b5c1578d0 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b5a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b5a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36638/0 (socket says 172.21.15.6:36638) 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b5a59c700 1 -- 172.21.15.6:0/1259462899 learned_addr learned my addr 172.21.15.6:0/1259462899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b59d9b700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c16abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.149+0000 7f4b5ad9d700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 -- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 msgr2=0x7f4b5c16abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c16abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 -- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b5c157ca0 msgr2=0x7f4b5c0aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c0aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 -- 172.21.15.6:0/1259462899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b440094f0 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b5a59c700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ec80 tx=0x7f4b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400c850 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400c9b0 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0ae720 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400cd50 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.150+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0aece0 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.151+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c067ac0 con 0x7f4b5c06d120 2023-10-09T11:42:43.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.151+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b54013680 con 0x7f4b5c06d120 2023-10-09T11:42:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.152+0000 7f4b527fc700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.152+0000 7f4b59d9b700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.152+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b54084730 con 0x7f4b5c06d120 2023-10-09T11:42:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.152+0000 7f4b59d9b700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 0x7f4b3c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4b440099b0 tx=0x7f4b44017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.156+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b540519a0 con 0x7f4b5c06d120 2023-10-09T11:42:43.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.350+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b5c0d0450 con 0x7f4b5c06d120 2023-10-09T11:42:43.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.350+0000 7f4b527fc700 1 -- 172.21.15.6:0/1259462899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b54054fc0 con 0x7f4b5c06d120 2023-10-09T11:42:43.352 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:42:43.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 msgr2=0x7f4b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 0x7f4b3c0693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4b440099b0 tx=0x7f4b44017000 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 msgr2=0x7f4b5c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ec80 tx=0x7f4b540091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 shutdown_connections 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b3c066f30 0x7f4b3c0693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b5c157ca0 0x7f4b5c0aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c06d120 0x7f4b5c154e40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 --2- 172.21.15.6:0/1259462899 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b5c1578d0 0x7f4b5c16abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 >> 172.21.15.6:0/1259462899 conn(0x7f4b5c06bb90 msgr2=0x7f4b5c068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 shutdown_connections 2023-10-09T11:42:43.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.353+0000 7f4b6095f700 1 -- 172.21.15.6:0/1259462899 wait complete. 2023-10-09T11:42:43.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:42:43.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.486+0000 7f9e11a41700 1 Processor -- start 2023-10-09T11:42:43.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.486+0000 7f9e11a41700 1 -- start start 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11a41700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9e0c069860 0x7f9e0c159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11a41700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e0c0ace20 0x7f9e0c0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11a41700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06e3d0 con 0x7f9e0c0aca50 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11a41700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c75d0 con 0x7f9e0c0ace20 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11a41700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c069cf0 con 0x7f9e0c069860 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e0c0ace20 0x7f9e0c0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e0c0ace20 0x7f9e0c0c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38468/0 (socket says 172.21.15.6:38468) 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 -- 172.21.15.6:0/847113980 learned_addr learned my addr 172.21.15.6:0/847113980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e10a3f700 1 --1- 172.21.15.6:0/847113980 >> v1:172.21.15.118:6789/0 conn(0x7f9e0c0aca50 0x7f9e0c159680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:42526/0 (socket says 172.21.15.6:42526) 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e0bfff700 1 --2- 172.21.15.6:0/847113980 >> v2:172.21.15.118:3300/0 conn(0x7f9e0c069860 0x7f9e0c159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 -- 172.21.15.6:0/847113980 >> v2:172.21.15.118:3300/0 conn(0x7f9e0c069860 msgr2=0x7f9e0c159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 --2- 172.21.15.6:0/847113980 >> v2:172.21.15.118:3300/0 conn(0x7f9e0c069860 0x7f9e0c159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 -- 172.21.15.6:0/847113980 >> v1:172.21.15.118:6789/0 conn(0x7f9e0c0aca50 legacy=0x7f9e0c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e11240700 1 -- 172.21.15.6:0/847113980 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c069fd0 con 0x7f9e0c0ace20 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.487+0000 7f9e0b7fe700 1 -- 172.21.15.6:0/847113980 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744090395 0 0) 0x7f9e0c06e3d0 con 0x7f9e0c0aca50 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11240700 1 --2- 172.21.15.6:0/847113980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c0c7090 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c064a80 tx=0x7f9e04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c456f42dc0193789 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e0b7fe700 1 -- 172.21.15.6:0/847113980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400e070 con 0x7f9e0c0ace20 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e0b7fe700 1 -- 172.21.15.6:0/847113980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0400ba20 con 0x7f9e0c0ace20 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e0b7fe700 1 -- 172.21.15.6:0/847113980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040092e0 con 0x7f9e0c0ace20 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 -- 172.21.15.6:0/847113980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c0ace20 msgr2=0x7f9e0c0c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 --2- 172.21.15.6:0/847113980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c0c7090 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c064a80 tx=0x7f9e04009840 comp rx=0 tx=0).stop 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 -- 172.21.15.6:0/847113980 shutdown_connections 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 --2- 172.21.15.6:0/847113980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c0c7090 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 --2- 172.21.15.6:0/847113980 >> v2:172.21.15.118:3300/0 conn(0x7f9e0c069860 0x7f9e0c159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.488+0000 7f9e11a41700 1 -- 172.21.15.6:0/847113980 >> 172.21.15.6:0/847113980 conn(0x7f9e0c06cca0 msgr2=0x7f9e0c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.489+0000 7f9e11a41700 1 -- 172.21.15.6:0/847113980 shutdown_connections 2023-10-09T11:42:43.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.489+0000 7f9e11a41700 1 -- 172.21.15.6:0/847113980 wait complete. 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.490+0000 7f9e11a41700 1 Processor -- start 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.490+0000 7f9e11a41700 1 -- start start 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e0c0aca50 0x7f9e0c0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c16a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c16dc10 con 0x7f9e0c069860 2023-10-09T11:42:43.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c16def0 con 0x7f9e0c0ace20 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c16e1d0 con 0x7f9e0c0aca50 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38484/0 (socket says 172.21.15.6:38484) 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 -- 172.21.15.6:0/2229542459 learned_addr learned my addr 172.21.15.6:0/2229542459 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11240700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c16a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e0bfff700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e0c0aca50 0x7f9e0c0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 -- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e0c0aca50 msgr2=0x7f9e0c0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e0c0aca50 0x7f9e0c0afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 -- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e0c0ace20 msgr2=0x7f9e0c16a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c16a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 -- 172.21.15.6:0/2229542459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04009ae0 con 0x7f9e0c069860 2023-10-09T11:42:43.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e10a3f700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0011e0 tx=0x7f9dfc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc005a70 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc005bd0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c16e4b0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.491+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0070d0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.492+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c16d7b0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.493+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c0684e0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.493+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dfc007480 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.493+0000 7f9e08ff9700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.493+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9dfc0839e0 con 0x7f9e0c069860 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.493+0000 7f9e0bfff700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.494+0000 7f9e0bfff700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 0x7f9df80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009d10 tx=0x7f9e000091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.498+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dfc050c50 con 0x7f9e0c069860 2023-10-09T11:42:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.690+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e0c071b10 con 0x7f9e0c069860 2023-10-09T11:42:43.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.691+0000 7f9e08ff9700 1 -- 172.21.15.6:0/2229542459 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v133) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dfc017020 con 0x7f9e0c069860 2023-10-09T11:42:43.692 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:42:43.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.692+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 msgr2=0x7f9df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.692+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 0x7f9df80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009d10 tx=0x7f9e000091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.692+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 msgr2=0x7f9e0c1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.692+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0011e0 tx=0x7f9dfc007e10 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 shutdown_connections 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9df8066f30 0x7f9df80693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e0c0ace20 0x7f9e0c16a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e0c069860 0x7f9e0c1581c0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 --2- 172.21.15.6:0/2229542459 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e0c0aca50 0x7f9e0c0afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 >> 172.21.15.6:0/2229542459 conn(0x7f9e0c06cca0 msgr2=0x7f9e0c154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 shutdown_connections 2023-10-09T11:42:43.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.693+0000 7f9e11a41700 1 -- 172.21.15.6:0/2229542459 wait complete. 2023-10-09T11:42:43.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:42:43.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.827+0000 7f91a2772700 1 Processor -- start 2023-10-09T11:42:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.827+0000 7f91a2772700 1 -- start start 2023-10-09T11:42:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a2772700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f919c0d0f50 0x7f919c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a2772700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c06d990 con 0x7f919c0d0b80 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a2772700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0cf2d0 con 0x7f919c06d530 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a2772700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c15a690 con 0x7f919c0d0f50 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a1770700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f919c0d0b80 0x7f919c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57232/0 (socket says 172.21.15.6:57232) 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a1770700 1 -- 172.21.15.6:0/482477462 learned_addr learned my addr 172.21.15.6:0/482477462 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812306225 0 0) 0x7f919c06d990 con 0x7f919c0d0b80 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003570 con 0x7f919c0d0b80 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.828+0000 7f91a0f6f700 1 --2- 172.21.15.6:0/482477462 >> v2:172.21.15.118:3300/0 conn(0x7f919c0d0f50 0x7f919c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555438558 0 0) 0x7f9184003570 con 0x7f919c0d0b80 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 >> v2:172.21.15.118:3300/0 conn(0x7f919c0d0f50 msgr2=0x7f919c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 --2- 172.21.15.6:0/482477462 >> v2:172.21.15.118:3300/0 conn(0x7f919c0d0f50 0x7f919c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 >> v1:172.21.15.118:6789/0 conn(0x7f919c06d530 legacy=0x7f919c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0d0480 con 0x7f919c0d0b80 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f9194001470 con 0x7f919c0d0b80 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 >> v1:172.21.15.6:6789/0 conn(0x7f919c0d0b80 legacy=0x7f919c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 0x7f9184003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184004810 0x7f9184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91840051c0 0x7f918400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c15a690 con 0x7f9184003a60 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918400c0d0 con 0x7f91840051c0 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918400c290 con 0x7f9184004810 2023-10-09T11:42:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 0x7f9184003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1f71700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91840051c0 0x7f918400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a0f6f700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184004810 0x7f9184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 -- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184004810 msgr2=0x7f9184004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184004810 0x7f9184004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 -- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91840051c0 msgr2=0x7f918400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91840051c0 0x7f918400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 -- 172.21.15.6:0/482477462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184003570 con 0x7f9184003a60 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1f71700 1 -- 172.21.15.6:0/482477462 reap_dead start 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.829+0000 7f91a1770700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 0x7f9184003e70 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f919400c390 tx=0x7f919c0cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b13e1ed805e41c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400cc60 con 0x7f9184003a60 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919400cdc0 con 0x7f9184003a60 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f919bfff700 1 -- 172.21.15.6:0/482477462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194005b70 con 0x7f9184003a60 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 -- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 msgr2=0x7f9184003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 0x7f9184003e70 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f919400c390 tx=0x7f919c0cf460 comp rx=0 tx=0).stop 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 -- 172.21.15.6:0/482477462 shutdown_connections 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 --2- 172.21.15.6:0/482477462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184003a60 0x7f9184003e70 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 -- 172.21.15.6:0/482477462 >> 172.21.15.6:0/482477462 conn(0x7f919c063230 msgr2=0x7f919c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 -- 172.21.15.6:0/482477462 shutdown_connections 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.830+0000 7f91a2772700 1 -- 172.21.15.6:0/482477462 wait complete. 2023-10-09T11:42:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.831+0000 7f91a2772700 1 Processor -- start 2023-10-09T11:42:43.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.831+0000 7f91a2772700 1 -- start start 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 0x7f919c0ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 0x7f919c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0ae030 con 0x7f919c1465e0 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0b0d50 con 0x7f919c0b03a0 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a2772700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0ac8e0 con 0x7f9184003a60 2023-10-09T11:42:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a0f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a0f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38504/0 (socket says 172.21.15.6:38504) 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.832+0000 7f91a0f6f700 1 -- 172.21.15.6:0/1224707100 learned_addr learned my addr 172.21.15.6:0/1224707100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a1770700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 0x7f919c0ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a1f71700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 0x7f919c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 -- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 msgr2=0x7f919c0ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 0x7f919c0ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 -- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 msgr2=0x7f919c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 0x7f919c0b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 -- 172.21.15.6:0/1224707100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0acbc0 con 0x7f919c1465e0 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a1f71700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 0x7f919c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a1770700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 0x7f919c0ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a0f6f700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9190011d40 tx=0x7f91900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000fac0 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000fc20 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c0acea0 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190014440 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.833+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c0ae760 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.834+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c0676e0 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.834+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9190014a80 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.835+0000 7f91997fa700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 0x7f91880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.835+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9190018030 con 0x7f919c1465e0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.835+0000 7f91a1770700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 0x7f91880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.835+0000 7f91a1770700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 0x7f91880693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f919400c1a0 tx=0x7f9194015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:43.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:43.839+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9190052480 con 0x7f919c1465e0 2023-10-09T11:42:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.030+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f919c0ae5b0 con 0x7f919c1465e0 2023-10-09T11:42:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.030+0000 7f91997fa700 1 -- 172.21.15.6:0/1224707100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v133) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9190022020 con 0x7f919c1465e0 2023-10-09T11:42:44.032 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:42:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 msgr2=0x7f91880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 0x7f91880693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f919400c1a0 tx=0x7f9194015000 comp rx=0 tx=0).stop 2023-10-09T11:42:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 msgr2=0x7f919c0adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9190011d40 tx=0x7f91900091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 shutdown_connections 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9188066f30 0x7f91880693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f919c0b03a0 0x7f919c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9184003a60 0x7f919c0ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 --2- 172.21.15.6:0/1224707100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f919c1465e0 0x7f919c0adaf0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 >> 172.21.15.6:0/1224707100 conn(0x7f919c063230 msgr2=0x7f919c15bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 shutdown_connections 2023-10-09T11:42:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.033+0000 7f91a2772700 1 -- 172.21.15.6:0/1224707100 wait complete. 2023-10-09T11:42:44.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.164+0000 7f5277290700 1 Processor -- start 2023-10-09T11:42:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.164+0000 7f5277290700 1 -- start start 2023-10-09T11:42:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f5277290700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 0x7f52700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f5277290700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 0x7f527015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f5277290700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700d07c0 con 0x7f527006d120 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f5277290700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700cfbb0 con 0x7f52701578d0 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f5277290700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700cfe90 con 0x7f5270157ca0 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f527482b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 0x7f527015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f527502c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 0x7f52700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f527582d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f527006d120 0x7f527015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:42542/0 (socket says 172.21.15.6:42542) 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.165+0000 7f527582d700 1 -- 172.21.15.6:0/2504563060 learned_addr learned my addr 172.21.15.6:0/2504563060 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527482b700 1 -- 172.21.15.6:0/2504563060 >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 msgr2=0x7f52700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527482b700 1 --2- 172.21.15.6:0/2504563060 >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 0x7f52700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527482b700 1 -- 172.21.15.6:0/2504563060 >> v1:172.21.15.118:6789/0 conn(0x7f527006d120 legacy=0x7f527015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527482b700 1 -- 172.21.15.6:0/2504563060 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700d0170 con 0x7f5270157ca0 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527502c700 1 --2- 172.21.15.6:0/2504563060 >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 0x7f52700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f527482b700 1 --2- 172.21.15.6:0/2504563060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 0x7f527015af00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f52640098e0 tx=0x7f52640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b665145b72a57d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f526ffff700 1 -- 172.21.15.6:0/2504563060 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400b640 con 0x7f5270157ca0 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f526ffff700 1 -- 172.21.15.6:0/2504563060 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400b7a0 con 0x7f5270157ca0 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.166+0000 7f526ffff700 1 -- 172.21.15.6:0/2504563060 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400bb40 con 0x7f5270157ca0 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 -- 172.21.15.6:0/2504563060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 msgr2=0x7f527015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 --2- 172.21.15.6:0/2504563060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 0x7f527015af00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f52640098e0 tx=0x7f52640091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 -- 172.21.15.6:0/2504563060 shutdown_connections 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 --2- 172.21.15.6:0/2504563060 >> v2:172.21.15.118:3300/0 conn(0x7f52701578d0 0x7f52700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 --2- 172.21.15.6:0/2504563060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5270157ca0 0x7f527015af00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 -- 172.21.15.6:0/2504563060 >> 172.21.15.6:0/2504563060 conn(0x7f527006bb90 msgr2=0x7f527006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 -- 172.21.15.6:0/2504563060 shutdown_connections 2023-10-09T11:42:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.167+0000 7f5277290700 1 -- 172.21.15.6:0/2504563060 wait complete. 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.168+0000 7f5277290700 1 Processor -- start 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.168+0000 7f5277290700 1 -- start start 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 0x7f5270143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5270157ca0 0x7f5270068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527016c8d0 con 0x7f52701578d0 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527016bcc0 con 0x7f5270157ca0 2023-10-09T11:42:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f5277290700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527016bfa0 con 0x7f527006d120 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38510/0 (socket says 172.21.15.6:38510) 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 -- 172.21.15.6:0/806265013 learned_addr learned my addr 172.21.15.6:0/806265013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527502c700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 0x7f5270143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527582d700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5270157ca0 0x7f5270068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 -- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 msgr2=0x7f5270143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 0x7f5270143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 -- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5270157ca0 msgr2=0x7f5270068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5270157ca0 0x7f5270068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 -- 172.21.15.6:0/806265013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009a20 con 0x7f52701578d0 2023-10-09T11:42:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527502c700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 0x7f5270143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.169+0000 7f527482b700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5264009f80 tx=0x7f5264017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.170+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400bb20 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.170+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5264000c90 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.170+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5264009420 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.170+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264011650 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.170+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527016c560 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.171+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527016ca40 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.171+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5264011a80 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.172+0000 7f526d7fa700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.172+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5264085cc0 con 0x7f52701578d0 2023-10-09T11:42:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.172+0000 7f527502c700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.172+0000 7f527502c700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 0x7f525c0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5270069d20 tx=0x7f526000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.176+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5264052f30 con 0x7f52701578d0 2023-10-09T11:42:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.414+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52700d0450 con 0x7f52701578d0 2023-10-09T11:42:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.415+0000 7f526d7fa700 1 -- 172.21.15.6:0/806265013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f5264056550 con 0x7f52701578d0 2023-10-09T11:42:44.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:44.417 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 msgr2=0x7f525c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 0x7f525c0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5270069d20 tx=0x7f526000b040 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 msgr2=0x7f527016b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5264009f80 tx=0x7f5264017000 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 shutdown_connections 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f525c066f30 0x7f525c0693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5270157ca0 0x7f5270068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527006d120 0x7f5270143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 --2- 172.21.15.6:0/806265013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52701578d0 0x7f527016b230 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 >> 172.21.15.6:0/806265013 conn(0x7f527006bb90 msgr2=0x7f52701589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 shutdown_connections 2023-10-09T11:42:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.417+0000 7f5277290700 1 -- 172.21.15.6:0/806265013 wait complete. 2023-10-09T11:42:44.420 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:44.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:44.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.547+0000 7fe2d6cb4700 1 Processor -- start 2023-10-09T11:42:44.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.547+0000 7fe2d6cb4700 1 -- start start 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d6cb4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2d0159b40 0x7fe2d00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d6cb4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00cee10 con 0x7fe2d0159f10 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d6cb4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00cd040 con 0x7fe2d0068e90 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d6cb4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00cd320 con 0x7fe2d0159b40 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d5cb2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2d0159b40 0x7fe2d00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d54b1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2d0159f10 0x7fe2d0068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57242/0 (socket says 172.21.15.6:57242) 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d54b1700 1 -- 172.21.15.6:0/1940110798 learned_addr learned my addr 172.21.15.6:0/1940110798 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d5cb2700 1 -- 172.21.15.6:0/1940110798 >> v1:172.21.15.118:6789/0 conn(0x7fe2d0068e90 legacy=0x7fe2d00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d5cb2700 1 -- 172.21.15.6:0/1940110798 >> v1:172.21.15.6:6789/0 conn(0x7fe2d0159f10 legacy=0x7fe2d0068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d5cb2700 1 -- 172.21.15.6:0/1940110798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00ce7c0 con 0x7fe2d0159b40 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.548+0000 7fe2d4cb0700 1 -- 172.21.15.6:0/1940110798 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651877758 0 0) 0x7fe2d00cee10 con 0x7fe2d0159f10 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d5cb2700 1 --2- 172.21.15.6:0/1940110798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d00cc600 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00098e0 tx=0x7fe2c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c6fed8ddf10d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d4cb0700 1 -- 172.21.15.6:0/1940110798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0009e80 con 0x7fe2d0159b40 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d4cb0700 1 -- 172.21.15.6:0/1940110798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000b860 con 0x7fe2d0159b40 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d4cb0700 1 -- 172.21.15.6:0/1940110798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000bbe0 con 0x7fe2d0159b40 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/1940110798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 msgr2=0x7fe2d00cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/1940110798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d00cc600 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00098e0 tx=0x7fe2c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/1940110798 shutdown_connections 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/1940110798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d00cc600 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/1940110798 >> 172.21.15.6:0/1940110798 conn(0x7fe2d00cd660 msgr2=0x7fe2d00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/1940110798 shutdown_connections 2023-10-09T11:42:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.549+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/1940110798 wait complete. 2023-10-09T11:42:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.550+0000 7fe2d6cb4700 1 Processor -- start 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 -- start start 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 0x7fe2d016b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 0x7fe2d00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0157860 con 0x7fe2d0159b40 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d015b200 con 0x7fe2d0159f10 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d6cb4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0156f70 con 0x7fe2d0068e90 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d54b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d54b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38534/0 (socket says 172.21.15.6:38534) 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.551+0000 7fe2d54b1700 1 -- 172.21.15.6:0/2899182524 learned_addr learned my addr 172.21.15.6:0/2899182524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d64b3700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 0x7fe2d00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d5cb2700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 0x7fe2d016b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 -- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 msgr2=0x7fe2d016b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 0x7fe2d016b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 -- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 msgr2=0x7fe2d00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 0x7fe2d00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 -- 172.21.15.6:0/2899182524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009420 con 0x7fe2d0159b40 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d5cb2700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 0x7fe2d016b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d64b3700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 0x7fe2d00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d54b1700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c560 tx=0x7fe2c4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4005b30 con 0x7fe2d0159b40 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c4005c90 con 0x7fe2d0159b40 2023-10-09T11:42:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0157210 con 0x7fe2d0159b40 2023-10-09T11:42:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4007320 con 0x7fe2d0159b40 2023-10-09T11:42:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.552+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01575a0 con 0x7fe2d0159b40 2023-10-09T11:42:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.553+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0157a10 con 0x7fe2d0159b40 2023-10-09T11:42:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.554+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2c401b3b0 con 0x7fe2d0159b40 2023-10-09T11:42:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.554+0000 7fe2cdffb700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.554+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2c4083ae0 con 0x7fe2d0159b40 2023-10-09T11:42:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.554+0000 7fe2d5cb2700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.555+0000 7fe2d5cb2700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00093f0 tx=0x7fe2c0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.558+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d0157a10 con 0x7fe2d0159b40 2023-10-09T11:42:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.751+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d0157a10 con 0x7fe2d0159b40 2023-10-09T11:42:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.752+0000 7fe2cdffb700 1 -- 172.21.15.6:0/2899182524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fe2d0157a10 con 0x7fe2d0159b40 2023-10-09T11:42:44.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:44.754 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":133,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:35.931169+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 msgr2=0x7fe2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00093f0 tx=0x7fe2c0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 msgr2=0x7fe2d015acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c560 tx=0x7fe2c4000fe0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 shutdown_connections 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2bc066f30 0x7fe2bc0693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d0159f10 0x7fe2d00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d0068e90 0x7fe2d016b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 --2- 172.21.15.6:0/2899182524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d0159b40 0x7fe2d015acc0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 >> 172.21.15.6:0/2899182524 conn(0x7fe2d00cd660 msgr2=0x7fe2d00c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 shutdown_connections 2023-10-09T11:42:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.754+0000 7fe2d6cb4700 1 -- 172.21.15.6:0/2899182524 wait complete. 2023-10-09T11:42:44.768 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:42:44.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.885+0000 7fe72d4a9700 1 Processor -- start 2023-10-09T11:42:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.885+0000 7fe72d4a9700 1 -- start start 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72d4a9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe728159b40 0x7fe7280cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72d4a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe728159f10 0x7fe728068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72d4a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280cee10 con 0x7fe7280ccb40 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72d4a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280cd040 con 0x7fe728159f10 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72d4a9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280cd320 con 0x7fe728159b40 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe728159f10 0x7fe728068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72cca8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe7280ccb40 0x7fe72815d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57246/0 (socket says 172.21.15.6:57246) 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe72cca8700 1 -- 172.21.15.6:0/3502183480 learned_addr learned my addr 172.21.15.6:0/3502183480 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe728159f10 0x7fe728068780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38542/0 (socket says 172.21.15.6:38542) 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe727fff700 1 --2- 172.21.15.6:0/3502183480 >> v2:172.21.15.118:3300/0 conn(0x7fe728159b40 0x7fe7280cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 -- 172.21.15.6:0/3502183480 >> v2:172.21.15.118:3300/0 conn(0x7fe728159b40 msgr2=0x7fe7280cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 --2- 172.21.15.6:0/3502183480 >> v2:172.21.15.118:3300/0 conn(0x7fe728159b40 0x7fe7280cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 -- 172.21.15.6:0/3502183480 >> v1:172.21.15.6:6789/0 conn(0x7fe7280ccb40 legacy=0x7fe72815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe7277fe700 1 -- 172.21.15.6:0/3502183480 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280ce7c0 con 0x7fe728159f10 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.886+0000 7fe726ffd700 1 -- 172.21.15.6:0/3502183480 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900956765 0 0) 0x7fe7280cee10 con 0x7fe7280ccb40 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe7277fe700 1 --2- 172.21.15.6:0/3502183480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe728068780 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe7280d0bc0 tx=0x7fe7180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23bdf9f28bfc4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe726ffd700 1 -- 172.21.15.6:0/3502183480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011630 con 0x7fe728159f10 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe726ffd700 1 -- 172.21.15.6:0/3502183480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718011790 con 0x7fe728159f10 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe726ffd700 1 -- 172.21.15.6:0/3502183480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718011b30 con 0x7fe728159f10 2023-10-09T11:42:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 -- 172.21.15.6:0/3502183480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 msgr2=0x7fe728068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/3502183480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe728068780 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe7280d0bc0 tx=0x7fe7180091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 -- 172.21.15.6:0/3502183480 shutdown_connections 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/3502183480 >> v2:172.21.15.118:3300/0 conn(0x7fe728159b40 0x7fe7280cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/3502183480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe728068780 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 -- 172.21.15.6:0/3502183480 >> 172.21.15.6:0/3502183480 conn(0x7fe7280cd660 msgr2=0x7fe7280cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 -- 172.21.15.6:0/3502183480 shutdown_connections 2023-10-09T11:42:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.887+0000 7fe72d4a9700 1 -- 172.21.15.6:0/3502183480 wait complete. 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.888+0000 7fe72d4a9700 1 Processor -- start 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 -- start start 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280ccb40 0x7fe728154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 0x7fe728157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728157180 con 0x7fe728159f10 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728154fc0 con 0x7fe728159b40 2023-10-09T11:42:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72d4a9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281562d0 con 0x7fe7280ccb40 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72cca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.889+0000 7fe72cca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38558/0 (socket says 172.21.15.6:38558) 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 -- 172.21.15.6:0/1555334029 learned_addr learned my addr 172.21.15.6:0/1555334029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe7277fe700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 0x7fe728157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 -- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280ccb40 msgr2=0x7fe728154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe727fff700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280ccb40 0x7fe728154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280ccb40 0x7fe728154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 -- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 msgr2=0x7fe728157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 0x7fe728157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 -- 172.21.15.6:0/1555334029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009420 con 0x7fe728159f10 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe7277fe700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 0x7fe728157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72cca8700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe72000ccc0 tx=0x7fe720001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000aaf0 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000ac50 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200070f0 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe728156570 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.890+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728156b30 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.891+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728157330 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.892+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7200074a0 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.892+0000 7fe71ffff700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 0x7fe7080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.892+0000 7fe727fff700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 0x7fe7080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.892+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7200849f0 con 0x7fe728159f10 2023-10-09T11:42:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.893+0000 7fe727fff700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 0x7fe7080693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7100093f0 tx=0x7fe710008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:44.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:44.896+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe728157330 con 0x7fe728159f10 2023-10-09T11:42:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.132+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe728157330 con 0x7fe728159f10 2023-10-09T11:42:45.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.133+0000 7fe71ffff700 1 -- 172.21.15.6:0/1555334029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe728157330 con 0x7fe728159f10 2023-10-09T11:42:45.134 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:45.134 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 msgr2=0x7fe7080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 0x7fe7080693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7100093f0 tx=0x7fe710008040 comp rx=0 tx=0).stop 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 msgr2=0x7fe7280c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe72000ccc0 tx=0x7fe720001a20 comp rx=0 tx=0).stop 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 shutdown_connections 2023-10-09T11:42:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe708066f30 0x7fe7080693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728159f10 0x7fe7280c9d50 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe7280ccb40 0x7fe728154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 --2- 172.21.15.6:0/1555334029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe728159b40 0x7fe728157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 >> 172.21.15.6:0/1555334029 conn(0x7fe7280cd660 msgr2=0x7fe7280b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 shutdown_connections 2023-10-09T11:42:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.135+0000 7fe72d4a9700 1 -- 172.21.15.6:0/1555334029 wait complete. 2023-10-09T11:42:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:45.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.266+0000 7fed228ea700 1 Processor -- start 2023-10-09T11:42:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 -- start start 2023-10-09T11:42:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed1c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed1c06dd60 0x7fed1c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c0cf4e0 con 0x7fed1c0ceb30 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c06ea90 con 0x7fed1c06dd60 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.267+0000 7fed228ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0b0ca0 con 0x7fed1c15a2a0 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed1c0ceb30 0x7fed1c06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57260/0 (socket says 172.21.15.6:57260) 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1b7fe700 1 -- 172.21.15.6:0/3121431969 learned_addr learned my addr 172.21.15.6:0/3121431969 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed20e87700 1 --2- 172.21.15.6:0/3121431969 >> v2:172.21.15.118:3300/0 conn(0x7fed1c06dd60 0x7fed1c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1bfff700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed1c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628183088 0 0) 0x7fed1c0cf4e0 con 0x7fed1c0ceb30 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed08003570 con 0x7fed1c0ceb30 2023-10-09T11:42:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4162583424 0 0) 0x7fed08003570 con 0x7fed1c0ceb30 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 msgr2=0x7fed1c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed1c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 >> v2:172.21.15.118:3300/0 conn(0x7fed1c06dd60 msgr2=0x7fed1c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 --2- 172.21.15.6:0/3121431969 >> v2:172.21.15.118:3300/0 conn(0x7fed1c06dd60 0x7fed1c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c0b00d0 con 0x7fed1c0ceb30 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fed0c001470 con 0x7fed1c0ceb30 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 >> v1:172.21.15.6:6789/0 conn(0x7fed1c0ceb30 legacy=0x7fed1c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed08003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed080040b0 0x7fed08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed08004d50 0x7fed080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c06ea90 con 0x7fed080040b0 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0b0ca0 con 0x7fed08004d50 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0800bb60 con 0x7fed1c15a2a0 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed080040b0 0x7fed08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed20e87700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed08004d50 0x7fed080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.268+0000 7fed1bfff700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed08003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 -- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 msgr2=0x7fed08003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c15a2a0 0x7fed08003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 -- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed08004d50 msgr2=0x7fed080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed08004d50 0x7fed080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 -- 172.21.15.6:0/3121431969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08003570 con 0x7fed080040b0 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed080040b0 0x7fed08004810 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c2a0 tx=0x7fed0c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1cc5a74578428b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c00cb70 con 0x7fed080040b0 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c00ccf0 con 0x7fed080040b0 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed1affd700 1 -- 172.21.15.6:0/3121431969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c005b70 con 0x7fed080040b0 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed228ea700 1 -- 172.21.15.6:0/3121431969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed080040b0 msgr2=0x7fed08004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed228ea700 1 --2- 172.21.15.6:0/3121431969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed080040b0 0x7fed08004810 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c2a0 tx=0x7fed0c001dc0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed20e87700 1 -- 172.21.15.6:0/3121431969 reap_dead start 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed228ea700 1 -- 172.21.15.6:0/3121431969 shutdown_connections 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed228ea700 1 -- 172.21.15.6:0/3121431969 >> 172.21.15.6:0/3121431969 conn(0x7fed1c067640 msgr2=0x7fed1c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.269+0000 7fed228ea700 1 -- 172.21.15.6:0/3121431969 shutdown_connections 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.270+0000 7fed228ea700 1 -- 172.21.15.6:0/3121431969 wait complete. 2023-10-09T11:42:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.271+0000 7fed228ea700 1 Processor -- start 2023-10-09T11:42:45.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.271+0000 7fed228ea700 1 -- start start 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.271+0000 7fed228ea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 0x7fed1c16a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0b27c0 0x7fed1c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c16a9f0 con 0x7fed1c0b2350 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c15ccd0 con 0x7fed080040b0 2023-10-09T11:42:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c15cfb0 con 0x7fed1c0b27c0 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38582/0 (socket says 172.21.15.6:38582) 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 -- 172.21.15.6:0/2437203515 learned_addr learned my addr 172.21.15.6:0/2437203515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed20e87700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0b27c0 0x7fed1c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1bfff700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 0x7fed1c16a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 -- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0b27c0 msgr2=0x7fed1c1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0b27c0 0x7fed1c1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 -- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 msgr2=0x7fed1c16a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 0x7fed1c16a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 -- 172.21.15.6:0/2437203515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c15d290 con 0x7fed1c0b2350 2023-10-09T11:42:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1bfff700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 0x7fed1c16a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed1b7fe700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fed08004760 tx=0x7fed0c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0070d0 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c007230 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c15d570 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0075f0 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.272+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c15c910 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.273+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c16a9f0 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.274+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed0c019030 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.274+0000 7fed13fff700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 0x7fecfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.274+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed0c0858a0 con 0x7fed1c0b2350 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.274+0000 7fed1bfff700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 0x7fecfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.274+0000 7fed1bfff700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 0x7fecfc0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fed04006dc0 tx=0x7fed04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.278+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed0c052b10 con 0x7fed1c0b2350 2023-10-09T11:42:45.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.515+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed1c15dbc0 con 0x7fed1c0b2350 2023-10-09T11:42:45.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.516+0000 7fed13fff700 1 -- 172.21.15.6:0/2437203515 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fed0c056130 con 0x7fed1c0b2350 2023-10-09T11:42:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:45.518 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:11.653965+0000","modified":"2023-10-09T11:42:15.280223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"d","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1187699477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1187699477},{"type":"v1","addr":"172.21.15.118:6835","nonce":1187699477}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 msgr2=0x7fecfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 0x7fecfc0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fed04006dc0 tx=0x7fed04008040 comp rx=0 tx=0).stop 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 msgr2=0x7fed1c156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fed08004760 tx=0x7fed0c012000 comp rx=0 tx=0).stop 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 shutdown_connections 2023-10-09T11:42:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fecfc066f30 0x7fecfc0693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed1c0b27c0 0x7fed1c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed080040b0 0x7fed1c16a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 --2- 172.21.15.6:0/2437203515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed1c0b2350 0x7fed1c156880 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 >> 172.21.15.6:0/2437203515 conn(0x7fed1c067640 msgr2=0x7fed1c0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 shutdown_connections 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.518+0000 7fed228ea700 1 -- 172.21.15.6:0/2437203515 wait complete. 2023-10-09T11:42:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-10-09T11:42:45.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.650+0000 7f2139b8c700 1 Processor -- start 2023-10-09T11:42:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.650+0000 7f2139b8c700 1 -- start start 2023-10-09T11:42:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2139b8c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f21341578d0 0x7f21340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2139b8c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f213406d120 0x7f213406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2139b8c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21340d07c0 con 0x7f2134157ca0 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2139b8c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213406da50 con 0x7f213406d120 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2139b8c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21340cfbb0 con 0x7f21341578d0 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f213406d120 0x7f213406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2132ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2134157ca0 0x7f213415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57272/0 (socket says 172.21.15.6:57272) 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2132ffd700 1 -- 172.21.15.6:0/2117704246 learned_addr learned my addr 172.21.15.6:0/2117704246 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f21337fe700 1 --2- 172.21.15.6:0/2117704246 >> v2:172.21.15.118:3300/0 conn(0x7f21341578d0 0x7f21340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 -- 172.21.15.6:0/2117704246 >> v2:172.21.15.118:3300/0 conn(0x7f21341578d0 msgr2=0x7f21340cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 --2- 172.21.15.6:0/2117704246 >> v2:172.21.15.118:3300/0 conn(0x7f21341578d0 0x7f21340cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 -- 172.21.15.6:0/2117704246 >> v1:172.21.15.6:6789/0 conn(0x7f2134157ca0 legacy=0x7f213415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 -- 172.21.15.6:0/2117704246 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340cfe90 con 0x7f213406d120 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f2133fff700 1 --2- 172.21.15.6:0/2117704246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213406d120 0x7f213406d510 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f21340646b0 tx=0x7f212c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596b9621e728a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f21327fc700 1 -- 172.21.15.6:0/2117704246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c00e070 con 0x7f213406d120 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.651+0000 7f21327fc700 1 -- 172.21.15.6:0/2117704246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c00bc30 con 0x7f213406d120 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f21327fc700 1 -- 172.21.15.6:0/2117704246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c012430 con 0x7f213406d120 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 -- 172.21.15.6:0/2117704246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213406d120 msgr2=0x7f213406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 --2- 172.21.15.6:0/2117704246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213406d120 0x7f213406d510 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f21340646b0 tx=0x7f212c009780 comp rx=0 tx=0).stop 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 -- 172.21.15.6:0/2117704246 shutdown_connections 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 --2- 172.21.15.6:0/2117704246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213406d120 0x7f213406d510 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 --2- 172.21.15.6:0/2117704246 >> v2:172.21.15.118:3300/0 conn(0x7f21341578d0 0x7f21340cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 -- 172.21.15.6:0/2117704246 >> 172.21.15.6:0/2117704246 conn(0x7f213406bb90 msgr2=0x7f213406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 -- 172.21.15.6:0/2117704246 shutdown_connections 2023-10-09T11:42:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.652+0000 7f2139b8c700 1 -- 172.21.15.6:0/2117704246 wait complete. 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.653+0000 7f2139b8c700 1 Processor -- start 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.653+0000 7f2139b8c700 1 -- start start 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f213406d120 0x7f21341595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21341578d0 0x7f21340b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134153f40 con 0x7f2134157ca0 2023-10-09T11:42:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340b4760 con 0x7f21341578d0 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2139b8c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21340b4de0 con 0x7f213406d120 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38598/0 (socket says 172.21.15.6:38598) 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 -- 172.21.15.6:0/1671902087 learned_addr learned my addr 172.21.15.6:0/1671902087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2132ffd700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21341578d0 0x7f21340b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f21337fe700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f213406d120 0x7f21341595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 -- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f213406d120 msgr2=0x7f21341595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f213406d120 0x7f21341595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 -- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21341578d0 msgr2=0x7f21340b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21341578d0 0x7f21340b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.654+0000 7f2133fff700 1 -- 172.21.15.6:0/1671902087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009a20 con 0x7f2134157ca0 2023-10-09T11:42:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f2133fff700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f212c013000 tx=0x7f212c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c027470 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c027630 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21340b50c0 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0279f0 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.655+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21340b4a40 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.656+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21340ceb10 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.656+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f212c024070 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.657+0000 7f211b7fe700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.657+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f212c086c90 con 0x7f2134157ca0 2023-10-09T11:42:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.657+0000 7f21337fe700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.657+0000 7f21337fe700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 0x7f21200693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2124006fd0 tx=0x7f2124008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.661+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f212c053f00 con 0x7f2134157ca0 2023-10-09T11:42:45.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.854+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21340d0170 con 0x7f2134157ca0 2023-10-09T11:42:45.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.855+0000 7f211b7fe700 1 -- 172.21.15.6:0/1671902087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f212c057520 con 0x7f2134157ca0 2023-10-09T11:42:45.857 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:45.857 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":133,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:35.931169+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:10.058517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:10.625524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 msgr2=0x7f21200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 0x7f21200693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2124006fd0 tx=0x7f2124008040 comp rx=0 tx=0).stop 2023-10-09T11:42:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 msgr2=0x7f21340b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f212c013000 tx=0x7f212c019000 comp rx=0 tx=0).stop 2023-10-09T11:42:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 shutdown_connections 2023-10-09T11:42:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2120066f30 0x7f21200693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2134157ca0 0x7f21340b40e0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f213406d120 0x7f21341595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 --2- 172.21.15.6:0/1671902087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21341578d0 0x7f21340b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 >> 172.21.15.6:0/1671902087 conn(0x7f213406bb90 msgr2=0x7f2134156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 shutdown_connections 2023-10-09T11:42:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.857+0000 7f2139b8c700 1 -- 172.21.15.6:0/1671902087 wait complete. 2023-10-09T11:42:45.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:42:45.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.991+0000 7febae8e2700 1 Processor -- start 2023-10-09T11:42:45.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.992+0000 7febae8e2700 1 -- start start 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.992+0000 7febae8e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feba8157ca0 0x7feba80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.992+0000 7febae8e2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80d07c0 con 0x7feba806d120 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.992+0000 7febae8e2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80cfbb0 con 0x7feba81578d0 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.992+0000 7febae8e2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80cfe90 con 0x7feba8157ca0 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7febace7f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feba806d120 0x7feba806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57282/0 (socket says 172.21.15.6:57282) 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7febace7f700 1 -- 172.21.15.6:0/4280418002 learned_addr learned my addr 172.21.15.6:0/4280418002 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235072563 0 0) 0x7feba80d07c0 con 0x7feba806d120 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90003570 con 0x7feba806d120 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba77fe700 1 --2- 172.21.15.6:0/4280418002 >> v2:172.21.15.118:3300/0 conn(0x7feba8157ca0 0x7feba80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4029801526 0 0) 0x7feb90003570 con 0x7feba806d120 2023-10-09T11:42:45.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 >> v2:172.21.15.118:3300/0 conn(0x7feba8157ca0 msgr2=0x7feba80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 --2- 172.21.15.6:0/4280418002 >> v2:172.21.15.118:3300/0 conn(0x7feba8157ca0 0x7feba80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 >> v1:172.21.15.118:6789/0 conn(0x7feba81578d0 legacy=0x7feba815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80d0170 con 0x7feba806d120 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7feba00017f0 con 0x7feba806d120 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 >> v1:172.21.15.6:6789/0 conn(0x7feba806d120 legacy=0x7feba806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cfe90 con 0x7feb900051c0 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c0d0 con 0x7feb90004810 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c290 con 0x7feb90003a60 2023-10-09T11:42:45.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7febace7f700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba7fff700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.993+0000 7feba77fe700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 -- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb90003a60 msgr2=0x7feb90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb90003a60 0x7feb90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 -- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb90004810 msgr2=0x7feb90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb90004810 0x7feb90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 -- 172.21.15.6:0/4280418002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90003570 con 0x7feb900051c0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 -- 172.21.15.6:0/4280418002 reap_dead start 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febace7f700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 0x7feb9000ba60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7feba000a930 tx=0x7feba00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdada85e315edd2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba00070d0 con 0x7feb900051c0 2023-10-09T11:42:45.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0007230 con 0x7feb900051c0 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7feba6ffd700 1 -- 172.21.15.6:0/4280418002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba00075d0 con 0x7feb900051c0 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febae8e2700 1 -- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 msgr2=0x7feb9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.994+0000 7febae8e2700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 0x7feb9000ba60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7feba000a930 tx=0x7feba00021d0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.995+0000 7febae8e2700 1 -- 172.21.15.6:0/4280418002 shutdown_connections 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.995+0000 7febae8e2700 1 --2- 172.21.15.6:0/4280418002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900051c0 0x7feb9000ba60 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.995+0000 7febae8e2700 1 -- 172.21.15.6:0/4280418002 >> 172.21.15.6:0/4280418002 conn(0x7feba806bb90 msgr2=0x7feba806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.995+0000 7febae8e2700 1 -- 172.21.15.6:0/4280418002 shutdown_connections 2023-10-09T11:42:46.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.995+0000 7febae8e2700 1 -- 172.21.15.6:0/4280418002 wait complete. 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.996+0000 7febae8e2700 1 Processor -- start 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.996+0000 7febae8e2700 1 -- start start 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb900051c0 0x7feba80b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feba80caf70 0x7feba80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80b4d20 con 0x7feba80c74b0 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80b5b80 con 0x7feba80caf70 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cd870 con 0x7feb900051c0 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38612/0 (socket says 172.21.15.6:38612) 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 -- 172.21.15.6:0/2714020794 learned_addr learned my addr 172.21.15.6:0/2714020794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba7fff700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb900051c0 0x7feba80b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febace7f700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feba80caf70 0x7feba80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 -- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb900051c0 msgr2=0x7feba80b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb900051c0 0x7feba80b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 -- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feba80caf70 msgr2=0x7feba80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feba80caf70 0x7feba80cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80b4f70 con 0x7feba80c74b0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feba77fe700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009fd0 tx=0x7feb9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00f790 con 0x7feba80c74b0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00f8f0 con 0x7feba80c74b0 2023-10-09T11:42:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80b5250 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.997+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00fc70 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.998+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80b5810 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.998+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80b5d30 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.999+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb9c014650 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.999+0000 7feb8ffff700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 0x7feb940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.999+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb9c018030 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.999+0000 7feba7fff700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 0x7feb940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:45.999+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=135}) v3 -- 0x7feb9406ea50 con 0x7feba80c74b0 2023-10-09T11:42:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.000+0000 7feba7fff700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 0x7feb940693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb98007e40 tx=0x7feb98007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.004+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb9c022060 con 0x7feba80c74b0 2023-10-09T11:42:46.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.244+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feba80d0450 con 0x7feba80c74b0 2023-10-09T11:42:46.246 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:42:46.245+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:42:46.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.246+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(135..135 src has 1..135) v4 ==== 366+0+0 (secure 0 0 0) 0x7feb9c055d30 con 0x7feba80c74b0 2023-10-09T11:42:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.246+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=136}) v3 -- 0x7feb9406f330 con 0x7feba80c74b0 2023-10-09T11:42:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.249+0000 7feb8ffff700 1 -- 172.21.15.6:0/2714020794 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7feba80b5d30 con 0x7feba80c74b0 2023-10-09T11:42:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 msgr2=0x7feb940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 0x7feb940693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb98007e40 tx=0x7feb98007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 msgr2=0x7feba80c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009fd0 tx=0x7feb9c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 shutdown_connections 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7feb94066f30 0x7feb940693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feba80caf70 0x7feba80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb900051c0 0x7feba80b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 --2- 172.21.15.6:0/2714020794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feba80c74b0 0x7feba80c7920 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.251+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 >> 172.21.15.6:0/2714020794 conn(0x7feba806bb90 msgr2=0x7feba8155af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.252+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 shutdown_connections 2023-10-09T11:42:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.252+0000 7febae8e2700 1 -- 172.21.15.6:0/2714020794 wait complete. 2023-10-09T11:42:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:42:46.255 INFO:tasks.ceph.mds.d.smithi118.stderr: -8661> 2023-10-09T11:42:07.175+0000 7f4e32410700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-09T11:42:46.255 INFO:tasks.ceph.mds.d.smithi118.stderr: -7488> 2023-10-09T11:42:17.570+0000 7f4e2c404700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:42:46.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:42:46.282 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:42:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.384+0000 7f42f463f700 1 Processor -- start 2023-10-09T11:42:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.384+0000 7f42f463f700 1 -- start start 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.385+0000 7f42f463f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec0b3bd0 0x7f42ec0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.385+0000 7f42f463f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42ec1583b0 0x7f42ec0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.385+0000 7f42f463f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0b2890 con 0x7f42ec157fe0 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.385+0000 7f42f463f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec0b4070 con 0x7f42ec1583b0 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.385+0000 7f42f463f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0b4350 con 0x7f42ec0b3bd0 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f23db700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f42ec157fe0 0x7f42ec0b34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57290/0 (socket says 172.21.15.6:57290) 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f23db700 1 -- 172.21.15.6:0/2983781934 learned_addr learned my addr 172.21.15.6:0/2983781934 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 --2- 172.21.15.6:0/2983781934 >> v2:172.21.15.118:3300/0 conn(0x7f42ec1583b0 0x7f42ec0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f1bda700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec0b3bd0 0x7f42ec0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f13d9700 1 -- 172.21.15.6:0/2983781934 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056056904 0 0) 0x7f42ec0b2890 con 0x7f42ec157fe0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f13d9700 1 -- 172.21.15.6:0/2983781934 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d4003570 con 0x7f42ec157fe0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 -- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec0b3bd0 msgr2=0x7f42ec0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec0b3bd0 0x7f42ec0ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 -- 172.21.15.6:0/2983781934 >> v1:172.21.15.6:6789/0 conn(0x7f42ec157fe0 legacy=0x7f42ec0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 -- 172.21.15.6:0/2983781934 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0b4630 con 0x7f42ec1583b0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f2bdc700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec1583b0 0x7f42ec0cf070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e60 tx=0x7f42dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5236e27e59c58eff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f13d9700 1 -- 172.21.15.6:0/2983781934 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00e070 con 0x7f42ec1583b0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f13d9700 1 -- 172.21.15.6:0/2983781934 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00bab0 con 0x7f42ec1583b0 2023-10-09T11:42:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.386+0000 7f42f13d9700 1 -- 172.21.15.6:0/2983781934 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00be70 con 0x7f42ec1583b0 2023-10-09T11:42:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 -- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec1583b0 msgr2=0x7f42ec0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec1583b0 0x7f42ec0cf070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e60 tx=0x7f42dc009780 comp rx=0 tx=0).stop 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 -- 172.21.15.6:0/2983781934 shutdown_connections 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec1583b0 0x7f42ec0cf070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 --2- 172.21.15.6:0/2983781934 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec0b3bd0 0x7f42ec0ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 -- 172.21.15.6:0/2983781934 >> 172.21.15.6:0/2983781934 conn(0x7f42ec067640 msgr2=0x7f42ec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 -- 172.21.15.6:0/2983781934 shutdown_connections 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.387+0000 7f42f463f700 1 -- 172.21.15.6:0/2983781934 wait complete. 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.388+0000 7f42f463f700 1 Processor -- start 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.388+0000 7f42f463f700 1 -- start start 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec0b3bd0 0x7f42ec13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec1583b0 0x7f42ec16bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec14fba0 con 0x7f42ec157fe0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec14ef90 con 0x7f42ec0b3bd0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f463f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec14f270 con 0x7f42ec1583b0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38614/0 (socket says 172.21.15.6:38614) 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 -- 172.21.15.6:0/666905589 learned_addr learned my addr 172.21.15.6:0/666905589 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f23db700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec0b3bd0 0x7f42ec13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f2bdc700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec1583b0 0x7f42ec16bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 -- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec1583b0 msgr2=0x7f42ec16bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec1583b0 0x7f42ec16bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 -- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec0b3bd0 msgr2=0x7f42ec13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec0b3bd0 0x7f42ec13f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009a20 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.389+0000 7f42f1bda700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e900 tx=0x7f42e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.390+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000eea0 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.390+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e000c850 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.390+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec14f550 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.390+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000cc10 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.390+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec14ec20 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.391+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec069e40 con 0x7f42ec157fe0 2023-10-09T11:42:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.391+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42e0013470 con 0x7f42ec157fe0 2023-10-09T11:42:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.391+0000 7f42ea7fc700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 0x7f42d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.392+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f42e0084b00 con 0x7f42ec157fe0 2023-10-09T11:42:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.392+0000 7f42f23db700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 0x7f42d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.392+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=136}) v3 -- 0x7f42d806eaf0 con 0x7f42ec157fe0 2023-10-09T11:42:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.392+0000 7f42f23db700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 0x7f42d80693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f42e40058d0 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.396+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42e0017060 con 0x7f42ec157fe0 2023-10-09T11:42:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:46.636+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42ec064650 con 0x7f42ec157fe0 2023-10-09T11:42:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.249+0000 7f42ea7fc700 1 -- 172.21.15.6:0/666905589 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42ec064650 con 0x7f42ec157fe0 2023-10-09T11:42:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.251+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 msgr2=0x7f42d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.251+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 0x7f42d80693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f42e40058d0 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.251+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 msgr2=0x7f42ec0c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.251+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e900 tx=0x7f42e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.251+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 shutdown_connections 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f42d8066f30 0x7f42d80693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42ec1583b0 0x7f42ec16bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42ec0b3bd0 0x7f42ec13f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 --2- 172.21.15.6:0/666905589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ec157fe0 0x7f42ec0c3940 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 >> 172.21.15.6:0/666905589 conn(0x7f42ec067640 msgr2=0x7f42ec14db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 shutdown_connections 2023-10-09T11:42:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.252+0000 7f42f463f700 1 -- 172.21.15.6:0/666905589 wait complete. 2023-10-09T11:42:47.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:42:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.392+0000 7fc7324e4700 1 Processor -- start 2023-10-09T11:42:47.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.392+0000 7fc7324e4700 1 -- start start 2023-10-09T11:42:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc7324e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc72c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc7324e4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0d07c0 con 0x7fc72c1578d0 2023-10-09T11:42:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc7324e4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0cfbb0 con 0x7fc72c06d120 2023-10-09T11:42:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc7324e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0cfe90 con 0x7fc72c157ca0 2023-10-09T11:42:47.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc72bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc72c1578d0 0x7fc72c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57292/0 (socket says 172.21.15.6:57292) 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc72bfff700 1 -- 172.21.15.6:0/1032255569 learned_addr learned my addr 172.21.15.6:0/1032255569 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc72c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.393+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615260295 0 0) 0x7fc72c0d07c0 con 0x7fc72c1578d0 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc718003570 con 0x7fc72c1578d0 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118618934 0 0) 0x7fc718003570 con 0x7fc72c1578d0 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 msgr2=0x7fc72c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc72c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 >> v1:172.21.15.118:6789/0 conn(0x7fc72c06d120 legacy=0x7fc72c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0d0170 con 0x7fc72c1578d0 2023-10-09T11:42:47.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fc71c001470 con 0x7fc72c1578d0 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 >> v1:172.21.15.6:6789/0 conn(0x7fc72c1578d0 legacy=0x7fc72c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc718003a90 0x7fc718003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc718004810 0x7fc718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc7180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0cfe90 con 0x7fc718004810 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71800bb10 con 0x7fc718003a90 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71800bcd0 con 0x7fc72c157ca0 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc718004810 0x7fc718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72bfff700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc718003a90 0x7fc718003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc730a81700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc7180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 -- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 msgr2=0x7fc7180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc72c157ca0 0x7fc7180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 -- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc718003a90 msgr2=0x7fc718003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc718003a90 0x7fc718003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 -- 172.21.15.6:0/1032255569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718003570 con 0x7fc718004810 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.394+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc718004810 0x7fc718004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc714009c00 tx=0x7fc7140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87489d93c3a25d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400e710 con 0x7fc718004810 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400e870 con 0x7fc718004810 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc72affd700 1 -- 172.21.15.6:0/1032255569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400ec30 con 0x7fc718004810 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 -- 172.21.15.6:0/1032255569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc718004810 msgr2=0x7fc718004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 --2- 172.21.15.6:0/1032255569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc718004810 0x7fc718004c80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc714009c00 tx=0x7fc7140091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc730a81700 1 -- 172.21.15.6:0/1032255569 reap_dead start 2023-10-09T11:42:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 -- 172.21.15.6:0/1032255569 shutdown_connections 2023-10-09T11:42:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 -- 172.21.15.6:0/1032255569 >> 172.21.15.6:0/1032255569 conn(0x7fc72c06bb90 msgr2=0x7fc72c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 -- 172.21.15.6:0/1032255569 shutdown_connections 2023-10-09T11:42:47.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.395+0000 7fc7324e4700 1 -- 172.21.15.6:0/1032255569 wait complete. 2023-10-09T11:42:47.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.396+0000 7fc7324e4700 1 Processor -- start 2023-10-09T11:42:47.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 -- start start 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 0x7fc72c14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72c069850 0x7fc72c069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c14be00 con 0x7fc72c0cbf60 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0c8640 con 0x7fc72c069850 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc7324e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c06a1c0 con 0x7fc718004810 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc72b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc72b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38630/0 (socket says 172.21.15.6:38630) 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.397+0000 7fc72b7fe700 1 -- 172.21.15.6:0/2246819879 learned_addr learned my addr 172.21.15.6:0/2246819879 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:47.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc730a81700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72c069850 0x7fc72c069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72bfff700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 0x7fc72c14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 -- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 msgr2=0x7fc72c14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 0x7fc72c14b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 -- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72c069850 msgr2=0x7fc72c069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72c069850 0x7fc72c069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0c67e0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72bfff700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 0x7fc72c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc72b7fe700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc71400e4b0 tx=0x7fc71401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714022070 con 0x7fc72c0cbf60 2023-10-09T11:42:47.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400e9e0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c0c6ac0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71401c450 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.398+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c0c82d0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.399+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c0c7e40 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.399+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc71401c880 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.400+0000 7fc723fff700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.400+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc714085cd0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.400+0000 7fc72bfff700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.400+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=136}) v3 -- 0x7fc70c06eaf0 con 0x7fc72c0cbf60 2023-10-09T11:42:47.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.400+0000 7fc72bfff700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 0x7fc70c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0015a0 tx=0x7fc71c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:47.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.404+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc71402b060 con 0x7fc72c0cbf60 2023-10-09T11:42:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:47.597+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc72c0cf700 con 0x7fc72c0cbf60 2023-10-09T11:42:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.249+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(136..136 src has 1..136) v4 ==== 288+0+0 (secure 0 0 0) 0x7fc714056c60 con 0x7fc72c0cbf60 2023-10-09T11:42:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.249+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=137}) v3 -- 0x7fc70c06cf20 con 0x7fc72c0cbf60 2023-10-09T11:42:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.252+0000 7fc723fff700 1 -- 172.21.15.6:0/2246819879 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v136) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc71402b030 con 0x7fc72c0cbf60 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 msgr2=0x7fc70c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 0x7fc70c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0015a0 tx=0x7fc71c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 msgr2=0x7fc72c0cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc71400e4b0 tx=0x7fc71401a000 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 shutdown_connections 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc70c066f30 0x7fc70c0693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72c069850 0x7fc72c069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc718004810 0x7fc72c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 --2- 172.21.15.6:0/2246819879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc72c0cbf60 0x7fc72c0cc3d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 >> 172.21.15.6:0/2246819879 conn(0x7fc72c06bb90 msgr2=0x7fc72c15bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 shutdown_connections 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.260+0000 7fc7324e4700 1 -- 172.21.15.6:0/2246819879 wait complete. 2023-10-09T11:42:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:42:48.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:42:48.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.402+0000 7f02ed6d3700 1 Processor -- start 2023-10-09T11:42:48.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.402+0000 7f02ed6d3700 1 -- start start 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02ed6d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02e81578d0 0x7f02e80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02ed6d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e8157ca0 0x7f02e815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02ed6d3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80d07c0 con 0x7f02e806d120 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02ed6d3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80cfbb0 con 0x7f02e81578d0 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02ed6d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80cfe90 con 0x7f02e8157ca0 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02e6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02e81578d0 0x7f02e80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02e77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02e806d120 0x7f02e815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57300/0 (socket says 172.21.15.6:57300) 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.403+0000 7f02e77fe700 1 -- 172.21.15.6:0/2035263528 learned_addr learned my addr 172.21.15.6:0/2035263528 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e6ffd700 1 -- 172.21.15.6:0/2035263528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e8157ca0 msgr2=0x7f02e815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e67fc700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e8157ca0 0x7f02e815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e6ffd700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e8157ca0 0x7f02e815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e5ffb700 1 -- 172.21.15.6:0/2035263528 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577204518 0 0) 0x7f02e80d07c0 con 0x7f02e806d120 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e6ffd700 1 -- 172.21.15.6:0/2035263528 >> v1:172.21.15.6:6789/0 conn(0x7f02e806d120 legacy=0x7f02e815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e6ffd700 1 -- 172.21.15.6:0/2035263528 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80d0170 con 0x7f02e81578d0 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e6ffd700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e81578d0 0x7f02e80cf4f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f02d80098e0 tx=0x7f02d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62604cb9371a85a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e5ffb700 1 -- 172.21.15.6:0/2035263528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8009e80 con 0x7f02e81578d0 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e5ffb700 1 -- 172.21.15.6:0/2035263528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800b860 con 0x7f02e81578d0 2023-10-09T11:42:48.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02e5ffb700 1 -- 172.21.15.6:0/2035263528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800bbe0 con 0x7f02e81578d0 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02ed6d3700 1 -- 172.21.15.6:0/2035263528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e81578d0 msgr2=0x7f02e80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.404+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e81578d0 0x7f02e80cf4f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f02d80098e0 tx=0x7f02d80091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 -- 172.21.15.6:0/2035263528 shutdown_connections 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e81578d0 0x7f02e80cf4f0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/2035263528 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e8157ca0 0x7f02e815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 -- 172.21.15.6:0/2035263528 >> 172.21.15.6:0/2035263528 conn(0x7f02e806bb90 msgr2=0x7f02e806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 -- 172.21.15.6:0/2035263528 shutdown_connections 2023-10-09T11:42:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.405+0000 7f02ed6d3700 1 -- 172.21.15.6:0/2035263528 wait complete. 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.406+0000 7f02ed6d3700 1 Processor -- start 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.406+0000 7f02ed6d3700 1 -- start start 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.406+0000 7f02ed6d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e81578d0 0x7f02e80ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e8157ca0 0x7f02e80aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80b54a0 con 0x7f02e806d120 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8154970 con 0x7f02e8157ca0 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80abf50 con 0x7f02e81578d0 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38648/0 (socket says 172.21.15.6:38648) 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 -- 172.21.15.6:0/3348837678 learned_addr learned my addr 172.21.15.6:0/3348837678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e67fc700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e81578d0 0x7f02e80ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e77fe700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e8157ca0 0x7f02e80aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 -- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e81578d0 msgr2=0x7f02e80ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e81578d0 0x7f02e80ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 -- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e8157ca0 msgr2=0x7f02e80aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e8157ca0 0x7f02e80aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009420 con 0x7f02e806d120 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02e6ffd700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b3c0 tx=0x7f02d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d800bbe0 con 0x7f02e806d120 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8000cc0 con 0x7f02e806d120 2023-10-09T11:42:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80ac1e0 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8011650 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.407+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80b4e50 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.408+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8067ac0 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02d8011a40 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02deffd700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 0x7f02c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f02d8085a50 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02e67fc700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 0x7f02c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=137}) v3 -- 0x7f02c806dcf0 con 0x7f02e806d120 2023-10-09T11:42:48.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.409+0000 7f02e67fc700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 0x7f02c80693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f02e80b6ba0 tx=0x7f02d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:48.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.413+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02d8015060 con 0x7f02e806d120 2023-10-09T11:42:48.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:48.606+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02e80d0450 con 0x7f02e806d120 2023-10-09T11:42:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.265+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(137..137 src has 1..137) v4 ==== 288+0+0 (secure 0 0 0) 0x7f02d80571e0 con 0x7f02e806d120 2023-10-09T11:42:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.265+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7f02c806ca80 con 0x7f02e806d120 2023-10-09T11:42:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.269+0000 7f02deffd700 1 -- 172.21.15.6:0/3348837678 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v137) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02d8028070 con 0x7f02e806d120 2023-10-09T11:42:49.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 msgr2=0x7f02c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 0x7f02c80693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f02e80b6ba0 tx=0x7f02d0008040 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 msgr2=0x7f02e80af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b3c0 tx=0x7f02d8017000 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 shutdown_connections 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f02c8066f30 0x7f02c80693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e8157ca0 0x7f02e80aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e806d120 0x7f02e80af4b0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 --2- 172.21.15.6:0/3348837678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02e81578d0 0x7f02e80ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 >> 172.21.15.6:0/3348837678 conn(0x7f02e806bb90 msgr2=0x7f02e8155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 shutdown_connections 2023-10-09T11:42:49.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.274+0000 7f02ed6d3700 1 -- 172.21.15.6:0/3348837678 wait complete. 2023-10-09T11:42:49.277 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:42:49.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:42:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.409+0000 7f52d5c9a700 1 Processor -- start 2023-10-09T11:42:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.409+0000 7f52d5c9a700 1 -- start start 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5c9a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f52d00d0b80 0x7f52d00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5c9a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d00d02b0 0x7f52d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5c9a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00cf2d0 con 0x7f52d00d0f50 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5c9a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d015a690 con 0x7f52d00d02b0 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5c9a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d006dc00 con 0x7f52d00d0b80 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d00d02b0 0x7f52d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5499700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52d00d0f50 0x7f52d015b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57314/0 (socket says 172.21.15.6:57314) 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d5499700 1 -- 172.21.15.6:0/1627341718 learned_addr learned my addr 172.21.15.6:0/1627341718 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52d4c98700 1 --2- 172.21.15.6:0/1627341718 >> v2:172.21.15.118:3300/0 conn(0x7f52d00d0b80 0x7f52d00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cffff700 1 -- 172.21.15.6:0/1627341718 >> v2:172.21.15.118:3300/0 conn(0x7f52d00d0b80 msgr2=0x7f52d00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cffff700 1 --2- 172.21.15.6:0/1627341718 >> v2:172.21.15.118:3300/0 conn(0x7f52d00d0b80 0x7f52d00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cffff700 1 -- 172.21.15.6:0/1627341718 >> v1:172.21.15.6:6789/0 conn(0x7f52d00d0f50 legacy=0x7f52d015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cffff700 1 -- 172.21.15.6:0/1627341718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00cf570 con 0x7f52d00d02b0 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.410+0000 7f52cf7fe700 1 -- 172.21.15.6:0/1627341718 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155343366 0 0) 0x7f52d00cf2d0 con 0x7f52d00d0f50 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52cffff700 1 --2- 172.21.15.6:0/1627341718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d02b0 0x7f52d006cff0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f52d006cd80 tx=0x7f52c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3928bb505dd5a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52cf7fe700 1 -- 172.21.15.6:0/1627341718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011630 con 0x7f52d00d02b0 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52cf7fe700 1 -- 172.21.15.6:0/1627341718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4011790 con 0x7f52d00d02b0 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52cf7fe700 1 -- 172.21.15.6:0/1627341718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011b30 con 0x7f52d00d02b0 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 -- 172.21.15.6:0/1627341718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d02b0 msgr2=0x7f52d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/1627341718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d02b0 0x7f52d006cff0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f52d006cd80 tx=0x7f52c40091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 -- 172.21.15.6:0/1627341718 shutdown_connections 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/1627341718 >> v2:172.21.15.118:3300/0 conn(0x7f52d00d0b80 0x7f52d00cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/1627341718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d02b0 0x7f52d006cff0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 -- 172.21.15.6:0/1627341718 >> 172.21.15.6:0/1627341718 conn(0x7f52d0063230 msgr2=0x7f52d0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 -- 172.21.15.6:0/1627341718 shutdown_connections 2023-10-09T11:42:49.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.411+0000 7f52d5c9a700 1 -- 172.21.15.6:0/1627341718 wait complete. 2023-10-09T11:42:49.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.412+0000 7f52d5c9a700 1 Processor -- start 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 -- start start 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52d00d02b0 0x7f52d014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52d00d0b80 0x7f52d00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d014f690 con 0x7f52d00d0f50 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b47b0 con 0x7f52d00d02b0 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5c9a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b4a90 con 0x7f52d00d0b80 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38678/0 (socket says 172.21.15.6:38678) 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.413+0000 7f52d5499700 1 -- 172.21.15.6:0/4045844025 learned_addr learned my addr 172.21.15.6:0/4045844025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d4c98700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52d00d02b0 0x7f52d014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52cffff700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52d00d0b80 0x7f52d00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 -- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52d00d0b80 msgr2=0x7f52d00b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52d00d0b80 0x7f52d00b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 -- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52d00d02b0 msgr2=0x7f52d014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52d00d02b0 0x7f52d014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 -- 172.21.15.6:0/4045844025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009420 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5499700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cc10 tx=0x7f52c8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800a850 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800a9d0 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800ad90 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00b4d70 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.414+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00b53d0 con 0x7f52d00d0f50 2023-10-09T11:42:49.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.415+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00676e0 con 0x7f52d00d0f50 2023-10-09T11:42:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.416+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52c8007300 con 0x7f52d00d0f50 2023-10-09T11:42:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.416+0000 7f52ccff9700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.416+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f52c8084460 con 0x7f52d00d0f50 2023-10-09T11:42:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.416+0000 7f52d4c98700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.416+0000 7f52d4c98700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 0x7f52bc0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009db0 tx=0x7f52c00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.420+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52c8051a50 con 0x7f52d00d0f50 2023-10-09T11:42:49.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.614+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f52d00cf850 con 0x7f52d00d0f50 2023-10-09T11:42:49.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.620+0000 7f52ccff9700 1 -- 172.21.15.6:0/4045844025 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f52c8055070 con 0x7f52d00d0f50 2023-10-09T11:42:49.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 msgr2=0x7f52bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 0x7f52bc0693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009db0 tx=0x7f52c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 msgr2=0x7f52d0156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f52c800cc10 tx=0x7f52c8001970 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 shutdown_connections 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f52bc066f30 0x7f52bc0693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d00d0f50 0x7f52d0156c40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52d00d02b0 0x7f52d014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 --2- 172.21.15.6:0/4045844025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f52d00d0b80 0x7f52d00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 >> 172.21.15.6:0/4045844025 conn(0x7f52d0063230 msgr2=0x7f52d01580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 shutdown_connections 2023-10-09T11:42:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.622+0000 7f52d5c9a700 1 -- 172.21.15.6:0/4045844025 wait complete. 2023-10-09T11:42:49.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-09T11:42:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.752+0000 7fa37d1f5700 1 Processor -- start 2023-10-09T11:42:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.752+0000 7fa37d1f5700 1 -- start start 2023-10-09T11:42:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37d1f5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 0x7fa3780aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37d1f5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3780ce5c0 0x7fa37815e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37d1f5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37815dfb0 con 0x7fa3780ac570 2023-10-09T11:42:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37d1f5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3780acec0 con 0x7fa3780ce5c0 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37d1f5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ad1a0 con 0x7fa3780ce1f0 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa376d9d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 0x7fa3780aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3780ce5c0 0x7fa37815e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.753+0000 7fa37759e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa3780ac570 0x7fa37806e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:42582/0 (socket says 172.21.15.6:42582) 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37759e700 1 -- 172.21.15.6:0/850281279 learned_addr learned my addr 172.21.15.6:0/850281279 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa375d9b700 1 -- 172.21.15.6:0/850281279 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484430356 0 0) 0x7fa37815dfb0 con 0x7fa3780ac570 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa375d9b700 1 -- 172.21.15.6:0/850281279 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa364003570 con 0x7fa3780ac570 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37659c700 1 -- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 msgr2=0x7fa3780aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37659c700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 0x7fa3780aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37659c700 1 -- 172.21.15.6:0/850281279 >> v1:172.21.15.118:6789/0 conn(0x7fa3780ac570 legacy=0x7fa37806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37659c700 1 -- 172.21.15.6:0/850281279 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37815dc40 con 0x7fa3780ce5c0 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa376d9d700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 0x7fa3780aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa37659c700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa37815e440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098e0 tx=0x7fa3600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4ddc1a842370184 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa375d9b700 1 -- 172.21.15.6:0/850281279 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011630 con 0x7fa3780ce5c0 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa375d9b700 1 -- 172.21.15.6:0/850281279 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360011790 con 0x7fa3780ce5c0 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.754+0000 7fa375d9b700 1 -- 172.21.15.6:0/850281279 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011b30 con 0x7fa3780ce5c0 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 -- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 msgr2=0x7fa37815e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa37815e440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098e0 tx=0x7fa3600091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 -- 172.21.15.6:0/850281279 shutdown_connections 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ce1f0 0x7fa3780aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/850281279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa37815e440 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 -- 172.21.15.6:0/850281279 >> 172.21.15.6:0/850281279 conn(0x7fa37806cca0 msgr2=0x7fa37806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 -- 172.21.15.6:0/850281279 shutdown_connections 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.755+0000 7fa37d1f5700 1 -- 172.21.15.6:0/850281279 wait complete. 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.756+0000 7fa37d1f5700 1 Processor -- start 2023-10-09T11:42:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.756+0000 7fa37d1f5700 1 -- start start 2023-10-09T11:42:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ac570 0x7fa37814a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa3781575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ada80 con 0x7fa3780ce1f0 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780add60 con 0x7fa3780ce5c0 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37d1f5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780ae040 con 0x7fa3780ac570 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38684/0 (socket says 172.21.15.6:38684) 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 -- 172.21.15.6:0/4192598378 learned_addr learned my addr 172.21.15.6:0/4192598378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa376d9d700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ac570 0x7fa37814a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37759e700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa3781575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 -- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ac570 msgr2=0x7fa37814a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ac570 0x7fa37814a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 -- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 msgr2=0x7fa3781575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa3781575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.757+0000 7fa37659c700 1 -- 172.21.15.6:0/4192598378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009420 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa37659c700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa37806cc70 tx=0x7fa360017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36001f070 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360000bc0 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa360009420 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011b30 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.758+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3780c2ac0 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.759+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa378068900 con 0x7fa3780ce1f0 2023-10-09T11:42:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.759+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa360023070 con 0x7fa3780ce1f0 2023-10-09T11:42:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.760+0000 7fa36effd700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.760+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa3600854c0 con 0x7fa3780ce1f0 2023-10-09T11:42:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.760+0000 7fa376d9d700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.760+0000 7fa376d9d700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 0x7fa3580693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa370009f40 tx=0x7fa3700091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:49.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:49.764+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa360052a30 con 0x7fa3780ce1f0 2023-10-09T11:42:50.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.032+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fa37815e980 con 0x7fa3780ce1f0 2023-10-09T11:42:50.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.258+0000 7fa36effd700 1 -- 172.21.15.6:0/4192598378 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v350) v1 ==== 140+0+0 (secure 0 0 0) 0x7fa36002a0d0 con 0x7fa3780ce1f0 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 msgr2=0x7fa3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 0x7fa3580693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa370009f40 tx=0x7fa3700091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 msgr2=0x7fa378157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa37806cc70 tx=0x7fa360017000 comp rx=0 tx=0).stop 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 shutdown_connections 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa358066f30 0x7fa3580693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780ce5c0 0x7fa3781575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780ac570 0x7fa37814a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 --2- 172.21.15.6:0/4192598378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3780ce1f0 0x7fa378157080 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 >> 172.21.15.6:0/4192598378 conn(0x7fa37806cca0 msgr2=0x7fa3780aa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 shutdown_connections 2023-10-09T11:42:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.260+0000 7fa37d1f5700 1 -- 172.21.15.6:0/4192598378 wait complete. 2023-10-09T11:42:50.274 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T11:42:50.274 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T11:42:50.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-09T11:42:50.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.392+0000 7f296f142700 1 Processor -- start 2023-10-09T11:42:50.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.392+0000 7f296f142700 1 -- start start 2023-10-09T11:42:50.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296f142700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2968159f10 0x7f2968068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296f142700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 0x7f29680cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296f142700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680cee10 con 0x7f2968159b40 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296f142700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2968069140 con 0x7f2968159f10 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296f142700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680cd040 con 0x7f2968068cc0 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296e140700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2968159b40 0x7f29680cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:57320/0 (socket says 172.21.15.6:57320) 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296e140700 1 -- 172.21.15.6:0/1966636900 learned_addr learned my addr 172.21.15.6:0/1966636900 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296e941700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 0x7f29680cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.393+0000 7f296d93f700 1 --2- 172.21.15.6:0/1966636900 >> v2:172.21.15.118:3300/0 conn(0x7f2968159f10 0x7f2968068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311073632 0 0) 0x7f29680cee10 con 0x7f2968159b40 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2950003570 con 0x7f2968159b40 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352473100 0 0) 0x7f2950003570 con 0x7f2968159b40 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d93f700 1 -- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 msgr2=0x7f29680cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d93f700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 0x7f29680cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d93f700 1 -- 172.21.15.6:0/1966636900 >> v1:172.21.15.6:6789/0 conn(0x7f2968159b40 legacy=0x7f29680cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d93f700 1 -- 172.21.15.6:0/1966636900 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680cd320 con 0x7f2968159f10 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296e941700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 0x7f29680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d93f700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f2968068780 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f295c0098e0 tx=0x7f295c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aadde15eee93a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580017f0 con 0x7f2968159f10 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c011420 con 0x7f2968159f10 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.394+0000 7f296d13e700 1 -- 172.21.15.6:0/1966636900 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0117c0 con 0x7f2968159f10 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 -- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 msgr2=0x7f2968068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f2968068780 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f295c0098e0 tx=0x7f295c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 -- 172.21.15.6:0/1966636900 shutdown_connections 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968068cc0 0x7f29680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 --2- 172.21.15.6:0/1966636900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f2968068780 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 -- 172.21.15.6:0/1966636900 >> 172.21.15.6:0/1966636900 conn(0x7f29680cd660 msgr2=0x7f29680cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:50.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 -- 172.21.15.6:0/1966636900 shutdown_connections 2023-10-09T11:42:50.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.395+0000 7f296f142700 1 -- 172.21.15.6:0/1966636900 wait complete. 2023-10-09T11:42:50.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.396+0000 7f296f142700 1 Processor -- start 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.396+0000 7f296f142700 1 -- start start 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 0x7f2968158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f296816a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296815b5a0 con 0x7f2968068cc0 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296815b880 con 0x7f2968159f10 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296815bb60 con 0x7f2968159b40 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38688/0 (socket says 172.21.15.6:38688) 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 -- 172.21.15.6:0/425900504 learned_addr learned my addr 172.21.15.6:0/425900504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296d93f700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 0x7f2968158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e941700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f296816a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 -- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 msgr2=0x7f2968158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 0x7f2968158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 -- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 msgr2=0x7f296816a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f296816a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 -- 172.21.15.6:0/425900504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009420 con 0x7f2968068cc0 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296d93f700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 0x7f2968158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e941700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f296816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296e140700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f295800ccd0 tx=0x7f29580016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958004dc0 con 0x7f2968068cc0 2023-10-09T11:42:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295800a920 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295800ace0 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c009420 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.397+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296815c120 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.398+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29680cb890 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.399+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2958007360 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.399+0000 7f29667fc700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 0x7f29540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.399+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2958083ee0 con 0x7f2968068cc0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.399+0000 7f296d93f700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 0x7f29540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.400+0000 7f296d93f700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 0x7f29540693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f296815d880 tx=0x7f295c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.404+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29580514d0 con 0x7f2968068cc0 2023-10-09T11:42:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:50.673+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f29680ce7c0 con 0x7f2968068cc0 2023-10-09T11:42:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.258+0000 7f29667fc700 1 -- 172.21.15.6:0/425900504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v351) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2958018070 con 0x7f2968068cc0 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 msgr2=0x7f29540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 0x7f29540693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f296815d880 tx=0x7f295c016000 comp rx=0 tx=0).stop 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 msgr2=0x7f296815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f295800ccd0 tx=0x7f29580016f0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 shutdown_connections 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2954066f30 0x7f29540693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2968159f10 0x7f296816a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2968068cc0 0x7f296815ad50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 --2- 172.21.15.6:0/425900504 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2968159b40 0x7f2968158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 >> 172.21.15.6:0/425900504 conn(0x7f29680cd660 msgr2=0x7f29680cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 shutdown_connections 2023-10-09T11:42:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.260+0000 7f296f142700 1 -- 172.21.15.6:0/425900504 wait complete. 2023-10-09T11:42:51.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:42:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.397+0000 7f5b7dc28700 1 Processor -- start 2023-10-09T11:42:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.397+0000 7f5b7dc28700 1 -- start start 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b7dc28700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b780cf240 0x7f5b780b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b7dc28700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7806d650 0x7f5b7806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b7dc28700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b0ca0 con 0x7f5b7815a2a0 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b7dc28700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7806ea90 con 0x7f5b7806d650 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b7dc28700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b00d0 con 0x7f5b780cf240 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7806d650 0x7f5b7806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7806d650 0x7f5b7806da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38692/0 (socket says 172.21.15.6:38692) 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 -- 172.21.15.6:0/1274729757 learned_addr learned my addr 172.21.15.6:0/1274729757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b76ffd700 1 --2- 172.21.15.6:0/1274729757 >> v2:172.21.15.118:3300/0 conn(0x7f5b780cf240 0x7f5b780b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 -- 172.21.15.6:0/1274729757 >> v2:172.21.15.118:3300/0 conn(0x7f5b780cf240 msgr2=0x7f5b780b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 --2- 172.21.15.6:0/1274729757 >> v2:172.21.15.118:3300/0 conn(0x7f5b780cf240 0x7f5b780b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 -- 172.21.15.6:0/1274729757 >> v1:172.21.15.118:6789/0 conn(0x7f5b7815a2a0 legacy=0x7f5b780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 -- 172.21.15.6:0/1274729757 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780b0370 con 0x7f5b7806d650 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b77fff700 1 --2- 172.21.15.6:0/1274729757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7806d650 0x7f5b7806da20 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5b780713b0 tx=0x7f5b70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e786443ca4f204 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.398+0000 7f5b767fc700 1 -- 172.21.15.6:0/1274729757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000e070 con 0x7f5b7806d650 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b767fc700 1 -- 172.21.15.6:0/1274729757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000ba20 con 0x7f5b7806d650 2023-10-09T11:42:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b767fc700 1 -- 172.21.15.6:0/1274729757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700092e0 con 0x7f5b7806d650 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1274729757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7806d650 msgr2=0x7f5b7806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1274729757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7806d650 0x7f5b7806da20 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5b780713b0 tx=0x7f5b70009840 comp rx=0 tx=0).stop 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1274729757 shutdown_connections 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1274729757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7806d650 0x7f5b7806da20 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1274729757 >> v2:172.21.15.118:3300/0 conn(0x7f5b780cf240 0x7f5b780b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1274729757 >> 172.21.15.6:0/1274729757 conn(0x7f5b78067640 msgr2=0x7f5b78067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1274729757 shutdown_connections 2023-10-09T11:42:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.399+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1274729757 wait complete. 2023-10-09T11:42:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.400+0000 7f5b7dc28700 1 Processor -- start 2023-10-09T11:42:51.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.400+0000 7f5b7dc28700 1 -- start start 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b7806d650 0x7f5b781469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 0x7f5b780ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780b25c0 con 0x7f5b780cf240 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780b1fb0 con 0x7f5b7815a2a0 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b7dc28700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7815f6d0 con 0x7f5b7806d650 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38702/0 (socket says 172.21.15.6:38702) 2023-10-09T11:42:51.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b76ffd700 1 -- 172.21.15.6:0/1624149200 learned_addr learned my addr 172.21.15.6:0/1624149200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b77fff700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 0x7f5b780ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.401+0000 7f5b777fe700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b7806d650 0x7f5b781469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 -- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b7806d650 msgr2=0x7f5b781469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b7806d650 0x7f5b781469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 -- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 msgr2=0x7f5b780ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 0x7f5b780ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 -- 172.21.15.6:0/1624149200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70009ae0 con 0x7f5b780cf240 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b77fff700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 0x7f5b780ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b76ffd700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00ea50 tx=0x7f5b6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00c9b0 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00cb10 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c013470 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780b2250 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.402+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7815f9b0 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.403+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78069e40 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.403+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b6c013860 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.404+0000 7f5b5f7fe700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 0x7f5b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.404+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5b6c0846e0 con 0x7f5b780cf240 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.404+0000 7f5b777fe700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 0x7f5b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.404+0000 7f5b777fe700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 0x7f5b640693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000c00 tx=0x7f5b68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.408+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b6c051c50 con 0x7f5b780cf240 2023-10-09T11:42:51.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.599+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5b7804bb80 con 0x7f5b780cf240 2023-10-09T11:42:51.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.603+0000 7f5b5f7fe700 1 -- 172.21.15.6:0/1624149200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5b6c055270 con 0x7f5b780cf240 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 msgr2=0x7f5b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 0x7f5b640693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000c00 tx=0x7f5b68009040 comp rx=0 tx=0).stop 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 msgr2=0x7f5b7815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00ea50 tx=0x7f5b6c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 shutdown_connections 2023-10-09T11:42:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b64066f30 0x7f5b640693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b7815a2a0 0x7f5b780ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b7806d650 0x7f5b781469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 --2- 172.21.15.6:0/1624149200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b780cf240 0x7f5b7815eea0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 >> 172.21.15.6:0/1624149200 conn(0x7f5b78067640 msgr2=0x7f5b78067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 shutdown_connections 2023-10-09T11:42:51.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.605+0000 7f5b7dc28700 1 -- 172.21.15.6:0/1624149200 wait complete. 2023-10-09T11:42:51.619 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:42:51.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:51.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:42:51.700 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:42:51.700 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:42:51.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:42:51.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.818+0000 7f7dcd862700 1 Processor -- start 2023-10-09T11:42:51.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.818+0000 7f7dcd862700 1 -- start start 2023-10-09T11:42:51.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dcd862700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 0x7f7dc80ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dcd862700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc80c3020 0x7f7dc81618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dcd862700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80c8e20 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dcd862700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80c9100 con 0x7f7dc80c3020 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dcd862700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80c1810 con 0x7f7dc8068980 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc80c3020 0x7f7dc81618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc80c3020 0x7f7dc81618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38714/0 (socket says 172.21.15.6:38714) 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 -- 172.21.15.6:0/2372145954 learned_addr learned my addr 172.21.15.6:0/2372145954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 -- 172.21.15.6:0/2372145954 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 msgr2=0x7f7dc80ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc67fc700 1 --2- 172.21.15.6:0/2372145954 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 0x7f7dc80ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/2372145954 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 0x7f7dc80ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 -- 172.21.15.6:0/2372145954 >> v1:172.21.15.118:6789/0 conn(0x7f7dc80c6fc0 legacy=0x7f7dc80c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 -- 172.21.15.6:0/2372145954 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80c1af0 con 0x7f7dc80c3020 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc67fc700 1 --2- 172.21.15.6:0/2372145954 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 0x7f7dc80ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/2372145954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c3020 0x7f7dc81618e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8068670 tx=0x7f7dc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf70f63c24c664f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc5ffb700 1 -- 172.21.15.6:0/2372145954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000e070 con 0x7f7dc80c3020 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc5ffb700 1 -- 172.21.15.6:0/2372145954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000ba10 con 0x7f7dc80c3020 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.819+0000 7f7dc5ffb700 1 -- 172.21.15.6:0/2372145954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00092e0 con 0x7f7dc80c3020 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 -- 172.21.15.6:0/2372145954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c3020 msgr2=0x7f7dc81618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 --2- 172.21.15.6:0/2372145954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c3020 0x7f7dc81618e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8068670 tx=0x7f7dc0009840 comp rx=0 tx=0).stop 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 -- 172.21.15.6:0/2372145954 shutdown_connections 2023-10-09T11:42:51.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 --2- 172.21.15.6:0/2372145954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c3020 0x7f7dc81618e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 --2- 172.21.15.6:0/2372145954 >> v2:172.21.15.118:3300/0 conn(0x7f7dc8068980 0x7f7dc80ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 -- 172.21.15.6:0/2372145954 >> 172.21.15.6:0/2372145954 conn(0x7f7dc806c660 msgr2=0x7f7dc80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:51.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 -- 172.21.15.6:0/2372145954 shutdown_connections 2023-10-09T11:42:51.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.820+0000 7f7dcd862700 1 -- 172.21.15.6:0/2372145954 wait complete. 2023-10-09T11:42:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.821+0000 7f7dcd862700 1 Processor -- start 2023-10-09T11:42:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.821+0000 7f7dcd862700 1 -- start start 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8068980 0x7f7dc80c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc80c3020 0x7f7dc814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ca900 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80c52c0 con 0x7f7dc80c3020 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dcd862700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80c46f0 con 0x7f7dc8068980 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38730/0 (socket says 172.21.15.6:38730) 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 -- 172.21.15.6:0/3289375089 learned_addr learned my addr 172.21.15.6:0/3289375089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc67fc700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc80c3020 0x7f7dc814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc6ffd700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8068980 0x7f7dc80c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 -- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8068980 msgr2=0x7f7dc80c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8068980 0x7f7dc80c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 -- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc80c3020 msgr2=0x7f7dc814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc80c3020 0x7f7dc814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.822+0000 7f7dc77fe700 1 -- 172.21.15.6:0/3289375089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0009ae0 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8064700 tx=0x7f7dc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00094e0 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc00032f0 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80cbf30 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc001d630 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.823+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80c4c70 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.824+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80c5450 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.824+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dc001da60 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.825+0000 7f7daeffd700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.825+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7dc0085a90 con 0x7f7dc80c6fc0 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.825+0000 7f7dc6ffd700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.825+0000 7f7dc6ffd700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7db8006fd0 tx=0x7f7db8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:51.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:51.829+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc0053000 con 0x7f7dc80c6fc0 2023-10-09T11:42:52.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.065+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc8068e10 con 0x7f7dc80c6fc0 2023-10-09T11:42:52.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.066+0000 7f7daeffd700 1 -- 172.21.15.6:0/3289375089 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f7dc002ade0 con 0x7f7dc80c6fc0 2023-10-09T11:42:52.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:52.068 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/521904865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":521904865},{"type":"v1","addr":"172.21.15.118:6835","nonce":521904865}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/2384039626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2384039626},{"type":"v1","addr":"172.21.15.6:6836","nonce":2384039626}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2755957678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2755957678},{"type":"v1","addr":"172.21.15.6:6837","nonce":2755957678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/899261274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":899261274},{"type":"v1","addr":"172.21.15.118:6834","nonce":899261274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-10-09T11:42:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 msgr2=0x7f7db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7db8006fd0 tx=0x7f7db8008040 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 msgr2=0x7f7dc80c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8064700 tx=0x7f7dc0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 shutdown_connections 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7db4066f30 0x7f7db40693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc80c6fc0 0x7f7dc80c1f10 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7dc8068980 0x7f7dc80c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 --2- 172.21.15.6:0/3289375089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7dc80c3020 0x7f7dc814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 >> 172.21.15.6:0/3289375089 conn(0x7f7dc806c660 msgr2=0x7f7dc806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 shutdown_connections 2023-10-09T11:42:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.068+0000 7f7dcd862700 1 -- 172.21.15.6:0/3289375089 wait complete. 2023-10-09T11:42:52.071 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-10-09T11:42:52.082 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:42:52.082 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:42:52.082 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:42:52.082 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:52.082 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:42:52.082 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:42:52.083 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:42:52.083 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:52.083 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:42:52.083 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:42:52.083 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:42:52.083 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:52.084 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:42:52.084 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:42:52.084 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:42:52.084 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:42:52.091 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:42:52.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:42:52.092 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:42:52.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:42:52.093 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:42:52.094 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:42:52.094 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:42:52.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:42:52.133 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:42:52.134 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:52.135 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:42:52.135 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:52.136 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:42:52.136 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:52.136 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:42:52.137 DEBUG:teuthology.parallel:result is None 2023-10-09T11:42:52.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:42:52.210 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:42:52.211 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:42:52.217 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:42:52.217 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:42:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.261+0000 7f4839d91700 1 Processor -- start 2023-10-09T11:42:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.261+0000 7f4839d91700 1 -- start start 2023-10-09T11:42:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4839d91700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f483406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4839d91700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f483406e770 0x7f48340cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4839d91700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48340b2290 con 0x7f48341569e0 2023-10-09T11:42:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4839d91700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483406ebf0 con 0x7f483406e770 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4839d91700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4834157c00 con 0x7f4834156db0 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4833fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f483406e770 0x7f48340cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4833fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f483406e770 0x7f48340cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38790/0 (socket says 172.21.15.6:38790) 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f4832ffd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f483406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.262+0000 7f48337fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f48341569e0 0x7f48340b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:42626/0 (socket says 172.21.15.6:42626) 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 -- 172.21.15.6:0/2369277206 learned_addr learned my addr 172.21.15.6:0/2369277206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 -- 172.21.15.6:0/2369277206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 msgr2=0x7f483406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 --2- 172.21.15.6:0/2369277206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f483406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 -- 172.21.15.6:0/2369277206 >> v1:172.21.15.118:6789/0 conn(0x7f48341569e0 legacy=0x7f48340b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 -- 172.21.15.6:0/2369277206 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48341572d0 con 0x7f483406e770 2023-10-09T11:42:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.263+0000 7f4833fff700 1 --2- 172.21.15.6:0/2369277206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48340cd920 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f482c00bfc0 tx=0x7f482c00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45935a8203e9fd8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.265+0000 7f48327fc700 1 -- 172.21.15.6:0/2369277206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00b300 con 0x7f483406e770 2023-10-09T11:42:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.265+0000 7f48327fc700 1 -- 172.21.15.6:0/2369277206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00b460 con 0x7f483406e770 2023-10-09T11:42:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.265+0000 7f48327fc700 1 -- 172.21.15.6:0/2369277206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00ccc0 con 0x7f483406e770 2023-10-09T11:42:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 -- 172.21.15.6:0/2369277206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 msgr2=0x7f48340cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 --2- 172.21.15.6:0/2369277206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48340cd920 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f482c00bfc0 tx=0x7f482c00d040 comp rx=0 tx=0).stop 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 -- 172.21.15.6:0/2369277206 shutdown_connections 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 --2- 172.21.15.6:0/2369277206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48340cd920 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 --2- 172.21.15.6:0/2369277206 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f483406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 -- 172.21.15.6:0/2369277206 >> 172.21.15.6:0/2369277206 conn(0x7f483406cca0 msgr2=0x7f483406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 -- 172.21.15.6:0/2369277206 shutdown_connections 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.266+0000 7f4839d91700 1 -- 172.21.15.6:0/2369277206 wait complete. 2023-10-09T11:42:52.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.267+0000 7f4839d91700 1 Processor -- start 2023-10-09T11:42:52.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.267+0000 7f4839d91700 1 -- start start 2023-10-09T11:42:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48341569e0 0x7f4834155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f4834155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834169470 con 0x7f483406e770 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483416a2d0 con 0x7f48341569e0 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4839d91700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48341696c0 con 0x7f4834156db0 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38794/0 (socket says 172.21.15.6:38794) 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 -- 172.21.15.6:0/2834121917 learned_addr learned my addr 172.21.15.6:0/2834121917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4833fff700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f4834155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f4832ffd700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48341569e0 0x7f4834155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 -- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 msgr2=0x7f4834155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f4834155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 -- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48341569e0 msgr2=0x7f4834155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48341569e0 0x7f4834155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.268+0000 7f48337fe700 1 -- 172.21.15.6:0/2834121917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c00bb00 con 0x7f483406e770 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f48337fe700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f482400c7c0 tx=0x7f4824007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824005a70 con 0x7f483406e770 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824005bd0 con 0x7f483406e770 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48341699a0 con 0x7f483406e770 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240070d0 con 0x7f483406e770 2023-10-09T11:42:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.269+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4834169f60 con 0x7f483406e770 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.270+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483415b2d0 con 0x7f483406e770 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.270+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4824007480 con 0x7f483406e770 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.270+0000 7f481b7fe700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 0x7f48200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.270+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4824083620 con 0x7f483406e770 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.270+0000 7f4832ffd700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 0x7f48200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.271+0000 7f4832ffd700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 0x7f48200693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4834157200 tx=0x7f482800f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.275+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4824050b90 con 0x7f483406e770 2023-10-09T11:42:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:52.483+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f48341575b0 con 0x7f483406e770 2023-10-09T11:42:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.268+0000 7f481b7fe700 1 -- 172.21.15.6:0/2834121917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4824017080 con 0x7f483406e770 2023-10-09T11:42:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 msgr2=0x7f48200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 0x7f48200693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4834157200 tx=0x7f482800f040 comp rx=0 tx=0).stop 2023-10-09T11:42:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 msgr2=0x7f48341454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f482400c7c0 tx=0x7f4824007f70 comp rx=0 tx=0).stop 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 shutdown_connections 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4820066f30 0x7f48200693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4834156db0 0x7f4834155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483406e770 0x7f48341454a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 --2- 172.21.15.6:0/2834121917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48341569e0 0x7f4834155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 >> 172.21.15.6:0/2834121917 conn(0x7f483406cca0 msgr2=0x7f48340cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 shutdown_connections 2023-10-09T11:42:53.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.271+0000 7f4839d91700 1 -- 172.21.15.6:0/2834121917 wait complete. 2023-10-09T11:42:53.275 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:42:53.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:42:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.412+0000 7fc692673700 1 Processor -- start 2023-10-09T11:42:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.412+0000 7fc692673700 1 -- start start 2023-10-09T11:42:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc692673700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 0x7fc68c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc692673700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0d07c0 con 0x7fc68c1578d0 2023-10-09T11:42:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc692673700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0cfbb0 con 0x7fc68c06d120 2023-10-09T11:42:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc692673700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0cfe90 con 0x7fc68c157ca0 2023-10-09T11:42:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc68c1578d0 0x7fc68c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42434/0 (socket says 172.21.15.6:42434) 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68bfff700 1 -- 172.21.15.6:0/926523409 learned_addr learned my addr 172.21.15.6:0/926523409 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/926523409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 0x7fc68c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380260450 0 0) 0x7fc68c0d07c0 con 0x7fc68c1578d0 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc678003570 con 0x7fc68c1578d0 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546315247 0 0) 0x7fc68c0cfbb0 con 0x7fc68c06d120 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c0d07c0 con 0x7fc68c06d120 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68b7fe700 1 -- 172.21.15.6:0/926523409 >> v1:172.21.15.118:6789/0 conn(0x7fc68c06d120 legacy=0x7fc68c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68b7fe700 1 -- 172.21.15.6:0/926523409 >> v1:172.21.15.6:6789/0 conn(0x7fc68c1578d0 legacy=0x7fc68c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.413+0000 7fc68b7fe700 1 -- 172.21.15.6:0/926523409 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0d0170 con 0x7fc68c157ca0 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/926523409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 0x7fc68c0cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc674009910 tx=0x7fc6740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b080671cb9e425f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674011630 con 0x7fc68c157ca0 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc674011790 con 0x7fc68c157ca0 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc68affd700 1 -- 172.21.15.6:0/926523409 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674011b30 con 0x7fc68c157ca0 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 -- 172.21.15.6:0/926523409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 msgr2=0x7fc68c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 --2- 172.21.15.6:0/926523409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 0x7fc68c0cf4f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc674009910 tx=0x7fc6740091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 -- 172.21.15.6:0/926523409 shutdown_connections 2023-10-09T11:42:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 --2- 172.21.15.6:0/926523409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c157ca0 0x7fc68c0cf4f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 -- 172.21.15.6:0/926523409 >> 172.21.15.6:0/926523409 conn(0x7fc68c06bb90 msgr2=0x7fc68c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 -- 172.21.15.6:0/926523409 shutdown_connections 2023-10-09T11:42:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.414+0000 7fc692673700 1 -- 172.21.15.6:0/926523409 wait complete. 2023-10-09T11:42:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.415+0000 7fc692673700 1 Processor -- start 2023-10-09T11:42:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 -- start start 2023-10-09T11:42:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 0x7fc68c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 0x7fc68c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1550c0 con 0x7fc68c06d120 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c8730 con 0x7fc68c157ca0 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc692673700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c8a10 con 0x7fc68c1578d0 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.416+0000 7fc68bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37614/0 (socket says 172.21.15.6:37614) 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 -- 172.21.15.6:0/859446673 learned_addr learned my addr 172.21.15.6:0/859446673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 0x7fc68c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc690c10700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 0x7fc68c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 -- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 msgr2=0x7fc68c0caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 0x7fc68c0caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 -- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 msgr2=0x7fc68c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 0x7fc68c0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 -- 172.21.15.6:0/859446673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009420 con 0x7fc68c06d120 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 0x7fc68c0caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc690c10700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 0x7fc68c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc68bfff700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c7c0 tx=0x7fc67c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c005b30 con 0x7fc68c06d120 2023-10-09T11:42:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c005c90 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0c6490 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c007300 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.417+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c0c6a50 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.418+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c067ac0 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.418+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc67c007670 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.419+0000 7fc683fff700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 0x7fc66c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.419+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc67c083cb0 con 0x7fc68c06d120 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.419+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 0x7fc66c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.419+0000 7fc68b7fe700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 0x7fc66c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc674009860 tx=0x7fc674017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.423+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc67c0512f0 con 0x7fc68c06d120 2023-10-09T11:42:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.695+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc68c0d0450 con 0x7fc68c06d120 2023-10-09T11:42:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.696+0000 7fc683fff700 1 -- 172.21.15.6:0/859446673 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc67c054910 con 0x7fc68c06d120 2023-10-09T11:42:53.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.698 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.699 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.700 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.701 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:42:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.704 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.705 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.706 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.710 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.711 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.712 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.713 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.714 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:42:53.715 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:42:53.716 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 msgr2=0x7fc66c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 0x7fc66c0693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc674009860 tx=0x7fc674017000 comp rx=0 tx=0).stop 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 msgr2=0x7fc68c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c7c0 tx=0x7fc67c007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 shutdown_connections 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc66c066f30 0x7fc66c0693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc68c157ca0 0x7fc68c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc68c06d120 0x7fc68c154b80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 --2- 172.21.15.6:0/859446673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc68c1578d0 0x7fc68c0caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 >> 172.21.15.6:0/859446673 conn(0x7fc68c06bb90 msgr2=0x7fc68c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 shutdown_connections 2023-10-09T11:42:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.698+0000 7fc692673700 1 -- 172.21.15.6:0/859446673 wait complete. 2023-10-09T11:42:53.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.836+0000 7fc87e3e5700 1 Processor -- start 2023-10-09T11:42:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 -- start start 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc878157fe0 0x7fc8780b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 0x7fc8780b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780b2890 con 0x7fc8781583b0 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780b4070 con 0x7fc878157fe0 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.837+0000 7fc87e3e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780b4350 con 0x7fc8780cf240 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc8777fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc8781583b0 0x7fc8780ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42442/0 (socket says 172.21.15.6:42442) 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc8777fe700 1 -- 172.21.15.6:0/4059702078 learned_addr learned my addr 172.21.15.6:0/4059702078 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 --2- 172.21.15.6:0/4059702078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 0x7fc8780b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc877fff700 1 --2- 172.21.15.6:0/4059702078 >> v2:172.21.15.118:3300/0 conn(0x7fc878157fe0 0x7fc8780b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc876ffd700 1 -- 172.21.15.6:0/4059702078 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112895234 0 0) 0x7fc8780b2890 con 0x7fc8781583b0 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc876ffd700 1 -- 172.21.15.6:0/4059702078 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc860003570 con 0x7fc8781583b0 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 -- 172.21.15.6:0/4059702078 >> v2:172.21.15.118:3300/0 conn(0x7fc878157fe0 msgr2=0x7fc8780b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 --2- 172.21.15.6:0/4059702078 >> v2:172.21.15.118:3300/0 conn(0x7fc878157fe0 0x7fc8780b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 -- 172.21.15.6:0/4059702078 >> v1:172.21.15.6:6789/0 conn(0x7fc8781583b0 legacy=0x7fc8780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 -- 172.21.15.6:0/4059702078 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780b4630 con 0x7fc8780cf240 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc87c982700 1 --2- 172.21.15.6:0/4059702078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 0x7fc8780b3a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc870009e60 tx=0x7fc870009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381eb3d1eee52d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc876ffd700 1 -- 172.21.15.6:0/4059702078 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000e070 con 0x7fc8780cf240 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc876ffd700 1 -- 172.21.15.6:0/4059702078 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000bab0 con 0x7fc8780cf240 2023-10-09T11:42:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.838+0000 7fc876ffd700 1 -- 172.21.15.6:0/4059702078 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000be50 con 0x7fc8780cf240 2023-10-09T11:42:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 -- 172.21.15.6:0/4059702078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 msgr2=0x7fc8780b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/4059702078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 0x7fc8780b3a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc870009e60 tx=0x7fc870009780 comp rx=0 tx=0).stop 2023-10-09T11:42:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 -- 172.21.15.6:0/4059702078 shutdown_connections 2023-10-09T11:42:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/4059702078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8780cf240 0x7fc8780b3a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/4059702078 >> v2:172.21.15.118:3300/0 conn(0x7fc878157fe0 0x7fc8780b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 -- 172.21.15.6:0/4059702078 >> 172.21.15.6:0/4059702078 conn(0x7fc878067640 msgr2=0x7fc878067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 -- 172.21.15.6:0/4059702078 shutdown_connections 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.839+0000 7fc87e3e5700 1 -- 172.21.15.6:0/4059702078 wait complete. 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.840+0000 7fc87e3e5700 1 Processor -- start 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.840+0000 7fc87e3e5700 1 -- start start 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc878157fe0 0x7fc87814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 0x7fc87814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878156160 con 0x7fc8780cf240 2023-10-09T11:42:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87814d440 con 0x7fc878157fe0 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87e3e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878155550 con 0x7fc8781583b0 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37630/0 (socket says 172.21.15.6:37630) 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 -- 172.21.15.6:0/1279410731 learned_addr learned my addr 172.21.15.6:0/1279410731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc8777fe700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc878157fe0 0x7fc87814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87c982700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 0x7fc87814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 -- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 msgr2=0x7fc87814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 0x7fc87814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 -- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc878157fe0 msgr2=0x7fc87814d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc878157fe0 0x7fc87814d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc877fff700 1 -- 172.21.15.6:0/1279410731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009a20 con 0x7fc8780cf240 2023-10-09T11:42:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.841+0000 7fc87c982700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 0x7fc87814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc877fff700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc86800ec80 tx=0x7fc8680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800c850 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800c9b0 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc878155830 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800cd50 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.842+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc878155df0 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.843+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878069e40 con 0x7fc8780cf240 2023-10-09T11:42:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.843+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc868013680 con 0x7fc8780cf240 2023-10-09T11:42:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.844+0000 7fc85ffff700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 0x7fc8640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.844+0000 7fc8777fe700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 0x7fc8640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.844+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc868084480 con 0x7fc8780cf240 2023-10-09T11:42:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.844+0000 7fc8777fe700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 0x7fc8640693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007fd0 tx=0x7fc86c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:53.848+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc868051a40 con 0x7fc8780cf240 2023-10-09T11:42:54.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.040+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8780cc6b0 con 0x7fc8780cf240 2023-10-09T11:42:54.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.040+0000 7fc85ffff700 1 -- 172.21.15.6:0/1279410731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+12097 (secure 0 0 0) 0x7fc868055060 con 0x7fc8780cf240 2023-10-09T11:42:54.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:54.042 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":142,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:53.267067+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.042+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 msgr2=0x7fc8640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.042+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 0x7fc8640693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007fd0 tx=0x7fc86c009040 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.042+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 msgr2=0x7fc87814cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.042+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc86800ec80 tx=0x7fc8680091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 shutdown_connections 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc864066f30 0x7fc8640693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8781583b0 0x7fc87814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8780cf240 0x7fc87814cf00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 --2- 172.21.15.6:0/1279410731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc878157fe0 0x7fc87814d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 >> 172.21.15.6:0/1279410731 conn(0x7fc878067640 msgr2=0x7fc8780b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 shutdown_connections 2023-10-09T11:42:54.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.043+0000 7fc87e3e5700 1 -- 172.21.15.6:0/1279410731 wait complete. 2023-10-09T11:42:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:42:54.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:42:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.177+0000 7f57d604b700 1 Processor -- start 2023-10-09T11:42:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.177+0000 7f57d604b700 1 -- start start 2023-10-09T11:42:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57d604b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f57d01578d0 0x7f57d00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57d604b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 0x7f57d015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57d604b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d00d07c0 con 0x7f57d006d120 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57d604b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00cfbb0 con 0x7f57d01578d0 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57d604b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00cfe90 con 0x7f57d0157ca0 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57cf7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f57d01578d0 0x7f57d00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57cf7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f57d01578d0 0x7f57d00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:59130/0 (socket says 172.21.15.6:59130) 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.178+0000 7f57cf7fe700 1 -- 172.21.15.6:0/334767288 learned_addr learned my addr 172.21.15.6:0/334767288 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57ceffd700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 0x7f57d015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57cf7fe700 1 -- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 msgr2=0x7f57d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57cf7fe700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 0x7f57d015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57cf7fe700 1 -- 172.21.15.6:0/334767288 >> v1:172.21.15.118:6789/0 conn(0x7f57d006d120 legacy=0x7f57d015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57cf7fe700 1 -- 172.21.15.6:0/334767288 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00d0170 con 0x7f57d01578d0 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57ceffd700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 0x7f57d015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57cf7fe700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00cf4f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f57c00099b0 tx=0x7f57c0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbaf7ae54ca068ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57ce7fc700 1 -- 172.21.15.6:0/334767288 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000b860 con 0x7f57d01578d0 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57ce7fc700 1 -- 172.21.15.6:0/334767288 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c000b9c0 con 0x7f57d01578d0 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.179+0000 7f57ce7fc700 1 -- 172.21.15.6:0/334767288 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000bd60 con 0x7f57d01578d0 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 -- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 msgr2=0x7f57d00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00cf4f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f57c00099b0 tx=0x7f57c0009250 comp rx=0 tx=0).stop 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 -- 172.21.15.6:0/334767288 shutdown_connections 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00cf4f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 --2- 172.21.15.6:0/334767288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d0157ca0 0x7f57d015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 -- 172.21.15.6:0/334767288 >> 172.21.15.6:0/334767288 conn(0x7f57d006bb90 msgr2=0x7f57d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 -- 172.21.15.6:0/334767288 shutdown_connections 2023-10-09T11:42:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.180+0000 7f57d604b700 1 -- 172.21.15.6:0/334767288 wait complete. 2023-10-09T11:42:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.181+0000 7f57d604b700 1 Processor -- start 2023-10-09T11:42:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.181+0000 7f57d604b700 1 -- start start 2023-10-09T11:42:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d006d120 0x7f57d016d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00b5b20 con 0x7f57d0157ca0 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00ab5e0 con 0x7f57d01578d0 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57d604b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00b6910 con 0x7f57d006d120 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37644/0 (socket says 172.21.15.6:37644) 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 -- 172.21.15.6:0/4147055002 learned_addr learned my addr 172.21.15.6:0/4147055002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cf7fe700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d006d120 0x7f57d016d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57ceffd700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 -- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d006d120 msgr2=0x7f57d016d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d006d120 0x7f57d016d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 -- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 msgr2=0x7f57d00b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 -- 172.21.15.6:0/4147055002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00094f0 con 0x7f57d0157ca0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57cffff700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c8e0 tx=0x7f57c8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.182+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8012630 con 0x7f57d0157ca0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.183+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d00b5d00 con 0x7f57d0157ca0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.183+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8012790 con 0x7f57d0157ca0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.183+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8012b50 con 0x7f57d0157ca0 2023-10-09T11:42:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.183+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d00b62c0 con 0x7f57d0157ca0 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.184+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d0067ac0 con 0x7f57d0157ca0 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.184+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57c801a3a0 con 0x7f57d0157ca0 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.184+0000 7f57b77fe700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 0x7f57bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.184+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f57c80844c0 con 0x7f57d0157ca0 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.184+0000 7f57cf7fe700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 0x7f57bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.185+0000 7f57cf7fe700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 0x7f57bc0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57c00099b0 tx=0x7f57c0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.189+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57c80519e0 con 0x7f57d0157ca0 2023-10-09T11:42:54.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.383+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57d00b6a80 con 0x7f57d0157ca0 2023-10-09T11:42:54.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.383+0000 7f57b77fe700 1 -- 172.21.15.6:0/4147055002 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57c8055000 con 0x7f57d0157ca0 2023-10-09T11:42:54.385 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:42:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 msgr2=0x7f57bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 0x7f57bc0693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f57c00099b0 tx=0x7f57c0017000 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 msgr2=0x7f57d00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c8e0 tx=0x7f57c8001710 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 shutdown_connections 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f57bc066f30 0x7f57bc0693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d0157ca0 0x7f57d00b55e0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57d006d120 0x7f57d016d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 --2- 172.21.15.6:0/4147055002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d01578d0 0x7f57d00b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.385+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 >> 172.21.15.6:0/4147055002 conn(0x7f57d006bb90 msgr2=0x7f57d01558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.386+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 shutdown_connections 2023-10-09T11:42:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.386+0000 7f57d604b700 1 -- 172.21.15.6:0/4147055002 wait complete. 2023-10-09T11:42:54.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:42:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.516+0000 7f27bde56700 1 Processor -- start 2023-10-09T11:42:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.516+0000 7f27bde56700 1 -- start start 2023-10-09T11:42:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f27b81578d0 0x7f27b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 0x7f27b815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27b806d120 0x7f27b806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b806dac0 con 0x7f27b81578d0 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b80d07c0 con 0x7f27b806d120 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27bde56700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b80cfbb0 con 0x7f27b8157ca0 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f27b81578d0 0x7f27b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f27b81578d0 0x7f27b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37650/0 (socket says 172.21.15.6:37650) 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 -- 172.21.15.6:0/2047121594 learned_addr learned my addr 172.21.15.6:0/2047121594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b7fff700 1 --2- 172.21.15.6:0/2047121594 >> v2:172.21.15.118:3300/0 conn(0x7f27b806d120 0x7f27b806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b6ffd700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 0x7f27b815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 -- 172.21.15.6:0/2047121594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 msgr2=0x7f27b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 0x7f27b815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 -- 172.21.15.6:0/2047121594 >> v2:172.21.15.118:3300/0 conn(0x7f27b806d120 msgr2=0x7f27b806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2047121594 >> v2:172.21.15.118:3300/0 conn(0x7f27b806d120 0x7f27b806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 -- 172.21.15.6:0/2047121594 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b80cfe90 con 0x7f27b81578d0 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b6ffd700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 0x7f27b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.517+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b81578d0 0x7f27b80cf4f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f27b80b3940 tx=0x7f27a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dd6381a5ec0bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27b67fc700 1 -- 172.21.15.6:0/2047121594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800b860 con 0x7f27b81578d0 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27b67fc700 1 -- 172.21.15.6:0/2047121594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800b9c0 con 0x7f27b81578d0 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27b67fc700 1 -- 172.21.15.6:0/2047121594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800bd60 con 0x7f27b81578d0 2023-10-09T11:42:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 -- 172.21.15.6:0/2047121594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b81578d0 msgr2=0x7f27b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b81578d0 0x7f27b80cf4f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f27b80b3940 tx=0x7f27a8009250 comp rx=0 tx=0).stop 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 -- 172.21.15.6:0/2047121594 shutdown_connections 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 --2- 172.21.15.6:0/2047121594 >> v2:172.21.15.118:3300/0 conn(0x7f27b806d120 0x7f27b806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b81578d0 0x7f27b80cf4f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 --2- 172.21.15.6:0/2047121594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b8157ca0 0x7f27b815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 -- 172.21.15.6:0/2047121594 >> 172.21.15.6:0/2047121594 conn(0x7f27b806bb90 msgr2=0x7f27b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 -- 172.21.15.6:0/2047121594 shutdown_connections 2023-10-09T11:42:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.518+0000 7f27bde56700 1 -- 172.21.15.6:0/2047121594 wait complete. 2023-10-09T11:42:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 Processor -- start 2023-10-09T11:42:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 -- start start 2023-10-09T11:42:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b806d120 0x7f27b80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 0x7f27b816a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b816b2e0 con 0x7f27b8157ca0 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b816b8f0 con 0x7f27b81578d0 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27bde56700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b816c470 con 0x7f27b806d120 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.520+0000 7f27b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37662/0 (socket says 172.21.15.6:37662) 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 -- 172.21.15.6:0/2352717288 learned_addr learned my addr 172.21.15.6:0/2352717288 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b6ffd700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 0x7f27b816a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b806d120 0x7f27b80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 -- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b806d120 msgr2=0x7f27b80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b806d120 0x7f27b80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 -- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 msgr2=0x7f27b816a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 0x7f27b816a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 -- 172.21.15.6:0/2352717288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a80094f0 con 0x7f27b8157ca0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b6ffd700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 0x7f27b816a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27b7fff700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009fa0 tx=0x7f27b0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000ed20 con 0x7f27b8157ca0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b000ee80 con 0x7f27b8157ca0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b816bb40 con 0x7f27b8157ca0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0014670 con 0x7f27b8157ca0 2023-10-09T11:42:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.521+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b816c100 con 0x7f27b8157ca0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.522+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b8067ac0 con 0x7f27b8157ca0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.523+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27b00149e0 con 0x7f27b8157ca0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.523+0000 7f279f7fe700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 0x7f27a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.523+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f27b0084960 con 0x7f27b8157ca0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.523+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 0x7f27a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.523+0000 7f27b77fe700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 0x7f27a40693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f27b80b3940 tx=0x7f27a8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.527+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27b0051f20 con 0x7f27b8157ca0 2023-10-09T11:42:54.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.723+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f27b80d0170 con 0x7f27b8157ca0 2023-10-09T11:42:54.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.723+0000 7f279f7fe700 1 -- 172.21.15.6:0/2352717288 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v142) v1 ==== 84+0+65 (secure 0 0 0) 0x7f27b0055540 con 0x7f27b8157ca0 2023-10-09T11:42:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:54.725 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:42:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:42:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:42:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:42:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:42:54.726 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:42:54.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 msgr2=0x7f27a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 0x7f27a40693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f27b80b3940 tx=0x7f27a8017000 comp rx=0 tx=0).stop 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 msgr2=0x7f27b816ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009fa0 tx=0x7f27b0009900 comp rx=0 tx=0).stop 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 shutdown_connections 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f27a4066f30 0x7f27a40693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27b8157ca0 0x7f27b816ada0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27b806d120 0x7f27b80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 --2- 172.21.15.6:0/2352717288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27b81578d0 0x7f27b816a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 >> 172.21.15.6:0/2352717288 conn(0x7f27b806bb90 msgr2=0x7f27b8155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 shutdown_connections 2023-10-09T11:42:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.726+0000 7f27bde56700 1 -- 172.21.15.6:0/2352717288 wait complete. 2023-10-09T11:42:54.739 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:42:54.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:42:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.861+0000 7ff809570700 1 Processor -- start 2023-10-09T11:42:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 -- start start 2023-10-09T11:42:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff804157860 0x7ff80406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff80406a020 0x7ff80415a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8040cbec0 con 0x7ff8040cdb60 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8040cb9d0 con 0x7ff80406a020 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff809570700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80415b2d0 con 0x7ff804157860 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.862+0000 7ff8027fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff80406a020 0x7ff80415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff80406a020 0x7ff80415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37670/0 (socket says 172.21.15.6:37670) 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 -- 172.21.15.6:0/1455509564 learned_addr learned my addr 172.21.15.6:0/1455509564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff802ffd700 1 --2- 172.21.15.6:0/1455509564 >> v2:172.21.15.118:3300/0 conn(0x7ff804157860 0x7ff80406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 -- 172.21.15.6:0/1455509564 >> v2:172.21.15.118:3300/0 conn(0x7ff804157860 msgr2=0x7ff80406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 --2- 172.21.15.6:0/1455509564 >> v2:172.21.15.118:3300/0 conn(0x7ff804157860 0x7ff80406dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 -- 172.21.15.6:0/1455509564 >> v1:172.21.15.118:6789/0 conn(0x7ff8040cdb60 legacy=0x7ff8040cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 -- 172.21.15.6:0/1455509564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8040cc180 con 0x7ff80406a020 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff8027fc700 1 --2- 172.21.15.6:0/1455509564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80406a020 0x7ff80415a300 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff804068620 tx=0x7ff7ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22e4a1d91513893 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff801ffb700 1 -- 172.21.15.6:0/1455509564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00b7e0 con 0x7ff80406a020 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff801ffb700 1 -- 172.21.15.6:0/1455509564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec00b940 con 0x7ff80406a020 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.863+0000 7ff801ffb700 1 -- 172.21.15.6:0/1455509564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00bce0 con 0x7ff80406a020 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 -- 172.21.15.6:0/1455509564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80406a020 msgr2=0x7ff80415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 --2- 172.21.15.6:0/1455509564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80406a020 0x7ff80415a300 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff804068620 tx=0x7ff7ec009250 comp rx=0 tx=0).stop 2023-10-09T11:42:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 -- 172.21.15.6:0/1455509564 shutdown_connections 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 --2- 172.21.15.6:0/1455509564 >> v2:172.21.15.118:3300/0 conn(0x7ff804157860 0x7ff80406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 --2- 172.21.15.6:0/1455509564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff80406a020 0x7ff80415a300 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 -- 172.21.15.6:0/1455509564 >> 172.21.15.6:0/1455509564 conn(0x7ff804063230 msgr2=0x7ff804063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 -- 172.21.15.6:0/1455509564 shutdown_connections 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.864+0000 7ff809570700 1 -- 172.21.15.6:0/1455509564 wait complete. 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.865+0000 7ff809570700 1 Processor -- start 2023-10-09T11:42:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.865+0000 7ff809570700 1 -- start start 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff80406a020 0x7ff804153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 0x7ff8040c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff804156b90 con 0x7ff804157860 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040c8320 con 0x7ff8040cdb60 2023-10-09T11:42:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff809570700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040c7710 con 0x7ff80406a020 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37680/0 (socket says 172.21.15.6:37680) 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 -- 172.21.15.6:0/3334959847 learned_addr learned my addr 172.21.15.6:0/3334959847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff802ffd700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff80406a020 0x7ff804153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8027fc700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 0x7ff8040c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 -- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff80406a020 msgr2=0x7ff804153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff80406a020 0x7ff804153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 -- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 msgr2=0x7ff8040c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 0x7ff8040c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 -- 172.21.15.6:0/3334959847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec0094f0 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8027fc700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 0x7ff8040c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.866+0000 7ff8037fe700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c5b0 tx=0x7ff7f4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.867+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4011590 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.867+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4011710 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.867+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8040c79f0 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.867+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4011ad0 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.867+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8040c7fb0 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.868+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8040690d0 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.868+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7f401c460 con 0x7ff804157860 2023-10-09T11:42:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.868+0000 7ff7faffd700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:54.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.869+0000 7ff802ffd700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:54.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.869+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff7f4083e50 con 0x7ff804157860 2023-10-09T11:42:54.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.869+0000 7ff802ffd700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 0x7ff7e40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0074f0 tx=0x7ff7fc009700 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:54.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:54.873+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7f4051410 con 0x7ff804157860 2023-10-09T11:42:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.065+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff80406d8c0 con 0x7ff804157860 2023-10-09T11:42:55.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.278+0000 7ff7faffd700 1 -- 172.21.15.6:0/3334959847 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v143) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff7f4054a30 con 0x7ff804157860 2023-10-09T11:42:55.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 msgr2=0x7ff7e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 0x7ff7e40693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0074f0 tx=0x7ff7fc009700 comp rx=0 tx=0).stop 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 msgr2=0x7ff8040c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c5b0 tx=0x7ff7f4007f60 comp rx=0 tx=0).stop 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 shutdown_connections 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804157860 0x7ff8040c6b30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.281+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff80406a020 0x7ff804153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.282+0000 7ff809570700 1 --2- 172.21.15.6:0/3334959847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8040cdb60 0x7ff8040c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.282+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 >> 172.21.15.6:0/3334959847 conn(0x7ff804063230 msgr2=0x7ff80406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.282+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 shutdown_connections 2023-10-09T11:42:55.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.282+0000 7ff809570700 1 -- 172.21.15.6:0/3334959847 wait complete. 2023-10-09T11:42:55.286 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:42:55.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:42:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.420+0000 7ffa97333700 1 Processor -- start 2023-10-09T11:42:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.420+0000 7ffa97333700 1 -- start start 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa97333700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa900cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa97333700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900cca80 con 0x7ffa901577c0 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa97333700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900cedd0 con 0x7ffa90068f20 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa97333700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900cc4c0 con 0x7ffa90157b90 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa950cf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffa901577c0 0x7ffa90068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42458/0 (socket says 172.21.15.6:42458) 2023-10-09T11:42:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.421+0000 7ffa950cf700 1 -- 172.21.15.6:0/3706115066 learned_addr learned my addr 172.21.15.6:0/3706115066 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512671138 0 0) 0x7ffa900cca80 con 0x7ffa901577c0 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa78003570 con 0x7ffa901577c0 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa958d0700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa900cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244739062 0 0) 0x7ffa78003570 con 0x7ffa901577c0 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 msgr2=0x7ffa900cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa900cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 >> v1:172.21.15.118:6789/0 conn(0x7ffa90068f20 legacy=0x7ffa900cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900cc7a0 con 0x7ffa901577c0 2023-10-09T11:42:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7ffa800017f0 con 0x7ffa901577c0 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 >> v1:172.21.15.6:6789/0 conn(0x7ffa901577c0 legacy=0x7ffa90068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa78003a90 0x7ffa78003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78004810 0x7ffa78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa780051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900cc4c0 con 0x7ffa78003a90 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7800bb60 con 0x7ffa78004810 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7800bd20 con 0x7ffa90157b90 2023-10-09T11:42:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa78003a90 0x7ffa78003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa948ce700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78004810 0x7ffa78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa958d0700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa780051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 -- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 msgr2=0x7ffa780051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa90157b90 0x7ffa780051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 -- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78004810 msgr2=0x7ffa78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78004810 0x7ffa78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.422+0000 7ffa950cf700 1 -- 172.21.15.6:0/3706115066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78003570 con 0x7ffa78003a90 2023-10-09T11:42:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa950cf700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa78003a90 0x7ffa78003ea0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000a950 tx=0x7ffa800021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84ea03b62bc00e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800070d0 con 0x7ffa78003a90 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80007230 con 0x7ffa78003a90 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa8ffff700 1 -- 172.21.15.6:0/3706115066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800075f0 con 0x7ffa78003a90 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 -- 172.21.15.6:0/3706115066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa78003a90 msgr2=0x7ffa78003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 --2- 172.21.15.6:0/3706115066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa78003a90 0x7ffa78003ea0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000a950 tx=0x7ffa800021f0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa958d0700 1 -- 172.21.15.6:0/3706115066 reap_dead start 2023-10-09T11:42:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 -- 172.21.15.6:0/3706115066 shutdown_connections 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 -- 172.21.15.6:0/3706115066 >> 172.21.15.6:0/3706115066 conn(0x7ffa900d0df0 msgr2=0x7ffa900d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 -- 172.21.15.6:0/3706115066 shutdown_connections 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.423+0000 7ffa97333700 1 -- 172.21.15.6:0/3706115066 wait complete. 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.424+0000 7ffa97333700 1 Processor -- start 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.424+0000 7ffa97333700 1 -- start start 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78003a90 0x7ffa9016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa900cbd00 0x7ffa90150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c9970 con 0x7ffa900cb890 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c8d60 con 0x7ffa78003a90 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa97333700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c9040 con 0x7ffa900cbd00 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa948ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa948ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37698/0 (socket says 172.21.15.6:37698) 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa948ce700 1 -- 172.21.15.6:0/2154280225 learned_addr learned my addr 172.21.15.6:0/2154280225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa950cf700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78003a90 0x7ffa9016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.425+0000 7ffa958d0700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa900cbd00 0x7ffa90150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 -- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa900cbd00 msgr2=0x7ffa90150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa900cbd00 0x7ffa90150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 -- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78003a90 msgr2=0x7ffa9016a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78003a90 0x7ffa9016a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 -- 172.21.15.6:0/2154280225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900c9320 con 0x7ffa900cb890 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa948ce700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ffa840029d0 tx=0x7ffa84007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84006820 con 0x7ffa900cb890 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa84006980 con 0x7ffa900cb890 2023-10-09T11:42:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa900c9600 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84006d20 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.426+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900c8230 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.427+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900c9ae0 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.428+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa84007240 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.428+0000 7ffa8d7fa700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.428+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ffa840843d0 con 0x7ffa900cb890 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.428+0000 7ffa950cf700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.428+0000 7ffa950cf700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 0x7ffa7c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa80002230 tx=0x7ffa80016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.433+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa84051820 con 0x7ffa900cb890 2023-10-09T11:42:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:55.627+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffa900cea60 con 0x7ffa900cb890 2023-10-09T11:42:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.282+0000 7ffa8d7fa700 1 -- 172.21.15.6:0/2154280225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v144) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffa84054e40 con 0x7ffa900cb890 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 msgr2=0x7ffa7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 0x7ffa7c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa80002230 tx=0x7ffa80016000 comp rx=0 tx=0).stop 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 msgr2=0x7ffa90150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ffa840029d0 tx=0x7ffa84007d30 comp rx=0 tx=0).stop 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 shutdown_connections 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffa7c066f30 0x7ffa7c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa900cbd00 0x7ffa90150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa78003a90 0x7ffa9016a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 --2- 172.21.15.6:0/2154280225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa900cb890 0x7ffa90150340 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 >> 172.21.15.6:0/2154280225 conn(0x7ffa900d0df0 msgr2=0x7ffa900c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 shutdown_connections 2023-10-09T11:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.295+0000 7ffa97333700 1 -- 172.21.15.6:0/2154280225 wait complete. 2023-10-09T11:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:42:56.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:42:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.434+0000 7ffb1a874700 1 Processor -- start 2023-10-09T11:42:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.434+0000 7ffb1a874700 1 -- start start 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb1a874700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb141578d0 0x7ffb140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb1a874700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb14157ca0 0x7ffb1415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb1a874700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140d07c0 con 0x7ffb1406d120 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb1a874700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140cfbb0 con 0x7ffb14157ca0 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb1a874700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140cfe90 con 0x7ffb141578d0 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb14157ca0 0x7ffb1415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb14157ca0 0x7ffb1415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37714/0 (socket says 172.21.15.6:37714) 2023-10-09T11:42:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 -- 172.21.15.6:0/1094274901 learned_addr learned my addr 172.21.15.6:0/1094274901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb13fff700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb141578d0 0x7ffb140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 -- 172.21.15.6:0/1094274901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb141578d0 msgr2=0x7ffb140cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb141578d0 0x7ffb140cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 -- 172.21.15.6:0/1094274901 >> v1:172.21.15.118:6789/0 conn(0x7ffb1406d120 legacy=0x7ffb1415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 -- 172.21.15.6:0/1094274901 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140d0170 con 0x7ffb14157ca0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb137fe700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14157ca0 0x7ffb1415af00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ffb040099b0 tx=0x7ffb04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4926573143b498cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.435+0000 7ffb12ffd700 1 -- 172.21.15.6:0/1094274901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400b860 con 0x7ffb14157ca0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb12ffd700 1 -- 172.21.15.6:0/1094274901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400b9c0 con 0x7ffb14157ca0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb12ffd700 1 -- 172.21.15.6:0/1094274901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400bd60 con 0x7ffb14157ca0 2023-10-09T11:42:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 -- 172.21.15.6:0/1094274901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14157ca0 msgr2=0x7ffb1415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14157ca0 0x7ffb1415af00 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ffb040099b0 tx=0x7ffb04009250 comp rx=0 tx=0).stop 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 -- 172.21.15.6:0/1094274901 shutdown_connections 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb141578d0 0x7ffb140cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 --2- 172.21.15.6:0/1094274901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb14157ca0 0x7ffb1415af00 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 -- 172.21.15.6:0/1094274901 >> 172.21.15.6:0/1094274901 conn(0x7ffb1406bb90 msgr2=0x7ffb1406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 -- 172.21.15.6:0/1094274901 shutdown_connections 2023-10-09T11:42:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.436+0000 7ffb1a874700 1 -- 172.21.15.6:0/1094274901 wait complete. 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.437+0000 7ffb1a874700 1 Processor -- start 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.437+0000 7ffb1a874700 1 -- start start 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb1406d120 0x7ffb14154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb14157ca0 0x7ffb140aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140ad8f0 con 0x7ffb141578d0 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140af330 con 0x7ffb14157ca0 2023-10-09T11:42:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb1a874700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1416b100 con 0x7ffb1406d120 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37716/0 (socket says 172.21.15.6:37716) 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb137fe700 1 -- 172.21.15.6:0/3538135217 learned_addr learned my addr 172.21.15.6:0/3538135217 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb137fe700 1 -- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb1406d120 msgr2=0x7ffb14154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb13fff700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb1406d120 0x7ffb14154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb18e11700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb14157ca0 0x7ffb140aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.438+0000 7ffb137fe700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb1406d120 0x7ffb14154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb137fe700 1 -- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb14157ca0 msgr2=0x7ffb140aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb137fe700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb14157ca0 0x7ffb140aca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:56.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb137fe700 1 -- 172.21.15.6:0/3538135217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040094f0 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb137fe700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406fe20 tx=0x7ffb04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04024440 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb040245c0 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb140ae720 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04024980 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.439+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb140aece0 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.440+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb140af4a0 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.440+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb0401a420 con 0x7ffb141578d0 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.441+0000 7ffb0bfff700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.441+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ffb04086220 con 0x7ffb141578d0 2023-10-09T11:42:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.441+0000 7ffb13fff700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.441+0000 7ffb13fff700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006fd0 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:56.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.445+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb040534f0 con 0x7ffb141578d0 2023-10-09T11:42:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:56.682+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb140d0450 con 0x7ffb141578d0 2023-10-09T11:42:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.293+0000 7ffb0bfff700 1 -- 172.21.15.6:0/3538135217 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7ffb04056b10 con 0x7ffb141578d0 2023-10-09T11:42:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.297+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 msgr2=0x7ffaf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.297+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 0x7ffaf40693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffafc006fd0 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2023-10-09T11:42:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.297+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 msgr2=0x7ffb1416abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.297+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406fe20 tx=0x7ffb04017000 comp rx=0 tx=0).stop 2023-10-09T11:42:57.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 shutdown_connections 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffaf4066f30 0x7ffaf40693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb14157ca0 0x7ffb140aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffb1406d120 0x7ffb14154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 --2- 172.21.15.6:0/3538135217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb141578d0 0x7ffb1416abc0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 >> 172.21.15.6:0/3538135217 conn(0x7ffb1406bb90 msgr2=0x7ffb14068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 shutdown_connections 2023-10-09T11:42:57.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.299+0000 7ffb1a874700 1 -- 172.21.15.6:0/3538135217 wait complete. 2023-10-09T11:42:57.302 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T11:42:57.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 Processor -- start 2023-10-09T11:42:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 -- start start 2023-10-09T11:42:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22ac1578d0 0x7f22ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0d07c0 con 0x7f22ac157ca0 2023-10-09T11:42:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0cfbb0 con 0x7f22ac06d120 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.435+0000 7f22b2920700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0cfe90 con 0x7f22ac1578d0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22ac1578d0 0x7f22ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22ab7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22ac157ca0 0x7f22ac15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42472/0 (socket says 172.21.15.6:42472) 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22ab7fe700 1 -- 172.21.15.6:0/787705740 learned_addr learned my addr 172.21.15.6:0/787705740 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22abfff700 1 -- 172.21.15.6:0/787705740 >> v1:172.21.15.118:6789/0 conn(0x7f22ac06d120 legacy=0x7f22ac06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22abfff700 1 -- 172.21.15.6:0/787705740 >> v1:172.21.15.6:6789/0 conn(0x7f22ac157ca0 legacy=0x7f22ac15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22abfff700 1 -- 172.21.15.6:0/787705740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0d0170 con 0x7f22ac1578d0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22aaffd700 1 -- 172.21.15.6:0/787705740 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195773303 0 0) 0x7f22ac0d07c0 con 0x7f22ac157ca0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22abfff700 1 --2- 172.21.15.6:0/787705740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0cf4f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098e0 tx=0x7f229c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ade875f23995d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22aaffd700 1 -- 172.21.15.6:0/787705740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c009e80 con 0x7f22ac1578d0 2023-10-09T11:42:57.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22aaffd700 1 -- 172.21.15.6:0/787705740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c00b820 con 0x7f22ac1578d0 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.436+0000 7f22aaffd700 1 -- 172.21.15.6:0/787705740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00bba0 con 0x7f22ac1578d0 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 -- 172.21.15.6:0/787705740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 msgr2=0x7f22ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 --2- 172.21.15.6:0/787705740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0cf4f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098e0 tx=0x7f229c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 -- 172.21.15.6:0/787705740 shutdown_connections 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 --2- 172.21.15.6:0/787705740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0cf4f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 -- 172.21.15.6:0/787705740 >> 172.21.15.6:0/787705740 conn(0x7f22ac06bb90 msgr2=0x7f22ac06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 -- 172.21.15.6:0/787705740 shutdown_connections 2023-10-09T11:42:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.437+0000 7f22b2920700 1 -- 172.21.15.6:0/787705740 wait complete. 2023-10-09T11:42:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.438+0000 7f22b2920700 1 Processor -- start 2023-10-09T11:42:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.438+0000 7f22b2920700 1 -- start start 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 0x7f22ac151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22ac157ca0 0x7f22ac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b4c40 con 0x7f22ac1578d0 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b4030 con 0x7f22ac06d120 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b2920700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b4310 con 0x7f22ac157ca0 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37732/0 (socket says 172.21.15.6:37732) 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 -- 172.21.15.6:0/3676431350 learned_addr learned my addr 172.21.15.6:0/3676431350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22abfff700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 0x7f22ac151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22b0ebd700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22ac157ca0 0x7f22ac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 -- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22ac157ca0 msgr2=0x7f22ac068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22ac157ca0 0x7f22ac068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 -- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 msgr2=0x7f22ac151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 0x7f22ac151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22ab7fe700 1 -- 172.21.15.6:0/3676431350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009420 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.439+0000 7f22abfff700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 0x7f22ac151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f22ab7fe700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c5e0 tx=0x7f22a0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0005b30 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0005c90 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0b45f0 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0007300 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.440+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac151d80 con 0x7f22ac1578d0 2023-10-09T11:42:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.441+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac067ac0 con 0x7f22ac1578d0 2023-10-09T11:42:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.441+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22a00076b0 con 0x7f22ac1578d0 2023-10-09T11:42:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.442+0000 7f2293fff700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.442+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22a0083b90 con 0x7f22ac1578d0 2023-10-09T11:42:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.442+0000 7f22abfff700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.442+0000 7f22abfff700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 0x7f22980693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f229c0030c0 tx=0x7f229c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.446+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a0050d60 con 0x7f22ac1578d0 2023-10-09T11:42:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.640+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ac0d0450 con 0x7f22ac1578d0 2023-10-09T11:42:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.641+0000 7f2293fff700 1 -- 172.21.15.6:0/3676431350 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f22a0017090 con 0x7f22ac1578d0 2023-10-09T11:42:57.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:57.643 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":145,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:56.684730+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 msgr2=0x7f22980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 0x7f22980693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f229c0030c0 tx=0x7f229c016000 comp rx=0 tx=0).stop 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 msgr2=0x7f22ac0b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c5e0 tx=0x7f22a0000fe0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 shutdown_connections 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22ac157ca0 0x7f22ac068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22ac06d120 0x7f22ac151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 --2- 172.21.15.6:0/3676431350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22ac1578d0 0x7f22ac0b64f0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 >> 172.21.15.6:0/3676431350 conn(0x7f22ac06bb90 msgr2=0x7f22ac15d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 shutdown_connections 2023-10-09T11:42:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.643+0000 7f22b2920700 1 -- 172.21.15.6:0/3676431350 wait complete. 2023-10-09T11:42:57.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:42:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.775+0000 7efcf96e2700 1 Processor -- start 2023-10-09T11:42:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.775+0000 7efcf96e2700 1 -- start start 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf96e2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efcf406d830 0x7efcf40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf96e2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40d07c0 con 0x7efcf4157ca0 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf96e2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40cfbb0 con 0x7efcf41578d0 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf96e2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40cfe90 con 0x7efcf406d830 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf27fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efcf4157ca0 0x7efcf406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42480/0 (socket says 172.21.15.6:42480) 2023-10-09T11:42:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf27fc700 1 -- 172.21.15.6:0/3617367381 learned_addr learned my addr 172.21.15.6:0/3617367381 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf37fe700 1 --2- 172.21.15.6:0/3617367381 >> v2:172.21.15.118:3300/0 conn(0x7efcf406d830 0x7efcf40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf1ffb700 1 -- 172.21.15.6:0/3617367381 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519805308 0 0) 0x7efcf40d07c0 con 0x7efcf4157ca0 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf1ffb700 1 -- 172.21.15.6:0/3617367381 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc003570 con 0x7efcf4157ca0 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf37fe700 1 -- 172.21.15.6:0/3617367381 >> v1:172.21.15.118:6789/0 conn(0x7efcf41578d0 legacy=0x7efcf415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf37fe700 1 -- 172.21.15.6:0/3617367381 >> v1:172.21.15.6:6789/0 conn(0x7efcf4157ca0 legacy=0x7efcf406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf37fe700 1 -- 172.21.15.6:0/3617367381 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40d0170 con 0x7efcf406d830 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.776+0000 7efcf37fe700 1 --2- 172.21.15.6:0/3617367381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf406d830 0x7efcf40cf4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e60 tx=0x7efcec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1993634050650e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf1ffb700 1 -- 172.21.15.6:0/3617367381 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00e070 con 0x7efcf406d830 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf1ffb700 1 -- 172.21.15.6:0/3617367381 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00bb60 con 0x7efcf406d830 2023-10-09T11:42:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf1ffb700 1 -- 172.21.15.6:0/3617367381 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec012430 con 0x7efcf406d830 2023-10-09T11:42:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 -- 172.21.15.6:0/3617367381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf406d830 msgr2=0x7efcf40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 --2- 172.21.15.6:0/3617367381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf406d830 0x7efcf40cf4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcec009e60 tx=0x7efcec009780 comp rx=0 tx=0).stop 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 -- 172.21.15.6:0/3617367381 shutdown_connections 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 --2- 172.21.15.6:0/3617367381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf406d830 0x7efcf40cf4f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 -- 172.21.15.6:0/3617367381 >> 172.21.15.6:0/3617367381 conn(0x7efcf406bb90 msgr2=0x7efcf406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 -- 172.21.15.6:0/3617367381 shutdown_connections 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.777+0000 7efcf96e2700 1 -- 172.21.15.6:0/3617367381 wait complete. 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.778+0000 7efcf96e2700 1 Processor -- start 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 -- start start 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 0x7efcf40aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 0x7efcf416a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40b5c60 con 0x7efcf406d830 2023-10-09T11:42:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415e860 con 0x7efcf4157ca0 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf96e2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4146d60 con 0x7efcf41578d0 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37736/0 (socket says 172.21.15.6:37736) 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.779+0000 7efcf2ffd700 1 -- 172.21.15.6:0/2997644998 learned_addr learned my addr 172.21.15.6:0/2997644998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf27fc700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 0x7efcf40aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf37fe700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 0x7efcf416a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 -- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 msgr2=0x7efcf40aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 0x7efcf40aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 -- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 msgr2=0x7efcf416a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 0x7efcf416a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 -- 172.21.15.6:0/2997644998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009a20 con 0x7efcf406d830 2023-10-09T11:42:57.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf27fc700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 0x7efcf40aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf37fe700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 0x7efcf416a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf2ffd700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efce400c5f0 tx=0x7efce400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011590 con 0x7efcf406d830 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011710 con 0x7efcf406d830 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40b56c0 con 0x7efcf406d830 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011ad0 con 0x7efcf406d830 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.780+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf415e4f0 con 0x7efcf406d830 2023-10-09T11:42:57.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.781+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf4067ac0 con 0x7efcf406d830 2023-10-09T11:42:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.781+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efce401b3b0 con 0x7efcf406d830 2023-10-09T11:42:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.782+0000 7efcdaffd700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 0x7efce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.782+0000 7efcf27fc700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 0x7efce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.782+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efce4083b40 con 0x7efcf406d830 2023-10-09T11:42:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.782+0000 7efcf27fc700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 0x7efce00693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:57.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.786+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efce4050db0 con 0x7efcf406d830 2023-10-09T11:42:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.982+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcf415eb40 con 0x7efcf406d830 2023-10-09T11:42:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.982+0000 7efcdaffd700 1 -- 172.21.15.6:0/2997644998 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+15317 (secure 0 0 0) 0x7efce4017070 con 0x7efcf406d830 2023-10-09T11:42:57.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:42:57.984 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":146,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:57.938373+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:42:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 msgr2=0x7efce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 0x7efce00693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efce8007fd0 tx=0x7efce8009040 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 msgr2=0x7efcf415ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efce400c5f0 tx=0x7efce400c9b0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 shutdown_connections 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7efce0066f30 0x7efce00693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efcf4157ca0 0x7efcf416a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf406d830 0x7efcf415ecf0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 --2- 172.21.15.6:0/2997644998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efcf41578d0 0x7efcf40aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 >> 172.21.15.6:0/2997644998 conn(0x7efcf406bb90 msgr2=0x7efcf4160560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 shutdown_connections 2023-10-09T11:42:57.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:57.985+0000 7efcf96e2700 1 -- 172.21.15.6:0/2997644998 wait complete. 2023-10-09T11:42:57.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:42:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.119+0000 7f811c262700 1 Processor -- start 2023-10-09T11:42:58.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.119+0000 7f811c262700 1 -- start start 2023-10-09T11:42:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f811c262700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8114157ca0 0x7f81140cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f811c262700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 0x7f811406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f811c262700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140d07c0 con 0x7f81141578d0 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f811c262700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811406da50 con 0x7f8114157ca0 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f811c262700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140cfbb0 con 0x7f811406d120 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f81197fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8114157ca0 0x7f81140cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f81197fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8114157ca0 0x7f81140cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37748/0 (socket says 172.21.15.6:37748) 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.120+0000 7f81197fd700 1 -- 172.21.15.6:0/3471089667 learned_addr learned my addr 172.21.15.6:0/3471089667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f811a7ff700 1 --2- 172.21.15.6:0/3471089667 >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 0x7f811406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f81197fd700 1 -- 172.21.15.6:0/3471089667 >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 msgr2=0x7f811406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f81197fd700 1 --2- 172.21.15.6:0/3471089667 >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 0x7f811406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f81197fd700 1 -- 172.21.15.6:0/3471089667 >> v1:172.21.15.118:6789/0 conn(0x7f81141578d0 legacy=0x7f811415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:58.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f81197fd700 1 -- 172.21.15.6:0/3471089667 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140cfe90 con 0x7f8114157ca0 2023-10-09T11:42:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f811a7ff700 1 --2- 172.21.15.6:0/3471089667 >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 0x7f811406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:42:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f81197fd700 1 --2- 172.21.15.6:0/3471089667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f81140cf4f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8114068300 tx=0x7f8104009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421ac3ce4df04df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f8118ffc700 1 -- 172.21.15.6:0/3471089667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400b820 con 0x7f8114157ca0 2023-10-09T11:42:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f8118ffc700 1 -- 172.21.15.6:0/3471089667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400b980 con 0x7f8114157ca0 2023-10-09T11:42:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.121+0000 7f8118ffc700 1 -- 172.21.15.6:0/3471089667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400bd20 con 0x7f8114157ca0 2023-10-09T11:42:58.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 -- 172.21.15.6:0/3471089667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 msgr2=0x7f81140cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 --2- 172.21.15.6:0/3471089667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f81140cf4f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8114068300 tx=0x7f8104009250 comp rx=0 tx=0).stop 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 -- 172.21.15.6:0/3471089667 shutdown_connections 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 --2- 172.21.15.6:0/3471089667 >> v2:172.21.15.118:3300/0 conn(0x7f811406d120 0x7f811406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 --2- 172.21.15.6:0/3471089667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f81140cf4f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 -- 172.21.15.6:0/3471089667 >> 172.21.15.6:0/3471089667 conn(0x7f811406bb90 msgr2=0x7f811406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 -- 172.21.15.6:0/3471089667 shutdown_connections 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.122+0000 7f811c262700 1 -- 172.21.15.6:0/3471089667 wait complete. 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.123+0000 7f811c262700 1 Processor -- start 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.123+0000 7f811c262700 1 -- start start 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811406d120 0x7f811416e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81141578d0 0x7f81140b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811416eaf0 con 0x7f8114157ca0 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140b5110 con 0x7f811406d120 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811c262700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140b4500 con 0x7f81141578d0 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37760/0 (socket says 172.21.15.6:37760) 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 -- 172.21.15.6:0/2387358527 learned_addr learned my addr 172.21.15.6:0/2387358527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f8119ffe700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811406d120 0x7f811416e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f81197fd700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81141578d0 0x7f81140b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 -- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81141578d0 msgr2=0x7f81140b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81141578d0 0x7f81140b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 -- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811406d120 msgr2=0x7f811416e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811406d120 0x7f811416e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 -- 172.21.15.6:0/2387358527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040094f0 con 0x7f8114157ca0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f811a7ff700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f810c00a380 tx=0x7f810c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.124+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c015440 con 0x7f8114157ca0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.125+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c0155a0 con 0x7f8114157ca0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.125+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140b47e0 con 0x7f8114157ca0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.125+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c015960 con 0x7f8114157ca0 2023-10-09T11:42:58.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.125+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140b4da0 con 0x7f8114157ca0 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.126+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114067ac0 con 0x7f8114157ca0 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.126+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f810c00d440 con 0x7f8114157ca0 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.126+0000 7f8109ffb700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.126+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f810c085030 con 0x7f8114157ca0 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.126+0000 7f8119ffe700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.127+0000 7f8119ffe700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8110003a30 tx=0x7f8110007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:58.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.131+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f810c0522a0 con 0x7f8114157ca0 2023-10-09T11:42:58.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:58.370+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81140d0170 con 0x7f8114157ca0 2023-10-09T11:42:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.305+0000 7f8109ffb700 1 -- 172.21.15.6:0/2387358527 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f810c0558c0 con 0x7f8114157ca0 2023-10-09T11:42:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 msgr2=0x7f80f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8110003a30 tx=0x7f8110007ea0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 msgr2=0x7f8114069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f810c00a380 tx=0x7f810c007900 comp rx=0 tx=0).stop 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 shutdown_connections 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8114157ca0 0x7f8114069ce0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f811406d120 0x7f811416e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 --2- 172.21.15.6:0/2387358527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81141578d0 0x7f81140b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.307+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 >> 172.21.15.6:0/2387358527 conn(0x7f811406bb90 msgr2=0x7f811415e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.308+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 shutdown_connections 2023-10-09T11:42:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.308+0000 7f811c262700 1 -- 172.21.15.6:0/2387358527 wait complete. 2023-10-09T11:42:59.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:42:59.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.450+0000 7f60d3373700 1 Processor -- start 2023-10-09T11:42:59.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.450+0000 7f60d3373700 1 -- start start 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d3373700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60cc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d3373700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0d07c0 con 0x7f60cc1578d0 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d3373700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0cfbb0 con 0x7f60cc157ca0 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d3373700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0cfe90 con 0x7f60cc06d830 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d110f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60cc1578d0 0x7f60cc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42496/0 (socket says 172.21.15.6:42496) 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d110f700 1 -- 172.21.15.6:0/3162930357 learned_addr learned my addr 172.21.15.6:0/3162930357 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60d1910700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60cc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051132168 0 0) 0x7f60cc0d07c0 con 0x7f60cc1578d0 2023-10-09T11:42:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b4003570 con 0x7f60cc1578d0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901538432 0 0) 0x7f60cc0cfbb0 con 0x7f60cc157ca0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc0d07c0 con 0x7f60cc157ca0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334681728 0 0) 0x7f60b4003570 con 0x7f60cc1578d0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 msgr2=0x7f60cc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60cc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 >> v1:172.21.15.118:6789/0 conn(0x7f60cc157ca0 legacy=0x7f60cc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0d0170 con 0x7f60cc1578d0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f60c40017f0 con 0x7f60cc1578d0 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 >> v1:172.21.15.6:6789/0 conn(0x7f60cc1578d0 legacy=0x7f60cc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.451+0000 7f60cbfff700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b4003c20 0x7f60b4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4004d50 0x7f60b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0cfe90 con 0x7f60b4003c20 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b400bb40 con 0x7f60b4004d50 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b400bd00 con 0x7f60cc06d830 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b4003c20 0x7f60b4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d1910700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4004d50 0x7f60b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d090e700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 -- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 msgr2=0x7f60b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 -- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4004d50 msgr2=0x7f60b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4004d50 0x7f60b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 -- 172.21.15.6:0/3162930357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4003570 con 0x7f60b4003c20 2023-10-09T11:42:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d090e700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc06d830 0x7f60b4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60d110f700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b4003c20 0x7f60b4004010 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f60c400a8f0 tx=0x7f60cc15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7a2c1affe665eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40070d0 con 0x7f60b4003c20 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4007250 con 0x7f60b4003c20 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.452+0000 7f60cbfff700 1 -- 172.21.15.6:0/3162930357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4007610 con 0x7f60b4003c20 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 -- 172.21.15.6:0/3162930357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b4003c20 msgr2=0x7f60b4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 --2- 172.21.15.6:0/3162930357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b4003c20 0x7f60b4004010 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f60c400a8f0 tx=0x7f60cc15b610 comp rx=0 tx=0).stop 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d1910700 1 -- 172.21.15.6:0/3162930357 reap_dead start 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 -- 172.21.15.6:0/3162930357 shutdown_connections 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 -- 172.21.15.6:0/3162930357 >> 172.21.15.6:0/3162930357 conn(0x7f60cc06bb90 msgr2=0x7f60cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 -- 172.21.15.6:0/3162930357 shutdown_connections 2023-10-09T11:42:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.453+0000 7f60d3373700 1 -- 172.21.15.6:0/3162930357 wait complete. 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.454+0000 7f60d3373700 1 Processor -- start 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.454+0000 7f60d3373700 1 -- start start 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4003c20 0x7f60cc16e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc159680 0x7f60cc159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc15a030 con 0x7f60cc08b940 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc08d1f0 con 0x7f60b4003c20 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d3373700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc08c670 con 0x7f60cc159680 2023-10-09T11:42:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37780/0 (socket says 172.21.15.6:37780) 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 -- 172.21.15.6:0/460894030 learned_addr learned my addr 172.21.15.6:0/460894030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d090e700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc159680 0x7f60cc159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d110f700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4003c20 0x7f60cc16e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 -- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc159680 msgr2=0x7f60cc159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc159680 0x7f60cc159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 -- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4003c20 msgr2=0x7f60cc16e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4003c20 0x7f60cc16e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.455+0000 7f60d1910700 1 -- 172.21.15.6:0/460894030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc08c950 con 0x7f60cc08b940 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60d1910700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f60cc068680 tx=0x7f60bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc013750 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0138d0 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc08cc30 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc013c90 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.456+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc16e960 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.457+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc06a550 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.457+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60bc014650 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.458+0000 7f60c97fa700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 0x7f60b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.458+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60bc084a40 con 0x7f60cc08b940 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.458+0000 7f60d110f700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 0x7f60b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:42:59.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.458+0000 7f60d110f700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 0x7f60b80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f60c4015000 tx=0x7f60c4013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:42:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.462+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60bc086e60 con 0x7f60cc08b940 2023-10-09T11:42:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:42:59.701+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f60cc16eb80 con 0x7f60cc08b940 2023-10-09T11:43:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.309+0000 7f60c97fa700 1 -- 172.21.15.6:0/460894030 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60bc0220c0 con 0x7f60cc08b940 2023-10-09T11:43:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 msgr2=0x7f60b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 0x7f60b80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f60c4015000 tx=0x7f60c4013000 comp rx=0 tx=0).stop 2023-10-09T11:43:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 msgr2=0x7f60cc08bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f60cc068680 tx=0x7f60bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 shutdown_connections 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f60b8066f30 0x7f60b80693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc08b940 0x7f60cc08bde0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60b4003c20 0x7f60cc16e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 --2- 172.21.15.6:0/460894030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f60cc159680 0x7f60cc159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 >> 172.21.15.6:0/460894030 conn(0x7f60cc06bb90 msgr2=0x7f60cc070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 shutdown_connections 2023-10-09T11:43:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.311+0000 7f60d3373700 1 -- 172.21.15.6:0/460894030 wait complete. 2023-10-09T11:43:00.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.447+0000 7ff46b97e700 1 Processor -- start 2023-10-09T11:43:00.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.447+0000 7ff46b97e700 1 -- start start 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46b97e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 0x7ff4640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46b97e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff46406d120 0x7ff46406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46b97e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46406dac0 con 0x7ff464157ca0 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46b97e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640d07c0 con 0x7ff46406d120 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46b97e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640cfbb0 con 0x7ff4641578d0 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff468f19700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff464157ca0 0x7ff46415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42510/0 (socket says 172.21.15.6:42510) 2023-10-09T11:43:00.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff468f19700 1 -- 172.21.15.6:0/3044847201 learned_addr learned my addr 172.21.15.6:0/3044847201 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff469f1b700 1 --2- 172.21.15.6:0/3044847201 >> v2:172.21.15.118:3300/0 conn(0x7ff46406d120 0x7ff46406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46971a700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 0x7ff4640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff463fff700 1 -- 172.21.15.6:0/3044847201 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974774779 0 0) 0x7ff458001110 con 0x7ff464157ca0 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff463fff700 1 -- 172.21.15.6:0/3044847201 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44c003570 con 0x7ff464157ca0 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff469f1b700 1 -- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 msgr2=0x7ff4640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff469f1b700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 0x7ff4640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff469f1b700 1 -- 172.21.15.6:0/3044847201 >> v1:172.21.15.6:6789/0 conn(0x7ff464157ca0 legacy=0x7ff46415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff469f1b700 1 -- 172.21.15.6:0/3044847201 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640cfe90 con 0x7ff46406d120 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.448+0000 7ff46971a700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 0x7ff4640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff469f1b700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46406d120 0x7ff46406d580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098e0 tx=0x7ff45c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced41f01d5326139 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff463fff700 1 -- 172.21.15.6:0/3044847201 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011630 con 0x7ff46406d120 2023-10-09T11:43:00.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff463fff700 1 -- 172.21.15.6:0/3044847201 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c011790 con 0x7ff46406d120 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff463fff700 1 -- 172.21.15.6:0/3044847201 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011b30 con 0x7ff46406d120 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 -- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46406d120 msgr2=0x7ff46406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46406d120 0x7ff46406d580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098e0 tx=0x7ff45c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 -- 172.21.15.6:0/3044847201 shutdown_connections 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46406d120 0x7ff46406d580 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 --2- 172.21.15.6:0/3044847201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4641578d0 0x7ff4640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 -- 172.21.15.6:0/3044847201 >> 172.21.15.6:0/3044847201 conn(0x7ff46406bb90 msgr2=0x7ff46406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 -- 172.21.15.6:0/3044847201 shutdown_connections 2023-10-09T11:43:00.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.449+0000 7ff46b97e700 1 -- 172.21.15.6:0/3044847201 wait complete. 2023-10-09T11:43:00.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.450+0000 7ff46b97e700 1 Processor -- start 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 -- start start 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46406d120 0x7ff46414bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464157ca0 0x7ff464159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46416b210 con 0x7ff4641578d0 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46414c0c0 con 0x7ff464157ca0 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff46b97e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46416a600 con 0x7ff46406d120 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.451+0000 7ff468f19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37786/0 (socket says 172.21.15.6:37786) 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 -- 172.21.15.6:0/1745084222 learned_addr learned my addr 172.21.15.6:0/1745084222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:00.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff469f1b700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464157ca0 0x7ff464159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff46971a700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46406d120 0x7ff46414bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 -- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46406d120 msgr2=0x7ff46414bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46406d120 0x7ff46414bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 -- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464157ca0 msgr2=0x7ff464159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464157ca0 0x7ff464159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 -- 172.21.15.6:0/1745084222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454009a20 con 0x7ff4641578d0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff468f19700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c5c0 tx=0x7ff458007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458005b30 con 0x7ff4641578d0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005cb0 con 0x7ff4641578d0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c009420 con 0x7ff4641578d0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458007320 con 0x7ff4641578d0 2023-10-09T11:43:00.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.452+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46416abc0 con 0x7ff4641578d0 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.453+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464150ca0 con 0x7ff4641578d0 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.454+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff45801b3b0 con 0x7ff4641578d0 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.454+0000 7ff4617fa700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.454+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff458083760 con 0x7ff4641578d0 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.454+0000 7ff46971a700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.454+0000 7ff46971a700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 0x7ff4500693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff454009fd0 tx=0x7ff45400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.458+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4580509d0 con 0x7ff4641578d0 2023-10-09T11:43:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.694+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff46406dac0 con 0x7ff4641578d0 2023-10-09T11:43:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.694+0000 7ff4617fa700 1 -- 172.21.15.6:0/1745084222 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ff46406dac0 con 0x7ff4641578d0 2023-10-09T11:43:00.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:00.696 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 msgr2=0x7ff4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 0x7ff4500693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff454009fd0 tx=0x7ff45400b040 comp rx=0 tx=0).stop 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 msgr2=0x7ff4641594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c5c0 tx=0x7ff458007c70 comp rx=0 tx=0).stop 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 shutdown_connections 2023-10-09T11:43:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464157ca0 0x7ff464159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46406d120 0x7ff46414bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 --2- 172.21.15.6:0/1745084222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4641578d0 0x7ff4641594f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 >> 172.21.15.6:0/1745084222 conn(0x7ff46406bb90 msgr2=0x7ff464070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 shutdown_connections 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.696+0000 7ff46b97e700 1 -- 172.21.15.6:0/1745084222 wait complete. 2023-10-09T11:43:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:43:00.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:43:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.827+0000 7fa69124e700 1 Processor -- start 2023-10-09T11:43:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.827+0000 7fa69124e700 1 -- start start 2023-10-09T11:43:00.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.828+0000 7fa69124e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa68c06d830 0x7fa68c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.828+0000 7fa69124e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0d07c0 con 0x7fa68c157ca0 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.828+0000 7fa69124e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0cfbb0 con 0x7fa68c1578d0 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.828+0000 7fa69124e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0cfe90 con 0x7fa68c06d830 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.828+0000 7fa68b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa68c06d830 0x7fa68c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa68c157ca0 0x7fa68c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42514/0 (socket says 172.21.15.6:42514) 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68a59c700 1 -- 172.21.15.6:0/2769773776 learned_addr learned my addr 172.21.15.6:0/2769773776 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68b59e700 1 -- 172.21.15.6:0/2769773776 >> v1:172.21.15.118:6789/0 conn(0x7fa68c1578d0 legacy=0x7fa68c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68b59e700 1 -- 172.21.15.6:0/2769773776 >> v1:172.21.15.6:6789/0 conn(0x7fa68c157ca0 legacy=0x7fa68c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa689d9b700 1 -- 172.21.15.6:0/2769773776 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067583750 0 0) 0x7fa68c0d07c0 con 0x7fa68c157ca0 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68b59e700 1 -- 172.21.15.6:0/2769773776 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0d0170 con 0x7fa68c06d830 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa68b59e700 1 --2- 172.21.15.6:0/2769773776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c06d830 0x7fa68c0cf4f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa684009e60 tx=0x7fa684009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8739f5aebf7ba631 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa689d9b700 1 -- 172.21.15.6:0/2769773776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400e070 con 0x7fa68c06d830 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa689d9b700 1 -- 172.21.15.6:0/2769773776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400bc30 con 0x7fa68c06d830 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.829+0000 7fa689d9b700 1 -- 172.21.15.6:0/2769773776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012430 con 0x7fa68c06d830 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 -- 172.21.15.6:0/2769773776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c06d830 msgr2=0x7fa68c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 --2- 172.21.15.6:0/2769773776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c06d830 0x7fa68c0cf4f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa684009e60 tx=0x7fa684009780 comp rx=0 tx=0).stop 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 -- 172.21.15.6:0/2769773776 shutdown_connections 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 --2- 172.21.15.6:0/2769773776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c06d830 0x7fa68c0cf4f0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 -- 172.21.15.6:0/2769773776 >> 172.21.15.6:0/2769773776 conn(0x7fa68c06bb90 msgr2=0x7fa68c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:00.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 -- 172.21.15.6:0/2769773776 shutdown_connections 2023-10-09T11:43:00.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.830+0000 7fa69124e700 1 -- 172.21.15.6:0/2769773776 wait complete. 2023-10-09T11:43:00.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.831+0000 7fa69124e700 1 Processor -- start 2023-10-09T11:43:00.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.831+0000 7fa69124e700 1 -- start start 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa68c06d830 0x7fa68c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa68c157ca0 0x7fa68c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c154fa0 con 0x7fa68c1578d0 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c15ea20 con 0x7fa68c157ca0 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa69124e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0b60f0 con 0x7fa68c06d830 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37812/0 (socket says 172.21.15.6:37812) 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 -- 172.21.15.6:0/3005215478 learned_addr learned my addr 172.21.15.6:0/3005215478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:00.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68ad9d700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa68c06d830 0x7fa68c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68b59e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa68c157ca0 0x7fa68c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 -- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa68c06d830 msgr2=0x7fa68c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa68c06d830 0x7fa68c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 -- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa68c157ca0 msgr2=0x7fa68c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa68c157ca0 0x7fa68c0b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.832+0000 7fa68a59c700 1 -- 172.21.15.6:0/3005215478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009a20 con 0x7fa68c1578d0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa68a59c700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c5e0 tx=0x7fa674000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674005b30 con 0x7fa68c1578d0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674005c90 con 0x7fa68c1578d0 2023-10-09T11:43:00.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0b63d0 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674007300 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.833+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c0b6990 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.834+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c067ac0 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.834+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa67401b3b0 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.834+0000 7fa682ffd700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 0x7fa66c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.834+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa674083930 con 0x7fa68c1578d0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.834+0000 7fa68ad9d700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 0x7fa66c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:00.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.835+0000 7fa68ad9d700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 0x7fa66c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa67c003a80 tx=0x7fa67c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:00.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:00.839+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa674050ba0 con 0x7fa68c1578d0 2023-10-09T11:43:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.033+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa68c0d0450 con 0x7fa68c1578d0 2023-10-09T11:43:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.033+0000 7fa682ffd700 1 -- 172.21.15.6:0/3005215478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+15317 (secure 0 0 0) 0x7fa674017090 con 0x7fa68c1578d0 2023-10-09T11:43:01.035 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:01.035 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":146,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:42:57.938373+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:43:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 msgr2=0x7fa66c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 0x7fa66c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa67c003a80 tx=0x7fa67c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 msgr2=0x7fa68c0b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c5e0 tx=0x7fa674000fe0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 shutdown_connections 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa66c066f30 0x7fa66c0693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa68c157ca0 0x7fa68c0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa68c06d830 0x7fa68c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 --2- 172.21.15.6:0/3005215478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa68c1578d0 0x7fa68c0b5520 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 >> 172.21.15.6:0/3005215478 conn(0x7fa68c06bb90 msgr2=0x7fa68c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 shutdown_connections 2023-10-09T11:43:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.036+0000 7fa69124e700 1 -- 172.21.15.6:0/3005215478 wait complete. 2023-10-09T11:43:01.050 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:43:01.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:01.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.167+0000 7eff3d992700 1 Processor -- start 2023-10-09T11:43:01.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.167+0000 7eff3d992700 1 -- start start 2023-10-09T11:43:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d992700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d992700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7eff38068e90 0x7eff380cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d992700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380cee10 con 0x7eff38159f10 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d992700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff380cd040 con 0x7eff38068e90 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d992700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff380cd320 con 0x7eff38159b40 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3c990700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3d191700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7eff38068e90 0x7eff380cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff37fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7eff38159f10 0x7eff38068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:56324/0 (socket says 172.21.15.6:56324) 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff37fff700 1 -- 172.21.15.6:0/3912077902 learned_addr learned my addr 172.21.15.6:0/3912077902 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.168+0000 7eff3c990700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:37384/0 (socket says 172.21.15.6:37384) 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3c990700 1 -- 172.21.15.6:0/3912077902 >> v2:172.21.15.118:3300/0 conn(0x7eff38068e90 msgr2=0x7eff380cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3c990700 1 --2- 172.21.15.6:0/3912077902 >> v2:172.21.15.118:3300/0 conn(0x7eff38068e90 0x7eff380cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff377fe700 1 -- 172.21.15.6:0/3912077902 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834299551 0 0) 0x7eff380cee10 con 0x7eff38159f10 2023-10-09T11:43:01.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3c990700 1 -- 172.21.15.6:0/3912077902 >> v1:172.21.15.118:6789/0 conn(0x7eff38159f10 legacy=0x7eff38068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3c990700 1 -- 172.21.15.6:0/3912077902 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380ce7c0 con 0x7eff38159b40 2023-10-09T11:43:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3c990700 1 --2- 172.21.15.6:0/3912077902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff280098e0 tx=0x7eff280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce15d74fbf814f5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff377fe700 1 -- 172.21.15.6:0/3912077902 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800b640 con 0x7eff38159b40 2023-10-09T11:43:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff377fe700 1 -- 172.21.15.6:0/3912077902 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800b7a0 con 0x7eff38159b40 2023-10-09T11:43:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff377fe700 1 -- 172.21.15.6:0/3912077902 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800bb40 con 0x7eff38159b40 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3d992700 1 -- 172.21.15.6:0/3912077902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 msgr2=0x7eff380cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.169+0000 7eff3d992700 1 --2- 172.21.15.6:0/3912077902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7eff280098e0 tx=0x7eff280091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 -- 172.21.15.6:0/3912077902 shutdown_connections 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 --2- 172.21.15.6:0/3912077902 >> v2:172.21.15.118:3300/0 conn(0x7eff38068e90 0x7eff380cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 --2- 172.21.15.6:0/3912077902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159b40 0x7eff380cc600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 -- 172.21.15.6:0/3912077902 >> 172.21.15.6:0/3912077902 conn(0x7eff380cd660 msgr2=0x7eff380cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 -- 172.21.15.6:0/3912077902 shutdown_connections 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.170+0000 7eff3d992700 1 -- 172.21.15.6:0/3912077902 wait complete. 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.171+0000 7eff3d992700 1 Processor -- start 2023-10-09T11:43:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.171+0000 7eff3d992700 1 -- start start 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.171+0000 7eff3d992700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff38068e90 0x7eff380c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.171+0000 7eff3d992700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.171+0000 7eff3d992700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159f10 0x7eff381575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d992700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ca3f0 con 0x7eff38159b40 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d992700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38155b00 con 0x7eff38068e90 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d992700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3816a300 con 0x7eff38159f10 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37816/0 (socket says 172.21.15.6:37816) 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 -- 172.21.15.6:0/555553577 learned_addr learned my addr 172.21.15.6:0/555553577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3c990700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff38068e90 0x7eff380c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d191700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159f10 0x7eff381575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 -- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159f10 msgr2=0x7eff381575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159f10 0x7eff381575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 -- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff38068e90 msgr2=0x7eff380c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff38068e90 0x7eff380c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 -- 172.21.15.6:0/555553577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009420 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff37fff700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c5e0 tx=0x7eff2c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c005b30 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c005c90 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380c97e0 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c007300 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.172+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff380c9da0 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.173+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380cb910 con 0x7eff38159b40 2023-10-09T11:43:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.174+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff2c01b3b0 con 0x7eff38159b40 2023-10-09T11:43:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.174+0000 7eff34ff9700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.174+0000 7eff3c990700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.174+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff2c083960 con 0x7eff38159b40 2023-10-09T11:43:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.175+0000 7eff3c990700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 0x7eff240693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7eff280093f0 tx=0x7eff28017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.179+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff2c050bd0 con 0x7eff38159b40 2023-10-09T11:43:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.369+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff380ca530 con 0x7eff24066f30 2023-10-09T11:43:01.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.377+0000 7eff34ff9700 1 -- 172.21.15.6:0/555553577 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285733 (secure 0 0 0) 0x7eff380ca530 con 0x7eff24066f30 2023-10-09T11:43:01.382 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 msgr2=0x7eff240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 0x7eff240693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7eff280093f0 tx=0x7eff28017000 comp rx=0 tx=0).stop 2023-10-09T11:43:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 msgr2=0x7eff380c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c5e0 tx=0x7eff2c001070 comp rx=0 tx=0).stop 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 shutdown_connections 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7eff24066f30 0x7eff240693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff38159f10 0x7eff381575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff38068e90 0x7eff380c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 --2- 172.21.15.6:0/555553577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff38159b40 0x7eff380c91b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 >> 172.21.15.6:0/555553577 conn(0x7eff380cd660 msgr2=0x7eff380b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 shutdown_connections 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.380+0000 7eff3d992700 1 -- 172.21.15.6:0/555553577 wait complete. 2023-10-09T11:43:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:43:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-10-09T11:43:00.235452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555071,"statfs":{"total":1600000000,"available":1592393247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.957538"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951367+0000","last_change":"2023-10-09T11:42:56.951288+0000","last_active":"2023-10-09T11:42:56.951367+0000","last_peered":"2023-10-09T11:42:56.951367+0000","last_clean":"2023-10-09T11:42:56.951367+0000","last_became_active":"2023-10-09T11:42:56.951070+0000","last_became_peered":"2023-10-09T11:42:56.951070+0000","last_unstale":"2023-10-09T11:42:56.951367+0000","last_undegraded":"2023-10-09T11:42:56.951367+0000","last_fullsized":"2023-10-09T11:42:56.951367+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:18.686630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948689+0000","last_change":"2023-10-09T11:42:56.948625+0000","last_active":"2023-10-09T11:42:56.948689+0000","last_peered":"2023-10-09T11:42:56.948689+0000","last_clean":"2023-10-09T11:42:56.948689+0000","last_became_active":"2023-10-09T11:42:56.948367+0000","last_became_peered":"2023-10-09T11:42:56.948367+0000","last_unstale":"2023-10-09T11:42:56.948689+0000","last_undegraded":"2023-10-09T11:42:56.948689+0000","last_fullsized":"2023-10-09T11:42:56.948689+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:48.081279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951711+0000","last_change":"2023-10-09T11:42:56.951711+0000","last_active":"2023-10-09T11:42:56.951711+0000","last_peered":"2023-10-09T11:42:56.951711+0000","last_clean":"2023-10-09T11:42:56.951711+0000","last_became_active":"2023-10-09T11:42:56.950403+0000","last_became_peered":"2023-10-09T11:42:56.950403+0000","last_unstale":"2023-10-09T11:42:56.951711+0000","last_undegraded":"2023-10-09T11:42:56.951711+0000","last_fullsized":"2023-10-09T11:42:56.951711+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:49.651397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951629+0000","last_change":"2023-10-09T11:42:56.951571+0000","last_active":"2023-10-09T11:42:56.951629+0000","last_peered":"2023-10-09T11:42:56.951629+0000","last_clean":"2023-10-09T11:42:56.951629+0000","last_became_active":"2023-10-09T11:42:56.951162+0000","last_became_peered":"2023-10-09T11:42:56.951162+0000","last_unstale":"2023-10-09T11:42:56.951629+0000","last_undegraded":"2023-10-09T11:42:56.951629+0000","last_fullsized":"2023-10-09T11:42:56.951629+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.805043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953237+0000","last_change":"2023-10-09T11:42:56.953237+0000","last_active":"2023-10-09T11:42:56.953237+0000","last_peered":"2023-10-09T11:42:56.953237+0000","last_clean":"2023-10-09T11:42:56.953237+0000","last_became_active":"2023-10-09T11:42:56.953017+0000","last_became_peered":"2023-10-09T11:42:56.953017+0000","last_unstale":"2023-10-09T11:42:56.953237+0000","last_undegraded":"2023-10-09T11:42:56.953237+0000","last_fullsized":"2023-10-09T11:42:56.953237+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:16.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951808+0000","last_change":"2023-10-09T11:42:56.951664+0000","last_active":"2023-10-09T11:42:56.951808+0000","last_peered":"2023-10-09T11:42:56.951808+0000","last_clean":"2023-10-09T11:42:56.951808+0000","last_became_active":"2023-10-09T11:42:56.951392+0000","last_became_peered":"2023-10-09T11:42:56.951392+0000","last_unstale":"2023-10-09T11:42:56.951808+0000","last_undegraded":"2023-10-09T11:42:56.951808+0000","last_fullsized":"2023-10-09T11:42:56.951808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:22.155935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953974+0000","last_change":"2023-10-09T11:42:56.953807+0000","last_active":"2023-10-09T11:42:56.953974+0000","last_peered":"2023-10-09T11:42:56.953974+0000","last_clean":"2023-10-09T11:42:56.953974+0000","last_became_active":"2023-10-09T11:42:56.952676+0000","last_became_peered":"2023-10-09T11:42:56.952676+0000","last_unstale":"2023-10-09T11:42:56.953974+0000","last_undegraded":"2023-10-09T11:42:56.953974+0000","last_fullsized":"2023-10-09T11:42:56.953974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:34.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954710+0000","last_change":"2023-10-09T11:42:56.954710+0000","last_active":"2023-10-09T11:42:56.954710+0000","last_peered":"2023-10-09T11:42:56.954710+0000","last_clean":"2023-10-09T11:42:56.954710+0000","last_became_active":"2023-10-09T11:42:56.951173+0000","last_became_peered":"2023-10-09T11:42:56.951173+0000","last_unstale":"2023-10-09T11:42:56.954710+0000","last_undegraded":"2023-10-09T11:42:56.954710+0000","last_fullsized":"2023-10-09T11:42:56.954710+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:17.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954453+0000","last_change":"2023-10-09T11:42:56.954453+0000","last_active":"2023-10-09T11:42:56.954453+0000","last_peered":"2023-10-09T11:42:56.954453+0000","last_clean":"2023-10-09T11:42:56.954453+0000","last_became_active":"2023-10-09T11:42:56.954231+0000","last_became_peered":"2023-10-09T11:42:56.954231+0000","last_unstale":"2023-10-09T11:42:56.954453+0000","last_undegraded":"2023-10-09T11:42:56.954453+0000","last_fullsized":"2023-10-09T11:42:56.954453+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:14.215269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945193+0000","last_change":"2023-10-09T11:42:56.945009+0000","last_active":"2023-10-09T11:42:56.945193+0000","last_peered":"2023-10-09T11:42:56.945193+0000","last_clean":"2023-10-09T11:42:56.945193+0000","last_became_active":"2023-10-09T11:42:56.944783+0000","last_became_peered":"2023-10-09T11:42:56.944783+0000","last_unstale":"2023-10-09T11:42:56.945193+0000","last_undegraded":"2023-10-09T11:42:56.945193+0000","last_fullsized":"2023-10-09T11:42:56.945193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:23.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945691+0000","last_change":"2023-10-09T11:42:56.945691+0000","last_active":"2023-10-09T11:42:56.945691+0000","last_peered":"2023-10-09T11:42:56.945691+0000","last_clean":"2023-10-09T11:42:56.945691+0000","last_became_active":"2023-10-09T11:42:56.945415+0000","last_became_peered":"2023-10-09T11:42:56.945415+0000","last_unstale":"2023-10-09T11:42:56.945691+0000","last_undegraded":"2023-10-09T11:42:56.945691+0000","last_fullsized":"2023-10-09T11:42:56.945691+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:59.406482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953165+0000","last_change":"2023-10-09T11:42:56.953165+0000","last_active":"2023-10-09T11:42:56.953165+0000","last_peered":"2023-10-09T11:42:56.953165+0000","last_clean":"2023-10-09T11:42:56.953165+0000","last_became_active":"2023-10-09T11:42:56.951745+0000","last_became_peered":"2023-10-09T11:42:56.951745+0000","last_unstale":"2023-10-09T11:42:56.953165+0000","last_undegraded":"2023-10-09T11:42:56.953165+0000","last_fullsized":"2023-10-09T11:42:56.953165+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:14.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946599+0000","last_change":"2023-10-09T11:42:56.946497+0000","last_active":"2023-10-09T11:42:56.946599+0000","last_peered":"2023-10-09T11:42:56.946599+0000","last_clean":"2023-10-09T11:42:56.946599+0000","last_became_active":"2023-10-09T11:42:56.946261+0000","last_became_peered":"2023-10-09T11:42:56.946261+0000","last_unstale":"2023-10-09T11:42:56.946599+0000","last_undegraded":"2023-10-09T11:42:56.946599+0000","last_fullsized":"2023-10-09T11:42:56.946599+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:28.276827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.944045+0000","last_change":"2023-10-09T11:42:56.943978+0000","last_active":"2023-10-09T11:42:56.944045+0000","last_peered":"2023-10-09T11:42:56.944045+0000","last_clean":"2023-10-09T11:42:56.944045+0000","last_became_active":"2023-10-09T11:42:56.943733+0000","last_became_peered":"2023-10-09T11:42:56.943733+0000","last_unstale":"2023-10-09T11:42:56.944045+0000","last_undegraded":"2023-10-09T11:42:56.944045+0000","last_fullsized":"2023-10-09T11:42:56.944045+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:36.044882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950802+0000","last_change":"2023-10-09T11:42:56.950764+0000","last_active":"2023-10-09T11:42:56.950802+0000","last_peered":"2023-10-09T11:42:56.950802+0000","last_clean":"2023-10-09T11:42:56.950802+0000","last_became_active":"2023-10-09T11:42:56.950110+0000","last_became_peered":"2023-10-09T11:42:56.950110+0000","last_unstale":"2023-10-09T11:42:56.950802+0000","last_undegraded":"2023-10-09T11:42:56.950802+0000","last_fullsized":"2023-10-09T11:42:56.950802+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:51.680642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949220+0000","last_change":"2023-10-09T11:42:56.949220+0000","last_active":"2023-10-09T11:42:56.949220+0000","last_peered":"2023-10-09T11:42:56.949220+0000","last_clean":"2023-10-09T11:42:56.949220+0000","last_became_active":"2023-10-09T11:42:56.948683+0000","last_became_peered":"2023-10-09T11:42:56.948683+0000","last_unstale":"2023-10-09T11:42:56.949220+0000","last_undegraded":"2023-10-09T11:42:56.949220+0000","last_fullsized":"2023-10-09T11:42:56.949220+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:39.249792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954099+0000","last_change":"2023-10-09T11:42:56.953953+0000","last_active":"2023-10-09T11:42:56.954099+0000","last_peered":"2023-10-09T11:42:56.954099+0000","last_clean":"2023-10-09T11:42:56.954099+0000","last_became_active":"2023-10-09T11:42:56.953360+0000","last_became_peered":"2023-10-09T11:42:56.953360+0000","last_unstale":"2023-10-09T11:42:56.954099+0000","last_undegraded":"2023-10-09T11:42:56.954099+0000","last_fullsized":"2023-10-09T11:42:56.954099+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.729641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949217+0000","last_change":"2023-10-09T11:42:56.949217+0000","last_active":"2023-10-09T11:42:56.949217+0000","last_peered":"2023-10-09T11:42:56.949217+0000","last_clean":"2023-10-09T11:42:56.949217+0000","last_became_active":"2023-10-09T11:42:56.948479+0000","last_became_peered":"2023-10-09T11:42:56.948479+0000","last_unstale":"2023-10-09T11:42:56.949217+0000","last_undegraded":"2023-10-09T11:42:56.949217+0000","last_fullsized":"2023-10-09T11:42:56.949217+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.583141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950328+0000","last_change":"2023-10-09T11:42:56.950328+0000","last_active":"2023-10-09T11:42:56.950328+0000","last_peered":"2023-10-09T11:42:56.950328+0000","last_clean":"2023-10-09T11:42:56.950328+0000","last_became_active":"2023-10-09T11:42:56.950077+0000","last_became_peered":"2023-10-09T11:42:56.950077+0000","last_unstale":"2023-10-09T11:42:56.950328+0000","last_undegraded":"2023-10-09T11:42:56.950328+0000","last_fullsized":"2023-10-09T11:42:56.950328+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:27.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951488+0000","last_change":"2023-10-09T11:42:56.951488+0000","last_active":"2023-10-09T11:42:56.951488+0000","last_peered":"2023-10-09T11:42:56.951488+0000","last_clean":"2023-10-09T11:42:56.951488+0000","last_became_active":"2023-10-09T11:42:56.951280+0000","last_became_peered":"2023-10-09T11:42:56.951280+0000","last_unstale":"2023-10-09T11:42:56.951488+0000","last_undegraded":"2023-10-09T11:42:56.951488+0000","last_fullsized":"2023-10-09T11:42:56.951488+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:16.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.955405+0000","last_change":"2023-10-09T11:42:56.955405+0000","last_active":"2023-10-09T11:42:56.955405+0000","last_peered":"2023-10-09T11:42:56.955405+0000","last_clean":"2023-10-09T11:42:56.955405+0000","last_became_active":"2023-10-09T11:42:56.955222+0000","last_became_peered":"2023-10-09T11:42:56.955222+0000","last_unstale":"2023-10-09T11:42:56.955405+0000","last_undegraded":"2023-10-09T11:42:56.955405+0000","last_fullsized":"2023-10-09T11:42:56.955405+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:51.500246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948770+0000","last_change":"2023-10-09T11:42:56.948770+0000","last_active":"2023-10-09T11:42:56.948770+0000","last_peered":"2023-10-09T11:42:56.948770+0000","last_clean":"2023-10-09T11:42:56.948770+0000","last_became_active":"2023-10-09T11:42:56.947978+0000","last_became_peered":"2023-10-09T11:42:56.947978+0000","last_unstale":"2023-10-09T11:42:56.948770+0000","last_undegraded":"2023-10-09T11:42:56.948770+0000","last_fullsized":"2023-10-09T11:42:56.948770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:13.546734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954860+0000","last_change":"2023-10-09T11:42:56.954860+0000","last_active":"2023-10-09T11:42:56.954860+0000","last_peered":"2023-10-09T11:42:56.954860+0000","last_clean":"2023-10-09T11:42:56.954860+0000","last_became_active":"2023-10-09T11:42:56.952260+0000","last_became_peered":"2023-10-09T11:42:56.952260+0000","last_unstale":"2023-10-09T11:42:56.954860+0000","last_undegraded":"2023-10-09T11:42:56.954860+0000","last_fullsized":"2023-10-09T11:42:56.954860+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:59.580669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948571+0000","last_change":"2023-10-09T11:42:56.948571+0000","last_active":"2023-10-09T11:42:56.948571+0000","last_peered":"2023-10-09T11:42:56.948571+0000","last_clean":"2023-10-09T11:42:56.948571+0000","last_became_active":"2023-10-09T11:42:56.948069+0000","last_became_peered":"2023-10-09T11:42:56.948069+0000","last_unstale":"2023-10-09T11:42:56.948571+0000","last_undegraded":"2023-10-09T11:42:56.948571+0000","last_fullsized":"2023-10-09T11:42:56.948571+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:58.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952601+0000","last_change":"2023-10-09T11:42:56.952340+0000","last_active":"2023-10-09T11:42:56.952601+0000","last_peered":"2023-10-09T11:42:56.952601+0000","last_clean":"2023-10-09T11:42:56.952601+0000","last_became_active":"2023-10-09T11:42:56.951704+0000","last_became_peered":"2023-10-09T11:42:56.951704+0000","last_unstale":"2023-10-09T11:42:56.952601+0000","last_undegraded":"2023-10-09T11:42:56.952601+0000","last_fullsized":"2023-10-09T11:42:56.952601+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:48:22.638765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949362+0000","last_change":"2023-10-09T11:42:56.949362+0000","last_active":"2023-10-09T11:42:56.949362+0000","last_peered":"2023-10-09T11:42:56.949362+0000","last_clean":"2023-10-09T11:42:56.949362+0000","last_became_active":"2023-10-09T11:42:56.948994+0000","last_became_peered":"2023-10-09T11:42:56.948994+0000","last_unstale":"2023-10-09T11:42:56.949362+0000","last_undegraded":"2023-10-09T11:42:56.949362+0000","last_fullsized":"2023-10-09T11:42:56.949362+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:51.500246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950299+0000","last_change":"2023-10-09T11:42:56.950231+0000","last_active":"2023-10-09T11:42:56.950299+0000","last_peered":"2023-10-09T11:42:56.950299+0000","last_clean":"2023-10-09T11:42:56.950299+0000","last_became_active":"2023-10-09T11:42:56.949816+0000","last_became_peered":"2023-10-09T11:42:56.949816+0000","last_unstale":"2023-10-09T11:42:56.950299+0000","last_undegraded":"2023-10-09T11:42:56.950299+0000","last_fullsized":"2023-10-09T11:42:56.950299+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:44.351360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950049+0000","last_change":"2023-10-09T11:42:56.948156+0000","last_active":"2023-10-09T11:42:56.950049+0000","last_peered":"2023-10-09T11:42:56.950049+0000","last_clean":"2023-10-09T11:42:56.950049+0000","last_became_active":"2023-10-09T11:42:56.947843+0000","last_became_peered":"2023-10-09T11:42:56.947843+0000","last_unstale":"2023-10-09T11:42:56.950049+0000","last_undegraded":"2023-10-09T11:42:56.950049+0000","last_fullsized":"2023-10-09T11:42:56.950049+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:14.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951485+0000","last_change":"2023-10-09T11:42:56.951425+0000","last_active":"2023-10-09T11:42:56.951485+0000","last_peered":"2023-10-09T11:42:56.951485+0000","last_clean":"2023-10-09T11:42:56.951485+0000","last_became_active":"2023-10-09T11:42:56.950622+0000","last_became_peered":"2023-10-09T11:42:56.950622+0000","last_unstale":"2023-10-09T11:42:56.951485+0000","last_undegraded":"2023-10-09T11:42:56.951485+0000","last_fullsized":"2023-10-09T11:42:56.951485+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:44.241241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950696+0000","last_change":"2023-10-09T11:42:56.950641+0000","last_active":"2023-10-09T11:42:56.950696+0000","last_peered":"2023-10-09T11:42:56.950696+0000","last_clean":"2023-10-09T11:42:56.950696+0000","last_became_active":"2023-10-09T11:42:56.949906+0000","last_became_peered":"2023-10-09T11:42:56.949906+0000","last_unstale":"2023-10-09T11:42:56.950696+0000","last_undegraded":"2023-10-09T11:42:56.950696+0000","last_fullsized":"2023-10-09T11:42:56.950696+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:58.522886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950030+0000","last_change":"2023-10-09T11:42:56.950030+0000","last_active":"2023-10-09T11:42:56.950030+0000","last_peered":"2023-10-09T11:42:56.950030+0000","last_clean":"2023-10-09T11:42:56.950030+0000","last_became_active":"2023-10-09T11:42:56.949496+0000","last_became_peered":"2023-10-09T11:42:56.949496+0000","last_unstale":"2023-10-09T11:42:56.950030+0000","last_undegraded":"2023-10-09T11:42:56.950030+0000","last_fullsized":"2023-10-09T11:42:56.950030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.583141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953371+0000","last_change":"2023-10-09T11:42:56.952985+0000","last_active":"2023-10-09T11:42:56.953371+0000","last_peered":"2023-10-09T11:42:56.953371+0000","last_clean":"2023-10-09T11:42:56.953371+0000","last_became_active":"2023-10-09T11:42:56.950633+0000","last_became_peered":"2023-10-09T11:42:56.950633+0000","last_unstale":"2023-10-09T11:42:56.953371+0000","last_undegraded":"2023-10-09T11:42:56.953371+0000","last_fullsized":"2023-10-09T11:42:56.953371+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.447284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949591+0000","last_change":"2023-10-09T11:42:56.949591+0000","last_active":"2023-10-09T11:42:56.949591+0000","last_peered":"2023-10-09T11:42:56.949591+0000","last_clean":"2023-10-09T11:42:56.949591+0000","last_became_active":"2023-10-09T11:42:56.948954+0000","last_became_peered":"2023-10-09T11:42:56.948954+0000","last_unstale":"2023-10-09T11:42:56.949591+0000","last_undegraded":"2023-10-09T11:42:56.949591+0000","last_fullsized":"2023-10-09T11:42:56.949591+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:16.329960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"145'4","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299971+0000","last_change":"2023-10-09T11:42:56.291810+0000","last_active":"2023-10-09T11:42:57.299971+0000","last_peered":"2023-10-09T11:42:57.299971+0000","last_clean":"2023-10-09T11:42:57.299971+0000","last_became_active":"2023-10-09T11:42:56.291540+0000","last_became_peered":"2023-10-09T11:42:56.291540+0000","last_unstale":"2023-10-09T11:42:57.299971+0000","last_undegraded":"2023-10-09T11:42:57.299971+0000","last_fullsized":"2023-10-09T11:42:57.299971+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:29.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952494+0000","last_change":"2023-10-09T11:42:56.952494+0000","last_active":"2023-10-09T11:42:56.952494+0000","last_peered":"2023-10-09T11:42:56.952494+0000","last_clean":"2023-10-09T11:42:56.952494+0000","last_became_active":"2023-10-09T11:42:56.950709+0000","last_became_peered":"2023-10-09T11:42:56.950709+0000","last_unstale":"2023-10-09T11:42:56.952494+0000","last_undegraded":"2023-10-09T11:42:56.952494+0000","last_fullsized":"2023-10-09T11:42:56.952494+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:14.568416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299365+0000","last_change":"2023-10-09T11:42:56.287536+0000","last_active":"2023-10-09T11:42:57.299365+0000","last_peered":"2023-10-09T11:42:57.299365+0000","last_clean":"2023-10-09T11:42:57.299365+0000","last_became_active":"2023-10-09T11:42:56.287250+0000","last_became_peered":"2023-10-09T11:42:56.287250+0000","last_unstale":"2023-10-09T11:42:57.299365+0000","last_undegraded":"2023-10-09T11:42:57.299365+0000","last_fullsized":"2023-10-09T11:42:57.299365+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:38.834996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952127+0000","last_change":"2023-10-09T11:42:56.952127+0000","last_active":"2023-10-09T11:42:56.952127+0000","last_peered":"2023-10-09T11:42:56.952127+0000","last_clean":"2023-10-09T11:42:56.952127+0000","last_became_active":"2023-10-09T11:42:56.951856+0000","last_became_peered":"2023-10-09T11:42:56.951856+0000","last_unstale":"2023-10-09T11:42:56.952127+0000","last_undegraded":"2023-10-09T11:42:56.952127+0000","last_fullsized":"2023-10-09T11:42:56.952127+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:48.666352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300332+0000","last_change":"2023-10-09T11:42:56.287964+0000","last_active":"2023-10-09T11:42:57.300332+0000","last_peered":"2023-10-09T11:42:57.300332+0000","last_clean":"2023-10-09T11:42:57.300332+0000","last_became_active":"2023-10-09T11:42:56.287758+0000","last_became_peered":"2023-10-09T11:42:56.287758+0000","last_unstale":"2023-10-09T11:42:57.300332+0000","last_undegraded":"2023-10-09T11:42:57.300332+0000","last_fullsized":"2023-10-09T11:42:57.300332+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:47.662069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952106+0000","last_change":"2023-10-09T11:42:56.952106+0000","last_active":"2023-10-09T11:42:56.952106+0000","last_peered":"2023-10-09T11:42:56.952106+0000","last_clean":"2023-10-09T11:42:56.952106+0000","last_became_active":"2023-10-09T11:42:56.951585+0000","last_became_peered":"2023-10-09T11:42:56.951585+0000","last_unstale":"2023-10-09T11:42:56.952106+0000","last_undegraded":"2023-10-09T11:42:56.952106+0000","last_fullsized":"2023-10-09T11:42:56.952106+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:19.271413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299188+0000","last_change":"2023-10-09T11:42:56.286220+0000","last_active":"2023-10-09T11:42:57.299188+0000","last_peered":"2023-10-09T11:42:57.299188+0000","last_clean":"2023-10-09T11:42:57.299188+0000","last_became_active":"2023-10-09T11:42:56.285645+0000","last_became_peered":"2023-10-09T11:42:56.285645+0000","last_unstale":"2023-10-09T11:42:57.299188+0000","last_undegraded":"2023-10-09T11:42:57.299188+0000","last_fullsized":"2023-10-09T11:42:57.299188+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:38.352072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951782+0000","last_change":"2023-10-09T11:42:56.951782+0000","last_active":"2023-10-09T11:42:56.951782+0000","last_peered":"2023-10-09T11:42:56.951782+0000","last_clean":"2023-10-09T11:42:56.951782+0000","last_became_active":"2023-10-09T11:42:56.948793+0000","last_became_peered":"2023-10-09T11:42:56.948793+0000","last_unstale":"2023-10-09T11:42:56.951782+0000","last_undegraded":"2023-10-09T11:42:56.951782+0000","last_fullsized":"2023-10-09T11:42:56.951782+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:48.666352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300278+0000","last_change":"2023-10-09T11:42:56.287796+0000","last_active":"2023-10-09T11:42:57.300278+0000","last_peered":"2023-10-09T11:42:57.300278+0000","last_clean":"2023-10-09T11:42:57.300278+0000","last_became_active":"2023-10-09T11:42:56.287531+0000","last_became_peered":"2023-10-09T11:42:56.287531+0000","last_unstale":"2023-10-09T11:42:57.300278+0000","last_undegraded":"2023-10-09T11:42:57.300278+0000","last_fullsized":"2023-10-09T11:42:57.300278+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:06.878711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953391+0000","last_change":"2023-10-09T11:42:56.953140+0000","last_active":"2023-10-09T11:42:56.953391+0000","last_peered":"2023-10-09T11:42:56.953391+0000","last_clean":"2023-10-09T11:42:56.953391+0000","last_became_active":"2023-10-09T11:42:56.951101+0000","last_became_peered":"2023-10-09T11:42:56.951101+0000","last_unstale":"2023-10-09T11:42:56.953391+0000","last_undegraded":"2023-10-09T11:42:56.953391+0000","last_fullsized":"2023-10-09T11:42:56.953391+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:49.651397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"145'1","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.943950+0000","last_change":"2023-10-09T11:42:56.291847+0000","last_active":"2023-10-09T11:42:56.943950+0000","last_peered":"2023-10-09T11:42:56.943950+0000","last_clean":"2023-10-09T11:42:56.943950+0000","last_became_active":"2023-10-09T11:42:56.291547+0000","last_became_peered":"2023-10-09T11:42:56.291547+0000","last_unstale":"2023-10-09T11:42:56.943950+0000","last_undegraded":"2023-10-09T11:42:56.943950+0000","last_fullsized":"2023-10-09T11:42:56.943950+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:21.151652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948162+0000","last_change":"2023-10-09T11:42:56.948162+0000","last_active":"2023-10-09T11:42:56.948162+0000","last_peered":"2023-10-09T11:42:56.948162+0000","last_clean":"2023-10-09T11:42:56.948162+0000","last_became_active":"2023-10-09T11:42:56.947947+0000","last_became_peered":"2023-10-09T11:42:56.947947+0000","last_unstale":"2023-10-09T11:42:56.948162+0000","last_undegraded":"2023-10-09T11:42:56.948162+0000","last_fullsized":"2023-10-09T11:42:56.948162+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.729641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.944200+0000","last_change":"2023-10-09T11:42:56.292614+0000","last_active":"2023-10-09T11:42:56.944200+0000","last_peered":"2023-10-09T11:42:56.944200+0000","last_clean":"2023-10-09T11:42:56.944200+0000","last_became_active":"2023-10-09T11:42:56.292220+0000","last_became_peered":"2023-10-09T11:42:56.292220+0000","last_unstale":"2023-10-09T11:42:56.944200+0000","last_undegraded":"2023-10-09T11:42:56.944200+0000","last_fullsized":"2023-10-09T11:42:56.944200+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:13.914487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947830+0000","last_change":"2023-10-09T11:42:56.947745+0000","last_active":"2023-10-09T11:42:56.947830+0000","last_peered":"2023-10-09T11:42:56.947830+0000","last_clean":"2023-10-09T11:42:56.947830+0000","last_became_active":"2023-10-09T11:42:56.947528+0000","last_became_peered":"2023-10-09T11:42:56.947528+0000","last_unstale":"2023-10-09T11:42:56.947830+0000","last_undegraded":"2023-10-09T11:42:56.947830+0000","last_fullsized":"2023-10-09T11:42:56.947830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:10.998965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.941818+0000","last_change":"2023-10-09T11:42:56.291609+0000","last_active":"2023-10-09T11:42:56.941818+0000","last_peered":"2023-10-09T11:42:56.941818+0000","last_clean":"2023-10-09T11:42:56.941818+0000","last_became_active":"2023-10-09T11:42:56.291225+0000","last_became_peered":"2023-10-09T11:42:56.291225+0000","last_unstale":"2023-10-09T11:42:56.941818+0000","last_undegraded":"2023-10-09T11:42:56.941818+0000","last_fullsized":"2023-10-09T11:42:56.941818+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:20.956274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946048+0000","last_change":"2023-10-09T11:42:56.945703+0000","last_active":"2023-10-09T11:42:56.946048+0000","last_peered":"2023-10-09T11:42:56.946048+0000","last_clean":"2023-10-09T11:42:56.946048+0000","last_became_active":"2023-10-09T11:42:56.945488+0000","last_became_peered":"2023-10-09T11:42:56.945488+0000","last_unstale":"2023-10-09T11:42:56.946048+0000","last_undegraded":"2023-10-09T11:42:56.946048+0000","last_fullsized":"2023-10-09T11:42:56.946048+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.111862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940877+0000","last_change":"2023-10-09T11:42:56.288024+0000","last_active":"2023-10-09T11:42:56.940877+0000","last_peered":"2023-10-09T11:42:56.940877+0000","last_clean":"2023-10-09T11:42:56.940877+0000","last_became_active":"2023-10-09T11:42:56.287520+0000","last_became_peered":"2023-10-09T11:42:56.287520+0000","last_unstale":"2023-10-09T11:42:56.940877+0000","last_undegraded":"2023-10-09T11:42:56.940877+0000","last_fullsized":"2023-10-09T11:42:56.940877+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:22.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950081+0000","last_change":"2023-10-09T11:42:56.948831+0000","last_active":"2023-10-09T11:42:56.950081+0000","last_peered":"2023-10-09T11:42:56.950081+0000","last_clean":"2023-10-09T11:42:56.950081+0000","last_became_active":"2023-10-09T11:42:56.948515+0000","last_became_peered":"2023-10-09T11:42:56.948515+0000","last_unstale":"2023-10-09T11:42:56.950081+0000","last_undegraded":"2023-10-09T11:42:56.950081+0000","last_fullsized":"2023-10-09T11:42:56.950081+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:37.628055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.289426+0000","last_change":"2023-10-09T11:42:56.289144+0000","last_active":"2023-10-09T11:42:56.289426+0000","last_peered":"2023-10-09T11:42:56.289426+0000","last_clean":"2023-10-09T11:42:56.289426+0000","last_became_active":"2023-10-09T11:42:56.288918+0000","last_became_peered":"2023-10-09T11:42:56.288918+0000","last_unstale":"2023-10-09T11:42:56.289426+0000","last_undegraded":"2023-10-09T11:42:56.289426+0000","last_fullsized":"2023-10-09T11:42:56.289426+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.443001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952537+0000","last_change":"2023-10-09T11:42:56.952537+0000","last_active":"2023-10-09T11:42:56.952537+0000","last_peered":"2023-10-09T11:42:56.952537+0000","last_clean":"2023-10-09T11:42:56.952537+0000","last_became_active":"2023-10-09T11:42:56.952287+0000","last_became_peered":"2023-10-09T11:42:56.952287+0000","last_unstale":"2023-10-09T11:42:56.952537+0000","last_undegraded":"2023-10-09T11:42:56.952537+0000","last_fullsized":"2023-10-09T11:42:56.952537+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:16.329960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299928+0000","last_change":"2023-10-09T11:42:56.285518+0000","last_active":"2023-10-09T11:42:57.299928+0000","last_peered":"2023-10-09T11:42:57.299928+0000","last_clean":"2023-10-09T11:42:57.299928+0000","last_became_active":"2023-10-09T11:42:56.285297+0000","last_became_peered":"2023-10-09T11:42:56.285297+0000","last_unstale":"2023-10-09T11:42:57.299928+0000","last_undegraded":"2023-10-09T11:42:57.299928+0000","last_fullsized":"2023-10-09T11:42:57.299928+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:48:21.634482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950932+0000","last_change":"2023-10-09T11:42:56.950932+0000","last_active":"2023-10-09T11:42:56.950932+0000","last_peered":"2023-10-09T11:42:56.950932+0000","last_clean":"2023-10-09T11:42:56.950932+0000","last_became_active":"2023-10-09T11:42:56.950708+0000","last_became_peered":"2023-10-09T11:42:56.950708+0000","last_unstale":"2023-10-09T11:42:56.950932+0000","last_undegraded":"2023-10-09T11:42:56.950932+0000","last_fullsized":"2023-10-09T11:42:56.950932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.172975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"145'6","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300400+0000","last_change":"2023-10-09T11:42:56.291775+0000","last_active":"2023-10-09T11:42:57.300400+0000","last_peered":"2023-10-09T11:42:57.300400+0000","last_clean":"2023-10-09T11:42:57.300400+0000","last_became_active":"2023-10-09T11:42:56.291353+0000","last_became_peered":"2023-10-09T11:42:56.291353+0000","last_unstale":"2023-10-09T11:42:57.300400+0000","last_undegraded":"2023-10-09T11:42:57.300400+0000","last_fullsized":"2023-10-09T11:42:57.300400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:09.994682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946844+0000","last_change":"2023-10-09T11:42:56.946715+0000","last_active":"2023-10-09T11:42:56.946844+0000","last_peered":"2023-10-09T11:42:56.946844+0000","last_clean":"2023-10-09T11:42:56.946844+0000","last_became_active":"2023-10-09T11:42:56.946482+0000","last_became_peered":"2023-10-09T11:42:56.946482+0000","last_unstale":"2023-10-09T11:42:56.946844+0000","last_undegraded":"2023-10-09T11:42:56.946844+0000","last_fullsized":"2023-10-09T11:42:56.946844+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.359933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.941166+0000","last_change":"2023-10-09T11:42:56.289106+0000","last_active":"2023-10-09T11:42:56.941166+0000","last_peered":"2023-10-09T11:42:56.941166+0000","last_clean":"2023-10-09T11:42:56.941166+0000","last_became_active":"2023-10-09T11:42:56.288088+0000","last_became_peered":"2023-10-09T11:42:56.288088+0000","last_unstale":"2023-10-09T11:42:56.941166+0000","last_undegraded":"2023-10-09T11:42:56.941166+0000","last_fullsized":"2023-10-09T11:42:56.941166+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:42.270465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950166+0000","last_change":"2023-10-09T11:42:56.950056+0000","last_active":"2023-10-09T11:42:56.950166+0000","last_peered":"2023-10-09T11:42:56.950166+0000","last_clean":"2023-10-09T11:42:56.950166+0000","last_became_active":"2023-10-09T11:42:56.949836+0000","last_became_peered":"2023-10-09T11:42:56.949836+0000","last_unstale":"2023-10-09T11:42:56.950166+0000","last_undegraded":"2023-10-09T11:42:56.950166+0000","last_fullsized":"2023-10-09T11:42:56.950166+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:42.084527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940175+0000","last_change":"2023-10-09T11:42:56.293885+0000","last_active":"2023-10-09T11:42:56.940175+0000","last_peered":"2023-10-09T11:42:56.940175+0000","last_clean":"2023-10-09T11:42:56.940175+0000","last_became_active":"2023-10-09T11:42:56.293654+0000","last_became_peered":"2023-10-09T11:42:56.293654+0000","last_unstale":"2023-10-09T11:42:56.940175+0000","last_undegraded":"2023-10-09T11:42:56.940175+0000","last_fullsized":"2023-10-09T11:42:56.940175+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:31.860550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952897+0000","last_change":"2023-10-09T11:42:56.952897+0000","last_active":"2023-10-09T11:42:56.952897+0000","last_peered":"2023-10-09T11:42:56.952897+0000","last_clean":"2023-10-09T11:42:56.952897+0000","last_became_active":"2023-10-09T11:42:56.951367+0000","last_became_peered":"2023-10-09T11:42:56.951367+0000","last_unstale":"2023-10-09T11:42:56.952897+0000","last_undegraded":"2023-10-09T11:42:56.952897+0000","last_fullsized":"2023-10-09T11:42:56.952897+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:50.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"145'8","reported_seq":17,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.302588+0000","last_change":"2023-10-09T11:42:56.294006+0000","last_active":"2023-10-09T11:42:57.302588+0000","last_peered":"2023-10-09T11:42:57.302588+0000","last_clean":"2023-10-09T11:42:57.302588+0000","last_became_active":"2023-10-09T11:42:56.293297+0000","last_became_peered":"2023-10-09T11:42:56.293297+0000","last_unstale":"2023-10-09T11:42:57.302588+0000","last_undegraded":"2023-10-09T11:42:57.302588+0000","last_fullsized":"2023-10-09T11:42:57.302588+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:22.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953715+0000","last_change":"2023-10-09T11:42:56.953715+0000","last_active":"2023-10-09T11:42:56.953715+0000","last_peered":"2023-10-09T11:42:56.953715+0000","last_clean":"2023-10-09T11:42:56.953715+0000","last_became_active":"2023-10-09T11:42:56.953335+0000","last_became_peered":"2023-10-09T11:42:56.953335+0000","last_unstale":"2023-10-09T11:42:56.953715+0000","last_undegraded":"2023-10-09T11:42:56.953715+0000","last_fullsized":"2023-10-09T11:42:56.953715+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:15.965910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299268+0000","last_change":"2023-10-09T11:42:56.290349+0000","last_active":"2023-10-09T11:42:57.299268+0000","last_peered":"2023-10-09T11:42:57.299268+0000","last_clean":"2023-10-09T11:42:57.299268+0000","last_became_active":"2023-10-09T11:42:56.290070+0000","last_became_peered":"2023-10-09T11:42:56.290070+0000","last_unstale":"2023-10-09T11:42:57.299268+0000","last_undegraded":"2023-10-09T11:42:57.299268+0000","last_fullsized":"2023-10-09T11:42:57.299268+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:05.324637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950028+0000","last_change":"2023-10-09T11:42:56.947737+0000","last_active":"2023-10-09T11:42:56.950028+0000","last_peered":"2023-10-09T11:42:56.950028+0000","last_clean":"2023-10-09T11:42:56.950028+0000","last_became_active":"2023-10-09T11:42:56.946920+0000","last_became_peered":"2023-10-09T11:42:56.946920+0000","last_unstale":"2023-10-09T11:42:56.950028+0000","last_undegraded":"2023-10-09T11:42:56.950028+0000","last_fullsized":"2023-10-09T11:42:56.950028+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:04.360514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299889+0000","last_change":"2023-10-09T11:42:56.294064+0000","last_active":"2023-10-09T11:42:57.299889+0000","last_peered":"2023-10-09T11:42:57.299889+0000","last_clean":"2023-10-09T11:42:57.299889+0000","last_became_active":"2023-10-09T11:42:56.293839+0000","last_became_peered":"2023-10-09T11:42:56.293839+0000","last_unstale":"2023-10-09T11:42:57.299889+0000","last_undegraded":"2023-10-09T11:42:57.299889+0000","last_fullsized":"2023-10-09T11:42:57.299889+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:15.865641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945652+0000","last_change":"2023-10-09T11:42:56.945652+0000","last_active":"2023-10-09T11:42:56.945652+0000","last_peered":"2023-10-09T11:42:56.945652+0000","last_clean":"2023-10-09T11:42:56.945652+0000","last_became_active":"2023-10-09T11:42:56.945418+0000","last_became_peered":"2023-10-09T11:42:56.945418+0000","last_unstale":"2023-10-09T11:42:56.945652+0000","last_undegraded":"2023-10-09T11:42:56.945652+0000","last_fullsized":"2023-10-09T11:42:56.945652+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:30.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300427+0000","last_change":"2023-10-09T11:42:56.288874+0000","last_active":"2023-10-09T11:42:57.300427+0000","last_peered":"2023-10-09T11:42:57.300427+0000","last_clean":"2023-10-09T11:42:57.300427+0000","last_became_active":"2023-10-09T11:42:56.288401+0000","last_became_peered":"2023-10-09T11:42:56.288401+0000","last_unstale":"2023-10-09T11:42:57.300427+0000","last_undegraded":"2023-10-09T11:42:57.300427+0000","last_fullsized":"2023-10-09T11:42:57.300427+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:49.814752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947814+0000","last_change":"2023-10-09T11:42:56.947655+0000","last_active":"2023-10-09T11:42:56.947814+0000","last_peered":"2023-10-09T11:42:56.947814+0000","last_clean":"2023-10-09T11:42:56.947814+0000","last_became_active":"2023-10-09T11:42:56.947426+0000","last_became_peered":"2023-10-09T11:42:56.947426+0000","last_unstale":"2023-10-09T11:42:56.947814+0000","last_undegraded":"2023-10-09T11:42:56.947814+0000","last_fullsized":"2023-10-09T11:42:56.947814+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:30.452749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940234+0000","last_change":"2023-10-09T11:42:56.286028+0000","last_active":"2023-10-09T11:42:56.940234+0000","last_peered":"2023-10-09T11:42:56.940234+0000","last_clean":"2023-10-09T11:42:56.940234+0000","last_became_active":"2023-10-09T11:42:56.285703+0000","last_became_peered":"2023-10-09T11:42:56.285703+0000","last_unstale":"2023-10-09T11:42:56.940234+0000","last_undegraded":"2023-10-09T11:42:56.940234+0000","last_fullsized":"2023-10-09T11:42:56.940234+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:09.994682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945112+0000","last_change":"2023-10-09T11:42:56.945025+0000","last_active":"2023-10-09T11:42:56.945112+0000","last_peered":"2023-10-09T11:42:56.945112+0000","last_clean":"2023-10-09T11:42:56.945112+0000","last_became_active":"2023-10-09T11:42:56.944797+0000","last_became_peered":"2023-10-09T11:42:56.944797+0000","last_unstale":"2023-10-09T11:42:56.945112+0000","last_undegraded":"2023-10-09T11:42:56.945112+0000","last_fullsized":"2023-10-09T11:42:56.945112+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:01.839893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300116+0000","last_change":"2023-10-09T11:42:56.282577+0000","last_active":"2023-10-09T11:42:57.300116+0000","last_peered":"2023-10-09T11:42:57.300116+0000","last_clean":"2023-10-09T11:42:57.300116+0000","last_became_active":"2023-10-09T11:42:56.282301+0000","last_became_peered":"2023-10-09T11:42:56.282301+0000","last_unstale":"2023-10-09T11:42:57.300116+0000","last_undegraded":"2023-10-09T11:42:57.300116+0000","last_fullsized":"2023-10-09T11:42:57.300116+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:47.076996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948579+0000","last_change":"2023-10-09T11:42:56.948510+0000","last_active":"2023-10-09T11:42:56.948579+0000","last_peered":"2023-10-09T11:42:56.948579+0000","last_clean":"2023-10-09T11:42:56.948579+0000","last_became_active":"2023-10-09T11:42:56.948075+0000","last_became_peered":"2023-10-09T11:42:56.948075+0000","last_unstale":"2023-10-09T11:42:56.948579+0000","last_undegraded":"2023-10-09T11:42:56.948579+0000","last_fullsized":"2023-10-09T11:42:56.948579+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:30.037690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293369+0000","last_change":"2023-10-09T11:42:56.293301+0000","last_active":"2023-10-09T11:42:56.293369+0000","last_peered":"2023-10-09T11:42:56.293369+0000","last_clean":"2023-10-09T11:42:56.293369+0000","last_became_active":"2023-10-09T11:42:56.293139+0000","last_became_peered":"2023-10-09T11:42:56.293139+0000","last_unstale":"2023-10-09T11:42:56.293369+0000","last_undegraded":"2023-10-09T11:42:56.293369+0000","last_fullsized":"2023-10-09T11:42:56.293369+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:05.214465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947309+0000","last_change":"2023-10-09T11:42:56.947202+0000","last_active":"2023-10-09T11:42:56.947309+0000","last_peered":"2023-10-09T11:42:56.947309+0000","last_clean":"2023-10-09T11:42:56.947309+0000","last_became_active":"2023-10-09T11:42:56.946816+0000","last_became_peered":"2023-10-09T11:42:56.946816+0000","last_unstale":"2023-10-09T11:42:56.947309+0000","last_undegraded":"2023-10-09T11:42:56.947309+0000","last_fullsized":"2023-10-09T11:42:56.947309+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:04.159373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.288759+0000","last_change":"2023-10-09T11:42:56.288691+0000","last_active":"2023-10-09T11:42:56.288759+0000","last_peered":"2023-10-09T11:42:56.288759+0000","last_clean":"2023-10-09T11:42:56.288759+0000","last_became_active":"2023-10-09T11:42:56.288300+0000","last_became_peered":"2023-10-09T11:42:56.288300+0000","last_unstale":"2023-10-09T11:42:56.288759+0000","last_undegraded":"2023-10-09T11:42:56.288759+0000","last_fullsized":"2023-10-09T11:42:56.288759+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:33.261539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952293+0000","last_change":"2023-10-09T11:42:56.952293+0000","last_active":"2023-10-09T11:42:56.952293+0000","last_peered":"2023-10-09T11:42:56.952293+0000","last_clean":"2023-10-09T11:42:56.952293+0000","last_became_active":"2023-10-09T11:42:56.951873+0000","last_became_peered":"2023-10-09T11:42:56.951873+0000","last_unstale":"2023-10-09T11:42:56.952293+0000","last_undegraded":"2023-10-09T11:42:56.952293+0000","last_fullsized":"2023-10-09T11:42:56.952293+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:30.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.291943+0000","last_change":"2023-10-09T11:42:56.291882+0000","last_active":"2023-10-09T11:42:56.291943+0000","last_peered":"2023-10-09T11:42:56.291943+0000","last_clean":"2023-10-09T11:42:56.291943+0000","last_became_active":"2023-10-09T11:42:56.291669+0000","last_became_peered":"2023-10-09T11:42:56.291669+0000","last_unstale":"2023-10-09T11:42:56.291943+0000","last_undegraded":"2023-10-09T11:42:56.291943+0000","last_fullsized":"2023-10-09T11:42:56.291943+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:58.578858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950361+0000","last_change":"2023-10-09T11:42:56.950234+0000","last_active":"2023-10-09T11:42:56.950361+0000","last_peered":"2023-10-09T11:42:56.950361+0000","last_clean":"2023-10-09T11:42:56.950361+0000","last_became_active":"2023-10-09T11:42:56.949990+0000","last_became_peered":"2023-10-09T11:42:56.949990+0000","last_unstale":"2023-10-09T11:42:56.950361+0000","last_undegraded":"2023-10-09T11:42:56.950361+0000","last_fullsized":"2023-10-09T11:42:56.950361+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:30.834427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300671+0000","last_change":"2023-10-09T11:42:56.283322+0000","last_active":"2023-10-09T11:42:57.300671+0000","last_peered":"2023-10-09T11:42:57.300671+0000","last_clean":"2023-10-09T11:42:57.300671+0000","last_became_active":"2023-10-09T11:42:56.283066+0000","last_became_peered":"2023-10-09T11:42:56.283066+0000","last_unstale":"2023-10-09T11:42:57.300671+0000","last_undegraded":"2023-10-09T11:42:57.300671+0000","last_fullsized":"2023-10-09T11:42:57.300671+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:19.661105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950098+0000","last_change":"2023-10-09T11:42:56.950041+0000","last_active":"2023-10-09T11:42:56.950098+0000","last_peered":"2023-10-09T11:42:56.950098+0000","last_clean":"2023-10-09T11:42:56.950098+0000","last_became_active":"2023-10-09T11:42:56.949510+0000","last_became_peered":"2023-10-09T11:42:56.949510+0000","last_unstale":"2023-10-09T11:42:56.950098+0000","last_undegraded":"2023-10-09T11:42:56.950098+0000","last_fullsized":"2023-10-09T11:42:56.950098+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.693991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293284+0000","last_change":"2023-10-09T11:42:56.293169+0000","last_active":"2023-10-09T11:42:56.293284+0000","last_peered":"2023-10-09T11:42:56.293284+0000","last_clean":"2023-10-09T11:42:56.293284+0000","last_became_active":"2023-10-09T11:42:56.292706+0000","last_became_peered":"2023-10-09T11:42:56.292706+0000","last_unstale":"2023-10-09T11:42:56.293284+0000","last_undegraded":"2023-10-09T11:42:56.293284+0000","last_fullsized":"2023-10-09T11:42:56.293284+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:16.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952668+0000","last_change":"2023-10-09T11:42:56.952606+0000","last_active":"2023-10-09T11:42:56.952668+0000","last_peered":"2023-10-09T11:42:56.952668+0000","last_clean":"2023-10-09T11:42:56.952668+0000","last_became_active":"2023-10-09T11:42:56.952018+0000","last_became_peered":"2023-10-09T11:42:56.952018+0000","last_unstale":"2023-10-09T11:42:56.952668+0000","last_undegraded":"2023-10-09T11:42:56.952668+0000","last_fullsized":"2023-10-09T11:42:56.952668+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:54.402662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940394+0000","last_change":"2023-10-09T11:42:56.291438+0000","last_active":"2023-10-09T11:42:56.940394+0000","last_peered":"2023-10-09T11:42:56.940394+0000","last_clean":"2023-10-09T11:42:56.940394+0000","last_became_active":"2023-10-09T11:42:56.291209+0000","last_became_peered":"2023-10-09T11:42:56.291209+0000","last_unstale":"2023-10-09T11:42:56.940394+0000","last_undegraded":"2023-10-09T11:42:56.940394+0000","last_fullsized":"2023-10-09T11:42:56.940394+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:17.982641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947440+0000","last_change":"2023-10-09T11:42:56.947334+0000","last_active":"2023-10-09T11:42:56.947440+0000","last_peered":"2023-10-09T11:42:56.947440+0000","last_clean":"2023-10-09T11:42:56.947440+0000","last_became_active":"2023-10-09T11:42:56.946950+0000","last_became_peered":"2023-10-09T11:42:56.946950+0000","last_unstale":"2023-10-09T11:42:56.947440+0000","last_undegraded":"2023-10-09T11:42:56.947440+0000","last_fullsized":"2023-10-09T11:42:56.947440+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:06.218748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.291275+0000","last_change":"2023-10-09T11:42:56.290789+0000","last_active":"2023-10-09T11:42:56.291275+0000","last_peered":"2023-10-09T11:42:56.291275+0000","last_clean":"2023-10-09T11:42:56.291275+0000","last_became_active":"2023-10-09T11:42:56.290505+0000","last_became_peered":"2023-10-09T11:42:56.290505+0000","last_unstale":"2023-10-09T11:42:56.291275+0000","last_undegraded":"2023-10-09T11:42:56.291275+0000","last_fullsized":"2023-10-09T11:42:56.291275+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:38.245509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949543+0000","last_change":"2023-10-09T11:42:56.949543+0000","last_active":"2023-10-09T11:42:56.949543+0000","last_peered":"2023-10-09T11:42:56.949543+0000","last_clean":"2023-10-09T11:42:56.949543+0000","last_became_active":"2023-10-09T11:42:56.949308+0000","last_became_peered":"2023-10-09T11:42:56.949308+0000","last_unstale":"2023-10-09T11:42:56.949543+0000","last_undegraded":"2023-10-09T11:42:56.949543+0000","last_fullsized":"2023-10-09T11:42:56.949543+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:30.025220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.942649+0000","last_change":"2023-10-09T11:42:56.292043+0000","last_active":"2023-10-09T11:42:56.942649+0000","last_peered":"2023-10-09T11:42:56.942649+0000","last_clean":"2023-10-09T11:42:56.942649+0000","last_became_active":"2023-10-09T11:42:56.291867+0000","last_became_peered":"2023-10-09T11:42:56.291867+0000","last_unstale":"2023-10-09T11:42:56.942649+0000","last_undegraded":"2023-10-09T11:42:56.942649+0000","last_fullsized":"2023-10-09T11:42:56.942649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:53.875841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946911+0000","last_change":"2023-10-09T11:42:56.944879+0000","last_active":"2023-10-09T11:42:56.946911+0000","last_peered":"2023-10-09T11:42:56.946911+0000","last_clean":"2023-10-09T11:42:56.946911+0000","last_became_active":"2023-10-09T11:42:56.944603+0000","last_became_peered":"2023-10-09T11:42:56.944603+0000","last_unstale":"2023-10-09T11:42:56.946911+0000","last_undegraded":"2023-10-09T11:42:56.946911+0000","last_fullsized":"2023-10-09T11:42:56.946911+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:33.897751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.292690+0000","last_change":"2023-10-09T11:42:56.292340+0000","last_active":"2023-10-09T11:42:56.292690+0000","last_peered":"2023-10-09T11:42:56.292690+0000","last_clean":"2023-10-09T11:42:56.292690+0000","last_became_active":"2023-10-09T11:42:56.292084+0000","last_became_peered":"2023-10-09T11:42:56.292084+0000","last_unstale":"2023-10-09T11:42:56.292690+0000","last_undegraded":"2023-10-09T11:42:56.292690+0000","last_fullsized":"2023-10-09T11:42:56.292690+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:21.151652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946460+0000","last_change":"2023-10-09T11:42:56.946460+0000","last_active":"2023-10-09T11:42:56.946460+0000","last_peered":"2023-10-09T11:42:56.946460+0000","last_clean":"2023-10-09T11:42:56.946460+0000","last_became_active":"2023-10-09T11:42:56.945945+0000","last_became_peered":"2023-10-09T11:42:56.945945+0000","last_unstale":"2023-10-09T11:42:56.946460+0000","last_undegraded":"2023-10-09T11:42:56.946460+0000","last_fullsized":"2023-10-09T11:42:56.946460+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:30.025220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293149+0000","last_change":"2023-10-09T11:42:56.293040+0000","last_active":"2023-10-09T11:42:56.293149+0000","last_peered":"2023-10-09T11:42:56.293149+0000","last_clean":"2023-10-09T11:42:56.293149+0000","last_became_active":"2023-10-09T11:42:56.292793+0000","last_became_peered":"2023-10-09T11:42:56.292793+0000","last_unstale":"2023-10-09T11:42:56.293149+0000","last_undegraded":"2023-10-09T11:42:56.293149+0000","last_fullsized":"2023-10-09T11:42:56.293149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:29.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947178+0000","last_change":"2023-10-09T11:42:56.947114+0000","last_active":"2023-10-09T11:42:56.947178+0000","last_peered":"2023-10-09T11:42:56.947178+0000","last_clean":"2023-10-09T11:42:56.947178+0000","last_became_active":"2023-10-09T11:42:56.946877+0000","last_became_peered":"2023-10-09T11:42:56.946877+0000","last_unstale":"2023-10-09T11:42:56.947178+0000","last_undegraded":"2023-10-09T11:42:56.947178+0000","last_fullsized":"2023-10-09T11:42:56.947178+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:39.839279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.290063+0000","last_change":"2023-10-09T11:42:56.289995+0000","last_active":"2023-10-09T11:42:56.290063+0000","last_peered":"2023-10-09T11:42:56.290063+0000","last_clean":"2023-10-09T11:42:56.290063+0000","last_became_active":"2023-10-09T11:42:56.289770+0000","last_became_peered":"2023-10-09T11:42:56.289770+0000","last_unstale":"2023-10-09T11:42:56.290063+0000","last_undegraded":"2023-10-09T11:42:56.290063+0000","last_fullsized":"2023-10-09T11:42:56.290063+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:50.495963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950168+0000","last_change":"2023-10-09T11:42:56.950168+0000","last_active":"2023-10-09T11:42:56.950168+0000","last_peered":"2023-10-09T11:42:56.950168+0000","last_clean":"2023-10-09T11:42:56.950168+0000","last_became_active":"2023-10-09T11:42:56.949813+0000","last_became_peered":"2023-10-09T11:42:56.949813+0000","last_unstale":"2023-10-09T11:42:56.950168+0000","last_undegraded":"2023-10-09T11:42:56.950168+0000","last_fullsized":"2023-10-09T11:42:56.950168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:39.249792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299773+0000","last_change":"2023-10-09T11:42:56.294858+0000","last_active":"2023-10-09T11:42:57.299773+0000","last_peered":"2023-10-09T11:42:57.299773+0000","last_clean":"2023-10-09T11:42:57.299773+0000","last_became_active":"2023-10-09T11:42:56.294675+0000","last_became_peered":"2023-10-09T11:42:56.294675+0000","last_unstale":"2023-10-09T11:42:57.299773+0000","last_undegraded":"2023-10-09T11:42:57.299773+0000","last_fullsized":"2023-10-09T11:42:57.299773+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:33.261539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":267,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.289445+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:42:56.289445+0000","last_peered":"2023-10-09T11:42:56.289445+0000","last_clean":"2023-10-09T11:42:56.289445+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:42:56.289445+0000","last_undegraded":"2023-10-09T11:42:56.289445+0000","last_fullsized":"2023-10-09T11:42:56.289445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193950,"statfs":{"total":200000000,"available":198605470,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.745},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.79200000000000004,"15min":0.878},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69999999999999996,"5min":0.72699999999999998,"15min":0.88900000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.90200000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":1.048},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.079},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.42899999999999999},"min":{"1min":0.33400000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.441}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.87,"15min":0.92700000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199196448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53500000000000003,"15min":0.61599999999999999},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":3.7589999999999999},"last":0.504},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.66200000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.67400000000000004},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72999999999999998,"5min":0.77900000000000003,"15min":5.298},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64800000000000002,"5min":0.73399999999999999,"15min":5.3540000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":1.6060000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":1.617},"last":0.73699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":5.46},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":5.3949999999999996},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.80600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76000000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48499999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64700000000000002,"5min":0.72599999999999998,"15min":0.80000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34200000000000003,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46700000000000003,"5min":0.623,"15min":1.9370000000000001},"last":0.37},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.37,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.66500000000000004,"15min":2.004},"last":0.246}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.501,"5min":0.64000000000000001,"15min":2.2589999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40799999999999997,"15min":0.40899999999999997},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57299999999999995,"5min":0.77000000000000002,"15min":1.909},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41399999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51000000000000001,"5min":0.78200000000000003,"15min":2.0369999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":0.872,"15min":1.869},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.93000000000000005,"15min":1.9790000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.91400000000000003,"15min":2.1960000000000002},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.66000000000000003},"min":{"1min":0.46000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":1.952},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.94999999999999996,"15min":2.2280000000000002},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.86299999999999999,"15min":1.782},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":1.819},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193953,"statfs":{"total":200000000,"available":198608627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45000000000000001,"15min":0.41499999999999998},"min":{"1min":0.23899999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22},"max":{"1min":0.53300000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.223},"max":{"1min":0.63400000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42199999999999999,"15min":0.5},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55900000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.371},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":2.194,"15min":2.194},"last":0.39300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.86799999999999999,"5min":1.508,"15min":1.508},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85499999999999998,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63400000000000001,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":2.379,"15min":3.976},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.93300000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.95999999999999996,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.593,"15min":1.593},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68899999999999995,"15min":0.76700000000000002},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.91600000000000004,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197396,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36699999999999999,"15min":0.32600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.622,"15min":0.622},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38400000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35499999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.61899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41699999999999998,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":11.055},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.39900000000000002},"min":{"1min":0.307,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.627,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.999,"15min":0.999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":1.097,"15min":1.097},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.96499999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93100000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.442,"5min":0.64800000000000002,"15min":1.3069999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.55400000000000005,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.313}]},{"osd":1,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51100000000000001,"5min":0.57399999999999995,"15min":1.034},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.72899999999999998,"15min":1.335},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.68999999999999995,"15min":1.1200000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61399999999999999,"5min":0.69499999999999995,"15min":1.405},"last":0.33300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73599999999999999,"5min":0.91100000000000003,"15min":0.98399999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":1.387,"15min":1.387},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.96399999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.3819999999999999},"last":0.46899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":1.0109999999999999},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":789,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199191626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54600000000000004,"15min":0.73699999999999999},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":7.4210000000000003},"last":0.442},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":5.274},"last":0.51400000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.80400000000000005},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":7.5460000000000003},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":1.2729999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.379,"5min":0.31,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.751,"15min":0.75600000000000001},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.501},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":1.1839999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.67900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68600000000000005,"5min":0.84199999999999997,"15min":0.96399999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.86899999999999999,"15min":0.98899999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.88500000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.747,"15min":0.78000000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.43099999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81499999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T11:43:01.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:43:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.550+0000 7f50ab947700 1 Processor -- start 2023-10-09T11:43:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.551+0000 7f50ab947700 1 -- start start 2023-10-09T11:43:01.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.551+0000 7f50ab947700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50a41578d0 0x7f50a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.551+0000 7f50ab947700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40d07c0 con 0x7f50a406d120 2023-10-09T11:43:01.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.551+0000 7f50ab947700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a40cfbb0 con 0x7f50a4157ca0 2023-10-09T11:43:01.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.551+0000 7f50ab947700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a40cfe90 con 0x7f50a41578d0 2023-10-09T11:43:01.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a96e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50a41578d0 0x7f50a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a9ee4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f50a406d120 0x7f50a406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42524/0 (socket says 172.21.15.6:42524) 2023-10-09T11:43:01.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a9ee4700 1 -- 172.21.15.6:0/799984403 learned_addr learned my addr 172.21.15.6:0/799984403 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a96e3700 1 -- 172.21.15.6:0/799984403 >> v1:172.21.15.118:6789/0 conn(0x7f50a4157ca0 legacy=0x7f50a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a96e3700 1 -- 172.21.15.6:0/799984403 >> v1:172.21.15.6:6789/0 conn(0x7f50a406d120 legacy=0x7f50a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a96e3700 1 -- 172.21.15.6:0/799984403 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40d0170 con 0x7f50a41578d0 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a3fff700 1 -- 172.21.15.6:0/799984403 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002564323 0 0) 0x7f50a40d07c0 con 0x7f50a406d120 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a96e3700 1 --2- 172.21.15.6:0/799984403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a41578d0 0x7f50a40cf4f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5094009e60 tx=0x7f5094009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b93ebe34a8b85f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a3fff700 1 -- 172.21.15.6:0/799984403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400e070 con 0x7f50a41578d0 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a3fff700 1 -- 172.21.15.6:0/799984403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400bbf0 con 0x7f50a41578d0 2023-10-09T11:43:01.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.552+0000 7f50a3fff700 1 -- 172.21.15.6:0/799984403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094012430 con 0x7f50a41578d0 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 -- 172.21.15.6:0/799984403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a41578d0 msgr2=0x7f50a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 --2- 172.21.15.6:0/799984403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a41578d0 0x7f50a40cf4f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5094009e60 tx=0x7f5094009780 comp rx=0 tx=0).stop 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 -- 172.21.15.6:0/799984403 shutdown_connections 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 --2- 172.21.15.6:0/799984403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a41578d0 0x7f50a40cf4f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 -- 172.21.15.6:0/799984403 >> 172.21.15.6:0/799984403 conn(0x7f50a406bb90 msgr2=0x7f50a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 -- 172.21.15.6:0/799984403 shutdown_connections 2023-10-09T11:43:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.553+0000 7f50ab947700 1 -- 172.21.15.6:0/799984403 wait complete. 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.554+0000 7f50ab947700 1 Processor -- start 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.554+0000 7f50ab947700 1 -- start start 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50a406d120 0x7f50a40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50a41578d0 0x7f50a40c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40b5b40 con 0x7f50a4157ca0 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40b4f30 con 0x7f50a41578d0 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50ab947700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40b5210 con 0x7f50a406d120 2023-10-09T11:43:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37830/0 (socket says 172.21.15.6:37830) 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 -- 172.21.15.6:0/99180186 learned_addr learned my addr 172.21.15.6:0/99180186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a96e3700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50a406d120 0x7f50a40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a8ee2700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50a41578d0 0x7f50a40c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 -- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50a406d120 msgr2=0x7f50a40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50a406d120 0x7f50a40b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 -- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50a41578d0 msgr2=0x7f50a40c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50a41578d0 0x7f50a40c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 -- 172.21.15.6:0/99180186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009a20 con 0x7f50a4157ca0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.555+0000 7f50a9ee4700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f509c0011e0 tx=0x7f509c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c005b30 con 0x7f50a4157ca0 2023-10-09T11:43:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c005c90 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a40b54f0 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c007320 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a40b6510 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.556+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a4067ac0 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.557+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f509c007690 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.557+0000 7f50a17fa700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 0x7f50900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.557+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f509c0839e0 con 0x7f50a4157ca0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.557+0000 7f50a96e3700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 0x7f50900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.558+0000 7f50a96e3700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 0x7f50900693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f50940097c0 tx=0x7f5094018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.562+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f509c050bc0 con 0x7f50a4157ca0 2023-10-09T11:43:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.750+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50a40d0450 con 0x7f5090066f30 2023-10-09T11:43:01.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.758+0000 7f50a17fa700 1 -- 172.21.15.6:0/99180186 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285733 (secure 0 0 0) 0x7f50a40d0450 con 0x7f5090066f30 2023-10-09T11:43:01.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.760+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 msgr2=0x7f50900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.760+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 0x7f50900693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f50940097c0 tx=0x7f5094018000 comp rx=0 tx=0).stop 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.760+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 msgr2=0x7f50a416a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.760+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f509c0011e0 tx=0x7f509c007d30 comp rx=0 tx=0).stop 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 shutdown_connections 2023-10-09T11:43:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5090066f30 0x7f50900693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50a4157ca0 0x7f50a416a660 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f50a406d120 0x7f50a40b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 --2- 172.21.15.6:0/99180186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50a41578d0 0x7f50a40c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 >> 172.21.15.6:0/99180186 conn(0x7f50a406bb90 msgr2=0x7f50a4154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 shutdown_connections 2023-10-09T11:43:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.761+0000 7f50ab947700 1 -- 172.21.15.6:0/99180186 wait complete. 2023-10-09T11:43:01.767 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:43:01.774 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-10-09T11:43:00.235452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555071,"statfs":{"total":1600000000,"available":1592393247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.957538"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951367+0000","last_change":"2023-10-09T11:42:56.951288+0000","last_active":"2023-10-09T11:42:56.951367+0000","last_peered":"2023-10-09T11:42:56.951367+0000","last_clean":"2023-10-09T11:42:56.951367+0000","last_became_active":"2023-10-09T11:42:56.951070+0000","last_became_peered":"2023-10-09T11:42:56.951070+0000","last_unstale":"2023-10-09T11:42:56.951367+0000","last_undegraded":"2023-10-09T11:42:56.951367+0000","last_fullsized":"2023-10-09T11:42:56.951367+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:18.686630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948689+0000","last_change":"2023-10-09T11:42:56.948625+0000","last_active":"2023-10-09T11:42:56.948689+0000","last_peered":"2023-10-09T11:42:56.948689+0000","last_clean":"2023-10-09T11:42:56.948689+0000","last_became_active":"2023-10-09T11:42:56.948367+0000","last_became_peered":"2023-10-09T11:42:56.948367+0000","last_unstale":"2023-10-09T11:42:56.948689+0000","last_undegraded":"2023-10-09T11:42:56.948689+0000","last_fullsized":"2023-10-09T11:42:56.948689+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:48.081279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951711+0000","last_change":"2023-10-09T11:42:56.951711+0000","last_active":"2023-10-09T11:42:56.951711+0000","last_peered":"2023-10-09T11:42:56.951711+0000","last_clean":"2023-10-09T11:42:56.951711+0000","last_became_active":"2023-10-09T11:42:56.950403+0000","last_became_peered":"2023-10-09T11:42:56.950403+0000","last_unstale":"2023-10-09T11:42:56.951711+0000","last_undegraded":"2023-10-09T11:42:56.951711+0000","last_fullsized":"2023-10-09T11:42:56.951711+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:49.651397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951629+0000","last_change":"2023-10-09T11:42:56.951571+0000","last_active":"2023-10-09T11:42:56.951629+0000","last_peered":"2023-10-09T11:42:56.951629+0000","last_clean":"2023-10-09T11:42:56.951629+0000","last_became_active":"2023-10-09T11:42:56.951162+0000","last_became_peered":"2023-10-09T11:42:56.951162+0000","last_unstale":"2023-10-09T11:42:56.951629+0000","last_undegraded":"2023-10-09T11:42:56.951629+0000","last_fullsized":"2023-10-09T11:42:56.951629+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:12.805043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953237+0000","last_change":"2023-10-09T11:42:56.953237+0000","last_active":"2023-10-09T11:42:56.953237+0000","last_peered":"2023-10-09T11:42:56.953237+0000","last_clean":"2023-10-09T11:42:56.953237+0000","last_became_active":"2023-10-09T11:42:56.953017+0000","last_became_peered":"2023-10-09T11:42:56.953017+0000","last_unstale":"2023-10-09T11:42:56.953237+0000","last_undegraded":"2023-10-09T11:42:56.953237+0000","last_fullsized":"2023-10-09T11:42:56.953237+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:16.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951808+0000","last_change":"2023-10-09T11:42:56.951664+0000","last_active":"2023-10-09T11:42:56.951808+0000","last_peered":"2023-10-09T11:42:56.951808+0000","last_clean":"2023-10-09T11:42:56.951808+0000","last_became_active":"2023-10-09T11:42:56.951392+0000","last_became_peered":"2023-10-09T11:42:56.951392+0000","last_unstale":"2023-10-09T11:42:56.951808+0000","last_undegraded":"2023-10-09T11:42:56.951808+0000","last_fullsized":"2023-10-09T11:42:56.951808+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:22.155935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953974+0000","last_change":"2023-10-09T11:42:56.953807+0000","last_active":"2023-10-09T11:42:56.953974+0000","last_peered":"2023-10-09T11:42:56.953974+0000","last_clean":"2023-10-09T11:42:56.953974+0000","last_became_active":"2023-10-09T11:42:56.952676+0000","last_became_peered":"2023-10-09T11:42:56.952676+0000","last_unstale":"2023-10-09T11:42:56.953974+0000","last_undegraded":"2023-10-09T11:42:56.953974+0000","last_fullsized":"2023-10-09T11:42:56.953974+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:34.265822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954710+0000","last_change":"2023-10-09T11:42:56.954710+0000","last_active":"2023-10-09T11:42:56.954710+0000","last_peered":"2023-10-09T11:42:56.954710+0000","last_clean":"2023-10-09T11:42:56.954710+0000","last_became_active":"2023-10-09T11:42:56.951173+0000","last_became_peered":"2023-10-09T11:42:56.951173+0000","last_unstale":"2023-10-09T11:42:56.954710+0000","last_undegraded":"2023-10-09T11:42:56.954710+0000","last_fullsized":"2023-10-09T11:42:56.954710+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:17.571112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954453+0000","last_change":"2023-10-09T11:42:56.954453+0000","last_active":"2023-10-09T11:42:56.954453+0000","last_peered":"2023-10-09T11:42:56.954453+0000","last_clean":"2023-10-09T11:42:56.954453+0000","last_became_active":"2023-10-09T11:42:56.954231+0000","last_became_peered":"2023-10-09T11:42:56.954231+0000","last_unstale":"2023-10-09T11:42:56.954453+0000","last_undegraded":"2023-10-09T11:42:56.954453+0000","last_fullsized":"2023-10-09T11:42:56.954453+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:14.215269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945193+0000","last_change":"2023-10-09T11:42:56.945009+0000","last_active":"2023-10-09T11:42:56.945193+0000","last_peered":"2023-10-09T11:42:56.945193+0000","last_clean":"2023-10-09T11:42:56.945193+0000","last_became_active":"2023-10-09T11:42:56.944783+0000","last_became_peered":"2023-10-09T11:42:56.944783+0000","last_unstale":"2023-10-09T11:42:56.945193+0000","last_undegraded":"2023-10-09T11:42:56.945193+0000","last_fullsized":"2023-10-09T11:42:56.945193+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:23.311875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945691+0000","last_change":"2023-10-09T11:42:56.945691+0000","last_active":"2023-10-09T11:42:56.945691+0000","last_peered":"2023-10-09T11:42:56.945691+0000","last_clean":"2023-10-09T11:42:56.945691+0000","last_became_active":"2023-10-09T11:42:56.945415+0000","last_became_peered":"2023-10-09T11:42:56.945415+0000","last_unstale":"2023-10-09T11:42:56.945691+0000","last_undegraded":"2023-10-09T11:42:56.945691+0000","last_fullsized":"2023-10-09T11:42:56.945691+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:25:59.406482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953165+0000","last_change":"2023-10-09T11:42:56.953165+0000","last_active":"2023-10-09T11:42:56.953165+0000","last_peered":"2023-10-09T11:42:56.953165+0000","last_clean":"2023-10-09T11:42:56.953165+0000","last_became_active":"2023-10-09T11:42:56.951745+0000","last_became_peered":"2023-10-09T11:42:56.951745+0000","last_unstale":"2023-10-09T11:42:56.953165+0000","last_undegraded":"2023-10-09T11:42:56.953165+0000","last_fullsized":"2023-10-09T11:42:56.953165+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:14.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946599+0000","last_change":"2023-10-09T11:42:56.946497+0000","last_active":"2023-10-09T11:42:56.946599+0000","last_peered":"2023-10-09T11:42:56.946599+0000","last_clean":"2023-10-09T11:42:56.946599+0000","last_became_active":"2023-10-09T11:42:56.946261+0000","last_became_peered":"2023-10-09T11:42:56.946261+0000","last_unstale":"2023-10-09T11:42:56.946599+0000","last_undegraded":"2023-10-09T11:42:56.946599+0000","last_fullsized":"2023-10-09T11:42:56.946599+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:28.276827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.944045+0000","last_change":"2023-10-09T11:42:56.943978+0000","last_active":"2023-10-09T11:42:56.944045+0000","last_peered":"2023-10-09T11:42:56.944045+0000","last_clean":"2023-10-09T11:42:56.944045+0000","last_became_active":"2023-10-09T11:42:56.943733+0000","last_became_peered":"2023-10-09T11:42:56.943733+0000","last_unstale":"2023-10-09T11:42:56.944045+0000","last_undegraded":"2023-10-09T11:42:56.944045+0000","last_fullsized":"2023-10-09T11:42:56.944045+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:36.044882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950802+0000","last_change":"2023-10-09T11:42:56.950764+0000","last_active":"2023-10-09T11:42:56.950802+0000","last_peered":"2023-10-09T11:42:56.950802+0000","last_clean":"2023-10-09T11:42:56.950802+0000","last_became_active":"2023-10-09T11:42:56.950110+0000","last_became_peered":"2023-10-09T11:42:56.950110+0000","last_unstale":"2023-10-09T11:42:56.950802+0000","last_undegraded":"2023-10-09T11:42:56.950802+0000","last_fullsized":"2023-10-09T11:42:56.950802+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:51.680642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949220+0000","last_change":"2023-10-09T11:42:56.949220+0000","last_active":"2023-10-09T11:42:56.949220+0000","last_peered":"2023-10-09T11:42:56.949220+0000","last_clean":"2023-10-09T11:42:56.949220+0000","last_became_active":"2023-10-09T11:42:56.948683+0000","last_became_peered":"2023-10-09T11:42:56.948683+0000","last_unstale":"2023-10-09T11:42:56.949220+0000","last_undegraded":"2023-10-09T11:42:56.949220+0000","last_fullsized":"2023-10-09T11:42:56.949220+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:39.249792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954099+0000","last_change":"2023-10-09T11:42:56.953953+0000","last_active":"2023-10-09T11:42:56.954099+0000","last_peered":"2023-10-09T11:42:56.954099+0000","last_clean":"2023-10-09T11:42:56.954099+0000","last_became_active":"2023-10-09T11:42:56.953360+0000","last_became_peered":"2023-10-09T11:42:56.953360+0000","last_unstale":"2023-10-09T11:42:56.954099+0000","last_undegraded":"2023-10-09T11:42:56.954099+0000","last_fullsized":"2023-10-09T11:42:56.954099+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.729641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949217+0000","last_change":"2023-10-09T11:42:56.949217+0000","last_active":"2023-10-09T11:42:56.949217+0000","last_peered":"2023-10-09T11:42:56.949217+0000","last_clean":"2023-10-09T11:42:56.949217+0000","last_became_active":"2023-10-09T11:42:56.948479+0000","last_became_peered":"2023-10-09T11:42:56.948479+0000","last_unstale":"2023-10-09T11:42:56.949217+0000","last_undegraded":"2023-10-09T11:42:56.949217+0000","last_fullsized":"2023-10-09T11:42:56.949217+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.583141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950328+0000","last_change":"2023-10-09T11:42:56.950328+0000","last_active":"2023-10-09T11:42:56.950328+0000","last_peered":"2023-10-09T11:42:56.950328+0000","last_clean":"2023-10-09T11:42:56.950328+0000","last_became_active":"2023-10-09T11:42:56.950077+0000","last_became_peered":"2023-10-09T11:42:56.950077+0000","last_unstale":"2023-10-09T11:42:56.950328+0000","last_undegraded":"2023-10-09T11:42:56.950328+0000","last_fullsized":"2023-10-09T11:42:56.950328+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:03:27.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951488+0000","last_change":"2023-10-09T11:42:56.951488+0000","last_active":"2023-10-09T11:42:56.951488+0000","last_peered":"2023-10-09T11:42:56.951488+0000","last_clean":"2023-10-09T11:42:56.951488+0000","last_became_active":"2023-10-09T11:42:56.951280+0000","last_became_peered":"2023-10-09T11:42:56.951280+0000","last_unstale":"2023-10-09T11:42:56.951488+0000","last_undegraded":"2023-10-09T11:42:56.951488+0000","last_fullsized":"2023-10-09T11:42:56.951488+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:16.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.955405+0000","last_change":"2023-10-09T11:42:56.955405+0000","last_active":"2023-10-09T11:42:56.955405+0000","last_peered":"2023-10-09T11:42:56.955405+0000","last_clean":"2023-10-09T11:42:56.955405+0000","last_became_active":"2023-10-09T11:42:56.955222+0000","last_became_peered":"2023-10-09T11:42:56.955222+0000","last_unstale":"2023-10-09T11:42:56.955405+0000","last_undegraded":"2023-10-09T11:42:56.955405+0000","last_fullsized":"2023-10-09T11:42:56.955405+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:51.500246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948770+0000","last_change":"2023-10-09T11:42:56.948770+0000","last_active":"2023-10-09T11:42:56.948770+0000","last_peered":"2023-10-09T11:42:56.948770+0000","last_clean":"2023-10-09T11:42:56.948770+0000","last_became_active":"2023-10-09T11:42:56.947978+0000","last_became_peered":"2023-10-09T11:42:56.947978+0000","last_unstale":"2023-10-09T11:42:56.948770+0000","last_undegraded":"2023-10-09T11:42:56.948770+0000","last_fullsized":"2023-10-09T11:42:56.948770+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:13.546734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.954860+0000","last_change":"2023-10-09T11:42:56.954860+0000","last_active":"2023-10-09T11:42:56.954860+0000","last_peered":"2023-10-09T11:42:56.954860+0000","last_clean":"2023-10-09T11:42:56.954860+0000","last_became_active":"2023-10-09T11:42:56.952260+0000","last_became_peered":"2023-10-09T11:42:56.952260+0000","last_unstale":"2023-10-09T11:42:56.954860+0000","last_undegraded":"2023-10-09T11:42:56.954860+0000","last_fullsized":"2023-10-09T11:42:56.954860+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:04:59.580669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948571+0000","last_change":"2023-10-09T11:42:56.948571+0000","last_active":"2023-10-09T11:42:56.948571+0000","last_peered":"2023-10-09T11:42:56.948571+0000","last_clean":"2023-10-09T11:42:56.948571+0000","last_became_active":"2023-10-09T11:42:56.948069+0000","last_became_peered":"2023-10-09T11:42:56.948069+0000","last_unstale":"2023-10-09T11:42:56.948571+0000","last_undegraded":"2023-10-09T11:42:56.948571+0000","last_fullsized":"2023-10-09T11:42:56.948571+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:58.855684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952601+0000","last_change":"2023-10-09T11:42:56.952340+0000","last_active":"2023-10-09T11:42:56.952601+0000","last_peered":"2023-10-09T11:42:56.952601+0000","last_clean":"2023-10-09T11:42:56.952601+0000","last_became_active":"2023-10-09T11:42:56.951704+0000","last_became_peered":"2023-10-09T11:42:56.951704+0000","last_unstale":"2023-10-09T11:42:56.952601+0000","last_undegraded":"2023-10-09T11:42:56.952601+0000","last_fullsized":"2023-10-09T11:42:56.952601+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:48:22.638765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949362+0000","last_change":"2023-10-09T11:42:56.949362+0000","last_active":"2023-10-09T11:42:56.949362+0000","last_peered":"2023-10-09T11:42:56.949362+0000","last_clean":"2023-10-09T11:42:56.949362+0000","last_became_active":"2023-10-09T11:42:56.948994+0000","last_became_peered":"2023-10-09T11:42:56.948994+0000","last_unstale":"2023-10-09T11:42:56.949362+0000","last_undegraded":"2023-10-09T11:42:56.949362+0000","last_fullsized":"2023-10-09T11:42:56.949362+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:51.500246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950299+0000","last_change":"2023-10-09T11:42:56.950231+0000","last_active":"2023-10-09T11:42:56.950299+0000","last_peered":"2023-10-09T11:42:56.950299+0000","last_clean":"2023-10-09T11:42:56.950299+0000","last_became_active":"2023-10-09T11:42:56.949816+0000","last_became_peered":"2023-10-09T11:42:56.949816+0000","last_unstale":"2023-10-09T11:42:56.950299+0000","last_undegraded":"2023-10-09T11:42:56.950299+0000","last_fullsized":"2023-10-09T11:42:56.950299+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:51:44.351360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950049+0000","last_change":"2023-10-09T11:42:56.948156+0000","last_active":"2023-10-09T11:42:56.950049+0000","last_peered":"2023-10-09T11:42:56.950049+0000","last_clean":"2023-10-09T11:42:56.950049+0000","last_became_active":"2023-10-09T11:42:56.947843+0000","last_became_peered":"2023-10-09T11:42:56.947843+0000","last_unstale":"2023-10-09T11:42:56.950049+0000","last_undegraded":"2023-10-09T11:42:56.950049+0000","last_fullsized":"2023-10-09T11:42:56.950049+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:14.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951485+0000","last_change":"2023-10-09T11:42:56.951425+0000","last_active":"2023-10-09T11:42:56.951485+0000","last_peered":"2023-10-09T11:42:56.951485+0000","last_clean":"2023-10-09T11:42:56.951485+0000","last_became_active":"2023-10-09T11:42:56.950622+0000","last_became_peered":"2023-10-09T11:42:56.950622+0000","last_unstale":"2023-10-09T11:42:56.951485+0000","last_undegraded":"2023-10-09T11:42:56.951485+0000","last_fullsized":"2023-10-09T11:42:56.951485+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:44.241241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950696+0000","last_change":"2023-10-09T11:42:56.950641+0000","last_active":"2023-10-09T11:42:56.950696+0000","last_peered":"2023-10-09T11:42:56.950696+0000","last_clean":"2023-10-09T11:42:56.950696+0000","last_became_active":"2023-10-09T11:42:56.949906+0000","last_became_peered":"2023-10-09T11:42:56.949906+0000","last_unstale":"2023-10-09T11:42:56.950696+0000","last_undegraded":"2023-10-09T11:42:56.950696+0000","last_fullsized":"2023-10-09T11:42:56.950696+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:58.522886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950030+0000","last_change":"2023-10-09T11:42:56.950030+0000","last_active":"2023-10-09T11:42:56.950030+0000","last_peered":"2023-10-09T11:42:56.950030+0000","last_clean":"2023-10-09T11:42:56.950030+0000","last_became_active":"2023-10-09T11:42:56.949496+0000","last_became_peered":"2023-10-09T11:42:56.949496+0000","last_unstale":"2023-10-09T11:42:56.950030+0000","last_undegraded":"2023-10-09T11:42:56.950030+0000","last_fullsized":"2023-10-09T11:42:56.950030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.583141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953371+0000","last_change":"2023-10-09T11:42:56.952985+0000","last_active":"2023-10-09T11:42:56.953371+0000","last_peered":"2023-10-09T11:42:56.953371+0000","last_clean":"2023-10-09T11:42:56.953371+0000","last_became_active":"2023-10-09T11:42:56.950633+0000","last_became_peered":"2023-10-09T11:42:56.950633+0000","last_unstale":"2023-10-09T11:42:56.953371+0000","last_undegraded":"2023-10-09T11:42:56.953371+0000","last_fullsized":"2023-10-09T11:42:56.953371+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:59.447284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949591+0000","last_change":"2023-10-09T11:42:56.949591+0000","last_active":"2023-10-09T11:42:56.949591+0000","last_peered":"2023-10-09T11:42:56.949591+0000","last_clean":"2023-10-09T11:42:56.949591+0000","last_became_active":"2023-10-09T11:42:56.948954+0000","last_became_peered":"2023-10-09T11:42:56.948954+0000","last_unstale":"2023-10-09T11:42:56.949591+0000","last_undegraded":"2023-10-09T11:42:56.949591+0000","last_fullsized":"2023-10-09T11:42:56.949591+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:16.329960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"145'4","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299971+0000","last_change":"2023-10-09T11:42:56.291810+0000","last_active":"2023-10-09T11:42:57.299971+0000","last_peered":"2023-10-09T11:42:57.299971+0000","last_clean":"2023-10-09T11:42:57.299971+0000","last_became_active":"2023-10-09T11:42:56.291540+0000","last_became_peered":"2023-10-09T11:42:56.291540+0000","last_unstale":"2023-10-09T11:42:57.299971+0000","last_undegraded":"2023-10-09T11:42:57.299971+0000","last_fullsized":"2023-10-09T11:42:57.299971+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:29.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952494+0000","last_change":"2023-10-09T11:42:56.952494+0000","last_active":"2023-10-09T11:42:56.952494+0000","last_peered":"2023-10-09T11:42:56.952494+0000","last_clean":"2023-10-09T11:42:56.952494+0000","last_became_active":"2023-10-09T11:42:56.950709+0000","last_became_peered":"2023-10-09T11:42:56.950709+0000","last_unstale":"2023-10-09T11:42:56.952494+0000","last_undegraded":"2023-10-09T11:42:56.952494+0000","last_fullsized":"2023-10-09T11:42:56.952494+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:14.568416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299365+0000","last_change":"2023-10-09T11:42:56.287536+0000","last_active":"2023-10-09T11:42:57.299365+0000","last_peered":"2023-10-09T11:42:57.299365+0000","last_clean":"2023-10-09T11:42:57.299365+0000","last_became_active":"2023-10-09T11:42:56.287250+0000","last_became_peered":"2023-10-09T11:42:56.287250+0000","last_unstale":"2023-10-09T11:42:57.299365+0000","last_undegraded":"2023-10-09T11:42:57.299365+0000","last_fullsized":"2023-10-09T11:42:57.299365+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:38.834996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952127+0000","last_change":"2023-10-09T11:42:56.952127+0000","last_active":"2023-10-09T11:42:56.952127+0000","last_peered":"2023-10-09T11:42:56.952127+0000","last_clean":"2023-10-09T11:42:56.952127+0000","last_became_active":"2023-10-09T11:42:56.951856+0000","last_became_peered":"2023-10-09T11:42:56.951856+0000","last_unstale":"2023-10-09T11:42:56.952127+0000","last_undegraded":"2023-10-09T11:42:56.952127+0000","last_fullsized":"2023-10-09T11:42:56.952127+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:48.666352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300332+0000","last_change":"2023-10-09T11:42:56.287964+0000","last_active":"2023-10-09T11:42:57.300332+0000","last_peered":"2023-10-09T11:42:57.300332+0000","last_clean":"2023-10-09T11:42:57.300332+0000","last_became_active":"2023-10-09T11:42:56.287758+0000","last_became_peered":"2023-10-09T11:42:56.287758+0000","last_unstale":"2023-10-09T11:42:57.300332+0000","last_undegraded":"2023-10-09T11:42:57.300332+0000","last_fullsized":"2023-10-09T11:42:57.300332+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:47.662069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952106+0000","last_change":"2023-10-09T11:42:56.952106+0000","last_active":"2023-10-09T11:42:56.952106+0000","last_peered":"2023-10-09T11:42:56.952106+0000","last_clean":"2023-10-09T11:42:56.952106+0000","last_became_active":"2023-10-09T11:42:56.951585+0000","last_became_peered":"2023-10-09T11:42:56.951585+0000","last_unstale":"2023-10-09T11:42:56.952106+0000","last_undegraded":"2023-10-09T11:42:56.952106+0000","last_fullsized":"2023-10-09T11:42:56.952106+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:03:19.271413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299188+0000","last_change":"2023-10-09T11:42:56.286220+0000","last_active":"2023-10-09T11:42:57.299188+0000","last_peered":"2023-10-09T11:42:57.299188+0000","last_clean":"2023-10-09T11:42:57.299188+0000","last_became_active":"2023-10-09T11:42:56.285645+0000","last_became_peered":"2023-10-09T11:42:56.285645+0000","last_unstale":"2023-10-09T11:42:57.299188+0000","last_undegraded":"2023-10-09T11:42:57.299188+0000","last_fullsized":"2023-10-09T11:42:57.299188+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:38.352072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.951782+0000","last_change":"2023-10-09T11:42:56.951782+0000","last_active":"2023-10-09T11:42:56.951782+0000","last_peered":"2023-10-09T11:42:56.951782+0000","last_clean":"2023-10-09T11:42:56.951782+0000","last_became_active":"2023-10-09T11:42:56.948793+0000","last_became_peered":"2023-10-09T11:42:56.948793+0000","last_unstale":"2023-10-09T11:42:56.951782+0000","last_undegraded":"2023-10-09T11:42:56.951782+0000","last_fullsized":"2023-10-09T11:42:56.951782+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:54:48.666352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300278+0000","last_change":"2023-10-09T11:42:56.287796+0000","last_active":"2023-10-09T11:42:57.300278+0000","last_peered":"2023-10-09T11:42:57.300278+0000","last_clean":"2023-10-09T11:42:57.300278+0000","last_became_active":"2023-10-09T11:42:56.287531+0000","last_became_peered":"2023-10-09T11:42:56.287531+0000","last_unstale":"2023-10-09T11:42:57.300278+0000","last_undegraded":"2023-10-09T11:42:57.300278+0000","last_fullsized":"2023-10-09T11:42:57.300278+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:06.878711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953391+0000","last_change":"2023-10-09T11:42:56.953140+0000","last_active":"2023-10-09T11:42:56.953391+0000","last_peered":"2023-10-09T11:42:56.953391+0000","last_clean":"2023-10-09T11:42:56.953391+0000","last_became_active":"2023-10-09T11:42:56.951101+0000","last_became_peered":"2023-10-09T11:42:56.951101+0000","last_unstale":"2023-10-09T11:42:56.953391+0000","last_undegraded":"2023-10-09T11:42:56.953391+0000","last_fullsized":"2023-10-09T11:42:56.953391+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:49.651397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"145'1","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.943950+0000","last_change":"2023-10-09T11:42:56.291847+0000","last_active":"2023-10-09T11:42:56.943950+0000","last_peered":"2023-10-09T11:42:56.943950+0000","last_clean":"2023-10-09T11:42:56.943950+0000","last_became_active":"2023-10-09T11:42:56.291547+0000","last_became_peered":"2023-10-09T11:42:56.291547+0000","last_unstale":"2023-10-09T11:42:56.943950+0000","last_undegraded":"2023-10-09T11:42:56.943950+0000","last_fullsized":"2023-10-09T11:42:56.943950+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:21.151652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948162+0000","last_change":"2023-10-09T11:42:56.948162+0000","last_active":"2023-10-09T11:42:56.948162+0000","last_peered":"2023-10-09T11:42:56.948162+0000","last_clean":"2023-10-09T11:42:56.948162+0000","last_became_active":"2023-10-09T11:42:56.947947+0000","last_became_peered":"2023-10-09T11:42:56.947947+0000","last_unstale":"2023-10-09T11:42:56.948162+0000","last_undegraded":"2023-10-09T11:42:56.948162+0000","last_fullsized":"2023-10-09T11:42:56.948162+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:56:07.729641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.944200+0000","last_change":"2023-10-09T11:42:56.292614+0000","last_active":"2023-10-09T11:42:56.944200+0000","last_peered":"2023-10-09T11:42:56.944200+0000","last_clean":"2023-10-09T11:42:56.944200+0000","last_became_active":"2023-10-09T11:42:56.292220+0000","last_became_peered":"2023-10-09T11:42:56.292220+0000","last_unstale":"2023-10-09T11:42:56.944200+0000","last_undegraded":"2023-10-09T11:42:56.944200+0000","last_fullsized":"2023-10-09T11:42:56.944200+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:13.914487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947830+0000","last_change":"2023-10-09T11:42:56.947745+0000","last_active":"2023-10-09T11:42:56.947830+0000","last_peered":"2023-10-09T11:42:56.947830+0000","last_clean":"2023-10-09T11:42:56.947830+0000","last_became_active":"2023-10-09T11:42:56.947528+0000","last_became_peered":"2023-10-09T11:42:56.947528+0000","last_unstale":"2023-10-09T11:42:56.947830+0000","last_undegraded":"2023-10-09T11:42:56.947830+0000","last_fullsized":"2023-10-09T11:42:56.947830+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:10.998965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.941818+0000","last_change":"2023-10-09T11:42:56.291609+0000","last_active":"2023-10-09T11:42:56.941818+0000","last_peered":"2023-10-09T11:42:56.941818+0000","last_clean":"2023-10-09T11:42:56.941818+0000","last_became_active":"2023-10-09T11:42:56.291225+0000","last_became_peered":"2023-10-09T11:42:56.291225+0000","last_unstale":"2023-10-09T11:42:56.941818+0000","last_undegraded":"2023-10-09T11:42:56.941818+0000","last_fullsized":"2023-10-09T11:42:56.941818+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:20.956274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946048+0000","last_change":"2023-10-09T11:42:56.945703+0000","last_active":"2023-10-09T11:42:56.946048+0000","last_peered":"2023-10-09T11:42:56.946048+0000","last_clean":"2023-10-09T11:42:56.946048+0000","last_became_active":"2023-10-09T11:42:56.945488+0000","last_became_peered":"2023-10-09T11:42:56.945488+0000","last_unstale":"2023-10-09T11:42:56.946048+0000","last_undegraded":"2023-10-09T11:42:56.946048+0000","last_fullsized":"2023-10-09T11:42:56.946048+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:29.111862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940877+0000","last_change":"2023-10-09T11:42:56.288024+0000","last_active":"2023-10-09T11:42:56.940877+0000","last_peered":"2023-10-09T11:42:56.940877+0000","last_clean":"2023-10-09T11:42:56.940877+0000","last_became_active":"2023-10-09T11:42:56.287520+0000","last_became_peered":"2023-10-09T11:42:56.287520+0000","last_unstale":"2023-10-09T11:42:56.940877+0000","last_undegraded":"2023-10-09T11:42:56.940877+0000","last_fullsized":"2023-10-09T11:42:56.940877+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:22.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950081+0000","last_change":"2023-10-09T11:42:56.948831+0000","last_active":"2023-10-09T11:42:56.950081+0000","last_peered":"2023-10-09T11:42:56.950081+0000","last_clean":"2023-10-09T11:42:56.950081+0000","last_became_active":"2023-10-09T11:42:56.948515+0000","last_became_peered":"2023-10-09T11:42:56.948515+0000","last_unstale":"2023-10-09T11:42:56.950081+0000","last_undegraded":"2023-10-09T11:42:56.950081+0000","last_fullsized":"2023-10-09T11:42:56.950081+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:37.628055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.289426+0000","last_change":"2023-10-09T11:42:56.289144+0000","last_active":"2023-10-09T11:42:56.289426+0000","last_peered":"2023-10-09T11:42:56.289426+0000","last_clean":"2023-10-09T11:42:56.289426+0000","last_became_active":"2023-10-09T11:42:56.288918+0000","last_became_peered":"2023-10-09T11:42:56.288918+0000","last_unstale":"2023-10-09T11:42:56.289426+0000","last_undegraded":"2023-10-09T11:42:56.289426+0000","last_fullsized":"2023-10-09T11:42:56.289426+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.443001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952537+0000","last_change":"2023-10-09T11:42:56.952537+0000","last_active":"2023-10-09T11:42:56.952537+0000","last_peered":"2023-10-09T11:42:56.952537+0000","last_clean":"2023-10-09T11:42:56.952537+0000","last_became_active":"2023-10-09T11:42:56.952287+0000","last_became_peered":"2023-10-09T11:42:56.952287+0000","last_unstale":"2023-10-09T11:42:56.952537+0000","last_undegraded":"2023-10-09T11:42:56.952537+0000","last_fullsized":"2023-10-09T11:42:56.952537+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:16.329960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"145'3","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299928+0000","last_change":"2023-10-09T11:42:56.285518+0000","last_active":"2023-10-09T11:42:57.299928+0000","last_peered":"2023-10-09T11:42:57.299928+0000","last_clean":"2023-10-09T11:42:57.299928+0000","last_became_active":"2023-10-09T11:42:56.285297+0000","last_became_peered":"2023-10-09T11:42:56.285297+0000","last_unstale":"2023-10-09T11:42:57.299928+0000","last_undegraded":"2023-10-09T11:42:57.299928+0000","last_fullsized":"2023-10-09T11:42:57.299928+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:48:21.634482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950932+0000","last_change":"2023-10-09T11:42:56.950932+0000","last_active":"2023-10-09T11:42:56.950932+0000","last_peered":"2023-10-09T11:42:56.950932+0000","last_clean":"2023-10-09T11:42:56.950932+0000","last_became_active":"2023-10-09T11:42:56.950708+0000","last_became_peered":"2023-10-09T11:42:56.950708+0000","last_unstale":"2023-10-09T11:42:56.950932+0000","last_undegraded":"2023-10-09T11:42:56.950932+0000","last_fullsized":"2023-10-09T11:42:56.950932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:20.172975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"145'6","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300400+0000","last_change":"2023-10-09T11:42:56.291775+0000","last_active":"2023-10-09T11:42:57.300400+0000","last_peered":"2023-10-09T11:42:57.300400+0000","last_clean":"2023-10-09T11:42:57.300400+0000","last_became_active":"2023-10-09T11:42:56.291353+0000","last_became_peered":"2023-10-09T11:42:56.291353+0000","last_unstale":"2023-10-09T11:42:57.300400+0000","last_undegraded":"2023-10-09T11:42:57.300400+0000","last_fullsized":"2023-10-09T11:42:57.300400+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:09.994682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946844+0000","last_change":"2023-10-09T11:42:56.946715+0000","last_active":"2023-10-09T11:42:56.946844+0000","last_peered":"2023-10-09T11:42:56.946844+0000","last_clean":"2023-10-09T11:42:56.946844+0000","last_became_active":"2023-10-09T11:42:56.946482+0000","last_became_peered":"2023-10-09T11:42:56.946482+0000","last_unstale":"2023-10-09T11:42:56.946844+0000","last_undegraded":"2023-10-09T11:42:56.946844+0000","last_fullsized":"2023-10-09T11:42:56.946844+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.359933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.941166+0000","last_change":"2023-10-09T11:42:56.289106+0000","last_active":"2023-10-09T11:42:56.941166+0000","last_peered":"2023-10-09T11:42:56.941166+0000","last_clean":"2023-10-09T11:42:56.941166+0000","last_became_active":"2023-10-09T11:42:56.288088+0000","last_became_peered":"2023-10-09T11:42:56.288088+0000","last_unstale":"2023-10-09T11:42:56.941166+0000","last_undegraded":"2023-10-09T11:42:56.941166+0000","last_fullsized":"2023-10-09T11:42:56.941166+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:42.270465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950166+0000","last_change":"2023-10-09T11:42:56.950056+0000","last_active":"2023-10-09T11:42:56.950166+0000","last_peered":"2023-10-09T11:42:56.950166+0000","last_clean":"2023-10-09T11:42:56.950166+0000","last_became_active":"2023-10-09T11:42:56.949836+0000","last_became_peered":"2023-10-09T11:42:56.949836+0000","last_unstale":"2023-10-09T11:42:56.950166+0000","last_undegraded":"2023-10-09T11:42:56.950166+0000","last_fullsized":"2023-10-09T11:42:56.950166+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:41:42.084527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940175+0000","last_change":"2023-10-09T11:42:56.293885+0000","last_active":"2023-10-09T11:42:56.940175+0000","last_peered":"2023-10-09T11:42:56.940175+0000","last_clean":"2023-10-09T11:42:56.940175+0000","last_became_active":"2023-10-09T11:42:56.293654+0000","last_became_peered":"2023-10-09T11:42:56.293654+0000","last_unstale":"2023-10-09T11:42:56.940175+0000","last_undegraded":"2023-10-09T11:42:56.940175+0000","last_fullsized":"2023-10-09T11:42:56.940175+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:31.860550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952897+0000","last_change":"2023-10-09T11:42:56.952897+0000","last_active":"2023-10-09T11:42:56.952897+0000","last_peered":"2023-10-09T11:42:56.952897+0000","last_clean":"2023-10-09T11:42:56.952897+0000","last_became_active":"2023-10-09T11:42:56.951367+0000","last_became_peered":"2023-10-09T11:42:56.951367+0000","last_unstale":"2023-10-09T11:42:56.952897+0000","last_undegraded":"2023-10-09T11:42:56.952897+0000","last_fullsized":"2023-10-09T11:42:56.952897+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:50.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"145'8","reported_seq":17,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.302588+0000","last_change":"2023-10-09T11:42:56.294006+0000","last_active":"2023-10-09T11:42:57.302588+0000","last_peered":"2023-10-09T11:42:57.302588+0000","last_clean":"2023-10-09T11:42:57.302588+0000","last_became_active":"2023-10-09T11:42:56.293297+0000","last_became_peered":"2023-10-09T11:42:56.293297+0000","last_unstale":"2023-10-09T11:42:57.302588+0000","last_undegraded":"2023-10-09T11:42:57.302588+0000","last_fullsized":"2023-10-09T11:42:57.302588+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:22.307592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.953715+0000","last_change":"2023-10-09T11:42:56.953715+0000","last_active":"2023-10-09T11:42:56.953715+0000","last_peered":"2023-10-09T11:42:56.953715+0000","last_clean":"2023-10-09T11:42:56.953715+0000","last_became_active":"2023-10-09T11:42:56.953335+0000","last_became_peered":"2023-10-09T11:42:56.953335+0000","last_unstale":"2023-10-09T11:42:56.953715+0000","last_undegraded":"2023-10-09T11:42:56.953715+0000","last_fullsized":"2023-10-09T11:42:56.953715+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:15.965910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299268+0000","last_change":"2023-10-09T11:42:56.290349+0000","last_active":"2023-10-09T11:42:57.299268+0000","last_peered":"2023-10-09T11:42:57.299268+0000","last_clean":"2023-10-09T11:42:57.299268+0000","last_became_active":"2023-10-09T11:42:56.290070+0000","last_became_peered":"2023-10-09T11:42:56.290070+0000","last_unstale":"2023-10-09T11:42:57.299268+0000","last_undegraded":"2023-10-09T11:42:57.299268+0000","last_fullsized":"2023-10-09T11:42:57.299268+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:05.324637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950028+0000","last_change":"2023-10-09T11:42:56.947737+0000","last_active":"2023-10-09T11:42:56.950028+0000","last_peered":"2023-10-09T11:42:56.950028+0000","last_clean":"2023-10-09T11:42:56.950028+0000","last_became_active":"2023-10-09T11:42:56.946920+0000","last_became_peered":"2023-10-09T11:42:56.946920+0000","last_unstale":"2023-10-09T11:42:56.950028+0000","last_undegraded":"2023-10-09T11:42:56.950028+0000","last_fullsized":"2023-10-09T11:42:56.950028+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:34:04.360514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299889+0000","last_change":"2023-10-09T11:42:56.294064+0000","last_active":"2023-10-09T11:42:57.299889+0000","last_peered":"2023-10-09T11:42:57.299889+0000","last_clean":"2023-10-09T11:42:57.299889+0000","last_became_active":"2023-10-09T11:42:56.293839+0000","last_became_peered":"2023-10-09T11:42:56.293839+0000","last_unstale":"2023-10-09T11:42:57.299889+0000","last_undegraded":"2023-10-09T11:42:57.299889+0000","last_fullsized":"2023-10-09T11:42:57.299889+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:35:15.865641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945652+0000","last_change":"2023-10-09T11:42:56.945652+0000","last_active":"2023-10-09T11:42:56.945652+0000","last_peered":"2023-10-09T11:42:56.945652+0000","last_clean":"2023-10-09T11:42:56.945652+0000","last_became_active":"2023-10-09T11:42:56.945418+0000","last_became_peered":"2023-10-09T11:42:56.945418+0000","last_unstale":"2023-10-09T11:42:56.945652+0000","last_undegraded":"2023-10-09T11:42:56.945652+0000","last_fullsized":"2023-10-09T11:42:56.945652+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:30.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"145'1","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300427+0000","last_change":"2023-10-09T11:42:56.288874+0000","last_active":"2023-10-09T11:42:57.300427+0000","last_peered":"2023-10-09T11:42:57.300427+0000","last_clean":"2023-10-09T11:42:57.300427+0000","last_became_active":"2023-10-09T11:42:56.288401+0000","last_became_peered":"2023-10-09T11:42:56.288401+0000","last_unstale":"2023-10-09T11:42:57.300427+0000","last_undegraded":"2023-10-09T11:42:57.300427+0000","last_fullsized":"2023-10-09T11:42:57.300427+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:49.814752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947814+0000","last_change":"2023-10-09T11:42:56.947655+0000","last_active":"2023-10-09T11:42:56.947814+0000","last_peered":"2023-10-09T11:42:56.947814+0000","last_clean":"2023-10-09T11:42:56.947814+0000","last_became_active":"2023-10-09T11:42:56.947426+0000","last_became_peered":"2023-10-09T11:42:56.947426+0000","last_unstale":"2023-10-09T11:42:56.947814+0000","last_undegraded":"2023-10-09T11:42:56.947814+0000","last_fullsized":"2023-10-09T11:42:56.947814+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:28:30.452749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940234+0000","last_change":"2023-10-09T11:42:56.286028+0000","last_active":"2023-10-09T11:42:56.940234+0000","last_peered":"2023-10-09T11:42:56.940234+0000","last_clean":"2023-10-09T11:42:56.940234+0000","last_became_active":"2023-10-09T11:42:56.285703+0000","last_became_peered":"2023-10-09T11:42:56.285703+0000","last_unstale":"2023-10-09T11:42:56.940234+0000","last_undegraded":"2023-10-09T11:42:56.940234+0000","last_fullsized":"2023-10-09T11:42:56.940234+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:09.994682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.945112+0000","last_change":"2023-10-09T11:42:56.945025+0000","last_active":"2023-10-09T11:42:56.945112+0000","last_peered":"2023-10-09T11:42:56.945112+0000","last_clean":"2023-10-09T11:42:56.945112+0000","last_became_active":"2023-10-09T11:42:56.944797+0000","last_became_peered":"2023-10-09T11:42:56.944797+0000","last_unstale":"2023-10-09T11:42:56.945112+0000","last_undegraded":"2023-10-09T11:42:56.945112+0000","last_fullsized":"2023-10-09T11:42:56.945112+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:34:01.839893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300116+0000","last_change":"2023-10-09T11:42:56.282577+0000","last_active":"2023-10-09T11:42:57.300116+0000","last_peered":"2023-10-09T11:42:57.300116+0000","last_clean":"2023-10-09T11:42:57.300116+0000","last_became_active":"2023-10-09T11:42:56.282301+0000","last_became_peered":"2023-10-09T11:42:56.282301+0000","last_unstale":"2023-10-09T11:42:57.300116+0000","last_undegraded":"2023-10-09T11:42:57.300116+0000","last_fullsized":"2023-10-09T11:42:57.300116+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:47.076996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.948579+0000","last_change":"2023-10-09T11:42:56.948510+0000","last_active":"2023-10-09T11:42:56.948579+0000","last_peered":"2023-10-09T11:42:56.948579+0000","last_clean":"2023-10-09T11:42:56.948579+0000","last_became_active":"2023-10-09T11:42:56.948075+0000","last_became_peered":"2023-10-09T11:42:56.948075+0000","last_unstale":"2023-10-09T11:42:56.948579+0000","last_undegraded":"2023-10-09T11:42:56.948579+0000","last_fullsized":"2023-10-09T11:42:56.948579+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:30.037690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293369+0000","last_change":"2023-10-09T11:42:56.293301+0000","last_active":"2023-10-09T11:42:56.293369+0000","last_peered":"2023-10-09T11:42:56.293369+0000","last_clean":"2023-10-09T11:42:56.293369+0000","last_became_active":"2023-10-09T11:42:56.293139+0000","last_became_peered":"2023-10-09T11:42:56.293139+0000","last_unstale":"2023-10-09T11:42:56.293369+0000","last_undegraded":"2023-10-09T11:42:56.293369+0000","last_fullsized":"2023-10-09T11:42:56.293369+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:05.214465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947309+0000","last_change":"2023-10-09T11:42:56.947202+0000","last_active":"2023-10-09T11:42:56.947309+0000","last_peered":"2023-10-09T11:42:56.947309+0000","last_clean":"2023-10-09T11:42:56.947309+0000","last_became_active":"2023-10-09T11:42:56.946816+0000","last_became_peered":"2023-10-09T11:42:56.946816+0000","last_unstale":"2023-10-09T11:42:56.947309+0000","last_undegraded":"2023-10-09T11:42:56.947309+0000","last_fullsized":"2023-10-09T11:42:56.947309+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:04.159373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.288759+0000","last_change":"2023-10-09T11:42:56.288691+0000","last_active":"2023-10-09T11:42:56.288759+0000","last_peered":"2023-10-09T11:42:56.288759+0000","last_clean":"2023-10-09T11:42:56.288759+0000","last_became_active":"2023-10-09T11:42:56.288300+0000","last_became_peered":"2023-10-09T11:42:56.288300+0000","last_unstale":"2023-10-09T11:42:56.288759+0000","last_undegraded":"2023-10-09T11:42:56.288759+0000","last_fullsized":"2023-10-09T11:42:56.288759+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:33.261539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952293+0000","last_change":"2023-10-09T11:42:56.952293+0000","last_active":"2023-10-09T11:42:56.952293+0000","last_peered":"2023-10-09T11:42:56.952293+0000","last_clean":"2023-10-09T11:42:56.952293+0000","last_became_active":"2023-10-09T11:42:56.951873+0000","last_became_peered":"2023-10-09T11:42:56.951873+0000","last_unstale":"2023-10-09T11:42:56.952293+0000","last_undegraded":"2023-10-09T11:42:56.952293+0000","last_fullsized":"2023-10-09T11:42:56.952293+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:30.016809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.291943+0000","last_change":"2023-10-09T11:42:56.291882+0000","last_active":"2023-10-09T11:42:56.291943+0000","last_peered":"2023-10-09T11:42:56.291943+0000","last_clean":"2023-10-09T11:42:56.291943+0000","last_became_active":"2023-10-09T11:42:56.291669+0000","last_became_peered":"2023-10-09T11:42:56.291669+0000","last_unstale":"2023-10-09T11:42:56.291943+0000","last_undegraded":"2023-10-09T11:42:56.291943+0000","last_fullsized":"2023-10-09T11:42:56.291943+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:58.578858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950361+0000","last_change":"2023-10-09T11:42:56.950234+0000","last_active":"2023-10-09T11:42:56.950361+0000","last_peered":"2023-10-09T11:42:56.950361+0000","last_clean":"2023-10-09T11:42:56.950361+0000","last_became_active":"2023-10-09T11:42:56.949990+0000","last_became_peered":"2023-10-09T11:42:56.949990+0000","last_unstale":"2023-10-09T11:42:56.950361+0000","last_undegraded":"2023-10-09T11:42:56.950361+0000","last_fullsized":"2023-10-09T11:42:56.950361+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:30.834427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"145'2","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.300671+0000","last_change":"2023-10-09T11:42:56.283322+0000","last_active":"2023-10-09T11:42:57.300671+0000","last_peered":"2023-10-09T11:42:57.300671+0000","last_clean":"2023-10-09T11:42:57.300671+0000","last_became_active":"2023-10-09T11:42:56.283066+0000","last_became_peered":"2023-10-09T11:42:56.283066+0000","last_unstale":"2023-10-09T11:42:57.300671+0000","last_undegraded":"2023-10-09T11:42:57.300671+0000","last_fullsized":"2023-10-09T11:42:57.300671+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:19.661105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950098+0000","last_change":"2023-10-09T11:42:56.950041+0000","last_active":"2023-10-09T11:42:56.950098+0000","last_peered":"2023-10-09T11:42:56.950098+0000","last_clean":"2023-10-09T11:42:56.950098+0000","last_became_active":"2023-10-09T11:42:56.949510+0000","last_became_peered":"2023-10-09T11:42:56.949510+0000","last_unstale":"2023-10-09T11:42:56.950098+0000","last_undegraded":"2023-10-09T11:42:56.950098+0000","last_fullsized":"2023-10-09T11:42:56.950098+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:41:52.693991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293284+0000","last_change":"2023-10-09T11:42:56.293169+0000","last_active":"2023-10-09T11:42:56.293284+0000","last_peered":"2023-10-09T11:42:56.293284+0000","last_clean":"2023-10-09T11:42:56.293284+0000","last_became_active":"2023-10-09T11:42:56.292706+0000","last_became_peered":"2023-10-09T11:42:56.292706+0000","last_unstale":"2023-10-09T11:42:56.293284+0000","last_undegraded":"2023-10-09T11:42:56.293284+0000","last_fullsized":"2023-10-09T11:42:56.293284+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:20:16.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.952668+0000","last_change":"2023-10-09T11:42:56.952606+0000","last_active":"2023-10-09T11:42:56.952668+0000","last_peered":"2023-10-09T11:42:56.952668+0000","last_clean":"2023-10-09T11:42:56.952668+0000","last_became_active":"2023-10-09T11:42:56.952018+0000","last_became_peered":"2023-10-09T11:42:56.952018+0000","last_unstale":"2023-10-09T11:42:56.952668+0000","last_undegraded":"2023-10-09T11:42:56.952668+0000","last_fullsized":"2023-10-09T11:42:56.952668+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:25:54.402662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.940394+0000","last_change":"2023-10-09T11:42:56.291438+0000","last_active":"2023-10-09T11:42:56.940394+0000","last_peered":"2023-10-09T11:42:56.940394+0000","last_clean":"2023-10-09T11:42:56.940394+0000","last_became_active":"2023-10-09T11:42:56.291209+0000","last_became_peered":"2023-10-09T11:42:56.291209+0000","last_unstale":"2023-10-09T11:42:56.940394+0000","last_undegraded":"2023-10-09T11:42:56.940394+0000","last_fullsized":"2023-10-09T11:42:56.940394+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:17.982641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947440+0000","last_change":"2023-10-09T11:42:56.947334+0000","last_active":"2023-10-09T11:42:56.947440+0000","last_peered":"2023-10-09T11:42:56.947440+0000","last_clean":"2023-10-09T11:42:56.947440+0000","last_became_active":"2023-10-09T11:42:56.946950+0000","last_became_peered":"2023-10-09T11:42:56.946950+0000","last_unstale":"2023-10-09T11:42:56.947440+0000","last_undegraded":"2023-10-09T11:42:56.947440+0000","last_fullsized":"2023-10-09T11:42:56.947440+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:52:06.218748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.291275+0000","last_change":"2023-10-09T11:42:56.290789+0000","last_active":"2023-10-09T11:42:56.291275+0000","last_peered":"2023-10-09T11:42:56.291275+0000","last_clean":"2023-10-09T11:42:56.291275+0000","last_became_active":"2023-10-09T11:42:56.290505+0000","last_became_peered":"2023-10-09T11:42:56.290505+0000","last_unstale":"2023-10-09T11:42:56.291275+0000","last_undegraded":"2023-10-09T11:42:56.291275+0000","last_fullsized":"2023-10-09T11:42:56.291275+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:38.245509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.949543+0000","last_change":"2023-10-09T11:42:56.949543+0000","last_active":"2023-10-09T11:42:56.949543+0000","last_peered":"2023-10-09T11:42:56.949543+0000","last_clean":"2023-10-09T11:42:56.949543+0000","last_became_active":"2023-10-09T11:42:56.949308+0000","last_became_peered":"2023-10-09T11:42:56.949308+0000","last_unstale":"2023-10-09T11:42:56.949543+0000","last_undegraded":"2023-10-09T11:42:56.949543+0000","last_fullsized":"2023-10-09T11:42:56.949543+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:30.025220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.942649+0000","last_change":"2023-10-09T11:42:56.292043+0000","last_active":"2023-10-09T11:42:56.942649+0000","last_peered":"2023-10-09T11:42:56.942649+0000","last_clean":"2023-10-09T11:42:56.942649+0000","last_became_active":"2023-10-09T11:42:56.291867+0000","last_became_peered":"2023-10-09T11:42:56.291867+0000","last_unstale":"2023-10-09T11:42:56.942649+0000","last_undegraded":"2023-10-09T11:42:56.942649+0000","last_fullsized":"2023-10-09T11:42:56.942649+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:53.875841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946911+0000","last_change":"2023-10-09T11:42:56.944879+0000","last_active":"2023-10-09T11:42:56.946911+0000","last_peered":"2023-10-09T11:42:56.946911+0000","last_clean":"2023-10-09T11:42:56.946911+0000","last_became_active":"2023-10-09T11:42:56.944603+0000","last_became_peered":"2023-10-09T11:42:56.944603+0000","last_unstale":"2023-10-09T11:42:56.946911+0000","last_undegraded":"2023-10-09T11:42:56.946911+0000","last_fullsized":"2023-10-09T11:42:56.946911+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:33.897751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.292690+0000","last_change":"2023-10-09T11:42:56.292340+0000","last_active":"2023-10-09T11:42:56.292690+0000","last_peered":"2023-10-09T11:42:56.292690+0000","last_clean":"2023-10-09T11:42:56.292690+0000","last_became_active":"2023-10-09T11:42:56.292084+0000","last_became_peered":"2023-10-09T11:42:56.292084+0000","last_unstale":"2023-10-09T11:42:56.292690+0000","last_undegraded":"2023-10-09T11:42:56.292690+0000","last_fullsized":"2023-10-09T11:42:56.292690+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:21.151652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.946460+0000","last_change":"2023-10-09T11:42:56.946460+0000","last_active":"2023-10-09T11:42:56.946460+0000","last_peered":"2023-10-09T11:42:56.946460+0000","last_clean":"2023-10-09T11:42:56.946460+0000","last_became_active":"2023-10-09T11:42:56.945945+0000","last_became_peered":"2023-10-09T11:42:56.945945+0000","last_unstale":"2023-10-09T11:42:56.946460+0000","last_undegraded":"2023-10-09T11:42:56.946460+0000","last_fullsized":"2023-10-09T11:42:56.946460+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:30.025220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.293149+0000","last_change":"2023-10-09T11:42:56.293040+0000","last_active":"2023-10-09T11:42:56.293149+0000","last_peered":"2023-10-09T11:42:56.293149+0000","last_clean":"2023-10-09T11:42:56.293149+0000","last_became_active":"2023-10-09T11:42:56.292793+0000","last_became_peered":"2023-10-09T11:42:56.292793+0000","last_unstale":"2023-10-09T11:42:56.293149+0000","last_undegraded":"2023-10-09T11:42:56.293149+0000","last_fullsized":"2023-10-09T11:42:56.293149+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:09:29.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.947178+0000","last_change":"2023-10-09T11:42:56.947114+0000","last_active":"2023-10-09T11:42:56.947178+0000","last_peered":"2023-10-09T11:42:56.947178+0000","last_clean":"2023-10-09T11:42:56.947178+0000","last_became_active":"2023-10-09T11:42:56.946877+0000","last_became_peered":"2023-10-09T11:42:56.946877+0000","last_unstale":"2023-10-09T11:42:56.947178+0000","last_undegraded":"2023-10-09T11:42:56.947178+0000","last_fullsized":"2023-10-09T11:42:56.947178+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:46:39.839279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.290063+0000","last_change":"2023-10-09T11:42:56.289995+0000","last_active":"2023-10-09T11:42:56.290063+0000","last_peered":"2023-10-09T11:42:56.290063+0000","last_clean":"2023-10-09T11:42:56.290063+0000","last_became_active":"2023-10-09T11:42:56.289770+0000","last_became_peered":"2023-10-09T11:42:56.289770+0000","last_unstale":"2023-10-09T11:42:56.290063+0000","last_undegraded":"2023-10-09T11:42:56.290063+0000","last_fullsized":"2023-10-09T11:42:56.290063+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:50.495963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.950168+0000","last_change":"2023-10-09T11:42:56.950168+0000","last_active":"2023-10-09T11:42:56.950168+0000","last_peered":"2023-10-09T11:42:56.950168+0000","last_clean":"2023-10-09T11:42:56.950168+0000","last_became_active":"2023-10-09T11:42:56.949813+0000","last_became_peered":"2023-10-09T11:42:56.949813+0000","last_unstale":"2023-10-09T11:42:56.950168+0000","last_undegraded":"2023-10-09T11:42:56.950168+0000","last_fullsized":"2023-10-09T11:42:56.950168+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:56.277618+0000","last_clean_scrub_stamp":"2023-10-09T11:42:56.277618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:39.249792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"145'2","reported_seq":11,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-09T11:42:57.299773+0000","last_change":"2023-10-09T11:42:56.294858+0000","last_active":"2023-10-09T11:42:57.299773+0000","last_peered":"2023-10-09T11:42:57.299773+0000","last_clean":"2023-10-09T11:42:57.299773+0000","last_became_active":"2023-10-09T11:42:56.294675+0000","last_became_peered":"2023-10-09T11:42:56.294675+0000","last_unstale":"2023-10-09T11:42:57.299773+0000","last_undegraded":"2023-10-09T11:42:57.299773+0000","last_fullsized":"2023-10-09T11:42:57.299773+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:42:55.273335+0000","last_clean_scrub_stamp":"2023-10-09T11:42:55.273335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:24:33.261539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":267,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-09T11:42:56.289445+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:42:56.289445+0000","last_peered":"2023-10-09T11:42:56.289445+0000","last_clean":"2023-10-09T11:42:56.289445+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:42:56.289445+0000","last_undegraded":"2023-10-09T11:42:56.289445+0000","last_fullsized":"2023-10-09T11:42:56.289445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193950,"statfs":{"total":200000000,"available":198605470,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.745},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70799999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.751,"5min":0.79200000000000004,"15min":0.878},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69999999999999996,"5min":0.72699999999999998,"15min":0.88900000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74199999999999999,"5min":0.78700000000000003,"15min":0.90200000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":1.048},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":1.079},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44600000000000001,"15min":0.42899999999999999},"min":{"1min":0.33400000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46300000000000002,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.441}]},{"osd":6,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69099999999999995,"5min":0.87,"15min":0.92700000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199196448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53500000000000003,"15min":0.61599999999999999},"min":{"1min":0.307,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":3.7589999999999999},"last":0.504},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.66200000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.67400000000000004},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72999999999999998,"5min":0.77900000000000003,"15min":5.298},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64800000000000002,"5min":0.73399999999999999,"15min":5.3540000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":1.6060000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":1.617},"last":0.73699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":5.46},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.80300000000000005,"15min":5.3949999999999996},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.44800000000000001},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.80600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76000000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48499999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.34799999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64700000000000002,"5min":0.72599999999999998,"15min":0.80000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52000000000000002,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40799999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197984,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.34200000000000003,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46700000000000003,"5min":0.623,"15min":1.9370000000000001},"last":0.37},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.37,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45800000000000002,"5min":0.66500000000000004,"15min":2.004},"last":0.246}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.36399999999999999,"15min":0.40699999999999997},"min":{"1min":0.26200000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.501,"5min":0.64000000000000001,"15min":2.2589999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40799999999999997,"15min":0.40899999999999997},"min":{"1min":0.28599999999999998,"5min":0.26300000000000001,"15min":0.26200000000000001},"max":{"1min":0.57699999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57299999999999995,"5min":0.77000000000000002,"15min":1.909},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.41399999999999998,"15min":0.45900000000000002},"min":{"1min":0.29499999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.51000000000000001,"5min":0.78200000000000003,"15min":2.0369999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":0.872,"15min":1.869},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.84699999999999998,"5min":0.93000000000000005,"15min":1.9790000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.91400000000000003,"15min":2.1960000000000002},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.66000000000000003},"min":{"1min":0.46000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.76400000000000001,"5min":0.92200000000000004,"15min":1.952},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61899999999999999,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.94999999999999996,"15min":2.2280000000000002},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.86299999999999999,"15min":1.782},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":1.819},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1358,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193953,"statfs":{"total":200000000,"available":198608627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.45000000000000001,"15min":0.41499999999999998},"min":{"1min":0.23899999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39700000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22},"max":{"1min":0.53300000000000003,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.223},"max":{"1min":0.63400000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42199999999999999,"15min":0.5},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55900000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.371},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64800000000000002,"5min":2.194,"15min":2.194},"last":0.39300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.86799999999999999,"5min":1.508,"15min":1.508},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85499999999999998,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63400000000000001,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81599999999999995,"5min":2.379,"15min":3.976},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.93300000000000005,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.435,"15min":0.435},"max":{"1min":0.95999999999999996,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.63800000000000001},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45800000000000002,"5min":0.437,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":1.593,"15min":1.593},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68899999999999995,"15min":0.76700000000000002},"min":{"1min":0.48899999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.91600000000000004,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199197396,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36699999999999999,"15min":0.32600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51200000000000001,"5min":0.622,"15min":0.622},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38400000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55900000000000005,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35499999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.25,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53200000000000003,"5min":0.61599999999999999,"15min":0.61899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41699999999999998,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58599999999999997,"5min":0.71199999999999997,"15min":11.055},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38100000000000001},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.39900000000000002},"min":{"1min":0.307,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.627,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.999,"15min":0.999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":1.097,"15min":1.097},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.96499999999999997,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93100000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.34100000000000003,"15min":0.371},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.442,"5min":0.64800000000000002,"15min":1.3069999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.55400000000000005,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.313}]},{"osd":1,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.21299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51100000000000001,"5min":0.57399999999999995,"15min":1.034},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.72899999999999998,"15min":1.335},"last":0.28399999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.53600000000000003,"5min":0.68999999999999995,"15min":1.1200000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.434,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61399999999999999,"5min":0.69499999999999995,"15min":1.405},"last":0.33300000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73599999999999999,"5min":0.91100000000000003,"15min":0.98399999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":1.387,"15min":1.387},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.96399999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.40300000000000002,"15min":0.40100000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.3819999999999999},"last":0.46899999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.95199999999999996,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":1.0109999999999999},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":789,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194523,"statfs":{"total":200000000,"available":199191626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54600000000000004,"15min":0.73699999999999999},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.27300000000000002},"max":{"1min":0.72099999999999997,"5min":0.76400000000000001,"15min":7.4210000000000003},"last":0.442},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.38400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.53500000000000003},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56499999999999995,"15min":0.53600000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":5.274},"last":0.51400000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56599999999999995,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.80400000000000005},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.76700000000000002,"5min":0.83899999999999997,"15min":7.5460000000000003},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73399999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.72099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42399999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":783,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194529,"statfs":{"total":200000000,"available":199197872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65500000000000003,"5min":0.77600000000000002,"15min":1.2729999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.379,"5min":0.31,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.751,"15min":0.75600000000000001},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67600000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.501},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":1.1839999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.67900000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68600000000000005,"5min":0.84199999999999997,"15min":0.96399999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78600000000000003,"5min":0.86899999999999999,"15min":0.98899999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67200000000000004,"5min":0.69999999999999996,"15min":0.88500000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.45000000000000001,"15min":0.47699999999999998},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.747,"15min":0.78000000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.503},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:42:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.71399999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.54100000000000004},"min":{"1min":0.43099999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81499999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T11:43:01.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:43:01.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:43:01.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.939+0000 7f39ac37c700 1 Processor -- start 2023-10-09T11:43:01.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.939+0000 7f39ac37c700 1 -- start start 2023-10-09T11:43:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39ac37c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39ac37c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39a4157b90 0x7f39a40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39ac37c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a40cca80 con 0x7f39a41577c0 2023-10-09T11:43:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39ac37c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40cedd0 con 0x7f39a4157b90 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39ac37c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40cc210 con 0x7f39a4068f20 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39a9917700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39a4157b90 0x7f39a40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39a9917700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:37406/0 (socket says 172.21.15.6:37406) 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa118700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f39a41577c0 0x7f39a4068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:56338/0 (socket says 172.21.15.6:56338) 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39a4157b90 0x7f39a40cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:59312/0 (socket says 172.21.15.6:59312) 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa118700 1 -- 172.21.15.6:0/1827607336 learned_addr learned my addr 172.21.15.6:0/1827607336 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 -- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 msgr2=0x7f39a40cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 -- 172.21.15.6:0/1827607336 >> v1:172.21.15.118:6789/0 conn(0x7f39a41577c0 legacy=0x7f39a4068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39aa919700 1 -- 172.21.15.6:0/1827607336 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40cc4c0 con 0x7f39a4157b90 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.940+0000 7f39a9116700 1 -- 172.21.15.6:0/1827607336 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748796877 0 0) 0x7f39a40cca80 con 0x7f39a41577c0 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39a9917700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39aa919700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4157b90 0x7f39a40cbcd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f39940098e0 tx=0x7f39940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c0595a8553d8f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39a9116700 1 -- 172.21.15.6:0/1827607336 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400b640 con 0x7f39a4157b90 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39a9116700 1 -- 172.21.15.6:0/1827607336 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399400b7a0 con 0x7f39a4157b90 2023-10-09T11:43:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39a9116700 1 -- 172.21.15.6:0/1827607336 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400bb40 con 0x7f39a4157b90 2023-10-09T11:43:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 -- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4157b90 msgr2=0x7f39a40cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4157b90 0x7f39a40cbcd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f39940098e0 tx=0x7f39940091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 -- 172.21.15.6:0/1827607336 shutdown_connections 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4157b90 0x7f39a40cbcd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 --2- 172.21.15.6:0/1827607336 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a40cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 -- 172.21.15.6:0/1827607336 >> 172.21.15.6:0/1827607336 conn(0x7f39a40d0df0 msgr2=0x7f39a40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.941+0000 7f39ac37c700 1 -- 172.21.15.6:0/1827607336 shutdown_connections 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.942+0000 7f39ac37c700 1 -- 172.21.15.6:0/1827607336 wait complete. 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 Processor -- start 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 -- start start 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a41603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a41577c0 0x7f39a41458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4145e10 con 0x7f39a4157b90 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a415b380 con 0x7f39a41577c0 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.943+0000 7f39ac37c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a415aac0 con 0x7f39a4068f20 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37838/0 (socket says 172.21.15.6:37838) 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 -- 172.21.15.6:0/3072306974 learned_addr learned my addr 172.21.15.6:0/3072306974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39a9917700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a41577c0 0x7f39a41458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa118700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a41603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 -- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 msgr2=0x7f39a41603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a41603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 -- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a41577c0 msgr2=0x7f39a41458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a41577c0 0x7f39a41458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 -- 172.21.15.6:0/3072306974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998009420 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39aa919700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f3994013000 tx=0x7f3994017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399400bb20 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994011420 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3994009420 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940117a0 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.944+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a415b010 con 0x7f39a4157b90 2023-10-09T11:43:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.945+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a415b530 con 0x7f39a4157b90 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.945+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3994011b10 con 0x7f39a4157b90 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.946+0000 7f39a27fc700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.946+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3994085ec0 con 0x7f39a4157b90 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.946+0000 7f39aa118700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.946+0000 7f39aa118700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 0x7f39900693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f399c002230 tx=0x7f399c001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:01.950+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3994053130 con 0x7f39a4157b90 2023-10-09T11:43:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.230+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f39a40cc7a0 con 0x7f39a4157b90 2023-10-09T11:43:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.233+0000 7f39a27fc700 1 -- 172.21.15.6:0/3072306974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3994056750 con 0x7f39a4157b90 2023-10-09T11:43:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 msgr2=0x7f39900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 0x7f39900693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f399c002230 tx=0x7f399c001a20 comp rx=0 tx=0).stop 2023-10-09T11:43:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 msgr2=0x7f39a4154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f3994013000 tx=0x7f3994017000 comp rx=0 tx=0).stop 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 shutdown_connections 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3990066f30 0x7f39900693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a4157b90 0x7f39a4154b10 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39a4068f20 0x7f39a41603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 --2- 172.21.15.6:0/3072306974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a41577c0 0x7f39a41458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.235+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 >> 172.21.15.6:0/3072306974 conn(0x7f39a40d0df0 msgr2=0x7f39a41599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.236+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 shutdown_connections 2023-10-09T11:43:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.236+0000 7f39ac37c700 1 -- 172.21.15.6:0/3072306974 wait complete. 2023-10-09T11:43:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:43:02.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:02.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.367+0000 7f8417b58700 1 Processor -- start 2023-10-09T11:43:02.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.367+0000 7f8417b58700 1 -- start start 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f8417b58700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8410157fe0 0x7f84100b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f8417b58700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100b2890 con 0x7f84100cf240 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f8417b58700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100b4070 con 0x7f84101583b0 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f8417b58700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100b4350 con 0x7f8410157fe0 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f84160f5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84100cf240 0x7f8410158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42532/0 (socket says 172.21.15.6:42532) 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.368+0000 7f84160f5700 1 -- 172.21.15.6:0/3934358629 learned_addr learned my addr 172.21.15.6:0/3934358629 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84158f4700 1 --2- 172.21.15.6:0/3934358629 >> v2:172.21.15.118:3300/0 conn(0x7f8410157fe0 0x7f84100b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914219310 0 0) 0x7f84100b2890 con 0x7f84100cf240 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f8003570 con 0x7f84100cf240 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309374420 0 0) 0x7f84100b4070 con 0x7f84101583b0 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84100b2890 con 0x7f84101583b0 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525216587 0 0) 0x7f83f8003570 con 0x7f84100cf240 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84158f4700 1 -- 172.21.15.6:0/3934358629 >> v1:172.21.15.118:6789/0 conn(0x7f84101583b0 legacy=0x7f84100ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84158f4700 1 -- 172.21.15.6:0/3934358629 >> v1:172.21.15.6:6789/0 conn(0x7f84100cf240 legacy=0x7f8410158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84158f4700 1 -- 172.21.15.6:0/3934358629 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100b4630 con 0x7f8410157fe0 2023-10-09T11:43:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84158f4700 1 --2- 172.21.15.6:0/3934358629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8410157fe0 0x7f84100b34c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84080098e0 tx=0x7f84080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cea2d7210f4d50a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000017f0 con 0x7f8410157fe0 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408011420 con 0x7f8410157fe0 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.369+0000 7f84148f2700 1 -- 172.21.15.6:0/3934358629 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080117c0 con 0x7f8410157fe0 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 -- 172.21.15.6:0/3934358629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8410157fe0 msgr2=0x7f84100b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 --2- 172.21.15.6:0/3934358629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8410157fe0 0x7f84100b34c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84080098e0 tx=0x7f84080091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 -- 172.21.15.6:0/3934358629 shutdown_connections 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 --2- 172.21.15.6:0/3934358629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8410157fe0 0x7f84100b34c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 -- 172.21.15.6:0/3934358629 >> 172.21.15.6:0/3934358629 conn(0x7f8410067640 msgr2=0x7f8410067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 -- 172.21.15.6:0/3934358629 shutdown_connections 2023-10-09T11:43:02.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.370+0000 7f8417b58700 1 -- 172.21.15.6:0/3934358629 wait complete. 2023-10-09T11:43:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.371+0000 7f8417b58700 1 Processor -- start 2023-10-09T11:43:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.371+0000 7f8417b58700 1 -- start start 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8410157fe0 0x7f84100cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84101583b0 0x7f841013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841016cbb0 con 0x7f84100cf240 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c48f0 con 0x7f84101583b0 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f8417b58700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c3ce0 con 0x7f8410157fe0 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37840/0 (socket says 172.21.15.6:37840) 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 -- 172.21.15.6:0/3117097481 learned_addr learned my addr 172.21.15.6:0/3117097481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84160f5700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84101583b0 0x7f841013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84150f3700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8410157fe0 0x7f84100cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 -- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8410157fe0 msgr2=0x7f84100cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8410157fe0 0x7f84100cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 -- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84101583b0 msgr2=0x7f841013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84101583b0 0x7f841013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 -- 172.21.15.6:0/3117097481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009420 con 0x7f84100cf240 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.372+0000 7f84158f4700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f841006f990 tx=0x7f8408016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.373+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840801cb30 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.373+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840801cc90 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.373+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100c3fc0 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.373+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408025680 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.373+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84100c4580 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.374+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410069e40 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.374+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84080193f0 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.375+0000 7f840dffb700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 0x7f83fc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.375+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84080857d0 con 0x7f84100cf240 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.375+0000 7f84150f3700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 0x7f83fc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.375+0000 7f84150f3700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 0x7f83fc069410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8404007fd0 tx=0x7f8404007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.379+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84080529a0 con 0x7f84100cf240 2023-10-09T11:43:02.611 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-10-09T11:43:02.610+0000 7f67b786c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:43:02.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.615+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84100cc6b0 con 0x7f84100cf240 2023-10-09T11:43:02.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.615+0000 7f840dffb700 1 -- 172.21.15.6:0/3117097481 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8408055fc0 con 0x7f84100cf240 2023-10-09T11:43:02.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:02.617 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 msgr2=0x7f83fc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 0x7f83fc069410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8404007fd0 tx=0x7f8404007d50 comp rx=0 tx=0).stop 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 msgr2=0x7f841016c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f841006f990 tx=0x7f8408016000 comp rx=0 tx=0).stop 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 shutdown_connections 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f83fc066f60 0x7f83fc069410 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84101583b0 0x7f841013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84100cf240 0x7f841016c670 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 --2- 172.21.15.6:0/3117097481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8410157fe0 0x7f84100cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 >> 172.21.15.6:0/3117097481 conn(0x7f8410067640 msgr2=0x7f84100b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 shutdown_connections 2023-10-09T11:43:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:02.618+0000 7f8417b58700 1 -- 172.21.15.6:0/3117097481 wait complete. 2023-10-09T11:43:02.621 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:43:03.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:42:56.685032+0000', 'modified': '2023-10-09T11:43:00.305377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7485': {'gid': 7485, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6836/1461794471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 1461794471}, {'type': 'v1', 'addr': '172.21.15.6:6836', 'nonce': 1461794471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:43:03.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:43:03.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T11:43:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.153+0000 7fa145bd4700 1 Processor -- start 2023-10-09T11:43:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 -- start start 2023-10-09T11:43:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa14015daa0 0x7fa14015de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1400cae00 0x7fa140159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14006d350 con 0x7fa1400cb270 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1400c9ac0 con 0x7fa1400cae00 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.154+0000 7fa145bd4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14015e3b0 con 0x7fa14015daa0 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1400cae00 0x7fa140159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1400cb270 0x7fa140159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42546/0 (socket says 172.21.15.6:42546) 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1400cae00 0x7fa140159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37844/0 (socket says 172.21.15.6:37844) 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13ffff700 1 -- 172.21.15.6:0/2459932175 learned_addr learned my addr 172.21.15.6:0/2459932175 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa14015daa0 0x7fa14015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 -- 172.21.15.6:0/2459932175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa14015daa0 msgr2=0x7fa14015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa14015daa0 0x7fa14015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 -- 172.21.15.6:0/2459932175 >> v1:172.21.15.6:6789/0 conn(0x7fa1400cb270 legacy=0x7fa140159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 -- 172.21.15.6:0/2459932175 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14006c740 con 0x7fa1400cae00 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13e7fc700 1 -- 172.21.15.6:0/2459932175 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461713698 0 0) 0x7fa14006d350 con 0x7fa1400cb270 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13effd700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1400cae00 0x7fa140159540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa1340098e0 tx=0x7fa1340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2e5067968b996c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13e7fc700 1 -- 172.21.15.6:0/2459932175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400b640 con 0x7fa1400cae00 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13e7fc700 1 -- 172.21.15.6:0/2459932175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13400b7a0 con 0x7fa1400cae00 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.155+0000 7fa13e7fc700 1 -- 172.21.15.6:0/2459932175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400bb40 con 0x7fa1400cae00 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 -- 172.21.15.6:0/2459932175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1400cae00 msgr2=0x7fa140159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1400cae00 0x7fa140159540 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa1340098e0 tx=0x7fa1340091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 -- 172.21.15.6:0/2459932175 shutdown_connections 2023-10-09T11:43:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa14015daa0 0x7fa14015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 --2- 172.21.15.6:0/2459932175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1400cae00 0x7fa140159540 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 -- 172.21.15.6:0/2459932175 >> 172.21.15.6:0/2459932175 conn(0x7fa1400c9ca0 msgr2=0x7fa1400ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 -- 172.21.15.6:0/2459932175 shutdown_connections 2023-10-09T11:43:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.156+0000 7fa145bd4700 1 -- 172.21.15.6:0/2459932175 wait complete. 2023-10-09T11:43:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.157+0000 7fa145bd4700 1 Processor -- start 2023-10-09T11:43:03.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.157+0000 7fa145bd4700 1 -- start start 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 0x7fa1400b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1400cb270 0x7fa1400c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400ade20 con 0x7fa14015daa0 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400ae100 con 0x7fa1400cae00 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa145bd4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400ae3e0 con 0x7fa1400cb270 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37852/0 (socket says 172.21.15.6:37852) 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 -- 172.21.15.6:0/766963740 learned_addr learned my addr 172.21.15.6:0/766963740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13effd700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1400cb270 0x7fa1400c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 0x7fa1400b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 -- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1400cb270 msgr2=0x7fa1400c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1400cb270 0x7fa1400c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 -- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 msgr2=0x7fa1400b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 0x7fa1400b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 -- 172.21.15.6:0/766963740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134009420 con 0x7fa14015daa0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 0x7fa1400b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa13ffff700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa13800cc90 tx=0x7fa138001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa1277fe700 1 -- 172.21.15.6:0/766963740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800a960 con 0x7fa14015daa0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.158+0000 7fa1277fe700 1 -- 172.21.15.6:0/766963740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800aac0 con 0x7fa14015daa0 2023-10-09T11:43:03.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.159+0000 7fa1277fe700 1 -- 172.21.15.6:0/766963740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800ae80 con 0x7fa14015daa0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.159+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400ae6c0 con 0x7fa14015daa0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.159+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400ada40 con 0x7fa14015daa0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.160+0000 7fa1277fe700 1 -- 172.21.15.6:0/766963740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa138007300 con 0x7fa14015daa0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.160+0000 7fa1277fe700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 0x7fa12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.160+0000 7fa1277fe700 1 -- 172.21.15.6:0/766963740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa138084910 con 0x7fa14015daa0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.160+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 0x7fa12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.161+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 0x7fa12c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa130009d80 tx=0x7fa130008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.162+0000 7fa14eeccb80 1 Processor -- start 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.162+0000 7fa14eeccb80 1 -- start start 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866f3f60 0x558e866c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e86621a70 con 0x558e866caa50 2023-10-09T11:43:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e8661f270 con 0x558e866f3f60 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e8661b060 con 0x558e86714d00 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37858/0 (socket says 172.21.15.6:37858) 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13f7fe700 1 -- 172.21.15.6:0/339894294 learned_addr learned my addr 172.21.15.6:0/339894294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13ffff700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866f3f60 0x558e866c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13effd700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.163+0000 7fa13f7fe700 1 -- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 msgr2=0x558e866f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13f7fe700 1 -- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866f3f60 msgr2=0x558e866c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866f3f60 0x558e866c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13f7fe700 1 -- 172.21.15.6:0/339894294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e864b5270 con 0x558e866caa50 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13effd700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa130011f00 tx=0x7fa130018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af44348e90b840e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa124ff9700 1 -- 172.21.15.6:0/339894294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130015c60 con 0x558e866caa50 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa124ff9700 1 -- 172.21.15.6:0/339894294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130015dc0 con 0x558e866caa50 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa124ff9700 1 -- 172.21.15.6:0/339894294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130021440 con 0x558e866caa50 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa14eeccb80 1 -- 172.21.15.6:0/339894294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 msgr2=0x558e866cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.164+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa130011f00 tx=0x7fa130018000 comp rx=0 tx=0).stop 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 -- 172.21.15.6:0/339894294 shutdown_connections 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866f3f60 0x558e866c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866cae20 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/339894294 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 -- 172.21.15.6:0/339894294 >> 172.21.15.6:0/339894294 conn(0x558e866cc370 msgr2=0x558e866cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 -- 172.21.15.6:0/339894294 shutdown_connections 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 -- 172.21.15.6:0/339894294 wait complete. 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 -- start start 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.165+0000 7fa14eeccb80 1 Processor -- start 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8670ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e8670b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e865c6890 con 0x558e866caa50 2023-10-09T11:43:03.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e865e1ea0 con 0x558e86714d00 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e8649de30 con 0x558e866f3f60 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa14eeccb80 10 client.0 _ll_register_callbacks cb 0x558e8668e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37864/0 (socket says 172.21.15.6:37864) 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 -- 172.21.15.6:0/3714449754 learned_addr learned my addr 172.21.15.6:0/3714449754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13ffff700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e8670b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 -- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 msgr2=0x558e8670ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8670ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 -- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 msgr2=0x558e8670b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e8670b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.166+0000 7fa13f7fe700 1 -- 172.21.15.6:0/3714449754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa130011ad0 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa130008010 tx=0x7fa13001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5306f3369065af server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130021440 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e866bfb70 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa130015be0 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa130006e50 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 10 client.7620 fetch_fsmap learned FSMap version 76 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x558e86457fe0 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e866bfb70 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa130036cc0 con 0x558e866caa50 2023-10-09T11:43:03.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 10 client.7620 fetch_fsmap finished waiting for FSMap version 76 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 10 client.7620 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 20 client.7620 populate_metadata read hostname 'smithi006' 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e866f05c0 0x558e8670dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 4 client.7620 mds_command: new command op to 7485 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 --> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e8669caa0 con 0x558e866f05c0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.167+0000 7fa13effd700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e866f05c0 0x558e8670dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.168+0000 7fa13effd700 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e866f05c0 0x558e8670dd20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e17bf3321b4a9be1 server_cookie=ff3db949ddac4557 in_seq=0 out_seq=0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.168+0000 7fa11dffb700 10 client.7620 ms_handle_connect on v2:172.21.15.6:6834/1461794471 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.168+0000 7fa11dffb700 1 -- 172.21.15.6:0/3714449754 <== mds.0 v2:172.21.15.6:6834/1461794471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558e8669caa0 con 0x558e866f05c0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.168+0000 7fa11dffb700 10 client.7620 handle_command_reply: tid=0 2023-10-09T11:43:03.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.168+0000 7fa14eeccb80 1 client.7620 shutdown 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 msgr2=0x558e86711a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa130008010 tx=0x7fa13001b000 comp rx=0 tx=0).stop 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 shutdown_connections 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e866f05c0 0x558e8670dd20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e8670b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa11dffb700 0 client.7620 ms_handle_reset on v2:172.21.15.6:6834/1461794471 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e86711a20 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/3714449754 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8670ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 >> 172.21.15.6:0/3714449754 conn(0x558e866cc370 msgr2=0x558e86710520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 shutdown_connections 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 1 -- 172.21.15.6:0/3714449754 wait complete. 2023-10-09T11:43:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.169+0000 7fa14eeccb80 20 client.7620 trim_cache size 0 max 16384 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.186+0000 7fa14eeccb80 1 Processor -- start 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.186+0000 7fa14eeccb80 1 -- start start 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8676d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e866fa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e866ce5c0 con 0x558e866caa50 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e866aa510 con 0x558e86714d00 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e866ca330 con 0x558e866f3f60 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37872/0 (socket says 172.21.15.6:37872) 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 -- 172.21.15.6:0/174307062 learned_addr learned my addr 172.21.15.6:0/174307062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13effd700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8676d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13ffff700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e866fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 -- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 msgr2=0x558e8676d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8676d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 -- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 msgr2=0x558e866fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e866fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 -- 172.21.15.6:0/174307062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e865e9780 con 0x558e866caa50 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13ffff700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e866fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.187+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa130011a80 tx=0x7fa13002d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ffcbc9493c22ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa1257fa700 1 -- 172.21.15.6:0/174307062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130006e50 con 0x558e866caa50 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa1257fa700 1 -- 172.21.15.6:0/174307062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130011ea0 con 0x558e866caa50 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa1257fa700 1 -- 172.21.15.6:0/174307062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130021440 con 0x558e866caa50 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 -- 172.21.15.6:0/174307062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 msgr2=0x558e866ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa130011a80 tx=0x7fa13002d040 comp rx=0 tx=0).stop 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 -- 172.21.15.6:0/174307062 shutdown_connections 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e86714d00 0x558e866fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866caa50 0x558e866ef270 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/174307062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e866f3f60 0x558e8676d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 -- 172.21.15.6:0/174307062 >> 172.21.15.6:0/174307062 conn(0x558e866cc370 msgr2=0x558e86710380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 -- 172.21.15.6:0/174307062 shutdown_connections 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.188+0000 7fa14eeccb80 1 -- 172.21.15.6:0/174307062 wait complete. 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.189+0000 7fa14eeccb80 1 -- start start 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.189+0000 7fa14eeccb80 1 Processor -- start 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866caa50 0x558e8676a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e86777ae0 con 0x558e866f3f60 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e866eeac0 con 0x558e866caa50 2023-10-09T11:43:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e8676d830 con 0x558e86714d00 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 10 client.0 _ll_register_callbacks cb 0x558e8668e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37888/0 (socket says 172.21.15.6:37888) 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 -- 172.21.15.6:0/2501614703 learned_addr learned my addr 172.21.15.6:0/2501614703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13ffff700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866caa50 0x558e8676a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 -- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 msgr2=0x558e866f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 -- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866caa50 msgr2=0x558e8676a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866caa50 0x558e8676a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 -- 172.21.15.6:0/2501614703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e86457fe0 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa13effd700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa14006ebb0 tx=0x7fa13401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f203fd5e025069 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa11dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa134027500 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa134031af0 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa130015dc0 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa134027660 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 10 client.7626 fetch_fsmap learned FSMap version 76 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.190+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x558e865d0470 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130015dc0 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa1340277c0 con 0x558e866f3f60 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 10 client.7626 fetch_fsmap finished waiting for FSMap version 76 2023-10-09T11:43:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 20 client.7626 populate_metadata read hostname 'smithi006' 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e86776eb0 0x558e86777280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 4 client.7626 mds_command: new command op to 7485 tid=0[{"prefix": "status"}] 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 --> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558e865bde00 con 0x558e86776eb0 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e86776eb0 0x558e86777280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa11dffb700 10 client.7626 ms_handle_connect on v2:172.21.15.6:6834/1461794471 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa13f7fe700 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e86776eb0 0x558e86777280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a21a666a5e6bf2 server_cookie=1c848c4a121b0bf1 in_seq=0 out_seq=0 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa11dffb700 1 -- 172.21.15.6:0/2501614703 <== mds.0 v2:172.21.15.6:6834/1461794471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558e865bde00 con 0x558e86776eb0 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa11dffb700 10 client.7626 handle_command_reply: tid=0 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 1 client.7626 shutdown 2023-10-09T11:43:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 msgr2=0x558e866f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.191+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa14006ebb0 tx=0x7fa13401c040 comp rx=0 tx=0).stop 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 shutdown_connections 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:6834/1461794471,v1:172.21.15.6:6836/1461794471] conn(0x558e86776eb0 0x558e86777280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x558e86714d00 0x558e866f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e866caa50 0x558e8676a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa11dffb700 0 client.7626 ms_handle_reset on v2:172.21.15.6:6834/1461794471 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 --2- 172.21.15.6:0/2501614703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558e866f3f60 0x558e866f30f0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 >> 172.21.15.6:0/2501614703 conn(0x558e866cc370 msgr2=0x558e866c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 shutdown_connections 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 1 -- 172.21.15.6:0/2501614703 wait complete. 2023-10-09T11:43:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa14eeccb80 20 client.7626 trim_cache size 0 max 16384 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7485, 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:43:03.204 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9006628870000002, 2023-10-09T11:43:03.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 76, 2023-10-09T11:43:03.205 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 146, 2023-10-09T11:43:03.205 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 146, 2023-10-09T11:43:03.205 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.980538632 2023-10-09T11:43:03.205 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:43:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 msgr2=0x7fa12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 0x7fa12c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa130009d80 tx=0x7fa130008040 comp rx=0 tx=0).stop 2023-10-09T11:43:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 msgr2=0x7fa1400aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa13800cc90 tx=0x7fa138001a80 comp rx=0 tx=0).stop 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 shutdown_connections 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa12c066f30 0x7fa12c0693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa14015daa0 0x7fa1400aeea0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1400cae00 0x7fa1400b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 --2- 172.21.15.6:0/766963740 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1400cb270 0x7fa1400c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 >> 172.21.15.6:0/766963740 conn(0x7fa1400c9ca0 msgr2=0x7fa140069130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 shutdown_connections 2023-10-09T11:43:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.192+0000 7fa145bd4700 1 -- 172.21.15.6:0/766963740 wait complete. 2023-10-09T11:43:03.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.325+0000 7f7d46430700 1 Processor -- start 2023-10-09T11:43:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.325+0000 7f7d46430700 1 -- start start 2023-10-09T11:43:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d46430700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d400aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d46430700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4015dfb0 con 0x7f7d400ce5c0 2023-10-09T11:43:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d46430700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400acec0 con 0x7f7d400ac570 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d46430700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ad1a0 con 0x7f7d400ce1f0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d3f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d400ce5c0 0x7f7d4015e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48140/0 (socket says 172.21.15.6:48140) 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d3f7fe700 1 -- 172.21.15.6:0/3716087024 learned_addr learned my addr 172.21.15.6:0/3716087024 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d3ffff700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d400aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.326+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757879890 0 0) 0x7f7d4015dfb0 con 0x7f7d400ce5c0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d28003570 con 0x7f7d400ce5c0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896202038 0 0) 0x7f7d28003570 con 0x7f7d400ce5c0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 msgr2=0x7f7d400aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d400aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 >> v1:172.21.15.118:6789/0 conn(0x7f7d400ac570 legacy=0x7f7d4006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4015dc40 con 0x7f7d400ce5c0 2023-10-09T11:43:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f7d34001470 con 0x7f7d400ce5c0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 >> v1:172.21.15.6:6789/0 conn(0x7f7d400ce5c0 legacy=0x7f7d4015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d28003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d28004d50 0x7f7d280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ad1a0 con 0x7f7d28003fd0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800bb40 con 0x7f7d28004d50 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2800bd00 con 0x7f7d400ce1f0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3ffff700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d28003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d449cd700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d28004d50 0x7f7d280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 -- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 msgr2=0x7f7d28003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ce1f0 0x7f7d28003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 -- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d28004d50 msgr2=0x7f7d280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d28004d50 0x7f7d280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.327+0000 7f7d3f7fe700 1 -- 172.21.15.6:0/3716087024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28003570 con 0x7f7d28003fd0 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d28004810 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400c3c0 tx=0x7f7d34001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7528478b7a6ff36 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400cc90 con 0x7f7d28003fd0 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400cdf0 con 0x7f7d28003fd0 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d3effd700 1 -- 172.21.15.6:0/3716087024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34005b70 con 0x7f7d28003fd0 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 -- 172.21.15.6:0/3716087024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 msgr2=0x7f7d28004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 --2- 172.21.15.6:0/3716087024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d28004810 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400c3c0 tx=0x7f7d34001e70 comp rx=0 tx=0).stop 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d449cd700 1 -- 172.21.15.6:0/3716087024 reap_dead start 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 -- 172.21.15.6:0/3716087024 shutdown_connections 2023-10-09T11:43:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 -- 172.21.15.6:0/3716087024 >> 172.21.15.6:0/3716087024 conn(0x7f7d4006cca0 msgr2=0x7f7d4006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 -- 172.21.15.6:0/3716087024 shutdown_connections 2023-10-09T11:43:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.328+0000 7f7d46430700 1 -- 172.21.15.6:0/3716087024 wait complete. 2023-10-09T11:43:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.329+0000 7f7d46430700 1 Processor -- start 2023-10-09T11:43:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 -- start start 2023-10-09T11:43:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 0x7f7d40155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d400ae2c0 0x7f7d400aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400afba0 con 0x7f7d28003fd0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c3940 con 0x7f7d400ae2c0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d46430700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c3380 con 0x7f7d400ccdd0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48254/0 (socket says 172.21.15.6:48254) 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d3ffff700 1 -- 172.21.15.6:0/2258897007 learned_addr learned my addr 172.21.15.6:0/2258897007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.330+0000 7f7d449cd700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d400ae2c0 0x7f7d400aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 0x7f7d40155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 -- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 msgr2=0x7f7d40155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 0x7f7d40155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 -- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d400ae2c0 msgr2=0x7f7d400aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d400ae2c0 0x7f7d400aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 -- 172.21.15.6:0/2258897007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400c3660 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 0x7f7d40155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d3ffff700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011d40 tx=0x7f7d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000fac0 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000fc20 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400af830 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30014440 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.331+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400ae760 con 0x7f7d28003fd0 2023-10-09T11:43:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.332+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d400afe80 con 0x7f7d28003fd0 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.332+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d30014870 con 0x7f7d28003fd0 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.333+0000 7f7d27fff700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 0x7f7d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.333+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7d30018030 con 0x7f7d28003fd0 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.333+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 0x7f7d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.333+0000 7f7d3f7fe700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 0x7f7d2c0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7d400cdf20 tx=0x7f7d34015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.337+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d30052260 con 0x7f7d28003fd0 2023-10-09T11:43:03.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.575+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7d400aca10 con 0x7f7d28003fd0 2023-10-09T11:43:03.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.576+0000 7f7d27fff700 1 -- 172.21.15.6:0/2258897007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7d30022070 con 0x7f7d28003fd0 2023-10-09T11:43:03.577 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:03.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 msgr2=0x7f7d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 0x7f7d2c0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7d400cdf20 tx=0x7f7d34015000 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 msgr2=0x7f7d400b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f7d30011d40 tx=0x7f7d300091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 shutdown_connections 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d2c066f30 0x7f7d2c0693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d400ae2c0 0x7f7d400aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28003fd0 0x7f7d400b0030 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 --2- 172.21.15.6:0/2258897007 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7d400ccdd0 0x7f7d40155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 >> 172.21.15.6:0/2258897007 conn(0x7f7d4006cca0 msgr2=0x7f7d4006e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 shutdown_connections 2023-10-09T11:43:03.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:03.578+0000 7f7d46430700 1 -- 172.21.15.6:0/2258897007 wait complete. 2023-10-09T11:43:03.591 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:03.591 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:03.591 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:03.592 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:03.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.592 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:43:03.607 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:43:03.608 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42078sec preferred_lft 42078sec 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:03.609 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:43:03.610 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.611 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:03.611 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:43:03.611 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:43:03.611 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:03.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.611 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:03.671 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:43:03.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.673 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:43:03.729 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:43:03.729 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:03.729 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:43:03.730 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:43:03.730 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:03.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:43:03.730 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:43:03.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.831 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:43:03.846 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:43:03.846 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:43:03.846 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:03.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:03.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:43:03.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:03.911 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:03.966 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:43:03.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:03.967 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:04.020 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:43:04.020 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:04.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:04.101 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:04.102 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:04.120 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:04.120 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:43:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:43:04.143 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:43:04.144 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:04.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:43:04.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:43:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.369+0000 7f1ea88af700 1 Processor -- start 2023-10-09T11:43:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.369+0000 7f1ea88af700 1 -- start start 2023-10-09T11:43:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea88af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea88af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ea406d120 0x7f1ea406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea88af700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea406dac0 con 0x7f1ea4157ca0 2023-10-09T11:43:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea88af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea40d07c0 con 0x7f1ea406d120 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea88af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40cfbb0 con 0x7f1ea41578d0 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.370+0000 7f1ea2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ea406d120 0x7f1ea406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ea406d120 0x7f1ea406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48264/0 (socket says 172.21.15.6:48264) 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 -- 172.21.15.6:0/728598699 learned_addr learned my addr 172.21.15.6:0/728598699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea259c700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 -- 172.21.15.6:0/728598699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 msgr2=0x7f1ea40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 -- 172.21.15.6:0/728598699 >> v1:172.21.15.118:6789/0 conn(0x7f1ea4157ca0 legacy=0x7f1ea415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 -- 172.21.15.6:0/728598699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40cfe90 con 0x7f1ea406d120 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea2d9d700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea406d580 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f1e940099b0 tx=0x7f1e94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f278807040927cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea159a700 1 -- 172.21.15.6:0/728598699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94009ea0 con 0x7f1ea406d120 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea159a700 1 -- 172.21.15.6:0/728598699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400b860 con 0x7f1ea406d120 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.371+0000 7f1ea159a700 1 -- 172.21.15.6:0/728598699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400bc00 con 0x7f1ea406d120 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 -- 172.21.15.6:0/728598699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 msgr2=0x7f1ea406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea406d580 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f1e940099b0 tx=0x7f1e94009250 comp rx=0 tx=0).stop 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 -- 172.21.15.6:0/728598699 shutdown_connections 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea406d580 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 --2- 172.21.15.6:0/728598699 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 -- 172.21.15.6:0/728598699 >> 172.21.15.6:0/728598699 conn(0x7f1ea406bb90 msgr2=0x7f1ea406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 -- 172.21.15.6:0/728598699 shutdown_connections 2023-10-09T11:43:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.372+0000 7f1ea88af700 1 -- 172.21.15.6:0/728598699 wait complete. 2023-10-09T11:43:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.373+0000 7f1ea88af700 1 Processor -- start 2023-10-09T11:43:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.373+0000 7f1ea88af700 1 -- start start 2023-10-09T11:43:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea41510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 0x7f1ea4151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4154360 con 0x7f1ea406d120 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4153750 con 0x7f1ea4157ca0 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4153a30 con 0x7f1ea41578d0 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48272/0 (socket says 172.21.15.6:48272) 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 -- 172.21.15.6:0/2523604892 learned_addr learned my addr 172.21.15.6:0/2523604892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea1d9b700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea41510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea2d9d700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 0x7f1ea4151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 -- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 msgr2=0x7f1ea41510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea41510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 -- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 msgr2=0x7f1ea4151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 0x7f1ea4151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 -- 172.21.15.6:0/2523604892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940094f0 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea2d9d700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 0x7f1ea4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea259c700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009ef0 tx=0x7f1e9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00cc20 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00f040 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4153d10 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c014480 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.374+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea414f9c0 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.375+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea4067ac0 con 0x7f1ea406d120 2023-10-09T11:43:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.376+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e9c0147f0 con 0x7f1ea406d120 2023-10-09T11:43:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.376+0000 7f1e9a7fc700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 0x7f1e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.376+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e9c085230 con 0x7f1ea406d120 2023-10-09T11:43:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.376+0000 7f1ea1d9b700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 0x7f1e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.377+0000 7f1ea1d9b700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 0x7f1e840693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1ea406d730 tx=0x7f1e8c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.380+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e9c0524a0 con 0x7f1ea406d120 2023-10-09T11:43:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.620+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ea40d0170 con 0x7f1ea406d120 2023-10-09T11:43:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.620+0000 7f1e9a7fc700 1 -- 172.21.15.6:0/2523604892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e9c055ac0 con 0x7f1ea406d120 2023-10-09T11:43:04.622 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:43:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 msgr2=0x7f1e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 0x7f1e840693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1ea406d730 tx=0x7f1e8c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 msgr2=0x7f1ea414f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009ef0 tx=0x7f1e9c00b040 comp rx=0 tx=0).stop 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 shutdown_connections 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1e84066f30 0x7f1e840693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ea4157ca0 0x7f1ea4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ea406d120 0x7f1ea414f480 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 --2- 172.21.15.6:0/2523604892 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1ea41578d0 0x7f1ea41510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 >> 172.21.15.6:0/2523604892 conn(0x7f1ea406bb90 msgr2=0x7f1ea415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 shutdown_connections 2023-10-09T11:43:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:04.622+0000 7f1ea88af700 1 -- 172.21.15.6:0/2523604892 wait complete. 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:43:04.636 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:04.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.637 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:04.655 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42090sec preferred_lft 42090sec 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:43:04.656 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:43:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:43:04.658 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:43:04.658 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:43:04.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.658 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:43:04.722 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:43:04.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.723 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:43:04.780 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:43:04.780 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:43:04.780 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:43:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:43:04.781 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:43:04.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:43:04.781 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:43:04.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:04.867 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:04.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.885 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:43:04.939 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:43:04.939 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:43:04.939 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:04.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:04.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:43:05.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:05.008 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:05.062 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:43:05.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:43:05.063 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:05.116 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:43:05.116 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:43:05.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:05.196 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:05.196 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:05.235 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:43:05.235 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:43:05.236 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:43:05.237 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:43:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:43:05.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:43:05.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:43:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.424+0000 7f398c4bd700 1 Processor -- start 2023-10-09T11:43:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.425+0000 7f398c4bd700 1 -- start start 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.425+0000 7f398c4bd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3984157fe0 0x7f39840b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398c4bd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840b2890 con 0x7f39840cf240 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398c4bd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840b4070 con 0x7f39841583b0 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398c4bd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840b4350 con 0x7f3984157fe0 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398aa5a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39840cf240 0x7f3984158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48144/0 (socket says 172.21.15.6:48144) 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398aa5a700 1 -- 172.21.15.6:0/2578136488 learned_addr learned my addr 172.21.15.6:0/2578136488 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398a259700 1 --2- 172.21.15.6:0/2578136488 >> v2:172.21.15.118:3300/0 conn(0x7f3984157fe0 0x7f39840b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967998800 0 0) 0x7f39840b2890 con 0x7f39840cf240 2023-10-09T11:43:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f396c003570 con 0x7f39840cf240 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56563440 0 0) 0x7f39840b4070 con 0x7f39841583b0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39840b2890 con 0x7f39841583b0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398a259700 1 -- 172.21.15.6:0/2578136488 >> v1:172.21.15.118:6789/0 conn(0x7f39841583b0 legacy=0x7f39840ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398a259700 1 -- 172.21.15.6:0/2578136488 >> v1:172.21.15.6:6789/0 conn(0x7f39840cf240 legacy=0x7f3984158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398a259700 1 -- 172.21.15.6:0/2578136488 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840b4630 con 0x7f3984157fe0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.426+0000 7f398a259700 1 --2- 172.21.15.6:0/2578136488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840b34c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e60 tx=0x7f397c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab332d1face4e667 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00e070 con 0x7f3984157fe0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00bab0 con 0x7f3984157fe0 2023-10-09T11:43:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f3989257700 1 -- 172.21.15.6:0/2578136488 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00be70 con 0x7f3984157fe0 2023-10-09T11:43:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 -- 172.21.15.6:0/2578136488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 msgr2=0x7f39840b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 --2- 172.21.15.6:0/2578136488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840b34c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e60 tx=0x7f397c009780 comp rx=0 tx=0).stop 2023-10-09T11:43:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 -- 172.21.15.6:0/2578136488 shutdown_connections 2023-10-09T11:43:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 --2- 172.21.15.6:0/2578136488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840b34c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 -- 172.21.15.6:0/2578136488 >> 172.21.15.6:0/2578136488 conn(0x7f3984067640 msgr2=0x7f3984067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 -- 172.21.15.6:0/2578136488 shutdown_connections 2023-10-09T11:43:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.427+0000 7f398c4bd700 1 -- 172.21.15.6:0/2578136488 wait complete. 2023-10-09T11:43:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.428+0000 7f398c4bd700 1 Processor -- start 2023-10-09T11:43:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.428+0000 7f398c4bd700 1 -- start start 2023-10-09T11:43:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39840cf240 0x7f39840caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cbac0 con 0x7f39841583b0 2023-10-09T11:43:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cbda0 con 0x7f3984157fe0 2023-10-09T11:43:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398c4bd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cc080 con 0x7f39840cf240 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398aa5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398aa5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48280/0 (socket says 172.21.15.6:48280) 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398aa5a700 1 -- 172.21.15.6:0/834886158 learned_addr learned my addr 172.21.15.6:0/834886158 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f3989a58700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.429+0000 7f398a259700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39840cf240 0x7f39840caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 -- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39840cf240 msgr2=0x7f39840caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39840cf240 0x7f39840caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 -- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 msgr2=0x7f39840cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 -- 172.21.15.6:0/834886158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c009a20 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f3989a58700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398aa5a700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f39740010e0 tx=0x7f3974007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974005c00 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974005d60 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974007300 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39840cc360 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.430+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984155f30 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.431+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398406cf80 con 0x7f39841583b0 2023-10-09T11:43:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.431+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397401b3b0 con 0x7f39841583b0 2023-10-09T11:43:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.432+0000 7f39827fc700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.432+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3974083a40 con 0x7f39841583b0 2023-10-09T11:43:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.432+0000 7f398a259700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.432+0000 7f398a259700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f397c009460 tx=0x7f397c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.436+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f398406cf80 con 0x7f39841583b0 2023-10-09T11:43:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.673+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398406cf80 con 0x7f39841583b0 2023-10-09T11:43:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.674+0000 7f39827fc700 1 -- 172.21.15.6:0/834886158 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f398406cf80 con 0x7f39841583b0 2023-10-09T11:43:05.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:43:05.676 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 msgr2=0x7f39700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f397c009460 tx=0x7f397c019000 comp rx=0 tx=0).stop 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 msgr2=0x7f398416aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f39740010e0 tx=0x7f3974007db0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 shutdown_connections 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39841583b0 0x7f398416aa40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39840cf240 0x7f39840caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 --2- 172.21.15.6:0/834886158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3984157fe0 0x7f39840cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 >> 172.21.15.6:0/834886158 conn(0x7f3984067640 msgr2=0x7f3984153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 shutdown_connections 2023-10-09T11:43:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.676+0000 7f398c4bd700 1 -- 172.21.15.6:0/834886158 wait complete. 2023-10-09T11:43:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:43:05.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-09T11:43:05.828 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":7485,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5253822899999996,"mdsmap_epoch":76,"osdmap_epoch":146,"osdmap_epoch_barrier":146,"uptime":13.605260596000001} 2023-10-09T11:43:05.828 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 7485, "mdsmap_epoch": 76, "osdmap_epoch": 146, "osdmap_epoch_barrier": 146, "rank_uptime": 8.52538229, "state": "up:active", "uptime": 13.605260596, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:43:05.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T11:43:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.949+0000 7f99ff7c1700 1 Processor -- start 2023-10-09T11:43:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 -- start start 2023-10-09T11:43:05.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99f8157ca0 0x7f99f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99f806d120 0x7f99f806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80d07c0 con 0x7f99f81578d0 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f806da50 con 0x7f99f806d120 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.950+0000 7f99ff7c1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f80cfbb0 con 0x7f99f8157ca0 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99f806d120 0x7f99f806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fd55d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f99f81578d0 0x7f99f815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48152/0 (socket says 172.21.15.6:48152) 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99f806d120 0x7f99f806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48282/0 (socket says 172.21.15.6:48282) 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fd55d700 1 -- 172.21.15.6:0/2109539539 learned_addr learned my addr 172.21.15.6:0/2109539539 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fcd5c700 1 --2- 172.21.15.6:0/2109539539 >> v2:172.21.15.118:3300/0 conn(0x7f99f8157ca0 0x7f99f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 -- 172.21.15.6:0/2109539539 >> v2:172.21.15.118:3300/0 conn(0x7f99f8157ca0 msgr2=0x7f99f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 --2- 172.21.15.6:0/2109539539 >> v2:172.21.15.118:3300/0 conn(0x7f99f8157ca0 0x7f99f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 -- 172.21.15.6:0/2109539539 >> v1:172.21.15.6:6789/0 conn(0x7f99f81578d0 legacy=0x7f99f815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99f7fff700 1 -- 172.21.15.6:0/2109539539 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624032985 0 0) 0x7f99f80d07c0 con 0x7f99f81578d0 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 -- 172.21.15.6:0/2109539539 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80cfe90 con 0x7f99f806d120 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99fdd5e700 1 --2- 172.21.15.6:0/2109539539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f806d120 0x7f99f806d510 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f99f8068510 tx=0x7f99f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a257f4efefcf8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99f7fff700 1 -- 172.21.15.6:0/2109539539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011630 con 0x7f99f806d120 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99f7fff700 1 -- 172.21.15.6:0/2109539539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0011790 con 0x7f99f806d120 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.951+0000 7f99f7fff700 1 -- 172.21.15.6:0/2109539539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011b30 con 0x7f99f806d120 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 -- 172.21.15.6:0/2109539539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f806d120 msgr2=0x7f99f806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/2109539539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f806d120 0x7f99f806d510 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f99f8068510 tx=0x7f99f00091a0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 -- 172.21.15.6:0/2109539539 shutdown_connections 2023-10-09T11:43:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/2109539539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f806d120 0x7f99f806d510 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/2109539539 >> v2:172.21.15.118:3300/0 conn(0x7f99f8157ca0 0x7f99f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 -- 172.21.15.6:0/2109539539 >> 172.21.15.6:0/2109539539 conn(0x7f99f806bb90 msgr2=0x7f99f806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 -- 172.21.15.6:0/2109539539 shutdown_connections 2023-10-09T11:43:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.952+0000 7f99ff7c1700 1 -- 172.21.15.6:0/2109539539 wait complete. 2023-10-09T11:43:05.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.953+0000 7f99ff7c1700 1 Processor -- start 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.953+0000 7f99ff7c1700 1 -- start start 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f806d120 0x7f99f8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 0x7f99f80c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8154e90 con 0x7f99f8157ca0 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c6210 con 0x7f99f81578d0 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99ff7c1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c8260 con 0x7f99f806d120 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48298/0 (socket says 172.21.15.6:48298) 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 -- 172.21.15.6:0/1107296110 learned_addr learned my addr 172.21.15.6:0/1107296110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:43:05.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fcd5c700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 0x7f99f80c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fd55d700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f806d120 0x7f99f8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 -- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f806d120 msgr2=0x7f99f8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f806d120 0x7f99f8154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 -- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 msgr2=0x7f99f80c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 0x7f99f80c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 -- 172.21.15.6:0/1107296110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009420 con 0x7f99f8157ca0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fcd5c700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 0x7f99f80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.954+0000 7f99fdd5e700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f99f806fe20 tx=0x7f99f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.955+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00195c0 con 0x7f99f8157ca0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.955+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0019740 con 0x7f99f8157ca0 2023-10-09T11:43:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.955+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0019b00 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.955+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80c7f80 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.955+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f80c5ea0 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.956+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f8067ac0 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.956+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99f00253f0 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.956+0000 7f99f57fa700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.957+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99f0086140 con 0x7f99f8157ca0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.957+0000 7f99fd55d700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:43:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.957+0000 7f99fd55d700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 0x7f99e40693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f99e8001560 tx=0x7f99e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:43:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:05.961+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f0053310 con 0x7f99f8157ca0 2023-10-09T11:43:06.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.153+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f99f80d0170 con 0x7f99f8157ca0 2023-10-09T11:43:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.942+0000 7f99f57fa700 1 -- 172.21.15.6:0/1107296110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7f99f0056930 con 0x7f99f8157ca0 2023-10-09T11:43:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.944+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 msgr2=0x7f99e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.944+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 0x7f99e40693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f99e8001560 tx=0x7f99e8009040 comp rx=0 tx=0).stop 2023-10-09T11:43:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.944+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 msgr2=0x7f99f80c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.944+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f99f806fe20 tx=0x7f99f0017000 comp rx=0 tx=0).stop 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 shutdown_connections 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f99e4066f30 0x7f99e40693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8157ca0 0x7f99f80c66a0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f806d120 0x7f99f8154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 --2- 172.21.15.6:0/1107296110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f81578d0 0x7f99f80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 >> 172.21.15.6:0/1107296110 conn(0x7f99f806bb90 msgr2=0x7f99f8156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 shutdown_connections 2023-10-09T11:43:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:43:06.945+0000 7f99ff7c1700 1 -- 172.21.15.6:0/1107296110 wait complete. 2023-10-09T11:43:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T11:43:06.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:43:07.102 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:43:07.102 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:43:07.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T11:43:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:{"mon_tick_interval":"5"} 2023-10-09T11:43:07.231 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T11:43:07.231 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> import time 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> import datetime 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> # Write some buffered data through before going full, all should be well 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> print("writing some data through which we expect to succeed") 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> bytes = 0 2023-10-09T11:43:07.232 DEBUG:teuthology.orchestra.run.smithi006:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> # from write 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> full = False 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.233 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(32 * 0.9)): 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> print("done writing {0} bytes".format(bytes)) 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> # OK, now we should sneak in under the full condition 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> # due to the time it takes the OSDs to report to the 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> # mons, and get a successful fsync on our full-making data 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.234 DEBUG:teuthology.orchestra.run.smithi006:> # buffered write, add more dirty data to the buffer 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> print("starting buffered write") 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(32 * 0.2)): 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(15.0) 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> except OSError: 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> pass; 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.235 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> # Wait long enough for a background flush that should fail 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(30) 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> # ...and check that the failed background flush is reflected in fclose 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> except OSError: 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> print("close() returned an error as expected") 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:43:07.236 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("close() failed to raise error") 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> # The kernel cephfs client does not raise errors on fclose 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T11:43:07.237 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:43:34.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:43:34.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:05.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:05.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:35.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:44:35.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:05.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:05.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:12.383 INFO:teuthology.orchestra.run.smithi006.stdout:writing some data through which we expect to succeed 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-09T11:45:12.384 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-09T11:45:12.385 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:done writing 29884416 bytes 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:successfully fsync'ed prior to getting full state reported 2023-10-09T11:45:12.386 INFO:teuthology.orchestra.run.smithi006.stdout:starting buffered write 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:45:12.387 INFO:teuthology.orchestra.run.smithi006.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-09T11:45:12.473 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:45:12.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:45:12.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:45:12.564 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:45:12.565 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:45:12.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:45:12.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:45:12.612 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:45:12.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:12.613 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:45:12.630 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:45:12.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:45:12.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:45:12.669 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:45:12.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:12.670 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:45:12.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.855+0000 7f6277399700 1 Processor -- start 2023-10-09T11:45:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.856+0000 7f6277399700 1 -- start start 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.856+0000 7f6277399700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.856+0000 7f6277399700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700d07c0 con 0x7f627006d120 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.856+0000 7f6277399700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700cfbb0 con 0x7f6270157ca0 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f6277399700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700cfe90 con 0x7f62701578d0 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f6275936700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f627006d120 0x7f627006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46808/0 (socket says 172.21.15.6:46808) 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f6275936700 1 -- 172.21.15.6:0/3594205111 learned_addr learned my addr 172.21.15.6:0/3594205111 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f6275135700 1 --2- 172.21.15.6:0/3594205111 >> v2:172.21.15.118:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054818676 0 0) 0x7f62700d07c0 con 0x7f627006d120 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003570 con 0x7f627006d120 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007304018 0 0) 0x7f6258003570 con 0x7f627006d120 2023-10-09T11:45:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 >> v2:172.21.15.118:3300/0 conn(0x7f62701578d0 msgr2=0x7f62700cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 --2- 172.21.15.6:0/3594205111 >> v2:172.21.15.118:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 >> v1:172.21.15.118:6789/0 conn(0x7f6270157ca0 legacy=0x7f627015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700d0170 con 0x7f627006d120 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f62600017f0 con 0x7f627006d120 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 >> v1:172.21.15.6:6789/0 conn(0x7f627006d120 legacy=0x7f627006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f6258003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700cfe90 con 0x7f62580051c0 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c050 con 0x7f6258004810 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c210 con 0x7f6258003a60 2023-10-09T11:45:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.857+0000 7f6275135700 1 --2- 172.21.15.6:0/3594205111 >> v2:172.21.15.118:3300/0 conn(0x7f62701578d0 0x7f62700cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6274934700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275135700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f6258003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 -- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 msgr2=0x7f6258003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f6258003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 -- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 msgr2=0x7f6258004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 -- 172.21.15.6:0/3594205111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258003570 con 0x7f62580051c0 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 -- 172.21.15.6:0/3594205111 reap_dead start 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f6275936700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 0x7f625800ba60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f626000a950 tx=0x7f62600021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cb88adbbc7ff6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600070d0 con 0x7f62580051c0 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260007250 con 0x7f62580051c0 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.858+0000 7f626ffff700 1 -- 172.21.15.6:0/3594205111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260007610 con 0x7f62580051c0 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 -- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 msgr2=0x7f625800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 0x7f625800ba60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f626000a950 tx=0x7f62600021f0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 -- 172.21.15.6:0/3594205111 shutdown_connections 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 --2- 172.21.15.6:0/3594205111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 -- 172.21.15.6:0/3594205111 >> 172.21.15.6:0/3594205111 conn(0x7f627006bb90 msgr2=0x7f627006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 -- 172.21.15.6:0/3594205111 shutdown_connections 2023-10-09T11:45:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.859+0000 7f6277399700 1 -- 172.21.15.6:0/3594205111 wait complete. 2023-10-09T11:45:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.860+0000 7f6277399700 1 Processor -- start 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.860+0000 7f6277399700 1 -- start start 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f6270153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62700b56a0 0x7f62700b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700b6050 con 0x7f62700ac540 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700adc40 con 0x7f62700b56a0 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6277399700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700ad030 con 0x7f62580051c0 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46248/0 (socket says 172.21.15.6:46248) 2023-10-09T11:45:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 -- 172.21.15.6:0/1284432170 learned_addr learned my addr 172.21.15.6:0/1284432170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6275135700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f6270153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6275936700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62700b56a0 0x7f62700b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 -- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 msgr2=0x7f6270153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f6270153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 -- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62700b56a0 msgr2=0x7f62700b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62700b56a0 0x7f62700b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700ad310 con 0x7f62700ac540 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.861+0000 7f6274934700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6264002a90 tx=0x7f6264007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.862+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400f8d0 con 0x7f62700ac540 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.862+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400fa30 con 0x7f62700ac540 2023-10-09T11:45:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.862+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62700ad5f0 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.862+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400fdf0 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.862+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6270153a50 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.863+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270067ac0 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.863+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6264013600 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.863+0000 7f626d7fa700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.864+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6264084ab0 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.864+0000 7f6275135700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.864+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f625c06eb10 con 0x7f62700ac540 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.864+0000 7f6275135700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6268006f00 tx=0x7f62680091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:12.868+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6264017060 con 0x7f62700ac540 2023-10-09T11:45:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.107+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62700d0450 con 0x7f62700ac540 2023-10-09T11:45:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.107+0000 7f626d7fa700 1 -- 172.21.15.6:0/1284432170 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6264051ce0 con 0x7f62700ac540 2023-10-09T11:45:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:13.108 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:45:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 msgr2=0x7f625c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6268006f00 tx=0x7f62680091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 msgr2=0x7f62700ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6264002a90 tx=0x7f6264007d10 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 shutdown_connections 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62700b56a0 0x7f62700b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f6270153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 --2- 172.21.15.6:0/1284432170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62700ac540 0x7f62700ac9b0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.109+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 >> 172.21.15.6:0/1284432170 conn(0x7f627006bb90 msgr2=0x7f627015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.110+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 shutdown_connections 2023-10-09T11:45:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.110+0000 7f6277399700 1 -- 172.21.15.6:0/1284432170 wait complete. 2023-10-09T11:45:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:45:13.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.241+0000 7f9966cdd700 1 Processor -- start 2023-10-09T11:45:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.241+0000 7f9966cdd700 1 -- start start 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9966cdd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9960159b40 0x7f99600cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9966cdd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9960068e90 0x7f99600cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9966cdd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600cee10 con 0x7f9960159f10 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9966cdd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600cd040 con 0x7f9960159b40 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9966cdd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600cd320 con 0x7f9960068e90 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9960159b40 0x7f99600cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9960159b40 0x7f99600cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33762/0 (socket says 172.21.15.6:33762) 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 -- 172.21.15.6:0/500172726 learned_addr learned my addr 172.21.15.6:0/500172726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f99664dc700 1 --2- 172.21.15.6:0/500172726 >> v2:172.21.15.118:3300/0 conn(0x7f9960068e90 0x7f99600cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 -- 172.21.15.6:0/500172726 >> v2:172.21.15.118:3300/0 conn(0x7f9960068e90 msgr2=0x7f99600cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 --2- 172.21.15.6:0/500172726 >> v2:172.21.15.118:3300/0 conn(0x7f9960068e90 0x7f99600cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 -- 172.21.15.6:0/500172726 >> v1:172.21.15.118:6789/0 conn(0x7f9960159f10 legacy=0x7f9960068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.242+0000 7f9965cdb700 1 -- 172.21.15.6:0/500172726 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600ce7c0 con 0x7f9960159b40 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9965cdb700 1 --2- 172.21.15.6:0/500172726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159b40 0x7f99600cc600 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f99600cae10 tx=0x7f9958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51eb2e0706c538d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9964cd9700 1 -- 172.21.15.6:0/500172726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800b820 con 0x7f9960159b40 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9964cd9700 1 -- 172.21.15.6:0/500172726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800b980 con 0x7f9960159b40 2023-10-09T11:45:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9964cd9700 1 -- 172.21.15.6:0/500172726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800bd20 con 0x7f9960159b40 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 -- 172.21.15.6:0/500172726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159b40 msgr2=0x7f99600cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 --2- 172.21.15.6:0/500172726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159b40 0x7f99600cc600 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f99600cae10 tx=0x7f9958009250 comp rx=0 tx=0).stop 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 -- 172.21.15.6:0/500172726 shutdown_connections 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 --2- 172.21.15.6:0/500172726 >> v2:172.21.15.118:3300/0 conn(0x7f9960068e90 0x7f99600cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 --2- 172.21.15.6:0/500172726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159b40 0x7f99600cc600 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 -- 172.21.15.6:0/500172726 >> 172.21.15.6:0/500172726 conn(0x7f99600cd660 msgr2=0x7f99600cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 -- 172.21.15.6:0/500172726 shutdown_connections 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.243+0000 7f9966cdd700 1 -- 172.21.15.6:0/500172726 wait complete. 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.244+0000 7f9966cdd700 1 Processor -- start 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 -- start start 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9960068e90 0x7f9960153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 0x7f996015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99600c7ed0 con 0x7f9960159f10 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996015adc0 con 0x7f9960159b40 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f9966cdd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996015b0a0 con 0x7f9960068e90 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f99664dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f99664dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33772/0 (socket says 172.21.15.6:33772) 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.245+0000 7f99664dc700 1 -- 172.21.15.6:0/4208056251 learned_addr learned my addr 172.21.15.6:0/4208056251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99654da700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 0x7f996015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 -- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9960068e90 msgr2=0x7f9960153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f9965cdb700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9960068e90 0x7f9960153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9960068e90 0x7f9960153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 -- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 msgr2=0x7f996015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 0x7f996015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99580094f0 con 0x7f9960159f10 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99654da700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 0x7f996015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f99664dc700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9950007f30 tx=0x7f99500098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000ecf0 con 0x7f9960159f10 2023-10-09T11:45:13.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995000ee50 con 0x7f9960159f10 2023-10-09T11:45:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996015b380 con 0x7f9960159f10 2023-10-09T11:45:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950014670 con 0x7f9960159f10 2023-10-09T11:45:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.246+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99600c9f40 con 0x7f9960159f10 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.247+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996015b5c0 con 0x7f9960159f10 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.247+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99500149e0 con 0x7f9960159f10 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.248+0000 7f995dffb700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.248+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9950084d00 con 0x7f9960159f10 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.248+0000 7f9965cdb700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.248+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f994c06eb10 con 0x7f9960159f10 2023-10-09T11:45:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.248+0000 7f9965cdb700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 0x7f994c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f99600cae10 tx=0x7f9958016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.252+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f996015b5c0 con 0x7f9960159f10 2023-10-09T11:45:13.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.451+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99600c7ca0 con 0x7f9960159f10 2023-10-09T11:45:13.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.452+0000 7f995dffb700 1 -- 172.21.15.6:0/4208056251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f99600c7ca0 con 0x7f9960159f10 2023-10-09T11:45:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:13.453 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":150,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:44:35.956852+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.26","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:13.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 msgr2=0x7f994c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 0x7f994c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f99600cae10 tx=0x7f9958016000 comp rx=0 tx=0).stop 2023-10-09T11:45:13.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 msgr2=0x7f996015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9950007f30 tx=0x7f99500098e0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 shutdown_connections 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f994c066f30 0x7f994c0693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9960159f10 0x7f996015bbb0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9960068e90 0x7f9960153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 --2- 172.21.15.6:0/4208056251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9960159b40 0x7f996015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.454+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 >> 172.21.15.6:0/4208056251 conn(0x7f99600cd660 msgr2=0x7f996006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.455+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 shutdown_connections 2023-10-09T11:45:13.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.455+0000 7f9966cdd700 1 -- 172.21.15.6:0/4208056251 wait complete. 2023-10-09T11:45:13.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:42:55.096942+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:42:55.658373+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:45:13.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:45:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.589+0000 7fe1df92a700 1 Processor -- start 2023-10-09T11:45:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.589+0000 7fe1df92a700 1 -- start start 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1df92a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1d80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1df92a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1d806d120 0x7fe1d806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1df92a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806dac0 con 0x7fe1d81578d0 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1df92a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d80d07c0 con 0x7fe1d806d120 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1df92a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cfbb0 con 0x7fe1d8157ca0 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1dd6c6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1d81578d0 0x7fe1d815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41038/0 (socket says 172.21.15.6:41038) 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1dd6c6700 1 -- 172.21.15.6:0/3884740746 learned_addr learned my addr 172.21.15.6:0/3884740746 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358833550 0 0) 0x7fe1d0001110 con 0x7fe1d81578d0 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> v2:172.21.15.118:3300/0 conn(0x7fe1d806d120 0x7fe1d806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1dcec5700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1d80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.590+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c0003570 con 0x7fe1d81578d0 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260790281 0 0) 0x7fe1c0003570 con 0x7fe1d81578d0 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 msgr2=0x7fe1d80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1d80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 >> v2:172.21.15.118:3300/0 conn(0x7fe1d806d120 msgr2=0x7fe1d806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 --2- 172.21.15.6:0/3884740746 >> v2:172.21.15.118:3300/0 conn(0x7fe1d806d120 0x7fe1d806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80cfe90 con 0x7fe1d81578d0 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fe1d0001600 con 0x7fe1d81578d0 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 >> v1:172.21.15.6:6789/0 conn(0x7fe1d81578d0 legacy=0x7fe1d815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1c0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0003fe0 0x7fe1c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c0004d50 0x7fe1c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80d07c0 con 0x7fe1c0004d50 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cfbb0 con 0x7fe1c0003fe0 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c000bb40 con 0x7fe1d8157ca0 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> v2:172.21.15.118:3300/0 conn(0x7fe1d806d120 0x7fe1d806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1dcec5700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0003fe0 0x7fe1c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c0004d50 0x7fe1c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1dd6c6700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1c0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 -- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 msgr2=0x7fe1c0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d8157ca0 0x7fe1c0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 -- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0003fe0 msgr2=0x7fe1c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0003fe0 0x7fe1c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 -- 172.21.15.6:0/3884740746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0003570 con 0x7fe1c0004d50 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c0004d50 0x7fe1c00051c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8007550 tx=0x7fe1c80097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c783427bd9bc45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8009ad0 con 0x7fe1c0004d50 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8007da0 con 0x7fe1c0004d50 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.591+0000 7fe1d7fff700 1 -- 172.21.15.6:0/3884740746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8014610 con 0x7fe1c0004d50 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 -- 172.21.15.6:0/3884740746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c0004d50 msgr2=0x7fe1c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 --2- 172.21.15.6:0/3884740746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c0004d50 0x7fe1c00051c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8007550 tx=0x7fe1c80097a0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1ddec7700 1 -- 172.21.15.6:0/3884740746 reap_dead start 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 -- 172.21.15.6:0/3884740746 shutdown_connections 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 -- 172.21.15.6:0/3884740746 >> 172.21.15.6:0/3884740746 conn(0x7fe1d806bb90 msgr2=0x7fe1d806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 -- 172.21.15.6:0/3884740746 shutdown_connections 2023-10-09T11:45:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.592+0000 7fe1df92a700 1 -- 172.21.15.6:0/3884740746 wait complete. 2023-10-09T11:45:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.593+0000 7fe1df92a700 1 Processor -- start 2023-10-09T11:45:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.593+0000 7fe1df92a700 1 -- start start 2023-10-09T11:45:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 0x7fe1d80cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80ca5c0 0x7fe1d815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cda00 con 0x7fe1d80caa30 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cd030 con 0x7fe1d80ca5c0 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1df92a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cc420 con 0x7fe1d814b7f0 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1ddec7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1ddec7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33796/0 (socket says 172.21.15.6:33796) 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.594+0000 7fe1ddec7700 1 -- 172.21.15.6:0/1104436016 learned_addr learned my addr 172.21.15.6:0/1104436016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1dd6c6700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 0x7fe1d80cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1dcec5700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80ca5c0 0x7fe1d815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 -- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 msgr2=0x7fe1d80cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 0x7fe1d80cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 -- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80ca5c0 msgr2=0x7fe1d815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80ca5c0 0x7fe1d815c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80cc700 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1dd6c6700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 0x7fe1d80cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1ddec7700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8014000 tx=0x7fe1c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8020430 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c80205b0 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8020970 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d80cc9e0 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.595+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d80ca1c0 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.596+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d8067ac0 con 0x7fe1d80caa30 2023-10-09T11:45:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.596+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1c8020ce0 con 0x7fe1d80caa30 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.597+0000 7fe1d57fa700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.597+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe1c8085f50 con 0x7fe1d80caa30 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.597+0000 7fe1dd6c6700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.597+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fe1c406eb10 con 0x7fe1d80caa30 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.597+0000 7fe1dd6c6700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 0x7fe1c40693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000e10 tx=0x7fe1d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.601+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1c80530e0 con 0x7fe1d80caa30 2023-10-09T11:45:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.796+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1d80d0170 con 0x7fe1d80caa30 2023-10-09T11:45:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.796+0000 7fe1d57fa700 1 -- 172.21.15.6:0/1104436016 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1c8026020 con 0x7fe1d80caa30 2023-10-09T11:45:13.797 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:45:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.798+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 msgr2=0x7fe1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.798+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 0x7fe1c40693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000e10 tx=0x7fe1d0009040 comp rx=0 tx=0).stop 2023-10-09T11:45:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.798+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 msgr2=0x7fe1d815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.798+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8014000 tx=0x7fe1c8018000 comp rx=0 tx=0).stop 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 shutdown_connections 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1d80caa30 0x7fe1d815cd20 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1d814b7f0 0x7fe1d80cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 --2- 172.21.15.6:0/1104436016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80ca5c0 0x7fe1d815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 >> 172.21.15.6:0/1104436016 conn(0x7fe1d806bb90 msgr2=0x7fe1d8156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 shutdown_connections 2023-10-09T11:45:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.799+0000 7fe1df92a700 1 -- 172.21.15.6:0/1104436016 wait complete. 2023-10-09T11:45:13.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:45:13.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.932+0000 7f8a02c8f700 1 Processor -- start 2023-10-09T11:45:13.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.932+0000 7f8a02c8f700 1 -- start start 2023-10-09T11:45:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a02c8f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89fc0d0b80 0x7f89fc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a02c8f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc06d700 0x7f89fc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a02c8f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0cf2d0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a02c8f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc15a690 con 0x7f89fc06d700 2023-10-09T11:45:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a02c8f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc06dc00 con 0x7f89fc0d0b80 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a0248e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc06d700 0x7f89fc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a0248e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc06d700 0x7f89fc15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33802/0 (socket says 172.21.15.6:33802) 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a0248e700 1 -- 172.21.15.6:0/2816363287 learned_addr learned my addr 172.21.15.6:0/2816363287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.933+0000 7f8a01c8d700 1 --2- 172.21.15.6:0/2816363287 >> v2:172.21.15.118:3300/0 conn(0x7f89fc0d0b80 0x7f89fc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a0248e700 1 -- 172.21.15.6:0/2816363287 >> v2:172.21.15.118:3300/0 conn(0x7f89fc0d0b80 msgr2=0x7f89fc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a0248e700 1 --2- 172.21.15.6:0/2816363287 >> v2:172.21.15.118:3300/0 conn(0x7f89fc0d0b80 0x7f89fc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a0248e700 1 -- 172.21.15.6:0/2816363287 >> v1:172.21.15.118:6789/0 conn(0x7f89fc0d02b0 legacy=0x7f89fc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a0248e700 1 -- 172.21.15.6:0/2816363287 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0cf570 con 0x7f89fc06d700 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a0248e700 1 --2- 172.21.15.6:0/2816363287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc06d700 0x7f89fc15b320 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009f20 tx=0x7f89ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b4eb8a90d44c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a00c8b700 1 -- 172.21.15.6:0/2816363287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00e070 con 0x7f89fc06d700 2023-10-09T11:45:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a00c8b700 1 -- 172.21.15.6:0/2816363287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00b990 con 0x7f89fc06d700 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a00c8b700 1 -- 172.21.15.6:0/2816363287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0092e0 con 0x7f89fc06d700 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 -- 172.21.15.6:0/2816363287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc06d700 msgr2=0x7f89fc15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/2816363287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc06d700 0x7f89fc15b320 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009f20 tx=0x7f89ec009840 comp rx=0 tx=0).stop 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 -- 172.21.15.6:0/2816363287 shutdown_connections 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/2816363287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc06d700 0x7f89fc15b320 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/2816363287 >> v2:172.21.15.118:3300/0 conn(0x7f89fc0d0b80 0x7f89fc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 -- 172.21.15.6:0/2816363287 >> 172.21.15.6:0/2816363287 conn(0x7f89fc063230 msgr2=0x7f89fc063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 -- 172.21.15.6:0/2816363287 shutdown_connections 2023-10-09T11:45:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.934+0000 7f8a02c8f700 1 -- 172.21.15.6:0/2816363287 wait complete. 2023-10-09T11:45:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 Processor -- start 2023-10-09T11:45:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 -- start start 2023-10-09T11:45:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89fc06d700 0x7f89fc13d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89fc0d0b80 0x7f89fc152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc13d6c0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0b65a0 con 0x7f89fc0d0b80 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a02c8f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc154160 con 0x7f89fc06d700 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a0148c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a0148c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33814/0 (socket says 172.21.15.6:33814) 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a0148c700 1 -- 172.21.15.6:0/3373351993 learned_addr learned my addr 172.21.15.6:0/3373351993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a01c8d700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89fc06d700 0x7f89fc13d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.936+0000 7f8a0248e700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89fc0d0b80 0x7f89fc152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 -- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89fc06d700 msgr2=0x7f89fc13d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89fc06d700 0x7f89fc13d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 -- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89fc0d0b80 msgr2=0x7f89fc152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89fc0d0b80 0x7f89fc152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009ae0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a0148c700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c5c0 tx=0x7f89f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0011590 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0011710 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0011ad0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc1534b0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.937+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc153b10 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.938+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc0676e0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.938+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89f001b3b0 con 0x7f89fc0d02b0 2023-10-09T11:45:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.939+0000 7f89f9ffb700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 0x7f89e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.939+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f89f0083980 con 0x7f89fc0d02b0 2023-10-09T11:45:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.939+0000 7f8a01c8d700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 0x7f89e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.939+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f89e806eb10 con 0x7f89fc0d02b0 2023-10-09T11:45:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.939+0000 7f8a01c8d700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 0x7f89e80693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009d10 tx=0x7f89f40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:13.943+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89f0017070 con 0x7f89fc0d02b0 2023-10-09T11:45:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.133+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89fc071b10 con 0x7f89fc0d02b0 2023-10-09T11:45:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.133+0000 7f89f9ffb700 1 -- 172.21.15.6:0/3373351993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89f0050bb0 con 0x7f89fc0d02b0 2023-10-09T11:45:14.134 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:45:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 msgr2=0x7f89e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 0x7f89e80693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009d10 tx=0x7f89f40091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 msgr2=0x7f89fc0b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c5c0 tx=0x7f89f000c8d0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 shutdown_connections 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f89e8066f30 0x7f89e80693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89fc0d0b80 0x7f89fc152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89fc06d700 0x7f89fc13d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 --2- 172.21.15.6:0/3373351993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d02b0 0x7f89fc0b43e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 >> 172.21.15.6:0/3373351993 conn(0x7f89fc063230 msgr2=0x7f89fc15b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 shutdown_connections 2023-10-09T11:45:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.135+0000 7f8a02c8f700 1 -- 172.21.15.6:0/3373351993 wait complete. 2023-10-09T11:45:14.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:45:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.269+0000 7f18a56e7700 1 Processor -- start 2023-10-09T11:45:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.269+0000 7f18a56e7700 1 -- start start 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a56e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a00d0f50 0x7f18a006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a56e7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18a006d530 0x7f18a015b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a56e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a006d990 con 0x7f18a00d0b80 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a56e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a015a690 con 0x7f18a00d0f50 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a56e7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cf2d0 con 0x7f18a006d530 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a00d0f50 0x7f18a006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a00d0f50 0x7f18a006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33826/0 (socket says 172.21.15.6:33826) 2023-10-09T11:45:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18a00d0b80 0x7f18a00cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41040/0 (socket says 172.21.15.6:41040) 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189f7fe700 1 -- 172.21.15.6:0/203484181 learned_addr learned my addr 172.21.15.6:0/203484181 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f18a4ee6700 1 --2- 172.21.15.6:0/203484181 >> v2:172.21.15.118:3300/0 conn(0x7f18a006d530 0x7f18a015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189f7fe700 1 -- 172.21.15.6:0/203484181 >> v2:172.21.15.118:3300/0 conn(0x7f18a006d530 msgr2=0x7f18a015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.270+0000 7f189f7fe700 1 --2- 172.21.15.6:0/203484181 >> v2:172.21.15.118:3300/0 conn(0x7f18a006d530 0x7f18a015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189f7fe700 1 -- 172.21.15.6:0/203484181 >> v1:172.21.15.6:6789/0 conn(0x7f18a00d0b80 legacy=0x7f18a00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189f7fe700 1 -- 172.21.15.6:0/203484181 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00d0480 con 0x7f18a00d0f50 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189effd700 1 -- 172.21.15.6:0/203484181 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957106792 0 0) 0x7f18a006d990 con 0x7f18a00d0b80 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189f7fe700 1 --2- 172.21.15.6:0/203484181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a006cff0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ce9b0 tx=0x7f1894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e0bdc22c127aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189effd700 1 -- 172.21.15.6:0/203484181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894009e70 con 0x7f18a00d0f50 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189effd700 1 -- 172.21.15.6:0/203484181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400b860 con 0x7f18a00d0f50 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f189effd700 1 -- 172.21.15.6:0/203484181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400bc00 con 0x7f18a00d0f50 2023-10-09T11:45:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 -- 172.21.15.6:0/203484181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 msgr2=0x7f18a006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 --2- 172.21.15.6:0/203484181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a006cff0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ce9b0 tx=0x7f1894009250 comp rx=0 tx=0).stop 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 -- 172.21.15.6:0/203484181 shutdown_connections 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 --2- 172.21.15.6:0/203484181 >> v2:172.21.15.118:3300/0 conn(0x7f18a006d530 0x7f18a015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 --2- 172.21.15.6:0/203484181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a006cff0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 -- 172.21.15.6:0/203484181 >> 172.21.15.6:0/203484181 conn(0x7f18a0063230 msgr2=0x7f18a0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 -- 172.21.15.6:0/203484181 shutdown_connections 2023-10-09T11:45:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.271+0000 7f18a56e7700 1 -- 172.21.15.6:0/203484181 wait complete. 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.272+0000 7f18a56e7700 1 Processor -- start 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 -- start start 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18a006d530 0x7f18a015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18a00d0b80 0x7f18a00b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0153230 con 0x7f18a00d0f50 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c6730 con 0x7f18a006d530 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.273+0000 7f18a56e7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c5b20 con 0x7f18a00d0b80 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33834/0 (socket says 172.21.15.6:33834) 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 -- 172.21.15.6:0/654148488 learned_addr learned my addr 172.21.15.6:0/654148488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f189ffff700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18a006d530 0x7f18a015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f189f7fe700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18a00d0b80 0x7f18a00b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 -- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18a00d0b80 msgr2=0x7f18a00b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18a00d0b80 0x7f18a00b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 -- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18a006d530 msgr2=0x7f18a015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18a006d530 0x7f18a015bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940094f0 con 0x7f18a00d0f50 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a4ee6700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f189800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800cb70 con 0x7f18a00d0f50 2023-10-09T11:45:14.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800f040 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00c5e00 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898014480 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.274+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00c63c0 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.275+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00c68c0 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1898014830 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f1887fff700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1898084ef0 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f189ffff700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f188c06eb10 con 0x7f18a00d0f50 2023-10-09T11:45:14.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.276+0000 7f189ffff700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 0x7f188c0693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1890007fd0 tx=0x7f1890007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.280+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1898052120 con 0x7f18a00d0f50 2023-10-09T11:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.473+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18a00676e0 con 0x7f18a00d0f50 2023-10-09T11:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.473+0000 7f1887fff700 1 -- 172.21.15.6:0/654148488 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1898018030 con 0x7f18a00d0f50 2023-10-09T11:45:14.474 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 msgr2=0x7f188c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 0x7f188c0693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1890007fd0 tx=0x7f1890007d50 comp rx=0 tx=0).stop 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 msgr2=0x7f18a00b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f189800b040 comp rx=0 tx=0).stop 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 shutdown_connections 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a00d0f50 0x7f18a00b5d80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18a006d530 0x7f18a015bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 --2- 172.21.15.6:0/654148488 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18a00d0b80 0x7f18a00b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 >> 172.21.15.6:0/654148488 conn(0x7f18a0063230 msgr2=0x7f18a006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 shutdown_connections 2023-10-09T11:45:14.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.475+0000 7f18a56e7700 1 -- 172.21.15.6:0/654148488 wait complete. 2023-10-09T11:45:14.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.605+0000 7f441ee5c700 1 Processor -- start 2023-10-09T11:45:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.605+0000 7f441ee5c700 1 -- start start 2023-10-09T11:45:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441ee5c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f44180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441ee5c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44180d07c0 con 0x7f441806d120 2023-10-09T11:45:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441ee5c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44180cfbb0 con 0x7f4418157ca0 2023-10-09T11:45:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441ee5c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180cfe90 con 0x7f44181578d0 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441d3f9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f441806d120 0x7f441815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41044/0 (socket says 172.21.15.6:41044) 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.606+0000 7f441d3f9700 1 -- 172.21.15.6:0/3549968061 learned_addr learned my addr 172.21.15.6:0/3549968061 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183861468 0 0) 0x7f44180d07c0 con 0x7f441806d120 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441cbf8700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f44180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4400003570 con 0x7f441806d120 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1926663253 0 0) 0x7f4400003570 con 0x7f441806d120 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 msgr2=0x7f44180cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f44180cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 >> v1:172.21.15.118:6789/0 conn(0x7f4418157ca0 legacy=0x7f441815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180d0170 con 0x7f441806d120 2023-10-09T11:45:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f4408001470 con 0x7f441806d120 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441cbf8700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f44180cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 >> v1:172.21.15.6:6789/0 conn(0x7f441806d120 legacy=0x7f441815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f4400003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4400004080 0x7f4400004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400004d50 0x7f44000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180cfe90 con 0x7f4400004d50 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440000bca0 con 0x7f4400004080 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440000be60 con 0x7f44181578d0 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441cbf8700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f4400003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441d3f9700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400004d50 0x7f44000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f4417fff700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4400004080 0x7f4400004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441d3f9700 1 -- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 msgr2=0x7f4400003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441d3f9700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44181578d0 0x7f4400003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.607+0000 7f441d3f9700 1 -- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4400004080 msgr2=0x7f4400004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441d3f9700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4400004080 0x7f4400004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441d3f9700 1 -- 172.21.15.6:0/3549968061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400003570 con 0x7f4400004d50 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441d3f9700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400004d50 0x7f44000051c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4408001ed0 tx=0x7f441815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99566caf8cd17d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800cc30 con 0x7f4400004d50 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800cd90 con 0x7f4400004d50 2023-10-09T11:45:14.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f44177fe700 1 -- 172.21.15.6:0/3549968061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408005b70 con 0x7f4400004d50 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 -- 172.21.15.6:0/3549968061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400004d50 msgr2=0x7f44000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 --2- 172.21.15.6:0/3549968061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400004d50 0x7f44000051c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4408001ed0 tx=0x7f441815b610 comp rx=0 tx=0).stop 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441d3f9700 1 -- 172.21.15.6:0/3549968061 reap_dead start 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 -- 172.21.15.6:0/3549968061 shutdown_connections 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 -- 172.21.15.6:0/3549968061 >> 172.21.15.6:0/3549968061 conn(0x7f441806bb90 msgr2=0x7f441806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 -- 172.21.15.6:0/3549968061 shutdown_connections 2023-10-09T11:45:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.608+0000 7f441ee5c700 1 -- 172.21.15.6:0/3549968061 wait complete. 2023-10-09T11:45:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.609+0000 7f441ee5c700 1 Processor -- start 2023-10-09T11:45:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 -- start start 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441814b750 0x7f4418154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4418153ce0 0x7f44180b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418154d40 con 0x7f441814bb20 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441816eb00 con 0x7f4418153ce0 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f441ee5c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441814c7c0 con 0x7f441814b750 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.610+0000 7f4417fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33850/0 (socket says 172.21.15.6:33850) 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 -- 172.21.15.6:0/2630120116 learned_addr learned my addr 172.21.15.6:0/2630120116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:14.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f441cbf8700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441814b750 0x7f4418154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f441d3f9700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4418153ce0 0x7f44180b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 -- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441814b750 msgr2=0x7f4418154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441814b750 0x7f4418154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 -- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4418153ce0 msgr2=0x7f44180b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4418153ce0 0x7f44180b57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441816ef90 con 0x7f441814bb20 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4417fff700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f440c002980 tx=0x7f440c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c013600 con 0x7f441814bb20 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c013760 con 0x7f441814bb20 2023-10-09T11:45:14.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4418154aa0 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c013b20 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.611+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441816e4b0 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.612+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4418067ac0 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.612+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f440c00f420 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.613+0000 7f4414ff9700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 0x7f44040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.613+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f440c084260 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.613+0000 7f441cbf8700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 0x7f44040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.613+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f440406eb10 con 0x7f441814bb20 2023-10-09T11:45:14.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.613+0000 7f441cbf8700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 0x7f44040693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f44100076e0 tx=0x7f44100097d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.617+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f440c051490 con 0x7f441814bb20 2023-10-09T11:45:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.856+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f441816ec40 con 0x7f441814bb20 2023-10-09T11:45:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.856+0000 7f4414ff9700 1 -- 172.21.15.6:0/2630120116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f440c054ab0 con 0x7f441814bb20 2023-10-09T11:45:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:14.857 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 msgr2=0x7f44040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 0x7f44040693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f44100076e0 tx=0x7f44100097d0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 msgr2=0x7f44180b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f440c002980 tx=0x7f440c007d30 comp rx=0 tx=0).stop 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 shutdown_connections 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4404066f30 0x7f44040693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4418153ce0 0x7f44180b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441814b750 0x7f4418154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 --2- 172.21.15.6:0/2630120116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f441814bb20 0x7f44180b52a0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.858+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 >> 172.21.15.6:0/2630120116 conn(0x7f441806bb90 msgr2=0x7f4418156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.859+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 shutdown_connections 2023-10-09T11:45:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.859+0000 7f441ee5c700 1 -- 172.21.15.6:0/2630120116 wait complete. 2023-10-09T11:45:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:45:14.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.989+0000 7fc950cb2700 1 Processor -- start 2023-10-09T11:45:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.989+0000 7fc950cb2700 1 -- start start 2023-10-09T11:45:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.990+0000 7fc950cb2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 0x7fc94c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.990+0000 7fc950cb2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 0x7fc94c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.990+0000 7fc950cb2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0d07c0 con 0x7fc94c06d120 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.990+0000 7fc950cb2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cfbb0 con 0x7fc94c157ca0 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.990+0000 7fc950cb2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cfe90 con 0x7fc94c1578d0 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc949d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 0x7fc94c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 0x7fc94c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94ad9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc94c06d120 0x7fc94c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:48396/0 (socket says 172.21.15.6:48396) 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94ad9d700 1 -- 172.21.15.6:0/119706651 learned_addr learned my addr 172.21.15.6:0/119706651 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94959a700 1 -- 172.21.15.6:0/119706651 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695298394 0 0) 0x7fc94c0d07c0 con 0x7fc94c06d120 2023-10-09T11:45:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 -- 172.21.15.6:0/119706651 >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 msgr2=0x7fc94c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 --2- 172.21.15.6:0/119706651 >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 0x7fc94c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 -- 172.21.15.6:0/119706651 >> v1:172.21.15.118:6789/0 conn(0x7fc94c06d120 legacy=0x7fc94c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 -- 172.21.15.6:0/119706651 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0d0170 con 0x7fc94c1578d0 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc949d9b700 1 --2- 172.21.15.6:0/119706651 >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 0x7fc94c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94a59c700 1 --2- 172.21.15.6:0/119706651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 0x7fc94c0cf4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e60 tx=0x7fc944009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8deacb562cc1b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94959a700 1 -- 172.21.15.6:0/119706651 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400e070 con 0x7fc94c1578d0 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94959a700 1 -- 172.21.15.6:0/119706651 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400bb60 con 0x7fc94c1578d0 2023-10-09T11:45:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.991+0000 7fc94959a700 1 -- 172.21.15.6:0/119706651 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944012430 con 0x7fc94c1578d0 2023-10-09T11:45:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 -- 172.21.15.6:0/119706651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 msgr2=0x7fc94c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 --2- 172.21.15.6:0/119706651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 0x7fc94c0cf4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e60 tx=0x7fc944009780 comp rx=0 tx=0).stop 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 -- 172.21.15.6:0/119706651 shutdown_connections 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 --2- 172.21.15.6:0/119706651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c1578d0 0x7fc94c0cf4f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 --2- 172.21.15.6:0/119706651 >> v2:172.21.15.118:3300/0 conn(0x7fc94c157ca0 0x7fc94c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 -- 172.21.15.6:0/119706651 >> 172.21.15.6:0/119706651 conn(0x7fc94c06bb90 msgr2=0x7fc94c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 -- 172.21.15.6:0/119706651 shutdown_connections 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.992+0000 7fc950cb2700 1 -- 172.21.15.6:0/119706651 wait complete. 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.993+0000 7fc950cb2700 1 Processor -- start 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.993+0000 7fc950cb2700 1 -- start start 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c1578d0 0x7fc94c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c157ca0 0x7fc94c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c06a110 con 0x7fc94c06d120 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c7a20 con 0x7fc94c1578d0 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc950cb2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c8cc0 con 0x7fc94c157ca0 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33860/0 (socket says 172.21.15.6:33860) 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 -- 172.21.15.6:0/185827672 learned_addr learned my addr 172.21.15.6:0/185827672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94ad9d700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c157ca0 0x7fc94c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc949d9b700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c1578d0 0x7fc94c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 -- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c157ca0 msgr2=0x7fc94c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c157ca0 0x7fc94c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 -- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c1578d0 msgr2=0x7fc94c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c1578d0 0x7fc94c0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.994+0000 7fc94a59c700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009420 con 0x7fc94c06d120 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc94a59c700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fc94400b6c0 tx=0x7fc944019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944012be0 con 0x7fc94c06d120 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944012d80 con 0x7fc94c06d120 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc944009a20 con 0x7fc94c06d120 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440276c0 con 0x7fc94c06d120 2023-10-09T11:45:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.995+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c0c7cd0 con 0x7fc94c06d120 2023-10-09T11:45:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.996+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c0c8b10 con 0x7fc94c06d120 2023-10-09T11:45:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.996+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc944024070 con 0x7fc94c06d120 2023-10-09T11:45:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.997+0000 7fc9427fc700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.997+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fc944086ad0 con 0x7fc94c06d120 2023-10-09T11:45:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.997+0000 7fc949d9b700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.997+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fc92c06eb10 con 0x7fc94c06d120 2023-10-09T11:45:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:14.997+0000 7fc949d9b700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc94c1572f0 tx=0x7fc9340091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.001+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc944053d00 con 0x7fc94c06d120 2023-10-09T11:45:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.196+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc94c067b50 con 0x7fc94c06d120 2023-10-09T11:45:15.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.196+0000 7fc9427fc700 1 -- 172.21.15.6:0/185827672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+15440 (secure 0 0 0) 0x7fc94402c030 con 0x7fc94c06d120 2023-10-09T11:45:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:15.197 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":150,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:44:35.956852+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.26","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.198+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 msgr2=0x7fc92c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.198+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc94c1572f0 tx=0x7fc9340091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.198+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 msgr2=0x7fc94c069bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.198+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fc94400b6c0 tx=0x7fc944019000 comp rx=0 tx=0).stop 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 shutdown_connections 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc94c157ca0 0x7fc94c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc94c06d120 0x7fc94c069bd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 --2- 172.21.15.6:0/185827672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc94c1578d0 0x7fc94c0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 >> 172.21.15.6:0/185827672 conn(0x7fc94c06bb90 msgr2=0x7fc94c1558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 shutdown_connections 2023-10-09T11:45:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.199+0000 7fc950cb2700 1 -- 172.21.15.6:0/185827672 wait complete. 2023-10-09T11:45:15.211 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:45:15.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:15.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.329+0000 7fa5b76d6700 1 Processor -- start 2023-10-09T11:45:15.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.329+0000 7fa5b76d6700 1 -- start start 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.330+0000 7fa5b76d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.330+0000 7fa5b76d6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5b006e940 0x7fa5b00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.330+0000 7fa5b76d6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b00b2290 con 0x7fa5b0156db0 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.330+0000 7fa5b76d6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b0157c00 con 0x7fa5b006e940 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.330+0000 7fa5b76d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01572d0 con 0x7fa5b01569e0 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5472700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5b006e940 0x7fa5b00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5472700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:46620/0 (socket says 172.21.15.6:46620) 2023-10-09T11:45:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5b006e940 0x7fa5b00cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:50450/0 (socket says 172.21.15.6:50450) 2023-10-09T11:45:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5472700 1 -- 172.21.15.6:0/425615534 learned_addr learned my addr 172.21.15.6:0/425615534 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:15.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b4c71700 1 --1- 172.21.15.6:0/425615534 >> v1:172.21.15.118:6789/0 conn(0x7fa5b0156db0 0x7fa5b006e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:48402/0 (socket says 172.21.15.6:48402) 2023-10-09T11:45:15.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 -- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 msgr2=0x7fa5b00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 -- 172.21.15.6:0/425615534 >> v1:172.21.15.118:6789/0 conn(0x7fa5b0156db0 legacy=0x7fa5b006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5affff700 1 -- 172.21.15.6:0/425615534 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097893191 0 0) 0x7fa5b00b2290 con 0x7fa5b0156db0 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 -- 172.21.15.6:0/425615534 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b01575b0 con 0x7fa5b006e940 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5472700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5b5c73700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b006e940 0x7fa5b00cd920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009e60 tx=0x7fa5a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5215158f842204c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5affff700 1 -- 172.21.15.6:0/425615534 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000e070 con 0x7fa5b006e940 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5affff700 1 -- 172.21.15.6:0/425615534 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000bb60 con 0x7fa5b006e940 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.331+0000 7fa5affff700 1 -- 172.21.15.6:0/425615534 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0012430 con 0x7fa5b006e940 2023-10-09T11:45:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 -- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b006e940 msgr2=0x7fa5b00cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b006e940 0x7fa5b00cd920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009e60 tx=0x7fa5a0009780 comp rx=0 tx=0).stop 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 -- 172.21.15.6:0/425615534 shutdown_connections 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b006e940 0x7fa5b00cd920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/425615534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b01569e0 0x7fa5b00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 -- 172.21.15.6:0/425615534 >> 172.21.15.6:0/425615534 conn(0x7fa5b006cca0 msgr2=0x7fa5b006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 -- 172.21.15.6:0/425615534 shutdown_connections 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.332+0000 7fa5b76d6700 1 -- 172.21.15.6:0/425615534 wait complete. 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.333+0000 7fa5b76d6700 1 Processor -- start 2023-10-09T11:45:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.333+0000 7fa5b76d6700 1 -- start start 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b01569e0 0x7fa5b0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b0156db0 0x7fa5b00aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b014c630 con 0x7fa5b006e940 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b014bbd0 con 0x7fa5b01569e0 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b76d6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0158d40 con 0x7fa5b0156db0 2023-10-09T11:45:15.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33872/0 (socket says 172.21.15.6:33872) 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 -- 172.21.15.6:0/3400423385 learned_addr learned my addr 172.21.15.6:0/3400423385 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b4c71700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b01569e0 0x7fa5b0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5c73700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b0156db0 0x7fa5b00aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 -- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b0156db0 msgr2=0x7fa5b00aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b0156db0 0x7fa5b00aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 -- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b01569e0 msgr2=0x7fa5b0151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b01569e0 0x7fa5b0151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.334+0000 7fa5b5472700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80094f0 con 0x7fa5b006e940 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5b5472700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800ec50 tx=0x7fa5a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800c9d0 con 0x7fa5b006e940 2023-10-09T11:45:15.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800cb30 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8013470 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a0009a20 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.335+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b01586f0 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.336+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b0068900 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.336+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5a8013820 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.336+0000 7fa5ad7fa700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.337+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa5a8084d60 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.337+0000 7fa5b4c71700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.337+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7fa59c06eb10 con 0x7fa5b006e940 2023-10-09T11:45:15.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.337+0000 7fa5b4c71700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 0x7fa59c0693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5b016ad20 tx=0x7fa5a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.341+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5a8051ef0 con 0x7fa5b006e940 2023-10-09T11:45:15.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.580+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5b0157890 con 0x7fa5b006e940 2023-10-09T11:45:15.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.580+0000 7fa5ad7fa700 1 -- 172.21.15.6:0/3400423385 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa5a8021020 con 0x7fa5b006e940 2023-10-09T11:45:15.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:15.581 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 msgr2=0x7fa59c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 0x7fa59c0693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5b016ad20 tx=0x7fa5a4009040 comp rx=0 tx=0).stop 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 msgr2=0x7fa5b014c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800ec50 tx=0x7fa5a8009250 comp rx=0 tx=0).stop 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 shutdown_connections 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa59c066f30 0x7fa59c0693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5b0156db0 0x7fa5b00aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b006e940 0x7fa5b014c0f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 --2- 172.21.15.6:0/3400423385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5b01569e0 0x7fa5b0151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 >> 172.21.15.6:0/3400423385 conn(0x7fa5b006cca0 msgr2=0x7fa5b0152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 shutdown_connections 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.582+0000 7fa5b76d6700 1 -- 172.21.15.6:0/3400423385 wait complete. 2023-10-09T11:45:15.584 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:45:15.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.713+0000 7ff53c2c2700 1 Processor -- start 2023-10-09T11:45:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.713+0000 7ff53c2c2700 1 -- start start 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.713+0000 7ff53c2c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53c2c2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340d07c0 con 0x7ff53406d120 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53c2c2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340cfbb0 con 0x7ff534157ca0 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53c2c2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340cfe90 con 0x7ff5341578d0 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a85f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff53406d120 0x7ff53415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41054/0 (socket says 172.21.15.6:41054) 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a85f700 1 -- 172.21.15.6:0/2750927037 learned_addr learned my addr 172.21.15.6:0/2750927037 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a05e700 1 --2- 172.21.15.6:0/2750927037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280441324 0 0) 0x7ff5340d07c0 con 0x7ff53406d120 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c003570 con 0x7ff53406d120 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175989082 0 0) 0x7ff5340cfbb0 con 0x7ff534157ca0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5340d07c0 con 0x7ff534157ca0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a05e700 1 -- 172.21.15.6:0/2750927037 >> v1:172.21.15.118:6789/0 conn(0x7ff534157ca0 legacy=0x7ff53415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a05e700 1 -- 172.21.15.6:0/2750927037 >> v1:172.21.15.6:6789/0 conn(0x7ff53406d120 legacy=0x7ff53415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a05e700 1 -- 172.21.15.6:0/2750927037 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340d0170 con 0x7ff5341578d0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53a05e700 1 --2- 172.21.15.6:0/2750927037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340cf4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009910 tx=0x7ff52c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c6658c1f52c0fc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.714+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011630 con 0x7ff5341578d0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c011790 con 0x7ff5341578d0 2023-10-09T11:45:15.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53905c700 1 -- 172.21.15.6:0/2750927037 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011b30 con 0x7ff5341578d0 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 -- 172.21.15.6:0/2750927037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 msgr2=0x7ff5340cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/2750927037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340cf4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009910 tx=0x7ff52c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 -- 172.21.15.6:0/2750927037 shutdown_connections 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/2750927037 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340cf4f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 -- 172.21.15.6:0/2750927037 >> 172.21.15.6:0/2750927037 conn(0x7ff53406bb90 msgr2=0x7ff53406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 -- 172.21.15.6:0/2750927037 shutdown_connections 2023-10-09T11:45:15.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.715+0000 7ff53c2c2700 1 -- 172.21.15.6:0/2750927037 wait complete. 2023-10-09T11:45:15.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.716+0000 7ff53c2c2700 1 Processor -- start 2023-10-09T11:45:15.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.716+0000 7ff53c2c2700 1 -- start start 2023-10-09T11:45:15.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53406d120 0x7ff534153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53416b420 con 0x7ff534157ca0 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b50d0 con 0x7ff53406d120 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53c2c2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53416a810 con 0x7ff5341578d0 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33888/0 (socket says 172.21.15.6:33888) 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 -- 172.21.15.6:0/3995601903 learned_addr learned my addr 172.21.15.6:0/3995601903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a05e700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53406d120 0x7ff534153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53985d700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 -- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 msgr2=0x7ff5340b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 -- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53406d120 msgr2=0x7ff534153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53406d120 0x7ff534153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.717+0000 7ff53a85f700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c009420 con 0x7ff534157ca0 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff53a85f700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7ff52400cc60 tx=0x7ff524001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400a8b0 con 0x7ff534157ca0 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400aa30 con 0x7ff534157ca0 2023-10-09T11:45:15.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53416aaf0 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400adf0 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.718+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53416b0b0 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.719+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53416b5d0 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.719+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff524007300 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.720+0000 7ff5327fc700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.720+0000 7ff53a05e700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.720+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff5240848a0 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.720+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7ff52006eb10 con 0x7ff534157ca0 2023-10-09T11:45:15.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.720+0000 7ff53a05e700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 0x7ff5200693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009860 tx=0x7ff52c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:15.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.724+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff53416b5d0 con 0x7ff534157ca0 2023-10-09T11:45:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.960+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53416b560 con 0x7ff534157ca0 2023-10-09T11:45:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.961+0000 7ff5327fc700 1 -- 172.21.15.6:0/3995601903 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4599 (secure 0 0 0) 0x7ff5240555e0 con 0x7ff534157ca0 2023-10-09T11:45:15.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:15.961 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:42:56.685032+0000","modified":"2023-10-09T11:43:00.305377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/1461794471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1461794471},{"type":"v1","addr":"172.21.15.6:6836","nonce":1461794471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T11:45:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 msgr2=0x7ff5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 0x7ff5200693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009860 tx=0x7ff52c017000 comp rx=0 tx=0).stop 2023-10-09T11:45:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 msgr2=0x7ff5340b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7ff52400cc60 tx=0x7ff524001ae0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 shutdown_connections 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff520066f30 0x7ff5200693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff534157ca0 0x7ff5340b22c0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff53406d120 0x7ff534153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 --2- 172.21.15.6:0/3995601903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5341578d0 0x7ff5340b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 >> 172.21.15.6:0/3995601903 conn(0x7ff53406bb90 msgr2=0x7ff534155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 shutdown_connections 2023-10-09T11:45:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:15.963+0000 7ff53c2c2700 1 -- 172.21.15.6:0/3995601903 wait complete. 2023-10-09T11:45:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2023-10-09T11:45:15.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:16.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 Processor -- start 2023-10-09T11:45:16.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 -- start start 2023-10-09T11:45:16.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20c4157ca0 0x7f20c40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40d07c0 con 0x7f20c41578d0 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40cfbb0 con 0x7f20c406d120 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.095+0000 7f20cb1ee700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40cfe90 con 0x7f20c4157ca0 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c8f8a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20c41578d0 0x7f20c415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41064/0 (socket says 172.21.15.6:41064) 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c8f8a700 1 -- 172.21.15.6:0/163961767 learned_addr learned my addr 172.21.15.6:0/163961767 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c3fff700 1 --2- 172.21.15.6:0/163961767 >> v2:172.21.15.118:3300/0 conn(0x7f20c4157ca0 0x7f20c40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566674149 0 0) 0x7f20c40d07c0 con 0x7f20c41578d0 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b0003570 con 0x7f20c41578d0 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520730719 0 0) 0x7f20c40cfbb0 con 0x7f20c406d120 2023-10-09T11:45:16.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c3fff700 1 -- 172.21.15.6:0/163961767 >> v1:172.21.15.118:6789/0 conn(0x7f20c406d120 legacy=0x7f20c406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c3fff700 1 -- 172.21.15.6:0/163961767 >> v1:172.21.15.6:6789/0 conn(0x7f20c41578d0 legacy=0x7f20c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c3fff700 1 -- 172.21.15.6:0/163961767 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40d0170 con 0x7f20c4157ca0 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c3fff700 1 --2- 172.21.15.6:0/163961767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c4157ca0 0x7f20c40cf4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009e60 tx=0x7f20b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d770f67394c7c55d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.096+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b400e070 con 0x7f20c4157ca0 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b400b850 con 0x7f20c4157ca0 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20c37fe700 1 -- 172.21.15.6:0/163961767 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc001470 con 0x7f20c4157ca0 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 -- 172.21.15.6:0/163961767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c4157ca0 msgr2=0x7f20c40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/163961767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c4157ca0 0x7f20c40cf4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009e60 tx=0x7f20b4009780 comp rx=0 tx=0).stop 2023-10-09T11:45:16.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 -- 172.21.15.6:0/163961767 shutdown_connections 2023-10-09T11:45:16.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/163961767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c4157ca0 0x7f20c40cf4f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 -- 172.21.15.6:0/163961767 >> 172.21.15.6:0/163961767 conn(0x7f20c406bb90 msgr2=0x7f20c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:16.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 -- 172.21.15.6:0/163961767 shutdown_connections 2023-10-09T11:45:16.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.097+0000 7f20cb1ee700 1 -- 172.21.15.6:0/163961767 wait complete. 2023-10-09T11:45:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.098+0000 7f20cb1ee700 1 Processor -- start 2023-10-09T11:45:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.098+0000 7f20cb1ee700 1 -- start start 2023-10-09T11:45:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c41578d0 0x7f20c40ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20c4157ca0 0x7f20c415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40b1800 con 0x7f20c406d120 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41552c0 con 0x7f20c41578d0 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20cb1ee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40b0bf0 con 0x7f20c4157ca0 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20c8f8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20c8f8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33904/0 (socket says 172.21.15.6:33904) 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20c8f8a700 1 -- 172.21.15.6:0/4254710712 learned_addr learned my addr 172.21.15.6:0/4254710712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20c3fff700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c41578d0 0x7f20c40ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.099+0000 7f20c978b700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20c4157ca0 0x7f20c415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 -- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20c4157ca0 msgr2=0x7f20c415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20c4157ca0 0x7f20c415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 -- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c41578d0 msgr2=0x7f20c40ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c41578d0 0x7f20c40ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009a20 con 0x7f20c406d120 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c8f8a700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0015a0 tx=0x7f20bc001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00ce40 con 0x7f20c406d120 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc007360 con 0x7f20c406d120 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc004830 con 0x7f20c406d120 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c40b0ed0 con 0x7f20c406d120 2023-10-09T11:45:16.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.100+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c40b1490 con 0x7f20c406d120 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.101+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c4067ac0 con 0x7f20c406d120 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.101+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20bc004ba0 con 0x7f20c406d120 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.102+0000 7f20c0ff9700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.102+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f20bc0839b0 con 0x7f20c406d120 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.102+0000 7f20c3fff700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.102+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f20a406eb10 con 0x7f20c406d120 2023-10-09T11:45:16.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.102+0000 7f20c3fff700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f20c41580c0 tx=0x7f20b4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.106+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20bc018070 con 0x7f20c406d120 2023-10-09T11:45:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.304+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c40d0450 con 0x7f20c406d120 2023-10-09T11:45:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.305+0000 7f20c0ff9700 1 -- 172.21.15.6:0/4254710712 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+15440 (secure 0 0 0) 0x7f20bc0546f0 con 0x7f20c406d120 2023-10-09T11:45:16.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:16.306 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":150,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:44:35.956852+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:42:55.096942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T11:42:55.658373+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.9","mappings":[{"from":2,"to":0}]},{"pgid":"19.26","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 msgr2=0x7f20a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f20c41580c0 tx=0x7f20b4017000 comp rx=0 tx=0).stop 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 msgr2=0x7f20c4147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0015a0 tx=0x7f20bc001bf0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 shutdown_connections 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20c4157ca0 0x7f20c415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20c406d120 0x7f20c4147300 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 --2- 172.21.15.6:0/4254710712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c41578d0 0x7f20c40ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 >> 172.21.15.6:0/4254710712 conn(0x7f20c406bb90 msgr2=0x7f20c4155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 shutdown_connections 2023-10-09T11:45:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.307+0000 7f20cb1ee700 1 -- 172.21.15.6:0/4254710712 wait complete. 2023-10-09T11:45:16.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:45:16.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.439+0000 7ff5ddd2c700 1 Processor -- start 2023-10-09T11:45:16.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.439+0000 7ff5ddd2c700 1 -- start start 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5ddd2c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5d8157ca0 0x7ff5d80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5ddd2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80d07c0 con 0x7ff5d806d120 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5ddd2c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80cfbb0 con 0x7ff5d81578d0 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5ddd2c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d80cfe90 con 0x7ff5d8157ca0 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5d806d120 0x7ff5d806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41074/0 (socket says 172.21.15.6:41074) 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d7fff700 1 -- 172.21.15.6:0/1660602541 learned_addr learned my addr 172.21.15.6:0/1660602541 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d6ffd700 1 --2- 172.21.15.6:0/1660602541 >> v2:172.21.15.118:3300/0 conn(0x7ff5d8157ca0 0x7ff5d80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d67fc700 1 -- 172.21.15.6:0/1660602541 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239333697 0 0) 0x7ff5d80d07c0 con 0x7ff5d806d120 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d67fc700 1 -- 172.21.15.6:0/1660602541 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c0003570 con 0x7ff5d806d120 2023-10-09T11:45:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/1660602541 >> v1:172.21.15.118:6789/0 conn(0x7ff5d81578d0 legacy=0x7ff5d815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/1660602541 >> v1:172.21.15.6:6789/0 conn(0x7ff5d806d120 legacy=0x7ff5d806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.440+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/1660602541 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80d0170 con 0x7ff5d8157ca0 2023-10-09T11:45:16.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5d6ffd700 1 --2- 172.21.15.6:0/1660602541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d8157ca0 0x7ff5d80cf4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0098e0 tx=0x7ff5cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb65824c7d089335 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5d67fc700 1 -- 172.21.15.6:0/1660602541 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00b640 con 0x7ff5d8157ca0 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5d67fc700 1 -- 172.21.15.6:0/1660602541 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00b7a0 con 0x7ff5d8157ca0 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5d67fc700 1 -- 172.21.15.6:0/1660602541 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00bb20 con 0x7ff5d8157ca0 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/1660602541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d8157ca0 msgr2=0x7ff5d80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/1660602541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d8157ca0 0x7ff5d80cf4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0098e0 tx=0x7ff5cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/1660602541 shutdown_connections 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/1660602541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d8157ca0 0x7ff5d80cf4f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/1660602541 >> 172.21.15.6:0/1660602541 conn(0x7ff5d806bb90 msgr2=0x7ff5d806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/1660602541 shutdown_connections 2023-10-09T11:45:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.441+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/1660602541 wait complete. 2023-10-09T11:45:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 Processor -- start 2023-10-09T11:45:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 -- start start 2023-10-09T11:45:16.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 0x7ff5d813d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d8157ca0 0x7ff5d8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d814fd20 con 0x7ff5d81578d0 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8159040 con 0x7ff5d806d120 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5ddd2c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8159320 con 0x7ff5d8157ca0 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33910/0 (socket says 172.21.15.6:33910) 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.443+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/4174445723 learned_addr learned my addr 172.21.15.6:0/4174445723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d8157ca0 msgr2=0x7ff5d8158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d8157ca0 0x7ff5d8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 msgr2=0x7ff5d813d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d77fe700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 0x7ff5d813d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 0x7ff5d813d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009420 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d77fe700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 0x7ff5d813d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5d6ffd700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0093f0 tx=0x7ff5cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00b910 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00ba90 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d8159600 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc025670 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.444+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d8159bc0 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.445+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8067ac0 con 0x7ff5d81578d0 2023-10-09T11:45:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.445+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5cc023070 con 0x7ff5d81578d0 2023-10-09T11:45:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.446+0000 7ff5bf7fe700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.446+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff5cc085a50 con 0x7ff5d81578d0 2023-10-09T11:45:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.446+0000 7ff5d77fe700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.446+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7ff5c406eb10 con 0x7ff5d81578d0 2023-10-09T11:45:16.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.446+0000 7ff5d77fe700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 0x7ff5c40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001840 tx=0x7ff5c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.450+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5cc015020 con 0x7ff5d81578d0 2023-10-09T11:45:16.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.691+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff5d80d0450 con 0x7ff5d81578d0 2023-10-09T11:45:16.691 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:45:16.691+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:45:16.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.693+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(151..151 src has 1..151) v4 ==== 366+0+0 (secure 0 0 0) 0x7ff5cc023320 con 0x7ff5d81578d0 2023-10-09T11:45:16.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.693+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7ff5c406f2f0 con 0x7ff5d81578d0 2023-10-09T11:45:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.696+0000 7ff5bf7fe700 1 -- 172.21.15.6:0/4174445723 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff5cc052c80 con 0x7ff5d81578d0 2023-10-09T11:45:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 msgr2=0x7ff5c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 0x7ff5c40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001840 tx=0x7ff5c8009040 comp rx=0 tx=0).stop 2023-10-09T11:45:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 msgr2=0x7ff5d81584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0093f0 tx=0x7ff5cc017000 comp rx=0 tx=0).stop 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 shutdown_connections 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff5c4066f30 0x7ff5c40693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5d8157ca0 0x7ff5d8158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5d806d120 0x7ff5d813d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 --2- 172.21.15.6:0/4174445723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d81578d0 0x7ff5d81584d0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 >> 172.21.15.6:0/4174445723 conn(0x7ff5d806bb90 msgr2=0x7ff5d806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 shutdown_connections 2023-10-09T11:45:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.699+0000 7ff5ddd2c700 1 -- 172.21.15.6:0/4174445723 wait complete. 2023-10-09T11:45:16.700 INFO:tasks.ceph.mds.c.smithi006.stderr: -9084> 2023-10-09T11:43:02.610+0000 7f67b786c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:45:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:45:16.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:45:16.729 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:45:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.833+0000 7fe3729e7700 1 Processor -- start 2023-10-09T11:45:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 -- start start 2023-10-09T11:45:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe36c0d0b80 0x7fe36c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c06d700 0x7fe36c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0cf2d0 con 0x7fe36c0d02b0 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c15a690 con 0x7fe36c0d0b80 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.834+0000 7fe3729e7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06dc00 con 0x7fe36c06d700 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe36c0d0b80 0x7fe36c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe36c0d0b80 0x7fe36c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33946/0 (socket says 172.21.15.6:33946) 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3711e4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe36c0d02b0 0x7fe36c06cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41088/0 (socket says 172.21.15.6:41088) 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 -- 172.21.15.6:0/797107296 learned_addr learned my addr 172.21.15.6:0/797107296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3721e6700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c06d700 0x7fe36c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 -- 172.21.15.6:0/797107296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c06d700 msgr2=0x7fe36c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c06d700 0x7fe36c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 -- 172.21.15.6:0/797107296 >> v1:172.21.15.6:6789/0 conn(0x7fe36c0d02b0 legacy=0x7fe36c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 -- 172.21.15.6:0/797107296 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0cf570 con 0x7fe36c0d0b80 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3709e3700 1 -- 172.21.15.6:0/797107296 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256578932 0 0) 0x7fe36c0cf2d0 con 0x7fe36c0d02b0 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3719e5700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c0d0b80 0x7fe36c0cfd70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe3640099b0 tx=0x7fe364009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfed0f47c96e923 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3709e3700 1 -- 172.21.15.6:0/797107296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364009ea0 con 0x7fe36c0d0b80 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3709e3700 1 -- 172.21.15.6:0/797107296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400b860 con 0x7fe36c0d0b80 2023-10-09T11:45:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.835+0000 7fe3709e3700 1 -- 172.21.15.6:0/797107296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400bc00 con 0x7fe36c0d0b80 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 -- 172.21.15.6:0/797107296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c0d0b80 msgr2=0x7fe36c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c0d0b80 0x7fe36c0cfd70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe3640099b0 tx=0x7fe364009250 comp rx=0 tx=0).stop 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 -- 172.21.15.6:0/797107296 shutdown_connections 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c06d700 0x7fe36c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 --2- 172.21.15.6:0/797107296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c0d0b80 0x7fe36c0cfd70 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 -- 172.21.15.6:0/797107296 >> 172.21.15.6:0/797107296 conn(0x7fe36c063230 msgr2=0x7fe36c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 -- 172.21.15.6:0/797107296 shutdown_connections 2023-10-09T11:45:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.836+0000 7fe3729e7700 1 -- 172.21.15.6:0/797107296 wait complete. 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.837+0000 7fe3729e7700 1 Processor -- start 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.837+0000 7fe3729e7700 1 -- start start 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe36c0d02b0 0x7fe36c0c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c0d0b80 0x7fe36c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c155a60 con 0x7fe36c06d700 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c7cc0 con 0x7fe36c0d02b0 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3729e7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c5e90 con 0x7fe36c0d0b80 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33956/0 (socket says 172.21.15.6:33956) 2023-10-09T11:45:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 -- 172.21.15.6:0/464069307 learned_addr learned my addr 172.21.15.6:0/464069307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3711e4700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe36c0d02b0 0x7fe36c0c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3721e6700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c0d0b80 0x7fe36c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 -- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c0d0b80 msgr2=0x7fe36c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c0d0b80 0x7fe36c0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 -- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe36c0d02b0 msgr2=0x7fe36c0c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe36c0d02b0 0x7fe36c0c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640094f0 con 0x7fe36c06d700 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.838+0000 7fe3719e5700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.839+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400bbe0 con 0x7fe36c06d700 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.839+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364011420 con 0x7fe36c06d700 2023-10-09T11:45:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.839+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640117e0 con 0x7fe36c06d700 2023-10-09T11:45:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.839+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0c70b0 con 0x7fe36c06d700 2023-10-09T11:45:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.839+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c0c7670 con 0x7fe36c06d700 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.840+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0c7fa0 con 0x7fe36c06d700 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.840+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe364011bd0 con 0x7fe36c06d700 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.841+0000 7fe369ffb700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 0x7fe3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.841+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fe3640868f0 con 0x7fe36c06d700 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.841+0000 7fe3711e4700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 0x7fe3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.841+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fe35806ebb0 con 0x7fe36c06d700 2023-10-09T11:45:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.841+0000 7fe3711e4700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 0x7fe3580693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe3600011e0 tx=0x7fe360007bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:16.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:16.845+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe364015020 con 0x7fe36c06d700 2023-10-09T11:45:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.083+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe36c0676e0 con 0x7fe36c06d700 2023-10-09T11:45:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.696+0000 7fe369ffb700 1 -- 172.21.15.6:0/464069307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe364053090 con 0x7fe36c06d700 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.698+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 msgr2=0x7fe3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.698+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 0x7fe3580693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe3600011e0 tx=0x7fe360007bf0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.698+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 msgr2=0x7fe36c0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.698+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364017000 comp rx=0 tx=0).stop 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 shutdown_connections 2023-10-09T11:45:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe358066f30 0x7fe3580693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe36c0d0b80 0x7fe36c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe36c06d700 0x7fe36c0c6540 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 --2- 172.21.15.6:0/464069307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe36c0d02b0 0x7fe36c0c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 >> 172.21.15.6:0/464069307 conn(0x7fe36c063230 msgr2=0x7fe36c1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 shutdown_connections 2023-10-09T11:45:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.699+0000 7fe3729e7700 1 -- 172.21.15.6:0/464069307 wait complete. 2023-10-09T11:45:17.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:45:17.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.878+0000 7f5f6eed1700 1 Processor -- start 2023-10-09T11:45:17.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6eed1700 1 -- start start 2023-10-09T11:45:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6eed1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f6806dd60 0x7f5f680b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6eed1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680b0ca0 con 0x7f5f680cf240 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6eed1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680b00d0 con 0x7f5f6815a2a0 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6eed1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6806ea90 con 0x7f5f6806dd60 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.879+0000 7f5f6d46e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f6806dd60 0x7f5f680b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f67fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f680cf240 0x7f5f6806d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41096/0 (socket says 172.21.15.6:41096) 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f67fff700 1 -- 172.21.15.6:0/3898276613 learned_addr learned my addr 172.21.15.6:0/3898276613 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f677fe700 1 -- 172.21.15.6:0/3898276613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440045548 0 0) 0x7f5f680b0ca0 con 0x7f5f680cf240 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f677fe700 1 -- 172.21.15.6:0/3898276613 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f54003570 con 0x7f5f680cf240 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3898276613 >> v1:172.21.15.118:6789/0 conn(0x7f5f6815a2a0 legacy=0x7f5f680ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3898276613 >> v1:172.21.15.6:6789/0 conn(0x7f5f680cf240 legacy=0x7f5f6806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3898276613 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680b0370 con 0x7f5f6806dd60 2023-10-09T11:45:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f6d46e700 1 --2- 172.21.15.6:0/3898276613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6806dd60 0x7f5f680b1130 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5f500098e0 tx=0x7f5f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b3139150c7db0b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f677fe700 1 -- 172.21.15.6:0/3898276613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000b640 con 0x7f5f6806dd60 2023-10-09T11:45:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f677fe700 1 -- 172.21.15.6:0/3898276613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5000b7a0 con 0x7f5f6806dd60 2023-10-09T11:45:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.880+0000 7f5f677fe700 1 -- 172.21.15.6:0/3898276613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000bb40 con 0x7f5f6806dd60 2023-10-09T11:45:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3898276613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6806dd60 msgr2=0x7f5f680b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3898276613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6806dd60 0x7f5f680b1130 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5f500098e0 tx=0x7f5f500091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3898276613 shutdown_connections 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3898276613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6806dd60 0x7f5f680b1130 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3898276613 >> 172.21.15.6:0/3898276613 conn(0x7f5f68067640 msgr2=0x7f5f68067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3898276613 shutdown_connections 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.881+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3898276613 wait complete. 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.882+0000 7f5f6eed1700 1 Processor -- start 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.882+0000 7f5f6eed1700 1 -- start start 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f6806dd60 0x7f5f681436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 0x7f5f680ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c9390 con 0x7f5f6815a2a0 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c9670 con 0x7f5f680cf240 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6eed1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c9950 con 0x7f5f6806dd60 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33968/0 (socket says 172.21.15.6:33968) 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3993394696 learned_addr learned my addr 172.21.15.6:0/3993394696 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f67fff700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 0x7f5f680ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6cc6d700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f6806dd60 0x7f5f681436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f6806dd60 msgr2=0x7f5f681436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f6806dd60 0x7f5f681436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 msgr2=0x7f5f680ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 0x7f5f680ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009420 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f67fff700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 0x7f5f680ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f6d46e700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806f990 tx=0x7f5f50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.883+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000bae0 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.884+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50011630 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.884+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680c9c30 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.884+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f500119d0 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.884+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f680c8fb0 con 0x7f5f6815a2a0 2023-10-09T11:45:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.884+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68069e40 con 0x7f5f6815a2a0 2023-10-09T11:45:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.885+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f50011d40 con 0x7f5f6815a2a0 2023-10-09T11:45:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.885+0000 7f5f64ff9700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.885+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f5f50086190 con 0x7f5f6815a2a0 2023-10-09T11:45:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.885+0000 7f5f6cc6d700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.885+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f5f4806ebb0 con 0x7f5f6815a2a0 2023-10-09T11:45:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.886+0000 7f5f6cc6d700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 0x7f5f480693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f600037c0 tx=0x7f5f60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:17.890+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f50053370 con 0x7f5f6815a2a0 2023-10-09T11:45:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.082+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f680683d0 con 0x7f5f6815a2a0 2023-10-09T11:45:18.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.698+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(152..152 src has 1..152) v4 ==== 288+0+0 (secure 0 0 0) 0x7f5f5000f2e0 con 0x7f5f6815a2a0 2023-10-09T11:45:18.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.698+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f5f4806cfe0 con 0x7f5f6815a2a0 2023-10-09T11:45:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.703+0000 7f5f64ff9700 1 -- 172.21.15.6:0/3993394696 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v152) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5f50056990 con 0x7f5f6815a2a0 2023-10-09T11:45:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 msgr2=0x7f5f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 0x7f5f480693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f600037c0 tx=0x7f5f60009040 comp rx=0 tx=0).stop 2023-10-09T11:45:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 msgr2=0x7f5f680cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806f990 tx=0x7f5f50017000 comp rx=0 tx=0).stop 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 shutdown_connections 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5f48066f30 0x7f5f480693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f6815a2a0 0x7f5f680cab00 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5f6806dd60 0x7f5f681436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 --2- 172.21.15.6:0/3993394696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f680cf240 0x7f5f680ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 >> 172.21.15.6:0/3993394696 conn(0x7f5f68067640 msgr2=0x7f5f68156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 shutdown_connections 2023-10-09T11:45:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.707+0000 7f5f6eed1700 1 -- 172.21.15.6:0/3993394696 wait complete. 2023-10-09T11:45:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:45:18.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:45:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.846+0000 7f1fb8665700 1 Processor -- start 2023-10-09T11:45:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.846+0000 7f1fb8665700 1 -- start start 2023-10-09T11:45:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb8665700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fb0157fe0 0x7f1fb00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb8665700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1fb01583b0 0x7f1fb00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb8665700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00b2890 con 0x7f1fb00ceb30 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb8665700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00b4070 con 0x7f1fb0157fe0 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb8665700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00b4350 con 0x7f1fb01583b0 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb6c02700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1fb00ceb30 0x7f1fb00cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41102/0 (socket says 172.21.15.6:41102) 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb6c02700 1 -- 172.21.15.6:0/2872714892 learned_addr learned my addr 172.21.15.6:0/2872714892 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb6401700 1 --2- 172.21.15.6:0/2872714892 >> v2:172.21.15.6:3300/0 conn(0x7f1fb0157fe0 0x7f1fb00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.847+0000 7f1fb5c00700 1 --2- 172.21.15.6:0/2872714892 >> v2:172.21.15.118:3300/0 conn(0x7f1fb01583b0 0x7f1fb00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb53ff700 1 -- 172.21.15.6:0/2872714892 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96164854 0 0) 0x7f1fb00b2890 con 0x7f1fb00ceb30 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb53ff700 1 -- 172.21.15.6:0/2872714892 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f9c003570 con 0x7f1fb00ceb30 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb6401700 1 -- 172.21.15.6:0/2872714892 >> v2:172.21.15.118:3300/0 conn(0x7f1fb01583b0 msgr2=0x7f1fb00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb6401700 1 --2- 172.21.15.6:0/2872714892 >> v2:172.21.15.118:3300/0 conn(0x7f1fb01583b0 0x7f1fb00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb6401700 1 -- 172.21.15.6:0/2872714892 >> v1:172.21.15.6:6789/0 conn(0x7f1fb00ceb30 legacy=0x7f1fb00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb6401700 1 -- 172.21.15.6:0/2872714892 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00b4630 con 0x7f1fb0157fe0 2023-10-09T11:45:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb6401700 1 --2- 172.21.15.6:0/2872714892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb0157fe0 0x7f1fb00b34c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1fb004c150 tx=0x7f1fac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07b106e5cfdbb99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb53ff700 1 -- 172.21.15.6:0/2872714892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac011630 con 0x7f1fb0157fe0 2023-10-09T11:45:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb53ff700 1 -- 172.21.15.6:0/2872714892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0117b0 con 0x7f1fb0157fe0 2023-10-09T11:45:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.848+0000 7f1fb53ff700 1 -- 172.21.15.6:0/2872714892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac011b70 con 0x7f1fb0157fe0 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 -- 172.21.15.6:0/2872714892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb0157fe0 msgr2=0x7f1fb00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 --2- 172.21.15.6:0/2872714892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb0157fe0 0x7f1fb00b34c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1fb004c150 tx=0x7f1fac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 -- 172.21.15.6:0/2872714892 shutdown_connections 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 --2- 172.21.15.6:0/2872714892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb0157fe0 0x7f1fb00b34c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 --2- 172.21.15.6:0/2872714892 >> v2:172.21.15.118:3300/0 conn(0x7f1fb01583b0 0x7f1fb00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 -- 172.21.15.6:0/2872714892 >> 172.21.15.6:0/2872714892 conn(0x7f1fb0067640 msgr2=0x7f1fb0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 -- 172.21.15.6:0/2872714892 shutdown_connections 2023-10-09T11:45:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.849+0000 7f1fb8665700 1 -- 172.21.15.6:0/2872714892 wait complete. 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.850+0000 7f1fb8665700 1 Processor -- start 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.850+0000 7f1fb8665700 1 -- start start 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb0157fe0 0x7f1fb006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 0x7f1fb00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb006d010 con 0x7f1fb00ceb30 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb006d2f0 con 0x7f1fb0157fe0 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb8665700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb006d5d0 con 0x7f1fb01583b0 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33986/0 (socket says 172.21.15.6:33986) 2023-10-09T11:45:18.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 -- 172.21.15.6:0/70693952 learned_addr learned my addr 172.21.15.6:0/70693952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb5c00700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb0157fe0 0x7f1fb006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6c02700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 0x7f1fb00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 -- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 msgr2=0x7f1fb00cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 0x7f1fb00cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 -- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb0157fe0 msgr2=0x7f1fb006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb0157fe0 0x7f1fb006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:18.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009420 con 0x7f1fb00ceb30 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6c02700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 0x7f1fb00cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fb6401700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1fac013000 tx=0x7f1fac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac01f070 con 0x7f1fb00ceb30 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.851+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac000bc0 con 0x7f1fb00ceb30 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.852+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb006d8b0 con 0x7f1fb00ceb30 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.852+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac011b70 con 0x7f1fb00ceb30 2023-10-09T11:45:18.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.852+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb006e5f0 con 0x7f1fb00ceb30 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.852+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0069e40 con 0x7f1fb00ceb30 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.853+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fac023070 con 0x7f1fb00ceb30 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.853+0000 7f1fa67fc700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.853+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f1fac0856e0 con 0x7f1fb00ceb30 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.853+0000 7f1fb5c00700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.853+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=153}) v3 -- 0x7f1f9406ddb0 con 0x7f1fb00ceb30 2023-10-09T11:45:18.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.854+0000 7f1fb5c00700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0157280 tx=0x7f1fa00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:18.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:18.857+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fac02a060 con 0x7f1fb00ceb30 2023-10-09T11:45:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.052+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fb0157650 con 0x7f1fb00ceb30 2023-10-09T11:45:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.701+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(153..153 src has 1..153) v4 ==== 322+0+0 (secure 0 0 0) 0x7f1fac056730 con 0x7f1fb00ceb30 2023-10-09T11:45:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.701+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f1f9406cb40 con 0x7f1fb00ceb30 2023-10-09T11:45:19.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.706+0000 7f1fa67fc700 1 -- 172.21.15.6:0/70693952 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v153) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1fac015020 con 0x7f1fb00ceb30 2023-10-09T11:45:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 msgr2=0x7f1f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0157280 tx=0x7f1fa00091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 msgr2=0x7f1fb0144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1fac013000 tx=0x7f1fac017000 comp rx=0 tx=0).stop 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 shutdown_connections 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1fb01583b0 0x7f1fb00cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fb00ceb30 0x7f1fb0144930 secure :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1fac013000 tx=0x7f1fac017000 comp rx=0 tx=0).stop 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 --2- 172.21.15.6:0/70693952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb0157fe0 0x7f1fb006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 >> 172.21.15.6:0/70693952 conn(0x7f1fb0067640 msgr2=0x7f1fb01537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 shutdown_connections 2023-10-09T11:45:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.713+0000 7f1fb8665700 1 -- 172.21.15.6:0/70693952 wait complete. 2023-10-09T11:45:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:45:19.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:45:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.851+0000 7f666b43d700 1 Processor -- start 2023-10-09T11:45:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.851+0000 7f666b43d700 1 -- start start 2023-10-09T11:45:19.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f666b43d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66641578d0 0x7f66640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f666b43d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66640d07c0 con 0x7f666406d120 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f666b43d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66640cfbb0 con 0x7f6664157ca0 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f666b43d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66640cfe90 con 0x7f66641578d0 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f66699da700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f666406d120 0x7f666415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41104/0 (socket says 172.21.15.6:41104) 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f66699da700 1 -- 172.21.15.6:0/739762620 learned_addr learned my addr 172.21.15.6:0/739762620 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66641578d0 0x7f66640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678721830 0 0) 0x7f66640d07c0 con 0x7f666406d120 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f664c003570 con 0x7f666406d120 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790924389 0 0) 0x7f66640cfbb0 con 0x7f6664157ca0 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66640d07c0 con 0x7f6664157ca0 2023-10-09T11:45:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883178590 0 0) 0x7f664c003570 con 0x7f666406d120 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66641578d0 msgr2=0x7f66640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66641578d0 0x7f66640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 >> v1:172.21.15.118:6789/0 conn(0x7f6664157ca0 legacy=0x7f666415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640d0170 con 0x7f666406d120 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.852+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f66540017f0 con 0x7f666406d120 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 >> v1:172.21.15.6:6789/0 conn(0x7f666406d120 legacy=0x7f666415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f664c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f664c004810 0x7f664c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0051c0 0x7f664c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66640cfe90 con 0x7f664c003c20 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c00c020 con 0x7f664c0051c0 2023-10-09T11:45:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c00c1e0 con 0x7f664c004810 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66641578d0 0x7f66640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f664c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66689d8700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f664c004810 0x7f664c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66699da700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0051c0 0x7f664c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 -- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f664c004810 msgr2=0x7f664c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f664c004810 0x7f664c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 -- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0051c0 msgr2=0x7f664c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f664c0051c0 0x7f664c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 -- 172.21.15.6:0/739762620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c003570 con 0x7f664c003c20 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f66691d9700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f664c004010 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f66640646e0 tx=0x7f665c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f745b932a7f07185 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00e710 con 0x7f664c003c20 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00e870 con 0x7f664c003c20 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.853+0000 7f6663fff700 1 -- 172.21.15.6:0/739762620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00ec10 con 0x7f664c003c20 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 -- 172.21.15.6:0/739762620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 msgr2=0x7f664c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 --2- 172.21.15.6:0/739762620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f664c004010 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f66640646e0 tx=0x7f665c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f66699da700 1 -- 172.21.15.6:0/739762620 reap_dead start 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 -- 172.21.15.6:0/739762620 shutdown_connections 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 -- 172.21.15.6:0/739762620 >> 172.21.15.6:0/739762620 conn(0x7f666406bb90 msgr2=0x7f666406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 -- 172.21.15.6:0/739762620 shutdown_connections 2023-10-09T11:45:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.854+0000 7f666b43d700 1 -- 172.21.15.6:0/739762620 wait complete. 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.855+0000 7f666b43d700 1 Processor -- start 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.855+0000 7f666b43d700 1 -- start start 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 0x7f6664151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 0x7f6664158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66640b4710 con 0x7f664c003c20 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666414ee30 con 0x7f6664151b90 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f666b43d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66641520c0 con 0x7f66640b61a0 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34012/0 (socket says 172.21.15.6:34012) 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 -- 172.21.15.6:0/2838396338 learned_addr learned my addr 172.21.15.6:0/2838396338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66699da700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 0x7f6664158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66689d8700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 0x7f6664151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 -- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 msgr2=0x7f6664151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 0x7f6664151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 -- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 msgr2=0x7f6664158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 0x7f6664158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66691d9700 1 -- 172.21.15.6:0/2838396338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66641523a0 con 0x7f664c003c20 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66689d8700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 0x7f6664151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.856+0000 7f66699da700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 0x7f6664158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f66691d9700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f665c00e4b0 tx=0x7f665c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c022070 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c01c420 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c01c7e0 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6664152680 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.857+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666416a550 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.858+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66640ce550 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.858+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f665c01cc10 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.858+0000 7f66617fa700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 0x7f66500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.858+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f665c085c00 con 0x7f664c003c20 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.859+0000 7f66689d8700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 0x7f66500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.859+0000 7f66689d8700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 0x7f66500693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6658007bc0 tx=0x7f6658009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:19.863+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f665c08c080 con 0x7f664c003c20 2023-10-09T11:45:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.057+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f66640b49f0 con 0x7f664c003c20 2023-10-09T11:45:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.060+0000 7f66617fa700 1 -- 172.21.15.6:0/2838396338 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f665c053320 con 0x7f664c003c20 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.062+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 msgr2=0x7f66500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.062+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 0x7f66500693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6658007bc0 tx=0x7f6658009040 comp rx=0 tx=0).stop 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.062+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 msgr2=0x7f666414e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.062+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f665c00e4b0 tx=0x7f665c019000 comp rx=0 tx=0).stop 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 shutdown_connections 2023-10-09T11:45:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6650066f30 0x7f66500693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6664151b90 0x7f6664158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c003c20 0x7f666414e8f0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 --2- 172.21.15.6:0/2838396338 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f66640b61a0 0x7f6664151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 >> 172.21.15.6:0/2838396338 conn(0x7f666406bb90 msgr2=0x7f6664159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 shutdown_connections 2023-10-09T11:45:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.063+0000 7f666b43d700 1 -- 172.21.15.6:0/2838396338 wait complete. 2023-10-09T11:45:20.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-09T11:45:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.193+0000 7f41930f4700 1 Processor -- start 2023-10-09T11:45:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.193+0000 7f41930f4700 1 -- start start 2023-10-09T11:45:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f41930f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418c1578d0 0x7f418c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f41930f4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f41930f4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0d07c0 con 0x7f418c157ca0 2023-10-09T11:45:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f41930f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c06daa0 con 0x7f418c1578d0 2023-10-09T11:45:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f41930f4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0cfbb0 con 0x7f418c06d120 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f4190e90700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418c1578d0 0x7f418c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f418bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f418c157ca0 0x7f418c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41116/0 (socket says 172.21.15.6:41116) 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.194+0000 7f418bfff700 1 -- 172.21.15.6:0/4106630165 learned_addr learned my addr 172.21.15.6:0/4106630165 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4191691700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4190e90700 1 -- 172.21.15.6:0/4106630165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c06d120 msgr2=0x7f418c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4190e90700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4190e90700 1 -- 172.21.15.6:0/4106630165 >> v1:172.21.15.6:6789/0 conn(0x7f418c157ca0 legacy=0x7f418c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4190e90700 1 -- 172.21.15.6:0/4106630165 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0cfe90 con 0x7f418c1578d0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f4190e90700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c1578d0 0x7f418c0cf4f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f41740098e0 tx=0x7f41740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9830361aab9a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f418b7fe700 1 -- 172.21.15.6:0/4106630165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174009e80 con 0x7f418c1578d0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f418b7fe700 1 -- 172.21.15.6:0/4106630165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400b760 con 0x7f418c1578d0 2023-10-09T11:45:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.195+0000 7f418b7fe700 1 -- 172.21.15.6:0/4106630165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400bae0 con 0x7f418c1578d0 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 -- 172.21.15.6:0/4106630165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c1578d0 msgr2=0x7f418c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c1578d0 0x7f418c0cf4f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f41740098e0 tx=0x7f41740091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 -- 172.21.15.6:0/4106630165 shutdown_connections 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c06d120 0x7f418c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 --2- 172.21.15.6:0/4106630165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c1578d0 0x7f418c0cf4f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 -- 172.21.15.6:0/4106630165 >> 172.21.15.6:0/4106630165 conn(0x7f418c06bb90 msgr2=0x7f418c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 -- 172.21.15.6:0/4106630165 shutdown_connections 2023-10-09T11:45:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.196+0000 7f41930f4700 1 -- 172.21.15.6:0/4106630165 wait complete. 2023-10-09T11:45:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.197+0000 7f41930f4700 1 Processor -- start 2023-10-09T11:45:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.197+0000 7f41930f4700 1 -- start start 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418c06d120 0x7f418c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c1578d0 0x7f418c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c16a5b0 con 0x7f418c157ca0 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c16a850 con 0x7f418c06d120 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f41930f4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c16ab30 con 0x7f418c1578d0 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34028/0 (socket says 172.21.15.6:34028) 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 -- 172.21.15.6:0/1441885396 learned_addr learned my addr 172.21.15.6:0/1441885396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f418bfff700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c1578d0 0x7f418c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4190e90700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418c06d120 0x7f418c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 -- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c1578d0 msgr2=0x7f418c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c1578d0 0x7f418c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 -- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418c06d120 msgr2=0x7f418c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418c06d120 0x7f418c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 -- 172.21.15.6:0/1441885396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009420 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.198+0000 7f4191691700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f418400c880 tx=0x7f4184008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.199+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184011660 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.199+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840117c0 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.199+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184011b60 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.199+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c16ae10 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.199+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c1555c0 con 0x7f418c157ca0 2023-10-09T11:45:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.200+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c16b330 con 0x7f418c157ca0 2023-10-09T11:45:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.200+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41840193f0 con 0x7f418c157ca0 2023-10-09T11:45:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.200+0000 7f4188ff9700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.200+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f41840844c0 con 0x7f418c157ca0 2023-10-09T11:45:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.200+0000 7f4190e90700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.201+0000 7f4190e90700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41740093f0 tx=0x7f4174016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.205+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f418c16b330 con 0x7f418c157ca0 2023-10-09T11:45:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.478+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f418c16b330 con 0x7f418c157ca0 2023-10-09T11:45:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.700+0000 7f4188ff9700 1 -- 172.21.15.6:0/1441885396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v438) v1 ==== 132+0+0 (secure 0 0 0) 0x7f418c16b330 con 0x7f418c157ca0 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 msgr2=0x7f416c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41740093f0 tx=0x7f4174016000 comp rx=0 tx=0).stop 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 msgr2=0x7f418c144620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f418400c880 tx=0x7f4184008040 comp rx=0 tx=0).stop 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 shutdown_connections 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f416c066f30 0x7f416c0693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c157ca0 0x7f418c144620 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f418c06d120 0x7f418c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 --2- 172.21.15.6:0/1441885396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f418c1578d0 0x7f418c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 >> 172.21.15.6:0/1441885396 conn(0x7f418c06bb90 msgr2=0x7f418c068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 shutdown_connections 2023-10-09T11:45:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.702+0000 7f41930f4700 1 -- 172.21.15.6:0/1441885396 wait complete. 2023-10-09T11:45:20.716 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T11:45:20.716 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-09T11:45:20.716 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T11:45:20.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-09T11:45:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.835+0000 7f93bcd4b700 1 Processor -- start 2023-10-09T11:45:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.835+0000 7f93bcd4b700 1 -- start start 2023-10-09T11:45:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93bcd4b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93b80686e0 0x7f93b815d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93bcd4b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 0x7f93b80b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93bcd4b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b815e830 con 0x7f93b8159c90 2023-10-09T11:45:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93bcd4b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80b34e0 con 0x7f93b80686e0 2023-10-09T11:45:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93bcd4b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80cb3f0 con 0x7f93b80b2b20 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93b6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93b80686e0 0x7f93b815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93b77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f93b8159c90 0x7f93b80ccc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41132/0 (socket says 172.21.15.6:41132) 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93b6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93b80686e0 0x7f93b815d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34042/0 (socket says 172.21.15.6:34042) 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93b77fe700 1 -- 172.21.15.6:0/3347153506 learned_addr learned my addr 172.21.15.6:0/3347153506 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.836+0000 7f93b7fff700 1 --2- 172.21.15.6:0/3347153506 >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 0x7f93b80b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b6ffd700 1 -- 172.21.15.6:0/3347153506 >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 msgr2=0x7f93b80b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b6ffd700 1 --2- 172.21.15.6:0/3347153506 >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 0x7f93b80b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b6ffd700 1 -- 172.21.15.6:0/3347153506 >> v1:172.21.15.6:6789/0 conn(0x7f93b8159c90 legacy=0x7f93b80ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b6ffd700 1 -- 172.21.15.6:0/3347153506 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80caf60 con 0x7f93b80686e0 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b7fff700 1 --2- 172.21.15.6:0/3347153506 >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 0x7f93b80b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b67fc700 1 -- 172.21.15.6:0/3347153506 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544441941 0 0) 0x7f93a8001110 con 0x7f93b8159c90 2023-10-09T11:45:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b6ffd700 1 --2- 172.21.15.6:0/3347153506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80686e0 0x7f93b815d890 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f93b80ce2e0 tx=0x7f93ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df05dfb5f93041dd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b67fc700 1 -- 172.21.15.6:0/3347153506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00b6b0 con 0x7f93b80686e0 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b67fc700 1 -- 172.21.15.6:0/3347153506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00b810 con 0x7f93b80686e0 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93b67fc700 1 -- 172.21.15.6:0/3347153506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00bbb0 con 0x7f93b80686e0 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 -- 172.21.15.6:0/3347153506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80686e0 msgr2=0x7f93b815d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/3347153506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80686e0 0x7f93b815d890 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f93b80ce2e0 tx=0x7f93ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 -- 172.21.15.6:0/3347153506 shutdown_connections 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/3347153506 >> v2:172.21.15.118:3300/0 conn(0x7f93b80b2b20 0x7f93b80b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/3347153506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80686e0 0x7f93b815d890 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 -- 172.21.15.6:0/3347153506 >> 172.21.15.6:0/3347153506 conn(0x7f93b806bb90 msgr2=0x7f93b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 -- 172.21.15.6:0/3347153506 shutdown_connections 2023-10-09T11:45:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.837+0000 7f93bcd4b700 1 -- 172.21.15.6:0/3347153506 wait complete. 2023-10-09T11:45:20.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 Processor -- start 2023-10-09T11:45:20.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 -- start start 2023-10-09T11:45:20.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b80686e0 0x7f93b816a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b80b2b20 0x7f93b80c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b816c8f0 con 0x7f93b8159c90 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b816a570 con 0x7f93b80b2b20 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93bcd4b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80c7e60 con 0x7f93b80686e0 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.839+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34048/0 (socket says 172.21.15.6:34048) 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 -- 172.21.15.6:0/1839761942 learned_addr learned my addr 172.21.15.6:0/1839761942 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b6ffd700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b80b2b20 0x7f93b80c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b77fe700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b80686e0 0x7f93b816a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 -- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b80686e0 msgr2=0x7f93b816a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b80686e0 0x7f93b816a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 -- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b80b2b20 msgr2=0x7f93b80c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b80b2b20 0x7f93b80c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 -- 172.21.15.6:0/1839761942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac009420 con 0x7f93b8159c90 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93b7fff700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f93b000a380 tx=0x7f93b0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ae10 con 0x7f93b8159c90 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000d650 con 0x7f93b8159c90 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b816bce0 con 0x7f93b8159c90 2023-10-09T11:45:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000da10 con 0x7f93b8159c90 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.840+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b816c2a0 con 0x7f93b8159c90 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.841+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b806fbe0 con 0x7f93b8159c90 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.842+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93b001e3b0 con 0x7f93b8159c90 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.842+0000 7f939f7fe700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.842+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f93b0084c80 con 0x7f93b8159c90 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.842+0000 7f93b77fe700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.843+0000 7f93b77fe700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 0x7f93a40693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f93b80d14a0 tx=0x7f93a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:20.846+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93b00521f0 con 0x7f93b8159c90 2023-10-09T11:45:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.120+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f93b8071b10 con 0x7f93b8159c90 2023-10-09T11:45:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.701+0000 7f939f7fe700 1 -- 172.21.15.6:0/1839761942 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v439) v1 ==== 134+0+0 (secure 0 0 0) 0x7f93b001a0c0 con 0x7f93b8159c90 2023-10-09T11:45:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 msgr2=0x7f93a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 0x7f93a40693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f93b80d14a0 tx=0x7f93a8009040 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 msgr2=0x7f93b816b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f93b000a380 tx=0x7f93b0007900 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 shutdown_connections 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f93a4066f30 0x7f93a40693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b8159c90 0x7f93b816b0f0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b80686e0 0x7f93b816a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 --2- 172.21.15.6:0/1839761942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b80b2b20 0x7f93b80c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 >> 172.21.15.6:0/1839761942 conn(0x7f93b806bb90 msgr2=0x7f93b80cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 shutdown_connections 2023-10-09T11:45:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.704+0000 7f93bcd4b700 1 -- 172.21.15.6:0/1839761942 wait complete. 2023-10-09T11:45:21.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:45:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.843+0000 7f5de3ff6700 1 Processor -- start 2023-10-09T11:45:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.843+0000 7f5de3ff6700 1 -- start start 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de3ff6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ddc1578d0 0x7f5ddc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de3ff6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ddc06d120 0x7f5ddc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de3ff6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc0d07c0 con 0x7f5ddc157ca0 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de3ff6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc06da50 con 0x7f5ddc06d120 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de3ff6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0cfbb0 con 0x7f5ddc1578d0 2023-10-09T11:45:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de2593700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ddc06d120 0x7f5ddc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de2593700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ddc06d120 0x7f5ddc06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34052/0 (socket says 172.21.15.6:34052) 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de2593700 1 -- 172.21.15.6:0/430598299 learned_addr learned my addr 172.21.15.6:0/430598299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.844+0000 7f5de1d92700 1 --2- 172.21.15.6:0/430598299 >> v2:172.21.15.118:3300/0 conn(0x7f5ddc1578d0 0x7f5ddc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de2593700 1 -- 172.21.15.6:0/430598299 >> v2:172.21.15.118:3300/0 conn(0x7f5ddc1578d0 msgr2=0x7f5ddc0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de2593700 1 --2- 172.21.15.6:0/430598299 >> v2:172.21.15.118:3300/0 conn(0x7f5ddc1578d0 0x7f5ddc0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de2593700 1 -- 172.21.15.6:0/430598299 >> v1:172.21.15.118:6789/0 conn(0x7f5ddc157ca0 legacy=0x7f5ddc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de2593700 1 -- 172.21.15.6:0/430598299 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0cfe90 con 0x7f5ddc06d120 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de2593700 1 --2- 172.21.15.6:0/430598299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc06d510 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0646b0 tx=0x7f5dd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27aefb3a0323f8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de0d90700 1 -- 172.21.15.6:0/430598299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4009e70 con 0x7f5ddc06d120 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de0d90700 1 -- 172.21.15.6:0/430598299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400b860 con 0x7f5ddc06d120 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.845+0000 7f5de0d90700 1 -- 172.21.15.6:0/430598299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400bc00 con 0x7f5ddc06d120 2023-10-09T11:45:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 -- 172.21.15.6:0/430598299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 msgr2=0x7f5ddc06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/430598299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc06d510 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0646b0 tx=0x7f5dd4009250 comp rx=0 tx=0).stop 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 -- 172.21.15.6:0/430598299 shutdown_connections 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/430598299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc06d510 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/430598299 >> v2:172.21.15.118:3300/0 conn(0x7f5ddc1578d0 0x7f5ddc0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 -- 172.21.15.6:0/430598299 >> 172.21.15.6:0/430598299 conn(0x7f5ddc06bb90 msgr2=0x7f5ddc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 -- 172.21.15.6:0/430598299 shutdown_connections 2023-10-09T11:45:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.846+0000 7f5de3ff6700 1 -- 172.21.15.6:0/430598299 wait complete. 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 Processor -- start 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 -- start start 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ddc1578d0 0x7f5ddc152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ddc157ca0 0x7f5ddc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0b6010 con 0x7f5ddc06d120 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc14ad10 con 0x7f5ddc157ca0 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.847+0000 7f5de3ff6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc14a6f0 con 0x7f5ddc1578d0 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34062/0 (socket says 172.21.15.6:34062) 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 -- 172.21.15.6:0/3590637609 learned_addr learned my addr 172.21.15.6:0/3590637609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de2593700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ddc157ca0 0x7f5ddc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1591700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ddc1578d0 0x7f5ddc152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 -- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ddc1578d0 msgr2=0x7f5ddc152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ddc1578d0 0x7f5ddc152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 -- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ddc157ca0 msgr2=0x7f5ddc14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ddc157ca0 0x7f5ddc14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 -- 172.21.15.6:0/3590637609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40094f0 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de1d92700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009ef0 tx=0x7f5dcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00cb70 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00f040 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc16a5e0 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.848+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc014480 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.849+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc16aba0 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.849+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc16b1f0 con 0x7f5ddc06d120 2023-10-09T11:45:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.850+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dcc0147f0 con 0x7f5ddc06d120 2023-10-09T11:45:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.850+0000 7f5dd9ffb700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.850+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5dcc084e30 con 0x7f5ddc06d120 2023-10-09T11:45:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.850+0000 7f5de1591700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.851+0000 7f5de1591700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 0x7f5dc80693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b6ba0 tx=0x7f5dd0007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:21.855+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dcc0523a0 con 0x7f5ddc06d120 2023-10-09T11:45:22.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.049+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5ddc0d0170 con 0x7f5ddc06d120 2023-10-09T11:45:22.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.053+0000 7f5dd9ffb700 1 -- 172.21.15.6:0/3590637609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5dcc0559c0 con 0x7f5ddc06d120 2023-10-09T11:45:22.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 msgr2=0x7f5dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 0x7f5dc80693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b6ba0 tx=0x7f5dd0007ec0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 msgr2=0x7f5ddc153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009ef0 tx=0x7f5dcc00b040 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 shutdown_connections 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5dc8066f30 0x7f5dc80693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ddc157ca0 0x7f5ddc14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ddc06d120 0x7f5ddc153ad0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 --2- 172.21.15.6:0/3590637609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ddc1578d0 0x7f5ddc152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 >> 172.21.15.6:0/3590637609 conn(0x7f5ddc06bb90 msgr2=0x7f5ddc155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 shutdown_connections 2023-10-09T11:45:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.055+0000 7f5de3ff6700 1 -- 172.21.15.6:0/3590637609 wait complete. 2023-10-09T11:45:22.067 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:45:22.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:45:22.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:45:22.162 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:45:22.162 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:45:22.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.281+0000 7f4e01be8700 1 Processor -- start 2023-10-09T11:45:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.281+0000 7f4e01be8700 1 -- start start 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e01be8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4dfc159b40 0x7f4dfc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e01be8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0cee10 con 0x7f4dfc159f10 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e01be8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0cd040 con 0x7f4dfc068e90 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e01be8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0cd320 con 0x7f4dfc159b40 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4dfc159b40 0x7f4dfc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4dfc159b40 0x7f4dfc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34064/0 (socket says 172.21.15.6:34064) 2023-10-09T11:45:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4dfbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4dfc159f10 0x7f4dfc068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41146/0 (socket says 172.21.15.6:41146) 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 -- 172.21.15.6:0/3797878149 learned_addr learned my addr 172.21.15.6:0/3797878149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 -- 172.21.15.6:0/3797878149 >> v1:172.21.15.118:6789/0 conn(0x7f4dfc068e90 legacy=0x7f4dfc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 -- 172.21.15.6:0/3797878149 >> v1:172.21.15.6:6789/0 conn(0x7f4dfc159f10 legacy=0x7f4dfc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.282+0000 7f4e00be6700 1 -- 172.21.15.6:0/3797878149 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0ce7c0 con 0x7f4dfc159b40 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e00be6700 1 --2- 172.21.15.6:0/3797878149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0cc600 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009f20 tx=0x7f4df4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b389d7856f28be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4dfb7fe700 1 -- 172.21.15.6:0/3797878149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400e070 con 0x7f4dfc159b40 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4dfb7fe700 1 -- 172.21.15.6:0/3797878149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400ba80 con 0x7f4dfc159b40 2023-10-09T11:45:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4dfb7fe700 1 -- 172.21.15.6:0/3797878149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40092e0 con 0x7f4dfc159b40 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 -- 172.21.15.6:0/3797878149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159b40 msgr2=0x7f4dfc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 --2- 172.21.15.6:0/3797878149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0cc600 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009f20 tx=0x7f4df4009840 comp rx=0 tx=0).stop 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 -- 172.21.15.6:0/3797878149 shutdown_connections 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 --2- 172.21.15.6:0/3797878149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0cc600 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 -- 172.21.15.6:0/3797878149 >> 172.21.15.6:0/3797878149 conn(0x7f4dfc0cd660 msgr2=0x7f4dfc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 -- 172.21.15.6:0/3797878149 shutdown_connections 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.283+0000 7f4e01be8700 1 -- 172.21.15.6:0/3797878149 wait complete. 2023-10-09T11:45:22.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.284+0000 7f4e01be8700 1 Processor -- start 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 -- start start 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc068e90 0x7f4dfc153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc15cda0 con 0x7f4dfc159f10 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0b5890 con 0x7f4dfc159b40 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e01be8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc15a750 con 0x7f4dfc068e90 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.285+0000 7f4e013e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34074/0 (socket says 172.21.15.6:34074) 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 -- 172.21.15.6:0/2455398782 learned_addr learned my addr 172.21.15.6:0/2455398782 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4dfbfff700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e00be6700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc068e90 0x7f4dfc153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 -- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc068e90 msgr2=0x7f4dfc153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc068e90 0x7f4dfc153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 -- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc159b40 msgr2=0x7f4dfc0b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 -- 172.21.15.6:0/2455398782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009ae0 con 0x7f4dfc159f10 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e013e7700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c590 tx=0x7f4de4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011590 con 0x7f4dfc159f10 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40116f0 con 0x7f4dfc159f10 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc0b55b0 con 0x7f4dfc159f10 2023-10-09T11:45:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011ab0 con 0x7f4dfc159f10 2023-10-09T11:45:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.286+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc153f40 con 0x7f4dfc159f10 2023-10-09T11:45:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.287+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc15a900 con 0x7f4dfc159f10 2023-10-09T11:45:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.288+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de401b3b0 con 0x7f4dfc159f10 2023-10-09T11:45:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.288+0000 7f4df8ff9700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.288+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4de4083590 con 0x7f4dfc159f10 2023-10-09T11:45:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.288+0000 7f4e00be6700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.288+0000 7f4e00be6700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 0x7f4ddc0693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009880 tx=0x7f4df4018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.292+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de4050b00 con 0x7f4dfc159f10 2023-10-09T11:45:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.534+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dfc15bf50 con 0x7f4dfc159f10 2023-10-09T11:45:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.534+0000 7f4df8ff9700 1 -- 172.21.15.6:0/2455398782 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4de4017020 con 0x7f4dfc159f10 2023-10-09T11:45:22.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:22.535 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2083713840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2083713840},{"type":"v1","addr":"172.21.15.6:6837","nonce":2083713840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2341296322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2341296322},{"type":"v1","addr":"172.21.15.118:6834","nonce":2341296322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2594415753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2594415753},{"type":"v1","addr":"172.21.15.118:6835","nonce":2594415753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7725,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3582979524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3582979524},{"type":"v1","addr":"172.21.15.6:6836","nonce":3582979524}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[]} 2023-10-09T11:45:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.536+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 msgr2=0x7f4ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.536+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 0x7f4ddc0693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009880 tx=0x7f4df4018000 comp rx=0 tx=0).stop 2023-10-09T11:45:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.536+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 msgr2=0x7f4dfc156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.536+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c590 tx=0x7f4de4007ec0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 shutdown_connections 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4ddc066f30 0x7f4ddc0693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4dfc159f10 0x7f4dfc156850 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4dfc068e90 0x7f4dfc153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 --2- 172.21.15.6:0/2455398782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4dfc159b40 0x7f4dfc0b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 >> 172.21.15.6:0/2455398782 conn(0x7f4dfc0cd660 msgr2=0x7f4dfc06f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 shutdown_connections 2023-10-09T11:45:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.537+0000 7f4e01be8700 1 -- 172.21.15.6:0/2455398782 wait complete. 2023-10-09T11:45:22.539 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-10-09T11:45:22.549 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:45:22.549 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:45:22.550 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:45:22.550 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:45:22.550 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:45:22.550 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:45:22.550 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:45:22.551 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:45:22.551 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:45:22.551 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:45:22.551 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:45:22.551 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:45:22.551 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:45:22.551 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:45:22.552 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:45:22.552 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:45:22.558 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:45:22.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:45:22.559 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:45:22.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:45:22.562 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:45:22.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:45:22.563 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:45:22.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:45:22.601 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:45:22.602 DEBUG:teuthology.parallel:result is None 2023-10-09T11:45:22.602 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:45:22.603 DEBUG:teuthology.parallel:result is None 2023-10-09T11:45:22.604 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:45:22.605 DEBUG:teuthology.parallel:result is None 2023-10-09T11:45:22.605 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:45:22.605 DEBUG:teuthology.parallel:result is None 2023-10-09T11:45:22.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:45:22.678 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:45:22.679 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:45:22.690 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:45:22.691 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:45:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.735+0000 7f59b001c700 1 Processor -- start 2023-10-09T11:45:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 -- start start 2023-10-09T11:45:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59a8157ca0 0x7f59a80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80d07c0 con 0x7f59a81578d0 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a806daa0 con 0x7f59a8157ca0 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.736+0000 7f59b001c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80cfbb0 con 0x7f59a806d120 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59addb8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59a81578d0 0x7f59a815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41176/0 (socket says 172.21.15.6:41176) 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59a8157ca0 0x7f59a80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59addb8700 1 -- 172.21.15.6:0/105097275 learned_addr learned my addr 172.21.15.6:0/105097275 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ae5b9700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 -- 172.21.15.6:0/105097275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 msgr2=0x7f59a806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 -- 172.21.15.6:0/105097275 >> v1:172.21.15.6:6789/0 conn(0x7f59a81578d0 legacy=0x7f59a815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 -- 172.21.15.6:0/105097275 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80cfe90 con 0x7f59a8157ca0 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59acdb6700 1 -- 172.21.15.6:0/105097275 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312247671 0 0) 0x7f59a80d07c0 con 0x7f59a81578d0 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59ad5b7700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a8157ca0 0x7f59a80cf4f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f59a40098e0 tx=0x7f59a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91477bb192f9805 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59acdb6700 1 -- 172.21.15.6:0/105097275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4009e80 con 0x7f59a8157ca0 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59acdb6700 1 -- 172.21.15.6:0/105097275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400b860 con 0x7f59a8157ca0 2023-10-09T11:45:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.737+0000 7f59acdb6700 1 -- 172.21.15.6:0/105097275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400bbe0 con 0x7f59a8157ca0 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 -- 172.21.15.6:0/105097275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a8157ca0 msgr2=0x7f59a80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a8157ca0 0x7f59a80cf4f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f59a40098e0 tx=0x7f59a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 -- 172.21.15.6:0/105097275 shutdown_connections 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 --2- 172.21.15.6:0/105097275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a8157ca0 0x7f59a80cf4f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 -- 172.21.15.6:0/105097275 >> 172.21.15.6:0/105097275 conn(0x7f59a806bb90 msgr2=0x7f59a806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 -- 172.21.15.6:0/105097275 shutdown_connections 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.738+0000 7f59b001c700 1 -- 172.21.15.6:0/105097275 wait complete. 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.739+0000 7f59b001c700 1 Processor -- start 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.739+0000 7f59b001c700 1 -- start start 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 0x7f59a81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a816b930 con 0x7f59a81578d0 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80b6710 con 0x7f59a8157ca0 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80b4390 con 0x7f59a806d120 2023-10-09T11:45:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34126/0 (socket says 172.21.15.6:34126) 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 -- 172.21.15.6:0/3923419065 learned_addr learned my addr 172.21.15.6:0/3923419065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59addb8700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ae5b9700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 0x7f59a81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 -- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 msgr2=0x7f59a80b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a80b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 -- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 msgr2=0x7f59a81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 0x7f59a81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 -- 172.21.15.6:0/3923419065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a4009420 con 0x7f59a81578d0 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ae5b9700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 0x7f59a81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59addb8700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59ad5b7700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f59a806fe20 tx=0x7f59a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400bbe0 con 0x7f59a81578d0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4011420 con 0x7f59a81578d0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a816b650 con 0x7f59a81578d0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.740+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40117c0 con 0x7f59a81578d0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.741+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a80b4020 con 0x7f59a81578d0 2023-10-09T11:45:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.742+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a815d420 con 0x7f59a81578d0 2023-10-09T11:45:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.742+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59a4011bb0 con 0x7f59a81578d0 2023-10-09T11:45:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.743+0000 7f599dffb700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 0x7f598c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.743+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59a4085b60 con 0x7f59a81578d0 2023-10-09T11:45:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.743+0000 7f59addb8700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 0x7f598c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.743+0000 7f59addb8700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 0x7f598c069410 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5998001840 tx=0x7f5998009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.747+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59a40530d0 con 0x7f59a81578d0 2023-10-09T11:45:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:22.954+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f59a80b3ba0 con 0x7f59a81578d0 2023-10-09T11:45:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.715+0000 7f599dffb700 1 -- 172.21.15.6:0/3923419065 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v158) v1 ==== 97+0+0 (secure 0 0 0) 0x7f59a80b3ba0 con 0x7f59a81578d0 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 msgr2=0x7f598c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 0x7f598c069410 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5998001840 tx=0x7f5998009040 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 msgr2=0x7f59a8153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f59a806fe20 tx=0x7f59a4017000 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 shutdown_connections 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f598c066f60 0x7f598c069410 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59a8157ca0 0x7f59a81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59a806d120 0x7f59a80b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 --2- 172.21.15.6:0/3923419065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a81578d0 0x7f59a8153630 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 >> 172.21.15.6:0/3923419065 conn(0x7f59a806bb90 msgr2=0x7f59a8070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 shutdown_connections 2023-10-09T11:45:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.718+0000 7f59b001c700 1 -- 172.21.15.6:0/3923419065 wait complete. 2023-10-09T11:45:23.720 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:45:23.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:45:23.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.857+0000 7f736c7e1700 1 Processor -- start 2023-10-09T11:45:23.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.857+0000 7f736c7e1700 1 -- start start 2023-10-09T11:45:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736c7e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f736406d830 0x7f73640cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736c7e1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73640d07c0 con 0x7f7364157ca0 2023-10-09T11:45:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736c7e1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73640cfbb0 con 0x7f73641578d0 2023-10-09T11:45:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736c7e1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640cfe90 con 0x7f736406d830 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f7369d7c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7364157ca0 0x7f736406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44870/0 (socket says 172.21.15.6:44870) 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f7369d7c700 1 -- 172.21.15.6:0/2235200834 learned_addr learned my addr 172.21.15.6:0/2235200834 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> v2:172.21.15.118:3300/0 conn(0x7f736406d830 0x7f73640cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.858+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749523833 0 0) 0x7f73640d07c0 con 0x7f7364157ca0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f734c003570 con 0x7f7364157ca0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828768988 0 0) 0x7f73640cfbb0 con 0x7f73641578d0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73640d07c0 con 0x7f73641578d0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497148925 0 0) 0x7f734c003570 con 0x7f7364157ca0 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 >> v2:172.21.15.118:3300/0 conn(0x7f736406d830 msgr2=0x7f73640cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 --2- 172.21.15.6:0/2235200834 >> v2:172.21.15.118:3300/0 conn(0x7f736406d830 0x7f73640cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 >> v1:172.21.15.118:6789/0 conn(0x7f73641578d0 legacy=0x7f736415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640d0170 con 0x7f7364157ca0 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f73580013f0 con 0x7f7364157ca0 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> v2:172.21.15.118:3300/0 conn(0x7f736406d830 0x7f73640cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 >> v1:172.21.15.6:6789/0 conn(0x7f7364157ca0 legacy=0x7f736406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c003c40 0x7f734c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c004810 0x7f734c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f734c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640cfe90 con 0x7f734c005210 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c00c130 con 0x7f734c004810 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c00c2c0 con 0x7f734c003c40 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f734c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f7369d7c700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c004810 0x7f734c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736a57d700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c003c40 0x7f734c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 -- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c003c40 msgr2=0x7f734c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f734c003c40 0x7f734c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 -- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c004810 msgr2=0x7f734c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734c004810 0x7f734c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 -- 172.21.15.6:0/2235200834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c003570 con 0x7f734c005210 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.859+0000 7f736ad7e700 1 -- 172.21.15.6:0/2235200834 reap_dead start 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736ad7e700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f734c00ba60 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f735400e3f0 tx=0x7f735400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be63dd4ea3203652 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354009c50 con 0x7f734c005210 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400f040 con 0x7f734c005210 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736957b700 1 -- 172.21.15.6:0/2235200834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354014480 con 0x7f734c005210 2023-10-09T11:45:23.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 -- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 msgr2=0x7f734c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f734c00ba60 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f735400e3f0 tx=0x7f735400b040 comp rx=0 tx=0).stop 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 -- 172.21.15.6:0/2235200834 shutdown_connections 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 --2- 172.21.15.6:0/2235200834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f734c00ba60 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 -- 172.21.15.6:0/2235200834 >> 172.21.15.6:0/2235200834 conn(0x7f736406bb90 msgr2=0x7f736406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 -- 172.21.15.6:0/2235200834 shutdown_connections 2023-10-09T11:45:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.860+0000 7f736c7e1700 1 -- 172.21.15.6:0/2235200834 wait complete. 2023-10-09T11:45:23.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.861+0000 7f736c7e1700 1 Processor -- start 2023-10-09T11:45:23.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.861+0000 7f736c7e1700 1 -- start start 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f736415ee50 0x7f736415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73640b5550 0x7f73640b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640b5f30 con 0x7f734c005210 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364153d90 con 0x7f73640b5550 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736c7e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364152bd0 con 0x7f736415ee50 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736a57d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736a57d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58546/0 (socket says 172.21.15.6:58546) 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736a57d700 1 -- 172.21.15.6:0/1140565143 learned_addr learned my addr 172.21.15.6:0/1140565143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f7369d7c700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f736415ee50 0x7f736415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736a57d700 1 -- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f736415ee50 msgr2=0x7f736415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.862+0000 7f736a57d700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f736415ee50 0x7f736415f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736a57d700 1 -- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73640b5550 msgr2=0x7f73640b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736ad7e700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73640b5550 0x7f73640b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736a57d700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73640b5550 0x7f73640b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736a57d700 1 -- 172.21.15.6:0/1140565143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364153180 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736a57d700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f735c002bb0 tx=0x7f735c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00fa50 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c00fbb0 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c006820 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7364153460 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.863+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364153a20 con 0x7f734c005210 2023-10-09T11:45:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.864+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7364067ac0 con 0x7f734c005210 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.864+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f735c0133f0 con 0x7f734c005210 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.865+0000 7f73627fc700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.865+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f735c084490 con 0x7f734c005210 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.865+0000 7f7369d7c700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.865+0000 7f7369d7c700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 0x7f73500693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7358001db0 tx=0x7f7358009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:23.869+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f735c051a50 con 0x7f734c005210 2023-10-09T11:45:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.136+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f73640d0450 con 0x7f734c005210 2023-10-09T11:45:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.137+0000 7f73627fc700 1 -- 172.21.15.6:0/1140565143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f735c055070 con 0x7f734c005210 2023-10-09T11:45:24.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:24.137 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:45:24.137 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:45:24.139 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:45:24.143 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.144 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:45:24.146 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:45:24.147 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.149 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:45:24.150 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:45:24.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:24.152 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:45:24.153 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 msgr2=0x7f73500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 0x7f73500693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7358001db0 tx=0x7f7358009040 comp rx=0 tx=0).stop 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 msgr2=0x7f7364145910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f735c002bb0 tx=0x7f735c007d30 comp rx=0 tx=0).stop 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 shutdown_connections 2023-10-09T11:45:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73640b5550 0x7f73640b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f734c005210 0x7f7364145910 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 --2- 172.21.15.6:0/1140565143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f736415ee50 0x7f736415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 >> 172.21.15.6:0/1140565143 conn(0x7f736406bb90 msgr2=0x7f7364155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 shutdown_connections 2023-10-09T11:45:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.139+0000 7f736c7e1700 1 -- 172.21.15.6:0/1140565143 wait complete. 2023-10-09T11:45:24.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.274+0000 7ff83a222700 1 Processor -- start 2023-10-09T11:45:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.274+0000 7ff83a222700 1 -- start start 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff83a222700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff834159f10 0x7ff834068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff83a222700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff83a222700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340cee10 con 0x7ff834159b40 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff83a222700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff834069140 con 0x7ff834159f10 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff83a222700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340cd040 con 0x7ff834068cc0 2023-10-09T11:45:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff839a21700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff838a1f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff834159f10 0x7ff834068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff839a21700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:52790/0 (socket says 172.21.15.6:52790) 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff839a21700 1 -- 172.21.15.6:0/1403707053 learned_addr learned my addr 172.21.15.6:0/1403707053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.275+0000 7ff839220700 1 --1- 172.21.15.6:0/1403707053 >> v1:172.21.15.118:6789/0 conn(0x7ff834159b40 0x7ff8340cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:48668/0 (socket says 172.21.15.6:48668) 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff839a21700 1 -- 172.21.15.6:0/1403707053 >> v2:172.21.15.118:3300/0 conn(0x7ff834159f10 msgr2=0x7ff834068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff839a21700 1 --2- 172.21.15.6:0/1403707053 >> v2:172.21.15.118:3300/0 conn(0x7ff834159f10 0x7ff834068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff839a21700 1 -- 172.21.15.6:0/1403707053 >> v1:172.21.15.118:6789/0 conn(0x7ff834159b40 legacy=0x7ff8340cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff839a21700 1 -- 172.21.15.6:0/1403707053 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340cd320 con 0x7ff834068cc0 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff839a21700 1 --2- 172.21.15.6:0/1403707053 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0099b0 tx=0x7ff82c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f651f0e325c3c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff833fff700 1 -- 172.21.15.6:0/1403707053 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c009ea0 con 0x7ff834068cc0 2023-10-09T11:45:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff833fff700 1 -- 172.21.15.6:0/1403707053 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00b860 con 0x7ff834068cc0 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.276+0000 7ff833fff700 1 -- 172.21.15.6:0/1403707053 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00bc00 con 0x7ff834068cc0 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 -- 172.21.15.6:0/1403707053 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 msgr2=0x7ff8340cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 --2- 172.21.15.6:0/1403707053 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0099b0 tx=0x7ff82c009250 comp rx=0 tx=0).stop 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 -- 172.21.15.6:0/1403707053 shutdown_connections 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 --2- 172.21.15.6:0/1403707053 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834068cc0 0x7ff8340cf2a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 --2- 172.21.15.6:0/1403707053 >> v2:172.21.15.118:3300/0 conn(0x7ff834159f10 0x7ff834068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 -- 172.21.15.6:0/1403707053 >> 172.21.15.6:0/1403707053 conn(0x7ff8340cd660 msgr2=0x7ff8340cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 -- 172.21.15.6:0/1403707053 shutdown_connections 2023-10-09T11:45:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.277+0000 7ff83a222700 1 -- 172.21.15.6:0/1403707053 wait complete. 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.278+0000 7ff83a222700 1 Processor -- start 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.278+0000 7ff83a222700 1 -- start start 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff834068cc0 0x7ff8340c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 0x7ff8340cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c8360 con 0x7ff834159b40 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c8640 con 0x7ff834068cc0 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff83a222700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c8920 con 0x7ff834159f10 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58548/0 (socket says 172.21.15.6:58548) 2023-10-09T11:45:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 -- 172.21.15.6:0/3303463226 learned_addr learned my addr 172.21.15.6:0/3303463226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff839220700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff834068cc0 0x7ff8340c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff839a21700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 0x7ff8340cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 -- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 msgr2=0x7ff8340cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 0x7ff8340cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 -- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff834068cc0 msgr2=0x7ff8340c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff834068cc0 0x7ff8340c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 -- 172.21.15.6:0/3303463226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094f0 con 0x7ff834159b40 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff839a21700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 0x7ff8340cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff838a1f700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e930 tx=0x7ff8280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.279+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828013680 con 0x7ff834159b40 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.280+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280137e0 con 0x7ff834159b40 2023-10-09T11:45:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.280+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828013b80 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.280+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83415a3c0 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.280+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83416b370 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.281+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff834063e90 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.281+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff82800c3e0 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.281+0000 7ff8317fa700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.281+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff828084290 con 0x7ff834159b40 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.281+0000 7ff839220700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.282+0000 7ff839220700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 0x7ff8200693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff8240020c0 tx=0x7ff824001ad0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.286+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff828051850 con 0x7ff834159b40 2023-10-09T11:45:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.480+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8340ce7c0 con 0x7ff834159b40 2023-10-09T11:45:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.481+0000 7ff8317fa700 1 -- 172.21.15.6:0/3303463226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+12097 (secure 0 0 0) 0x7ff828054e70 con 0x7ff834159b40 2023-10-09T11:45:24.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:24.482 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":158,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:45:23.712904+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 msgr2=0x7ff8200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 0x7ff8200693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff8240020c0 tx=0x7ff824001ad0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 msgr2=0x7ff83416ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff82800e930 tx=0x7ff8280091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 shutdown_connections 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff834159f10 0x7ff8340cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff834068cc0 0x7ff8340c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 --2- 172.21.15.6:0/3303463226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff834159b40 0x7ff83416ae30 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 >> 172.21.15.6:0/3303463226 conn(0x7ff8340cd660 msgr2=0x7ff83406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 shutdown_connections 2023-10-09T11:45:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.483+0000 7ff83a222700 1 -- 172.21.15.6:0/3303463226 wait complete. 2023-10-09T11:45:24.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:45:24.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:45:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.617+0000 7f47648a5700 1 Processor -- start 2023-10-09T11:45:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.617+0000 7f47648a5700 1 -- start start 2023-10-09T11:45:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.618+0000 7f47648a5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 0x7f47600cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.618+0000 7f47648a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f476006d120 0x7f476006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.618+0000 7f47648a5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47600d07c0 con 0x7f47601578d0 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.618+0000 7f47648a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476006da50 con 0x7f476006d120 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.618+0000 7f47648a5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47600cfbb0 con 0x7f4760157ca0 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f476006d120 0x7f476006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f476006d120 0x7f476006d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58550/0 (socket says 172.21.15.6:58550) 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 -- 172.21.15.6:0/94490535 learned_addr learned my addr 172.21.15.6:0/94490535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475dd9b700 1 --2- 172.21.15.6:0/94490535 >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 0x7f47600cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 -- 172.21.15.6:0/94490535 >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 msgr2=0x7f47600cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 --2- 172.21.15.6:0/94490535 >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 0x7f47600cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 -- 172.21.15.6:0/94490535 >> v1:172.21.15.118:6789/0 conn(0x7f47601578d0 legacy=0x7f476015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 -- 172.21.15.6:0/94490535 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600cfe90 con 0x7f476006d120 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475dd9b700 1 --2- 172.21.15.6:0/94490535 >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 0x7f47600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475ed9d700 1 --2- 172.21.15.6:0/94490535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f476006d120 0x7f476006d510 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4760068510 tx=0x7f4758009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9260b11d4a97acb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475d59a700 1 -- 172.21.15.6:0/94490535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800e070 con 0x7f476006d120 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475d59a700 1 -- 172.21.15.6:0/94490535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800ba10 con 0x7f476006d120 2023-10-09T11:45:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.619+0000 7f475d59a700 1 -- 172.21.15.6:0/94490535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580092e0 con 0x7f476006d120 2023-10-09T11:45:24.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 -- 172.21.15.6:0/94490535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f476006d120 msgr2=0x7f476006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 --2- 172.21.15.6:0/94490535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f476006d120 0x7f476006d510 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4760068510 tx=0x7f4758009840 comp rx=0 tx=0).stop 2023-10-09T11:45:24.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 -- 172.21.15.6:0/94490535 shutdown_connections 2023-10-09T11:45:24.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 --2- 172.21.15.6:0/94490535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f476006d120 0x7f476006d510 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 --2- 172.21.15.6:0/94490535 >> v2:172.21.15.118:3300/0 conn(0x7f4760157ca0 0x7f47600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 -- 172.21.15.6:0/94490535 >> 172.21.15.6:0/94490535 conn(0x7f476006bb90 msgr2=0x7f476006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 -- 172.21.15.6:0/94490535 shutdown_connections 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.620+0000 7f47648a5700 1 -- 172.21.15.6:0/94490535 wait complete. 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.621+0000 7f47648a5700 1 Processor -- start 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.621+0000 7f47648a5700 1 -- start start 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f476006d120 0x7f47601489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47601578d0 0x7f47600ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600abe10 con 0x7f4760157ca0 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476016ac10 con 0x7f47601578d0 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f47648a5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476016a080 con 0x7f476006d120 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58552/0 (socket says 172.21.15.6:58552) 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 -- 172.21.15.6:0/3408062667 learned_addr learned my addr 172.21.15.6:0/3408062667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475dd9b700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47601578d0 0x7f47600ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475e59c700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f476006d120 0x7f47601489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 -- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f476006d120 msgr2=0x7f47601489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f476006d120 0x7f47601489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 -- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47601578d0 msgr2=0x7f47600ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47601578d0 0x7f47600ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 -- 172.21.15.6:0/3408062667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009ae0 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.622+0000 7f475ed9d700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f476006fe20 tx=0x7f4758017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.623+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580032f0 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.623+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758013d50 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.623+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4760159910 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.623+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475801c640 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.623+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476016a5c0 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.624+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4760067ac0 con 0x7f4760157ca0 2023-10-09T11:45:24.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.624+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4758019070 con 0x7f4760157ca0 2023-10-09T11:45:24.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.624+0000 7f47567fc700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 0x7f47400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.625+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4758085600 con 0x7f4760157ca0 2023-10-09T11:45:24.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.625+0000 7f475e59c700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 0x7f47400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.625+0000 7f475e59c700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 0x7f47400693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4750003a30 tx=0x7f4750007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.629+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4758052bc0 con 0x7f4760157ca0 2023-10-09T11:45:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.823+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47600d0170 con 0x7f4760157ca0 2023-10-09T11:45:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.823+0000 7f47567fc700 1 -- 172.21.15.6:0/3408062667 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4758020020 con 0x7f4760157ca0 2023-10-09T11:45:24.824 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 msgr2=0x7f47400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 0x7f47400693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4750003a30 tx=0x7f4750007ea0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 msgr2=0x7f47600ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f476006fe20 tx=0x7f4758017000 comp rx=0 tx=0).stop 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 shutdown_connections 2023-10-09T11:45:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4740066f30 0x7f47400693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4760157ca0 0x7f47600ab7b0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.825+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f476006d120 0x7f47601489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.826+0000 7f47648a5700 1 --2- 172.21.15.6:0/3408062667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47601578d0 0x7f47600ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.826+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 >> 172.21.15.6:0/3408062667 conn(0x7f476006bb90 msgr2=0x7f47601569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.826+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 shutdown_connections 2023-10-09T11:45:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.826+0000 7f47648a5700 1 -- 172.21.15.6:0/3408062667 wait complete. 2023-10-09T11:45:24.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:45:24.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.956+0000 7fca4059f700 1 Processor -- start 2023-10-09T11:45:24.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.956+0000 7fca4059f700 1 -- start start 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca4059f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca4059f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca3806d120 0x7fca3806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca4059f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3806dac0 con 0x7fca381578d0 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca4059f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380d07c0 con 0x7fca3806d120 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca4059f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380cfbb0 con 0x7fca38157ca0 2023-10-09T11:45:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca3db3a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.957+0000 7fca3eb3c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca3806d120 0x7fca3806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:52812/0 (socket says 172.21.15.6:52812) 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 -- 172.21.15.6:0/702265513 learned_addr learned my addr 172.21.15.6:0/702265513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3e33b700 1 --1- 172.21.15.6:0/702265513 >> v1:172.21.15.118:6789/0 conn(0x7fca381578d0 0x7fca3815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:48688/0 (socket says 172.21.15.6:48688) 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 -- 172.21.15.6:0/702265513 >> v2:172.21.15.118:3300/0 conn(0x7fca3806d120 msgr2=0x7fca3806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 --2- 172.21.15.6:0/702265513 >> v2:172.21.15.118:3300/0 conn(0x7fca3806d120 0x7fca3806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 -- 172.21.15.6:0/702265513 >> v1:172.21.15.118:6789/0 conn(0x7fca381578d0 legacy=0x7fca3815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 -- 172.21.15.6:0/702265513 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380cfe90 con 0x7fca38157ca0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3db3a700 1 --2- 172.21.15.6:0/702265513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0099b0 tx=0x7fca2c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc5659f94130f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3d339700 1 -- 172.21.15.6:0/702265513 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c009ea0 con 0x7fca38157ca0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3d339700 1 -- 172.21.15.6:0/702265513 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c00b860 con 0x7fca38157ca0 2023-10-09T11:45:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.958+0000 7fca3d339700 1 -- 172.21.15.6:0/702265513 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00bc00 con 0x7fca38157ca0 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 -- 172.21.15.6:0/702265513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 msgr2=0x7fca380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 --2- 172.21.15.6:0/702265513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0099b0 tx=0x7fca2c009250 comp rx=0 tx=0).stop 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 -- 172.21.15.6:0/702265513 shutdown_connections 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 --2- 172.21.15.6:0/702265513 >> v2:172.21.15.118:3300/0 conn(0x7fca3806d120 0x7fca3806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 --2- 172.21.15.6:0/702265513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca38157ca0 0x7fca380cf4f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 -- 172.21.15.6:0/702265513 >> 172.21.15.6:0/702265513 conn(0x7fca3806bb90 msgr2=0x7fca3806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 -- 172.21.15.6:0/702265513 shutdown_connections 2023-10-09T11:45:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.959+0000 7fca4059f700 1 -- 172.21.15.6:0/702265513 wait complete. 2023-10-09T11:45:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.960+0000 7fca4059f700 1 Processor -- start 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.960+0000 7fca4059f700 1 -- start start 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 0x7fca380b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 0x7fca38153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38153b70 con 0x7fca38157ca0 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c7410 con 0x7fca3806d120 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca4059f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c7c20 con 0x7fca381578d0 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58562/0 (socket says 172.21.15.6:58562) 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 -- 172.21.15.6:0/4215891452 learned_addr learned my addr 172.21.15.6:0/4215891452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3db3a700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 0x7fca38153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3e33b700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 0x7fca380b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 -- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 msgr2=0x7fca38153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 0x7fca38153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 -- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 msgr2=0x7fca380b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 0x7fca380b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 -- 172.21.15.6:0/4215891452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0094f0 con 0x7fca38157ca0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3db3a700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 0x7fca38153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3e33b700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 0x7fca380b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca3eb3c700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fca28009e90 tx=0x7fca2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800cb70 con 0x7fca38157ca0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.961+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800f040 con 0x7fca38157ca0 2023-10-09T11:45:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.962+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380c5fc0 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.962+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28014480 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.962+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca380c7940 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.962+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca380c6150 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.963+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca28014830 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.963+0000 7fca367fc700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 0x7fca24069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.963+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fca28084b60 con 0x7fca38157ca0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.963+0000 7fca3e33b700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 0x7fca24069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.964+0000 7fca3e33b700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 0x7fca24069410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca30001710 tx=0x7fca30007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:24.967+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca28052120 con 0x7fca38157ca0 2023-10-09T11:45:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.166+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fca380d0170 con 0x7fca38157ca0 2023-10-09T11:45:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.167+0000 7fca367fc700 1 -- 172.21.15.6:0/4215891452 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) v1 ==== 84+0+65 (secure 0 0 0) 0x7fca28018060 con 0x7fca38157ca0 2023-10-09T11:45:25.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:25.167 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:45:25.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:45:25.167 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:45:25.168 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:45:25.168 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:45:25.168 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:45:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 msgr2=0x7fca24069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 0x7fca24069410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca30001710 tx=0x7fca30007eb0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 msgr2=0x7fca380b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fca28009e90 tx=0x7fca2800b040 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 shutdown_connections 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fca24066f60 0x7fca24069410 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca38157ca0 0x7fca380b3ba0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca3806d120 0x7fca380b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 --2- 172.21.15.6:0/4215891452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca381578d0 0x7fca38153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 >> 172.21.15.6:0/4215891452 conn(0x7fca3806bb90 msgr2=0x7fca38069150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 shutdown_connections 2023-10-09T11:45:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.169+0000 7fca4059f700 1 -- 172.21.15.6:0/4215891452 wait complete. 2023-10-09T11:45:25.181 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:45:25.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:45:25.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.304+0000 7fce89842700 1 Processor -- start 2023-10-09T11:45:25.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.304+0000 7fce89842700 1 -- start start 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce89842700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce841578d0 0x7fce840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce89842700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840d07c0 con 0x7fce84157ca0 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce89842700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840cfbb0 con 0x7fce8406d120 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce89842700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840cfe90 con 0x7fce841578d0 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce827fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fce84157ca0 0x7fce8415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44880/0 (socket says 172.21.15.6:44880) 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce827fc700 1 -- 172.21.15.6:0/2732886168 learned_addr learned my addr 172.21.15.6:0/2732886168 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce82ffd700 1 --2- 172.21.15.6:0/2732886168 >> v2:172.21.15.118:3300/0 conn(0x7fce841578d0 0x7fce840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.305+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039088684 0 0) 0x7fce840d07c0 con 0x7fce84157ca0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce70003570 con 0x7fce84157ca0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267565301 0 0) 0x7fce840cfbb0 con 0x7fce8406d120 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce840d07c0 con 0x7fce8406d120 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce82ffd700 1 -- 172.21.15.6:0/2732886168 >> v1:172.21.15.118:6789/0 conn(0x7fce8406d120 legacy=0x7fce8406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce82ffd700 1 -- 172.21.15.6:0/2732886168 >> v1:172.21.15.6:6789/0 conn(0x7fce84157ca0 legacy=0x7fce8415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce82ffd700 1 -- 172.21.15.6:0/2732886168 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840d0170 con 0x7fce841578d0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce82ffd700 1 --2- 172.21.15.6:0/2732886168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce841578d0 0x7fce840cf4f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fce740098e0 tx=0x7fce740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dcd1512af1247b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011630 con 0x7fce841578d0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74011790 con 0x7fce841578d0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.306+0000 7fce81ffb700 1 -- 172.21.15.6:0/2732886168 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74011b30 con 0x7fce841578d0 2023-10-09T11:45:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 -- 172.21.15.6:0/2732886168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce841578d0 msgr2=0x7fce840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 --2- 172.21.15.6:0/2732886168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce841578d0 0x7fce840cf4f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fce740098e0 tx=0x7fce740091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 -- 172.21.15.6:0/2732886168 shutdown_connections 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 --2- 172.21.15.6:0/2732886168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce841578d0 0x7fce840cf4f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 -- 172.21.15.6:0/2732886168 >> 172.21.15.6:0/2732886168 conn(0x7fce8406bb90 msgr2=0x7fce8406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 -- 172.21.15.6:0/2732886168 shutdown_connections 2023-10-09T11:45:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.307+0000 7fce89842700 1 -- 172.21.15.6:0/2732886168 wait complete. 2023-10-09T11:45:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.308+0000 7fce89842700 1 Processor -- start 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.308+0000 7fce89842700 1 -- start start 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce8406d120 0x7fce84154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce84157ca0 0x7fce84068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841554b0 con 0x7fce841578d0 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840c6fd0 con 0x7fce84157ca0 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce89842700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840c7870 con 0x7fce8406d120 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58576/0 (socket says 172.21.15.6:58576) 2023-10-09T11:45:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 -- 172.21.15.6:0/487851903 learned_addr learned my addr 172.21.15.6:0/487851903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce82ffd700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce8406d120 0x7fce84154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce837fe700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce84157ca0 0x7fce84068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 -- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce8406d120 msgr2=0x7fce84154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce8406d120 0x7fce84154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 -- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce84157ca0 msgr2=0x7fce84068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce84157ca0 0x7fce84068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 -- 172.21.15.6:0/487851903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009420 con 0x7fce841578d0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce827fc700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c5b0 tx=0x7fce6c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.309+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c005b30 con 0x7fce841578d0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.310+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c005c90 con 0x7fce841578d0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.310+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c007320 con 0x7fce841578d0 2023-10-09T11:45:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.310+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840ca2b0 con 0x7fce841578d0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.310+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce840c7500 con 0x7fce841578d0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.311+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce84067ac0 con 0x7fce841578d0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.311+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce6c01b3b0 con 0x7fce841578d0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.311+0000 7fce7affd700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 0x7fce640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.311+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fce6c0835d0 con 0x7fce841578d0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.312+0000 7fce82ffd700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 0x7fce640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.312+0000 7fce82ffd700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 0x7fce640693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fce740093f0 tx=0x7fce74017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.316+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce6c050b90 con 0x7fce841578d0 2023-10-09T11:45:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.507+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce840c79b0 con 0x7fce841578d0 2023-10-09T11:45:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.724+0000 7fce7affd700 1 -- 172.21.15.6:0/487851903 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v159) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce6c0170b0 con 0x7fce841578d0 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 msgr2=0x7fce640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 0x7fce640693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fce740093f0 tx=0x7fce74017000 comp rx=0 tx=0).stop 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 msgr2=0x7fce840cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c5b0 tx=0x7fce6c007e40 comp rx=0 tx=0).stop 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 shutdown_connections 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fce64066f30 0x7fce640693e0 secure :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fce740093f0 tx=0x7fce74017000 comp rx=0 tx=0).stop 2023-10-09T11:45:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce84157ca0 0x7fce84068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce8406d120 0x7fce84154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 --2- 172.21.15.6:0/487851903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce841578d0 0x7fce840cb970 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 >> 172.21.15.6:0/487851903 conn(0x7fce8406bb90 msgr2=0x7fce8415ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 shutdown_connections 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.728+0000 7fce89842700 1 -- 172.21.15.6:0/487851903 wait complete. 2023-10-09T11:45:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:45:25.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:45:25.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.866+0000 7f854cede700 1 Processor -- start 2023-10-09T11:45:25.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.867+0000 7f854cede700 1 -- start start 2023-10-09T11:45:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.867+0000 7f854cede700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85481577c0 0x7f8548068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.867+0000 7f854cede700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8548157b90 0x7f8548068d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.867+0000 7f854cede700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85480cca80 con 0x7f85480cb790 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854cede700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85480cc2e0 con 0x7f85481577c0 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854cede700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85480cedd0 con 0x7f8548157b90 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85481577c0 0x7f8548068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f8546d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85480cb790 0x7f85480cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44886/0 (socket says 172.21.15.6:44886) 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85481577c0 0x7f8548068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58590/0 (socket says 172.21.15.6:58590) 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f8546d9d700 1 -- 172.21.15.6:0/2309410077 learned_addr learned my addr 172.21.15.6:0/2309410077 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f8545d9b700 1 --2- 172.21.15.6:0/2309410077 >> v2:172.21.15.118:3300/0 conn(0x7f8548157b90 0x7f8548068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 -- 172.21.15.6:0/2309410077 >> v2:172.21.15.118:3300/0 conn(0x7f8548157b90 msgr2=0x7f8548068d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:25.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 --2- 172.21.15.6:0/2309410077 >> v2:172.21.15.118:3300/0 conn(0x7f8548157b90 0x7f8548068d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 -- 172.21.15.6:0/2309410077 >> v1:172.21.15.6:6789/0 conn(0x7f85480cb790 legacy=0x7f85480cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 -- 172.21.15.6:0/2309410077 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480cc4c0 con 0x7f85481577c0 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854559a700 1 -- 172.21.15.6:0/2309410077 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263862732 0 0) 0x7f85480cca80 con 0x7f85480cb790 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854659c700 1 --2- 172.21.15.6:0/2309410077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85481577c0 0x7f8548068810 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f85480682c0 tx=0x7f85380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2e578ad2343c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854559a700 1 -- 172.21.15.6:0/2309410077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538011630 con 0x7f85481577c0 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854559a700 1 -- 172.21.15.6:0/2309410077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8538011790 con 0x7f85481577c0 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.868+0000 7f854559a700 1 -- 172.21.15.6:0/2309410077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538011b30 con 0x7f85481577c0 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 -- 172.21.15.6:0/2309410077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85481577c0 msgr2=0x7f8548068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 --2- 172.21.15.6:0/2309410077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85481577c0 0x7f8548068810 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f85480682c0 tx=0x7f85380091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 -- 172.21.15.6:0/2309410077 shutdown_connections 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 --2- 172.21.15.6:0/2309410077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85481577c0 0x7f8548068810 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 --2- 172.21.15.6:0/2309410077 >> v2:172.21.15.118:3300/0 conn(0x7f8548157b90 0x7f8548068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 -- 172.21.15.6:0/2309410077 >> 172.21.15.6:0/2309410077 conn(0x7f85480d0df0 msgr2=0x7f85480d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 -- 172.21.15.6:0/2309410077 shutdown_connections 2023-10-09T11:45:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.869+0000 7f854cede700 1 -- 172.21.15.6:0/2309410077 wait complete. 2023-10-09T11:45:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.870+0000 7f854cede700 1 Processor -- start 2023-10-09T11:45:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.870+0000 7f854cede700 1 -- start start 2023-10-09T11:45:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85480cb790 0x7f8548154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85481577c0 0x7f854806da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548158670 con 0x7f8548157b90 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85480c8960 con 0x7f85481577c0 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854cede700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854806e690 con 0x7f85480cb790 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58602/0 (socket says 172.21.15.6:58602) 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 -- 172.21.15.6:0/1671621816 learned_addr learned my addr 172.21.15.6:0/1671621816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8545d9b700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85481577c0 0x7f854806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f854659c700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85480cb790 0x7f8548154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 -- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85480cb790 msgr2=0x7f8548154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85480cb790 0x7f8548154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 -- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85481577c0 msgr2=0x7f854806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85481577c0 0x7f854806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.871+0000 7f8546d9d700 1 -- 172.21.15.6:0/1671621816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009420 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f8546d9d700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f854000cc90 tx=0x7f8540001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854000cea0 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000ab30 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854806e970 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85400070f0 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.872+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8548158300 con 0x7f8548157b90 2023-10-09T11:45:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.873+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85481587e0 con 0x7f8548157b90 2023-10-09T11:45:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.873+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85400074a0 con 0x7f8548157b90 2023-10-09T11:45:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.874+0000 7f853e7fc700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 0x7f85280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.874+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8540084780 con 0x7f8548157b90 2023-10-09T11:45:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.874+0000 7f854659c700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 0x7f85280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.874+0000 7f854659c700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 0x7f85280693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f85380093f0 tx=0x7f8538017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:25.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:25.878+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8540051c50 con 0x7f8548157b90 2023-10-09T11:45:26.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.072+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f85480cc7a0 con 0x7f8548157b90 2023-10-09T11:45:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.730+0000 7f853e7fc700 1 -- 172.21.15.6:0/1671621816 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v160) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8540055270 con 0x7f8548157b90 2023-10-09T11:45:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.738+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 msgr2=0x7f85280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.738+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 0x7f85280693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f85380093f0 tx=0x7f8538017000 comp rx=0 tx=0).stop 2023-10-09T11:45:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.738+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 msgr2=0x7f854806df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.738+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f854000cc90 tx=0x7f8540001a20 comp rx=0 tx=0).stop 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 shutdown_connections 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8528066f30 0x7f85280693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8548157b90 0x7f854806df90 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85480cb790 0x7f8548154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 --2- 172.21.15.6:0/1671621816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85481577c0 0x7f854806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.739+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 >> 172.21.15.6:0/1671621816 conn(0x7f85480d0df0 msgr2=0x7f854815aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.740+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 shutdown_connections 2023-10-09T11:45:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.740+0000 7f854cede700 1 -- 172.21.15.6:0/1671621816 wait complete. 2023-10-09T11:45:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:45:26.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:45:26.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.877+0000 7f6d3e33b700 1 Processor -- start 2023-10-09T11:45:26.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.877+0000 7f6d3e33b700 1 -- start start 2023-10-09T11:45:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3e33b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d3806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3e33b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3806d9b0 con 0x7f6d380d0b80 2023-10-09T11:45:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3e33b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380cf2d0 con 0x7f6d3806d530 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3e33b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3815a690 con 0x7f6d380d0f50 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3d339700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6d380d0b80 0x7f6d380cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44892/0 (socket says 172.21.15.6:44892) 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3d339700 1 -- 172.21.15.6:0/3248880565 learned_addr learned my addr 172.21.15.6:0/3248880565 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d3cb38700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d3806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966625868 0 0) 0x7f6d3806d9b0 con 0x7f6d380d0b80 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.878+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d20003570 con 0x7f6d380d0b80 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291306120 0 0) 0x7f6d380cf2d0 con 0x7f6d3806d530 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3806d9b0 con 0x7f6d3806d530 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626476860 0 0) 0x7f6d20003570 con 0x7f6d380d0b80 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 msgr2=0x7f6d3806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d3806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 >> v1:172.21.15.118:6789/0 conn(0x7f6d3806d530 legacy=0x7f6d3815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380d0480 con 0x7f6d380d0b80 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f6d30001470 con 0x7f6d380d0b80 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 >> v1:172.21.15.6:6789/0 conn(0x7f6d380d0b80 legacy=0x7f6d380cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d20004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3815a690 con 0x7f6d20003c20 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2000bbf0 con 0x7f6d20004d50 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2000bdb0 con 0x7f6d380d0f50 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d20004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3cb38700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3db3a700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 -- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 msgr2=0x7f6d20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d380d0f50 0x7f6d20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 -- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d20004d50 msgr2=0x7f6d200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d20004d50 0x7f6d200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 -- 172.21.15.6:0/3248880565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20003570 con 0x7f6d20003c20 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d3d339700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d20004010 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f6d30007fd0 tx=0x7f6d380cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9a32f5caa761a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.879+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000cae0 con 0x7f6d20003c20 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000cc60 con 0x7f6d20003c20 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d37fff700 1 -- 172.21.15.6:0/3248880565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30005920 con 0x7f6d20003c20 2023-10-09T11:45:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 -- 172.21.15.6:0/3248880565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 msgr2=0x7f6d20004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/3248880565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d20004010 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f6d30007fd0 tx=0x7f6d380cf460 comp rx=0 tx=0).stop 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3db3a700 1 -- 172.21.15.6:0/3248880565 reap_dead start 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 -- 172.21.15.6:0/3248880565 shutdown_connections 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 -- 172.21.15.6:0/3248880565 >> 172.21.15.6:0/3248880565 conn(0x7f6d38063230 msgr2=0x7f6d38063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 -- 172.21.15.6:0/3248880565 shutdown_connections 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.880+0000 7f6d3e33b700 1 -- 172.21.15.6:0/3248880565 wait complete. 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.881+0000 7f6d3e33b700 1 Processor -- start 2023-10-09T11:45:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.881+0000 7f6d3e33b700 1 -- start start 2023-10-09T11:45:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d38153820 0x7f6d38153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d3816a0c0 0x7f6d3816a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38150b70 con 0x7f6d20003c20 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3814ed50 con 0x7f6d38153820 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3e33b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38150280 con 0x7f6d3816a0c0 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3d339700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3d339700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58614/0 (socket says 172.21.15.6:58614) 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3d339700 1 -- 172.21.15.6:0/96988995 learned_addr learned my addr 172.21.15.6:0/96988995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3cb38700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d38153820 0x7f6d38153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.882+0000 7f6d3db3a700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d3816a0c0 0x7f6d3816a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 -- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d3816a0c0 msgr2=0x7f6d3816a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d3816a0c0 0x7f6d3816a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 -- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d38153820 msgr2=0x7f6d38153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d38153820 0x7f6d38153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 -- 172.21.15.6:0/96988995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38150520 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3d339700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c7a0 tx=0x7f6d30015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30024070 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000cea0 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38150800 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30005d10 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.883+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d381542a0 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.884+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d38150990 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.884+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d30004a40 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.885+0000 7f6d357fa700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.885+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6d30085210 con 0x7f6d20003c20 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.885+0000 7f6d3cb38700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.885+0000 7f6d3cb38700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6d38155630 tx=0x7f6d2c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:26.889+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d300524f0 con 0x7f6d20003c20 2023-10-09T11:45:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.129+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d380676e0 con 0x7f6d20003c20 2023-10-09T11:45:27.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.974+0000 7f6d357fa700 1 -- 172.21.15.6:0/96988995 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6d30055b10 con 0x7f6d20003c20 2023-10-09T11:45:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.977+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 msgr2=0x7f6d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.977+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6d38155630 tx=0x7f6d2c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.977+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 msgr2=0x7f6d3814e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.977+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c7a0 tx=0x7f6d30015000 comp rx=0 tx=0).stop 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 shutdown_connections 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6d3816a0c0 0x7f6d3816a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d20003c20 0x7f6d3814e810 secure :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000c7a0 tx=0x7f6d30015000 comp rx=0 tx=0).stop 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 --2- 172.21.15.6:0/96988995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d38153820 0x7f6d38153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.978+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 >> 172.21.15.6:0/96988995 conn(0x7f6d38063230 msgr2=0x7f6d380b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.979+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 shutdown_connections 2023-10-09T11:45:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:27.979+0000 7f6d3e33b700 1 -- 172.21.15.6:0/96988995 wait complete. 2023-10-09T11:45:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 20 and data pool 21 2023-10-09T11:45:27.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.116+0000 7fe556edd700 1 Processor -- start 2023-10-09T11:45:28.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.116+0000 7fe556edd700 1 -- start start 2023-10-09T11:45:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe556edd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 0x7fe5500cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe556edd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe550068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe556edd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500cee10 con 0x7fe5500ccb40 2023-10-09T11:45:28.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe556edd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5500cd040 con 0x7fe550159b40 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe556edd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500cd320 con 0x7fe550159f10 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe5566dc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe5500ccb40 0x7fe55015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44898/0 (socket says 172.21.15.6:44898) 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe5566dc700 1 -- 172.21.15.6:0/1347780445 learned_addr learned my addr 172.21.15.6:0/1347780445 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe555edb700 1 --2- 172.21.15.6:0/1347780445 >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 0x7fe5500cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe5556da700 1 --2- 172.21.15.6:0/1347780445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe550068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe554ed9700 1 -- 172.21.15.6:0/1347780445 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107135021 0 0) 0x7fe5500cee10 con 0x7fe5500ccb40 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.117+0000 7fe554ed9700 1 -- 172.21.15.6:0/1347780445 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe538003570 con 0x7fe5500ccb40 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe5556da700 1 -- 172.21.15.6:0/1347780445 >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 msgr2=0x7fe5500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe5556da700 1 --2- 172.21.15.6:0/1347780445 >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 0x7fe5500cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe5556da700 1 -- 172.21.15.6:0/1347780445 >> v1:172.21.15.6:6789/0 conn(0x7fe5500ccb40 legacy=0x7fe55015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe5556da700 1 -- 172.21.15.6:0/1347780445 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500ce7c0 con 0x7fe550159f10 2023-10-09T11:45:28.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe555edb700 1 --2- 172.21.15.6:0/1347780445 >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 0x7fe5500cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe5556da700 1 --2- 172.21.15.6:0/1347780445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe550068780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe5440098e0 tx=0x7fe5440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8939e1f5c95e49c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe554ed9700 1 -- 172.21.15.6:0/1347780445 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011630 con 0x7fe550159f10 2023-10-09T11:45:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe554ed9700 1 -- 172.21.15.6:0/1347780445 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544011790 con 0x7fe550159f10 2023-10-09T11:45:28.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe554ed9700 1 -- 172.21.15.6:0/1347780445 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011b30 con 0x7fe550159f10 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe556edd700 1 -- 172.21.15.6:0/1347780445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 msgr2=0x7fe550068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.118+0000 7fe556edd700 1 --2- 172.21.15.6:0/1347780445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe550068780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe5440098e0 tx=0x7fe5440091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 -- 172.21.15.6:0/1347780445 shutdown_connections 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 --2- 172.21.15.6:0/1347780445 >> v2:172.21.15.118:3300/0 conn(0x7fe550159b40 0x7fe5500cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 --2- 172.21.15.6:0/1347780445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe550068780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 -- 172.21.15.6:0/1347780445 >> 172.21.15.6:0/1347780445 conn(0x7fe5500cd660 msgr2=0x7fe5500cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 -- 172.21.15.6:0/1347780445 shutdown_connections 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.119+0000 7fe556edd700 1 -- 172.21.15.6:0/1347780445 wait complete. 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 Processor -- start 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 -- start start 2023-10-09T11:45:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 0x7fe55016a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe5500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550155dd0 con 0x7fe550159b40 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501560b0 con 0x7fe5500ccb40 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.120+0000 7fe556edd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe550156390 con 0x7fe550159f10 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58624/0 (socket says 172.21.15.6:58624) 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 -- 172.21.15.6:0/1844169477 learned_addr learned my addr 172.21.15.6:0/1844169477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5566dc700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe5500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe555edb700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 0x7fe55016a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 -- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 msgr2=0x7fe5500c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe5500c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 -- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 msgr2=0x7fe55016a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 0x7fe55016a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 -- 172.21.15.6:0/1844169477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009420 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe555edb700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 0x7fe55016a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe5556da700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe550068580 tx=0x7fe544017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011b10 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5440253f0 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544009420 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5440257b0 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.121+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe550156950 con 0x7fe550159b40 2023-10-09T11:45:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.122+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5500cb910 con 0x7fe550159b40 2023-10-09T11:45:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.123+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe544025ba0 con 0x7fe550159b40 2023-10-09T11:45:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.123+0000 7fe54dffb700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 0x7fe53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.123+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe544085e70 con 0x7fe550159b40 2023-10-09T11:45:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.123+0000 7fe555edb700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 0x7fe53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.124+0000 7fe555edb700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 0x7fe53c0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe5480093f0 tx=0x7fe548008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.128+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe544089030 con 0x7fe550159b40 2023-10-09T11:45:28.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.322+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5500ceaa0 con 0x7fe550159b40 2023-10-09T11:45:28.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.323+0000 7fe54dffb700 1 -- 172.21.15.6:0/1844169477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fe544053040 con 0x7fe550159b40 2023-10-09T11:45:28.323 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:28.323 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":161,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:45:27.130552+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:28.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 msgr2=0x7fe53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 0x7fe53c0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe5480093f0 tx=0x7fe548008040 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 msgr2=0x7fe55014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe550068580 tx=0x7fe544017000 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 shutdown_connections 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe53c066f30 0x7fe53c0693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe550159f10 0x7fe5500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5500ccb40 0x7fe55016a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 --2- 172.21.15.6:0/1844169477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe550159b40 0x7fe55014e510 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 >> 172.21.15.6:0/1844169477 conn(0x7fe5500cd660 msgr2=0x7fe5500cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:28.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 shutdown_connections 2023-10-09T11:45:28.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.325+0000 7fe556edd700 1 -- 172.21.15.6:0/1844169477 wait complete. 2023-10-09T11:45:28.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:28.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.455+0000 7f719d0df700 1 Processor -- start 2023-10-09T11:45:28.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.455+0000 7f719d0df700 1 -- start start 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719d0df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71981578d0 0x7f71980cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719d0df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980d07c0 con 0x7f719806d120 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719d0df700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980cfbb0 con 0x7f7198157ca0 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719d0df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980cfe90 con 0x7f71981578d0 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f7196d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71981578d0 0x7f71980cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719759e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f719806d120 0x7f719806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44900/0 (socket says 172.21.15.6:44900) 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.456+0000 7f719759e700 1 -- 172.21.15.6:0/562963760 learned_addr learned my addr 172.21.15.6:0/562963760 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:28.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7196d9d700 1 -- 172.21.15.6:0/562963760 >> v1:172.21.15.118:6789/0 conn(0x7f7198157ca0 legacy=0x7f719815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7196d9d700 1 -- 172.21.15.6:0/562963760 >> v1:172.21.15.6:6789/0 conn(0x7f719806d120 legacy=0x7f719806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7195d9b700 1 -- 172.21.15.6:0/562963760 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508233433 0 0) 0x7f71980cfbb0 con 0x7f7198157ca0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7196d9d700 1 -- 172.21.15.6:0/562963760 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980d0170 con 0x7f71981578d0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7196d9d700 1 --2- 172.21.15.6:0/562963760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71981578d0 0x7f71980cf4f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e60 tx=0x7f7188009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51455a56fb47fc1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7195d9b700 1 -- 172.21.15.6:0/562963760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800e070 con 0x7f71981578d0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7195d9b700 1 -- 172.21.15.6:0/562963760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800bb30 con 0x7f71981578d0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f7195d9b700 1 -- 172.21.15.6:0/562963760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188012430 con 0x7f71981578d0 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 -- 172.21.15.6:0/562963760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71981578d0 msgr2=0x7f71980cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 --2- 172.21.15.6:0/562963760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71981578d0 0x7f71980cf4f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e60 tx=0x7f7188009780 comp rx=0 tx=0).stop 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 -- 172.21.15.6:0/562963760 shutdown_connections 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 --2- 172.21.15.6:0/562963760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71981578d0 0x7f71980cf4f0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 -- 172.21.15.6:0/562963760 >> 172.21.15.6:0/562963760 conn(0x7f719806bb90 msgr2=0x7f719806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 -- 172.21.15.6:0/562963760 shutdown_connections 2023-10-09T11:45:28.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.457+0000 7f719d0df700 1 -- 172.21.15.6:0/562963760 wait complete. 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 Processor -- start 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 -- start start 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f719806d120 0x7f71980cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71981578d0 0x7f719816dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980c6790 con 0x7f7198157ca0 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980c5df0 con 0x7f719806d120 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719d0df700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719816e890 con 0x7f71981578d0 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.459+0000 7f719759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58634/0 (socket says 172.21.15.6:58634) 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 -- 172.21.15.6:0/1509410717 learned_addr learned my addr 172.21.15.6:0/1509410717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719659c700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71981578d0 0x7f719816dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f7196d9d700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f719806d120 0x7f71980cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 -- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71981578d0 msgr2=0x7f719816dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71981578d0 0x7f719816dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 -- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f719806d120 msgr2=0x7f71980cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f719806d120 0x7f71980cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 -- 172.21.15.6:0/1509410717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009a20 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719759e700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f719000c7e0 tx=0x7f7190007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190005b30 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190005c90 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71980c6140 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190007320 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.460+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71980cdcd0 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.461+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71980c6940 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.462+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7190007690 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.462+0000 7f718effd700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.462+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71900839d0 con 0x7f7198157ca0 2023-10-09T11:45:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.462+0000 7f7196d9d700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.462+0000 7f7196d9d700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 0x7f71780693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f71880097c0 tx=0x7f7188018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.466+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71980c6940 con 0x7f7198157ca0 2023-10-09T11:45:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.660+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71980c68d0 con 0x7f7198157ca0 2023-10-09T11:45:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.661+0000 7f718effd700 1 -- 172.21.15.6:0/1509410717 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+15330 (secure 0 0 0) 0x7f7190017020 con 0x7f7198157ca0 2023-10-09T11:45:28.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:28.662 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":161,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:45:27.130552+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 msgr2=0x7f71780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 0x7f71780693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f71880097c0 tx=0x7f7188018000 comp rx=0 tx=0).stop 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 msgr2=0x7f719816e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f719000c7e0 tx=0x7f7190007ea0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 shutdown_connections 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7198157ca0 0x7f719816e260 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f719806d120 0x7f71980cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 --2- 172.21.15.6:0/1509410717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f71981578d0 0x7f719816dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 >> 172.21.15.6:0/1509410717 conn(0x7f719806bb90 msgr2=0x7f71981567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 shutdown_connections 2023-10-09T11:45:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.663+0000 7f719d0df700 1 -- 172.21.15.6:0/1509410717 wait complete. 2023-10-09T11:45:28.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:45:28.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.798+0000 7fd18ca64700 1 Processor -- start 2023-10-09T11:45:28.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.798+0000 7fd18ca64700 1 -- start start 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18ca64700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd188157ca0 0x7fd1880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18ca64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd18806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18ca64700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880d07c0 con 0x7fd1881578d0 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18ca64700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18806daa0 con 0x7fd188157ca0 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18ca64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cfbb0 con 0x7fd18806d120 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd1881578d0 0x7fd18815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44904/0 (socket says 172.21.15.6:44904) 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.799+0000 7fd18659c700 1 -- 172.21.15.6:0/954643602 learned_addr learned my addr 172.21.15.6:0/954643602 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd185d9b700 1 --2- 172.21.15.6:0/954643602 >> v2:172.21.15.118:3300/0 conn(0x7fd188157ca0 0x7fd1880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd186d9d700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd18806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471523031 0 0) 0x7fd1880d07c0 con 0x7fd1881578d0 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd174003570 con 0x7fd1881578d0 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201694925 0 0) 0x7fd174003570 con 0x7fd1881578d0 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 msgr2=0x7fd18806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd18806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 >> v2:172.21.15.118:3300/0 conn(0x7fd188157ca0 msgr2=0x7fd1880cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 --2- 172.21.15.6:0/954643602 >> v2:172.21.15.118:3300/0 conn(0x7fd188157ca0 0x7fd1880cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880cfe90 con 0x7fd1881578d0 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fd178001470 con 0x7fd1881578d0 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 >> v1:172.21.15.6:6789/0 conn(0x7fd1881578d0 legacy=0x7fd18815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd174003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd174003fe0 0x7fd174004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174004d50 0x7fd1740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18806daa0 con 0x7fd174003fe0 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cfbb0 con 0x7fd174004d50 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17400ba90 con 0x7fd18806d120 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd185d9b700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd174003fe0 0x7fd174004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd18659c700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd174003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd186d9d700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174004d50 0x7fd1740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd185d9b700 1 -- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 msgr2=0x7fd174003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.800+0000 7fd185d9b700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18806d120 0x7fd174003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd185d9b700 1 -- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174004d50 msgr2=0x7fd1740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:28.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd185d9b700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174004d50 0x7fd1740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd185d9b700 1 -- 172.21.15.6:0/954643602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174003570 con 0x7fd174003fe0 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd185d9b700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd174003fe0 0x7fd174004810 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd1881580c0 tx=0x7fd1700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9a5c428bd55463 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000e6b0 con 0x7fd174003fe0 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000e810 con 0x7fd174003fe0 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18559a700 1 -- 172.21.15.6:0/954643602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000ebd0 con 0x7fd174003fe0 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 -- 172.21.15.6:0/954643602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd174003fe0 msgr2=0x7fd174004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 --2- 172.21.15.6:0/954643602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd174003fe0 0x7fd174004810 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd1881580c0 tx=0x7fd1700091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd186d9d700 1 -- 172.21.15.6:0/954643602 reap_dead start 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 -- 172.21.15.6:0/954643602 shutdown_connections 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 -- 172.21.15.6:0/954643602 >> 172.21.15.6:0/954643602 conn(0x7fd18806bb90 msgr2=0x7fd18806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:28.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 -- 172.21.15.6:0/954643602 shutdown_connections 2023-10-09T11:45:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.801+0000 7fd18ca64700 1 -- 172.21.15.6:0/954643602 wait complete. 2023-10-09T11:45:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.802+0000 7fd18ca64700 1 Processor -- start 2023-10-09T11:45:28.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 -- start start 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174003fe0 0x7fd1880b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18816a8f0 0x7fd1880c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18816def0 con 0x7fd1880b4b70 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880c7c00 con 0x7fd174003fe0 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd18ca64700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b6be0 con 0x7fd18816a8f0 2023-10-09T11:45:28.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd186d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd186d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58662/0 (socket says 172.21.15.6:58662) 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.803+0000 7fd186d9d700 1 -- 172.21.15.6:0/4063388157 learned_addr learned my addr 172.21.15.6:0/4063388157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd18659c700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174003fe0 0x7fd1880b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd185d9b700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18816a8f0 0x7fd1880c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 -- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18816a8f0 msgr2=0x7fd1880c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18816a8f0 0x7fd1880c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 -- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174003fe0 msgr2=0x7fd1880b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174003fe0 0x7fd1880b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 -- 172.21.15.6:0/4063388157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18816add0 con 0x7fd1880b4b70 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd186d9d700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b2ee0 tx=0x7fd18000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18000e070 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180011d00 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18816b0b0 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800166c0 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.804+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18816b670 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.805+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18816e060 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.805+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd180016ab0 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.806+0000 7fd17e7fc700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.806+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd180085030 con 0x7fd1880b4b70 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.806+0000 7fd18659c700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:28.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.806+0000 7fd18659c700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 0x7fd1680693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd18806a8f0 tx=0x7fd178009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:28.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:28.810+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd18816e060 con 0x7fd1880b4b70 2023-10-09T11:45:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.049+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd18816e060 con 0x7fd1880b4b70 2023-10-09T11:45:29.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.986+0000 7fd17e7fc700 1 -- 172.21.15.6:0/4063388157 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd18816e060 con 0x7fd1880b4b70 2023-10-09T11:45:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 msgr2=0x7fd1680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:29.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 0x7fd1680693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd18806a8f0 tx=0x7fd178009040 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 msgr2=0x7fd188069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd1880b2ee0 tx=0x7fd18000b040 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 shutdown_connections 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1880b4b70 0x7fd188069be0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd174003fe0 0x7fd1880b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 --2- 172.21.15.6:0/4063388157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18816a8f0 0x7fd1880c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 >> 172.21.15.6:0/4063388157 conn(0x7fd18806bb90 msgr2=0x7fd188155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:29.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 shutdown_connections 2023-10-09T11:45:29.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:29.989+0000 7fd18ca64700 1 -- 172.21.15.6:0/4063388157 wait complete. 2023-10-09T11:45:30.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:45:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.131+0000 7f886f4de700 1 Processor -- start 2023-10-09T11:45:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.131+0000 7f886f4de700 1 -- start start 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0b80 0x7f88680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 0x7f886806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88680d0f50 0x7f886806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886815a690 con 0x7f88680d0f50 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680cf2d0 con 0x7f88680d02b0 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886f4de700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886806dc00 con 0x7f88680d0b80 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88680d0f50 0x7f886806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88680d0f50 0x7f886806d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58674/0 (socket says 172.21.15.6:58674) 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 -- 172.21.15.6:0/1408503219 learned_addr learned my addr 172.21.15.6:0/1408503219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886dcdb700 1 --2- 172.21.15.6:0/1408503219 >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 0x7f886806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886e4dc700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0b80 0x7f88680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 -- 172.21.15.6:0/1408503219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0b80 msgr2=0x7f88680cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0b80 0x7f88680cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 -- 172.21.15.6:0/1408503219 >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 msgr2=0x7f886806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 --2- 172.21.15.6:0/1408503219 >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 0x7f886806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886ecdd700 1 -- 172.21.15.6:0/1408503219 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680cf570 con 0x7f88680d0f50 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.132+0000 7f886dcdb700 1 --2- 172.21.15.6:0/1408503219 >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 0x7f886806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886ecdd700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0f50 0x7f886806d530 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f886806e810 tx=0x7f8860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a5a2b88c27cb91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886d4da700 1 -- 172.21.15.6:0/1408503219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000b860 con 0x7f88680d0f50 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886d4da700 1 -- 172.21.15.6:0/1408503219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000b9c0 con 0x7f88680d0f50 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886d4da700 1 -- 172.21.15.6:0/1408503219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000bd60 con 0x7f88680d0f50 2023-10-09T11:45:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 -- 172.21.15.6:0/1408503219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0f50 msgr2=0x7f886806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0f50 0x7f886806d530 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f886806e810 tx=0x7f8860009250 comp rx=0 tx=0).stop 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 -- 172.21.15.6:0/1408503219 shutdown_connections 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0f50 0x7f886806d530 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 --2- 172.21.15.6:0/1408503219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0b80 0x7f88680cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 --2- 172.21.15.6:0/1408503219 >> v2:172.21.15.118:3300/0 conn(0x7f88680d02b0 0x7f886806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 -- 172.21.15.6:0/1408503219 >> 172.21.15.6:0/1408503219 conn(0x7f8868063230 msgr2=0x7f8868063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 -- 172.21.15.6:0/1408503219 shutdown_connections 2023-10-09T11:45:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.133+0000 7f886f4de700 1 -- 172.21.15.6:0/1408503219 wait complete. 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.134+0000 7f886f4de700 1 Processor -- start 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.134+0000 7f886f4de700 1 -- start start 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 0x7f886815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0f50 0x7f886816d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680b6400 con 0x7f88680d0b80 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c61d0 con 0x7f88680d02b0 2023-10-09T11:45:30.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886f4de700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c5bc0 con 0x7f88680d0f50 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886dcdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886dcdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58680/0 (socket says 172.21.15.6:58680) 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.135+0000 7f886dcdb700 1 -- 172.21.15.6:0/2042947930 learned_addr learned my addr 172.21.15.6:0/2042947930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886e4dc700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 0x7f886815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886ecdd700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0f50 0x7f886816d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 -- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0f50 msgr2=0x7f886816d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0f50 0x7f886816d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 -- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 msgr2=0x7f886815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 0x7f886815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 -- 172.21.15.6:0/2042947930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88600094f0 con 0x7f88680d0b80 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886e4dc700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 0x7f886815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:30.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886dcdb700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e8d0 tx=0x7f885c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00ee70 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00c5e0 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886816e020 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00c980 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.136+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886816e300 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.137+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88680c6360 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.137+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f885c013410 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.138+0000 7f88667fc700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.138+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f885c084340 con 0x7f88680d0b80 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.138+0000 7f886e4dc700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.138+0000 7f886e4dc700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 0x7f88540693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8858007540 tx=0x7f885800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.142+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f885c0515b0 con 0x7f88680d0b80 2023-10-09T11:45:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.379+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88680676e0 con 0x7f88680d0b80 2023-10-09T11:45:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.991+0000 7f88667fc700 1 -- 172.21.15.6:0/2042947930 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7f885c054bd0 con 0x7f88680d0b80 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 msgr2=0x7f88540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 0x7f88540693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8858007540 tx=0x7f885800b040 comp rx=0 tx=0).stop 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 msgr2=0x7f8868169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e8d0 tx=0x7f885c008040 comp rx=0 tx=0).stop 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 shutdown_connections 2023-10-09T11:45:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8854066f30 0x7f88540693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88680d0f50 0x7f886816d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88680d02b0 0x7f886815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 --2- 172.21.15.6:0/2042947930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88680d0b80 0x7f8868169ed0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 >> 172.21.15.6:0/2042947930 conn(0x7f8868063230 msgr2=0x7f88681575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 shutdown_connections 2023-10-09T11:45:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:30.993+0000 7f886f4de700 1 -- 172.21.15.6:0/2042947930 wait complete. 2023-10-09T11:45:31.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:31.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.129+0000 7fe75dd98700 1 Processor -- start 2023-10-09T11:45:31.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.129+0000 7fe75dd98700 1 -- start start 2023-10-09T11:45:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75dd98700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe758159b40 0x7fe7580cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75dd98700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe758159f10 0x7fe758068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75dd98700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7580cee10 con 0x7fe7580ccb40 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75dd98700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580cd040 con 0x7fe758159b40 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75dd98700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580cd320 con 0x7fe758159f10 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75cd96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe758159b40 0x7fe7580cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75cd96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe758159b40 0x7fe7580cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58686/0 (socket says 172.21.15.6:58686) 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe75cd96700 1 -- 172.21.15.6:0/3749566261 learned_addr learned my addr 172.21.15.6:0/3749566261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.130+0000 7fe757fff700 1 --2- 172.21.15.6:0/3749566261 >> v2:172.21.15.118:3300/0 conn(0x7fe758159f10 0x7fe758068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75cd96700 1 -- 172.21.15.6:0/3749566261 >> v2:172.21.15.118:3300/0 conn(0x7fe758159f10 msgr2=0x7fe758068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75cd96700 1 --2- 172.21.15.6:0/3749566261 >> v2:172.21.15.118:3300/0 conn(0x7fe758159f10 0x7fe758068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75cd96700 1 -- 172.21.15.6:0/3749566261 >> v1:172.21.15.118:6789/0 conn(0x7fe7580ccb40 legacy=0x7fe75815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75cd96700 1 -- 172.21.15.6:0/3749566261 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580ce7c0 con 0x7fe758159b40 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75cd96700 1 --2- 172.21.15.6:0/3749566261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe7580cc600 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe75806fd80 tx=0x7fe750009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b932e80098cc6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe7577fe700 1 -- 172.21.15.6:0/3749566261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750009e70 con 0x7fe758159b40 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe7577fe700 1 -- 172.21.15.6:0/3749566261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75000b860 con 0x7fe758159b40 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe7577fe700 1 -- 172.21.15.6:0/3749566261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75000bc00 con 0x7fe758159b40 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75dd98700 1 -- 172.21.15.6:0/3749566261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 msgr2=0x7fe7580cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3749566261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe7580cc600 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe75806fd80 tx=0x7fe750009250 comp rx=0 tx=0).stop 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75dd98700 1 -- 172.21.15.6:0/3749566261 shutdown_connections 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.131+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3749566261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe7580cc600 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.132+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3749566261 >> v2:172.21.15.118:3300/0 conn(0x7fe758159f10 0x7fe758068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.132+0000 7fe75dd98700 1 -- 172.21.15.6:0/3749566261 >> 172.21.15.6:0/3749566261 conn(0x7fe7580cd660 msgr2=0x7fe7580cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.132+0000 7fe75dd98700 1 -- 172.21.15.6:0/3749566261 shutdown_connections 2023-10-09T11:45:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.132+0000 7fe75dd98700 1 -- 172.21.15.6:0/3749566261 wait complete. 2023-10-09T11:45:31.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.133+0000 7fe75dd98700 1 Processor -- start 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.133+0000 7fe75dd98700 1 -- start start 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7580ccb40 0x7fe75806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe758159f10 0x7fe75815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c8560 con 0x7fe758159b40 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c8800 con 0x7fe7580ccb40 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c8ae0 con 0x7fe758159f10 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58698/0 (socket says 172.21.15.6:58698) 2023-10-09T11:45:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 -- 172.21.15.6:0/3007446103 learned_addr learned my addr 172.21.15.6:0/3007446103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75cd96700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7580ccb40 0x7fe75806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75d597700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe758159f10 0x7fe75815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 -- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe758159f10 msgr2=0x7fe75815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe758159f10 0x7fe75815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 -- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7580ccb40 msgr2=0x7fe75806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7580ccb40 0x7fe75806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 -- 172.21.15.6:0/3007446103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500094f0 con 0x7fe758159b40 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe757fff700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e50 tx=0x7fe74800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800caa0 con 0x7fe758159b40 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74800f040 con 0x7fe758159b40 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7580c8dc0 con 0x7fe758159b40 2023-10-09T11:45:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800ce30 con 0x7fe758159b40 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.134+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7580c8150 con 0x7fe758159b40 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.135+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7580c92e0 con 0x7fe758159b40 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.136+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe748014690 con 0x7fe758159b40 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.136+0000 7fe754ff9700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.136+0000 7fe75cd96700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.136+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe748084de0 con 0x7fe758159b40 2023-10-09T11:45:31.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.137+0000 7fe75cd96700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 0x7fe7380693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe75806fd80 tx=0x7fe750017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.141+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7580c92e0 con 0x7fe758159b40 2023-10-09T11:45:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.380+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7580c92e0 con 0x7fe758159b40 2023-10-09T11:45:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.380+0000 7fe754ff9700 1 -- 172.21.15.6:0/3007446103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fe7580c92e0 con 0x7fe758159b40 2023-10-09T11:45:31.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:31.381 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:45:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.382+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 msgr2=0x7fe7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.382+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 0x7fe7380693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe75806fd80 tx=0x7fe750017000 comp rx=0 tx=0).stop 2023-10-09T11:45:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.382+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 msgr2=0x7fe75815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.382+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe748009e50 tx=0x7fe74800b040 comp rx=0 tx=0).stop 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 shutdown_connections 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe758159f10 0x7fe75815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7580ccb40 0x7fe75806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 --2- 172.21.15.6:0/3007446103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe758159b40 0x7fe75815b4c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 >> 172.21.15.6:0/3007446103 conn(0x7fe7580cd660 msgr2=0x7fe7580c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 shutdown_connections 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.383+0000 7fe75dd98700 1 -- 172.21.15.6:0/3007446103 wait complete. 2023-10-09T11:45:31.384 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:45:31.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:45:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.513+0000 7fe2f19fd700 1 Processor -- start 2023-10-09T11:45:31.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.513+0000 7fe2f19fd700 1 -- start start 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2f19fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2f19fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2f19fd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0c9bd0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2f19fd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec06e330 con 0x7fe2ec157dc0 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2f19fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec06e5d0 con 0x7fe2ec06a2c0 2023-10-09T11:45:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2ea7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2eaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2ec1579f0 0x7fe2ec06a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44906/0 (socket says 172.21.15.6:44906) 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2eaffd700 1 -- 172.21.15.6:0/3670410068 learned_addr learned my addr 172.21.15.6:0/3670410068 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.514+0000 7fe2ea7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58706/0 (socket says 172.21.15.6:58706) 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2eb7fe700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/3670410068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 msgr2=0x7fe2ec0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2ea7fc700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/3670410068 >> v1:172.21.15.6:6789/0 conn(0x7fe2ec1579f0 legacy=0x7fe2ec06a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2e9ffb700 1 -- 172.21.15.6:0/3670410068 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893093077 0 0) 0x7fe2ec0c9bd0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/3670410068 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec06e8b0 con 0x7fe2ec157dc0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2eb7fe700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2ea7fc700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40098d0 tx=0x7fe2d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8788e1de39283abd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2e9ffb700 1 -- 172.21.15.6:0/3670410068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4009e70 con 0x7fe2ec157dc0 2023-10-09T11:45:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2e9ffb700 1 -- 172.21.15.6:0/3670410068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d4005c10 con 0x7fe2ec157dc0 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2e9ffb700 1 -- 172.21.15.6:0/3670410068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400b650 con 0x7fe2ec157dc0 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 -- 172.21.15.6:0/3670410068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec157dc0 msgr2=0x7fe2ec0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40098d0 tx=0x7fe2d4009120 comp rx=0 tx=0).stop 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 -- 172.21.15.6:0/3670410068 shutdown_connections 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/3670410068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec0b07a0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.515+0000 7fe2f19fd700 1 -- 172.21.15.6:0/3670410068 >> 172.21.15.6:0/3670410068 conn(0x7fe2ec06cca0 msgr2=0x7fe2ec06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.516+0000 7fe2f19fd700 1 -- 172.21.15.6:0/3670410068 shutdown_connections 2023-10-09T11:45:31.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.516+0000 7fe2f19fd700 1 -- 172.21.15.6:0/3670410068 wait complete. 2023-10-09T11:45:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 Processor -- start 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 -- start start 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0c65e0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec15a230 con 0x7fe2ec157dc0 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.517+0000 7fe2f19fd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0c5960 con 0x7fe2ec06a2c0 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58722/0 (socket says 172.21.15.6:58722) 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/2140209116 learned_addr learned my addr 172.21.15.6:0/2140209116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2eb7fe700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2eaffd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 msgr2=0x7fe2ec0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 msgr2=0x7fe2ec15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 -- 172.21.15.6:0/2140209116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40093c0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2eaffd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2eb7fe700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2ea7fc700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fd0 tx=0x7fe2d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4006460 con 0x7fe2ec1579f0 2023-10-09T11:45:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d40065e0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec0c5c40 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4026430 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.518+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec0c6200 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.519+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec068750 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.520+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d401a420 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.520+0000 7fe2e2ffd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.520+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2d4085e70 con 0x7fe2ec1579f0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.520+0000 7fe2eaffd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.521+0000 7fe2eaffd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 0x7fe2cc0693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec15d5d0 tx=0x7fe2e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.525+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d40530e0 con 0x7fe2ec1579f0 2023-10-09T11:45:31.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.717+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2ec071b10 con 0x7fe2ec1579f0 2023-10-09T11:45:31.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.718+0000 7fe2e2ffd700 1 -- 172.21.15.6:0/2140209116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+15317 (secure 0 0 0) 0x7fe2d402b090 con 0x7fe2ec1579f0 2023-10-09T11:45:31.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":162,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:45:28.741087+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 msgr2=0x7fe2cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 0x7fe2cc0693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec15d5d0 tx=0x7fe2e4009040 comp rx=0 tx=0).stop 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 msgr2=0x7fe2ec159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fd0 tx=0x7fe2d4016000 comp rx=0 tx=0).stop 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 shutdown_connections 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe2cc066f30 0x7fe2cc0693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2ec157dc0 0x7fe2ec15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2ec06a2c0 0x7fe2ec0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 --2- 172.21.15.6:0/2140209116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2ec1579f0 0x7fe2ec159cf0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 >> 172.21.15.6:0/2140209116 conn(0x7fe2ec06cca0 msgr2=0x7fe2ec153400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:31.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 shutdown_connections 2023-10-09T11:45:31.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.720+0000 7fe2f19fd700 1 -- 172.21.15.6:0/2140209116 wait complete. 2023-10-09T11:45:31.733 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:45:31.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:45:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.851+0000 7f3278ca9700 1 Processor -- start 2023-10-09T11:45:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.851+0000 7f3278ca9700 1 -- start start 2023-10-09T11:45:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f3278ca9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f327406d830 0x7f32740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f3278ca9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32740d07c0 con 0x7f32741578d0 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f3278ca9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32740cfbb0 con 0x7f3274157ca0 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f3278ca9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32740cfe90 con 0x7f327406d830 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f3272d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f327406d830 0x7f32740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.852+0000 7f327259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32741578d0 0x7f327415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44912/0 (socket says 172.21.15.6:44912) 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f327259c700 1 -- 172.21.15.6:0/4052199699 learned_addr learned my addr 172.21.15.6:0/4052199699 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f3272d9d700 1 -- 172.21.15.6:0/4052199699 >> v1:172.21.15.118:6789/0 conn(0x7f3274157ca0 legacy=0x7f327406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f3272d9d700 1 -- 172.21.15.6:0/4052199699 >> v1:172.21.15.6:6789/0 conn(0x7f32741578d0 legacy=0x7f327415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f327159a700 1 -- 172.21.15.6:0/4052199699 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306574030 0 0) 0x7f32740d07c0 con 0x7f32741578d0 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f3272d9d700 1 -- 172.21.15.6:0/4052199699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740d0170 con 0x7f327406d830 2023-10-09T11:45:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f3272d9d700 1 --2- 172.21.15.6:0/4052199699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f32740cf4f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f32640098e0 tx=0x7f32640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89c96bdde6a8da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f327159a700 1 -- 172.21.15.6:0/4052199699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264009e80 con 0x7f327406d830 2023-10-09T11:45:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f327159a700 1 -- 172.21.15.6:0/4052199699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326400b820 con 0x7f327406d830 2023-10-09T11:45:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.853+0000 7f327159a700 1 -- 172.21.15.6:0/4052199699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326400bba0 con 0x7f327406d830 2023-10-09T11:45:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 -- 172.21.15.6:0/4052199699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 msgr2=0x7f32740cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 --2- 172.21.15.6:0/4052199699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f32740cf4f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f32640098e0 tx=0x7f32640091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 -- 172.21.15.6:0/4052199699 shutdown_connections 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 --2- 172.21.15.6:0/4052199699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f32740cf4f0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 -- 172.21.15.6:0/4052199699 >> 172.21.15.6:0/4052199699 conn(0x7f327406bb90 msgr2=0x7f327406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 -- 172.21.15.6:0/4052199699 shutdown_connections 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.854+0000 7f3278ca9700 1 -- 172.21.15.6:0/4052199699 wait complete. 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.855+0000 7f3278ca9700 1 Processor -- start 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.855+0000 7f3278ca9700 1 -- start start 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32741578d0 0x7f32740ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 0x7f32740aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327416b3e0 con 0x7f327406d830 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32740b4ca0 con 0x7f3274157ca0 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32740ace60 con 0x7f32741578d0 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58734/0 (socket says 172.21.15.6:58734) 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 -- 172.21.15.6:0/298694309 learned_addr learned my addr 172.21.15.6:0/298694309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3272d9d700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 0x7f32740aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3271d9b700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32741578d0 0x7f32740ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 -- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32741578d0 msgr2=0x7f32740ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32741578d0 0x7f32740ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 -- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 msgr2=0x7f32740aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 0x7f32740aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 -- 172.21.15.6:0/298694309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264009420 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3272d9d700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 0x7f32740aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f327259c700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f326c00cd80 tx=0x7f326c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00ab10 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00ac70 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32740b4f40 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c0070f0 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.856+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32740ad140 con 0x7f327406d830 2023-10-09T11:45:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.857+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32740b5460 con 0x7f327406d830 2023-10-09T11:45:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.858+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f326c0074e0 con 0x7f327406d830 2023-10-09T11:45:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.858+0000 7f326a7fc700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 0x7f32540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.859+0000 7f3271d9b700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 0x7f32540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.859+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f326c084a60 con 0x7f327406d830 2023-10-09T11:45:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.859+0000 7f3271d9b700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 0x7f32540693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:31.863+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32740b5460 con 0x7f327406d830 2023-10-09T11:45:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.050+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f327415a180 con 0x7f3254066f30 2023-10-09T11:45:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.058+0000 7f326a7fc700 1 -- 172.21.15.6:0/298694309 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285364 (secure 0 0 0) 0x7f327415a180 con 0x7f3254066f30 2023-10-09T11:45:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:32.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 msgr2=0x7f32540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 0x7f32540693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c008040 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 msgr2=0x7f3274154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f326c00cd80 tx=0x7f326c001ae0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 shutdown_connections 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3254066f30 0x7f32540693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3274157ca0 0x7f32740aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327406d830 0x7f3274154d10 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 --2- 172.21.15.6:0/298694309 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32741578d0 0x7f32740ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 >> 172.21.15.6:0/298694309 conn(0x7f327406bb90 msgr2=0x7f3274068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 shutdown_connections 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.061+0000 7f3278ca9700 1 -- 172.21.15.6:0/298694309 wait complete. 2023-10-09T11:45:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:45:32.073 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2023-10-09T11:45:30.272912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554380,"statfs":{"total":1600000000,"available":1591685463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.549174"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754588+0000","last_change":"2023-10-09T11:45:27.754588+0000","last_active":"2023-10-09T11:45:27.754588+0000","last_peered":"2023-10-09T11:45:27.754588+0000","last_clean":"2023-10-09T11:45:27.754588+0000","last_became_active":"2023-10-09T11:45:27.753117+0000","last_became_peered":"2023-10-09T11:45:27.753117+0000","last_unstale":"2023-10-09T11:45:27.754588+0000","last_undegraded":"2023-10-09T11:45:27.754588+0000","last_fullsized":"2023-10-09T11:45:27.754588+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:37.808055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752585+0000","last_change":"2023-10-09T11:45:27.752585+0000","last_active":"2023-10-09T11:45:27.752585+0000","last_peered":"2023-10-09T11:45:27.752585+0000","last_clean":"2023-10-09T11:45:27.752585+0000","last_became_active":"2023-10-09T11:45:27.752338+0000","last_became_peered":"2023-10-09T11:45:27.752338+0000","last_unstale":"2023-10-09T11:45:27.752585+0000","last_undegraded":"2023-10-09T11:45:27.752585+0000","last_fullsized":"2023-10-09T11:45:27.752585+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:57.752390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758559+0000","last_change":"2023-10-09T11:45:27.758559+0000","last_active":"2023-10-09T11:45:27.758559+0000","last_peered":"2023-10-09T11:45:27.758559+0000","last_clean":"2023-10-09T11:45:27.758559+0000","last_became_active":"2023-10-09T11:45:27.752106+0000","last_became_peered":"2023-10-09T11:45:27.752106+0000","last_unstale":"2023-10-09T11:45:27.758559+0000","last_undegraded":"2023-10-09T11:45:27.758559+0000","last_fullsized":"2023-10-09T11:45:27.758559+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:01.688609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.748850+0000","last_change":"2023-10-09T11:45:27.748850+0000","last_active":"2023-10-09T11:45:27.748850+0000","last_peered":"2023-10-09T11:45:27.748850+0000","last_clean":"2023-10-09T11:45:27.748850+0000","last_became_active":"2023-10-09T11:45:27.748143+0000","last_became_peered":"2023-10-09T11:45:27.748143+0000","last_unstale":"2023-10-09T11:45:27.748850+0000","last_undegraded":"2023-10-09T11:45:27.748850+0000","last_fullsized":"2023-10-09T11:45:27.748850+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:06.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755800+0000","last_change":"2023-10-09T11:45:27.755800+0000","last_active":"2023-10-09T11:45:27.755800+0000","last_peered":"2023-10-09T11:45:27.755800+0000","last_clean":"2023-10-09T11:45:27.755800+0000","last_became_active":"2023-10-09T11:45:27.755562+0000","last_became_peered":"2023-10-09T11:45:27.755562+0000","last_unstale":"2023-10-09T11:45:27.755800+0000","last_undegraded":"2023-10-09T11:45:27.755800+0000","last_fullsized":"2023-10-09T11:45:27.755800+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:36.739772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759930+0000","last_change":"2023-10-09T11:45:27.759930+0000","last_active":"2023-10-09T11:45:27.759930+0000","last_peered":"2023-10-09T11:45:27.759930+0000","last_clean":"2023-10-09T11:45:27.759930+0000","last_became_active":"2023-10-09T11:45:27.759566+0000","last_became_peered":"2023-10-09T11:45:27.759566+0000","last_unstale":"2023-10-09T11:45:27.759930+0000","last_undegraded":"2023-10-09T11:45:27.759930+0000","last_fullsized":"2023-10-09T11:45:27.759930+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:11.292224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755882+0000","last_change":"2023-10-09T11:45:27.755882+0000","last_active":"2023-10-09T11:45:27.755882+0000","last_peered":"2023-10-09T11:45:27.755882+0000","last_clean":"2023-10-09T11:45:27.755882+0000","last_became_active":"2023-10-09T11:45:27.755394+0000","last_became_peered":"2023-10-09T11:45:27.755394+0000","last_unstale":"2023-10-09T11:45:27.755882+0000","last_undegraded":"2023-10-09T11:45:27.755882+0000","last_fullsized":"2023-10-09T11:45:27.755882+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:56.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751150+0000","last_change":"2023-10-09T11:45:27.751150+0000","last_active":"2023-10-09T11:45:27.751150+0000","last_peered":"2023-10-09T11:45:27.751150+0000","last_clean":"2023-10-09T11:45:27.751150+0000","last_became_active":"2023-10-09T11:45:27.750920+0000","last_became_peered":"2023-10-09T11:45:27.750920+0000","last_unstale":"2023-10-09T11:45:27.751150+0000","last_undegraded":"2023-10-09T11:45:27.751150+0000","last_fullsized":"2023-10-09T11:45:27.751150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:14.003168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750685+0000","last_change":"2023-10-09T11:45:27.750685+0000","last_active":"2023-10-09T11:45:27.750685+0000","last_peered":"2023-10-09T11:45:27.750685+0000","last_clean":"2023-10-09T11:45:27.750685+0000","last_became_active":"2023-10-09T11:45:27.750450+0000","last_became_peered":"2023-10-09T11:45:27.750450+0000","last_unstale":"2023-10-09T11:45:27.750685+0000","last_undegraded":"2023-10-09T11:45:27.750685+0000","last_fullsized":"2023-10-09T11:45:27.750685+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:47.343125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757163+0000","last_change":"2023-10-09T11:45:27.757163+0000","last_active":"2023-10-09T11:45:27.757163+0000","last_peered":"2023-10-09T11:45:27.757163+0000","last_clean":"2023-10-09T11:45:27.757163+0000","last_became_active":"2023-10-09T11:45:27.756459+0000","last_became_peered":"2023-10-09T11:45:27.756459+0000","last_unstale":"2023-10-09T11:45:27.757163+0000","last_undegraded":"2023-10-09T11:45:27.757163+0000","last_fullsized":"2023-10-09T11:45:27.757163+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:34.409259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754408+0000","last_change":"2023-10-09T11:45:27.754408+0000","last_active":"2023-10-09T11:45:27.754408+0000","last_peered":"2023-10-09T11:45:27.754408+0000","last_clean":"2023-10-09T11:45:27.754408+0000","last_became_active":"2023-10-09T11:45:27.752769+0000","last_became_peered":"2023-10-09T11:45:27.752769+0000","last_unstale":"2023-10-09T11:45:27.754408+0000","last_undegraded":"2023-10-09T11:45:27.754408+0000","last_fullsized":"2023-10-09T11:45:27.754408+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:23.992532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751204+0000","last_change":"2023-10-09T11:45:27.751204+0000","last_active":"2023-10-09T11:45:27.751204+0000","last_peered":"2023-10-09T11:45:27.751204+0000","last_clean":"2023-10-09T11:45:27.751204+0000","last_became_active":"2023-10-09T11:45:27.750948+0000","last_became_peered":"2023-10-09T11:45:27.750948+0000","last_unstale":"2023-10-09T11:45:27.751204+0000","last_undegraded":"2023-10-09T11:45:27.751204+0000","last_fullsized":"2023-10-09T11:45:27.751204+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:33.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757571+0000","last_change":"2023-10-09T11:45:27.757571+0000","last_active":"2023-10-09T11:45:27.757571+0000","last_peered":"2023-10-09T11:45:27.757571+0000","last_clean":"2023-10-09T11:45:27.757571+0000","last_became_active":"2023-10-09T11:45:27.757265+0000","last_became_peered":"2023-10-09T11:45:27.757265+0000","last_unstale":"2023-10-09T11:45:27.757571+0000","last_undegraded":"2023-10-09T11:45:27.757571+0000","last_fullsized":"2023-10-09T11:45:27.757571+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:05.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754730+0000","last_change":"2023-10-09T11:45:27.754730+0000","last_active":"2023-10-09T11:45:27.754730+0000","last_peered":"2023-10-09T11:45:27.754730+0000","last_clean":"2023-10-09T11:45:27.754730+0000","last_became_active":"2023-10-09T11:45:27.754379+0000","last_became_peered":"2023-10-09T11:45:27.754379+0000","last_unstale":"2023-10-09T11:45:27.754730+0000","last_undegraded":"2023-10-09T11:45:27.754730+0000","last_fullsized":"2023-10-09T11:45:27.754730+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:48.535793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756683+0000","last_change":"2023-10-09T11:45:27.756683+0000","last_active":"2023-10-09T11:45:27.756683+0000","last_peered":"2023-10-09T11:45:27.756683+0000","last_clean":"2023-10-09T11:45:27.756683+0000","last_became_active":"2023-10-09T11:45:27.755842+0000","last_became_peered":"2023-10-09T11:45:27.755842+0000","last_unstale":"2023-10-09T11:45:27.756683+0000","last_undegraded":"2023-10-09T11:45:27.756683+0000","last_fullsized":"2023-10-09T11:45:27.756683+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:02.446052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756398+0000","last_change":"2023-10-09T11:45:27.756398+0000","last_active":"2023-10-09T11:45:27.756398+0000","last_peered":"2023-10-09T11:45:27.756398+0000","last_clean":"2023-10-09T11:45:27.756398+0000","last_became_active":"2023-10-09T11:45:27.756157+0000","last_became_peered":"2023-10-09T11:45:27.756157+0000","last_unstale":"2023-10-09T11:45:27.756398+0000","last_undegraded":"2023-10-09T11:45:27.756398+0000","last_fullsized":"2023-10-09T11:45:27.756398+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:53.239307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753993+0000","last_change":"2023-10-09T11:45:27.753993+0000","last_active":"2023-10-09T11:45:27.753993+0000","last_peered":"2023-10-09T11:45:27.753993+0000","last_clean":"2023-10-09T11:45:27.753993+0000","last_became_active":"2023-10-09T11:45:27.753763+0000","last_became_peered":"2023-10-09T11:45:27.753763+0000","last_unstale":"2023-10-09T11:45:27.753993+0000","last_undegraded":"2023-10-09T11:45:27.753993+0000","last_fullsized":"2023-10-09T11:45:27.753993+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752868+0000","last_change":"2023-10-09T11:45:27.752868+0000","last_active":"2023-10-09T11:45:27.752868+0000","last_peered":"2023-10-09T11:45:27.752868+0000","last_clean":"2023-10-09T11:45:27.752868+0000","last_became_active":"2023-10-09T11:45:27.751061+0000","last_became_peered":"2023-10-09T11:45:27.751061+0000","last_unstale":"2023-10-09T11:45:27.752868+0000","last_undegraded":"2023-10-09T11:45:27.752868+0000","last_fullsized":"2023-10-09T11:45:27.752868+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:19.773755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753080+0000","last_change":"2023-10-09T11:45:27.753080+0000","last_active":"2023-10-09T11:45:27.753080+0000","last_peered":"2023-10-09T11:45:27.753080+0000","last_clean":"2023-10-09T11:45:27.753080+0000","last_became_active":"2023-10-09T11:45:27.752895+0000","last_became_peered":"2023-10-09T11:45:27.752895+0000","last_unstale":"2023-10-09T11:45:27.753080+0000","last_undegraded":"2023-10-09T11:45:27.753080+0000","last_fullsized":"2023-10-09T11:45:27.753080+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755559+0000","last_change":"2023-10-09T11:45:27.755559+0000","last_active":"2023-10-09T11:45:27.755559+0000","last_peered":"2023-10-09T11:45:27.755559+0000","last_clean":"2023-10-09T11:45:27.755559+0000","last_became_active":"2023-10-09T11:45:27.755318+0000","last_became_peered":"2023-10-09T11:45:27.755318+0000","last_unstale":"2023-10-09T11:45:27.755559+0000","last_undegraded":"2023-10-09T11:45:27.755559+0000","last_fullsized":"2023-10-09T11:45:27.755559+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:44.636476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756045+0000","last_change":"2023-10-09T11:45:27.756045+0000","last_active":"2023-10-09T11:45:27.756045+0000","last_peered":"2023-10-09T11:45:27.756045+0000","last_clean":"2023-10-09T11:45:27.756045+0000","last_became_active":"2023-10-09T11:45:27.754630+0000","last_became_peered":"2023-10-09T11:45:27.754630+0000","last_unstale":"2023-10-09T11:45:27.756045+0000","last_undegraded":"2023-10-09T11:45:27.756045+0000","last_fullsized":"2023-10-09T11:45:27.756045+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:38.793854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745981+0000","last_change":"2023-10-09T11:45:27.745981+0000","last_active":"2023-10-09T11:45:27.745981+0000","last_peered":"2023-10-09T11:45:27.745981+0000","last_clean":"2023-10-09T11:45:27.745981+0000","last_became_active":"2023-10-09T11:45:27.745734+0000","last_became_peered":"2023-10-09T11:45:27.745734+0000","last_unstale":"2023-10-09T11:45:27.745981+0000","last_undegraded":"2023-10-09T11:45:27.745981+0000","last_fullsized":"2023-10-09T11:45:27.745981+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:50.504984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755125+0000","last_change":"2023-10-09T11:45:27.755125+0000","last_active":"2023-10-09T11:45:27.755125+0000","last_peered":"2023-10-09T11:45:27.755125+0000","last_clean":"2023-10-09T11:45:27.755125+0000","last_became_active":"2023-10-09T11:45:27.753233+0000","last_became_peered":"2023-10-09T11:45:27.753233+0000","last_unstale":"2023-10-09T11:45:27.755125+0000","last_undegraded":"2023-10-09T11:45:27.755125+0000","last_fullsized":"2023-10-09T11:45:27.755125+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:30.758861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759174+0000","last_change":"2023-10-09T11:45:27.759174+0000","last_active":"2023-10-09T11:45:27.759174+0000","last_peered":"2023-10-09T11:45:27.759174+0000","last_clean":"2023-10-09T11:45:27.759174+0000","last_became_active":"2023-10-09T11:45:27.758208+0000","last_became_peered":"2023-10-09T11:45:27.758208+0000","last_unstale":"2023-10-09T11:45:27.759174+0000","last_undegraded":"2023-10-09T11:45:27.759174+0000","last_fullsized":"2023-10-09T11:45:27.759174+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:34.563672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754579+0000","last_change":"2023-10-09T11:45:27.754579+0000","last_active":"2023-10-09T11:45:27.754579+0000","last_peered":"2023-10-09T11:45:27.754579+0000","last_clean":"2023-10-09T11:45:27.754579+0000","last_became_active":"2023-10-09T11:45:27.754246+0000","last_became_peered":"2023-10-09T11:45:27.754246+0000","last_unstale":"2023-10-09T11:45:27.754579+0000","last_undegraded":"2023-10-09T11:45:27.754579+0000","last_fullsized":"2023-10-09T11:45:27.754579+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:29.237199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754909+0000","last_change":"2023-10-09T11:45:27.754909+0000","last_active":"2023-10-09T11:45:27.754909+0000","last_peered":"2023-10-09T11:45:27.754909+0000","last_clean":"2023-10-09T11:45:27.754909+0000","last_became_active":"2023-10-09T11:45:27.754180+0000","last_became_peered":"2023-10-09T11:45:27.754180+0000","last_unstale":"2023-10-09T11:45:27.754909+0000","last_undegraded":"2023-10-09T11:45:27.754909+0000","last_fullsized":"2023-10-09T11:45:27.754909+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:05.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759986+0000","last_change":"2023-10-09T11:45:27.759986+0000","last_active":"2023-10-09T11:45:27.759986+0000","last_peered":"2023-10-09T11:45:27.759986+0000","last_clean":"2023-10-09T11:45:27.759986+0000","last_became_active":"2023-10-09T11:45:27.759797+0000","last_became_peered":"2023-10-09T11:45:27.759797+0000","last_unstale":"2023-10-09T11:45:27.759986+0000","last_undegraded":"2023-10-09T11:45:27.759986+0000","last_fullsized":"2023-10-09T11:45:27.759986+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:24.012512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760432+0000","last_change":"2023-10-09T11:45:27.760432+0000","last_active":"2023-10-09T11:45:27.760432+0000","last_peered":"2023-10-09T11:45:27.760432+0000","last_clean":"2023-10-09T11:45:27.760432+0000","last_became_active":"2023-10-09T11:45:27.760198+0000","last_became_peered":"2023-10-09T11:45:27.760198+0000","last_unstale":"2023-10-09T11:45:27.760432+0000","last_undegraded":"2023-10-09T11:45:27.760432+0000","last_fullsized":"2023-10-09T11:45:27.760432+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:35.811082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759432+0000","last_change":"2023-10-09T11:45:27.759432+0000","last_active":"2023-10-09T11:45:27.759432+0000","last_peered":"2023-10-09T11:45:27.759432+0000","last_clean":"2023-10-09T11:45:27.759432+0000","last_became_active":"2023-10-09T11:45:27.759190+0000","last_became_peered":"2023-10-09T11:45:27.759190+0000","last_unstale":"2023-10-09T11:45:27.759432+0000","last_undegraded":"2023-10-09T11:45:27.759432+0000","last_fullsized":"2023-10-09T11:45:27.759432+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:07.449542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751078+0000","last_change":"2023-10-09T11:45:27.751078+0000","last_active":"2023-10-09T11:45:27.751078+0000","last_peered":"2023-10-09T11:45:27.751078+0000","last_clean":"2023-10-09T11:45:27.751078+0000","last_became_active":"2023-10-09T11:45:27.750857+0000","last_became_peered":"2023-10-09T11:45:27.750857+0000","last_unstale":"2023-10-09T11:45:27.751078+0000","last_undegraded":"2023-10-09T11:45:27.751078+0000","last_fullsized":"2023-10-09T11:45:27.751078+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:34.580175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759421+0000","last_change":"2023-10-09T11:45:27.759421+0000","last_active":"2023-10-09T11:45:27.759421+0000","last_peered":"2023-10-09T11:45:27.759421+0000","last_clean":"2023-10-09T11:45:27.759421+0000","last_became_active":"2023-10-09T11:45:27.759239+0000","last_became_peered":"2023-10-09T11:45:27.759239+0000","last_unstale":"2023-10-09T11:45:27.759421+0000","last_undegraded":"2023-10-09T11:45:27.759421+0000","last_fullsized":"2023-10-09T11:45:27.759421+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:49.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754976+0000","last_change":"2023-10-09T11:45:27.754976+0000","last_active":"2023-10-09T11:45:27.754976+0000","last_peered":"2023-10-09T11:45:27.754976+0000","last_clean":"2023-10-09T11:45:27.754976+0000","last_became_active":"2023-10-09T11:45:27.754434+0000","last_became_peered":"2023-10-09T11:45:27.754434+0000","last_unstale":"2023-10-09T11:45:27.754976+0000","last_undegraded":"2023-10-09T11:45:27.754976+0000","last_fullsized":"2023-10-09T11:45:27.754976+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:49.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759386+0000","last_change":"2023-10-09T11:45:27.759386+0000","last_active":"2023-10-09T11:45:27.759386+0000","last_peered":"2023-10-09T11:45:27.759386+0000","last_clean":"2023-10-09T11:45:27.759386+0000","last_became_active":"2023-10-09T11:45:27.758571+0000","last_became_peered":"2023-10-09T11:45:27.758571+0000","last_unstale":"2023-10-09T11:45:27.759386+0000","last_undegraded":"2023-10-09T11:45:27.759386+0000","last_fullsized":"2023-10-09T11:45:27.759386+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:35.590061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"161'4","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979135+0000","last_change":"2023-10-09T11:45:26.735935+0000","last_active":"2023-10-09T11:45:27.979135+0000","last_peered":"2023-10-09T11:45:27.979135+0000","last_clean":"2023-10-09T11:45:27.979135+0000","last_became_active":"2023-10-09T11:45:26.735628+0000","last_became_peered":"2023-10-09T11:45:26.735628+0000","last_unstale":"2023-10-09T11:45:27.979135+0000","last_undegraded":"2023-10-09T11:45:27.979135+0000","last_fullsized":"2023-10-09T11:45:27.979135+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:48.755707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753640+0000","last_change":"2023-10-09T11:45:27.753640+0000","last_active":"2023-10-09T11:45:27.753640+0000","last_peered":"2023-10-09T11:45:27.753640+0000","last_clean":"2023-10-09T11:45:27.753640+0000","last_became_active":"2023-10-09T11:45:27.753410+0000","last_became_peered":"2023-10-09T11:45:27.753410+0000","last_unstale":"2023-10-09T11:45:27.753640+0000","last_undegraded":"2023-10-09T11:45:27.753640+0000","last_fullsized":"2023-10-09T11:45:27.753640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:59.700540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.742162+0000","last_change":"2023-10-09T11:45:26.739250+0000","last_active":"2023-10-09T11:45:27.742162+0000","last_peered":"2023-10-09T11:45:27.742162+0000","last_clean":"2023-10-09T11:45:27.742162+0000","last_became_active":"2023-10-09T11:45:26.738727+0000","last_became_peered":"2023-10-09T11:45:26.738727+0000","last_unstale":"2023-10-09T11:45:27.742162+0000","last_undegraded":"2023-10-09T11:45:27.742162+0000","last_fullsized":"2023-10-09T11:45:27.742162+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:54.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754742+0000","last_change":"2023-10-09T11:45:27.754742+0000","last_active":"2023-10-09T11:45:27.754742+0000","last_peered":"2023-10-09T11:45:27.754742+0000","last_clean":"2023-10-09T11:45:27.754742+0000","last_became_active":"2023-10-09T11:45:27.753427+0000","last_became_peered":"2023-10-09T11:45:27.753427+0000","last_unstale":"2023-10-09T11:45:27.754742+0000","last_undegraded":"2023-10-09T11:45:27.754742+0000","last_fullsized":"2023-10-09T11:45:27.754742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.978799+0000","last_change":"2023-10-09T11:45:26.729598+0000","last_active":"2023-10-09T11:45:27.978799+0000","last_peered":"2023-10-09T11:45:27.978799+0000","last_clean":"2023-10-09T11:45:27.978799+0000","last_became_active":"2023-10-09T11:45:26.729371+0000","last_became_peered":"2023-10-09T11:45:26.729371+0000","last_unstale":"2023-10-09T11:45:27.978799+0000","last_undegraded":"2023-10-09T11:45:27.978799+0000","last_fullsized":"2023-10-09T11:45:27.978799+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:22.988046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757642+0000","last_change":"2023-10-09T11:45:27.757642+0000","last_active":"2023-10-09T11:45:27.757642+0000","last_peered":"2023-10-09T11:45:27.757642+0000","last_clean":"2023-10-09T11:45:27.757642+0000","last_became_active":"2023-10-09T11:45:27.757404+0000","last_became_peered":"2023-10-09T11:45:27.757404+0000","last_unstale":"2023-10-09T11:45:27.757642+0000","last_undegraded":"2023-10-09T11:45:27.757642+0000","last_fullsized":"2023-10-09T11:45:27.757642+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:43.346275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979269+0000","last_change":"2023-10-09T11:45:26.736117+0000","last_active":"2023-10-09T11:45:27.979269+0000","last_peered":"2023-10-09T11:45:27.979269+0000","last_clean":"2023-10-09T11:45:27.979269+0000","last_became_active":"2023-10-09T11:45:26.735903+0000","last_became_peered":"2023-10-09T11:45:26.735903+0000","last_unstale":"2023-10-09T11:45:27.979269+0000","last_undegraded":"2023-10-09T11:45:27.979269+0000","last_fullsized":"2023-10-09T11:45:27.979269+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:27.617252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760595+0000","last_change":"2023-10-09T11:45:27.760595+0000","last_active":"2023-10-09T11:45:27.760595+0000","last_peered":"2023-10-09T11:45:27.760595+0000","last_clean":"2023-10-09T11:45:27.760595+0000","last_became_active":"2023-10-09T11:45:27.760317+0000","last_became_peered":"2023-10-09T11:45:27.760317+0000","last_unstale":"2023-10-09T11:45:27.760595+0000","last_undegraded":"2023-10-09T11:45:27.760595+0000","last_fullsized":"2023-10-09T11:45:27.760595+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:19.010517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.749470+0000","last_change":"2023-10-09T11:45:26.735350+0000","last_active":"2023-10-09T11:45:27.749470+0000","last_peered":"2023-10-09T11:45:27.749470+0000","last_clean":"2023-10-09T11:45:27.749470+0000","last_became_active":"2023-10-09T11:45:26.735051+0000","last_became_peered":"2023-10-09T11:45:26.735051+0000","last_unstale":"2023-10-09T11:45:27.749470+0000","last_undegraded":"2023-10-09T11:45:27.749470+0000","last_fullsized":"2023-10-09T11:45:27.749470+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:28.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760358+0000","last_change":"2023-10-09T11:45:27.760358+0000","last_active":"2023-10-09T11:45:27.760358+0000","last_peered":"2023-10-09T11:45:27.760358+0000","last_clean":"2023-10-09T11:45:27.760358+0000","last_became_active":"2023-10-09T11:45:27.760117+0000","last_became_peered":"2023-10-09T11:45:27.760117+0000","last_unstale":"2023-10-09T11:45:27.760358+0000","last_undegraded":"2023-10-09T11:45:27.760358+0000","last_fullsized":"2023-10-09T11:45:27.760358+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:38.255520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745129+0000","last_change":"2023-10-09T11:45:26.736256+0000","last_active":"2023-10-09T11:45:27.745129+0000","last_peered":"2023-10-09T11:45:27.745129+0000","last_clean":"2023-10-09T11:45:27.745129+0000","last_became_active":"2023-10-09T11:45:26.736057+0000","last_became_peered":"2023-10-09T11:45:26.736057+0000","last_unstale":"2023-10-09T11:45:27.745129+0000","last_undegraded":"2023-10-09T11:45:27.745129+0000","last_fullsized":"2023-10-09T11:45:27.745129+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:41.099808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745205+0000","last_change":"2023-10-09T11:45:27.745205+0000","last_active":"2023-10-09T11:45:27.745205+0000","last_peered":"2023-10-09T11:45:27.745205+0000","last_clean":"2023-10-09T11:45:27.745205+0000","last_became_active":"2023-10-09T11:45:27.744782+0000","last_became_peered":"2023-10-09T11:45:27.744782+0000","last_unstale":"2023-10-09T11:45:27.745205+0000","last_undegraded":"2023-10-09T11:45:27.745205+0000","last_fullsized":"2023-10-09T11:45:27.745205+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:56.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.740669+0000","last_change":"2023-10-09T11:45:26.740612+0000","last_active":"2023-10-09T11:45:26.740669+0000","last_peered":"2023-10-09T11:45:26.740669+0000","last_clean":"2023-10-09T11:45:26.740669+0000","last_became_active":"2023-10-09T11:45:26.736429+0000","last_became_peered":"2023-10-09T11:45:26.736429+0000","last_unstale":"2023-10-09T11:45:26.740669+0000","last_undegraded":"2023-10-09T11:45:26.740669+0000","last_fullsized":"2023-10-09T11:45:26.740669+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:40.118076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750838+0000","last_change":"2023-10-09T11:45:27.750838+0000","last_active":"2023-10-09T11:45:27.750838+0000","last_peered":"2023-10-09T11:45:27.750838+0000","last_clean":"2023-10-09T11:45:27.750838+0000","last_became_active":"2023-10-09T11:45:27.750568+0000","last_became_peered":"2023-10-09T11:45:27.750568+0000","last_unstale":"2023-10-09T11:45:27.750838+0000","last_undegraded":"2023-10-09T11:45:27.750838+0000","last_fullsized":"2023-10-09T11:45:27.750838+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:12:42.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737701+0000","last_change":"2023-10-09T11:45:26.736732+0000","last_active":"2023-10-09T11:45:26.737701+0000","last_peered":"2023-10-09T11:45:26.737701+0000","last_clean":"2023-10-09T11:45:26.737701+0000","last_became_active":"2023-10-09T11:45:26.736502+0000","last_became_peered":"2023-10-09T11:45:26.736502+0000","last_unstale":"2023-10-09T11:45:26.737701+0000","last_undegraded":"2023-10-09T11:45:26.737701+0000","last_fullsized":"2023-10-09T11:45:26.737701+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:10.287738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752727+0000","last_change":"2023-10-09T11:45:27.752727+0000","last_active":"2023-10-09T11:45:27.752727+0000","last_peered":"2023-10-09T11:45:27.752727+0000","last_clean":"2023-10-09T11:45:27.752727+0000","last_became_active":"2023-10-09T11:45:27.752504+0000","last_became_peered":"2023-10-09T11:45:27.752504+0000","last_unstale":"2023-10-09T11:45:27.752727+0000","last_undegraded":"2023-10-09T11:45:27.752727+0000","last_fullsized":"2023-10-09T11:45:27.752727+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:23.992532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.738331+0000","last_change":"2023-10-09T11:45:26.737901+0000","last_active":"2023-10-09T11:45:26.738331+0000","last_peered":"2023-10-09T11:45:26.738331+0000","last_clean":"2023-10-09T11:45:26.738331+0000","last_became_active":"2023-10-09T11:45:26.737624+0000","last_became_peered":"2023-10-09T11:45:26.737624+0000","last_unstale":"2023-10-09T11:45:26.738331+0000","last_undegraded":"2023-10-09T11:45:26.738331+0000","last_fullsized":"2023-10-09T11:45:26.738331+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:42.416462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753526+0000","last_change":"2023-10-09T11:45:27.753526+0000","last_active":"2023-10-09T11:45:27.753526+0000","last_peered":"2023-10-09T11:45:27.753526+0000","last_clean":"2023-10-09T11:45:27.753526+0000","last_became_active":"2023-10-09T11:45:27.753304+0000","last_became_peered":"2023-10-09T11:45:27.753304+0000","last_unstale":"2023-10-09T11:45:27.753526+0000","last_undegraded":"2023-10-09T11:45:27.753526+0000","last_fullsized":"2023-10-09T11:45:27.753526+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:57.752390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.735598+0000","last_change":"2023-10-09T11:45:26.735206+0000","last_active":"2023-10-09T11:45:26.735598+0000","last_peered":"2023-10-09T11:45:26.735598+0000","last_clean":"2023-10-09T11:45:26.735598+0000","last_became_active":"2023-10-09T11:45:26.734392+0000","last_became_peered":"2023-10-09T11:45:26.734392+0000","last_unstale":"2023-10-09T11:45:26.735598+0000","last_undegraded":"2023-10-09T11:45:26.735598+0000","last_fullsized":"2023-10-09T11:45:26.735598+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:20.411604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757640+0000","last_change":"2023-10-09T11:45:27.757640+0000","last_active":"2023-10-09T11:45:27.757640+0000","last_peered":"2023-10-09T11:45:27.757640+0000","last_clean":"2023-10-09T11:45:27.757640+0000","last_became_active":"2023-10-09T11:45:27.757410+0000","last_became_peered":"2023-10-09T11:45:27.757410+0000","last_unstale":"2023-10-09T11:45:27.757640+0000","last_undegraded":"2023-10-09T11:45:27.757640+0000","last_fullsized":"2023-10-09T11:45:27.757640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:23.362805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"161'6","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.981295+0000","last_change":"2023-10-09T11:45:26.731549+0000","last_active":"2023-10-09T11:45:27.981295+0000","last_peered":"2023-10-09T11:45:27.981295+0000","last_clean":"2023-10-09T11:45:27.981295+0000","last_became_active":"2023-10-09T11:45:26.731317+0000","last_became_peered":"2023-10-09T11:45:26.731317+0000","last_unstale":"2023-10-09T11:45:27.981295+0000","last_undegraded":"2023-10-09T11:45:27.981295+0000","last_fullsized":"2023-10-09T11:45:27.981295+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:39.425210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757380+0000","last_change":"2023-10-09T11:45:27.757380+0000","last_active":"2023-10-09T11:45:27.757380+0000","last_peered":"2023-10-09T11:45:27.757380+0000","last_clean":"2023-10-09T11:45:27.757380+0000","last_became_active":"2023-10-09T11:45:27.757146+0000","last_became_peered":"2023-10-09T11:45:27.757146+0000","last_unstale":"2023-10-09T11:45:27.757380+0000","last_undegraded":"2023-10-09T11:45:27.757380+0000","last_fullsized":"2023-10-09T11:45:27.757380+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:27.868845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.980111+0000","last_change":"2023-10-09T11:45:26.734884+0000","last_active":"2023-10-09T11:45:27.980111+0000","last_peered":"2023-10-09T11:45:27.980111+0000","last_clean":"2023-10-09T11:45:27.980111+0000","last_became_active":"2023-10-09T11:45:26.734656+0000","last_became_peered":"2023-10-09T11:45:26.734656+0000","last_unstale":"2023-10-09T11:45:27.980111+0000","last_undegraded":"2023-10-09T11:45:27.980111+0000","last_fullsized":"2023-10-09T11:45:27.980111+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.359333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751684+0000","last_change":"2023-10-09T11:45:27.751684+0000","last_active":"2023-10-09T11:45:27.751684+0000","last_peered":"2023-10-09T11:45:27.751684+0000","last_clean":"2023-10-09T11:45:27.751684+0000","last_became_active":"2023-10-09T11:45:27.751456+0000","last_became_peered":"2023-10-09T11:45:27.751456+0000","last_unstale":"2023-10-09T11:45:27.751684+0000","last_undegraded":"2023-10-09T11:45:27.751684+0000","last_fullsized":"2023-10-09T11:45:27.751684+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:29.802133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737976+0000","last_change":"2023-10-09T11:45:26.737913+0000","last_active":"2023-10-09T11:45:26.737976+0000","last_peered":"2023-10-09T11:45:26.737976+0000","last_clean":"2023-10-09T11:45:26.737976+0000","last_became_active":"2023-10-09T11:45:26.737482+0000","last_became_peered":"2023-10-09T11:45:26.737482+0000","last_unstale":"2023-10-09T11:45:26.737976+0000","last_undegraded":"2023-10-09T11:45:26.737976+0000","last_fullsized":"2023-10-09T11:45:26.737976+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:12.998682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754488+0000","last_change":"2023-10-09T11:45:27.754488+0000","last_active":"2023-10-09T11:45:27.754488+0000","last_peered":"2023-10-09T11:45:27.754488+0000","last_clean":"2023-10-09T11:45:27.754488+0000","last_became_active":"2023-10-09T11:45:27.753613+0000","last_became_peered":"2023-10-09T11:45:27.753613+0000","last_unstale":"2023-10-09T11:45:27.754488+0000","last_undegraded":"2023-10-09T11:45:27.754488+0000","last_fullsized":"2023-10-09T11:45:27.754488+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.734071+0000","last_change":"2023-10-09T11:45:26.733804+0000","last_active":"2023-10-09T11:45:26.734071+0000","last_peered":"2023-10-09T11:45:26.734071+0000","last_clean":"2023-10-09T11:45:26.734071+0000","last_became_active":"2023-10-09T11:45:26.733578+0000","last_became_peered":"2023-10-09T11:45:26.733578+0000","last_unstale":"2023-10-09T11:45:26.734071+0000","last_undegraded":"2023-10-09T11:45:26.734071+0000","last_fullsized":"2023-10-09T11:45:26.734071+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:44.581376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756305+0000","last_change":"2023-10-09T11:45:27.756305+0000","last_active":"2023-10-09T11:45:27.756305+0000","last_peered":"2023-10-09T11:45:27.756305+0000","last_clean":"2023-10-09T11:45:27.756305+0000","last_became_active":"2023-10-09T11:45:27.755425+0000","last_became_peered":"2023-10-09T11:45:27.755425+0000","last_unstale":"2023-10-09T11:45:27.756305+0000","last_undegraded":"2023-10-09T11:45:27.756305+0000","last_fullsized":"2023-10-09T11:45:27.756305+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:11.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"161'8","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.981350+0000","last_change":"2023-10-09T11:45:26.740195+0000","last_active":"2023-10-09T11:45:27.981350+0000","last_peered":"2023-10-09T11:45:27.981350+0000","last_clean":"2023-10-09T11:45:27.981350+0000","last_became_active":"2023-10-09T11:45:26.739945+0000","last_became_peered":"2023-10-09T11:45:26.739945+0000","last_unstale":"2023-10-09T11:45:27.981350+0000","last_undegraded":"2023-10-09T11:45:27.981350+0000","last_fullsized":"2023-10-09T11:45:27.981350+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:23.462674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756835+0000","last_change":"2023-10-09T11:45:27.756835+0000","last_active":"2023-10-09T11:45:27.756835+0000","last_peered":"2023-10-09T11:45:27.756835+0000","last_clean":"2023-10-09T11:45:27.756835+0000","last_became_active":"2023-10-09T11:45:27.756151+0000","last_became_peered":"2023-10-09T11:45:27.756151+0000","last_unstale":"2023-10-09T11:45:27.756835+0000","last_undegraded":"2023-10-09T11:45:27.756835+0000","last_fullsized":"2023-10-09T11:45:27.756835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.293704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.743840+0000","last_change":"2023-10-09T11:45:26.734087+0000","last_active":"2023-10-09T11:45:27.743840+0000","last_peered":"2023-10-09T11:45:27.743840+0000","last_clean":"2023-10-09T11:45:27.743840+0000","last_became_active":"2023-10-09T11:45:26.733597+0000","last_became_peered":"2023-10-09T11:45:26.733597+0000","last_unstale":"2023-10-09T11:45:27.743840+0000","last_undegraded":"2023-10-09T11:45:27.743840+0000","last_fullsized":"2023-10-09T11:45:27.743840+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:27.688160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758549+0000","last_change":"2023-10-09T11:45:27.758549+0000","last_active":"2023-10-09T11:45:27.758549+0000","last_peered":"2023-10-09T11:45:27.758549+0000","last_clean":"2023-10-09T11:45:27.758549+0000","last_became_active":"2023-10-09T11:45:27.758072+0000","last_became_peered":"2023-10-09T11:45:27.758072+0000","last_unstale":"2023-10-09T11:45:27.758549+0000","last_undegraded":"2023-10-09T11:45:27.758549+0000","last_fullsized":"2023-10-09T11:45:27.758549+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:43.266465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979761+0000","last_change":"2023-10-09T11:45:26.735773+0000","last_active":"2023-10-09T11:45:27.979761+0000","last_peered":"2023-10-09T11:45:27.979761+0000","last_clean":"2023-10-09T11:45:27.979761+0000","last_became_active":"2023-10-09T11:45:26.735313+0000","last_became_peered":"2023-10-09T11:45:26.735313+0000","last_unstale":"2023-10-09T11:45:27.979761+0000","last_undegraded":"2023-10-09T11:45:27.979761+0000","last_fullsized":"2023-10-09T11:45:27.979761+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:48.755707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756603+0000","last_change":"2023-10-09T11:45:27.756603+0000","last_active":"2023-10-09T11:45:27.756603+0000","last_peered":"2023-10-09T11:45:27.756603+0000","last_clean":"2023-10-09T11:45:27.756603+0000","last_became_active":"2023-10-09T11:45:27.756069+0000","last_became_peered":"2023-10-09T11:45:27.756069+0000","last_unstale":"2023-10-09T11:45:27.756603+0000","last_undegraded":"2023-10-09T11:45:27.756603+0000","last_fullsized":"2023-10-09T11:45:27.756603+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750541+0000","last_change":"2023-10-09T11:45:26.739801+0000","last_active":"2023-10-09T11:45:27.750541+0000","last_peered":"2023-10-09T11:45:27.750541+0000","last_clean":"2023-10-09T11:45:27.750541+0000","last_became_active":"2023-10-09T11:45:26.736606+0000","last_became_peered":"2023-10-09T11:45:26.736606+0000","last_unstale":"2023-10-09T11:45:27.750541+0000","last_undegraded":"2023-10-09T11:45:27.750541+0000","last_fullsized":"2023-10-09T11:45:27.750541+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:24.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759797+0000","last_change":"2023-10-09T11:45:27.759797+0000","last_active":"2023-10-09T11:45:27.759797+0000","last_peered":"2023-10-09T11:45:27.759797+0000","last_clean":"2023-10-09T11:45:27.759797+0000","last_became_active":"2023-10-09T11:45:27.759275+0000","last_became_peered":"2023-10-09T11:45:27.759275+0000","last_unstale":"2023-10-09T11:45:27.759797+0000","last_undegraded":"2023-10-09T11:45:27.759797+0000","last_fullsized":"2023-10-09T11:45:27.759797+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:28.621738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732245+0000","last_change":"2023-10-09T11:45:26.732169+0000","last_active":"2023-10-09T11:45:26.732245+0000","last_peered":"2023-10-09T11:45:26.732245+0000","last_clean":"2023-10-09T11:45:26.732245+0000","last_became_active":"2023-10-09T11:45:26.731941+0000","last_became_peered":"2023-10-09T11:45:26.731941+0000","last_unstale":"2023-10-09T11:45:26.732245+0000","last_undegraded":"2023-10-09T11:45:26.732245+0000","last_fullsized":"2023-10-09T11:45:26.732245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:49.371148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754149+0000","last_change":"2023-10-09T11:45:27.754149+0000","last_active":"2023-10-09T11:45:27.754149+0000","last_peered":"2023-10-09T11:45:27.754149+0000","last_clean":"2023-10-09T11:45:27.754149+0000","last_became_active":"2023-10-09T11:45:27.753297+0000","last_became_peered":"2023-10-09T11:45:27.753297+0000","last_unstale":"2023-10-09T11:45:27.754149+0000","last_undegraded":"2023-10-09T11:45:27.754149+0000","last_fullsized":"2023-10-09T11:45:27.754149+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979547+0000","last_change":"2023-10-09T11:45:26.739209+0000","last_active":"2023-10-09T11:45:27.979547+0000","last_peered":"2023-10-09T11:45:27.979547+0000","last_clean":"2023-10-09T11:45:27.979547+0000","last_became_active":"2023-10-09T11:45:26.738984+0000","last_became_peered":"2023-10-09T11:45:26.738984+0000","last_unstale":"2023-10-09T11:45:27.979547+0000","last_undegraded":"2023-10-09T11:45:27.979547+0000","last_fullsized":"2023-10-09T11:45:27.979547+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:23.142528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756776+0000","last_change":"2023-10-09T11:45:27.756776+0000","last_active":"2023-10-09T11:45:27.756776+0000","last_peered":"2023-10-09T11:45:27.756776+0000","last_clean":"2023-10-09T11:45:27.756776+0000","last_became_active":"2023-10-09T11:45:27.756557+0000","last_became_peered":"2023-10-09T11:45:27.756557+0000","last_unstale":"2023-10-09T11:45:27.756776+0000","last_undegraded":"2023-10-09T11:45:27.756776+0000","last_fullsized":"2023-10-09T11:45:27.756776+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737314+0000","last_change":"2023-10-09T11:45:26.737235+0000","last_active":"2023-10-09T11:45:26.737314+0000","last_peered":"2023-10-09T11:45:26.737314+0000","last_clean":"2023-10-09T11:45:26.737314+0000","last_became_active":"2023-10-09T11:45:26.736969+0000","last_became_peered":"2023-10-09T11:45:26.736969+0000","last_unstale":"2023-10-09T11:45:26.737314+0000","last_undegraded":"2023-10-09T11:45:26.737314+0000","last_fullsized":"2023-10-09T11:45:26.737314+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:54.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753495+0000","last_change":"2023-10-09T11:45:27.753495+0000","last_active":"2023-10-09T11:45:27.753495+0000","last_peered":"2023-10-09T11:45:27.753495+0000","last_clean":"2023-10-09T11:45:27.753495+0000","last_became_active":"2023-10-09T11:45:27.753257+0000","last_became_peered":"2023-10-09T11:45:27.753257+0000","last_unstale":"2023-10-09T11:45:27.753495+0000","last_undegraded":"2023-10-09T11:45:27.753495+0000","last_fullsized":"2023-10-09T11:45:27.753495+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:12.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.738409+0000","last_change":"2023-10-09T11:45:26.738351+0000","last_active":"2023-10-09T11:45:26.738409+0000","last_peered":"2023-10-09T11:45:26.738409+0000","last_clean":"2023-10-09T11:45:26.738409+0000","last_became_active":"2023-10-09T11:45:26.738101+0000","last_became_peered":"2023-10-09T11:45:26.738101+0000","last_unstale":"2023-10-09T11:45:26.738409+0000","last_undegraded":"2023-10-09T11:45:26.738409+0000","last_fullsized":"2023-10-09T11:45:26.738409+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:50.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753032+0000","last_change":"2023-10-09T11:45:27.753032+0000","last_active":"2023-10-09T11:45:27.753032+0000","last_peered":"2023-10-09T11:45:27.753032+0000","last_clean":"2023-10-09T11:45:27.753032+0000","last_became_active":"2023-10-09T11:45:27.752824+0000","last_became_peered":"2023-10-09T11:45:27.752824+0000","last_unstale":"2023-10-09T11:45:27.753032+0000","last_undegraded":"2023-10-09T11:45:27.753032+0000","last_fullsized":"2023-10-09T11:45:27.753032+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:00.845949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737727+0000","last_change":"2023-10-09T11:45:26.736371+0000","last_active":"2023-10-09T11:45:26.737727+0000","last_peered":"2023-10-09T11:45:26.737727+0000","last_clean":"2023-10-09T11:45:26.737727+0000","last_became_active":"2023-10-09T11:45:26.734475+0000","last_became_peered":"2023-10-09T11:45:26.734475+0000","last_unstale":"2023-10-09T11:45:26.737727+0000","last_undegraded":"2023-10-09T11:45:26.737727+0000","last_fullsized":"2023-10-09T11:45:26.737727+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:06.445057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754337+0000","last_change":"2023-10-09T11:45:27.754337+0000","last_active":"2023-10-09T11:45:27.754337+0000","last_peered":"2023-10-09T11:45:27.754337+0000","last_clean":"2023-10-09T11:45:27.754337+0000","last_became_active":"2023-10-09T11:45:27.753292+0000","last_became_peered":"2023-10-09T11:45:27.753292+0000","last_unstale":"2023-10-09T11:45:27.754337+0000","last_undegraded":"2023-10-09T11:45:27.754337+0000","last_fullsized":"2023-10-09T11:45:27.754337+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.978286+0000","last_change":"2023-10-09T11:45:26.735378+0000","last_active":"2023-10-09T11:45:27.978286+0000","last_peered":"2023-10-09T11:45:27.978286+0000","last_clean":"2023-10-09T11:45:27.978286+0000","last_became_active":"2023-10-09T11:45:26.734697+0000","last_became_peered":"2023-10-09T11:45:26.734697+0000","last_unstale":"2023-10-09T11:45:27.978286+0000","last_undegraded":"2023-10-09T11:45:27.978286+0000","last_fullsized":"2023-10-09T11:45:27.978286+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:39.425210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756456+0000","last_change":"2023-10-09T11:45:27.756456+0000","last_active":"2023-10-09T11:45:27.756456+0000","last_peered":"2023-10-09T11:45:27.756456+0000","last_clean":"2023-10-09T11:45:27.756456+0000","last_became_active":"2023-10-09T11:45:27.755742+0000","last_became_peered":"2023-10-09T11:45:27.755742+0000","last_unstale":"2023-10-09T11:45:27.756456+0000","last_undegraded":"2023-10-09T11:45:27.756456+0000","last_fullsized":"2023-10-09T11:45:27.756456+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.736928+0000","last_change":"2023-10-09T11:45:26.736863+0000","last_active":"2023-10-09T11:45:26.736928+0000","last_peered":"2023-10-09T11:45:26.736928+0000","last_clean":"2023-10-09T11:45:26.736928+0000","last_became_active":"2023-10-09T11:45:26.736486+0000","last_became_peered":"2023-10-09T11:45:26.736486+0000","last_unstale":"2023-10-09T11:45:26.736928+0000","last_undegraded":"2023-10-09T11:45:26.736928+0000","last_fullsized":"2023-10-09T11:45:26.736928+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:58.980483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745020+0000","last_change":"2023-10-09T11:45:27.745020+0000","last_active":"2023-10-09T11:45:27.745020+0000","last_peered":"2023-10-09T11:45:27.745020+0000","last_clean":"2023-10-09T11:45:27.745020+0000","last_became_active":"2023-10-09T11:45:27.744463+0000","last_became_peered":"2023-10-09T11:45:27.744463+0000","last_unstale":"2023-10-09T11:45:27.745020+0000","last_undegraded":"2023-10-09T11:45:27.745020+0000","last_fullsized":"2023-10-09T11:45:27.745020+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.733486+0000","last_change":"2023-10-09T11:45:26.733419+0000","last_active":"2023-10-09T11:45:26.733486+0000","last_peered":"2023-10-09T11:45:26.733486+0000","last_clean":"2023-10-09T11:45:26.733486+0000","last_became_active":"2023-10-09T11:45:26.733190+0000","last_became_peered":"2023-10-09T11:45:26.733190+0000","last_unstale":"2023-10-09T11:45:26.733486+0000","last_undegraded":"2023-10-09T11:45:26.733486+0000","last_fullsized":"2023-10-09T11:45:26.733486+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:40.525370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750576+0000","last_change":"2023-10-09T11:45:27.750576+0000","last_active":"2023-10-09T11:45:27.750576+0000","last_peered":"2023-10-09T11:45:27.750576+0000","last_clean":"2023-10-09T11:45:27.750576+0000","last_became_active":"2023-10-09T11:45:27.750361+0000","last_became_peered":"2023-10-09T11:45:27.750361+0000","last_unstale":"2023-10-09T11:45:27.750576+0000","last_undegraded":"2023-10-09T11:45:27.750576+0000","last_fullsized":"2023-10-09T11:45:27.750576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:36.739772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737197+0000","last_change":"2023-10-09T11:45:26.737085+0000","last_active":"2023-10-09T11:45:26.737197+0000","last_peered":"2023-10-09T11:45:26.737197+0000","last_clean":"2023-10-09T11:45:26.737197+0000","last_became_active":"2023-10-09T11:45:26.736793+0000","last_became_peered":"2023-10-09T11:45:26.736793+0000","last_unstale":"2023-10-09T11:45:26.737197+0000","last_undegraded":"2023-10-09T11:45:26.737197+0000","last_fullsized":"2023-10-09T11:45:26.737197+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:02.285861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755147+0000","last_change":"2023-10-09T11:45:27.755147+0000","last_active":"2023-10-09T11:45:27.755147+0000","last_peered":"2023-10-09T11:45:27.755147+0000","last_clean":"2023-10-09T11:45:27.755147+0000","last_became_active":"2023-10-09T11:45:27.754746+0000","last_became_peered":"2023-10-09T11:45:27.754746+0000","last_unstale":"2023-10-09T11:45:27.755147+0000","last_undegraded":"2023-10-09T11:45:27.755147+0000","last_fullsized":"2023-10-09T11:45:27.755147+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:34.841490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732235+0000","last_change":"2023-10-09T11:45:26.732159+0000","last_active":"2023-10-09T11:45:26.732235+0000","last_peered":"2023-10-09T11:45:26.732235+0000","last_clean":"2023-10-09T11:45:26.732235+0000","last_became_active":"2023-10-09T11:45:26.731899+0000","last_became_peered":"2023-10-09T11:45:26.731899+0000","last_unstale":"2023-10-09T11:45:26.732235+0000","last_undegraded":"2023-10-09T11:45:26.732235+0000","last_fullsized":"2023-10-09T11:45:26.732235+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:50.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757196+0000","last_change":"2023-10-09T11:45:27.757196+0000","last_active":"2023-10-09T11:45:27.757196+0000","last_peered":"2023-10-09T11:45:27.757196+0000","last_clean":"2023-10-09T11:45:27.757196+0000","last_became_active":"2023-10-09T11:45:27.756980+0000","last_became_peered":"2023-10-09T11:45:27.756980+0000","last_unstale":"2023-10-09T11:45:27.757196+0000","last_undegraded":"2023-10-09T11:45:27.757196+0000","last_fullsized":"2023-10-09T11:45:27.757196+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:37.808055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.735638+0000","last_change":"2023-10-09T11:45:26.735520+0000","last_active":"2023-10-09T11:45:26.735638+0000","last_peered":"2023-10-09T11:45:26.735638+0000","last_clean":"2023-10-09T11:45:26.735638+0000","last_became_active":"2023-10-09T11:45:26.734982+0000","last_became_peered":"2023-10-09T11:45:26.734982+0000","last_unstale":"2023-10-09T11:45:26.735638+0000","last_undegraded":"2023-10-09T11:45:26.735638+0000","last_fullsized":"2023-10-09T11:45:26.735638+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:23.142528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758804+0000","last_change":"2023-10-09T11:45:27.758804+0000","last_active":"2023-10-09T11:45:27.758804+0000","last_peered":"2023-10-09T11:45:27.758804+0000","last_clean":"2023-10-09T11:45:27.758804+0000","last_became_active":"2023-10-09T11:45:27.757798+0000","last_became_peered":"2023-10-09T11:45:27.757798+0000","last_unstale":"2023-10-09T11:45:27.758804+0000","last_undegraded":"2023-10-09T11:45:27.758804+0000","last_fullsized":"2023-10-09T11:45:27.758804+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:19.564727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.741687+0000","last_change":"2023-10-09T11:45:26.741628+0000","last_active":"2023-10-09T11:45:26.741687+0000","last_peered":"2023-10-09T11:45:26.741687+0000","last_clean":"2023-10-09T11:45:26.741687+0000","last_became_active":"2023-10-09T11:45:26.741399+0000","last_became_peered":"2023-10-09T11:45:26.741399+0000","last_unstale":"2023-10-09T11:45:26.741687+0000","last_undegraded":"2023-10-09T11:45:26.741687+0000","last_fullsized":"2023-10-09T11:45:26.741687+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:48.532037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754636+0000","last_change":"2023-10-09T11:45:27.754636+0000","last_active":"2023-10-09T11:45:27.754636+0000","last_peered":"2023-10-09T11:45:27.754636+0000","last_clean":"2023-10-09T11:45:27.754636+0000","last_became_active":"2023-10-09T11:45:27.753936+0000","last_became_peered":"2023-10-09T11:45:27.753936+0000","last_unstale":"2023-10-09T11:45:27.754636+0000","last_undegraded":"2023-10-09T11:45:27.754636+0000","last_fullsized":"2023-10-09T11:45:27.754636+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:11.292224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.739446+0000","last_change":"2023-10-09T11:45:26.739368+0000","last_active":"2023-10-09T11:45:26.739446+0000","last_peered":"2023-10-09T11:45:26.739446+0000","last_clean":"2023-10-09T11:45:26.739446+0000","last_became_active":"2023-10-09T11:45:26.739039+0000","last_became_peered":"2023-10-09T11:45:26.739039+0000","last_unstale":"2023-10-09T11:45:26.739446+0000","last_undegraded":"2023-10-09T11:45:26.739446+0000","last_fullsized":"2023-10-09T11:45:26.739446+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:16.936387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754551+0000","last_change":"2023-10-09T11:45:27.754551+0000","last_active":"2023-10-09T11:45:27.754551+0000","last_peered":"2023-10-09T11:45:27.754551+0000","last_clean":"2023-10-09T11:45:27.754551+0000","last_became_active":"2023-10-09T11:45:27.754303+0000","last_became_peered":"2023-10-09T11:45:27.754303+0000","last_unstale":"2023-10-09T11:45:27.754551+0000","last_undegraded":"2023-10-09T11:45:27.754551+0000","last_fullsized":"2023-10-09T11:45:27.754551+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:49.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"161'3","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979397+0000","last_change":"2023-10-09T11:45:26.739066+0000","last_active":"2023-10-09T11:45:27.979397+0000","last_peered":"2023-10-09T11:45:27.979397+0000","last_clean":"2023-10-09T11:45:27.979397+0000","last_became_active":"2023-10-09T11:45:26.738612+0000","last_became_peered":"2023-10-09T11:45:26.738612+0000","last_unstale":"2023-10-09T11:45:27.979397+0000","last_undegraded":"2023-10-09T11:45:27.979397+0000","last_fullsized":"2023-10-09T11:45:27.979397+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:25.103509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":282,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732505+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:45:26.732505+0000","last_peered":"2023-10-09T11:45:26.732505+0000","last_clean":"2023-10-09T11:45:26.732505+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:45:26.732505+0000","last_undegraded":"2023-10-09T11:45:26.732505+0000","last_fullsized":"2023-10-09T11:45:26.732505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.496},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":0.76100000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.437},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77100000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.45000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.76700000000000002,"15min":0.78000000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.501,"5min":0.33500000000000002,"15min":0.315},"max":{"1min":0.77800000000000002,"5min":0.78900000000000003,"15min":0.878},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.47399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.54000000000000004,"5min":0.40000000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.77200000000000002,"15min":0.90200000000000002},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":1.048},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.505,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":1.079},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.33100000000000002,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.63600000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.61799999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.46600000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.55500000000000005,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65500000000000003,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.77300000000000002,"15min":3.7589999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.70499999999999996,"5min":4.8230000000000004,"15min":5.298},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":5.3540000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":0.71999999999999997,"5min":0.77400000000000002,"15min":1.6060000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76100000000000001,"15min":1.617},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.84499999999999997,"15min":5.46},"last":0.503},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.66400000000000003},"min":{"1min":0.48499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":5.3949999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.34399999999999997,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":0.59299999999999997,"5min":1.617,"15min":1.617},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":5,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46500000000000002,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.375,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.53600000000000003,"15min":0.50900000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.314},"max":{"1min":0.71199999999999997,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36499999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":0.624,"5min":0.624,"15min":1.9370000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53400000000000003,"5min":0.60899999999999999,"15min":2.004},"last":0.27100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36199999999999999,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":0.47599999999999998,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.443,"15min":0.46700000000000003},"min":{"1min":0.377,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58299999999999996,"5min":0.68400000000000005,"15min":1.909},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.44900000000000001},"min":{"1min":0.307,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":2.0369999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79200000000000004,"5min":0.872,"15min":1.869},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.95399999999999996,"15min":1.9790000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":2.1960000000000002},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45300000000000001,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":1.952},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.41799999999999998,"15min":0.40699999999999997},"max":{"1min":0.85799999999999998,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.52500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78600000000000003,"5min":0.86299999999999999,"15min":1.782},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.93700000000000006,"15min":1.819},"last":0.75900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1443,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193869,"statfs":{"total":200000000,"available":198522251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45900000000000002,"15min":0.40999999999999998},"min":{"1min":0.23699999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.25900000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.57799999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61599999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55500000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49299999999999999,"15min":0.47399999999999998},"min":{"1min":0.34499999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":2.194,"15min":2.194},"last":0.30399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.81299999999999994,"5min":1.508,"15min":1.508},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64900000000000002,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.67600000000000005},"min":{"1min":0.498,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89900000000000002,"5min":2.379,"15min":3.976},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.85299999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.55400000000000005,"5min":0.436,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.498,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":1.593,"15min":1.593},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.55300000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.871,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.376,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.65500000000000003,"15min":0.67100000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.35199999999999998},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":0.48999999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.436,"15min":0.67800000000000005},"min":{"1min":0.29799999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.71199999999999997,"15min":11.055},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.40200000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.622,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.40899999999999997},"min":{"1min":0.34000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.85599999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.78400000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.999,"15min":0.999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94599999999999995,"5min":1.097,"15min":1.097},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.51400000000000001,"5min":0.41999999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":1.03,"15min":1.03},"last":0.36299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.90500000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35899999999999999,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.54100000000000004,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.214,"15min":0.214},"max":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.374,"15min":0.375},"min":{"1min":0.308,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.621,"5min":0.621,"15min":1.034},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.433},"min":{"1min":0.35199999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57899999999999996,"5min":0.72899999999999998,"15min":1.335},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.64400000000000002,"5min":0.67800000000000005,"15min":1.1200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.82799999999999996,"15min":1.405},"last":0.33400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.50700000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":0.876,"15min":0.98399999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84399999999999997,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.38400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.387},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.53300000000000003,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":1.054,"15min":1.3819999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65100000000000002},"min":{"1min":0.57299999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.4570000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52600000000000002,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":7.4210000000000003},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53900000000000003,"15min":0.58799999999999997},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.63900000000000001},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":5.274},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.72099999999999997},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":7.5460000000000003},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46700000000000003},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59299999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.82899999999999996},"last":0.35899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.318},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":0.78100000000000003,"15min":0.86099999999999999},"last":0.42299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.68899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68999999999999995,"5min":0.752,"15min":1.2729999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68300000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":1.1839999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.85199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.77900000000000003,"15min":0.81899999999999995},"last":0.75800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.96399999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":0.98899999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.23899999999999999},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":0.88500000000000001},"last":0.371}]},{"osd":6,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.439},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.42299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.70599999999999996,"5min":0.78800000000000003,"15min":0.82999999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.67600000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.39200000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:45:32.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:45:32.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.233+0000 7f9d48d05700 1 Processor -- start 2023-10-09T11:45:32.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.233+0000 7f9d48d05700 1 -- start start 2023-10-09T11:45:32.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d48d05700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d441578d0 0x7f9d440cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d48d05700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 0x7f9d4415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d48d05700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440d07c0 con 0x7f9d4406d120 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d48d05700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440cfbb0 con 0x7f9d441578d0 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d48d05700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440cfe90 con 0x7f9d44157ca0 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d441578d0 0x7f9d440cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d42d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d4406d120 0x7f9d4415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44926/0 (socket says 172.21.15.6:44926) 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d42d9d700 1 -- 172.21.15.6:0/3948515523 learned_addr learned my addr 172.21.15.6:0/3948515523 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 0x7f9d4415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 -- 172.21.15.6:0/3948515523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 msgr2=0x7f9d4415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 0x7f9d4415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 -- 172.21.15.6:0/3948515523 >> v1:172.21.15.6:6789/0 conn(0x7f9d4406d120 legacy=0x7f9d4415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 -- 172.21.15.6:0/3948515523 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440d0170 con 0x7f9d441578d0 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d41d9b700 1 -- 172.21.15.6:0/3948515523 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950479452 0 0) 0x7f9d440d07c0 con 0x7f9d4406d120 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 0x7f9d4415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d4259c700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d441578d0 0x7f9d440cf4f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9d340098e0 tx=0x7f9d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3180f49acc72bbe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d41d9b700 1 -- 172.21.15.6:0/3948515523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34009e80 con 0x7f9d441578d0 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.234+0000 7f9d41d9b700 1 -- 172.21.15.6:0/3948515523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400b860 con 0x7f9d441578d0 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d41d9b700 1 -- 172.21.15.6:0/3948515523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400bbe0 con 0x7f9d441578d0 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 -- 172.21.15.6:0/3948515523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d441578d0 msgr2=0x7f9d440cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d441578d0 0x7f9d440cf4f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9d340098e0 tx=0x7f9d340091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 -- 172.21.15.6:0/3948515523 shutdown_connections 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d441578d0 0x7f9d440cf4f0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3948515523 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d44157ca0 0x7f9d4415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 -- 172.21.15.6:0/3948515523 >> 172.21.15.6:0/3948515523 conn(0x7f9d4406bb90 msgr2=0x7f9d4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 -- 172.21.15.6:0/3948515523 shutdown_connections 2023-10-09T11:45:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.235+0000 7f9d48d05700 1 -- 172.21.15.6:0/3948515523 wait complete. 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.236+0000 7f9d48d05700 1 Processor -- start 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.236+0000 7f9d48d05700 1 -- start start 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 0x7f9d440caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 0x7f9d4416db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440c9650 con 0x7f9d4406d120 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4415c1a0 con 0x7f9d44157ca0 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d48d05700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4415b8b0 con 0x7f9d441578d0 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58752/0 (socket says 172.21.15.6:58752) 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 -- 172.21.15.6:0/3563250632 learned_addr learned my addr 172.21.15.6:0/3563250632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d42d9d700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 0x7f9d4416db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 0x7f9d440caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 -- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 msgr2=0x7f9d440caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 0x7f9d440caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 -- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 msgr2=0x7f9d4416db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 0x7f9d4416db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 -- 172.21.15.6:0/3563250632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d34009420 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 0x7f9d440caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d42d9d700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 0x7f9d4416db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.237+0000 7f9d4259c700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f9d4406fe20 tx=0x7f9d34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400bbe0 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34011420 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4415bb50 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340117e0 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d440c78a0 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.238+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d441552e0 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.239+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d34011bd0 con 0x7f9d4406d120 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.239+0000 7f9d3a7fc700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 0x7f9d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.239+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d34086040 con 0x7f9d4406d120 2023-10-09T11:45:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.239+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 0x7f9d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.240+0000 7f9d3bfff700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 0x7f9d240693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9d4415d3d0 tx=0x7f9d2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.244+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d340532b0 con 0x7f9d4406d120 2023-10-09T11:45:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.433+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d440d0450 con 0x7f9d24066f30 2023-10-09T11:45:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.441+0000 7f9d3a7fc700 1 -- 172.21.15.6:0/3563250632 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285364 (secure 0 0 0) 0x7f9d440d0450 con 0x7f9d24066f30 2023-10-09T11:45:32.445 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 msgr2=0x7f9d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 0x7f9d240693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9d4415d3d0 tx=0x7f9d2c008040 comp rx=0 tx=0).stop 2023-10-09T11:45:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 msgr2=0x7f9d44154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f9d4406fe20 tx=0x7f9d34017000 comp rx=0 tx=0).stop 2023-10-09T11:45:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 shutdown_connections 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9d24066f30 0x7f9d240693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d44157ca0 0x7f9d4416db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d4406d120 0x7f9d44154c80 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 --2- 172.21.15.6:0/3563250632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d441578d0 0x7f9d440caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.444+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 >> 172.21.15.6:0/3563250632 conn(0x7f9d4406bb90 msgr2=0x7f9d44068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.445+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 shutdown_connections 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.445+0000 7f9d48d05700 1 -- 172.21.15.6:0/3563250632 wait complete. 2023-10-09T11:45:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:45:32.457 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2023-10-09T11:45:32.273206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554380,"statfs":{"total":1600000000,"available":1591685463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001159"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754588+0000","last_change":"2023-10-09T11:45:27.754588+0000","last_active":"2023-10-09T11:45:27.754588+0000","last_peered":"2023-10-09T11:45:27.754588+0000","last_clean":"2023-10-09T11:45:27.754588+0000","last_became_active":"2023-10-09T11:45:27.753117+0000","last_became_peered":"2023-10-09T11:45:27.753117+0000","last_unstale":"2023-10-09T11:45:27.754588+0000","last_undegraded":"2023-10-09T11:45:27.754588+0000","last_fullsized":"2023-10-09T11:45:27.754588+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:37.808055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752585+0000","last_change":"2023-10-09T11:45:27.752585+0000","last_active":"2023-10-09T11:45:27.752585+0000","last_peered":"2023-10-09T11:45:27.752585+0000","last_clean":"2023-10-09T11:45:27.752585+0000","last_became_active":"2023-10-09T11:45:27.752338+0000","last_became_peered":"2023-10-09T11:45:27.752338+0000","last_unstale":"2023-10-09T11:45:27.752585+0000","last_undegraded":"2023-10-09T11:45:27.752585+0000","last_fullsized":"2023-10-09T11:45:27.752585+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:57.752390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758559+0000","last_change":"2023-10-09T11:45:27.758559+0000","last_active":"2023-10-09T11:45:27.758559+0000","last_peered":"2023-10-09T11:45:27.758559+0000","last_clean":"2023-10-09T11:45:27.758559+0000","last_became_active":"2023-10-09T11:45:27.752106+0000","last_became_peered":"2023-10-09T11:45:27.752106+0000","last_unstale":"2023-10-09T11:45:27.758559+0000","last_undegraded":"2023-10-09T11:45:27.758559+0000","last_fullsized":"2023-10-09T11:45:27.758559+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:46:01.688609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.748850+0000","last_change":"2023-10-09T11:45:27.748850+0000","last_active":"2023-10-09T11:45:27.748850+0000","last_peered":"2023-10-09T11:45:27.748850+0000","last_clean":"2023-10-09T11:45:27.748850+0000","last_became_active":"2023-10-09T11:45:27.748143+0000","last_became_peered":"2023-10-09T11:45:27.748143+0000","last_unstale":"2023-10-09T11:45:27.748850+0000","last_undegraded":"2023-10-09T11:45:27.748850+0000","last_fullsized":"2023-10-09T11:45:27.748850+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:37:06.006083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755800+0000","last_change":"2023-10-09T11:45:27.755800+0000","last_active":"2023-10-09T11:45:27.755800+0000","last_peered":"2023-10-09T11:45:27.755800+0000","last_clean":"2023-10-09T11:45:27.755800+0000","last_became_active":"2023-10-09T11:45:27.755562+0000","last_became_peered":"2023-10-09T11:45:27.755562+0000","last_unstale":"2023-10-09T11:45:27.755800+0000","last_undegraded":"2023-10-09T11:45:27.755800+0000","last_fullsized":"2023-10-09T11:45:27.755800+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:36.739772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759930+0000","last_change":"2023-10-09T11:45:27.759930+0000","last_active":"2023-10-09T11:45:27.759930+0000","last_peered":"2023-10-09T11:45:27.759930+0000","last_clean":"2023-10-09T11:45:27.759930+0000","last_became_active":"2023-10-09T11:45:27.759566+0000","last_became_peered":"2023-10-09T11:45:27.759566+0000","last_unstale":"2023-10-09T11:45:27.759930+0000","last_undegraded":"2023-10-09T11:45:27.759930+0000","last_fullsized":"2023-10-09T11:45:27.759930+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:11.292224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755882+0000","last_change":"2023-10-09T11:45:27.755882+0000","last_active":"2023-10-09T11:45:27.755882+0000","last_peered":"2023-10-09T11:45:27.755882+0000","last_clean":"2023-10-09T11:45:27.755882+0000","last_became_active":"2023-10-09T11:45:27.755394+0000","last_became_peered":"2023-10-09T11:45:27.755394+0000","last_unstale":"2023-10-09T11:45:27.755882+0000","last_undegraded":"2023-10-09T11:45:27.755882+0000","last_fullsized":"2023-10-09T11:45:27.755882+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:56.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751150+0000","last_change":"2023-10-09T11:45:27.751150+0000","last_active":"2023-10-09T11:45:27.751150+0000","last_peered":"2023-10-09T11:45:27.751150+0000","last_clean":"2023-10-09T11:45:27.751150+0000","last_became_active":"2023-10-09T11:45:27.750920+0000","last_became_peered":"2023-10-09T11:45:27.750920+0000","last_unstale":"2023-10-09T11:45:27.751150+0000","last_undegraded":"2023-10-09T11:45:27.751150+0000","last_fullsized":"2023-10-09T11:45:27.751150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:14.003168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750685+0000","last_change":"2023-10-09T11:45:27.750685+0000","last_active":"2023-10-09T11:45:27.750685+0000","last_peered":"2023-10-09T11:45:27.750685+0000","last_clean":"2023-10-09T11:45:27.750685+0000","last_became_active":"2023-10-09T11:45:27.750450+0000","last_became_peered":"2023-10-09T11:45:27.750450+0000","last_unstale":"2023-10-09T11:45:27.750685+0000","last_undegraded":"2023-10-09T11:45:27.750685+0000","last_fullsized":"2023-10-09T11:45:27.750685+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:47.343125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757163+0000","last_change":"2023-10-09T11:45:27.757163+0000","last_active":"2023-10-09T11:45:27.757163+0000","last_peered":"2023-10-09T11:45:27.757163+0000","last_clean":"2023-10-09T11:45:27.757163+0000","last_became_active":"2023-10-09T11:45:27.756459+0000","last_became_peered":"2023-10-09T11:45:27.756459+0000","last_unstale":"2023-10-09T11:45:27.757163+0000","last_undegraded":"2023-10-09T11:45:27.757163+0000","last_fullsized":"2023-10-09T11:45:27.757163+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:34.409259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754408+0000","last_change":"2023-10-09T11:45:27.754408+0000","last_active":"2023-10-09T11:45:27.754408+0000","last_peered":"2023-10-09T11:45:27.754408+0000","last_clean":"2023-10-09T11:45:27.754408+0000","last_became_active":"2023-10-09T11:45:27.752769+0000","last_became_peered":"2023-10-09T11:45:27.752769+0000","last_unstale":"2023-10-09T11:45:27.754408+0000","last_undegraded":"2023-10-09T11:45:27.754408+0000","last_fullsized":"2023-10-09T11:45:27.754408+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:23.992532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751204+0000","last_change":"2023-10-09T11:45:27.751204+0000","last_active":"2023-10-09T11:45:27.751204+0000","last_peered":"2023-10-09T11:45:27.751204+0000","last_clean":"2023-10-09T11:45:27.751204+0000","last_became_active":"2023-10-09T11:45:27.750948+0000","last_became_peered":"2023-10-09T11:45:27.750948+0000","last_unstale":"2023-10-09T11:45:27.751204+0000","last_undegraded":"2023-10-09T11:45:27.751204+0000","last_fullsized":"2023-10-09T11:45:27.751204+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:33.185783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757571+0000","last_change":"2023-10-09T11:45:27.757571+0000","last_active":"2023-10-09T11:45:27.757571+0000","last_peered":"2023-10-09T11:45:27.757571+0000","last_clean":"2023-10-09T11:45:27.757571+0000","last_became_active":"2023-10-09T11:45:27.757265+0000","last_became_peered":"2023-10-09T11:45:27.757265+0000","last_unstale":"2023-10-09T11:45:27.757571+0000","last_undegraded":"2023-10-09T11:45:27.757571+0000","last_fullsized":"2023-10-09T11:45:27.757571+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:05.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754730+0000","last_change":"2023-10-09T11:45:27.754730+0000","last_active":"2023-10-09T11:45:27.754730+0000","last_peered":"2023-10-09T11:45:27.754730+0000","last_clean":"2023-10-09T11:45:27.754730+0000","last_became_active":"2023-10-09T11:45:27.754379+0000","last_became_peered":"2023-10-09T11:45:27.754379+0000","last_unstale":"2023-10-09T11:45:27.754730+0000","last_undegraded":"2023-10-09T11:45:27.754730+0000","last_fullsized":"2023-10-09T11:45:27.754730+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:48.535793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756683+0000","last_change":"2023-10-09T11:45:27.756683+0000","last_active":"2023-10-09T11:45:27.756683+0000","last_peered":"2023-10-09T11:45:27.756683+0000","last_clean":"2023-10-09T11:45:27.756683+0000","last_became_active":"2023-10-09T11:45:27.755842+0000","last_became_peered":"2023-10-09T11:45:27.755842+0000","last_unstale":"2023-10-09T11:45:27.756683+0000","last_undegraded":"2023-10-09T11:45:27.756683+0000","last_fullsized":"2023-10-09T11:45:27.756683+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:05:02.446052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756398+0000","last_change":"2023-10-09T11:45:27.756398+0000","last_active":"2023-10-09T11:45:27.756398+0000","last_peered":"2023-10-09T11:45:27.756398+0000","last_clean":"2023-10-09T11:45:27.756398+0000","last_became_active":"2023-10-09T11:45:27.756157+0000","last_became_peered":"2023-10-09T11:45:27.756157+0000","last_unstale":"2023-10-09T11:45:27.756398+0000","last_undegraded":"2023-10-09T11:45:27.756398+0000","last_fullsized":"2023-10-09T11:45:27.756398+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:53.239307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753993+0000","last_change":"2023-10-09T11:45:27.753993+0000","last_active":"2023-10-09T11:45:27.753993+0000","last_peered":"2023-10-09T11:45:27.753993+0000","last_clean":"2023-10-09T11:45:27.753993+0000","last_became_active":"2023-10-09T11:45:27.753763+0000","last_became_peered":"2023-10-09T11:45:27.753763+0000","last_unstale":"2023-10-09T11:45:27.753993+0000","last_undegraded":"2023-10-09T11:45:27.753993+0000","last_fullsized":"2023-10-09T11:45:27.753993+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752868+0000","last_change":"2023-10-09T11:45:27.752868+0000","last_active":"2023-10-09T11:45:27.752868+0000","last_peered":"2023-10-09T11:45:27.752868+0000","last_clean":"2023-10-09T11:45:27.752868+0000","last_became_active":"2023-10-09T11:45:27.751061+0000","last_became_peered":"2023-10-09T11:45:27.751061+0000","last_unstale":"2023-10-09T11:45:27.752868+0000","last_undegraded":"2023-10-09T11:45:27.752868+0000","last_fullsized":"2023-10-09T11:45:27.752868+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:22:19.773755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753080+0000","last_change":"2023-10-09T11:45:27.753080+0000","last_active":"2023-10-09T11:45:27.753080+0000","last_peered":"2023-10-09T11:45:27.753080+0000","last_clean":"2023-10-09T11:45:27.753080+0000","last_became_active":"2023-10-09T11:45:27.752895+0000","last_became_peered":"2023-10-09T11:45:27.752895+0000","last_unstale":"2023-10-09T11:45:27.753080+0000","last_undegraded":"2023-10-09T11:45:27.753080+0000","last_fullsized":"2023-10-09T11:45:27.753080+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755559+0000","last_change":"2023-10-09T11:45:27.755559+0000","last_active":"2023-10-09T11:45:27.755559+0000","last_peered":"2023-10-09T11:45:27.755559+0000","last_clean":"2023-10-09T11:45:27.755559+0000","last_became_active":"2023-10-09T11:45:27.755318+0000","last_became_peered":"2023-10-09T11:45:27.755318+0000","last_unstale":"2023-10-09T11:45:27.755559+0000","last_undegraded":"2023-10-09T11:45:27.755559+0000","last_fullsized":"2023-10-09T11:45:27.755559+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:32:44.636476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756045+0000","last_change":"2023-10-09T11:45:27.756045+0000","last_active":"2023-10-09T11:45:27.756045+0000","last_peered":"2023-10-09T11:45:27.756045+0000","last_clean":"2023-10-09T11:45:27.756045+0000","last_became_active":"2023-10-09T11:45:27.754630+0000","last_became_peered":"2023-10-09T11:45:27.754630+0000","last_unstale":"2023-10-09T11:45:27.756045+0000","last_undegraded":"2023-10-09T11:45:27.756045+0000","last_fullsized":"2023-10-09T11:45:27.756045+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:09:38.793854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745981+0000","last_change":"2023-10-09T11:45:27.745981+0000","last_active":"2023-10-09T11:45:27.745981+0000","last_peered":"2023-10-09T11:45:27.745981+0000","last_clean":"2023-10-09T11:45:27.745981+0000","last_became_active":"2023-10-09T11:45:27.745734+0000","last_became_peered":"2023-10-09T11:45:27.745734+0000","last_unstale":"2023-10-09T11:45:27.745981+0000","last_undegraded":"2023-10-09T11:45:27.745981+0000","last_fullsized":"2023-10-09T11:45:27.745981+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:50.504984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755125+0000","last_change":"2023-10-09T11:45:27.755125+0000","last_active":"2023-10-09T11:45:27.755125+0000","last_peered":"2023-10-09T11:45:27.755125+0000","last_clean":"2023-10-09T11:45:27.755125+0000","last_became_active":"2023-10-09T11:45:27.753233+0000","last_became_peered":"2023-10-09T11:45:27.753233+0000","last_unstale":"2023-10-09T11:45:27.755125+0000","last_undegraded":"2023-10-09T11:45:27.755125+0000","last_fullsized":"2023-10-09T11:45:27.755125+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:47:30.758861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759174+0000","last_change":"2023-10-09T11:45:27.759174+0000","last_active":"2023-10-09T11:45:27.759174+0000","last_peered":"2023-10-09T11:45:27.759174+0000","last_clean":"2023-10-09T11:45:27.759174+0000","last_became_active":"2023-10-09T11:45:27.758208+0000","last_became_peered":"2023-10-09T11:45:27.758208+0000","last_unstale":"2023-10-09T11:45:27.759174+0000","last_undegraded":"2023-10-09T11:45:27.759174+0000","last_fullsized":"2023-10-09T11:45:27.759174+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:34.563672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754579+0000","last_change":"2023-10-09T11:45:27.754579+0000","last_active":"2023-10-09T11:45:27.754579+0000","last_peered":"2023-10-09T11:45:27.754579+0000","last_clean":"2023-10-09T11:45:27.754579+0000","last_became_active":"2023-10-09T11:45:27.754246+0000","last_became_peered":"2023-10-09T11:45:27.754246+0000","last_unstale":"2023-10-09T11:45:27.754579+0000","last_undegraded":"2023-10-09T11:45:27.754579+0000","last_fullsized":"2023-10-09T11:45:27.754579+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:41:29.237199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754909+0000","last_change":"2023-10-09T11:45:27.754909+0000","last_active":"2023-10-09T11:45:27.754909+0000","last_peered":"2023-10-09T11:45:27.754909+0000","last_clean":"2023-10-09T11:45:27.754909+0000","last_became_active":"2023-10-09T11:45:27.754180+0000","last_became_peered":"2023-10-09T11:45:27.754180+0000","last_unstale":"2023-10-09T11:45:27.754909+0000","last_undegraded":"2023-10-09T11:45:27.754909+0000","last_fullsized":"2023-10-09T11:45:27.754909+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:08:05.011315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759986+0000","last_change":"2023-10-09T11:45:27.759986+0000","last_active":"2023-10-09T11:45:27.759986+0000","last_peered":"2023-10-09T11:45:27.759986+0000","last_clean":"2023-10-09T11:45:27.759986+0000","last_became_active":"2023-10-09T11:45:27.759797+0000","last_became_peered":"2023-10-09T11:45:27.759797+0000","last_unstale":"2023-10-09T11:45:27.759986+0000","last_undegraded":"2023-10-09T11:45:27.759986+0000","last_fullsized":"2023-10-09T11:45:27.759986+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:24.012512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760432+0000","last_change":"2023-10-09T11:45:27.760432+0000","last_active":"2023-10-09T11:45:27.760432+0000","last_peered":"2023-10-09T11:45:27.760432+0000","last_clean":"2023-10-09T11:45:27.760432+0000","last_became_active":"2023-10-09T11:45:27.760198+0000","last_became_peered":"2023-10-09T11:45:27.760198+0000","last_unstale":"2023-10-09T11:45:27.760432+0000","last_undegraded":"2023-10-09T11:45:27.760432+0000","last_fullsized":"2023-10-09T11:45:27.760432+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:37:35.811082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759432+0000","last_change":"2023-10-09T11:45:27.759432+0000","last_active":"2023-10-09T11:45:27.759432+0000","last_peered":"2023-10-09T11:45:27.759432+0000","last_clean":"2023-10-09T11:45:27.759432+0000","last_became_active":"2023-10-09T11:45:27.759190+0000","last_became_peered":"2023-10-09T11:45:27.759190+0000","last_unstale":"2023-10-09T11:45:27.759432+0000","last_undegraded":"2023-10-09T11:45:27.759432+0000","last_fullsized":"2023-10-09T11:45:27.759432+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:07.449542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751078+0000","last_change":"2023-10-09T11:45:27.751078+0000","last_active":"2023-10-09T11:45:27.751078+0000","last_peered":"2023-10-09T11:45:27.751078+0000","last_clean":"2023-10-09T11:45:27.751078+0000","last_became_active":"2023-10-09T11:45:27.750857+0000","last_became_peered":"2023-10-09T11:45:27.750857+0000","last_unstale":"2023-10-09T11:45:27.751078+0000","last_undegraded":"2023-10-09T11:45:27.751078+0000","last_fullsized":"2023-10-09T11:45:27.751078+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:26:34.580175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759421+0000","last_change":"2023-10-09T11:45:27.759421+0000","last_active":"2023-10-09T11:45:27.759421+0000","last_peered":"2023-10-09T11:45:27.759421+0000","last_clean":"2023-10-09T11:45:27.759421+0000","last_became_active":"2023-10-09T11:45:27.759239+0000","last_became_peered":"2023-10-09T11:45:27.759239+0000","last_unstale":"2023-10-09T11:45:27.759421+0000","last_undegraded":"2023-10-09T11:45:27.759421+0000","last_fullsized":"2023-10-09T11:45:27.759421+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:49.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754976+0000","last_change":"2023-10-09T11:45:27.754976+0000","last_active":"2023-10-09T11:45:27.754976+0000","last_peered":"2023-10-09T11:45:27.754976+0000","last_clean":"2023-10-09T11:45:27.754976+0000","last_became_active":"2023-10-09T11:45:27.754434+0000","last_became_peered":"2023-10-09T11:45:27.754434+0000","last_unstale":"2023-10-09T11:45:27.754976+0000","last_undegraded":"2023-10-09T11:45:27.754976+0000","last_fullsized":"2023-10-09T11:45:27.754976+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:49.927950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759386+0000","last_change":"2023-10-09T11:45:27.759386+0000","last_active":"2023-10-09T11:45:27.759386+0000","last_peered":"2023-10-09T11:45:27.759386+0000","last_clean":"2023-10-09T11:45:27.759386+0000","last_became_active":"2023-10-09T11:45:27.758571+0000","last_became_peered":"2023-10-09T11:45:27.758571+0000","last_unstale":"2023-10-09T11:45:27.759386+0000","last_undegraded":"2023-10-09T11:45:27.759386+0000","last_fullsized":"2023-10-09T11:45:27.759386+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:26:35.590061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"161'4","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979135+0000","last_change":"2023-10-09T11:45:26.735935+0000","last_active":"2023-10-09T11:45:27.979135+0000","last_peered":"2023-10-09T11:45:27.979135+0000","last_clean":"2023-10-09T11:45:27.979135+0000","last_became_active":"2023-10-09T11:45:26.735628+0000","last_became_peered":"2023-10-09T11:45:26.735628+0000","last_unstale":"2023-10-09T11:45:27.979135+0000","last_undegraded":"2023-10-09T11:45:27.979135+0000","last_fullsized":"2023-10-09T11:45:27.979135+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:48.755707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753640+0000","last_change":"2023-10-09T11:45:27.753640+0000","last_active":"2023-10-09T11:45:27.753640+0000","last_peered":"2023-10-09T11:45:27.753640+0000","last_clean":"2023-10-09T11:45:27.753640+0000","last_became_active":"2023-10-09T11:45:27.753410+0000","last_became_peered":"2023-10-09T11:45:27.753410+0000","last_unstale":"2023-10-09T11:45:27.753640+0000","last_undegraded":"2023-10-09T11:45:27.753640+0000","last_fullsized":"2023-10-09T11:45:27.753640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:59.700540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.742162+0000","last_change":"2023-10-09T11:45:26.739250+0000","last_active":"2023-10-09T11:45:27.742162+0000","last_peered":"2023-10-09T11:45:27.742162+0000","last_clean":"2023-10-09T11:45:27.742162+0000","last_became_active":"2023-10-09T11:45:26.738727+0000","last_became_peered":"2023-10-09T11:45:26.738727+0000","last_unstale":"2023-10-09T11:45:27.742162+0000","last_undegraded":"2023-10-09T11:45:27.742162+0000","last_fullsized":"2023-10-09T11:45:27.742162+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:54.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754742+0000","last_change":"2023-10-09T11:45:27.754742+0000","last_active":"2023-10-09T11:45:27.754742+0000","last_peered":"2023-10-09T11:45:27.754742+0000","last_clean":"2023-10-09T11:45:27.754742+0000","last_became_active":"2023-10-09T11:45:27.753427+0000","last_became_peered":"2023-10-09T11:45:27.753427+0000","last_unstale":"2023-10-09T11:45:27.754742+0000","last_undegraded":"2023-10-09T11:45:27.754742+0000","last_fullsized":"2023-10-09T11:45:27.754742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.978799+0000","last_change":"2023-10-09T11:45:26.729598+0000","last_active":"2023-10-09T11:45:27.978799+0000","last_peered":"2023-10-09T11:45:27.978799+0000","last_clean":"2023-10-09T11:45:27.978799+0000","last_became_active":"2023-10-09T11:45:26.729371+0000","last_became_peered":"2023-10-09T11:45:26.729371+0000","last_unstale":"2023-10-09T11:45:27.978799+0000","last_undegraded":"2023-10-09T11:45:27.978799+0000","last_fullsized":"2023-10-09T11:45:27.978799+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:22.988046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757642+0000","last_change":"2023-10-09T11:45:27.757642+0000","last_active":"2023-10-09T11:45:27.757642+0000","last_peered":"2023-10-09T11:45:27.757642+0000","last_clean":"2023-10-09T11:45:27.757642+0000","last_became_active":"2023-10-09T11:45:27.757404+0000","last_became_peered":"2023-10-09T11:45:27.757404+0000","last_unstale":"2023-10-09T11:45:27.757642+0000","last_undegraded":"2023-10-09T11:45:27.757642+0000","last_fullsized":"2023-10-09T11:45:27.757642+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:43.346275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979269+0000","last_change":"2023-10-09T11:45:26.736117+0000","last_active":"2023-10-09T11:45:27.979269+0000","last_peered":"2023-10-09T11:45:27.979269+0000","last_clean":"2023-10-09T11:45:27.979269+0000","last_became_active":"2023-10-09T11:45:26.735903+0000","last_became_peered":"2023-10-09T11:45:26.735903+0000","last_unstale":"2023-10-09T11:45:27.979269+0000","last_undegraded":"2023-10-09T11:45:27.979269+0000","last_fullsized":"2023-10-09T11:45:27.979269+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:27.617252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760595+0000","last_change":"2023-10-09T11:45:27.760595+0000","last_active":"2023-10-09T11:45:27.760595+0000","last_peered":"2023-10-09T11:45:27.760595+0000","last_clean":"2023-10-09T11:45:27.760595+0000","last_became_active":"2023-10-09T11:45:27.760317+0000","last_became_peered":"2023-10-09T11:45:27.760317+0000","last_unstale":"2023-10-09T11:45:27.760595+0000","last_undegraded":"2023-10-09T11:45:27.760595+0000","last_fullsized":"2023-10-09T11:45:27.760595+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:32:19.010517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.749470+0000","last_change":"2023-10-09T11:45:26.735350+0000","last_active":"2023-10-09T11:45:27.749470+0000","last_peered":"2023-10-09T11:45:27.749470+0000","last_clean":"2023-10-09T11:45:27.749470+0000","last_became_active":"2023-10-09T11:45:26.735051+0000","last_became_peered":"2023-10-09T11:45:26.735051+0000","last_unstale":"2023-10-09T11:45:27.749470+0000","last_undegraded":"2023-10-09T11:45:27.749470+0000","last_fullsized":"2023-10-09T11:45:27.749470+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:28.466118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.760358+0000","last_change":"2023-10-09T11:45:27.760358+0000","last_active":"2023-10-09T11:45:27.760358+0000","last_peered":"2023-10-09T11:45:27.760358+0000","last_clean":"2023-10-09T11:45:27.760358+0000","last_became_active":"2023-10-09T11:45:27.760117+0000","last_became_peered":"2023-10-09T11:45:27.760117+0000","last_unstale":"2023-10-09T11:45:27.760358+0000","last_undegraded":"2023-10-09T11:45:27.760358+0000","last_fullsized":"2023-10-09T11:45:27.760358+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:38.255520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745129+0000","last_change":"2023-10-09T11:45:26.736256+0000","last_active":"2023-10-09T11:45:27.745129+0000","last_peered":"2023-10-09T11:45:27.745129+0000","last_clean":"2023-10-09T11:45:27.745129+0000","last_became_active":"2023-10-09T11:45:26.736057+0000","last_became_peered":"2023-10-09T11:45:26.736057+0000","last_unstale":"2023-10-09T11:45:27.745129+0000","last_undegraded":"2023-10-09T11:45:27.745129+0000","last_fullsized":"2023-10-09T11:45:27.745129+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:25:41.099808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745205+0000","last_change":"2023-10-09T11:45:27.745205+0000","last_active":"2023-10-09T11:45:27.745205+0000","last_peered":"2023-10-09T11:45:27.745205+0000","last_clean":"2023-10-09T11:45:27.745205+0000","last_became_active":"2023-10-09T11:45:27.744782+0000","last_became_peered":"2023-10-09T11:45:27.744782+0000","last_unstale":"2023-10-09T11:45:27.745205+0000","last_undegraded":"2023-10-09T11:45:27.745205+0000","last_fullsized":"2023-10-09T11:45:27.745205+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:53:56.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.740669+0000","last_change":"2023-10-09T11:45:26.740612+0000","last_active":"2023-10-09T11:45:26.740669+0000","last_peered":"2023-10-09T11:45:26.740669+0000","last_clean":"2023-10-09T11:45:26.740669+0000","last_became_active":"2023-10-09T11:45:26.736429+0000","last_became_peered":"2023-10-09T11:45:26.736429+0000","last_unstale":"2023-10-09T11:45:26.740669+0000","last_undegraded":"2023-10-09T11:45:26.740669+0000","last_fullsized":"2023-10-09T11:45:26.740669+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:40.118076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750838+0000","last_change":"2023-10-09T11:45:27.750838+0000","last_active":"2023-10-09T11:45:27.750838+0000","last_peered":"2023-10-09T11:45:27.750838+0000","last_clean":"2023-10-09T11:45:27.750838+0000","last_became_active":"2023-10-09T11:45:27.750568+0000","last_became_peered":"2023-10-09T11:45:27.750568+0000","last_unstale":"2023-10-09T11:45:27.750838+0000","last_undegraded":"2023-10-09T11:45:27.750838+0000","last_fullsized":"2023-10-09T11:45:27.750838+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:12:42.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737701+0000","last_change":"2023-10-09T11:45:26.736732+0000","last_active":"2023-10-09T11:45:26.737701+0000","last_peered":"2023-10-09T11:45:26.737701+0000","last_clean":"2023-10-09T11:45:26.737701+0000","last_became_active":"2023-10-09T11:45:26.736502+0000","last_became_peered":"2023-10-09T11:45:26.736502+0000","last_unstale":"2023-10-09T11:45:26.737701+0000","last_undegraded":"2023-10-09T11:45:26.737701+0000","last_fullsized":"2023-10-09T11:45:26.737701+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:10.287738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.752727+0000","last_change":"2023-10-09T11:45:27.752727+0000","last_active":"2023-10-09T11:45:27.752727+0000","last_peered":"2023-10-09T11:45:27.752727+0000","last_clean":"2023-10-09T11:45:27.752727+0000","last_became_active":"2023-10-09T11:45:27.752504+0000","last_became_peered":"2023-10-09T11:45:27.752504+0000","last_unstale":"2023-10-09T11:45:27.752727+0000","last_undegraded":"2023-10-09T11:45:27.752727+0000","last_fullsized":"2023-10-09T11:45:27.752727+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:35:23.992532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.738331+0000","last_change":"2023-10-09T11:45:26.737901+0000","last_active":"2023-10-09T11:45:26.738331+0000","last_peered":"2023-10-09T11:45:26.738331+0000","last_clean":"2023-10-09T11:45:26.738331+0000","last_became_active":"2023-10-09T11:45:26.737624+0000","last_became_peered":"2023-10-09T11:45:26.737624+0000","last_unstale":"2023-10-09T11:45:26.738331+0000","last_undegraded":"2023-10-09T11:45:26.738331+0000","last_fullsized":"2023-10-09T11:45:26.738331+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:22:42.416462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753526+0000","last_change":"2023-10-09T11:45:27.753526+0000","last_active":"2023-10-09T11:45:27.753526+0000","last_peered":"2023-10-09T11:45:27.753526+0000","last_clean":"2023-10-09T11:45:27.753526+0000","last_became_active":"2023-10-09T11:45:27.753304+0000","last_became_peered":"2023-10-09T11:45:27.753304+0000","last_unstale":"2023-10-09T11:45:27.753526+0000","last_undegraded":"2023-10-09T11:45:27.753526+0000","last_fullsized":"2023-10-09T11:45:27.753526+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:11:57.752390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.735598+0000","last_change":"2023-10-09T11:45:26.735206+0000","last_active":"2023-10-09T11:45:26.735598+0000","last_peered":"2023-10-09T11:45:26.735598+0000","last_clean":"2023-10-09T11:45:26.735598+0000","last_became_active":"2023-10-09T11:45:26.734392+0000","last_became_peered":"2023-10-09T11:45:26.734392+0000","last_unstale":"2023-10-09T11:45:26.735598+0000","last_undegraded":"2023-10-09T11:45:26.735598+0000","last_fullsized":"2023-10-09T11:45:26.735598+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:22:20.411604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757640+0000","last_change":"2023-10-09T11:45:27.757640+0000","last_active":"2023-10-09T11:45:27.757640+0000","last_peered":"2023-10-09T11:45:27.757640+0000","last_clean":"2023-10-09T11:45:27.757640+0000","last_became_active":"2023-10-09T11:45:27.757410+0000","last_became_peered":"2023-10-09T11:45:27.757410+0000","last_unstale":"2023-10-09T11:45:27.757640+0000","last_undegraded":"2023-10-09T11:45:27.757640+0000","last_fullsized":"2023-10-09T11:45:27.757640+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:23.362805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"161'6","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.981295+0000","last_change":"2023-10-09T11:45:26.731549+0000","last_active":"2023-10-09T11:45:27.981295+0000","last_peered":"2023-10-09T11:45:27.981295+0000","last_clean":"2023-10-09T11:45:27.981295+0000","last_became_active":"2023-10-09T11:45:26.731317+0000","last_became_peered":"2023-10-09T11:45:26.731317+0000","last_unstale":"2023-10-09T11:45:27.981295+0000","last_undegraded":"2023-10-09T11:45:27.981295+0000","last_fullsized":"2023-10-09T11:45:27.981295+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:39.425210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757380+0000","last_change":"2023-10-09T11:45:27.757380+0000","last_active":"2023-10-09T11:45:27.757380+0000","last_peered":"2023-10-09T11:45:27.757380+0000","last_clean":"2023-10-09T11:45:27.757380+0000","last_became_active":"2023-10-09T11:45:27.757146+0000","last_became_peered":"2023-10-09T11:45:27.757146+0000","last_unstale":"2023-10-09T11:45:27.757380+0000","last_undegraded":"2023-10-09T11:45:27.757380+0000","last_fullsized":"2023-10-09T11:45:27.757380+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:27.868845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.980111+0000","last_change":"2023-10-09T11:45:26.734884+0000","last_active":"2023-10-09T11:45:27.980111+0000","last_peered":"2023-10-09T11:45:27.980111+0000","last_clean":"2023-10-09T11:45:27.980111+0000","last_became_active":"2023-10-09T11:45:26.734656+0000","last_became_peered":"2023-10-09T11:45:26.734656+0000","last_unstale":"2023-10-09T11:45:27.980111+0000","last_undegraded":"2023-10-09T11:45:27.980111+0000","last_fullsized":"2023-10-09T11:45:27.980111+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:16.359333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.751684+0000","last_change":"2023-10-09T11:45:27.751684+0000","last_active":"2023-10-09T11:45:27.751684+0000","last_peered":"2023-10-09T11:45:27.751684+0000","last_clean":"2023-10-09T11:45:27.751684+0000","last_became_active":"2023-10-09T11:45:27.751456+0000","last_became_peered":"2023-10-09T11:45:27.751456+0000","last_unstale":"2023-10-09T11:45:27.751684+0000","last_undegraded":"2023-10-09T11:45:27.751684+0000","last_fullsized":"2023-10-09T11:45:27.751684+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:29.802133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737976+0000","last_change":"2023-10-09T11:45:26.737913+0000","last_active":"2023-10-09T11:45:26.737976+0000","last_peered":"2023-10-09T11:45:26.737976+0000","last_clean":"2023-10-09T11:45:26.737976+0000","last_became_active":"2023-10-09T11:45:26.737482+0000","last_became_peered":"2023-10-09T11:45:26.737482+0000","last_unstale":"2023-10-09T11:45:26.737976+0000","last_undegraded":"2023-10-09T11:45:26.737976+0000","last_fullsized":"2023-10-09T11:45:26.737976+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:12.998682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754488+0000","last_change":"2023-10-09T11:45:27.754488+0000","last_active":"2023-10-09T11:45:27.754488+0000","last_peered":"2023-10-09T11:45:27.754488+0000","last_clean":"2023-10-09T11:45:27.754488+0000","last_became_active":"2023-10-09T11:45:27.753613+0000","last_became_peered":"2023-10-09T11:45:27.753613+0000","last_unstale":"2023-10-09T11:45:27.754488+0000","last_undegraded":"2023-10-09T11:45:27.754488+0000","last_fullsized":"2023-10-09T11:45:27.754488+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.734071+0000","last_change":"2023-10-09T11:45:26.733804+0000","last_active":"2023-10-09T11:45:26.734071+0000","last_peered":"2023-10-09T11:45:26.734071+0000","last_clean":"2023-10-09T11:45:26.734071+0000","last_became_active":"2023-10-09T11:45:26.733578+0000","last_became_peered":"2023-10-09T11:45:26.733578+0000","last_unstale":"2023-10-09T11:45:26.734071+0000","last_undegraded":"2023-10-09T11:45:26.734071+0000","last_fullsized":"2023-10-09T11:45:26.734071+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:40:44.581376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756305+0000","last_change":"2023-10-09T11:45:27.756305+0000","last_active":"2023-10-09T11:45:27.756305+0000","last_peered":"2023-10-09T11:45:27.756305+0000","last_clean":"2023-10-09T11:45:27.756305+0000","last_became_active":"2023-10-09T11:45:27.755425+0000","last_became_peered":"2023-10-09T11:45:27.755425+0000","last_unstale":"2023-10-09T11:45:27.756305+0000","last_undegraded":"2023-10-09T11:45:27.756305+0000","last_fullsized":"2023-10-09T11:45:27.756305+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:52:11.896455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"161'8","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.981350+0000","last_change":"2023-10-09T11:45:26.740195+0000","last_active":"2023-10-09T11:45:27.981350+0000","last_peered":"2023-10-09T11:45:27.981350+0000","last_clean":"2023-10-09T11:45:27.981350+0000","last_became_active":"2023-10-09T11:45:26.739945+0000","last_became_peered":"2023-10-09T11:45:26.739945+0000","last_unstale":"2023-10-09T11:45:27.981350+0000","last_undegraded":"2023-10-09T11:45:27.981350+0000","last_fullsized":"2023-10-09T11:45:27.981350+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:47:23.462674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756835+0000","last_change":"2023-10-09T11:45:27.756835+0000","last_active":"2023-10-09T11:45:27.756835+0000","last_peered":"2023-10-09T11:45:27.756835+0000","last_clean":"2023-10-09T11:45:27.756835+0000","last_became_active":"2023-10-09T11:45:27.756151+0000","last_became_peered":"2023-10-09T11:45:27.756151+0000","last_unstale":"2023-10-09T11:45:27.756835+0000","last_undegraded":"2023-10-09T11:45:27.756835+0000","last_fullsized":"2023-10-09T11:45:27.756835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:31:28.293704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.743840+0000","last_change":"2023-10-09T11:45:26.734087+0000","last_active":"2023-10-09T11:45:27.743840+0000","last_peered":"2023-10-09T11:45:27.743840+0000","last_clean":"2023-10-09T11:45:27.743840+0000","last_became_active":"2023-10-09T11:45:26.733597+0000","last_became_peered":"2023-10-09T11:45:26.733597+0000","last_unstale":"2023-10-09T11:45:27.743840+0000","last_undegraded":"2023-10-09T11:45:27.743840+0000","last_fullsized":"2023-10-09T11:45:27.743840+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:27.688160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758549+0000","last_change":"2023-10-09T11:45:27.758549+0000","last_active":"2023-10-09T11:45:27.758549+0000","last_peered":"2023-10-09T11:45:27.758549+0000","last_clean":"2023-10-09T11:45:27.758549+0000","last_became_active":"2023-10-09T11:45:27.758072+0000","last_became_peered":"2023-10-09T11:45:27.758072+0000","last_unstale":"2023-10-09T11:45:27.758549+0000","last_undegraded":"2023-10-09T11:45:27.758549+0000","last_fullsized":"2023-10-09T11:45:27.758549+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:25:43.266465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979761+0000","last_change":"2023-10-09T11:45:26.735773+0000","last_active":"2023-10-09T11:45:27.979761+0000","last_peered":"2023-10-09T11:45:27.979761+0000","last_clean":"2023-10-09T11:45:27.979761+0000","last_became_active":"2023-10-09T11:45:26.735313+0000","last_became_peered":"2023-10-09T11:45:26.735313+0000","last_unstale":"2023-10-09T11:45:27.979761+0000","last_undegraded":"2023-10-09T11:45:27.979761+0000","last_fullsized":"2023-10-09T11:45:27.979761+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:57:48.755707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756603+0000","last_change":"2023-10-09T11:45:27.756603+0000","last_active":"2023-10-09T11:45:27.756603+0000","last_peered":"2023-10-09T11:45:27.756603+0000","last_clean":"2023-10-09T11:45:27.756603+0000","last_became_active":"2023-10-09T11:45:27.756069+0000","last_became_peered":"2023-10-09T11:45:27.756069+0000","last_unstale":"2023-10-09T11:45:27.756603+0000","last_undegraded":"2023-10-09T11:45:27.756603+0000","last_fullsized":"2023-10-09T11:45:27.756603+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.749225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"161'1","reported_seq":10,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750541+0000","last_change":"2023-10-09T11:45:26.739801+0000","last_active":"2023-10-09T11:45:27.750541+0000","last_peered":"2023-10-09T11:45:27.750541+0000","last_clean":"2023-10-09T11:45:27.750541+0000","last_became_active":"2023-10-09T11:45:26.736606+0000","last_became_peered":"2023-10-09T11:45:26.736606+0000","last_unstale":"2023-10-09T11:45:27.750541+0000","last_undegraded":"2023-10-09T11:45:27.750541+0000","last_fullsized":"2023-10-09T11:45:27.750541+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:16:24.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.759797+0000","last_change":"2023-10-09T11:45:27.759797+0000","last_active":"2023-10-09T11:45:27.759797+0000","last_peered":"2023-10-09T11:45:27.759797+0000","last_clean":"2023-10-09T11:45:27.759797+0000","last_became_active":"2023-10-09T11:45:27.759275+0000","last_became_peered":"2023-10-09T11:45:27.759275+0000","last_unstale":"2023-10-09T11:45:27.759797+0000","last_undegraded":"2023-10-09T11:45:27.759797+0000","last_fullsized":"2023-10-09T11:45:27.759797+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:28.621738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732245+0000","last_change":"2023-10-09T11:45:26.732169+0000","last_active":"2023-10-09T11:45:26.732245+0000","last_peered":"2023-10-09T11:45:26.732245+0000","last_clean":"2023-10-09T11:45:26.732245+0000","last_became_active":"2023-10-09T11:45:26.731941+0000","last_became_peered":"2023-10-09T11:45:26.731941+0000","last_unstale":"2023-10-09T11:45:26.732245+0000","last_undegraded":"2023-10-09T11:45:26.732245+0000","last_fullsized":"2023-10-09T11:45:26.732245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:40:49.371148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754149+0000","last_change":"2023-10-09T11:45:27.754149+0000","last_active":"2023-10-09T11:45:27.754149+0000","last_peered":"2023-10-09T11:45:27.754149+0000","last_clean":"2023-10-09T11:45:27.754149+0000","last_became_active":"2023-10-09T11:45:27.753297+0000","last_became_peered":"2023-10-09T11:45:27.753297+0000","last_unstale":"2023-10-09T11:45:27.754149+0000","last_undegraded":"2023-10-09T11:45:27.754149+0000","last_fullsized":"2023-10-09T11:45:27.754149+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.020373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979547+0000","last_change":"2023-10-09T11:45:26.739209+0000","last_active":"2023-10-09T11:45:27.979547+0000","last_peered":"2023-10-09T11:45:27.979547+0000","last_clean":"2023-10-09T11:45:27.979547+0000","last_became_active":"2023-10-09T11:45:26.738984+0000","last_became_peered":"2023-10-09T11:45:26.738984+0000","last_unstale":"2023-10-09T11:45:27.979547+0000","last_undegraded":"2023-10-09T11:45:27.979547+0000","last_fullsized":"2023-10-09T11:45:27.979547+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:23.142528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756776+0000","last_change":"2023-10-09T11:45:27.756776+0000","last_active":"2023-10-09T11:45:27.756776+0000","last_peered":"2023-10-09T11:45:27.756776+0000","last_clean":"2023-10-09T11:45:27.756776+0000","last_became_active":"2023-10-09T11:45:27.756557+0000","last_became_peered":"2023-10-09T11:45:27.756557+0000","last_unstale":"2023-10-09T11:45:27.756776+0000","last_undegraded":"2023-10-09T11:45:27.756776+0000","last_fullsized":"2023-10-09T11:45:27.756776+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737314+0000","last_change":"2023-10-09T11:45:26.737235+0000","last_active":"2023-10-09T11:45:26.737314+0000","last_peered":"2023-10-09T11:45:26.737314+0000","last_clean":"2023-10-09T11:45:26.737314+0000","last_became_active":"2023-10-09T11:45:26.736969+0000","last_became_peered":"2023-10-09T11:45:26.736969+0000","last_unstale":"2023-10-09T11:45:26.737314+0000","last_undegraded":"2023-10-09T11:45:26.737314+0000","last_fullsized":"2023-10-09T11:45:26.737314+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:10:54.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753495+0000","last_change":"2023-10-09T11:45:27.753495+0000","last_active":"2023-10-09T11:45:27.753495+0000","last_peered":"2023-10-09T11:45:27.753495+0000","last_clean":"2023-10-09T11:45:27.753495+0000","last_became_active":"2023-10-09T11:45:27.753257+0000","last_became_peered":"2023-10-09T11:45:27.753257+0000","last_unstale":"2023-10-09T11:45:27.753495+0000","last_undegraded":"2023-10-09T11:45:27.753495+0000","last_fullsized":"2023-10-09T11:45:27.753495+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:12.566114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.738409+0000","last_change":"2023-10-09T11:45:26.738351+0000","last_active":"2023-10-09T11:45:26.738409+0000","last_peered":"2023-10-09T11:45:26.738409+0000","last_clean":"2023-10-09T11:45:26.738409+0000","last_became_active":"2023-10-09T11:45:26.738101+0000","last_became_peered":"2023-10-09T11:45:26.738101+0000","last_unstale":"2023-10-09T11:45:26.738409+0000","last_undegraded":"2023-10-09T11:45:26.738409+0000","last_fullsized":"2023-10-09T11:45:26.738409+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:50.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.753032+0000","last_change":"2023-10-09T11:45:27.753032+0000","last_active":"2023-10-09T11:45:27.753032+0000","last_peered":"2023-10-09T11:45:27.753032+0000","last_clean":"2023-10-09T11:45:27.753032+0000","last_became_active":"2023-10-09T11:45:27.752824+0000","last_became_peered":"2023-10-09T11:45:27.752824+0000","last_unstale":"2023-10-09T11:45:27.753032+0000","last_undegraded":"2023-10-09T11:45:27.753032+0000","last_fullsized":"2023-10-09T11:45:27.753032+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:00.845949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737727+0000","last_change":"2023-10-09T11:45:26.736371+0000","last_active":"2023-10-09T11:45:26.737727+0000","last_peered":"2023-10-09T11:45:26.737727+0000","last_clean":"2023-10-09T11:45:26.737727+0000","last_became_active":"2023-10-09T11:45:26.734475+0000","last_became_peered":"2023-10-09T11:45:26.734475+0000","last_unstale":"2023-10-09T11:45:26.737727+0000","last_undegraded":"2023-10-09T11:45:26.737727+0000","last_fullsized":"2023-10-09T11:45:26.737727+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:06.445057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754337+0000","last_change":"2023-10-09T11:45:27.754337+0000","last_active":"2023-10-09T11:45:27.754337+0000","last_peered":"2023-10-09T11:45:27.754337+0000","last_clean":"2023-10-09T11:45:27.754337+0000","last_became_active":"2023-10-09T11:45:27.753292+0000","last_became_peered":"2023-10-09T11:45:27.753292+0000","last_unstale":"2023-10-09T11:45:27.754337+0000","last_undegraded":"2023-10-09T11:45:27.754337+0000","last_fullsized":"2023-10-09T11:45:27.754337+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"161'2","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.978286+0000","last_change":"2023-10-09T11:45:26.735378+0000","last_active":"2023-10-09T11:45:27.978286+0000","last_peered":"2023-10-09T11:45:27.978286+0000","last_clean":"2023-10-09T11:45:27.978286+0000","last_became_active":"2023-10-09T11:45:26.734697+0000","last_became_peered":"2023-10-09T11:45:26.734697+0000","last_unstale":"2023-10-09T11:45:27.978286+0000","last_undegraded":"2023-10-09T11:45:27.978286+0000","last_fullsized":"2023-10-09T11:45:27.978286+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:39.425210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.756456+0000","last_change":"2023-10-09T11:45:27.756456+0000","last_active":"2023-10-09T11:45:27.756456+0000","last_peered":"2023-10-09T11:45:27.756456+0000","last_clean":"2023-10-09T11:45:27.756456+0000","last_became_active":"2023-10-09T11:45:27.755742+0000","last_became_peered":"2023-10-09T11:45:27.755742+0000","last_unstale":"2023-10-09T11:45:27.756456+0000","last_undegraded":"2023-10-09T11:45:27.756456+0000","last_fullsized":"2023-10-09T11:45:27.756456+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:49:46.762088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.736928+0000","last_change":"2023-10-09T11:45:26.736863+0000","last_active":"2023-10-09T11:45:26.736928+0000","last_peered":"2023-10-09T11:45:26.736928+0000","last_clean":"2023-10-09T11:45:26.736928+0000","last_became_active":"2023-10-09T11:45:26.736486+0000","last_became_peered":"2023-10-09T11:45:26.736486+0000","last_unstale":"2023-10-09T11:45:26.736928+0000","last_undegraded":"2023-10-09T11:45:26.736928+0000","last_fullsized":"2023-10-09T11:45:26.736928+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:58.980483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.745020+0000","last_change":"2023-10-09T11:45:27.745020+0000","last_active":"2023-10-09T11:45:27.745020+0000","last_peered":"2023-10-09T11:45:27.745020+0000","last_clean":"2023-10-09T11:45:27.745020+0000","last_became_active":"2023-10-09T11:45:27.744463+0000","last_became_peered":"2023-10-09T11:45:27.744463+0000","last_unstale":"2023-10-09T11:45:27.745020+0000","last_undegraded":"2023-10-09T11:45:27.745020+0000","last_fullsized":"2023-10-09T11:45:27.745020+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:30:14.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.733486+0000","last_change":"2023-10-09T11:45:26.733419+0000","last_active":"2023-10-09T11:45:26.733486+0000","last_peered":"2023-10-09T11:45:26.733486+0000","last_clean":"2023-10-09T11:45:26.733486+0000","last_became_active":"2023-10-09T11:45:26.733190+0000","last_became_peered":"2023-10-09T11:45:26.733190+0000","last_unstale":"2023-10-09T11:45:26.733486+0000","last_undegraded":"2023-10-09T11:45:26.733486+0000","last_fullsized":"2023-10-09T11:45:26.733486+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:49:40.525370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.750576+0000","last_change":"2023-10-09T11:45:27.750576+0000","last_active":"2023-10-09T11:45:27.750576+0000","last_peered":"2023-10-09T11:45:27.750576+0000","last_clean":"2023-10-09T11:45:27.750576+0000","last_became_active":"2023-10-09T11:45:27.750361+0000","last_became_peered":"2023-10-09T11:45:27.750361+0000","last_unstale":"2023-10-09T11:45:27.750576+0000","last_undegraded":"2023-10-09T11:45:27.750576+0000","last_fullsized":"2023-10-09T11:45:27.750576+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:50:36.739772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.737197+0000","last_change":"2023-10-09T11:45:26.737085+0000","last_active":"2023-10-09T11:45:26.737197+0000","last_peered":"2023-10-09T11:45:26.737197+0000","last_clean":"2023-10-09T11:45:26.737197+0000","last_became_active":"2023-10-09T11:45:26.736793+0000","last_became_peered":"2023-10-09T11:45:26.736793+0000","last_unstale":"2023-10-09T11:45:26.737197+0000","last_undegraded":"2023-10-09T11:45:26.737197+0000","last_fullsized":"2023-10-09T11:45:26.737197+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:20:02.285861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.755147+0000","last_change":"2023-10-09T11:45:27.755147+0000","last_active":"2023-10-09T11:45:27.755147+0000","last_peered":"2023-10-09T11:45:27.755147+0000","last_clean":"2023-10-09T11:45:27.755147+0000","last_became_active":"2023-10-09T11:45:27.754746+0000","last_became_peered":"2023-10-09T11:45:27.754746+0000","last_unstale":"2023-10-09T11:45:27.755147+0000","last_undegraded":"2023-10-09T11:45:27.755147+0000","last_fullsized":"2023-10-09T11:45:27.755147+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:37:34.841490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732235+0000","last_change":"2023-10-09T11:45:26.732159+0000","last_active":"2023-10-09T11:45:26.732235+0000","last_peered":"2023-10-09T11:45:26.732235+0000","last_clean":"2023-10-09T11:45:26.732235+0000","last_became_active":"2023-10-09T11:45:26.731899+0000","last_became_peered":"2023-10-09T11:45:26.731899+0000","last_unstale":"2023-10-09T11:45:26.732235+0000","last_undegraded":"2023-10-09T11:45:26.732235+0000","last_fullsized":"2023-10-09T11:45:26.732235+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:50.653989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.757196+0000","last_change":"2023-10-09T11:45:27.757196+0000","last_active":"2023-10-09T11:45:27.757196+0000","last_peered":"2023-10-09T11:45:27.757196+0000","last_clean":"2023-10-09T11:45:27.757196+0000","last_became_active":"2023-10-09T11:45:27.756980+0000","last_became_peered":"2023-10-09T11:45:27.756980+0000","last_unstale":"2023-10-09T11:45:27.757196+0000","last_undegraded":"2023-10-09T11:45:27.757196+0000","last_fullsized":"2023-10-09T11:45:27.757196+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:37.808055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.735638+0000","last_change":"2023-10-09T11:45:26.735520+0000","last_active":"2023-10-09T11:45:26.735638+0000","last_peered":"2023-10-09T11:45:26.735638+0000","last_clean":"2023-10-09T11:45:26.735638+0000","last_became_active":"2023-10-09T11:45:26.734982+0000","last_became_peered":"2023-10-09T11:45:26.734982+0000","last_unstale":"2023-10-09T11:45:26.735638+0000","last_undegraded":"2023-10-09T11:45:26.735638+0000","last_fullsized":"2023-10-09T11:45:26.735638+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:23.142528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.758804+0000","last_change":"2023-10-09T11:45:27.758804+0000","last_active":"2023-10-09T11:45:27.758804+0000","last_peered":"2023-10-09T11:45:27.758804+0000","last_clean":"2023-10-09T11:45:27.758804+0000","last_became_active":"2023-10-09T11:45:27.757798+0000","last_became_peered":"2023-10-09T11:45:27.757798+0000","last_unstale":"2023-10-09T11:45:27.758804+0000","last_undegraded":"2023-10-09T11:45:27.758804+0000","last_fullsized":"2023-10-09T11:45:27.758804+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:19.564727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.741687+0000","last_change":"2023-10-09T11:45:26.741628+0000","last_active":"2023-10-09T11:45:26.741687+0000","last_peered":"2023-10-09T11:45:26.741687+0000","last_clean":"2023-10-09T11:45:26.741687+0000","last_became_active":"2023-10-09T11:45:26.741399+0000","last_became_peered":"2023-10-09T11:45:26.741399+0000","last_unstale":"2023-10-09T11:45:26.741687+0000","last_undegraded":"2023-10-09T11:45:26.741687+0000","last_fullsized":"2023-10-09T11:45:26.741687+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:07:48.532037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754636+0000","last_change":"2023-10-09T11:45:27.754636+0000","last_active":"2023-10-09T11:45:27.754636+0000","last_peered":"2023-10-09T11:45:27.754636+0000","last_clean":"2023-10-09T11:45:27.754636+0000","last_became_active":"2023-10-09T11:45:27.753936+0000","last_became_peered":"2023-10-09T11:45:27.753936+0000","last_unstale":"2023-10-09T11:45:27.754636+0000","last_undegraded":"2023-10-09T11:45:27.754636+0000","last_fullsized":"2023-10-09T11:45:27.754636+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:11.292224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.739446+0000","last_change":"2023-10-09T11:45:26.739368+0000","last_active":"2023-10-09T11:45:26.739446+0000","last_peered":"2023-10-09T11:45:26.739446+0000","last_clean":"2023-10-09T11:45:26.739446+0000","last_became_active":"2023-10-09T11:45:26.739039+0000","last_became_peered":"2023-10-09T11:45:26.739039+0000","last_unstale":"2023-10-09T11:45:26.739446+0000","last_undegraded":"2023-10-09T11:45:26.739446+0000","last_fullsized":"2023-10-09T11:45:26.739446+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:34:16.936387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.754551+0000","last_change":"2023-10-09T11:45:27.754551+0000","last_active":"2023-10-09T11:45:27.754551+0000","last_peered":"2023-10-09T11:45:27.754551+0000","last_clean":"2023-10-09T11:45:27.754551+0000","last_became_active":"2023-10-09T11:45:27.754303+0000","last_became_peered":"2023-10-09T11:45:27.754303+0000","last_unstale":"2023-10-09T11:45:27.754551+0000","last_undegraded":"2023-10-09T11:45:27.754551+0000","last_fullsized":"2023-10-09T11:45:27.754551+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:26.723456+0000","last_clean_scrub_stamp":"2023-10-09T11:45:26.723456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:30:49.895671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"161'3","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-09T11:45:27.979397+0000","last_change":"2023-10-09T11:45:26.739066+0000","last_active":"2023-10-09T11:45:27.979397+0000","last_peered":"2023-10-09T11:45:27.979397+0000","last_clean":"2023-10-09T11:45:27.979397+0000","last_became_active":"2023-10-09T11:45:26.738612+0000","last_became_peered":"2023-10-09T11:45:26.738612+0000","last_unstale":"2023-10-09T11:45:27.979397+0000","last_undegraded":"2023-10-09T11:45:27.979397+0000","last_fullsized":"2023-10-09T11:45:27.979397+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:45:25.718970+0000","last_clean_scrub_stamp":"2023-10-09T11:45:25.718970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:25.103509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":282,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-09T11:45:26.732505+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:45:26.732505+0000","last_peered":"2023-10-09T11:45:26.732505+0000","last_clean":"2023-10-09T11:45:26.732505+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:45:26.732505+0000","last_undegraded":"2023-10-09T11:45:26.732505+0000","last_fullsized":"2023-10-09T11:45:26.732505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193861,"statfs":{"total":200000000,"available":198513853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.496},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":0.76100000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.437},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.40100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77100000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.45000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":0.76700000000000002,"15min":0.78000000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.56999999999999995},"min":{"1min":0.501,"5min":0.33500000000000002,"15min":0.315},"max":{"1min":0.77800000000000002,"5min":0.78900000000000003,"15min":0.878},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.47399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.54000000000000004,"5min":0.40000000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.77200000000000002,"15min":0.90200000000000002},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":1.048},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.505,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":1.079},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.33100000000000002,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.63600000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.61799999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47699999999999998,"15min":0.46600000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.55500000000000005,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51700000000000002,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65500000000000003,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54200000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.58599999999999997},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.77300000000000002,"15min":3.7589999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.64500000000000002},"min":{"1min":0.371,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.70499999999999996,"5min":4.8230000000000004,"15min":5.298},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":5.3540000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.35999999999999999,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":0.71999999999999997,"5min":0.77400000000000002,"15min":1.6060000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.747,"5min":0.76100000000000001,"15min":1.617},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.64100000000000001},"min":{"1min":0.42599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.84499999999999997,"15min":5.46},"last":0.503},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.66400000000000003},"min":{"1min":0.48499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68300000000000005,"5min":0.74399999999999999,"15min":5.3949999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.34399999999999997,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":0.59299999999999997,"5min":1.617,"15min":1.617},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":5,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46500000000000002,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26100000000000001},"max":{"1min":0.58099999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.375,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.53600000000000003,"15min":0.50900000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.66300000000000003,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.314},"max":{"1min":0.71199999999999997,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36499999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.21299999999999999},"max":{"1min":0.624,"5min":0.624,"15min":1.9370000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.27000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53400000000000003,"5min":0.60899999999999999,"15min":2.004},"last":0.27100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36199999999999999,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":0.47599999999999998,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.41599999999999998},"min":{"1min":0.35299999999999998,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.65100000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.443,"15min":0.46700000000000003},"min":{"1min":0.377,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58299999999999996,"5min":0.68400000000000005,"15min":1.909},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.44900000000000001},"min":{"1min":0.307,"5min":0.29099999999999998,"15min":0.255},"max":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":2.0369999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79200000000000004,"5min":0.872,"15min":1.869},"last":0.59799999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.877,"5min":0.95399999999999996,"15min":1.9790000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.63700000000000001},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":2.1960000000000002},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45300000000000001,"5min":0.41199999999999998,"15min":0.379},"max":{"1min":0.84499999999999997,"5min":0.90900000000000003,"15min":1.952},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63400000000000001,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.41799999999999998,"15min":0.40699999999999997},"max":{"1min":0.85799999999999998,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.629,"15min":0.64200000000000002},"min":{"1min":0.52500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78600000000000003,"5min":0.86299999999999999,"15min":1.782},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.93700000000000006,"15min":1.819},"last":0.75900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1443,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193869,"statfs":{"total":200000000,"available":198522251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45900000000000002,"15min":0.40999999999999998},"min":{"1min":0.23699999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":6.8959999999999999,"15min":6.8959999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.25900000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.57799999999999996,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.436,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.41799999999999998},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61599999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.55500000000000005,"5min":2.4289999999999998,"15min":4.0369999999999999},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.49299999999999999,"15min":0.47399999999999998},"min":{"1min":0.34499999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65200000000000002,"5min":2.194,"15min":2.194},"last":0.30399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.624,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.81299999999999994,"5min":1.508,"15min":1.508},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64900000000000002,"15min":0.67600000000000005},"min":{"1min":0.55600000000000005,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":2.2999999999999998,"15min":3.9340000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.67600000000000005},"min":{"1min":0.498,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89900000000000002,"5min":2.379,"15min":3.976},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.85299999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.55400000000000005,"5min":0.436,"15min":0.435},"max":{"1min":0.88800000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:45:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.498,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":1.593,"15min":1.593},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.55300000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.871,"5min":2.3410000000000002,"15min":4.0060000000000002},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.376,"15min":0.33900000000000002},"min":{"1min":0.27800000000000002,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53000000000000003,"5min":0.65500000000000003,"15min":0.67100000000000004},"last":0.30299999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.35199999999999998},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.22900000000000001},"max":{"1min":0.48999999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.436,"15min":0.67800000000000005},"min":{"1min":0.29799999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.71199999999999997,"15min":11.055},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.40200000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.622,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.40899999999999997},"min":{"1min":0.34000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54100000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.85599999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.78400000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.38100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74299999999999999,"5min":0.999,"15min":0.999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.498,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94599999999999995,"5min":1.097,"15min":1.097},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.51400000000000001,"5min":0.41999999999999998,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":1.03,"15min":1.03},"last":0.36299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.90500000000000003,"5min":1.1279999999999999,"15min":2.2789999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194444,"statfs":{"total":200000000,"available":199111608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35899999999999999,"15min":0.36699999999999999},"min":{"1min":0.26900000000000002,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.54100000000000004,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.214,"15min":0.214},"max":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":1.0960000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.374,"15min":0.375},"min":{"1min":0.308,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.621,"5min":0.621,"15min":1.034},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.433},"min":{"1min":0.35199999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57899999999999996,"5min":0.72899999999999998,"15min":1.335},"last":0.39600000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.64400000000000002,"5min":0.67800000000000005,"15min":1.1200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.28999999999999998},"max":{"1min":0.65600000000000003,"5min":0.82799999999999996,"15min":1.405},"last":0.33400000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.50700000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":0.876,"15min":0.98399999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84399999999999997,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.48999999999999999,"5min":0.40100000000000002,"15min":0.38400000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.387},"last":0.504}]},{"osd":6,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.53300000000000003,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":1.054,"15min":1.3819999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.65100000000000002},"min":{"1min":0.57299999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.4570000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52600000000000002,"5min":0.44600000000000001,"15min":0.40899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55100000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.35199999999999998,"15min":0.27300000000000002},"max":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":7.4210000000000003},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.58599999999999997,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.54800000000000004},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.318},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.40699999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53900000000000003,"15min":0.58799999999999997},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.32600000000000001},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.63900000000000001},"min":{"1min":0.34300000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":5.274},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.72099999999999997},"min":{"1min":0.374,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":7.5460000000000003},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.46700000000000003},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59299999999999997,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.82899999999999996},"last":0.35899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45900000000000002,"15min":0.46500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.318},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48999999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":0.78100000000000003,"15min":0.86099999999999999},"last":0.42299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.35599999999999998,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.68899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70299999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":874,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194438,"statfs":{"total":200000000,"available":199104845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68999999999999995,"5min":0.752,"15min":1.2729999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.309},"max":{"1min":0.73799999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71999999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68300000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.27100000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":1.1839999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.85199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71199999999999997,"5min":0.77900000000000003,"15min":0.81899999999999995},"last":0.75800000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.32700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73799999999999999,"5min":0.79200000000000004,"15min":0.96399999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58099999999999996},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72799999999999998,"5min":0.81299999999999994,"15min":0.98899999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.23899999999999999},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":0.88500000000000001},"last":0.371}]},{"osd":6,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.439},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67700000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.42299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.70599999999999996,"5min":0.78800000000000003,"15min":0.82999999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.67600000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.39200000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:45:32.462 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:45:32.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:45:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.624+0000 7f2471c3d700 1 Processor -- start 2023-10-09T11:45:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.624+0000 7f2471c3d700 1 -- start start 2023-10-09T11:45:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f2471c3d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 0x7f246c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f2471c3d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0cca80 con 0x7f246c157b90 2023-10-09T11:45:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f2471c3d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0cedd0 con 0x7f246c1577c0 2023-10-09T11:45:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f2471c3d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0cc4c0 con 0x7f246c068f20 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f246bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f246c157b90 0x7f246c0cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f246bfff700 1 -- 172.21.15.6:0/243689354 learned_addr learned my addr 172.21.15.6:0/243689354 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.625+0000 7f246affd700 1 --2- 172.21.15.6:0/243689354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 0x7f246c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563705803 0 0) 0x7f246c0cca80 con 0x7f246c157b90 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2454003570 con 0x7f246c157b90 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081646967 0 0) 0x7f246c0cedd0 con 0x7f246c1577c0 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f246c0cca80 con 0x7f246c1577c0 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246affd700 1 -- 172.21.15.6:0/243689354 >> v1:172.21.15.118:6789/0 conn(0x7f246c1577c0 legacy=0x7f246c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246affd700 1 -- 172.21.15.6:0/243689354 >> v1:172.21.15.6:6789/0 conn(0x7f246c157b90 legacy=0x7f246c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246affd700 1 -- 172.21.15.6:0/243689354 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0cc7a0 con 0x7f246c068f20 2023-10-09T11:45:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246affd700 1 --2- 172.21.15.6:0/243689354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 0x7f246c0cb790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2460009910 tx=0x7f24600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea443c6222a35cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460011630 con 0x7f246c068f20 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460011790 con 0x7f246c068f20 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.626+0000 7f246a7fc700 1 -- 172.21.15.6:0/243689354 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460011b30 con 0x7f246c068f20 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 -- 172.21.15.6:0/243689354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 msgr2=0x7f246c0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 --2- 172.21.15.6:0/243689354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 0x7f246c0cb790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2460009910 tx=0x7f24600091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 -- 172.21.15.6:0/243689354 shutdown_connections 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 --2- 172.21.15.6:0/243689354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c068f20 0x7f246c0cb790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 -- 172.21.15.6:0/243689354 >> 172.21.15.6:0/243689354 conn(0x7f246c0d0df0 msgr2=0x7f246c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 -- 172.21.15.6:0/243689354 shutdown_connections 2023-10-09T11:45:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.627+0000 7f2471c3d700 1 -- 172.21.15.6:0/243689354 wait complete. 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.628+0000 7f2471c3d700 1 Processor -- start 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.628+0000 7f2471c3d700 1 -- start start 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 0x7f246c145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c1577c0 0x7f246c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1598e0 con 0x7f246c157b90 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c158cd0 con 0x7f246c068f20 2023-10-09T11:45:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f2471c3d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c158fb0 con 0x7f246c1577c0 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58758/0 (socket says 172.21.15.6:58758) 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 0x7f246c145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 -- 172.21.15.6:0/1266293327 learned_addr learned my addr 172.21.15.6:0/1266293327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246affd700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c1577c0 0x7f246c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 -- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c1577c0 msgr2=0x7f246c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c1577c0 0x7f246c0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 -- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 msgr2=0x7f246c145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 0x7f246c145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246bfff700 1 -- 172.21.15.6:0/1266293327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009420 con 0x7f246c157b90 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.629+0000 7f246b7fe700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 0x7f246c145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f246bfff700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f2464001460 tx=0x7f2464001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400a7e0 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400a980 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c159290 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400ad40 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.630+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c1589e0 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.631+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c159a50 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.631+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2464007300 con 0x7f246c157b90 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.632+0000 7f24537fe700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.632+0000 7f246b7fe700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.632+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2464084800 con 0x7f246c157b90 2023-10-09T11:45:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.632+0000 7f246b7fe700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 0x7f24580693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f245c007fd0 tx=0x7f245c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.636+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2464051a70 con 0x7f246c157b90 2023-10-09T11:45:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.908+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f246c0cea60 con 0x7f246c157b90 2023-10-09T11:45:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.911+0000 7f24537fe700 1 -- 172.21.15.6:0/1266293327 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2464055090 con 0x7f246c157b90 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 msgr2=0x7f24580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 0x7f24580693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f245c007fd0 tx=0x7f245c007d50 comp rx=0 tx=0).stop 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 msgr2=0x7f246c0c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f2464001460 tx=0x7f2464001a00 comp rx=0 tx=0).stop 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 shutdown_connections 2023-10-09T11:45:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2458066f30 0x7f24580693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f246c157b90 0x7f246c0c8ac0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f246c068f20 0x7f246c145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 --2- 172.21.15.6:0/1266293327 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f246c1577c0 0x7f246c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.913+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 >> 172.21.15.6:0/1266293327 conn(0x7f246c0d0df0 msgr2=0x7f246c0c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.914+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 shutdown_connections 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:32.914+0000 7f2471c3d700 1 -- 172.21.15.6:0/1266293327 wait complete. 2023-10-09T11:45:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:45:32.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.047+0000 7f6247598700 1 Processor -- start 2023-10-09T11:45:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.047+0000 7f6247598700 1 -- start start 2023-10-09T11:45:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6247598700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6240164c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6247598700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cee10 con 0x7f6240159b40 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6247598700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cd040 con 0x7f6240159f10 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6247598700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cd320 con 0x7f6240068e90 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6246596700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6240159b40 0x7f62400cc600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44956/0 (socket says 172.21.15.6:44956) 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6246596700 1 -- 172.21.15.6:0/387720932 learned_addr learned my addr 172.21.15.6:0/387720932 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6246d97700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6240164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672019017 0 0) 0x7f62400cee10 con 0x7f6240159b40 2023-10-09T11:45:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.048+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6228003570 con 0x7f6240159b40 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2807632092 0 0) 0x7f6228003570 con 0x7f6240159b40 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 msgr2=0x7f6240164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6240164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 >> v1:172.21.15.118:6789/0 conn(0x7f6240159f10 legacy=0x7f6240068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400ce7c0 con 0x7f6240159b40 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f6238001470 con 0x7f6240159b40 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 >> v1:172.21.15.6:6789/0 conn(0x7f6240159b40 legacy=0x7f62400cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6228003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6228004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6228004d50 0x7f62280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cd320 con 0x7f6228003fd0 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622800bb40 con 0x7f6228004d50 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622800bd00 con 0x7f6240068e90 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6228004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6246596700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6228003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6246d97700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6228004d50 0x7f62280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 -- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 msgr2=0x7f6228003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6240068e90 0x7f6228003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 -- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6228004d50 msgr2=0x7f62280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6228004d50 0x7f62280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 -- 172.21.15.6:0/387720932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228003570 con 0x7f6228003fd0 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.049+0000 7f6245d95700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6228004810 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f62340019a0 tx=0x7f6234007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337aaa8826b99b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400c5d0 con 0x7f6228003fd0 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400c750 con 0x7f6228003fd0 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6245594700 1 -- 172.21.15.6:0/387720932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400cb10 con 0x7f6228003fd0 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 -- 172.21.15.6:0/387720932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 msgr2=0x7f6228004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 --2- 172.21.15.6:0/387720932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6228004810 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f62340019a0 tx=0x7f6234007d10 comp rx=0 tx=0).stop 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6246d97700 1 -- 172.21.15.6:0/387720932 reap_dead start 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 -- 172.21.15.6:0/387720932 shutdown_connections 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 -- 172.21.15.6:0/387720932 >> 172.21.15.6:0/387720932 conn(0x7f62400cd660 msgr2=0x7f62400cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 -- 172.21.15.6:0/387720932 shutdown_connections 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.050+0000 7f6247598700 1 -- 172.21.15.6:0/387720932 wait complete. 2023-10-09T11:45:33.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.051+0000 7f6247598700 1 Processor -- start 2023-10-09T11:45:33.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.051+0000 7f6247598700 1 -- start start 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62400b0000 0x7f62400c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400b0470 0x7f62400c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400aeb20 con 0x7f6228003fd0 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400ac220 con 0x7f62400b0000 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6247598700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400aad30 con 0x7f62400b0470 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58784/0 (socket says 172.21.15.6:58784) 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 -- 172.21.15.6:0/1981589211 learned_addr learned my addr 172.21.15.6:0/1981589211 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6245d95700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62400b0000 0x7f62400c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246d97700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400b0470 0x7f62400c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 -- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400b0470 msgr2=0x7f62400c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400b0470 0x7f62400c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 -- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62400b0000 msgr2=0x7f62400c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62400b0000 0x7f62400c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.052+0000 7f6246596700 1 -- 172.21.15.6:0/1981589211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400ae560 con 0x7f6228003fd0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f6246596700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f62380073c0 tx=0x7f6238001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800f7f0 con 0x7f6228003fd0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800f950 con 0x7f6228003fd0 2023-10-09T11:45:33.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400ae840 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800fd10 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.053+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6240158ba0 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.054+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6240158d60 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.054+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62380135c0 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.054+0000 7f623e7fc700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.055+0000 7f6245d95700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.055+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6238084230 con 0x7f6228003fd0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.055+0000 7f6245d95700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f62400cadd0 tx=0x7f6234015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.059+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62380514a0 con 0x7f6228003fd0 2023-10-09T11:45:33.061 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-10-09T11:45:33.060+0000 7fd2b9c65700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:45:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.297+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62400ceaa0 con 0x7f6228003fd0 2023-10-09T11:45:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.298+0000 7f623e7fc700 1 -- 172.21.15.6:0/1981589211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f623801a090 con 0x7f6228003fd0 2023-10-09T11:45:33.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:33.299 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 msgr2=0x7f622c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f62400cadd0 tx=0x7f6234015000 comp rx=0 tx=0).stop 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 msgr2=0x7f6240158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f62380073c0 tx=0x7f6238001e70 comp rx=0 tx=0).stop 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 shutdown_connections 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f622c066f30 0x7f622c0693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62400b0470 0x7f62400c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6228003fd0 0x7f6240158660 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 --2- 172.21.15.6:0/1981589211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62400b0000 0x7f62400c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 >> 172.21.15.6:0/1981589211 conn(0x7f62400cd660 msgr2=0x7f62400c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 shutdown_connections 2023-10-09T11:45:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.300+0000 7f6247598700 1 -- 172.21.15.6:0/1981589211 wait complete. 2023-10-09T11:45:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:45:33.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:45:27.130855+0000', 'modified': '2023-10-09T11:45:30.985644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7821}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7821': {'gid': 7821, 'name': 'd', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1955555002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1955555002}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1955555002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:45:33.716 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:45:33.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T11:45:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 Processor -- start 2023-10-09T11:45:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 -- start start 2023-10-09T11:45:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf380c6fc0 0x7fdf380ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf380c3020 0x7fdf381618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf380c8e20 con 0x7fdf38068980 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.837+0000 7fdf3ca5b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380c9100 con 0x7fdf380c6fc0 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3ca5b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380c1810 con 0x7fdf380c3020 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf380c6fc0 0x7fdf380ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf35d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf38068980 0x7fdf380c7390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37148/0 (socket says 172.21.15.6:37148) 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf35d9b700 1 -- 172.21.15.6:0/2119665305 learned_addr learned my addr 172.21.15.6:0/2119665305 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/2119665305 >> v2:172.21.15.118:3300/0 conn(0x7fdf380c3020 0x7fdf381618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 -- 172.21.15.6:0/2119665305 >> v2:172.21.15.118:3300/0 conn(0x7fdf380c3020 msgr2=0x7fdf381618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 --2- 172.21.15.6:0/2119665305 >> v2:172.21.15.118:3300/0 conn(0x7fdf380c3020 0x7fdf381618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 -- 172.21.15.6:0/2119665305 >> v1:172.21.15.6:6789/0 conn(0x7fdf38068980 legacy=0x7fdf380c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3559a700 1 -- 172.21.15.6:0/2119665305 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907367161 0 0) 0x7fdf380c8e20 con 0x7fdf38068980 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 -- 172.21.15.6:0/2119665305 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380c1af0 con 0x7fdf380c6fc0 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3659c700 1 --2- 172.21.15.6:0/2119665305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380ab6e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fdf380c39b0 tx=0x7fdf300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbdf0f9df37f87a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3559a700 1 -- 172.21.15.6:0/2119665305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30011630 con 0x7fdf380c6fc0 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3559a700 1 -- 172.21.15.6:0/2119665305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf30011790 con 0x7fdf380c6fc0 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.838+0000 7fdf3559a700 1 -- 172.21.15.6:0/2119665305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30011b30 con 0x7fdf380c6fc0 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/2119665305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 msgr2=0x7fdf380ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/2119665305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380ab6e0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fdf380c39b0 tx=0x7fdf300091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/2119665305 shutdown_connections 2023-10-09T11:45:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/2119665305 >> v2:172.21.15.118:3300/0 conn(0x7fdf380c3020 0x7fdf381618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/2119665305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380ab6e0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/2119665305 >> 172.21.15.6:0/2119665305 conn(0x7fdf3806c660 msgr2=0x7fdf380cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/2119665305 shutdown_connections 2023-10-09T11:45:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.839+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/2119665305 wait complete. 2023-10-09T11:45:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.840+0000 7fdf3ca5b700 1 Processor -- start 2023-10-09T11:45:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.840+0000 7fdf3ca5b700 1 -- start start 2023-10-09T11:45:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf38068980 0x7fdf38169020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf380c3020 0x7fdf3816ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38167f10 con 0x7fdf380c6fc0 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38168d60 con 0x7fdf38068980 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3ca5b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38168150 con 0x7fdf380c3020 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53842/0 (socket says 172.21.15.6:53842) 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3142503895 learned_addr learned my addr 172.21.15.6:0/3142503895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf38068980 0x7fdf38169020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf380c3020 0x7fdf3816ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf380c3020 msgr2=0x7fdf3816ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf380c3020 0x7fdf3816ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf38068980 msgr2=0x7fdf38169020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf38068980 0x7fdf38169020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3142503895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30009420 con 0x7fdf380c6fc0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.841+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e90 tx=0x7fdf2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.842+0000 7fdf2e7fc700 1 -- 172.21.15.6:0/3142503895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800cbc0 con 0x7fdf380c6fc0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.842+0000 7fdf2e7fc700 1 -- 172.21.15.6:0/3142503895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800f040 con 0x7fdf380c6fc0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.842+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf38168430 con 0x7fdf380c6fc0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.842+0000 7fdf2e7fc700 1 -- 172.21.15.6:0/3142503895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28014480 con 0x7fdf380c6fc0 2023-10-09T11:45:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.842+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381689f0 con 0x7fdf380c6fc0 2023-10-09T11:45:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.843+0000 7fdf2e7fc700 1 -- 172.21.15.6:0/3142503895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf28014830 con 0x7fdf380c6fc0 2023-10-09T11:45:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.843+0000 7fdf2e7fc700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.843+0000 7fdf2e7fc700 1 -- 172.21.15.6:0/3142503895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf28085260 con 0x7fdf380c6fc0 2023-10-09T11:45:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.844+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.844+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 0x7fdf180693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdf300093f0 tx=0x7fdf30017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.845+0000 7fdf45d53b80 1 Processor -- start 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.845+0000 7fdf45d53b80 1 -- start start 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e45050 0x5574d3e45420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e1c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3d72a70 con 0x5574d3e1cf80 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3d70270 con 0x5574d3e45050 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574d3d6c060 con 0x5574d3e1bdc0 2023-10-09T11:45:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53844/0 (socket says 172.21.15.6:53844) 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf35d9b700 1 -- 172.21.15.6:0/491042963 learned_addr learned my addr 172.21.15.6:0/491042963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf3659c700 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e45050 0x5574d3e45420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.846+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e1c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 -- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 msgr2=0x5574d3e1c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e1c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 -- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e45050 msgr2=0x5574d3e45420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e45050 0x5574d3e45420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 -- 172.21.15.6:0/491042963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574d3c06270 con 0x5574d3e1cf80 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fdf200016f0 tx=0x7fdf20009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7961af991319d1fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf177fe700 1 -- 172.21.15.6:0/491042963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20005ab0 con 0x5574d3e1cf80 2023-10-09T11:45:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf177fe700 1 -- 172.21.15.6:0/491042963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20005c10 con 0x5574d3e1cf80 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.847+0000 7fdf177fe700 1 -- 172.21.15.6:0/491042963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200070d0 con 0x5574d3e1cf80 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- 172.21.15.6:0/491042963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 msgr2=0x5574d3e1b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fdf200016f0 tx=0x7fdf20009040 comp rx=0 tx=0).stop 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- 172.21.15.6:0/491042963 shutdown_connections 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e1c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e45050 0x5574d3e45420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/491042963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e1b880 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- 172.21.15.6:0/491042963 >> 172.21.15.6:0/491042963 conn(0x5574d3e1d370 msgr2=0x5574d3e1d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- 172.21.15.6:0/491042963 shutdown_connections 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- 172.21.15.6:0/491042963 wait complete. 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 -- start start 2023-10-09T11:45:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.848+0000 7fdf45d53b80 1 Processor -- start 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1cf80 0x5574d3e16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3d17890 con 0x5574d3e45050 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3d32ea0 con 0x5574d3e1cf80 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574d3beee30 con 0x5574d3e1bdc0 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf45d53b80 10 client.0 _ll_register_callbacks cb 0x5574d3ddf110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.849+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53858/0 (socket says 172.21.15.6:53858) 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 -- 172.21.15.6:0/1579660734 learned_addr learned my addr 172.21.15.6:0/1579660734 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf3659c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1cf80 0x5574d3e16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 -- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 msgr2=0x5574d3e40d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e40d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 -- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1cf80 msgr2=0x5574d3e16c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1cf80 0x5574d3e16c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 -- 172.21.15.6:0/1579660734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2000f040 con 0x5574d3e45050 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fdf280099f0 tx=0x7fdf28085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9849e2bbd49ac54 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf280563f0 con 0x5574d3e45050 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf2806de70 con 0x5574d3e45050 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574d3e10b70 con 0x5574d3e45050 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf28055680 con 0x5574d3e45050 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf45d53b80 10 client.7956 fetch_fsmap learned FSMap version 84 2023-10-09T11:45:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5574d3ba8fe0 con 0x5574d3e45050 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.850+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5574d3e10b70 con 0x5574d3e45050 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf280832f0 con 0x5574d3e45050 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 10 client.7956 fetch_fsmap finished waiting for FSMap version 84 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 10 client.7956 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 20 client.7956 populate_metadata read hostname 'smithi006' 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e49360 0x5574d3e49730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 4 client.7956 mds_command: new command op to 7821 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 --> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574d3dedaa0 con 0x5574d3e49360 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf3659c700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e49360 0x5574d3e49730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf14ff9700 10 client.7956 ms_handle_connect on v2:172.21.15.118:6833/1955555002 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.851+0000 7fdf3659c700 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e49360 0x5574d3e49730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d53246215a6ed55c server_cookie=3d0cf249c5baa950 in_seq=0 out_seq=0 2023-10-09T11:45:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf14ff9700 1 -- 172.21.15.6:0/1579660734 <== mds.0 v2:172.21.15.118:6833/1955555002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5574d3dedaa0 con 0x5574d3e49360 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf14ff9700 10 client.7956 handle_command_reply: tid=0 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 client.7956 shutdown 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 msgr2=0x5574d3e17160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fdf280099f0 tx=0x7fdf28085040 comp rx=0 tx=0).stop 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 shutdown_connections 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e49360 0x5574d3e49730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e17160 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1bdc0 0x5574d3e40d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf14ff9700 0 client.7956 ms_handle_reset on v2:172.21.15.118:6833/1955555002 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/1579660734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1cf80 0x5574d3e16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 >> 172.21.15.6:0/1579660734 conn(0x5574d3e1d370 msgr2=0x5574d3e41b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 shutdown_connections 2023-10-09T11:45:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 1 -- 172.21.15.6:0/1579660734 wait complete. 2023-10-09T11:45:33.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.852+0000 7fdf45d53b80 20 client.7956 trim_cache size 0 max 16384 2023-10-09T11:45:33.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.869+0000 7fdf45d53b80 1 Processor -- start 2023-10-09T11:45:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.869+0000 7fdf45d53b80 1 -- start start 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e1a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e45050 0x5574d3e16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3e5d090 con 0x5574d3e1cf80 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3e605c0 con 0x5574d3e1bdc0 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574d3e42c90 con 0x5574d3e45050 2023-10-09T11:45:33.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53872/0 (socket says 172.21.15.6:53872) 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 -- 172.21.15.6:0/680450512 learned_addr learned my addr 172.21.15.6:0/680450512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e45050 0x5574d3e16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf3659c700 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e1a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 -- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e45050 msgr2=0x5574d3e16c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e45050 0x5574d3e16c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 -- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 msgr2=0x5574d3e1a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e1a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.870+0000 7fdf35d9b700 1 -- 172.21.15.6:0/680450512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574d3e1c900 con 0x5574d3e1cf80 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fdf20001610 tx=0x7fdf20019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bae6b0b413231df server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf17fff700 1 -- 172.21.15.6:0/680450512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200012b0 con 0x5574d3e1cf80 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf17fff700 1 -- 172.21.15.6:0/680450512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200070d0 con 0x5574d3e1cf80 2023-10-09T11:45:33.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf17fff700 1 -- 172.21.15.6:0/680450512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20007a80 con 0x5574d3e1cf80 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 -- 172.21.15.6:0/680450512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 msgr2=0x5574d3e190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fdf20001610 tx=0x7fdf20019000 comp rx=0 tx=0).stop 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 -- 172.21.15.6:0/680450512 shutdown_connections 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e45050 0x5574d3e16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e1a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/680450512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e1cf80 0x5574d3e190a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 -- 172.21.15.6:0/680450512 >> 172.21.15.6:0/680450512 conn(0x5574d3e1d370 msgr2=0x5574d3e19a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 -- 172.21.15.6:0/680450512 shutdown_connections 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.871+0000 7fdf45d53b80 1 -- 172.21.15.6:0/680450512 wait complete. 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.872+0000 7fdf45d53b80 1 -- start start 2023-10-09T11:45:33.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.872+0000 7fdf45d53b80 1 Processor -- start 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1cf80 0x5574d3e17160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3e192c0 con 0x5574d3e45050 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3e19500 con 0x5574d3e1bdc0 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574d3ecd420 con 0x5574d3e1cf80 2023-10-09T11:45:33.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf45d53b80 10 client.0 _ll_register_callbacks cb 0x5574d3ddf110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53884/0 (socket says 172.21.15.6:53884) 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3868653365 learned_addr learned my addr 172.21.15.6:0/3868653365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf35d9b700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1cf80 0x5574d3e17160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1cf80 msgr2=0x5574d3e17160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1cf80 0x5574d3e17160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 msgr2=0x5574d3e16c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e16c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 -- 172.21.15.6:0/3868653365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574d3c06270 con 0x5574d3e45050 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf36d9d700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fdf28052690 tx=0x7fdf2801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d382d0f917d80c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.873+0000 7fdf14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf280563f0 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf280832f0 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf20005c10 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf2805ceb0 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 10 client.7962 fetch_fsmap learned FSMap version 84 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5574d3d3a780 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20005c10 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf28083ba0 con 0x5574d3e45050 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 10 client.7962 fetch_fsmap finished waiting for FSMap version 84 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 10 client.7962 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T11:45:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 20 client.7962 populate_metadata read hostname 'smithi006' 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e42800 0x5574d3e58e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 4 client.7962 mds_command: new command op to 7821 tid=0[{"prefix": "status"}] 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 --> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574d3d0ee00 con 0x5574d3e42800 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.874+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e42800 0x5574d3e58e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf14ff9700 10 client.7962 ms_handle_connect on v2:172.21.15.118:6833/1955555002 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf3659c700 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e42800 0x5574d3e58e90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2899012d87d54c98 server_cookie=f48216373efc9f7c in_seq=0 out_seq=0 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf14ff9700 1 -- 172.21.15.6:0/3868653365 <== mds.0 v2:172.21.15.118:6833/1955555002 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5574d3d0ee00 con 0x5574d3e42800 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf14ff9700 10 client.7962 handle_command_reply: tid=0 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 client.7962 shutdown 2023-10-09T11:45:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 msgr2=0x5574d3e58950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fdf28052690 tx=0x7fdf2801e000 comp rx=0 tx=0).stop 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 shutdown_connections 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:6833/1955555002,v1:172.21.15.118:6835/1955555002] conn(0x5574d3e42800 0x5574d3e58e90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d3e45050 0x5574d3e58950 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574d3e1bdc0 0x5574d3e16c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 --2- 172.21.15.6:0/3868653365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x5574d3e1cf80 0x5574d3e17160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf14ff9700 0 client.7962 ms_handle_reset on v2:172.21.15.118:6833/1955555002 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 >> 172.21.15.6:0/3868653365 conn(0x5574d3e1d370 msgr2=0x5574d3e5ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 shutdown_connections 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 1 -- 172.21.15.6:0/3868653365 wait complete. 2023-10-09T11:45:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.875+0000 7fdf45d53b80 20 client.7962 trim_cache size 0 max 16384 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7821, 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9023914670000002, 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 84, 2023-10-09T11:45:33.885 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 162, 2023-10-09T11:45:33.886 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 162, 2023-10-09T11:45:33.886 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.183195987 2023-10-09T11:45:33.886 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 msgr2=0x7fdf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 0x7fdf180693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdf300093f0 tx=0x7fdf30017000 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 msgr2=0x7fdf380abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e90 tx=0x7fdf2800b040 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 shutdown_connections 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf380c6fc0 0x7fdf380abf50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf38068980 0x7fdf38169020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 --2- 172.21.15.6:0/3142503895 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf380c3020 0x7fdf3816ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 >> 172.21.15.6:0/3142503895 conn(0x7fdf3806c660 msgr2=0x7fdf380afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 shutdown_connections 2023-10-09T11:45:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:33.876+0000 7fdf3ca5b700 1 -- 172.21.15.6:0/3142503895 wait complete. 2023-10-09T11:45:33.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:45:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.008+0000 7f996f4a6700 1 Processor -- start 2023-10-09T11:45:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 -- start start 2023-10-09T11:45:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 0x7f99680cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f996806d120 0x7f996806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680d07c0 con 0x7f9968157ca0 2023-10-09T11:45:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996806da50 con 0x7f996806d120 2023-10-09T11:45:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.009+0000 7f996f4a6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680cfbb0 con 0x7f99681578d0 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f996806d120 0x7f996806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f996806d120 0x7f996806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53888/0 (socket says 172.21.15.6:53888) 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 -- 172.21.15.6:0/2705622551 learned_addr learned my addr 172.21.15.6:0/2705622551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996d242700 1 --2- 172.21.15.6:0/2705622551 >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 0x7f99680cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 -- 172.21.15.6:0/2705622551 >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 msgr2=0x7f99680cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 --2- 172.21.15.6:0/2705622551 >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 0x7f99680cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 -- 172.21.15.6:0/2705622551 >> v1:172.21.15.118:6789/0 conn(0x7f9968157ca0 legacy=0x7f996815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 -- 172.21.15.6:0/2705622551 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680cfe90 con 0x7f996806d120 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996d242700 1 --2- 172.21.15.6:0/2705622551 >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 0x7f99680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f996da43700 1 --2- 172.21.15.6:0/2705622551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f996806d120 0x7f996806d510 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f99680646b0 tx=0x7f9958009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62eaff9ed8f8a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f9967fff700 1 -- 172.21.15.6:0/2705622551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800e070 con 0x7f996806d120 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f9967fff700 1 -- 172.21.15.6:0/2705622551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800ba50 con 0x7f996806d120 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.010+0000 7f9967fff700 1 -- 172.21.15.6:0/2705622551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580092e0 con 0x7f996806d120 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 -- 172.21.15.6:0/2705622551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f996806d120 msgr2=0x7f996806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 --2- 172.21.15.6:0/2705622551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f996806d120 0x7f996806d510 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f99680646b0 tx=0x7f9958009840 comp rx=0 tx=0).stop 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 -- 172.21.15.6:0/2705622551 shutdown_connections 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 --2- 172.21.15.6:0/2705622551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f996806d120 0x7f996806d510 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 --2- 172.21.15.6:0/2705622551 >> v2:172.21.15.118:3300/0 conn(0x7f99681578d0 0x7f99680cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 -- 172.21.15.6:0/2705622551 >> 172.21.15.6:0/2705622551 conn(0x7f996806bb90 msgr2=0x7f996806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 -- 172.21.15.6:0/2705622551 shutdown_connections 2023-10-09T11:45:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.011+0000 7f996f4a6700 1 -- 172.21.15.6:0/2705622551 wait complete. 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.012+0000 7f996f4a6700 1 Processor -- start 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.012+0000 7f996f4a6700 1 -- start start 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996806d120 0x7f996816cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9968157ca0 0x7f9968159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680aac00 con 0x7f99681578d0 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680aaee0 con 0x7f996806d120 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996f4a6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ab1c0 con 0x7f9968157ca0 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53902/0 (socket says 172.21.15.6:53902) 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 -- 172.21.15.6:0/733709581 learned_addr learned my addr 172.21.15.6:0/733709581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996da43700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9968157ca0 0x7f9968159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996d242700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996806d120 0x7f996816cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 -- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9968157ca0 msgr2=0x7f9968159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9968157ca0 0x7f9968159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 -- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996806d120 msgr2=0x7f996816cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996806d120 0x7f996816cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.013+0000 7f996ca41700 1 -- 172.21.15.6:0/733709581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009ae0 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f996ca41700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c590 tx=0x7f995c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c011590 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c011710 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99680ab4a0 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c011ad0 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.014+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99680aa890 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.015+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9968067ac0 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.015+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f995c01a360 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.016+0000 7f99657fa700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 0x7f99540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.016+0000 7f996d242700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 0x7f99540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.016+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f995c083380 con 0x7f99681578d0 2023-10-09T11:45:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.016+0000 7f996d242700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 0x7f99540693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9960006f00 tx=0x7f9960008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.020+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f995c0505f0 con 0x7f99681578d0 2023-10-09T11:45:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.257+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99680d0170 con 0x7f99681578d0 2023-10-09T11:45:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.257+0000 7f99657fa700 1 -- 172.21.15.6:0/733709581 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f995c053c10 con 0x7f99681578d0 2023-10-09T11:45:34.257 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 msgr2=0x7f99540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 0x7f99540693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9960006f00 tx=0x7f9960008040 comp rx=0 tx=0).stop 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 msgr2=0x7f99680b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c590 tx=0x7f995c007f50 comp rx=0 tx=0).stop 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 shutdown_connections 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9954066f30 0x7f99540693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9968157ca0 0x7f9968159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996806d120 0x7f996816cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 --2- 172.21.15.6:0/733709581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99681578d0 0x7f99680b61c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 >> 172.21.15.6:0/733709581 conn(0x7f996806bb90 msgr2=0x7f9968156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 shutdown_connections 2023-10-09T11:45:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:34.259+0000 7f996f4a6700 1 -- 172.21.15.6:0/733709581 wait complete. 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:45:34.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:45:34.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.273 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:45:34.288 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:45:34.288 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:45:34.288 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:45:34.288 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:45:34.289 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41927sec preferred_lft 41927sec 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.290 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:34.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.291 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:45:34.351 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:45:34.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.353 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:45:34.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:45:34.410 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:45:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.511 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:45:34.526 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:45:34.526 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:45:34.526 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:45:34.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:45:34.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:45:34.591 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:45:34.646 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:45:34.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:45:34.646 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:45:34.700 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:45:34.701 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:45:34.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:34.783 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:34.783 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:34.802 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:45:34.803 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:45:34.824 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:45:34.825 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:45:34.825 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:45:34.825 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:45:34.826 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:45:34.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:34.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:45:34.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:45:35.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.051+0000 7f1322418700 1 Processor -- start 2023-10-09T11:45:35.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.051+0000 7f1322418700 1 -- start start 2023-10-09T11:45:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f1322418700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f1322418700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f131c06d120 0x7f131c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f1322418700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131c06dac0 con 0x7f131c157ca0 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f1322418700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131c0d07c0 con 0x7f131c06d120 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f1322418700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0cfbb0 con 0x7f131c1578d0 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f131bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f131bfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:40778/0 (socket says 172.21.15.6:40778) 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f131bfff700 1 -- 172.21.15.6:0/2696019422 learned_addr learned my addr 172.21.15.6:0/2696019422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.052+0000 7f13209b5700 1 --2- 172.21.15.6:0/2696019422 >> v2:172.21.15.118:3300/0 conn(0x7f131c06d120 0x7f131c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131bfff700 1 -- 172.21.15.6:0/2696019422 >> v2:172.21.15.118:3300/0 conn(0x7f131c06d120 msgr2=0x7f131c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131bfff700 1 --2- 172.21.15.6:0/2696019422 >> v2:172.21.15.118:3300/0 conn(0x7f131c06d120 0x7f131c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131bfff700 1 -- 172.21.15.6:0/2696019422 >> v1:172.21.15.118:6789/0 conn(0x7f131c157ca0 legacy=0x7f131c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131bfff700 1 -- 172.21.15.6:0/2696019422 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0cfe90 con 0x7f131c1578d0 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131bfff700 1 --2- 172.21.15.6:0/2696019422 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f130c0099b0 tx=0x7f130c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2a6361a11efe8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131affd700 1 -- 172.21.15.6:0/2696019422 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c009ea0 con 0x7f131c1578d0 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131affd700 1 -- 172.21.15.6:0/2696019422 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00b860 con 0x7f131c1578d0 2023-10-09T11:45:35.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.053+0000 7f131affd700 1 -- 172.21.15.6:0/2696019422 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00bc00 con 0x7f131c1578d0 2023-10-09T11:45:35.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 -- 172.21.15.6:0/2696019422 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 msgr2=0x7f131c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 --2- 172.21.15.6:0/2696019422 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f130c0099b0 tx=0x7f130c009250 comp rx=0 tx=0).stop 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 -- 172.21.15.6:0/2696019422 shutdown_connections 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 --2- 172.21.15.6:0/2696019422 >> v2:172.21.15.118:3300/0 conn(0x7f131c06d120 0x7f131c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 --2- 172.21.15.6:0/2696019422 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c1578d0 0x7f131c0cf4f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 -- 172.21.15.6:0/2696019422 >> 172.21.15.6:0/2696019422 conn(0x7f131c06bb90 msgr2=0x7f131c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 -- 172.21.15.6:0/2696019422 shutdown_connections 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.054+0000 7f1322418700 1 -- 172.21.15.6:0/2696019422 wait complete. 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.055+0000 7f1322418700 1 Processor -- start 2023-10-09T11:45:35.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.055+0000 7f1322418700 1 -- start start 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c06d120 0x7f131c14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 0x7f131c16bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c6890 con 0x7f131c1578d0 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c5cc0 con 0x7f131c06d120 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f1322418700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c5f60 con 0x7f131c157ca0 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f13209b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 0x7f131c16bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53912/0 (socket says 172.21.15.6:53912) 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 -- 172.21.15.6:0/962768533 learned_addr learned my addr 172.21.15.6:0/962768533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:35.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131bfff700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c06d120 0x7f131c14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 -- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 msgr2=0x7f131c16bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 0x7f131c16bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 -- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c06d120 msgr2=0x7f131c14b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c06d120 0x7f131c14b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 -- 172.21.15.6:0/962768533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0094f0 con 0x7f131c1578d0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f13209b5700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 0x7f131c16bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.056+0000 7f131b7fe700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f130400c4e0 tx=0x7f130400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.057+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011590 con 0x7f131c1578d0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.057+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011710 con 0x7f131c1578d0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.057+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c0c6240 con 0x7f131c1578d0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.057+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011ad0 con 0x7f131c1578d0 2023-10-09T11:45:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.057+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c14be90 con 0x7f131c1578d0 2023-10-09T11:45:35.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.058+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c0c6a00 con 0x7f131c1578d0 2023-10-09T11:45:35.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.058+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f130401b3b0 con 0x7f131c1578d0 2023-10-09T11:45:35.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.059+0000 7f1313fff700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:35.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.059+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1304083730 con 0x7f131c1578d0 2023-10-09T11:45:35.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.059+0000 7f131bfff700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:35.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.059+0000 7f131bfff700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f130c0099b0 tx=0x7f130c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:35.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.063+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13040509a0 con 0x7f131c1578d0 2023-10-09T11:45:35.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:35.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:45:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.301+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f131c06dac0 con 0x7f131c1578d0 2023-10-09T11:45:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.302+0000 7f1313fff700 1 -- 172.21.15.6:0/962768533 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f131c06dac0 con 0x7f131c1578d0 2023-10-09T11:45:35.302 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 msgr2=0x7f12fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f130c0099b0 tx=0x7f130c017000 comp rx=0 tx=0).stop 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 msgr2=0x7f131c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f130400c4e0 tx=0x7f130400c7f0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 shutdown_connections 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12fc066f30 0x7f12fc0693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f131c157ca0 0x7f131c16bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f131c06d120 0x7f131c14b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 --2- 172.21.15.6:0/962768533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f131c1578d0 0x7f131c0cd320 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 >> 172.21.15.6:0/962768533 conn(0x7f131c06bb90 msgr2=0x7f131c0b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 shutdown_connections 2023-10-09T11:45:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:35.304+0000 7f1322418700 1 -- 172.21.15.6:0/962768533 wait complete. 2023-10-09T11:45:35.316 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:45:35.317 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:45:35.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.318 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:45:35.335 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 41939sec preferred_lft 41939sec 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.336 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:45:35.337 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.338 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:45:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:45:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:45:35.338 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:45:35.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.338 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:45:35.400 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:45:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.402 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:45:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:45:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:45:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:45:35.458 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:45:35.459 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:45:35.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.459 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:45:35.459 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:45:35.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:45:35.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:45:35.460 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:45:35.460 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:45:35.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.560 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:45:35.575 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:45:35.575 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:45:35.575 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:45:35.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:45:35.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:45:35.640 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:45:35.695 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:45:35.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:45:35.695 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:45:35.749 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:45:35.749 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:45:35.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:35.828 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:35.829 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:35.847 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:45:35.848 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:45:35.868 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:45:35.868 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:45:35.868 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:45:35.868 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:45:35.869 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:45:35.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:45:35.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:45:35.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:45:35.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:45:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.062+0000 7fb020af9700 1 Processor -- start 2023-10-09T11:45:36.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.062+0000 7fb020af9700 1 -- start start 2023-10-09T11:45:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb020af9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 0x7fb01c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb020af9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb020af9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0b0ca0 con 0x7fb01c06d650 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb020af9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c06ea90 con 0x7fb01c15a2a0 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb020af9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0cf4c0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb01ad9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb01c06d650 0x7fb01c06da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37150/0 (socket says 172.21.15.6:37150) 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.063+0000 7fb01ad9d700 1 -- 172.21.15.6:0/1304514428 learned_addr learned my addr 172.21.15.6:0/1304514428 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1304514428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01a59c700 1 --2- 172.21.15.6:0/1304514428 >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 0x7fb01c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197044982 0 0) 0x7fb01c0b0ca0 con 0x7fb01c06d650 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb008003570 con 0x7fb01c06d650 2023-10-09T11:45:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 -- 172.21.15.6:0/1304514428 >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 msgr2=0x7fb01c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1304514428 >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 0x7fb01c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 -- 172.21.15.6:0/1304514428 >> v1:172.21.15.6:6789/0 conn(0x7fb01c06d650 legacy=0x7fb01c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251910798 0 0) 0x7fb008003570 con 0x7fb01c06d650 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 -- 172.21.15.6:0/1304514428 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0b00d0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01a59c700 1 --2- 172.21.15.6:0/1304514428 >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 0x7fb01c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1304514428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0cef80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0040098e0 tx=0x7fb0040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1231cbcd3daf6638 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c001470 con 0x7fb01c0ceb30 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004011420 con 0x7fb01c0ceb30 2023-10-09T11:45:36.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.064+0000 7fb01959a700 1 -- 172.21.15.6:0/1304514428 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0040117a0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 -- 172.21.15.6:0/1304514428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 msgr2=0x7fb01c0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 --2- 172.21.15.6:0/1304514428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0cef80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0040098e0 tx=0x7fb0040091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 -- 172.21.15.6:0/1304514428 shutdown_connections 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 --2- 172.21.15.6:0/1304514428 >> v2:172.21.15.118:3300/0 conn(0x7fb01c15a2a0 0x7fb01c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 --2- 172.21.15.6:0/1304514428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0cef80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 -- 172.21.15.6:0/1304514428 >> 172.21.15.6:0/1304514428 conn(0x7fb01c067640 msgr2=0x7fb01c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 -- 172.21.15.6:0/1304514428 shutdown_connections 2023-10-09T11:45:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.065+0000 7fb020af9700 1 -- 172.21.15.6:0/1304514428 wait complete. 2023-10-09T11:45:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.066+0000 7fb020af9700 1 Processor -- start 2023-10-09T11:45:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.066+0000 7fb020af9700 1 -- start start 2023-10-09T11:45:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 0x7fb01c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c15a2a0 0x7fb01c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15db40 con 0x7fb01c06d650 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15de20 con 0x7fb01c15a2a0 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb020af9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15e100 con 0x7fb01c0ceb30 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 0x7fb01c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 0x7fb01c0c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53928/0 (socket says 172.21.15.6:53928) 2023-10-09T11:45:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb01a59c700 1 -- 172.21.15.6:0/2407235232 learned_addr learned my addr 172.21.15.6:0/2407235232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c15a2a0 0x7fb01c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 -- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c15a2a0 msgr2=0x7fb01c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c15a2a0 0x7fb01c158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 -- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 msgr2=0x7fb01c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 0x7fb01c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 -- 172.21.15.6:0/2407235232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009a20 con 0x7fb01c0ceb30 2023-10-09T11:45:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.067+0000 7fb019d9b700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0c7e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb004015000 tx=0x7fb004016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.068+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00401caf0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.068+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00401cc50 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.068+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb004009420 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.068+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00401a450 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.068+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c15e6c0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.069+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c15e8b0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.069+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb00401a7e0 con 0x7fb01c0ceb30 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.069+0000 7fb0127fc700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.069+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb004085910 con 0x7fb01c0ceb30 2023-10-09T11:45:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.069+0000 7fb01a59c700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.070+0000 7fb01a59c700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb01400f750 tx=0x7fb01400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.074+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb004052c30 con 0x7fb01c0ceb30 2023-10-09T11:45:36.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.313+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb01c04bb80 con 0x7fb01c0ceb30 2023-10-09T11:45:36.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.314+0000 7fb0127fc700 1 -- 172.21.15.6:0/2407235232 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fb004029090 con 0x7fb01c0ceb30 2023-10-09T11:45:36.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:45:36.315 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:45:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 msgr2=0x7faffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb01400f750 tx=0x7fb01400b040 comp rx=0 tx=0).stop 2023-10-09T11:45:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 msgr2=0x7fb01c0c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0c7e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb004015000 tx=0x7fb004016000 comp rx=0 tx=0).stop 2023-10-09T11:45:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 shutdown_connections 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb01c15a2a0 0x7fb01c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c06d650 0x7fb01c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 --2- 172.21.15.6:0/2407235232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb01c0ceb30 0x7fb01c0c7e30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 >> 172.21.15.6:0/2407235232 conn(0x7fb01c067640 msgr2=0x7fb01c158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 shutdown_connections 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.316+0000 7fb020af9700 1 -- 172.21.15.6:0/2407235232 wait complete. 2023-10-09T11:45:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:45:36.329 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-09T11:45:36.461 INFO:teuthology.orchestra.run.smithi118.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":7821,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.478975213,"mdsmap_epoch":84,"osdmap_epoch":162,"osdmap_epoch_barrier":162,"uptime":13.759781572} 2023-10-09T11:45:36.462 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 7821, "mdsmap_epoch": 84, "osdmap_epoch": 162, "osdmap_epoch_barrier": 162, "rank_uptime": 8.478975213, "state": "up:active", "uptime": 13.759781572, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:45:36.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T11:45:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.586+0000 7ffad5174700 1 Processor -- start 2023-10-09T11:45:36.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.586+0000 7ffad5174700 1 -- start start 2023-10-09T11:45:36.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffad5174700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffad01578d0 0x7ffad00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffad5174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad006d120 0x7ffad006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffad5174700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00d07c0 con 0x7ffad0157ca0 2023-10-09T11:45:36.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffad5174700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad006daa0 con 0x7ffad01578d0 2023-10-09T11:45:36.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffad5174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00cfbb0 con 0x7ffad006d120 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffaced9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffad01578d0 0x7ffad00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7fface59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffad0157ca0 0x7ffad015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37158/0 (socket says 172.21.15.6:37158) 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7fface59c700 1 -- 172.21.15.6:0/1063497132 learned_addr learned my addr 172.21.15.6:0/1063497132 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.587+0000 7ffacf59e700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad006d120 0x7ffad006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffaced9d700 1 -- 172.21.15.6:0/1063497132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad006d120 msgr2=0x7ffad006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffaced9d700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad006d120 0x7ffad006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffaced9d700 1 -- 172.21.15.6:0/1063497132 >> v1:172.21.15.6:6789/0 conn(0x7ffad0157ca0 legacy=0x7ffad015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffacdd9b700 1 -- 172.21.15.6:0/1063497132 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230418462 0 0) 0x7ffad00d07c0 con 0x7ffad0157ca0 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffaced9d700 1 -- 172.21.15.6:0/1063497132 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00cfe90 con 0x7ffad01578d0 2023-10-09T11:45:36.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffaced9d700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad01578d0 0x7ffad00cf4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ffac00098e0 tx=0x7ffac00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372454e387f1b01f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffacdd9b700 1 -- 172.21.15.6:0/1063497132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000b640 con 0x7ffad01578d0 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffacdd9b700 1 -- 172.21.15.6:0/1063497132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000b7a0 con 0x7ffad01578d0 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffacdd9b700 1 -- 172.21.15.6:0/1063497132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000bb40 con 0x7ffad01578d0 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 -- 172.21.15.6:0/1063497132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad01578d0 msgr2=0x7ffad00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad01578d0 0x7ffad00cf4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ffac00098e0 tx=0x7ffac00091a0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 -- 172.21.15.6:0/1063497132 shutdown_connections 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad006d120 0x7ffad006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 --2- 172.21.15.6:0/1063497132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad01578d0 0x7ffad00cf4f0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 -- 172.21.15.6:0/1063497132 >> 172.21.15.6:0/1063497132 conn(0x7ffad006bb90 msgr2=0x7ffad006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.588+0000 7ffad5174700 1 -- 172.21.15.6:0/1063497132 shutdown_connections 2023-10-09T11:45:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.589+0000 7ffad5174700 1 -- 172.21.15.6:0/1063497132 wait complete. 2023-10-09T11:45:36.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 Processor -- start 2023-10-09T11:45:36.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 -- start start 2023-10-09T11:45:36.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad01578d0 0x7ffad014a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 0x7ffad00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00b3ba0 con 0x7ffad006d120 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00b3e40 con 0x7ffad0157ca0 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.590+0000 7ffad5174700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0152480 con 0x7ffad01578d0 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53960/0 (socket says 172.21.15.6:53960) 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 -- 172.21.15.6:0/2792431349 learned_addr learned my addr 172.21.15.6:0/2792431349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7fface59c700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad01578d0 0x7ffad014a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffacf59e700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 0x7ffad00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 -- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad01578d0 msgr2=0x7ffad014a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad01578d0 0x7ffad014a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 -- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 msgr2=0x7ffad00b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 0x7ffad00b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 -- 172.21.15.6:0/2792431349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0009420 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffacf59e700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 0x7ffad00b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffaced9d700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ffad006fe20 tx=0x7ffac0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0000d10 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000bb20 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad0152760 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011670 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.591+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad0152190 con 0x7ffad006d120 2023-10-09T11:45:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.592+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad0067ac0 con 0x7ffad006d120 2023-10-09T11:45:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.593+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffac0011a20 con 0x7ffad006d120 2023-10-09T11:45:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.593+0000 7ffab6ffd700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:45:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.593+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffac0085aa0 con 0x7ffad006d120 2023-10-09T11:45:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.593+0000 7fface59c700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:45:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.593+0000 7fface59c700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 0x7ffabc0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffad01537d0 tx=0x7ffac4007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:45:36.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.598+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffac0052d10 con 0x7ffad006d120 2023-10-09T11:45:36.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:36.790+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ffad00d0170 con 0x7ffad006d120 2023-10-09T11:45:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.010+0000 7ffab6ffd700 1 -- 172.21.15.6:0/2792431349 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffac0056330 con 0x7ffad006d120 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 msgr2=0x7ffabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 0x7ffabc0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffad01537d0 tx=0x7ffac4007f50 comp rx=0 tx=0).stop 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 msgr2=0x7ffad0151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ffad006fe20 tx=0x7ffac0017000 comp rx=0 tx=0).stop 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 shutdown_connections 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ffabc066f30 0x7ffabc0693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad0157ca0 0x7ffad00b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad006d120 0x7ffad0151c50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 --2- 172.21.15.6:0/2792431349 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffad01578d0 0x7ffad014a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:45:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 >> 172.21.15.6:0/2792431349 conn(0x7ffad006bb90 msgr2=0x7ffad0155740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:45:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 shutdown_connections 2023-10-09T11:45:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:45:37.012+0000 7ffad5174700 1 -- 172.21.15.6:0/2792431349 wait complete. 2023-10-09T11:45:37.014 INFO:teuthology.orchestra.run.smithi006.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T11:45:37.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:45:37.159 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:45:37.160 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:45:37.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-09T11:45:37.287 INFO:teuthology.orchestra.run.smithi006.stdout:{"mon_tick_interval":"5"} 2023-10-09T11:45:37.287 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-09T11:45:37.288 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> import time 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> import datetime 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> # Write some buffered data through before going full, all should be well 2023-10-09T11:45:37.288 DEBUG:teuthology.orchestra.run.smithi006:> print("writing some data through which we expect to succeed") 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> bytes = 0 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> # buffered IO, the error should always only appear from fsync and not 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> # from write 2023-10-09T11:45:37.289 DEBUG:teuthology.orchestra.run.smithi006:> full = False 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> for n in range(0, int(32 * 1.1)): 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> raise 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:45:37.290 DEBUG:teuthology.orchestra.run.smithi006:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> full = True 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> break 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> try: 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f) 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> print("fsync'"'"'ed successfully") 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> except OSError as e: 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> full = True 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> break 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> else: 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-09T11:45:37.291 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> if n > 32 * 0.9: 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> # Be cautious in the last region where we expect to hit 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(15.0) 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> if not full: 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> # close() should not raise an error because we already caught it in 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> # since then because all IOs got cancelled on the full flag. 2023-10-09T11:45:37.292 DEBUG:teuthology.orchestra.run.smithi006:> print("calling close") 2023-10-09T11:45:37.293 DEBUG:teuthology.orchestra.run.smithi006:> os.close(f) 2023-10-09T11:45:37.293 DEBUG:teuthology.orchestra.run.smithi006:> print("close() did not raise error") 2023-10-09T11:45:37.293 DEBUG:teuthology.orchestra.run.smithi006:> 2023-10-09T11:45:37.293 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-09T11:45:37.293 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-10-09T11:46:05.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:05.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:35.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:35.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:writing some data through which we expect to succeed 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 1.00 MB 2023-10-09T11:46:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 2.00 MB 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 3.00 MB 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 4.00 MB 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 5.00 MB 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.859 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 6.00 MB 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 7.00 MB 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 8.00 MB 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 9.00 MB 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.860 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 10.00 MB 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 11.00 MB 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 12.00 MB 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 13.00 MB 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.861 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 14.00 MB 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 15.00 MB 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 16.00 MB 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 17.00 MB 2023-10-09T11:46:37.862 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 18.00 MB 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 19.00 MB 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 20.00 MB 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 21.00 MB 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.863 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 22.00 MB 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 23.00 MB 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 24.00 MB 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 25.00 MB 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 26.00 MB 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 27.00 MB 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 28.00 MB 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 29.00 MB 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 30.00 MB 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 31.00 MB 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 32.00 MB 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:fsync'ed successfully 2023-10-09T11:46:37.866 INFO:teuthology.orchestra.run.smithi006.stdout:Not full yet after 33.00 MB 2023-10-09T11:46:37.867 INFO:teuthology.orchestra.run.smithi006.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-09T11:46:37.867 INFO:teuthology.orchestra.run.smithi006.stdout:Reached fullness after 33.00 MB 2023-10-09T11:46:37.867 INFO:teuthology.orchestra.run.smithi006.stdout:calling close 2023-10-09T11:46:37.867 INFO:teuthology.orchestra.run.smithi006.stdout:close() did not raise error 2023-10-09T11:46:38.035 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:46:38.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:38.078 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:38.126 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:46:38.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:46:38.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:46:38.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:46:38.172 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:46:38.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:46:38.173 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:46:38.189 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:46:38.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:46:38.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:46:38.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:46:38.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:46:38.233 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:46:38.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.414+0000 7fddf35b5700 1 Processor -- start 2023-10-09T11:46:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.415+0000 7fddf35b5700 1 -- start start 2023-10-09T11:46:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.415+0000 7fddf35b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.415+0000 7fddf35b5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0d07c0 con 0x7fddec157ca0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.415+0000 7fddf35b5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0cfbb0 con 0x7fddec06d120 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.415+0000 7fddf35b5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0cfe90 con 0x7fddec1578d0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf0b50700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fddec157ca0 0x7fddec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52458/0 (socket says 172.21.15.6:52458) 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf0b50700 1 -- 172.21.15.6:0/3212425278 learned_addr learned my addr 172.21.15.6:0/3212425278 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516913444 0 0) 0x7fddec0d07c0 con 0x7fddec157ca0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf1351700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd4003570 con 0x7fddec157ca0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 796782168 0 0) 0x7fddd4003570 con 0x7fddec157ca0 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 msgr2=0x7fddec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 >> v1:172.21.15.118:6789/0 conn(0x7fddec06d120 legacy=0x7fddec15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0d0170 con 0x7fddec157ca0 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fdde0001470 con 0x7fddec157ca0 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 >> v1:172.21.15.6:6789/0 conn(0x7fddec157ca0 legacy=0x7fddec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd4003a90 0x7fddd4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddd40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0cfe90 con 0x7fddd4004810 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd400bb60 con 0x7fddd4003a90 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd400bd20 con 0x7fddec1578d0 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf0b50700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf1351700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd4003a90 0x7fddd4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.416+0000 7fddf1b52700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddd40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 -- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 msgr2=0x7fddd40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec1578d0 0x7fddd40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 -- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd4003a90 msgr2=0x7fddd4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd4003a90 0x7fddd4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 -- 172.21.15.6:0/3212425278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4003570 con 0x7fddd4004810 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf0b50700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddd4004c80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fdde000c390 tx=0x7fddec15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f818aed8589f24b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde000cc60 con 0x7fddd4004810 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde000cdc0 con 0x7fddd4004810 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddebfff700 1 -- 172.21.15.6:0/3212425278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0005b70 con 0x7fddd4004810 2023-10-09T11:46:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf35b5700 1 -- 172.21.15.6:0/3212425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 msgr2=0x7fddd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.417+0000 7fddf35b5700 1 --2- 172.21.15.6:0/3212425278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddd4004c80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fdde000c390 tx=0x7fddec15b610 comp rx=0 tx=0).stop 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.418+0000 7fddf1b52700 1 -- 172.21.15.6:0/3212425278 reap_dead start 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.418+0000 7fddf35b5700 1 -- 172.21.15.6:0/3212425278 shutdown_connections 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.418+0000 7fddf35b5700 1 -- 172.21.15.6:0/3212425278 >> 172.21.15.6:0/3212425278 conn(0x7fddec06bb90 msgr2=0x7fddec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.418+0000 7fddf35b5700 1 -- 172.21.15.6:0/3212425278 shutdown_connections 2023-10-09T11:46:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.418+0000 7fddf35b5700 1 -- 172.21.15.6:0/3212425278 wait complete. 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.419+0000 7fddf35b5700 1 Processor -- start 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.419+0000 7fddf35b5700 1 -- start start 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddec0b61a0 0x7fddec0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec14e8f0 0x7fddec14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec153840 con 0x7fddd4004810 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec152d80 con 0x7fddec0b61a0 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14f280 con 0x7fddec14e8f0 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34650/0 (socket says 172.21.15.6:34650) 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 -- 172.21.15.6:0/2407273401 learned_addr learned my addr 172.21.15.6:0/2407273401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf0b50700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddec0b61a0 0x7fddec0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1b52700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec14e8f0 0x7fddec14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 -- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec14e8f0 msgr2=0x7fddec14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec14e8f0 0x7fddec14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 -- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddec0b61a0 msgr2=0x7fddec0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddec0b61a0 0x7fddec0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec152fa0 con 0x7fddd4004810 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf1351700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fdde4011d70 tx=0x7fdde40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400fa10 con 0x7fddd4004810 2023-10-09T11:46:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde400fb70 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec153280 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.420+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4014440 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.421+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0b4250 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.421+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec0b4470 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.422+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdde4014870 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.422+0000 7fdde97fa700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.422+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fdde4018030 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.422+0000 7fddf0b50700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.422+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7fddd806eab0 con 0x7fddd4004810 2023-10-09T11:46:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.423+0000 7fddf0b50700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 0x7fddd80693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdde0007cd0 tx=0x7fdde0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.426+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdde40521c0 con 0x7fddd4004810 2023-10-09T11:46:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.661+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddec0d0450 con 0x7fddd4004810 2023-10-09T11:46:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.662+0000 7fdde97fa700 1 -- 172.21.15.6:0/2407273401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7fdde4022070 con 0x7fddd4004810 2023-10-09T11:46:38.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:38.663 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:46:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 msgr2=0x7fddd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 0x7fddd80693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdde0007cd0 tx=0x7fdde0015000 comp rx=0 tx=0).stop 2023-10-09T11:46:38.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 msgr2=0x7fddec152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fdde4011d70 tx=0x7fdde40091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 shutdown_connections 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fddd8066f30 0x7fddd80693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddec14e8f0 0x7fddec14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddd4004810 0x7fddec152840 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 --2- 172.21.15.6:0/2407273401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddec0b61a0 0x7fddec0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 >> 172.21.15.6:0/2407273401 conn(0x7fddec06bb90 msgr2=0x7fddec154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 shutdown_connections 2023-10-09T11:46:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.664+0000 7fddf35b5700 1 -- 172.21.15.6:0/2407273401 wait complete. 2023-10-09T11:46:38.667 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:46:38.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.797+0000 7f5ca94d3700 1 Processor -- start 2023-10-09T11:46:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.797+0000 7f5ca94d3700 1 -- start start 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.797+0000 7f5ca94d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ca41578d0 0x7f5ca40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.797+0000 7f5ca94d3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40d07c0 con 0x7f5ca406d120 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca94d3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40cfbb0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca94d3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40cfe90 con 0x7f5ca41578d0 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ca41578d0 0x7f5ca40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ca41578d0 0x7f5ca40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34662/0 (socket says 172.21.15.6:34662) 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ca406d120 0x7f5ca406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52462/0 (socket says 172.21.15.6:52462) 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 -- 172.21.15.6:0/1999820845 learned_addr learned my addr 172.21.15.6:0/1999820845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 -- 172.21.15.6:0/1999820845 >> v1:172.21.15.118:6789/0 conn(0x7f5ca4157ca0 legacy=0x7f5ca415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 -- 172.21.15.6:0/1999820845 >> v1:172.21.15.6:6789/0 conn(0x7f5ca406d120 legacy=0x7f5ca406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 -- 172.21.15.6:0/1999820845 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40d0170 con 0x7f5ca41578d0 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca1ffb700 1 -- 172.21.15.6:0/1999820845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131375630 0 0) 0x7f5ca40d07c0 con 0x7f5ca406d120 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca2ffd700 1 --2- 172.21.15.6:0/1999820845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca41578d0 0x7f5ca40cf4f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f5c940099b0 tx=0x7f5c94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4477246ac58f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca1ffb700 1 -- 172.21.15.6:0/1999820845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400b860 con 0x7f5ca41578d0 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca1ffb700 1 -- 172.21.15.6:0/1999820845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400b9c0 con 0x7f5ca41578d0 2023-10-09T11:46:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.798+0000 7f5ca1ffb700 1 -- 172.21.15.6:0/1999820845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400bd60 con 0x7f5ca41578d0 2023-10-09T11:46:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 -- 172.21.15.6:0/1999820845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca41578d0 msgr2=0x7f5ca40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/1999820845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca41578d0 0x7f5ca40cf4f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f5c940099b0 tx=0x7f5c94009250 comp rx=0 tx=0).stop 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 -- 172.21.15.6:0/1999820845 shutdown_connections 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/1999820845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca41578d0 0x7f5ca40cf4f0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 -- 172.21.15.6:0/1999820845 >> 172.21.15.6:0/1999820845 conn(0x7f5ca406bb90 msgr2=0x7f5ca406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 -- 172.21.15.6:0/1999820845 shutdown_connections 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.799+0000 7f5ca94d3700 1 -- 172.21.15.6:0/1999820845 wait complete. 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.800+0000 7f5ca94d3700 1 Processor -- start 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.800+0000 7f5ca94d3700 1 -- start start 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca41578d0 0x7f5ca416e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40b5360 con 0x7f5ca4157ca0 2023-10-09T11:46:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca416ea20 con 0x7f5ca41578d0 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca94d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40cdc40 con 0x7f5ca406d120 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34678/0 (socket says 172.21.15.6:34678) 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 -- 172.21.15.6:0/778495859 learned_addr learned my addr 172.21.15.6:0/778495859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca2ffd700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca27fc700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca41578d0 0x7f5ca416e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 -- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 msgr2=0x7f5ca40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 -- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca41578d0 msgr2=0x7f5ca416e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca41578d0 0x7f5ca416e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.801+0000 7f5ca37fe700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940094f0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5ca37fe700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00cd50 tx=0x7f5c9c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c005df0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00a8b0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca40b4d10 con 0x7f5ca4157ca0 2023-10-09T11:46:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00ac70 con 0x7f5ca4157ca0 2023-10-09T11:46:38.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.802+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4152fa0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.803+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca40b4b70 con 0x7f5ca4157ca0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.803+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c9c007300 con 0x7f5ca4157ca0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.804+0000 7f5c8affd700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.804+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f5c9c084620 con 0x7f5ca4157ca0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.804+0000 7f5ca2ffd700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.804+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f5c9006eab0 con 0x7f5ca4157ca0 2023-10-09T11:46:38.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.804+0000 7f5ca2ffd700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c940099b0 tx=0x7f5c94017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:38.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:38.808+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca40b4b70 con 0x7f5ca4157ca0 2023-10-09T11:46:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.004+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ca40b4b70 con 0x7f5ca4157ca0 2023-10-09T11:46:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.005+0000 7f5c8affd700 1 -- 172.21.15.6:0/778495859 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+15393 (secure 0 0 0) 0x7f5ca40b4b70 con 0x7f5ca4157ca0 2023-10-09T11:46:39.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:39.007 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":166,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:10.974675+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 msgr2=0x7f5c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5c940099b0 tx=0x7f5c94017000 comp rx=0 tx=0).stop 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 msgr2=0x7f5ca4152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00cd50 tx=0x7f5c9c001b10 comp rx=0 tx=0).stop 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 shutdown_connections 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca4152a60 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 --2- 172.21.15.6:0/778495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca41578d0 0x7f5ca416e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 >> 172.21.15.6:0/778495859 conn(0x7f5ca406bb90 msgr2=0x7f5ca415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 shutdown_connections 2023-10-09T11:46:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.008+0000 7f5ca94d3700 1 -- 172.21.15.6:0/778495859 wait complete. 2023-10-09T11:46:39.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:45:25.538714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:45:26.103334+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:46:39.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:46:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.145+0000 7f11071ab700 1 Processor -- start 2023-10-09T11:46:39.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.145+0000 7f11071ab700 1 -- start start 2023-10-09T11:46:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.145+0000 7f11071ab700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11000cf240 0x7f11000b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.145+0000 7f11071ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000b0ca0 con 0x7f110006d650 2023-10-09T11:46:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f11071ab700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000b00d0 con 0x7f110015a2a0 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f11071ab700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110006ea90 con 0x7f11000cf240 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11000cf240 0x7f11000b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11000cf240 0x7f11000b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34692/0 (socket says 172.21.15.6:34692) 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 -- 172.21.15.6:0/550229848 learned_addr learned my addr 172.21.15.6:0/550229848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f1105748700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f110006d650 0x7f110006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52472/0 (socket says 172.21.15.6:52472) 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 -- 172.21.15.6:0/550229848 >> v1:172.21.15.118:6789/0 conn(0x7f110015a2a0 legacy=0x7f11000ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 -- 172.21.15.6:0/550229848 >> v1:172.21.15.6:6789/0 conn(0x7f110006d650 legacy=0x7f110006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 -- 172.21.15.6:0/550229848 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000b0370 con 0x7f11000cf240 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10ff7fe700 1 -- 172.21.15.6:0/550229848 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696867855 0 0) 0x7f11000b0ca0 con 0x7f110006d650 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10fffff700 1 --2- 172.21.15.6:0/550229848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f11000b1130 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f10e80099b0 tx=0x7f10e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12559f031d481dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10ff7fe700 1 -- 172.21.15.6:0/550229848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800b820 con 0x7f11000cf240 2023-10-09T11:46:39.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10ff7fe700 1 -- 172.21.15.6:0/550229848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800b980 con 0x7f11000cf240 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.146+0000 7f10ff7fe700 1 -- 172.21.15.6:0/550229848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800bd20 con 0x7f11000cf240 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 -- 172.21.15.6:0/550229848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 msgr2=0x7f11000b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 --2- 172.21.15.6:0/550229848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f11000b1130 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f10e80099b0 tx=0x7f10e8009250 comp rx=0 tx=0).stop 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 -- 172.21.15.6:0/550229848 shutdown_connections 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 --2- 172.21.15.6:0/550229848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f11000b1130 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 -- 172.21.15.6:0/550229848 >> 172.21.15.6:0/550229848 conn(0x7f1100067640 msgr2=0x7f1100067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 -- 172.21.15.6:0/550229848 shutdown_connections 2023-10-09T11:46:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.147+0000 7f11071ab700 1 -- 172.21.15.6:0/550229848 wait complete. 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.148+0000 7f11071ab700 1 Processor -- start 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.148+0000 7f11071ab700 1 -- start start 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f110006d650 0x7f1100155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 0x7f110015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000b37c0 con 0x7f11000cf240 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1100155690 con 0x7f110015a2a0 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f11071ab700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000b2910 con 0x7f110006d650 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34700/0 (socket says 172.21.15.6:34700) 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 -- 172.21.15.6:0/2293842216 learned_addr learned my addr 172.21.15.6:0/2293842216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f1105748700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 0x7f110015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 -- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f110006d650 msgr2=0x7f1100155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f110006d650 0x7f1100155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 -- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 msgr2=0x7f110015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 0x7f110015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80094f0 con 0x7f11000cf240 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f1105748700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 0x7f110015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.149+0000 7f10fffff700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009290 tx=0x7f10e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.150+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800bc40 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.150+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8020070 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.150+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11000b2bb0 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.150+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e801b6a0 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.150+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000b3170 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.151+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100071b70 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.151+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10e8022030 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.151+0000 7f10fcff9700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 0x7f10e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.151+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f10e80864d0 con 0x7f11000cf240 2023-10-09T11:46:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.152+0000 7f1104f47700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 0x7f10e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.152+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f10e006eab0 con 0x7f11000cf240 2023-10-09T11:46:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.152+0000 7f1104f47700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 0x7f10e00693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f10f800ac60 tx=0x7f10f80092c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.156+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e8053720 con 0x7f11000cf240 2023-10-09T11:46:39.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.348+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1100071b70 con 0x7f11000cf240 2023-10-09T11:46:39.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.349+0000 7f10fcff9700 1 -- 172.21.15.6:0/2293842216 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v166) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10e8056d40 con 0x7f11000cf240 2023-10-09T11:46:39.350 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 msgr2=0x7f10e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 0x7f10e00693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f10f800ac60 tx=0x7f10f80092c0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 msgr2=0x7f110015ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009290 tx=0x7f10e8016000 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 shutdown_connections 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f10e0066f30 0x7f10e00693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f110015a2a0 0x7f110015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f110006d650 0x7f1100155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 --2- 172.21.15.6:0/2293842216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11000cf240 0x7f110015ddd0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 >> 172.21.15.6:0/2293842216 conn(0x7f1100067640 msgr2=0x7f11000ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 shutdown_connections 2023-10-09T11:46:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.351+0000 7f11071ab700 1 -- 172.21.15.6:0/2293842216 wait complete. 2023-10-09T11:46:39.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:46:39.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.485+0000 7f4c87b53700 1 Processor -- start 2023-10-09T11:46:39.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.485+0000 7f4c87b53700 1 -- start start 2023-10-09T11:46:39.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c87b53700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c8006e940 0x7f4c80161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c87b53700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c800b2290 con 0x7f4c801569e0 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c87b53700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c80157c00 con 0x7f4c80156db0 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c87b53700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c801572d0 con 0x7f4c8006e940 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c860f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c8006e940 0x7f4c80161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c858ef700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4c801569e0 0x7f4c800b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52478/0 (socket says 172.21.15.6:52478) 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c858ef700 1 -- 172.21.15.6:0/489044518 learned_addr learned my addr 172.21.15.6:0/489044518 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c860f0700 1 -- 172.21.15.6:0/489044518 >> v1:172.21.15.118:6789/0 conn(0x7f4c80156db0 legacy=0x7f4c8006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c860f0700 1 -- 172.21.15.6:0/489044518 >> v1:172.21.15.6:6789/0 conn(0x7f4c801569e0 legacy=0x7f4c800b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c860f0700 1 -- 172.21.15.6:0/489044518 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c801575b0 con 0x7f4c8006e940 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c848ed700 1 -- 172.21.15.6:0/489044518 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401835716 0 0) 0x7f4c800b2290 con 0x7f4c801569e0 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c860f0700 1 --2- 172.21.15.6:0/489044518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c80161950 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89621949e94e85db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c848ed700 1 -- 172.21.15.6:0/489044518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78009e80 con 0x7f4c8006e940 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c848ed700 1 -- 172.21.15.6:0/489044518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800b820 con 0x7f4c8006e940 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.486+0000 7f4c848ed700 1 -- 172.21.15.6:0/489044518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800bba0 con 0x7f4c8006e940 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 -- 172.21.15.6:0/489044518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 msgr2=0x7f4c80161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 --2- 172.21.15.6:0/489044518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c80161950 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 -- 172.21.15.6:0/489044518 shutdown_connections 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 --2- 172.21.15.6:0/489044518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c80161950 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 -- 172.21.15.6:0/489044518 >> 172.21.15.6:0/489044518 conn(0x7f4c8006cca0 msgr2=0x7f4c8006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 -- 172.21.15.6:0/489044518 shutdown_connections 2023-10-09T11:46:39.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.487+0000 7f4c87b53700 1 -- 172.21.15.6:0/489044518 wait complete. 2023-10-09T11:46:39.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.488+0000 7f4c87b53700 1 Processor -- start 2023-10-09T11:46:39.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.488+0000 7f4c87b53700 1 -- start start 2023-10-09T11:46:39.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c801569e0 0x7f4c80069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c80156db0 0x7f4c80144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8016b8a0 con 0x7f4c8006e940 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8016bb80 con 0x7f4c80156db0 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c87b53700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8016be60 con 0x7f4c801569e0 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34722/0 (socket says 172.21.15.6:34722) 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 -- 172.21.15.6:0/1649773261 learned_addr learned my addr 172.21.15.6:0/1649773261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c860f0700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c80156db0 0x7f4c80144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c850ee700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c801569e0 0x7f4c80069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 -- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c801569e0 msgr2=0x7f4c80069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c801569e0 0x7f4c80069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 -- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c80156db0 msgr2=0x7f4c80144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c80156db0 0x7f4c80144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009420 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.489+0000 7f4c858ef700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00cd80 tx=0x7f4c7c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.490+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00ab10 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.490+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00ac70 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.490+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8016c140 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.490+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0070f0 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.490+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8015b550 con 0x7f4c8006e940 2023-10-09T11:46:39.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.491+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800c2d50 con 0x7f4c8006e940 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.491+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c7c0074e0 con 0x7f4c8006e940 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.491+0000 7f4c75ffb700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 0x7f4c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.492+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f4c7c084a80 con 0x7f4c8006e940 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.492+0000 7f4c850ee700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 0x7f4c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.492+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f4c6406eab0 con 0x7f4c8006e940 2023-10-09T11:46:39.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.492+0000 7f4c850ee700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 0x7f4c640693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4c70006fd0 tx=0x7f4c70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.496+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c7c051d50 con 0x7f4c8006e940 2023-10-09T11:46:39.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.686+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c80157890 con 0x7f4c8006e940 2023-10-09T11:46:39.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.686+0000 7f4c75ffb700 1 -- 172.21.15.6:0/1649773261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v166) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c7c055370 con 0x7f4c8006e940 2023-10-09T11:46:39.688 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:46:39.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.688+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 msgr2=0x7f4c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.688+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 0x7f4c640693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4c70006fd0 tx=0x7f4c70008040 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.688+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 msgr2=0x7f4c8015b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.688+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00cd80 tx=0x7f4c7c001ae0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 shutdown_connections 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c64066f30 0x7f4c640693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c80156db0 0x7f4c80144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8006e940 0x7f4c8015b010 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 --2- 172.21.15.6:0/1649773261 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c801569e0 0x7f4c80069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 >> 172.21.15.6:0/1649773261 conn(0x7f4c8006cca0 msgr2=0x7f4c80150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 shutdown_connections 2023-10-09T11:46:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.689+0000 7f4c87b53700 1 -- 172.21.15.6:0/1649773261 wait complete. 2023-10-09T11:46:39.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:46:39.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.824+0000 7f229c4f3700 1 Processor -- start 2023-10-09T11:46:39.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.824+0000 7f229c4f3700 1 -- start start 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229c4f3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22940ce5c0 0x7f22940aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229c4f3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22940ac570 0x7f229406e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229c4f3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229415dfb0 con 0x7f22940ce1f0 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229c4f3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940acec0 con 0x7f22940ac570 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229c4f3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940ad1a0 con 0x7f22940ce5c0 2023-10-09T11:46:39.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22940ac570 0x7f229406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22940ac570 0x7f229406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34728/0 (socket says 172.21.15.6:34728) 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 -- 172.21.15.6:0/3686817435 learned_addr learned my addr 172.21.15.6:0/3686817435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f2299a8e700 1 --2- 172.21.15.6:0/3686817435 >> v2:172.21.15.118:3300/0 conn(0x7f22940ce5c0 0x7f22940aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 -- 172.21.15.6:0/3686817435 >> v2:172.21.15.118:3300/0 conn(0x7f22940ce5c0 msgr2=0x7f22940aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 --2- 172.21.15.6:0/3686817435 >> v2:172.21.15.118:3300/0 conn(0x7f22940ce5c0 0x7f22940aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 -- 172.21.15.6:0/3686817435 >> v1:172.21.15.118:6789/0 conn(0x7f22940ce1f0 legacy=0x7f229415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 -- 172.21.15.6:0/3686817435 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229415dc40 con 0x7f22940ac570 2023-10-09T11:46:39.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.825+0000 7f229aa90700 1 --2- 172.21.15.6:0/3686817435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f229406e230 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f229406f590 tx=0x7f228c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58d8b3a492caa5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229928d700 1 -- 172.21.15.6:0/3686817435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c009e70 con 0x7f22940ac570 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229928d700 1 -- 172.21.15.6:0/3686817435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00b860 con 0x7f22940ac570 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229928d700 1 -- 172.21.15.6:0/3686817435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00bc00 con 0x7f22940ac570 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 -- 172.21.15.6:0/3686817435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 msgr2=0x7f229406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 --2- 172.21.15.6:0/3686817435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f229406e230 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f229406f590 tx=0x7f228c009250 comp rx=0 tx=0).stop 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 -- 172.21.15.6:0/3686817435 shutdown_connections 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 --2- 172.21.15.6:0/3686817435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f229406e230 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 --2- 172.21.15.6:0/3686817435 >> v2:172.21.15.118:3300/0 conn(0x7f22940ce5c0 0x7f22940aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 -- 172.21.15.6:0/3686817435 >> 172.21.15.6:0/3686817435 conn(0x7f229406cca0 msgr2=0x7f229406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:39.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 -- 172.21.15.6:0/3686817435 shutdown_connections 2023-10-09T11:46:39.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.826+0000 7f229c4f3700 1 -- 172.21.15.6:0/3686817435 wait complete. 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.827+0000 7f229c4f3700 1 Processor -- start 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.827+0000 7f229c4f3700 1 -- start start 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22940ce1f0 0x7f22940ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22940ce5c0 0x7f2294156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229415ad70 con 0x7f22940ac570 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940aea60 con 0x7f22940ce1f0 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229c4f3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229415a440 con 0x7f22940ce5c0 2023-10-09T11:46:39.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229a28f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229a28f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34738/0 (socket says 172.21.15.6:34738) 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229a28f700 1 -- 172.21.15.6:0/722049138 learned_addr learned my addr 172.21.15.6:0/722049138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f2299a8e700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22940ce1f0 0x7f22940ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.828+0000 7f229aa90700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22940ce5c0 0x7f2294156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 -- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22940ce5c0 msgr2=0x7f2294156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22940ce5c0 0x7f2294156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 -- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22940ce1f0 msgr2=0x7f22940ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22940ce1f0 0x7f22940ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:39.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0094f0 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229a28f700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f228400cb40 tx=0x7f22840017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400ce50 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400a7a0 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229415a720 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400ab60 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.829+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941568b0 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.830+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294068900 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.830+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2284003030 con 0x7f22940ac570 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.831+0000 7f22927fc700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:39.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.831+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f22840844d0 con 0x7f22940ac570 2023-10-09T11:46:39.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.831+0000 7f2299a8e700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:39.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.831+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f228006eab0 con 0x7f22940ac570 2023-10-09T11:46:39.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.831+0000 7f2299a8e700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 0x7f22800693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f22940b0610 tx=0x7f22880091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:39.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:39.835+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2284051720 con 0x7f22940ac570 2023-10-09T11:46:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.033+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22940ac9d0 con 0x7f22940ac570 2023-10-09T11:46:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.033+0000 7f22927fc700 1 -- 172.21.15.6:0/722049138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v166) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2284054d40 con 0x7f22940ac570 2023-10-09T11:46:40.035 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:46:40.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 msgr2=0x7f22800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 0x7f22800693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f22940b0610 tx=0x7f22880091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 msgr2=0x7f22940ae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f228400cb40 tx=0x7f22840017b0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 shutdown_connections 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2280066f30 0x7f22800693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22940ce5c0 0x7f2294156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22940ac570 0x7f22940ae460 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 --2- 172.21.15.6:0/722049138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22940ce1f0 0x7f22940ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 >> 172.21.15.6:0/722049138 conn(0x7f229406cca0 msgr2=0x7f229415e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 shutdown_connections 2023-10-09T11:46:40.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.035+0000 7f229c4f3700 1 -- 172.21.15.6:0/722049138 wait complete. 2023-10-09T11:46:40.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.166+0000 7f09ccb76700 1 Processor -- start 2023-10-09T11:46:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.166+0000 7f09ccb76700 1 -- start start 2023-10-09T11:46:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09ccb76700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09c80b3bd0 0x7f09c80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09ccb76700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c80b2890 con 0x7f09c81583b0 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09ccb76700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c80b4070 con 0x7f09c8157fe0 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09ccb76700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c80b4350 con 0x7f09c80b3bd0 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09c6d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f09c81583b0 0x7f09c8158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52486/0 (socket says 172.21.15.6:52486) 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.167+0000 7f09c6d9d700 1 -- 172.21.15.6:0/2434536170 learned_addr learned my addr 172.21.15.6:0/2434536170 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c5d9b700 1 --2- 172.21.15.6:0/2434536170 >> v2:172.21.15.118:3300/0 conn(0x7f09c80b3bd0 0x7f09c80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362338710 0 0) 0x7f09c80b2890 con 0x7f09c81583b0 2023-10-09T11:46:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b4003570 con 0x7f09c81583b0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878280863 0 0) 0x7f09c80b4070 con 0x7f09c8157fe0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c80b2890 con 0x7f09c8157fe0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557639624 0 0) 0x7f09b4003570 con 0x7f09c81583b0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c5d9b700 1 -- 172.21.15.6:0/2434536170 >> v1:172.21.15.118:6789/0 conn(0x7f09c8157fe0 legacy=0x7f09c80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c5d9b700 1 -- 172.21.15.6:0/2434536170 >> v1:172.21.15.6:6789/0 conn(0x7f09c81583b0 legacy=0x7f09c8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c5d9b700 1 -- 172.21.15.6:0/2434536170 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c80b4630 con 0x7f09c80b3bd0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c5d9b700 1 --2- 172.21.15.6:0/2434536170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c80b3bd0 0x7f09c80ceb30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09b00098e0 tx=0x7f09b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a222cf66ae36ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8001470 con 0x7f09c80b3bd0 2023-10-09T11:46:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0011420 con 0x7f09c80b3bd0 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.168+0000 7f09c559a700 1 -- 172.21.15.6:0/2434536170 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00117c0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 -- 172.21.15.6:0/2434536170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c80b3bd0 msgr2=0x7f09c80ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 --2- 172.21.15.6:0/2434536170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c80b3bd0 0x7f09c80ceb30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09b00098e0 tx=0x7f09b00091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 -- 172.21.15.6:0/2434536170 shutdown_connections 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 --2- 172.21.15.6:0/2434536170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c80b3bd0 0x7f09c80ceb30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 -- 172.21.15.6:0/2434536170 >> 172.21.15.6:0/2434536170 conn(0x7f09c8067640 msgr2=0x7f09c8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 -- 172.21.15.6:0/2434536170 shutdown_connections 2023-10-09T11:46:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.169+0000 7f09ccb76700 1 -- 172.21.15.6:0/2434536170 wait complete. 2023-10-09T11:46:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.170+0000 7f09ccb76700 1 Processor -- start 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.170+0000 7f09ccb76700 1 -- start start 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09c8157fe0 0x7f09c81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c81583b0 0x7f09c81689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c815b3a0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c815a790 con 0x7f09c81583b0 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c815aa70 con 0x7f09c8157fe0 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34740/0 (socket says 172.21.15.6:34740) 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 -- 172.21.15.6:0/3997532705 learned_addr learned my addr 172.21.15.6:0/3997532705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c5d9b700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09c8157fe0 0x7f09c81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c6d9d700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c81583b0 0x7f09c81689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 -- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09c8157fe0 msgr2=0x7f09c81506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09c8157fe0 0x7f09c81506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 -- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c81583b0 msgr2=0x7f09c81689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c81583b0 0x7f09c81689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0009420 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09c659c700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f09c000cb40 tx=0x7f09c0002810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000ce50 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000a7e0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c815ad50 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000aba0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c80c4970 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.172+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c8069e40 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.173+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09c0012420 con 0x7f09c80b3bd0 2023-10-09T11:46:40.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.173+0000 7f09be7fc700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 0x7f09a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.173+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f09c00848c0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.173+0000 7f09c5d9b700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 0x7f09a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.174+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f09a806eab0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.174+0000 7f09c5d9b700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 0x7f09a80693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f09c80b3fa0 tx=0x7f09b0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.179+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09c0051a70 con 0x7f09c80b3bd0 2023-10-09T11:46:40.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.414+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09c80cc6b0 con 0x7f09c80b3bd0 2023-10-09T11:46:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.414+0000 7f09be7fc700 1 -- 172.21.15.6:0/3997532705 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f09c0055090 con 0x7f09c80b3bd0 2023-10-09T11:46:40.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:40.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 msgr2=0x7f09a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 0x7f09a80693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f09c80b3fa0 tx=0x7f09b0016000 comp rx=0 tx=0).stop 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 msgr2=0x7f09c80c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f09c000cb40 tx=0x7f09c0002810 comp rx=0 tx=0).stop 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 shutdown_connections 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f09a8066f30 0x7f09a80693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c81583b0 0x7f09c81689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c80b3bd0 0x7f09c80c4430 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 --2- 172.21.15.6:0/3997532705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09c8157fe0 0x7f09c81506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 >> 172.21.15.6:0/3997532705 conn(0x7f09c8067640 msgr2=0x7f09c80cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 shutdown_connections 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.417+0000 7f09ccb76700 1 -- 172.21.15.6:0/3997532705 wait complete. 2023-10-09T11:46:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:46:40.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 Processor -- start 2023-10-09T11:46:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 -- start start 2023-10-09T11:46:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f138c157ca0 0x7f138c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 0x7f138c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0d07c0 con 0x7f138c1578d0 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c06daa0 con 0x7f138c157ca0 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.548+0000 7f1390fb5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0cfbb0 con 0x7f138c06d120 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f138c157ca0 0x7f138c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f138c157ca0 0x7f138c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 -- 172.21.15.6:0/3366488201 learned_addr learned my addr 172.21.15.6:0/3366488201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f138ad9d700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 0x7f138c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 -- 172.21.15.6:0/3366488201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 msgr2=0x7f138c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 0x7f138c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 -- 172.21.15.6:0/3366488201 >> v1:172.21.15.118:6789/0 conn(0x7f138c1578d0 legacy=0x7f138c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 -- 172.21.15.6:0/3366488201 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0cfe90 con 0x7f138c157ca0 2023-10-09T11:46:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f138ad9d700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 0x7f138c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f1389d9b700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c157ca0 0x7f138c0cf4f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f13740099b0 tx=0x7f1374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953d8a46218e2edc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f138959a700 1 -- 172.21.15.6:0/3366488201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400b860 con 0x7f138c157ca0 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f138959a700 1 -- 172.21.15.6:0/3366488201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400b9c0 con 0x7f138c157ca0 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.549+0000 7f138959a700 1 -- 172.21.15.6:0/3366488201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400bd60 con 0x7f138c157ca0 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 -- 172.21.15.6:0/3366488201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c157ca0 msgr2=0x7f138c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c157ca0 0x7f138c0cf4f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f13740099b0 tx=0x7f1374009250 comp rx=0 tx=0).stop 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 -- 172.21.15.6:0/3366488201 shutdown_connections 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c06d120 0x7f138c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3366488201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c157ca0 0x7f138c0cf4f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 -- 172.21.15.6:0/3366488201 >> 172.21.15.6:0/3366488201 conn(0x7f138c06bb90 msgr2=0x7f138c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 -- 172.21.15.6:0/3366488201 shutdown_connections 2023-10-09T11:46:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.550+0000 7f1390fb5700 1 -- 172.21.15.6:0/3366488201 wait complete. 2023-10-09T11:46:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.552+0000 7f1390fb5700 1 Processor -- start 2023-10-09T11:46:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.552+0000 7f1390fb5700 1 -- start start 2023-10-09T11:46:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c06d120 0x7f138c0ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c157ca0 0x7f138c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c153190 con 0x7f138c1578d0 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b4b70 con 0x7f138c06d120 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b5410 con 0x7f138c157ca0 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34748/0 (socket says 172.21.15.6:34748) 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 -- 172.21.15.6:0/3779488530 learned_addr learned my addr 172.21.15.6:0/3779488530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f138a59c700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c06d120 0x7f138c0ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f138ad9d700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c157ca0 0x7f138c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 -- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c157ca0 msgr2=0x7f138c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c157ca0 0x7f138c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 -- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c06d120 msgr2=0x7f138c0ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c06d120 0x7f138c0ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740094f0 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1389d9b700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f13740090b0 tx=0x7f1374017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374011dc0 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137401f070 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c0ac880 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740266d0 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.553+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0b50a0 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c067ac0 con 0x7f138c1578d0 2023-10-09T11:46:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1374026a40 con 0x7f138c1578d0 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f13827fc700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1374021070 con 0x7f138c1578d0 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f138a59c700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.554+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f136c06eab0 con 0x7f138c1578d0 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.555+0000 7f138a59c700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 0x7f136c0693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1384007fd0 tx=0x7f13840016f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.559+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1374053380 con 0x7f138c1578d0 2023-10-09T11:46:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.754+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f138c0b5550 con 0x7f138c1578d0 2023-10-09T11:46:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.755+0000 7f13827fc700 1 -- 172.21.15.6:0/3779488530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+15393 (secure 0 0 0) 0x7f1374015070 con 0x7f138c1578d0 2023-10-09T11:46:40.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:40.757 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":166,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:10.974675+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:40.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 msgr2=0x7f136c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 0x7f136c0693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1384007fd0 tx=0x7f13840016f0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 msgr2=0x7f138c0abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f13740090b0 tx=0x7f1374017000 comp rx=0 tx=0).stop 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 shutdown_connections 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f138c157ca0 0x7f138c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f138c06d120 0x7f138c0ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 --2- 172.21.15.6:0/3779488530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f138c1578d0 0x7f138c0abf10 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 >> 172.21.15.6:0/3779488530 conn(0x7f138c06bb90 msgr2=0x7f138c15b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 shutdown_connections 2023-10-09T11:46:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.758+0000 7f1390fb5700 1 -- 172.21.15.6:0/3779488530 wait complete. 2023-10-09T11:46:40.772 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:46:40.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 Processor -- start 2023-10-09T11:46:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 -- start start 2023-10-09T11:46:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 0x7f34e40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40d07c0 con 0x7f34e41578d0 2023-10-09T11:46:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40cfbb0 con 0x7f34e4157ca0 2023-10-09T11:46:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34eabdf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40cfe90 con 0x7f34e406d830 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34e897b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34e41578d0 0x7f34e415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52498/0 (socket says 172.21.15.6:52498) 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.889+0000 7f34e897b700 1 -- 172.21.15.6:0/1010143601 learned_addr learned my addr 172.21.15.6:0/1010143601 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e917c700 1 --2- 172.21.15.6:0/1010143601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 0x7f34e40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402669811 0 0) 0x7f34e40d07c0 con 0x7f34e41578d0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d0003570 con 0x7f34e41578d0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610003208 0 0) 0x7f34e40cfbb0 con 0x7f34e4157ca0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e40d07c0 con 0x7f34e4157ca0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042842275 0 0) 0x7f34d0003570 con 0x7f34e41578d0 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e917c700 1 -- 172.21.15.6:0/1010143601 >> v1:172.21.15.118:6789/0 conn(0x7f34e4157ca0 legacy=0x7f34e406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e917c700 1 -- 172.21.15.6:0/1010143601 >> v1:172.21.15.6:6789/0 conn(0x7f34e41578d0 legacy=0x7f34e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e917c700 1 -- 172.21.15.6:0/1010143601 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40d0170 con 0x7f34e406d830 2023-10-09T11:46:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e917c700 1 --2- 172.21.15.6:0/1010143601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 0x7f34e40cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009910 tx=0x7f34cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c95713aa423f0c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc001470 con 0x7f34e406d830 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc011420 con 0x7f34e406d830 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.890+0000 7f34e37fe700 1 -- 172.21.15.6:0/1010143601 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0117a0 con 0x7f34e406d830 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 -- 172.21.15.6:0/1010143601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 msgr2=0x7f34e40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 --2- 172.21.15.6:0/1010143601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 0x7f34e40cf4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009910 tx=0x7f34cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 -- 172.21.15.6:0/1010143601 shutdown_connections 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 --2- 172.21.15.6:0/1010143601 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e406d830 0x7f34e40cf4f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 -- 172.21.15.6:0/1010143601 >> 172.21.15.6:0/1010143601 conn(0x7f34e406bb90 msgr2=0x7f34e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 -- 172.21.15.6:0/1010143601 shutdown_connections 2023-10-09T11:46:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.891+0000 7f34eabdf700 1 -- 172.21.15.6:0/1010143601 wait complete. 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.892+0000 7f34eabdf700 1 Processor -- start 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.892+0000 7f34eabdf700 1 -- start start 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e41578d0 0x7f34e414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 0x7f34e414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e413d030 con 0x7f34e406d830 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4152bd0 con 0x7f34e41578d0 2023-10-09T11:46:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34eabdf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4153550 con 0x7f34e4157ca0 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34756/0 (socket says 172.21.15.6:34756) 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 -- 172.21.15.6:0/2880314101 learned_addr learned my addr 172.21.15.6:0/2880314101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e917c700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 0x7f34e414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e3fff700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e41578d0 0x7f34e414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 -- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 msgr2=0x7f34e414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 0x7f34e414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 -- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e41578d0 msgr2=0x7f34e414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e41578d0 0x7f34e414f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009420 con 0x7f34e406d830 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e917c700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 0x7f34e414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.893+0000 7f34e897b700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00cb60 tx=0x7f34dc001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.894+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc007e90 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.894+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc007360 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.894+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e41528f0 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.894+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc004830 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.894+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e41531e0 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.895+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4067ac0 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.895+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34dc004ba0 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.896+0000 7f34e0ff9700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 0x7f34c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.896+0000 7f34e3fff700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 0x7f34c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.896+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f34dc083950 con 0x7f34e406d830 2023-10-09T11:46:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.896+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f34c406eab0 con 0x7f34e406d830 2023-10-09T11:46:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.896+0000 7f34e3fff700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 0x7f34c40693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007fd0 tx=0x7f34d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:40.900+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34dc018020 con 0x7f34e406d830 2023-10-09T11:46:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.138+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34e40d0450 con 0x7f34e406d830 2023-10-09T11:46:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.138+0000 7f34e0ff9700 1 -- 172.21.15.6:0/2880314101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f34dc050c20 con 0x7f34e406d830 2023-10-09T11:46:41.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:41.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:46:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 msgr2=0x7f34c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 0x7f34c40693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007fd0 tx=0x7f34d4009040 comp rx=0 tx=0).stop 2023-10-09T11:46:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 msgr2=0x7f34e416bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00cb60 tx=0x7f34dc001ad0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 shutdown_connections 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34c4066f30 0x7f34c40693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34e4157ca0 0x7f34e414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34e406d830 0x7f34e416bab0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 --2- 172.21.15.6:0/2880314101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34e41578d0 0x7f34e414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 >> 172.21.15.6:0/2880314101 conn(0x7f34e406bb90 msgr2=0x7f34e406d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 shutdown_connections 2023-10-09T11:46:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.140+0000 7f34eabdf700 1 -- 172.21.15.6:0/2880314101 wait complete. 2023-10-09T11:46:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:46:41.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:41.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.271+0000 7f708c64e700 1 Processor -- start 2023-10-09T11:46:41.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.271+0000 7f708c64e700 1 -- start start 2023-10-09T11:46:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708c64e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f708406d830 0x7f70840cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708c64e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70840d07c0 con 0x7f7084157ca0 2023-10-09T11:46:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708c64e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70840cfbb0 con 0x7f70841578d0 2023-10-09T11:46:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708c64e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70840cfe90 con 0x7f708406d830 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708abeb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f708406d830 0x7f70840cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f7089be9700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7084157ca0 0x7f708406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52504/0 (socket says 172.21.15.6:52504) 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f708abeb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f708406d830 0x7f70840cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34758/0 (socket says 172.21.15.6:34758) 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.272+0000 7f7089be9700 1 -- 172.21.15.6:0/759425929 learned_addr learned my addr 172.21.15.6:0/759425929 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708abeb700 1 -- 172.21.15.6:0/759425929 >> v1:172.21.15.118:6789/0 conn(0x7f70841578d0 legacy=0x7f708415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708abeb700 1 -- 172.21.15.6:0/759425929 >> v1:172.21.15.6:6789/0 conn(0x7f7084157ca0 legacy=0x7f708406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f70893e8700 1 -- 172.21.15.6:0/759425929 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014773299 0 0) 0x7f70840d07c0 con 0x7f7084157ca0 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708abeb700 1 -- 172.21.15.6:0/759425929 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840d0170 con 0x7f708406d830 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708abeb700 1 --2- 172.21.15.6:0/759425929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f70840cf4f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f70740098e0 tx=0x7f70740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163463d13a39677d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f70893e8700 1 -- 172.21.15.6:0/759425929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074009e80 con 0x7f708406d830 2023-10-09T11:46:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f70893e8700 1 -- 172.21.15.6:0/759425929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400b860 con 0x7f708406d830 2023-10-09T11:46:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f70893e8700 1 -- 172.21.15.6:0/759425929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400bbe0 con 0x7f708406d830 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708c64e700 1 -- 172.21.15.6:0/759425929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 msgr2=0x7f70840cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.273+0000 7f708c64e700 1 --2- 172.21.15.6:0/759425929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f70840cf4f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f70740098e0 tx=0x7f70740091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.274+0000 7f708c64e700 1 -- 172.21.15.6:0/759425929 shutdown_connections 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.274+0000 7f708c64e700 1 --2- 172.21.15.6:0/759425929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f70840cf4f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.274+0000 7f708c64e700 1 -- 172.21.15.6:0/759425929 >> 172.21.15.6:0/759425929 conn(0x7f708406bb90 msgr2=0x7f708406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.274+0000 7f708c64e700 1 -- 172.21.15.6:0/759425929 shutdown_connections 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.274+0000 7f708c64e700 1 -- 172.21.15.6:0/759425929 wait complete. 2023-10-09T11:46:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.275+0000 7f708c64e700 1 Processor -- start 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.275+0000 7f708c64e700 1 -- start start 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70841578d0 0x7f70841545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7084157ca0 0x7f7084159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840b3ba0 con 0x7f708406d830 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70840b3e70 con 0x7f70841578d0 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70840b4150 con 0x7f7084157ca0 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34772/0 (socket says 172.21.15.6:34772) 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 -- 172.21.15.6:0/2645002993 learned_addr learned my addr 172.21.15.6:0/2645002993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:41.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 -- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7084157ca0 msgr2=0x7f7084159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7084157ca0 0x7f7084159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 -- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70841578d0 msgr2=0x7f70841545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70841578d0 0x7f70841545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074009420 con 0x7f708406d830 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708a3ea700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f707c00cb10 tx=0x7f707c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00a760 con 0x7f708406d830 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c00a8e0 con 0x7f708406d830 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70840b4430 con 0x7f708406d830 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00aca0 con 0x7f708406d830 2023-10-09T11:46:41.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.276+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70840b49f0 con 0x7f708406d830 2023-10-09T11:46:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.277+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70840b4c10 con 0x7f708406d830 2023-10-09T11:46:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f707c003030 con 0x7f708406d830 2023-10-09T11:46:41.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f70827fc700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 0x7f70700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f707c0845f0 con 0x7f708406d830 2023-10-09T11:46:41.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f7089be9700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 0x7f70700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7f707006eab0 con 0x7f708406d830 2023-10-09T11:46:41.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.278+0000 7f7089be9700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 0x7f70700693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7078007fd0 tx=0x7f7078007bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.282+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f707c051840 con 0x7f708406d830 2023-10-09T11:46:41.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.520+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70840d0450 con 0x7f708406d830 2023-10-09T11:46:41.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.520+0000 7f70827fc700 1 -- 172.21.15.6:0/2645002993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f707c054e60 con 0x7f708406d830 2023-10-09T11:46:41.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:41.521 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:45:27.130855+0000","modified":"2023-10-09T11:45:30.985644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1955555002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1955555002},{"type":"v1","addr":"172.21.15.118:6835","nonce":1955555002}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 msgr2=0x7f70700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 0x7f70700693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7078007fd0 tx=0x7f7078007bb0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 msgr2=0x7f708413f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f707c00cb10 tx=0x7f707c0017b0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 shutdown_connections 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7070066f30 0x7f70700693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7084157ca0 0x7f7084159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f708406d830 0x7f708413f700 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 --2- 172.21.15.6:0/2645002993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70841578d0 0x7f70841545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 >> 172.21.15.6:0/2645002993 conn(0x7f708406bb90 msgr2=0x7f7084069110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 shutdown_connections 2023-10-09T11:46:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.522+0000 7f708c64e700 1 -- 172.21.15.6:0/2645002993 wait complete. 2023-10-09T11:46:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 84 2023-10-09T11:46:41.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:41.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.653+0000 7fbc9b387700 1 Processor -- start 2023-10-09T11:46:41.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 -- start start 2023-10-09T11:46:41.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc940cf240 0x7fbc940b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 0x7fbc9406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc940b0ca0 con 0x7fbc9415a2a0 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9406ea90 con 0x7fbc940cf240 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.654+0000 7fbc9b387700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940b00d0 con 0x7fbc9406d650 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc99123700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc9415a2a0 0x7fbc940ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52520/0 (socket says 172.21.15.6:52520) 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc940cf240 0x7fbc940b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc99123700 1 -- 172.21.15.6:0/2190294266 learned_addr learned my addr 172.21.15.6:0/2190294266 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc99924700 1 --2- 172.21.15.6:0/2190294266 >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 0x7fbc9406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 -- 172.21.15.6:0/2190294266 >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 msgr2=0x7fbc9406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 --2- 172.21.15.6:0/2190294266 >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 0x7fbc9406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 -- 172.21.15.6:0/2190294266 >> v1:172.21.15.6:6789/0 conn(0x7fbc9415a2a0 legacy=0x7fbc940ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 -- 172.21.15.6:0/2190294266 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940b0370 con 0x7fbc940cf240 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc99924700 1 --2- 172.21.15.6:0/2190294266 >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 0x7fbc9406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc93fff700 1 -- 172.21.15.6:0/2190294266 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468119299 0 0) 0x7fbc940b0ca0 con 0x7fbc9415a2a0 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc98922700 1 --2- 172.21.15.6:0/2190294266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc940b1130 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fbc9406a680 tx=0x7fbc880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208c146116ec2bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc93fff700 1 -- 172.21.15.6:0/2190294266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b6b0 con 0x7fbc940cf240 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc93fff700 1 -- 172.21.15.6:0/2190294266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b810 con 0x7fbc940cf240 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.655+0000 7fbc93fff700 1 -- 172.21.15.6:0/2190294266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bbb0 con 0x7fbc940cf240 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 -- 172.21.15.6:0/2190294266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 msgr2=0x7fbc940b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 --2- 172.21.15.6:0/2190294266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc940b1130 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fbc9406a680 tx=0x7fbc880091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 -- 172.21.15.6:0/2190294266 shutdown_connections 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 --2- 172.21.15.6:0/2190294266 >> v2:172.21.15.118:3300/0 conn(0x7fbc9406d650 0x7fbc9406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 --2- 172.21.15.6:0/2190294266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc940b1130 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 -- 172.21.15.6:0/2190294266 >> 172.21.15.6:0/2190294266 conn(0x7fbc94067640 msgr2=0x7fbc94067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 -- 172.21.15.6:0/2190294266 shutdown_connections 2023-10-09T11:46:41.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.656+0000 7fbc9b387700 1 -- 172.21.15.6:0/2190294266 wait complete. 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.657+0000 7fbc9b387700 1 Processor -- start 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.657+0000 7fbc9b387700 1 -- start start 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc9406d650 0x7fbc94145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 0x7fbc9415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9415ce20 con 0x7fbc940cf240 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9416a6a0 con 0x7fbc9406d650 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc9b387700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9416e0c0 con 0x7fbc9415a2a0 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34788/0 (socket says 172.21.15.6:34788) 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 -- 172.21.15.6:0/491309861 learned_addr learned my addr 172.21.15.6:0/491309861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc99123700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc9406d650 0x7fbc94145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc99924700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 0x7fbc9415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 -- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 msgr2=0x7fbc9415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 0x7fbc9415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 -- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc9406d650 msgr2=0x7fbc94145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc9406d650 0x7fbc94145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009420 con 0x7fbc940cf240 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc99924700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 0x7fbc9415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.658+0000 7fbc98922700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fbc88013000 tx=0x7fbc88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.659+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bb90 con 0x7fbc940cf240 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.659+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88011420 con 0x7fbc940cf240 2023-10-09T11:46:41.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.659+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9416e3a0 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.659+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc880117a0 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.659+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9416e960 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.660+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc94069e40 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.660+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc88011b90 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.660+0000 7fbc917fa700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 0x7fbc800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.660+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fbc88085ef0 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.660+0000 7fbc99123700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 0x7fbc800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.661+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7fbc8006eab0 con 0x7fbc940cf240 2023-10-09T11:46:41.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.661+0000 7fbc99123700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 0x7fbc800693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c8f0 tx=0x7fbc8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:41.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.665+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc88053140 con 0x7fbc940cf240 2023-10-09T11:46:41.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.860+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc9416a7e0 con 0x7fbc940cf240 2023-10-09T11:46:41.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.861+0000 7fbc917fa700 1 -- 172.21.15.6:0/491309861 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+15393 (secure 0 0 0) 0x7fbc88015070 con 0x7fbc940cf240 2023-10-09T11:46:41.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:41.862 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":166,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:10.974675+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:45:25.538714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-09T11:45:26.103334+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3c","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 msgr2=0x7fbc800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 0x7fbc800693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c8f0 tx=0x7fbc8c009040 comp rx=0 tx=0).stop 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 msgr2=0x7fbc9415c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fbc88013000 tx=0x7fbc88017000 comp rx=0 tx=0).stop 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 shutdown_connections 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbc80066f30 0x7fbc800693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc9415a2a0 0x7fbc9415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc9406d650 0x7fbc94145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 --2- 172.21.15.6:0/491309861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc940cf240 0x7fbc9415c8e0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 >> 172.21.15.6:0/491309861 conn(0x7fbc94067640 msgr2=0x7fbc94157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 shutdown_connections 2023-10-09T11:46:41.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.863+0000 7fbc9b387700 1 -- 172.21.15.6:0/491309861 wait complete. 2023-10-09T11:46:41.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:46:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.995+0000 7fee7808a700 1 Processor -- start 2023-10-09T11:46:41.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.996+0000 7fee7808a700 1 -- start start 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.996+0000 7fee7808a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fee700cae00 0x7fee700aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.996+0000 7fee7808a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 0x7fee700aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.996+0000 7fee7808a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7006d350 con 0x7fee7015daa0 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee7808a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700c9ac0 con 0x7fee700cae00 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee7808a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7006c740 con 0x7fee700cb2a0 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee75e26700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee7015daa0 0x7fee7015de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52534/0 (socket says 172.21.15.6:52534) 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee75e26700 1 -- 172.21.15.6:0/761501841 learned_addr learned my addr 172.21.15.6:0/761501841 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:41.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 --2- 172.21.15.6:0/761501841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 0x7fee700aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee75625700 1 --2- 172.21.15.6:0/761501841 >> v2:172.21.15.118:3300/0 conn(0x7fee700cae00 0x7fee700aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee74e24700 1 -- 172.21.15.6:0/761501841 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935843105 0 0) 0x7fee7006d350 con 0x7fee7015daa0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee74e24700 1 -- 172.21.15.6:0/761501841 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003570 con 0x7fee7015daa0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 -- 172.21.15.6:0/761501841 >> v2:172.21.15.118:3300/0 conn(0x7fee700cae00 msgr2=0x7fee700aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 --2- 172.21.15.6:0/761501841 >> v2:172.21.15.118:3300/0 conn(0x7fee700cae00 0x7fee700aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 -- 172.21.15.6:0/761501841 >> v1:172.21.15.6:6789/0 conn(0x7fee7015daa0 legacy=0x7fee7015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 -- 172.21.15.6:0/761501841 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7006ca20 con 0x7fee700cb2a0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.997+0000 7fee76627700 1 --2- 172.21.15.6:0/761501841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 0x7fee700aadd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e60 tx=0x7fee60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d359f0621e6702 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee74e24700 1 -- 172.21.15.6:0/761501841 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000e070 con 0x7fee700cb2a0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee74e24700 1 -- 172.21.15.6:0/761501841 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000bab0 con 0x7fee700cb2a0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee74e24700 1 -- 172.21.15.6:0/761501841 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000be70 con 0x7fee700cb2a0 2023-10-09T11:46:42.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 -- 172.21.15.6:0/761501841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 msgr2=0x7fee700aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 --2- 172.21.15.6:0/761501841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 0x7fee700aadd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e60 tx=0x7fee60009780 comp rx=0 tx=0).stop 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 -- 172.21.15.6:0/761501841 shutdown_connections 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 --2- 172.21.15.6:0/761501841 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cb2a0 0x7fee700aadd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 --2- 172.21.15.6:0/761501841 >> v2:172.21.15.118:3300/0 conn(0x7fee700cae00 0x7fee700aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 -- 172.21.15.6:0/761501841 >> 172.21.15.6:0/761501841 conn(0x7fee700c9ca0 msgr2=0x7fee700ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 -- 172.21.15.6:0/761501841 shutdown_connections 2023-10-09T11:46:42.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.998+0000 7fee7808a700 1 -- 172.21.15.6:0/761501841 wait complete. 2023-10-09T11:46:42.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.999+0000 7fee7808a700 1 Processor -- start 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:41.999+0000 7fee7808a700 1 -- start start 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cae00 0x7fee7015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee700cb2a0 0x7fee700ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7016ab90 con 0x7fee7015daa0 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7016b020 con 0x7fee700cb2a0 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee7808a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7016a260 con 0x7fee700cae00 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34796/0 (socket says 172.21.15.6:34796) 2023-10-09T11:46:42.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 -- 172.21.15.6:0/879835478 learned_addr learned my addr 172.21.15.6:0/879835478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee75625700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee700cb2a0 0x7fee700ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee75e26700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cae00 0x7fee7015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 -- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cae00 msgr2=0x7fee7015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cae00 0x7fee7015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 -- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee700cb2a0 msgr2=0x7fee700ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.000+0000 7fee76627700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee700cb2a0 0x7fee700ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee76627700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009a20 con 0x7fee7015daa0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee76627700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fee7006d9b0 tx=0x7fee60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60012e10 con 0x7fee7015daa0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60027470 con 0x7fee7015daa0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7016a540 con 0x7fee7015daa0 2023-10-09T11:46:42.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60027830 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.001+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee700ac070 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.002+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7016a3a0 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.002+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee60024070 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.003+0000 7fee6dffb700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.003+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fee60086f70 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.003+0000 7fee75e26700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.003+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=167}) v3 -- 0x7fee5c06eab0 con 0x7fee7015daa0 2023-10-09T11:46:42.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.003+0000 7fee75e26700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fee68007fd0 tx=0x7fee68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.007+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee600b85a0 con 0x7fee7015daa0 2023-10-09T11:46:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.246+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fee7016acd0 con 0x7fee7015daa0 2023-10-09T11:46:42.247 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:46:42.247+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:46:42.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.248+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(167..167 src has 1..167) v4 ==== 366+0+0 (secure 0 0 0) 0x7fee60057e80 con 0x7fee7015daa0 2023-10-09T11:46:42.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.249+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fee5c06f400 con 0x7fee7015daa0 2023-10-09T11:46:42.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.251+0000 7fee6dffb700 1 -- 172.21.15.6:0/879835478 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7fee6002c060 con 0x7fee7015daa0 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 msgr2=0x7fee5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fee68007fd0 tx=0x7fee68009040 comp rx=0 tx=0).stop 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 msgr2=0x7fee700b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fee7006d9b0 tx=0x7fee60019000 comp rx=0 tx=0).stop 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 shutdown_connections 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7015daa0 0x7fee700b1fe0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fee700cae00 0x7fee7015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 --2- 172.21.15.6:0/879835478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee700cb2a0 0x7fee700ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.253+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 >> 172.21.15.6:0/879835478 conn(0x7fee700c9ca0 msgr2=0x7fee7015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.254+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 shutdown_connections 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.254+0000 7fee7808a700 1 -- 172.21.15.6:0/879835478 wait complete. 2023-10-09T11:46:42.255 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:46:42.256 INFO:tasks.ceph.mds.d.smithi118.stderr: -8338> 2023-10-09T11:45:33.060+0000 7fd2b9c65700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:46:42.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:46:42.285 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:46:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.386+0000 7f8182da1700 1 Processor -- start 2023-10-09T11:46:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.386+0000 7f8182da1700 1 -- start start 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f8182da1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f817c1578d0 0x7f817c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f8182da1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 0x7f817c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f8182da1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0d07c0 con 0x7f817c06d120 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f8182da1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0cfbb0 con 0x7f817c1578d0 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f8182da1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0cfe90 con 0x7f817c157ca0 2023-10-09T11:46:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f818133e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f817c06d120 0x7f817c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52546/0 (socket says 172.21.15.6:52546) 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.387+0000 7f818133e700 1 -- 172.21.15.6:0/1626863805 learned_addr learned my addr 172.21.15.6:0/1626863805 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 --2- 172.21.15.6:0/1626863805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 0x7f817c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f8180b3d700 1 --2- 172.21.15.6:0/1626863805 >> v2:172.21.15.118:3300/0 conn(0x7f817c1578d0 0x7f817c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817b7fe700 1 -- 172.21.15.6:0/1626863805 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330778095 0 0) 0x7f817c0d07c0 con 0x7f817c06d120 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817b7fe700 1 -- 172.21.15.6:0/1626863805 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8168003570 con 0x7f817c06d120 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 -- 172.21.15.6:0/1626863805 >> v2:172.21.15.118:3300/0 conn(0x7f817c1578d0 msgr2=0x7f817c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 --2- 172.21.15.6:0/1626863805 >> v2:172.21.15.118:3300/0 conn(0x7f817c1578d0 0x7f817c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 -- 172.21.15.6:0/1626863805 >> v1:172.21.15.6:6789/0 conn(0x7f817c06d120 legacy=0x7f817c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 -- 172.21.15.6:0/1626863805 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0d0170 con 0x7f817c157ca0 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817bfff700 1 --2- 172.21.15.6:0/1626863805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 0x7f817c15af00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e60 tx=0x7f816c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2a8bedbfe9b7ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817b7fe700 1 -- 172.21.15.6:0/1626863805 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00e070 con 0x7f817c157ca0 2023-10-09T11:46:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817b7fe700 1 -- 172.21.15.6:0/1626863805 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c00bab0 con 0x7f817c157ca0 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.388+0000 7f817b7fe700 1 -- 172.21.15.6:0/1626863805 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00be70 con 0x7f817c157ca0 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 -- 172.21.15.6:0/1626863805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 msgr2=0x7f817c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 --2- 172.21.15.6:0/1626863805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 0x7f817c15af00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e60 tx=0x7f816c009780 comp rx=0 tx=0).stop 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 -- 172.21.15.6:0/1626863805 shutdown_connections 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 --2- 172.21.15.6:0/1626863805 >> v2:172.21.15.118:3300/0 conn(0x7f817c1578d0 0x7f817c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 --2- 172.21.15.6:0/1626863805 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c157ca0 0x7f817c15af00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 -- 172.21.15.6:0/1626863805 >> 172.21.15.6:0/1626863805 conn(0x7f817c06bb90 msgr2=0x7f817c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 -- 172.21.15.6:0/1626863805 shutdown_connections 2023-10-09T11:46:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.389+0000 7f8182da1700 1 -- 172.21.15.6:0/1626863805 wait complete. 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.390+0000 7f8182da1700 1 Processor -- start 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.390+0000 7f8182da1700 1 -- start start 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 0x7f817c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f817c1578d0 0x7f817c16b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0c7180 con 0x7f817c157ca0 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c16b5c0 con 0x7f817c1578d0 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8182da1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0c60e0 con 0x7f817c06d120 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34808/0 (socket says 172.21.15.6:34808) 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 -- 172.21.15.6:0/2170742573 learned_addr learned my addr 172.21.15.6:0/2170742573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8180b3d700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 0x7f817c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f817bfff700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f817c1578d0 0x7f817c16b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 -- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 msgr2=0x7f817c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 0x7f817c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 -- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f817c1578d0 msgr2=0x7f817c16b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f817c1578d0 0x7f817c16b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f818133e700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009a20 con 0x7f817c157ca0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.391+0000 7f8180b3d700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 0x7f817c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f818133e700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f81640010e0 tx=0x7f8164007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164005c00 con 0x7f817c157ca0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8164005d60 con 0x7f817c157ca0 2023-10-09T11:46:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0c63c0 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640072e0 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.392+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c0c6980 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.393+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c067ac0 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.393+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8164007650 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.393+0000 7f8178ff9700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 0x7f815c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.394+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f8164083aa0 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.394+0000 7f8180b3d700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 0x7f815c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.394+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f815c06eb50 con 0x7f817c157ca0 2023-10-09T11:46:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.394+0000 7f8180b3d700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 0x7f815c0693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f817c0b6410 tx=0x7f8174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.398+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f816404b5a0 con 0x7f817c157ca0 2023-10-09T11:46:42.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:42.634+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f817c0d0450 con 0x7f817c157ca0 2023-10-09T11:46:43.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.258+0000 7f8178ff9700 1 -- 172.21.15.6:0/2170742573 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8164017020 con 0x7f817c157ca0 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 msgr2=0x7f815c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 0x7f815c0693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f817c0b6410 tx=0x7f8174008040 comp rx=0 tx=0).stop 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 msgr2=0x7f817c0c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f81640010e0 tx=0x7f8164007dd0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 shutdown_connections 2023-10-09T11:46:43.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f815c066f30 0x7f815c0693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c157ca0 0x7f817c0c7b40 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f817c06d120 0x7f817c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 --2- 172.21.15.6:0/2170742573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f817c1578d0 0x7f817c16b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 >> 172.21.15.6:0/2170742573 conn(0x7f817c06bb90 msgr2=0x7f817c156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 shutdown_connections 2023-10-09T11:46:43.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.261+0000 7f8182da1700 1 -- 172.21.15.6:0/2170742573 wait complete. 2023-10-09T11:46:43.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:46:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.400+0000 7f2df5773700 1 Processor -- start 2023-10-09T11:46:43.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.400+0000 7f2df5773700 1 -- start start 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2df5773700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df006d830 0x7f2df00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2df5773700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00d07c0 con 0x7f2df01578d0 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2df5773700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df00cfbb0 con 0x7f2df0157ca0 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2df5773700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00cfe90 con 0x7f2df006d830 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2deeffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2df01578d0 0x7f2df015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60342/0 (socket says 172.21.15.6:60342) 2023-10-09T11:46:43.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2deeffd700 1 -- 172.21.15.6:0/4274327815 learned_addr learned my addr 172.21.15.6:0/4274327815 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df006d830 0x7f2df00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990714069 0 0) 0x7f2df00d07c0 con 0x7f2df01578d0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ddc003570 con 0x7f2df01578d0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96121946 0 0) 0x7f2ddc003570 con 0x7f2df01578d0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df006d830 msgr2=0x7f2df00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df006d830 0x7f2df00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 >> v1:172.21.15.118:6789/0 conn(0x7f2df0157ca0 legacy=0x7f2df006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00d0170 con 0x7f2df01578d0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f2de8001470 con 0x7f2df01578d0 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 >> v1:172.21.15.6:6789/0 conn(0x7f2df01578d0 legacy=0x7f2df015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ddc003a90 0x7f2ddc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc0043e0 0x7f2ddc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ddc0050b0 0x7f2ddc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00cfe90 con 0x7f2ddc0050b0 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc00bfa0 con 0x7f2ddc0043e0 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc00c160 con 0x7f2ddc003a90 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.401+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df006d830 0x7f2df00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2deeffd700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ddc003a90 0x7f2ddc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2dee7fc700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc0043e0 0x7f2ddc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ddc0050b0 0x7f2ddc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 -- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ddc003a90 msgr2=0x7f2ddc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:43.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ddc003a90 0x7f2ddc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 -- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc0043e0 msgr2=0x7f2ddc0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc0043e0 0x7f2ddc0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 -- 172.21.15.6:0/4274327815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc003570 con 0x7f2ddc0050b0 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2dee7fc700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ddc0043e0 0x7f2ddc0048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2def7fe700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ddc0050b0 0x7f2ddc00ba60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2df006dc00 tx=0x7f2de000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f1644d264d986 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000ead0 con 0x7f2ddc0050b0 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000f040 con 0x7f2ddc0050b0 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.402+0000 7f2dedffb700 1 -- 172.21.15.6:0/4274327815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000ee80 con 0x7f2ddc0050b0 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 -- 172.21.15.6:0/4274327815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ddc0050b0 msgr2=0x7f2ddc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 --2- 172.21.15.6:0/4274327815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ddc0050b0 0x7f2ddc00ba60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2df006dc00 tx=0x7f2de000b040 comp rx=0 tx=0).stop 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2def7fe700 1 -- 172.21.15.6:0/4274327815 reap_dead start 2023-10-09T11:46:43.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 -- 172.21.15.6:0/4274327815 shutdown_connections 2023-10-09T11:46:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 -- 172.21.15.6:0/4274327815 >> 172.21.15.6:0/4274327815 conn(0x7f2df006bb90 msgr2=0x7f2df006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 -- 172.21.15.6:0/4274327815 shutdown_connections 2023-10-09T11:46:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.403+0000 7f2df5773700 1 -- 172.21.15.6:0/4274327815 wait complete. 2023-10-09T11:46:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.404+0000 7f2df5773700 1 Processor -- start 2023-10-09T11:46:43.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.404+0000 7f2df5773700 1 -- start start 2023-10-09T11:46:43.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df0155010 0x7f2df00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df00c7b80 0x7f2df00ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00cc930 con 0x7f2df01553e0 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00c8010 con 0x7f2df0155010 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00c82f0 con 0x7f2df00c7b80 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53824/0 (socket says 172.21.15.6:53824) 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 -- 172.21.15.6:0/1140378507 learned_addr learned my addr 172.21.15.6:0/1140378507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:43.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2deeffd700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df0155010 0x7f2df00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2def7fe700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df00c7b80 0x7f2df00ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 -- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df00c7b80 msgr2=0x7f2df00ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df00c7b80 0x7f2df00ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 -- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df0155010 msgr2=0x7f2df00c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df0155010 0x7f2df00c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00c85d0 con 0x7f2df01553e0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2dee7fc700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800fc00 tx=0x7f2dd8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800d850 con 0x7f2df01553e0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800d9b0 con 0x7f2df01553e0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800dd50 con 0x7f2df01553e0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.405+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df00c88b0 con 0x7f2df01553e0 2023-10-09T11:46:43.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.406+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df00ca800 con 0x7f2df01553e0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.406+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df00cda80 con 0x7f2df01553e0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.407+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2dd8013600 con 0x7f2df01553e0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.407+0000 7f2de6ffd700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.407+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f2dd80847d0 con 0x7f2df01553e0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.407+0000 7f2deeffd700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.407+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f2dd006eb50 con 0x7f2df01553e0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.408+0000 7f2deeffd700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001ed0 tx=0x7f2df015b610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:43.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.411+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dd80519d0 con 0x7f2df01553e0 2023-10-09T11:46:43.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:43.604+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2df00d0450 con 0x7f2df01553e0 2023-10-09T11:46:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.263+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(168..168 src has 1..168) v4 ==== 288+0+0 (secure 0 0 0) 0x7f2dd8055d90 con 0x7f2df01553e0 2023-10-09T11:46:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.264+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f2dd006cf80 con 0x7f2df01553e0 2023-10-09T11:46:44.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.268+0000 7f2de6ffd700 1 -- 172.21.15.6:0/1140378507 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2dd8054ff0 con 0x7f2df01553e0 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.271+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 msgr2=0x7f2dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.271+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001ed0 tx=0x7f2df015b610 comp rx=0 tx=0).stop 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.271+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 msgr2=0x7f2df00cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.271+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800fc00 tx=0x7f2dd8009040 comp rx=0 tx=0).stop 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 shutdown_connections 2023-10-09T11:46:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2df00c7b80 0x7f2df00ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2df0155010 0x7f2df00c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 --2- 172.21.15.6:0/1140378507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2df01553e0 0x7f2df00cd540 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 >> 172.21.15.6:0/1140378507 conn(0x7f2df006bb90 msgr2=0x7f2df01568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 shutdown_connections 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.272+0000 7f2df5773700 1 -- 172.21.15.6:0/1140378507 wait complete. 2023-10-09T11:46:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:46:44.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:46:44.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.411+0000 7fabc9c52700 1 Processor -- start 2023-10-09T11:46:44.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.411+0000 7fabc9c52700 1 -- start start 2023-10-09T11:46:44.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc9c52700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabc40cf240 0x7fabc40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc9c52700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc40b0ca0 con 0x7fabc406d650 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc9c52700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc40b00d0 con 0x7fabc415a2a0 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc9c52700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc406ea90 con 0x7fabc40cf240 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fabc406d650 0x7fabc406da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60346/0 (socket says 172.21.15.6:60346) 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc3fff700 1 -- 172.21.15.6:0/2376510779 learned_addr learned my addr 172.21.15.6:0/2376510779 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc2ffd700 1 --2- 172.21.15.6:0/2376510779 >> v2:172.21.15.118:3300/0 conn(0x7fabc40cf240 0x7fabc40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468603395 0 0) 0x7fabc40b0ca0 con 0x7fabc406d650 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabac003570 con 0x7fabc406d650 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2074393175 0 0) 0x7fabac003570 con 0x7fabc406d650 2023-10-09T11:46:44.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 >> v2:172.21.15.118:3300/0 conn(0x7fabc40cf240 msgr2=0x7fabc40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 --2- 172.21.15.6:0/2376510779 >> v2:172.21.15.118:3300/0 conn(0x7fabc40cf240 0x7fabc40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 >> v1:172.21.15.118:6789/0 conn(0x7fabc415a2a0 legacy=0x7fabc40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40b0370 con 0x7fabc406d650 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fabbc0017f0 con 0x7fabc406d650 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 >> v1:172.21.15.6:6789/0 conn(0x7fabc406d650 legacy=0x7fabc406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 0x7fabac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac004810 0x7fabac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabac0051c0 0x7fabac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc406ea90 con 0x7fabac003a60 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac00c0d0 con 0x7fabac004810 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.412+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac00c290 con 0x7fabac0051c0 2023-10-09T11:46:44.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 0x7fabac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc2ffd700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac004810 0x7fabac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc3fff700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabac0051c0 0x7fabac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 -- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabac0051c0 msgr2=0x7fabac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabac0051c0 0x7fabac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 -- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac004810 msgr2=0x7fabac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac004810 0x7fabac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 -- 172.21.15.6:0/2376510779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac003570 con 0x7fabac003a60 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc3fff700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabac0051c0 0x7fabac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc3fff700 1 -- 172.21.15.6:0/2376510779 reap_dead start 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc37fe700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 0x7fabac003e70 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fabb40018b0 tx=0x7fabb4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdbb44342c3260 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:44.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4012420 con 0x7fabac003a60 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb40125a0 con 0x7fabac003a60 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.413+0000 7fabc27fc700 1 -- 172.21.15.6:0/2376510779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4012960 con 0x7fabac003a60 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 -- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 msgr2=0x7fabac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 0x7fabac003e70 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fabb40018b0 tx=0x7fabb4007d30 comp rx=0 tx=0).stop 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 -- 172.21.15.6:0/2376510779 shutdown_connections 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 --2- 172.21.15.6:0/2376510779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabac003a60 0x7fabac003e70 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 -- 172.21.15.6:0/2376510779 >> 172.21.15.6:0/2376510779 conn(0x7fabc4067640 msgr2=0x7fabc4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 -- 172.21.15.6:0/2376510779 shutdown_connections 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.414+0000 7fabc9c52700 1 -- 172.21.15.6:0/2376510779 wait complete. 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.415+0000 7fabc9c52700 1 Processor -- start 2023-10-09T11:46:44.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.415+0000 7fabc9c52700 1 -- start start 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac003a60 0x7fabc414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabc4150340 0x7fabc40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc416a850 con 0x7fabc40ae0f0 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40ae540 con 0x7fabac003a60 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40b2060 con 0x7fabc4150340 2023-10-09T11:46:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53828/0 (socket says 172.21.15.6:53828) 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 -- 172.21.15.6:0/1191007018 learned_addr learned my addr 172.21.15.6:0/1191007018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc2ffd700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabc4150340 0x7fabc40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc37fe700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac003a60 0x7fabc414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 -- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabc4150340 msgr2=0x7fabc40adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabc4150340 0x7fabc40adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 -- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac003a60 msgr2=0x7fabc414fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac003a60 0x7fabc414fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40b2340 con 0x7fabc40ae0f0 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc3fff700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fabbc001f80 tx=0x7fabc40b0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:44.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00eba0 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc00ed00 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc40b2620 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.416+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc013670 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.417+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc40b2be0 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.417+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40b2da0 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.418+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabbc013a20 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.418+0000 7fabab7fe700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 0x7fabb0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.418+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fabbc084890 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.418+0000 7fabc37fe700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 0x7fabb0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.418+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7fabb006dd80 con 0x7fabc40ae0f0 2023-10-09T11:46:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.419+0000 7fabc37fe700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 0x7fabb0069410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fabb40018b0 tx=0x7fabb4015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.422+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabbc051c40 con 0x7fabc40ae0f0 2023-10-09T11:46:44.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:44.615+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fabc4068550 con 0x7fabc40ae0f0 2023-10-09T11:46:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.269+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 7 ==== osd_map(169..169 src has 1..169) v4 ==== 305+0+0 (secure 0 0 0) 0x7fabbc00ee70 con 0x7fabc40ae0f0 2023-10-09T11:46:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.269+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=170}) v3 -- 0x7fabb006cb10 con 0x7fabc40ae0f0 2023-10-09T11:46:45.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.271+0000 7fabab7fe700 1 -- 172.21.15.6:0/1191007018 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) v1 ==== 169+0+0 (secure 0 0 0) 0x7fabbc055260 con 0x7fabc40ae0f0 2023-10-09T11:46:45.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 msgr2=0x7fabb0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 0x7fabb0069410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fabb40018b0 tx=0x7fabb4015000 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 msgr2=0x7fabc41532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fabbc001f80 tx=0x7fabc40b0260 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 shutdown_connections 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fabb0066f60 0x7fabb0069410 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabc40ae0f0 0x7fabc41532a0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabac003a60 0x7fabc414fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 --2- 172.21.15.6:0/1191007018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabc4150340 0x7fabc40adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 >> 172.21.15.6:0/1191007018 conn(0x7fabc4067640 msgr2=0x7fabc406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 shutdown_connections 2023-10-09T11:46:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.278+0000 7fabc9c52700 1 -- 172.21.15.6:0/1191007018 wait complete. 2023-10-09T11:46:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:46:45.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:46:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.415+0000 7f207a443700 1 Processor -- start 2023-10-09T11:46:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.415+0000 7f207a443700 1 -- start start 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f207a443700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20741578d0 0x7f20740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f207a443700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20740d07c0 con 0x7f2074157ca0 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f207a443700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20740cfbb0 con 0x7f207406d120 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f207a443700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740cfe90 con 0x7f20741578d0 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f20737fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2074157ca0 0x7f207415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60348/0 (socket says 172.21.15.6:60348) 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f20737fe700 1 -- 172.21.15.6:0/1034507264 learned_addr learned my addr 172.21.15.6:0/1034507264 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.416+0000 7f2073fff700 1 --2- 172.21.15.6:0/1034507264 >> v2:172.21.15.118:3300/0 conn(0x7f20741578d0 0x7f20740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917090476 0 0) 0x7f20740d07c0 con 0x7f2074157ca0 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2060003570 con 0x7f2074157ca0 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249774146 0 0) 0x7f20740cfbb0 con 0x7f207406d120 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20740d07c0 con 0x7f207406d120 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234775330 0 0) 0x7f2060003570 con 0x7f2074157ca0 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 >> v2:172.21.15.118:3300/0 conn(0x7f20741578d0 msgr2=0x7f20740cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 --2- 172.21.15.6:0/1034507264 >> v2:172.21.15.118:3300/0 conn(0x7f20741578d0 0x7f20740cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 >> v1:172.21.15.118:6789/0 conn(0x7f207406d120 legacy=0x7f207406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740d0170 con 0x7f2074157ca0 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f2064001470 con 0x7f2074157ca0 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 >> v1:172.21.15.6:6789/0 conn(0x7f2074157ca0 legacy=0x7f207415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2060003bf0 0x7f2060003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740cfe90 con 0x7f20600051c0 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206000c0b0 con 0x7f2060004810 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206000c270 con 0x7f2060003bf0 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f2073fff700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2060003bf0 0x7f2060003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20737fe700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 -- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2060003bf0 msgr2=0x7f2060003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2060003bf0 0x7f2060003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 -- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2060004810 msgr2=0x7f2060004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2060004810 0x7f2060004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.417+0000 7f20789e0700 1 -- 172.21.15.6:0/1034507264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060003570 con 0x7f20600051c0 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f20789e0700 1 -- 172.21.15.6:0/1034507264 reap_dead start 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f20789e0700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 0x7f206000ba60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f206c002120 tx=0x7f206c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0d7edf03d42e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c00c980 con 0x7f20600051c0 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c00cae0 con 0x7f20600051c0 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f2072ffd700 1 -- 172.21.15.6:0/1034507264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c00ce80 con 0x7f20600051c0 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 -- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 msgr2=0x7f206000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 0x7f206000ba60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f206c002120 tx=0x7f206c0017a0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 -- 172.21.15.6:0/1034507264 shutdown_connections 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 --2- 172.21.15.6:0/1034507264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20600051c0 0x7f206000ba60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 -- 172.21.15.6:0/1034507264 >> 172.21.15.6:0/1034507264 conn(0x7f207406bb90 msgr2=0x7f207406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 -- 172.21.15.6:0/1034507264 shutdown_connections 2023-10-09T11:46:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.418+0000 7f207a443700 1 -- 172.21.15.6:0/1034507264 wait complete. 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 Processor -- start 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 -- start start 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20600051c0 0x7f207414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20740b4850 0x7f20740b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740b5210 con 0x7f207415c050 2023-10-09T11:46:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2074152210 con 0x7f20600051c0 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.420+0000 7f207a443700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207415c620 con 0x7f20740b4850 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53854/0 (socket says 172.21.15.6:53854) 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 -- 172.21.15.6:0/2183156909 learned_addr learned my addr 172.21.15.6:0/2183156909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f2073fff700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20600051c0 0x7f207414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20789e0700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20740b4850 0x7f20740b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 -- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20740b4850 msgr2=0x7f20740b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20740b4850 0x7f20740b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 -- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20600051c0 msgr2=0x7f207414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20600051c0 0x7f207414de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 -- 172.21.15.6:0/2183156909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207415c900 con 0x7f207415c050 2023-10-09T11:46:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f20737fe700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2064007390 tx=0x7f2064001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064018030 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064011590 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207415cbe0 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064011930 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.421+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20740b3cc0 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.422+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20741523a0 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.423+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f206401b070 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.423+0000 7f206bfff700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 0x7f20540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.423+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2064019070 con 0x7f207415c050 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.423+0000 7f2073fff700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 0x7f20540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.424+0000 7f2073fff700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 0x7f20540693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f205c006f00 tx=0x7f205c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.428+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2064051440 con 0x7f207415c050 2023-10-09T11:46:45.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.621+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f20740d0450 con 0x7f207415c050 2023-10-09T11:46:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.625+0000 7f206bfff700 1 -- 172.21.15.6:0/2183156909 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2064054a60 con 0x7f207415c050 2023-10-09T11:46:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 msgr2=0x7f20540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 0x7f20540693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f205c006f00 tx=0x7f205c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 msgr2=0x7f2074141950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2064007390 tx=0x7f2064001df0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 shutdown_connections 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2054066f30 0x7f20540693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20740b4850 0x7f20740b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20600051c0 0x7f207414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 --2- 172.21.15.6:0/2183156909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f207415c050 0x7f2074141950 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 >> 172.21.15.6:0/2183156909 conn(0x7f207406bb90 msgr2=0x7f2074068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 shutdown_connections 2023-10-09T11:46:45.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.627+0000 7f207a443700 1 -- 172.21.15.6:0/2183156909 wait complete. 2023-10-09T11:46:45.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-09T11:46:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.758+0000 7f62812e1700 1 Processor -- start 2023-10-09T11:46:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.758+0000 7f62812e1700 1 -- start start 2023-10-09T11:46:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f62812e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f627c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f62812e1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0d07c0 con 0x7f627c157ca0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f62812e1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0cfbb0 con 0x7f627c1578d0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f62812e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0cfe90 con 0x7f627c06d830 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f627a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f627c157ca0 0x7f627c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60364/0 (socket says 172.21.15.6:60364) 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.759+0000 7f627a7fc700 1 -- 172.21.15.6:0/2392681584 learned_addr learned my addr 172.21.15.6:0/2392681584 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627b7fe700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f627c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539603336 0 0) 0x7f627c0d07c0 con 0x7f627c157ca0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6268003570 con 0x7f627c157ca0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2822647435 0 0) 0x7f6268003570 con 0x7f627c157ca0 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 msgr2=0x7f627c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f627c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 >> v1:172.21.15.118:6789/0 conn(0x7f627c1578d0 legacy=0x7f627c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0d0170 con 0x7f627c157ca0 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f6264001470 con 0x7f627c157ca0 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 >> v1:172.21.15.6:6789/0 conn(0x7f627c157ca0 legacy=0x7f627c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f6268003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6268004010 0x7f6268004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004d50 0x7f62680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0cfe90 con 0x7f6268004010 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626800bbf0 con 0x7f6268004d50 2023-10-09T11:46:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626800bdb0 con 0x7f627c06d830 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627a7fc700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6268004010 0x7f6268004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627affd700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f6268003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627b7fe700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004d50 0x7f62680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627a7fc700 1 -- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 msgr2=0x7f6268003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627a7fc700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c06d830 0x7f6268003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627a7fc700 1 -- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004d50 msgr2=0x7f62680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.760+0000 7f627a7fc700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004d50 0x7f62680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f627a7fc700 1 -- 172.21.15.6:0/2392681584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268003570 con 0x7f6268004010 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f627a7fc700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6268004010 0x7f6268004810 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6264001ed0 tx=0x7f627c15b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a75fce126a7136 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400cc00 con 0x7f6268004010 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400cd60 con 0x7f6268004010 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f6279ffb700 1 -- 172.21.15.6:0/2392681584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264005b70 con 0x7f6268004010 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 -- 172.21.15.6:0/2392681584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6268004010 msgr2=0x7f6268004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 --2- 172.21.15.6:0/2392681584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6268004010 0x7f6268004810 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6264001ed0 tx=0x7f627c15b610 comp rx=0 tx=0).stop 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f627b7fe700 1 -- 172.21.15.6:0/2392681584 reap_dead start 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 -- 172.21.15.6:0/2392681584 shutdown_connections 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 -- 172.21.15.6:0/2392681584 >> 172.21.15.6:0/2392681584 conn(0x7f627c06bb90 msgr2=0x7f627c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 -- 172.21.15.6:0/2392681584 shutdown_connections 2023-10-09T11:46:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.761+0000 7f62812e1700 1 -- 172.21.15.6:0/2392681584 wait complete. 2023-10-09T11:46:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 Processor -- start 2023-10-09T11:46:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 -- start start 2023-10-09T11:46:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004010 0x7f627c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c0b1c40 0x7f627c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c15cfd0 con 0x7f627c15c620 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0ac6b0 con 0x7f6268004010 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.763+0000 7f62812e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0ac990 con 0x7f627c0b1c40 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53872/0 (socket says 172.21.15.6:53872) 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 -- 172.21.15.6:0/4126661480 learned_addr learned my addr 172.21.15.6:0/4126661480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627b7fe700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c0b1c40 0x7f627c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627affd700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004010 0x7f627c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 -- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c0b1c40 msgr2=0x7f627c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c0b1c40 0x7f627c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 -- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004010 msgr2=0x7f627c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004010 0x7f627c14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 -- 172.21.15.6:0/4126661480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0acc70 con 0x7f627c15c620 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f627a7fc700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6264007cd0 tx=0x7f6264015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400c950 con 0x7f627c15c620 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640070d0 con 0x7f627c15c620 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c0acf50 con 0x7f627c15c620 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264007470 con 0x7f627c15c620 2023-10-09T11:46:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.764+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c16aa40 con 0x7f627c15c620 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.765+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c067ac0 con 0x7f627c15c620 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.765+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6264019030 con 0x7f627c15c620 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.766+0000 7f6272ffd700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.766+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6264085500 con 0x7f627c15c620 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.766+0000 7f627affd700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.766+0000 7f627affd700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6274000c00 tx=0x7f6274009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:45.770+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6264052a70 con 0x7f627c15c620 2023-10-09T11:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.045+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f627c0d0450 con 0x7f627c15c620 2023-10-09T11:46:46.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.265+0000 7f6272ffd700 1 -- 172.21.15.6:0/4126661480 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v495) v1 ==== 131+0+0 (secure 0 0 0) 0x7f6264056090 con 0x7f627c15c620 2023-10-09T11:46:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 msgr2=0x7f625c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6274000c00 tx=0x7f6274009040 comp rx=0 tx=0).stop 2023-10-09T11:46:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 msgr2=0x7f627c15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6264007cd0 tx=0x7f6264015000 comp rx=0 tx=0).stop 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 shutdown_connections 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f625c066f30 0x7f625c0693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f627c0b1c40 0x7f627c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6268004010 0x7f627c14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 --2- 172.21.15.6:0/4126661480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c15c620 0x7f627c15ca90 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.267+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 >> 172.21.15.6:0/4126661480 conn(0x7f627c06bb90 msgr2=0x7f627c15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.268+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 shutdown_connections 2023-10-09T11:46:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.268+0000 7f62812e1700 1 -- 172.21.15.6:0/4126661480 wait complete. 2023-10-09T11:46:46.280 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-09T11:46:46.281 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-09T11:46:46.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-09T11:46:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 Processor -- start 2023-10-09T11:46:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 -- start start 2023-10-09T11:46:46.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f802006d830 0x7f80200cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:46.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200d07c0 con 0x7f80201578d0 2023-10-09T11:46:46.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200cfbb0 con 0x7f8020157ca0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.401+0000 7f802541c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200cfe90 con 0x7f802006d830 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f80201578d0 0x7f802015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60378/0 (socket says 172.21.15.6:60378) 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801effd700 1 -- 172.21.15.6:0/4261770492 learned_addr learned my addr 172.21.15.6:0/4261770492 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801f7fe700 1 --2- 172.21.15.6:0/4261770492 >> v2:172.21.15.118:3300/0 conn(0x7f802006d830 0x7f80200cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455278235 0 0) 0x7f80200d07c0 con 0x7f80201578d0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003570 con 0x7f80201578d0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509158923 0 0) 0x7f800c003570 con 0x7f80201578d0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801f7fe700 1 -- 172.21.15.6:0/4261770492 >> v1:172.21.15.118:6789/0 conn(0x7f8020157ca0 legacy=0x7f802006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801f7fe700 1 -- 172.21.15.6:0/4261770492 >> v1:172.21.15.6:6789/0 conn(0x7f80201578d0 legacy=0x7f802015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801f7fe700 1 -- 172.21.15.6:0/4261770492 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200d0170 con 0x7f802006d830 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801f7fe700 1 --2- 172.21.15.6:0/4261770492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f802006d830 0x7f80200cf4f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f80180098e0 tx=0x7f80180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcadd7cf3fb30355 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:46.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.402+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100017f0 con 0x7f802006d830 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8018011420 con 0x7f802006d830 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f801dffb700 1 -- 172.21.15.6:0/4261770492 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180117c0 con 0x7f802006d830 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 -- 172.21.15.6:0/4261770492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f802006d830 msgr2=0x7f80200cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 --2- 172.21.15.6:0/4261770492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f802006d830 0x7f80200cf4f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f80180098e0 tx=0x7f80180091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 -- 172.21.15.6:0/4261770492 shutdown_connections 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 --2- 172.21.15.6:0/4261770492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f802006d830 0x7f80200cf4f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 -- 172.21.15.6:0/4261770492 >> 172.21.15.6:0/4261770492 conn(0x7f802006bb90 msgr2=0x7f802006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 -- 172.21.15.6:0/4261770492 shutdown_connections 2023-10-09T11:46:46.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.403+0000 7f802541c700 1 -- 172.21.15.6:0/4261770492 wait complete. 2023-10-09T11:46:46.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.404+0000 7f802541c700 1 Processor -- start 2023-10-09T11:46:46.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.404+0000 7f802541c700 1 -- start start 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f802006d830 0x7f802016ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020157ca0 0x7f8020153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015f8e0 con 0x7f80201578d0 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015df20 con 0x7f8020157ca0 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f802541c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802015e200 con 0x7f802006d830 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f801e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f801e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53884/0 (socket says 172.21.15.6:53884) 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f801e7fc700 1 -- 172.21.15.6:0/2152172155 learned_addr learned my addr 172.21.15.6:0/2152172155 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f801effd700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f802006d830 0x7f802016ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:46.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.405+0000 7f801f7fe700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020157ca0 0x7f8020153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 -- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f802006d830 msgr2=0x7f802016ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f802006d830 0x7f802016ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 -- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020157ca0 msgr2=0x7f8020153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020157ca0 0x7f8020153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 -- 172.21.15.6:0/2152172155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009420 con 0x7f80201578d0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f801e7fc700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f800800c590 tx=0x7f8008007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008011590 con 0x7f80201578d0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008011710 con 0x7f80201578d0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802015e4e0 con 0x7f80201578d0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008011ad0 con 0x7f80201578d0 2023-10-09T11:46:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.406+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802015eaa0 con 0x7f80201578d0 2023-10-09T11:46:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.407+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80200b4e20 con 0x7f80201578d0 2023-10-09T11:46:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.407+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f800801b3b0 con 0x7f80201578d0 2023-10-09T11:46:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.408+0000 7f8016ffd700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 0x7f80000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.408+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8008083520 con 0x7f80201578d0 2023-10-09T11:46:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.408+0000 7f801effd700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 0x7f80000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:46.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.408+0000 7f801effd700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 0x7f80000693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8010001560 tx=0x7f8010000f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:46.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.412+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8008050a90 con 0x7f80201578d0 2023-10-09T11:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:46.688+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f802015ec90 con 0x7f80201578d0 2023-10-09T11:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.269+0000 7f8016ffd700 1 -- 172.21.15.6:0/2152172155 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v496) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8008017020 con 0x7f80201578d0 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 msgr2=0x7f80000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 0x7f80000693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8010001560 tx=0x7f8010000f40 comp rx=0 tx=0).stop 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 msgr2=0x7f802014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f800800c590 tx=0x7f8008007f50 comp rx=0 tx=0).stop 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 shutdown_connections 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8000066f30 0x7f80000693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8020157ca0 0x7f8020153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f802006d830 0x7f802016ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 --2- 172.21.15.6:0/2152172155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80201578d0 0x7f802014cb00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 >> 172.21.15.6:0/2152172155 conn(0x7f802006bb90 msgr2=0x7f802006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 shutdown_connections 2023-10-09T11:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.271+0000 7f802541c700 1 -- 172.21.15.6:0/2152172155 wait complete. 2023-10-09T11:46:47.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T11:46:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.412+0000 7fa47bd27700 1 Processor -- start 2023-10-09T11:46:47.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.412+0000 7fa47bd27700 1 -- start start 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47bd27700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 0x7fa4740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47bd27700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740d07c0 con 0x7fa47406d120 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47bd27700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740cfbb0 con 0x7fa4741578d0 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47bd27700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740cfe90 con 0x7fa474157ca0 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47a2c4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa47406d120 0x7fa47415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60390/0 (socket says 172.21.15.6:60390) 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa47a2c4700 1 -- 172.21.15.6:0/326006647 learned_addr learned my addr 172.21.15.6:0/326006647 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa4792c2700 1 --2- 172.21.15.6:0/326006647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 0x7fa4740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267451040 0 0) 0x7fa4740d07c0 con 0x7fa47406d120 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa45c003570 con 0x7fa47406d120 2023-10-09T11:46:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724596273 0 0) 0x7fa4740cfbb0 con 0x7fa4741578d0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4740d07c0 con 0x7fa4741578d0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa4792c2700 1 -- 172.21.15.6:0/326006647 >> v1:172.21.15.118:6789/0 conn(0x7fa4741578d0 legacy=0x7fa47415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa4792c2700 1 -- 172.21.15.6:0/326006647 >> v1:172.21.15.6:6789/0 conn(0x7fa47406d120 legacy=0x7fa47415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.413+0000 7fa4792c2700 1 -- 172.21.15.6:0/326006647 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740d0170 con 0x7fa474157ca0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa4792c2700 1 --2- 172.21.15.6:0/326006647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 0x7fa4740cf4f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa468009910 tx=0x7fa4680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39ed14631031c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468011630 con 0x7fa474157ca0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa468011790 con 0x7fa474157ca0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa478ac1700 1 -- 172.21.15.6:0/326006647 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468011b10 con 0x7fa474157ca0 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 -- 172.21.15.6:0/326006647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 msgr2=0x7fa4740cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 --2- 172.21.15.6:0/326006647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 0x7fa4740cf4f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa468009910 tx=0x7fa4680091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 -- 172.21.15.6:0/326006647 shutdown_connections 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 --2- 172.21.15.6:0/326006647 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa474157ca0 0x7fa4740cf4f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 -- 172.21.15.6:0/326006647 >> 172.21.15.6:0/326006647 conn(0x7fa47406bb90 msgr2=0x7fa47406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 -- 172.21.15.6:0/326006647 shutdown_connections 2023-10-09T11:46:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.414+0000 7fa47bd27700 1 -- 172.21.15.6:0/326006647 wait complete. 2023-10-09T11:46:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.415+0000 7fa47bd27700 1 Processor -- start 2023-10-09T11:46:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.415+0000 7fa47bd27700 1 -- start start 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4741578d0 0x7fa474068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa474157ca0 0x7fa474068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474147ff0 con 0x7fa47406d120 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740cce80 con 0x7fa474157ca0 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47bd27700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740cd160 con 0x7fa4741578d0 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa479ac3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa479ac3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53890/0 (socket says 172.21.15.6:53890) 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa479ac3700 1 -- 172.21.15.6:0/2598621931 learned_addr learned my addr 172.21.15.6:0/2598621931 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa4792c2700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4741578d0 0x7fa474068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.416+0000 7fa47a2c4700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa474157ca0 0x7fa474068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 -- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4741578d0 msgr2=0x7fa474068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4741578d0 0x7fa474068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 -- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa474157ca0 msgr2=0x7fa474068dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa474157ca0 0x7fa474068dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 -- 172.21.15.6:0/2598621931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009420 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa479ac3700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c790 tx=0x7fa46c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c010510 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c010670 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4740cd440 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c010a10 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.417+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4740cc0c0 con 0x7fa47406d120 2023-10-09T11:46:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.418+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa474067ac0 con 0x7fa47406d120 2023-10-09T11:46:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.418+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa46c01b3b0 con 0x7fa47406d120 2023-10-09T11:46:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.419+0000 7fa471ffb700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 0x7fa4600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.419+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa46c083ad0 con 0x7fa47406d120 2023-10-09T11:46:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.419+0000 7fa4792c2700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 0x7fa4600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.420+0000 7fa4792c2700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 0x7fa4600693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa468009860 tx=0x7fa468017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.423+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa46c051040 con 0x7fa47406d120 2023-10-09T11:46:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.617+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa474148540 con 0x7fa47406d120 2023-10-09T11:46:47.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.621+0000 7fa471ffb700 1 -- 172.21.15.6:0/2598621931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa46c017020 con 0x7fa47406d120 2023-10-09T11:46:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 msgr2=0x7fa4600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 0x7fa4600693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa468009860 tx=0x7fa468017000 comp rx=0 tx=0).stop 2023-10-09T11:46:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 msgr2=0x7fa474147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00c790 tx=0x7fa46c007e10 comp rx=0 tx=0).stop 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 shutdown_connections 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa460066f30 0x7fa4600693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa474157ca0 0x7fa474068dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47406d120 0x7fa474147ab0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 --2- 172.21.15.6:0/2598621931 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4741578d0 0x7fa474068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 >> 172.21.15.6:0/2598621931 conn(0x7fa47406bb90 msgr2=0x7fa474069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 shutdown_connections 2023-10-09T11:46:47.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.623+0000 7fa47bd27700 1 -- 172.21.15.6:0/2598621931 wait complete. 2023-10-09T11:46:47.635 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:46:47.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:47.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:46:47.718 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:46:47.718 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T11:46:47.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.837+0000 7f94d75d3700 1 Processor -- start 2023-10-09T11:46:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.837+0000 7f94d75d3700 1 -- start start 2023-10-09T11:46:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d75d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d75d3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94d006d650 0x7f94d006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d75d3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00b0ca0 con 0x7f94d015a2a0 2023-10-09T11:46:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d75d3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d006ea90 con 0x7f94d006d650 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d75d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00b00d0 con 0x7f94d00cf240 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d5b70700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94d006d650 0x7f94d006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d4b6e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d4b6e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:47220/0 (socket says 172.21.15.6:47220) 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94d4b6e700 1 -- 172.21.15.6:0/1462903712 learned_addr learned my addr 172.21.15.6:0/1462903712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.838+0000 7f94cffff700 1 -- 172.21.15.6:0/1462903712 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258027088 0 0) 0x7f94d00b0ca0 con 0x7f94d015a2a0 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94cffff700 1 -- 172.21.15.6:0/1462903712 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b8003570 con 0x7f94d015a2a0 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d5b70700 1 -- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 msgr2=0x7f94d00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d5b70700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d5b70700 1 -- 172.21.15.6:0/1462903712 >> v1:172.21.15.118:6789/0 conn(0x7f94d015a2a0 legacy=0x7f94d00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d5b70700 1 -- 172.21.15.6:0/1462903712 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00b0370 con 0x7f94d006d650 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d4b6e700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d5b70700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d006d650 0x7f94d006da90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e60 tx=0x7f94c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c81e32514c7e62d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94cffff700 1 -- 172.21.15.6:0/1462903712 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000e070 con 0x7f94d006d650 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94cffff700 1 -- 172.21.15.6:0/1462903712 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000bab0 con 0x7f94d006d650 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94cffff700 1 -- 172.21.15.6:0/1462903712 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000be70 con 0x7f94d006d650 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 -- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d006d650 msgr2=0x7f94d006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d006d650 0x7f94d006da90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009e60 tx=0x7f94c0009780 comp rx=0 tx=0).stop 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 -- 172.21.15.6:0/1462903712 shutdown_connections 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d006d650 0x7f94d006da90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 --2- 172.21.15.6:0/1462903712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.839+0000 7f94d75d3700 1 -- 172.21.15.6:0/1462903712 >> 172.21.15.6:0/1462903712 conn(0x7f94d0067640 msgr2=0x7f94d0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.840+0000 7f94d75d3700 1 -- 172.21.15.6:0/1462903712 shutdown_connections 2023-10-09T11:46:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.840+0000 7f94d75d3700 1 -- 172.21.15.6:0/1462903712 wait complete. 2023-10-09T11:46:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.841+0000 7f94d75d3700 1 Processor -- start 2023-10-09T11:46:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.841+0000 7f94d75d3700 1 -- start start 2023-10-09T11:46:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.841+0000 7f94d75d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.841+0000 7f94d75d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d015a2a0 0x7f94d0154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00ca1c0 con 0x7f94d006d650 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00cc6c0 con 0x7f94d015a2a0 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0154ba0 con 0x7f94d00cf240 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53894/0 (socket says 172.21.15.6:53894) 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 -- 172.21.15.6:0/669993998 learned_addr learned my addr 172.21.15.6:0/669993998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d4b6e700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d5b70700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d015a2a0 0x7f94d0154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 -- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 msgr2=0x7f94d00cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 -- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d015a2a0 msgr2=0x7f94d0154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d015a2a0 0x7f94d0154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 -- 172.21.15.6:0/669993998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40094f0 con 0x7f94d006d650 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d4b6e700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d536f700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c580 tx=0x7f94c8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8010510 con 0x7f94d006d650 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8010670 con 0x7f94d006d650 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c0009a20 con 0x7f94d006d650 2023-10-09T11:46:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8010a30 con 0x7f94d006d650 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.842+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d00ca690 con 0x7f94d006d650 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.843+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d0069e40 con 0x7f94d006d650 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.844+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94c801b400 con 0x7f94d006d650 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.844+0000 7f94cd7fa700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.844+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f94c8083d80 con 0x7f94d006d650 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.844+0000 7f94d4b6e700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.845+0000 7f94d4b6e700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 0x7f94bc0693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006d20 tx=0x7f94c4009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:47.849+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94c80512f0 con 0x7f94d006d650 2023-10-09T11:46:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.087+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94d004bb80 con 0x7f94d006d650 2023-10-09T11:46:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.088+0000 7f94cd7fa700 1 -- 172.21.15.6:0/669993998 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f94c8054910 con 0x7f94d006d650 2023-10-09T11:46:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:48.089 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/235220454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":235220454},{"type":"v1","addr":"172.21.15.118:6834","nonce":235220454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7528,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/732781646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":732781646},{"type":"v1","addr":"172.21.15.118:6835","nonce":732781646}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7803,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/116955569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":116955569},{"type":"v1","addr":"172.21.15.6:6836","nonce":116955569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/607685636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":607685636},{"type":"v1","addr":"172.21.15.6:6837","nonce":607685636}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.089+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 msgr2=0x7f94bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.089+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 0x7f94bc0693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006d20 tx=0x7f94c4009250 comp rx=0 tx=0).stop 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.089+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 msgr2=0x7f94d00c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.089+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c580 tx=0x7f94c8007e10 comp rx=0 tx=0).stop 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 shutdown_connections 2023-10-09T11:46:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f94bc066f30 0x7f94bc0693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94d015a2a0 0x7f94d0154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94d006d650 0x7f94d00c9c80 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 --2- 172.21.15.6:0/669993998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94d00cf240 0x7f94d00cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 >> 172.21.15.6:0/669993998 conn(0x7f94d0067640 msgr2=0x7f94d00ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 shutdown_connections 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.090+0000 7f94d75d3700 1 -- 172.21.15.6:0/669993998 wait complete. 2023-10-09T11:46:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-10-09T11:46:48.102 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T11:46:48.102 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T11:46:48.103 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:46:48.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:46:48.103 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T11:46:48.103 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T11:46:48.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:46:48.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:46:48.103 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T11:46:48.104 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T11:46:48.104 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:46:48.104 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:46:48.104 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T11:46:48.104 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T11:46:48.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:46:48.105 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:46:48.111 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:46:48.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T11:46:48.112 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:46:48.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T11:46:48.115 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:46:48.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T11:46:48.116 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:46:48.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T11:46:48.154 INFO:tasks.ceph.mds.a:Started 2023-10-09T11:46:48.154 DEBUG:teuthology.parallel:result is None 2023-10-09T11:46:48.155 INFO:tasks.ceph.mds.c:Started 2023-10-09T11:46:48.155 DEBUG:teuthology.parallel:result is None 2023-10-09T11:46:48.157 INFO:tasks.ceph.mds.d:Started 2023-10-09T11:46:48.158 DEBUG:teuthology.parallel:result is None 2023-10-09T11:46:48.158 INFO:tasks.ceph.mds.b:Started 2023-10-09T11:46:48.158 DEBUG:teuthology.parallel:result is None 2023-10-09T11:46:48.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T11:46:48.230 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-10-09T11:46:48.230 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:46:48.246 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-10-09T11:46:48.246 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-10-09T11:46:48.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.285+0000 7f4b3679f700 1 Processor -- start 2023-10-09T11:46:48.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.285+0000 7f4b3679f700 1 -- start start 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3679f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b30159b40 0x7f4b300cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3679f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4b30068e90 0x7f4b300cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3679f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300cee10 con 0x7f4b30159f10 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3679f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300cd040 con 0x7f4b30159b40 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3679f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300cd320 con 0x7f4b30068e90 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b30159b40 0x7f4b300cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b30159b40 0x7f4b300cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53954/0 (socket says 172.21.15.6:53954) 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 -- 172.21.15.6:0/2287545846 learned_addr learned my addr 172.21.15.6:0/2287545846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b35f9e700 1 --2- 172.21.15.6:0/2287545846 >> v2:172.21.15.118:3300/0 conn(0x7f4b30068e90 0x7f4b300cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 -- 172.21.15.6:0/2287545846 >> v2:172.21.15.118:3300/0 conn(0x7f4b30068e90 msgr2=0x7f4b300cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 --2- 172.21.15.6:0/2287545846 >> v2:172.21.15.118:3300/0 conn(0x7f4b30068e90 0x7f4b300cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 -- 172.21.15.6:0/2287545846 >> v1:172.21.15.118:6789/0 conn(0x7f4b30159f10 legacy=0x7f4b30068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.286+0000 7f4b3579d700 1 -- 172.21.15.6:0/2287545846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300ce7c0 con 0x7f4b30159b40 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3579d700 1 --2- 172.21.15.6:0/2287545846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30159b40 0x7f4b300cc600 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f4b300cae10 tx=0x7f4b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56687be8730d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b2ffff700 1 -- 172.21.15.6:0/2287545846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28009e70 con 0x7f4b30159b40 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b2ffff700 1 -- 172.21.15.6:0/2287545846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2800b860 con 0x7f4b30159b40 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b2ffff700 1 -- 172.21.15.6:0/2287545846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2800bc00 con 0x7f4b30159b40 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 -- 172.21.15.6:0/2287545846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30159b40 msgr2=0x7f4b300cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 --2- 172.21.15.6:0/2287545846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30159b40 0x7f4b300cc600 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f4b300cae10 tx=0x7f4b28009250 comp rx=0 tx=0).stop 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 -- 172.21.15.6:0/2287545846 shutdown_connections 2023-10-09T11:46:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 --2- 172.21.15.6:0/2287545846 >> v2:172.21.15.118:3300/0 conn(0x7f4b30068e90 0x7f4b300cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 --2- 172.21.15.6:0/2287545846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30159b40 0x7f4b300cc600 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 -- 172.21.15.6:0/2287545846 >> 172.21.15.6:0/2287545846 conn(0x7f4b300cd660 msgr2=0x7f4b300cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 -- 172.21.15.6:0/2287545846 shutdown_connections 2023-10-09T11:46:48.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.287+0000 7f4b3679f700 1 -- 172.21.15.6:0/2287545846 wait complete. 2023-10-09T11:46:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.288+0000 7f4b3679f700 1 Processor -- start 2023-10-09T11:46:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 -- start start 2023-10-09T11:46:48.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b30159b40 0x7f4b30144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b30159f10 0x7f4b3016a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30158750 con 0x7f4b30068e90 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3015af40 con 0x7f4b30159f10 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3679f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30158a10 con 0x7f4b30159b40 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3579d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3579d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53970/0 (socket says 172.21.15.6:53970) 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.289+0000 7f4b3579d700 1 -- 172.21.15.6:0/3203034615 learned_addr learned my addr 172.21.15.6:0/3203034615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 -- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b30159b40 msgr2=0x7f4b30144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b30159b40 0x7f4b30144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 -- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b30159f10 msgr2=0x7f4b3016a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:48.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b35f9e700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b30159f10 0x7f4b3016a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b30159f10 0x7f4b3016a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 -- 172.21.15.6:0/3203034615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280094f0 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3579d700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006fe10 tx=0x7f4b28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011420 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28011580 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b30158cf0 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011940 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.290+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b30159210 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.291+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b301585a0 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.292+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b2802c3b0 con 0x7f4b30068e90 2023-10-09T11:46:48.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.292+0000 7f4b2d7fa700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.292+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4b280858e0 con 0x7f4b30068e90 2023-10-09T11:46:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.292+0000 7f4b34f9c700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:48.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.292+0000 7f4b34f9c700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 0x7f4b1c0693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4b301557c0 tx=0x7f4b24007b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.297+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b28052e50 con 0x7f4b30068e90 2023-10-09T11:46:48.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:48.505+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4b30158ee0 con 0x7f4b30068e90 2023-10-09T11:46:49.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.282+0000 7f4b2d7fa700 1 -- 172.21.15.6:0/3203034615 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4b28015080 con 0x7f4b30068e90 2023-10-09T11:46:49.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 msgr2=0x7f4b1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 0x7f4b1c0693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4b301557c0 tx=0x7f4b24007b40 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 msgr2=0x7f4b30155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006fe10 tx=0x7f4b28017000 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 shutdown_connections 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b30159f10 0x7f4b3016a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b30068e90 0x7f4b30155fe0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 --2- 172.21.15.6:0/3203034615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4b30159b40 0x7f4b30144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 >> 172.21.15.6:0/3203034615 conn(0x7f4b300cd660 msgr2=0x7f4b300c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 shutdown_connections 2023-10-09T11:46:49.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.285+0000 7f4b3679f700 1 -- 172.21.15.6:0/3203034615 wait complete. 2023-10-09T11:46:49.287 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-10-09T11:46:49.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T11:46:49.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.424+0000 7fc9495ca700 1 Processor -- start 2023-10-09T11:46:49.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.424+0000 7fc9495ca700 1 -- start start 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9495ca700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9440cc490 0x7fc9440c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9495ca700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9440af720 con 0x7fc944156a50 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9495ca700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9440c7bd0 con 0x7fc9440cbff0 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9495ca700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9440af950 con 0x7fc9440cc490 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9437fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9440cc490 0x7fc9440c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc942ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc944156a50 0x7fc94406a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60410/0 (socket says 172.21.15.6:60410) 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc942ffd700 1 -- 172.21.15.6:0/3843261208 learned_addr learned my addr 172.21.15.6:0/3843261208 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9437fe700 1 -- 172.21.15.6:0/3843261208 >> v1:172.21.15.118:6789/0 conn(0x7fc9440cbff0 legacy=0x7fc9440c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc9437fe700 1 -- 172.21.15.6:0/3843261208 >> v1:172.21.15.6:6789/0 conn(0x7fc944156a50 legacy=0x7fc94406a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.425+0000 7fc941ffb700 1 -- 172.21.15.6:0/3843261208 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324925275 0 0) 0x7fc9440af720 con 0x7fc944156a50 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9437fe700 1 -- 172.21.15.6:0/3843261208 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9440afc30 con 0x7fc9440cc490 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9437fe700 1 --2- 172.21.15.6:0/3843261208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440c9340 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc9340098e0 tx=0x7fc9340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d413e5907c3cb74c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc941ffb700 1 -- 172.21.15.6:0/3843261208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934009e80 con 0x7fc9440cc490 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc941ffb700 1 -- 172.21.15.6:0/3843261208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93400b860 con 0x7fc9440cc490 2023-10-09T11:46:49.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc941ffb700 1 -- 172.21.15.6:0/3843261208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93400bbe0 con 0x7fc9440cc490 2023-10-09T11:46:49.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 -- 172.21.15.6:0/3843261208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 msgr2=0x7fc9440c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3843261208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440c9340 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc9340098e0 tx=0x7fc9340091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 -- 172.21.15.6:0/3843261208 shutdown_connections 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3843261208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440c9340 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 -- 172.21.15.6:0/3843261208 >> 172.21.15.6:0/3843261208 conn(0x7fc94406cca0 msgr2=0x7fc94406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 -- 172.21.15.6:0/3843261208 shutdown_connections 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.426+0000 7fc9495ca700 1 -- 172.21.15.6:0/3843261208 wait complete. 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 Processor -- start 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 -- start start 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9440cbff0 0x7fc9440b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc944156a50 0x7fc944159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440b17f0 con 0x7fc9440cc490 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944157730 con 0x7fc9440cbff0 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9495ca700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc944156e20 con 0x7fc944156a50 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53988/0 (socket says 172.21.15.6:53988) 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.428+0000 7fc9427fc700 1 -- 172.21.15.6:0/3853572212 learned_addr learned my addr 172.21.15.6:0/3853572212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc942ffd700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9440cbff0 0x7fc9440b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9437fe700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc944156a50 0x7fc944159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 -- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc944156a50 msgr2=0x7fc944159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc944156a50 0x7fc944159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 -- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9440cbff0 msgr2=0x7fc9440b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9440cbff0 0x7fc9440b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 -- 172.21.15.6:0/3853572212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009420 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9427fc700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c5b0 tx=0x7fc92c0020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011590 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0116f0 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011a90 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9440c6ee0 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.429+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441573c0 con 0x7fc9440cc490 2023-10-09T11:46:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.430+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9441578e0 con 0x7fc9440cc490 2023-10-09T11:46:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.430+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc92c012420 con 0x7fc9440cc490 2023-10-09T11:46:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.431+0000 7fc93affd700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 0x7fc9240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.431+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc92c083c00 con 0x7fc9440cc490 2023-10-09T11:46:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.431+0000 7fc942ffd700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 0x7fc9240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.431+0000 7fc942ffd700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 0x7fc9240693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc93c007240 tx=0x7fc93c001970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.435+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9441578e0 con 0x7fc9440cc490 2023-10-09T11:46:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.706+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc9441578a0 con 0x7fc9440cc490 2023-10-09T11:46:49.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.706+0000 7fc93affd700 1 -- 172.21.15.6:0/3853572212 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc92c051120 con 0x7fc9440cc490 2023-10-09T11:46:49.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:49.707 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:46:49.707 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNleJKvEBAA7y/mzNpORmP2jrDzPAGNFQ==", 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:46:49.708 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlyVoyHBAAbZ4dheXftKzlO0XuApPtrA==", 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:46:49.709 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQuiiFxAApq3U8XhqbKtJ68s7yWAtvQ==", 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:46:49.710 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlv+DyIhAA4iC6AsQ/ZAYNyHoZGBffcA==", 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:46:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCL5SNlJ/V/OxAAtDbk/vV5p7fRWhoH7ExS5A==", 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNluxEaBxAAk4cjc+6RIZU2dZHNaRoFFQ==", 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlLsxlEBAA+BRXrpAh1XE94Nco70h0oA==", 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.714 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCM5SNlXGCjGRAAzdpx3IpItTgh8aeyedU2uQ==", 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-10-09T11:46:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNl2axdExAAGzINPzU418hRcGp0gmlKxA==", 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlvGHnGRAA+imoaiMo4kzKHE2YaBQRjQ==", 2023-10-09T11:46:49.716 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlm8rYIhAAmR+snVUWy/DypjJIcgWyeg==", 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.717 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCO5SNlzi3GKxAATS0B43hjHjQTftPOsg9VPQ==", 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-10-09T11:46:49.718 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl0irdJhAARMq7rX+Rn56dKbYdnQ9fPQ==", 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-10-09T11:46:49.719 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl+49aLxAAJFap6oMzTuQXreHBHOwKbg==", 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:46:49.720 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlAv5ULBAAMtFfzGyTy3NdjO4D02ZwOQ==", 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:46:49.721 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNl16WzNBAAUtdCADwUr8XYBCcoVQ9zug==", 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-10-09T11:46:49.722 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCH5SNlzyI8MBAA9ITxJ09N1rUbcW1iFuXWWQ==", 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNlQWCGDRAA+ZETk322nKR0/caq0649qQ==", 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCI5SNltNc6CRAAU7McxDrorGMMqmhgUNCMCw==", 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:46:49.725 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:46:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 msgr2=0x7fc9240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 0x7fc9240693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc93c007240 tx=0x7fc93c001970 comp rx=0 tx=0).stop 2023-10-09T11:46:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 msgr2=0x7fc9440b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c5b0 tx=0x7fc92c0020e0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 shutdown_connections 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc924066f30 0x7fc9240693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc944156a50 0x7fc944159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9440cbff0 0x7fc9440b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 --2- 172.21.15.6:0/3853572212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9440cc490 0x7fc9440b30d0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 >> 172.21.15.6:0/3853572212 conn(0x7fc94406cca0 msgr2=0x7fc9440ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 shutdown_connections 2023-10-09T11:46:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.708+0000 7fc9495ca700 1 -- 172.21.15.6:0/3853572212 wait complete. 2023-10-09T11:46:49.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.847+0000 7f7881720700 1 Processor -- start 2023-10-09T11:46:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.847+0000 7f7881720700 1 -- start start 2023-10-09T11:46:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7881720700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f787c06d990 0x7f787c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7881720700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f787c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7881720700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c06e280 con 0x7f787c159a90 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7881720700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c068d60 con 0x7f787c06d990 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7881720700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c06dfa0 con 0x7f787c0691f0 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f787affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f787c159a90 0x7f787c06a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60414/0 (socket says 172.21.15.6:60414) 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f787affd700 1 -- 172.21.15.6:0/761749637 learned_addr learned my addr 172.21.15.6:0/761749637 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f787a7fc700 1 --2- 172.21.15.6:0/761749637 >> v2:172.21.15.118:3300/0 conn(0x7f787c06d990 0x7f787c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f787b7fe700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f787c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143961124 0 0) 0x7f787c06e280 con 0x7f787c159a90 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.848+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7868003570 con 0x7f787c159a90 2023-10-09T11:46:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419382849 0 0) 0x7f7868003570 con 0x7f787c159a90 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 msgr2=0x7f787c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f787c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 >> v2:172.21.15.118:3300/0 conn(0x7f787c06d990 msgr2=0x7f787c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 --2- 172.21.15.6:0/761749637 >> v2:172.21.15.118:3300/0 conn(0x7f787c06d990 0x7f787c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c068710 con 0x7f787c159a90 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787a7fc700 1 --2- 172.21.15.6:0/761749637 >> v2:172.21.15.118:3300/0 conn(0x7f787c06d990 0x7f787c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f7874001470 con 0x7f787c159a90 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 >> v1:172.21.15.6:6789/0 conn(0x7f787c159a90 legacy=0x7f787c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f7868003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868003fe0 0x7f7868004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7868004d50 0x7f78680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c068d60 con 0x7f7868004d50 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c06dfa0 con 0x7f7868003fe0 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786800bb40 con 0x7f787c0691f0 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7868004d50 0x7f78680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787affd700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f7868003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787a7fc700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868003fe0 0x7f7868004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 -- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 msgr2=0x7f7868003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c0691f0 0x7f7868003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 -- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868003fe0 msgr2=0x7f7868004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7868003fe0 0x7f7868004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 -- 172.21.15.6:0/761749637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868003570 con 0x7f7868004d50 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.849+0000 7f787b7fe700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7868004d50 0x7f78680051c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f786c0094d0 tx=0x7f786c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628061fc2b41f420 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00ea90 con 0x7f7868004d50 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00f040 con 0x7f7868004d50 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7879ffb700 1 -- 172.21.15.6:0/761749637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00ee20 con 0x7f7868004d50 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 -- 172.21.15.6:0/761749637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7868004d50 msgr2=0x7f78680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 --2- 172.21.15.6:0/761749637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7868004d50 0x7f78680051c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f786c0094d0 tx=0x7f786c00b040 comp rx=0 tx=0).stop 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f787b7fe700 1 -- 172.21.15.6:0/761749637 reap_dead start 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 -- 172.21.15.6:0/761749637 shutdown_connections 2023-10-09T11:46:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 -- 172.21.15.6:0/761749637 >> 172.21.15.6:0/761749637 conn(0x7f787c06bb90 msgr2=0x7f787c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 -- 172.21.15.6:0/761749637 shutdown_connections 2023-10-09T11:46:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.850+0000 7f7881720700 1 -- 172.21.15.6:0/761749637 wait complete. 2023-10-09T11:46:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.851+0000 7f7881720700 1 Processor -- start 2023-10-09T11:46:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.851+0000 7f7881720700 1 -- start start 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c14aa20 0x7f787c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 0x7f787c0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cd6b0 con 0x7f787c0cc540 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ccaa0 con 0x7f787c14adf0 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f7881720700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0ccd80 con 0x7f787c14aa20 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54000/0 (socket says 172.21.15.6:54000) 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 -- 172.21.15.6:0/159913264 learned_addr learned my addr 172.21.15.6:0/159913264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787affd700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c14aa20 0x7f787c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787a7fc700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 0x7f787c0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 -- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c14aa20 msgr2=0x7f787c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c14aa20 0x7f787c0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 -- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 msgr2=0x7f787c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.852+0000 7f787b7fe700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 0x7f787c0cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f787b7fe700 1 -- 172.21.15.6:0/159913264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0cd060 con 0x7f787c0cc540 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f787a7fc700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 0x7f787c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f787b7fe700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f786800ba90 tx=0x7f786c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01e640 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c01e7a0 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c0cd340 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01eba0 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.853+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c16d760 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.854+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c0cd860 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.854+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786c003040 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.855+0000 7f7872ffd700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 0x7f785c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.855+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f786c0862c0 con 0x7f787c0cc540 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.855+0000 7f787affd700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 0x7f785c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.855+0000 7f787affd700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 0x7f785c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f787c1582b0 tx=0x7f787c0b3fe0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:49.859+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f787c0cd860 con 0x7f787c0cc540 2023-10-09T11:46:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.055+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f787c0cd860 con 0x7f787c0cc540 2023-10-09T11:46:50.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.056+0000 7f7872ffd700 1 -- 172.21.15.6:0/159913264 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+12097 (secure 0 0 0) 0x7f787c0cd860 con 0x7f787c0cc540 2023-10-09T11:46:50.056 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:50.057 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":174,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:49.277914+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 msgr2=0x7f785c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 0x7f785c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f787c1582b0 tx=0x7f787c0b3fe0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 msgr2=0x7f787c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f786800ba90 tx=0x7f786c01a000 comp rx=0 tx=0).stop 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 shutdown_connections 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f785c066f30 0x7f785c0693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f787c0cc540 0x7f787c0cfc10 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f787c14aa20 0x7f787c0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 --2- 172.21.15.6:0/159913264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f787c14adf0 0x7f787c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 >> 172.21.15.6:0/159913264 conn(0x7f787c06bb90 msgr2=0x7f787c156450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 shutdown_connections 2023-10-09T11:46:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.058+0000 7f7881720700 1 -- 172.21.15.6:0/159913264 wait complete. 2023-10-09T11:46:50.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T11:46:50.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:46:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.193+0000 7f44b8bb7700 1 Processor -- start 2023-10-09T11:46:50.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.193+0000 7f44b8bb7700 1 -- start start 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 0x7f44b40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44b40ceb30 0x7f44b40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44b406d650 0x7f44b406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b406ea90 con 0x7f44b40ceb30 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40cf4e0 con 0x7f44b406d650 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b8bb7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40b0ca0 con 0x7f44b415a2a0 2023-10-09T11:46:50.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44b40ceb30 0x7f44b40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44b40ceb30 0x7f44b40cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54010/0 (socket says 172.21.15.6:54010) 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b1d9b700 1 -- 172.21.15.6:0/2888797054 learned_addr learned my addr 172.21.15.6:0/2888797054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b2d9d700 1 --2- 172.21.15.6:0/2888797054 >> v2:172.21.15.118:3300/0 conn(0x7f44b406d650 0x7f44b406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.194+0000 7f44b259c700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 0x7f44b40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 -- 172.21.15.6:0/2888797054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 msgr2=0x7f44b40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 0x7f44b40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 -- 172.21.15.6:0/2888797054 >> v2:172.21.15.118:3300/0 conn(0x7f44b406d650 msgr2=0x7f44b406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 --2- 172.21.15.6:0/2888797054 >> v2:172.21.15.118:3300/0 conn(0x7f44b406d650 0x7f44b406da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 -- 172.21.15.6:0/2888797054 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40b00d0 con 0x7f44b40ceb30 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b259c700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 0x7f44b40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b1d9b700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b40ceb30 0x7f44b40cefa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f44b406b970 tx=0x7f449c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56a5cba7e5cd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b159a700 1 -- 172.21.15.6:0/2888797054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00b860 con 0x7f44b40ceb30 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b159a700 1 -- 172.21.15.6:0/2888797054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b9c0 con 0x7f44b40ceb30 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b159a700 1 -- 172.21.15.6:0/2888797054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00bd60 con 0x7f44b40ceb30 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 -- 172.21.15.6:0/2888797054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b40ceb30 msgr2=0x7f44b40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b40ceb30 0x7f44b40cefa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f44b406b970 tx=0x7f449c009250 comp rx=0 tx=0).stop 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 -- 172.21.15.6:0/2888797054 shutdown_connections 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/2888797054 >> v2:172.21.15.118:3300/0 conn(0x7f44b406d650 0x7f44b406da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b415a2a0 0x7f44b40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/2888797054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b40ceb30 0x7f44b40cefa0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 -- 172.21.15.6:0/2888797054 >> 172.21.15.6:0/2888797054 conn(0x7f44b4067640 msgr2=0x7f44b4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.195+0000 7f44b8bb7700 1 -- 172.21.15.6:0/2888797054 shutdown_connections 2023-10-09T11:46:50.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.196+0000 7f44b8bb7700 1 -- 172.21.15.6:0/2888797054 wait complete. 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 Processor -- start 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 -- start start 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b406d650 0x7f44b41433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44b40ceb30 0x7f44b40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40cbc50 con 0x7f44b415a2a0 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40c8020 con 0x7f44b40ceb30 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b8bb7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40cb040 con 0x7f44b406d650 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.197+0000 7f44b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54014/0 (socket says 172.21.15.6:54014) 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 -- 172.21.15.6:0/3696488326 learned_addr learned my addr 172.21.15.6:0/3696488326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b259c700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b406d650 0x7f44b41433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b1d9b700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44b40ceb30 0x7f44b40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 -- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b406d650 msgr2=0x7f44b41433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b406d650 0x7f44b41433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 -- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44b40ceb30 msgr2=0x7f44b40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44b40ceb30 0x7f44b40ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 -- 172.21.15.6:0/3696488326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0094f0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b2d9d700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009fa0 tx=0x7f44a4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400ec70 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400edd0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40cb320 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4014670 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.198+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40cb8e0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.199+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b40cbdc0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.200+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44a40149e0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.200+0000 7f44aa7fc700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 0x7f44940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.200+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f44a40848d0 con 0x7f44b415a2a0 2023-10-09T11:46:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.200+0000 7f44b259c700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 0x7f44940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.200+0000 7f44b259c700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 0x7f44940693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006fd0 tx=0x7f44ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.204+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44a4051e90 con 0x7f44b415a2a0 2023-10-09T11:46:50.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.400+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44b404bb80 con 0x7f44b415a2a0 2023-10-09T11:46:50.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.400+0000 7f44aa7fc700 1 -- 172.21.15.6:0/3696488326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44a40554b0 con 0x7f44b415a2a0 2023-10-09T11:46:50.401 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:46:50.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 msgr2=0x7f44940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 0x7f44940693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006fd0 tx=0x7f44ac008040 comp rx=0 tx=0).stop 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 msgr2=0x7f44b40ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009fa0 tx=0x7f44a4009900 comp rx=0 tx=0).stop 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 shutdown_connections 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4494066f30 0x7f44940693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b415a2a0 0x7f44b40ca820 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44b406d650 0x7f44b41433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 --2- 172.21.15.6:0/3696488326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44b40ceb30 0x7f44b40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 >> 172.21.15.6:0/3696488326 conn(0x7f44b4067640 msgr2=0x7f44b406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 shutdown_connections 2023-10-09T11:46:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.402+0000 7f44b8bb7700 1 -- 172.21.15.6:0/3696488326 wait complete. 2023-10-09T11:46:50.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T11:46:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.533+0000 7f3d12af6700 1 Processor -- start 2023-10-09T11:46:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.533+0000 7f3d12af6700 1 -- start start 2023-10-09T11:46:50.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d12af6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3d0c06e940 0x7f3d0c161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d12af6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0b2290 con 0x7f3d0c156db0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d12af6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c157c00 con 0x7f3d0c1569e0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d12af6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c1572d0 con 0x7f3d0c06e940 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d0bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3d0c156db0 0x7f3d0c06e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60420/0 (socket says 172.21.15.6:60420) 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.534+0000 7f3d0bfff700 1 -- 172.21.15.6:0/219261038 learned_addr learned my addr 172.21.15.6:0/219261038 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d11093700 1 --2- 172.21.15.6:0/219261038 >> v2:172.21.15.118:3300/0 conn(0x7f3d0c06e940 0x7f3d0c161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585354161 0 0) 0x7f3d0c0b2290 con 0x7f3d0c156db0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf4003570 con 0x7f3d0c156db0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250869546 0 0) 0x7f3cf4003570 con 0x7f3d0c156db0 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 >> v2:172.21.15.118:3300/0 conn(0x7f3d0c06e940 msgr2=0x7f3d0c161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 --2- 172.21.15.6:0/219261038 >> v2:172.21.15.118:3300/0 conn(0x7f3d0c06e940 0x7f3d0c161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 >> v1:172.21.15.118:6789/0 conn(0x7f3d0c1569e0 legacy=0x7f3d0c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c1575b0 con 0x7f3d0c156db0 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f3d00001470 con 0x7f3d0c156db0 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 >> v1:172.21.15.6:6789/0 conn(0x7f3d0c156db0 legacy=0x7f3d0c06e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1572d0 con 0x7f3cf4003a60 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400c160 con 0x7f3cf4004810 2023-10-09T11:46:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400c320 con 0x7f3cf40051c0 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d0bfff700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d11093700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 -- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cf40051c0 msgr2=0x7f3cf400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3cf40051c0 0x7f3cf400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 -- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4004810 msgr2=0x7f3cf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4004810 0x7f3cf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d10892700 1 -- 172.21.15.6:0/219261038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4003570 con 0x7f3cf4003a60 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.535+0000 7f3d11093700 1 -- 172.21.15.6:0/219261038 reap_dead start 2023-10-09T11:46:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d10892700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001fc0 tx=0x7f3d04001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1570e2eef6f3bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04001950 con 0x7f3cf4003a60 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400c8b0 con 0x7f3cf4003a60 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d0b7fe700 1 -- 172.21.15.6:0/219261038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400cc50 con 0x7f3cf4003a60 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 -- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 msgr2=0x7f3cf4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001fc0 tx=0x7f3d04001640 comp rx=0 tx=0).stop 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 -- 172.21.15.6:0/219261038 shutdown_connections 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 --2- 172.21.15.6:0/219261038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf4003a60 0x7f3cf4003e70 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 -- 172.21.15.6:0/219261038 >> 172.21.15.6:0/219261038 conn(0x7f3d0c06cca0 msgr2=0x7f3d0c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 -- 172.21.15.6:0/219261038 shutdown_connections 2023-10-09T11:46:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.536+0000 7f3d12af6700 1 -- 172.21.15.6:0/219261038 wait complete. 2023-10-09T11:46:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.537+0000 7f3d12af6700 1 Processor -- start 2023-10-09T11:46:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 -- start start 2023-10-09T11:46:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4003a60 0x7f3d0c14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d0c14b420 0x7f3d0c14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c16a840 con 0x7f3d0c0caf10 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c14bdd0 con 0x7f3cf4003a60 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d12af6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cb8c0 con 0x7f3d0c14b420 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d11093700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.538+0000 7f3d11093700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54038/0 (socket says 172.21.15.6:54038) 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 -- 172.21.15.6:0/944760180 learned_addr learned my addr 172.21.15.6:0/944760180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d0bfff700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d0c14b420 0x7f3d0c14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d10892700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4003a60 0x7f3d0c14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 -- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d0c14b420 msgr2=0x7f3d0c14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d0c14b420 0x7f3d0c14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 -- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4003a60 msgr2=0x7f3d0c14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4003a60 0x7f3d0c14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 -- 172.21.15.6:0/944760180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0cbb60 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d11093700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06ed40 tx=0x7f3cfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc011ed0 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc015670 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0cbe40 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc015a10 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.539+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0cc400 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.540+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c068900 con 0x7f3d0c0caf10 2023-10-09T11:46:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.541+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cfc020460 con 0x7f3d0c0caf10 2023-10-09T11:46:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.541+0000 7f3d08ff9700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.541+0000 7f3d10892700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.541+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3cfc0840f0 con 0x7f3d0c0caf10 2023-10-09T11:46:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.542+0000 7f3d10892700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001da0 tx=0x7f3d04015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.546+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cfc0516b0 con 0x7f3d0c0caf10 2023-10-09T11:46:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.739+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3d0c155970 con 0x7f3d0c0caf10 2023-10-09T11:46:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.740+0000 7f3d08ff9700 1 -- 172.21.15.6:0/944760180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3cfc054cd0 con 0x7f3d0c0caf10 2023-10-09T11:46:50.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:46:50.741 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-09T11:46:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 msgr2=0x7f3cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 0x7f3cf80693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3d04001da0 tx=0x7f3d04015000 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 msgr2=0x7f3d0c0cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06ed40 tx=0x7f3cfc008040 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 shutdown_connections 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3cf8066f30 0x7f3cf80693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d0c0caf10 0x7f3d0c0cb380 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3cf4003a60 0x7f3d0c14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 --2- 172.21.15.6:0/944760180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d0c14b420 0x7f3d0c14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 >> 172.21.15.6:0/944760180 conn(0x7f3d0c06cca0 msgr2=0x7f3d0c1535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 shutdown_connections 2023-10-09T11:46:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.742+0000 7f3d12af6700 1 -- 172.21.15.6:0/944760180 wait complete. 2023-10-09T11:46:50.754 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T11:46:50.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T11:46:50.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.877+0000 7fc38f0e4700 1 Processor -- start 2023-10-09T11:46:50.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.877+0000 7fc38f0e4700 1 -- start start 2023-10-09T11:46:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38f0e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3881578d0 0x7fc3880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38f0e4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 0x7fc38815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38f0e4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880d07c0 con 0x7fc38806d120 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38f0e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880cfbb0 con 0x7fc3881578d0 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38f0e4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880cfe90 con 0x7fc388157ca0 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3881578d0 0x7fc3880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3881578d0 0x7fc3880cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54048/0 (socket says 172.21.15.6:54048) 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 -- 172.21.15.6:0/939738656 learned_addr learned my addr 172.21.15.6:0/939738656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc387fff700 1 --2- 172.21.15.6:0/939738656 >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 0x7fc38815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 -- 172.21.15.6:0/939738656 >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 msgr2=0x7fc38815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 --2- 172.21.15.6:0/939738656 >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 0x7fc38815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 -- 172.21.15.6:0/939738656 >> v1:172.21.15.118:6789/0 conn(0x7fc38806d120 legacy=0x7fc38806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 -- 172.21.15.6:0/939738656 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880d0170 con 0x7fc3881578d0 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc387fff700 1 --2- 172.21.15.6:0/939738656 >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 0x7fc38815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc38ce80700 1 --2- 172.21.15.6:0/939738656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3881578d0 0x7fc3880cf4f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc388068510 tx=0x7fc37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7862cfab5d03aff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc3877fe700 1 -- 172.21.15.6:0/939738656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00b820 con 0x7fc3881578d0 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc3877fe700 1 -- 172.21.15.6:0/939738656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00b980 con 0x7fc3881578d0 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.878+0000 7fc3877fe700 1 -- 172.21.15.6:0/939738656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00bd20 con 0x7fc3881578d0 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 -- 172.21.15.6:0/939738656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3881578d0 msgr2=0x7fc3880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/939738656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3881578d0 0x7fc3880cf4f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc388068510 tx=0x7fc37c009250 comp rx=0 tx=0).stop 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 -- 172.21.15.6:0/939738656 shutdown_connections 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/939738656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3881578d0 0x7fc3880cf4f0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/939738656 >> v2:172.21.15.118:3300/0 conn(0x7fc388157ca0 0x7fc38815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 -- 172.21.15.6:0/939738656 >> 172.21.15.6:0/939738656 conn(0x7fc38806bb90 msgr2=0x7fc38806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 -- 172.21.15.6:0/939738656 shutdown_connections 2023-10-09T11:46:50.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.879+0000 7fc38f0e4700 1 -- 172.21.15.6:0/939738656 wait complete. 2023-10-09T11:46:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.880+0000 7fc38f0e4700 1 Processor -- start 2023-10-09T11:46:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.880+0000 7fc38f0e4700 1 -- start start 2023-10-09T11:46:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc38806d120 0x7fc3880c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3881578d0 0x7fc3880c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880c5b20 con 0x7fc388157ca0 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880c5e00 con 0x7fc38806d120 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38f0e4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3880b5470 con 0x7fc3881578d0 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54062/0 (socket says 172.21.15.6:54062) 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 -- 172.21.15.6:0/264437513 learned_addr learned my addr 172.21.15.6:0/264437513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38ce80700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc38806d120 0x7fc3880c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc387fff700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3881578d0 0x7fc3880c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 -- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3881578d0 msgr2=0x7fc3880c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3881578d0 0x7fc3880c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 -- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc38806d120 msgr2=0x7fc3880c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc38806d120 0x7fc3880c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.881+0000 7fc38d681700 1 -- 172.21.15.6:0/264437513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0094f0 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc38d681700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c960 tx=0x7fc3800026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380012630 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380012790 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380012b50 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3880b5750 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.882+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3880c7bf0 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.883+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc388067ac0 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.883+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc38001b400 con 0x7fc388157ca0 2023-10-09T11:46:50.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.884+0000 7fc384ff9700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 0x7fc36c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.884+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc380084520 con 0x7fc388157ca0 2023-10-09T11:46:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.884+0000 7fc38ce80700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 0x7fc36c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.884+0000 7fc38ce80700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 0x7fc36c0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc388068510 tx=0x7fc37c016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:50.888+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc380051b90 con 0x7fc388157ca0 2023-10-09T11:46:51.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.080+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc3880d0450 con 0x7fc388157ca0 2023-10-09T11:46:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.987+0000 7fc384ff9700 1 -- 172.21.15.6:0/264437513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc3800551b0 con 0x7fc388157ca0 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 msgr2=0x7fc36c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 0x7fc36c0693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc388068510 tx=0x7fc37c016000 comp rx=0 tx=0).stop 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 msgr2=0x7fc3880b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c960 tx=0x7fc3800026e0 comp rx=0 tx=0).stop 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 shutdown_connections 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc36c066f30 0x7fc36c0693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc388157ca0 0x7fc3880b4b70 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc38806d120 0x7fc3880c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 --2- 172.21.15.6:0/264437513 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc3881578d0 0x7fc3880c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.993+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 >> 172.21.15.6:0/264437513 conn(0x7fc38806bb90 msgr2=0x7fc388154790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.994+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 shutdown_connections 2023-10-09T11:46:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:51.994+0000 7fc38f0e4700 1 -- 172.21.15.6:0/264437513 wait complete. 2023-10-09T11:46:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-09T11:46:52.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T11:46:52.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.141+0000 7f96bec80700 1 Processor -- start 2023-10-09T11:46:52.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 -- start start 2023-10-09T11:46:52.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b8068f20 0x7f96b80cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96b8157b90 0x7f96b80cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80cca80 con 0x7f96b81577c0 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b80cedd0 con 0x7f96b8157b90 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.142+0000 7f96bec80700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80cc210 con 0x7f96b8068f20 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96b7fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b8068f20 0x7f96b80cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96b8157b90 0x7f96b80cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bca1c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f96b81577c0 0x7f96b8068810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:44462/0 (socket says 172.21.15.6:44462) 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bca1c700 1 -- 172.21.15.6:0/1095370539 learned_addr learned my addr 172.21.15.6:0/1095370539 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 -- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b8068f20 msgr2=0x7f96b80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 --2- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b8068f20 0x7f96b80cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 -- 172.21.15.6:0/1095370539 >> v1:172.21.15.118:6789/0 conn(0x7f96b81577c0 legacy=0x7f96b8068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 -- 172.21.15.6:0/1095370539 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80cc4c0 con 0x7f96b8157b90 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96b77fe700 1 -- 172.21.15.6:0/1095370539 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143744867 0 0) 0x7f96b80cca80 con 0x7f96b81577c0 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96bd21d700 1 --2- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8157b90 0x7f96b80cbcd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96a00098e0 tx=0x7f96a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6296a554162773a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96b77fe700 1 -- 172.21.15.6:0/1095370539 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000b640 con 0x7f96b8157b90 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96b77fe700 1 -- 172.21.15.6:0/1095370539 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000b7a0 con 0x7f96b8157b90 2023-10-09T11:46:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.143+0000 7f96b77fe700 1 -- 172.21.15.6:0/1095370539 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000bb40 con 0x7f96b8157b90 2023-10-09T11:46:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 -- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8157b90 msgr2=0x7f96b80cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 --2- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8157b90 0x7f96b80cbcd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96a00098e0 tx=0x7f96a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 -- 172.21.15.6:0/1095370539 shutdown_connections 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 --2- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8157b90 0x7f96b80cbcd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 --2- 172.21.15.6:0/1095370539 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b8068f20 0x7f96b80cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 -- 172.21.15.6:0/1095370539 >> 172.21.15.6:0/1095370539 conn(0x7f96b80d0df0 msgr2=0x7f96b80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 -- 172.21.15.6:0/1095370539 shutdown_connections 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.144+0000 7f96bec80700 1 -- 172.21.15.6:0/1095370539 wait complete. 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.145+0000 7f96bec80700 1 Processor -- start 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.145+0000 7f96bec80700 1 -- start start 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8068f20 0x7f96b80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b81577c0 0x7f96b8145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b81542d0 con 0x7f96b8157b90 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8145da0 con 0x7f96b8068f20 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bec80700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b815d0d0 con 0x7f96b81577c0 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bd21d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bd21d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54066/0 (socket says 172.21.15.6:54066) 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bd21d700 1 -- 172.21.15.6:0/619413508 learned_addr learned my addr 172.21.15.6:0/619413508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96bca1c700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8068f20 0x7f96b80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.146+0000 7f96b7fff700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b81577c0 0x7f96b8145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 -- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b81577c0 msgr2=0x7f96b8145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b81577c0 0x7f96b8145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 -- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8068f20 msgr2=0x7f96b80c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8068f20 0x7f96b80c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 -- 172.21.15.6:0/619413508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009420 con 0x7f96b8157b90 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bd21d700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f96a0013000 tx=0x7f96a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000bb20 con 0x7f96b8157b90 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0011420 con 0x7f96b8157b90 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00117a0 con 0x7f96b8157b90 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b81539a0 con 0x7f96b8157b90 2023-10-09T11:46:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.147+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b8153f60 con 0x7f96b8157b90 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.148+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b8067a50 con 0x7f96b8157b90 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.148+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96a0011b10 con 0x7f96b8157b90 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.149+0000 7f96b4ff9700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 0x7f96980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.149+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f96a0085e60 con 0x7f96b8157b90 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.149+0000 7f96bca1c700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 0x7f96980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.149+0000 7f96bca1c700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 0x7f96980693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f96b0007fd0 tx=0x7f96b0007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.153+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96a0053210 con 0x7f96b8157b90 2023-10-09T11:46:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:52.350+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f96b80cc7a0 con 0x7f96b8157b90 2023-10-09T11:46:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.002+0000 7f96b4ff9700 1 -- 172.21.15.6:0/619413508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) v1 ==== 170+0+0 (secure 0 0 0) 0x7f96a005ae60 con 0x7f96b8157b90 2023-10-09T11:46:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 msgr2=0x7f96980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 0x7f96980693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f96b0007fd0 tx=0x7f96b0007d30 comp rx=0 tx=0).stop 2023-10-09T11:46:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 msgr2=0x7f96b80b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f96a0013000 tx=0x7f96a0017000 comp rx=0 tx=0).stop 2023-10-09T11:46:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 shutdown_connections 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9698066f30 0x7f96980693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96b8157b90 0x7f96b80b4ac0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b8068f20 0x7f96b80c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 --2- 172.21.15.6:0/619413508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b81577c0 0x7f96b8145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 >> 172.21.15.6:0/619413508 conn(0x7f96b80d0df0 msgr2=0x7f96b80cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 shutdown_connections 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.008+0000 7f96bec80700 1 -- 172.21.15.6:0/619413508 wait complete. 2023-10-09T11:46:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-09T11:46:53.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T11:46:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.147+0000 7f97c33dd700 1 Processor -- start 2023-10-09T11:46:53.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.147+0000 7f97c33dd700 1 -- start start 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c33dd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97bc06e4e0 0x7f97bc06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c33dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 0x7f97bc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c33dd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0aaf40 con 0x7f97bc159cb0 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c33dd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc06c570 con 0x7f97bc06e4e0 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c33dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc0aa930 con 0x7f97bc0cf080 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c1bda700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97bc06e4e0 0x7f97bc06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c23db700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97bc159cb0 0x7f97bc0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60424/0 (socket says 172.21.15.6:60424) 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c23db700 1 -- 172.21.15.6:0/952900934 learned_addr learned my addr 172.21.15.6:0/952900934 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c2bdc700 1 --2- 172.21.15.6:0/952900934 >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 0x7f97bc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c1bda700 1 -- 172.21.15.6:0/952900934 >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 msgr2=0x7f97bc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c1bda700 1 --2- 172.21.15.6:0/952900934 >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 0x7f97bc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c1bda700 1 -- 172.21.15.6:0/952900934 >> v1:172.21.15.6:6789/0 conn(0x7f97bc159cb0 legacy=0x7f97bc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c13d9700 1 -- 172.21.15.6:0/952900934 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901991731 0 0) 0x7f97bc0aaf40 con 0x7f97bc159cb0 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c1bda700 1 -- 172.21.15.6:0/952900934 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc06e970 con 0x7f97bc06e4e0 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.148+0000 7f97c2bdc700 1 --2- 172.21.15.6:0/952900934 >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 0x7f97bc06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c1bda700 1 --2- 172.21.15.6:0/952900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc06cca0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0b4ab0 tx=0x7f97ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0234b2cb9aee659 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c13d9700 1 -- 172.21.15.6:0/952900934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00b6b0 con 0x7f97bc06e4e0 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c13d9700 1 -- 172.21.15.6:0/952900934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00b810 con 0x7f97bc06e4e0 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c13d9700 1 -- 172.21.15.6:0/952900934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00bbb0 con 0x7f97bc06e4e0 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 -- 172.21.15.6:0/952900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 msgr2=0x7f97bc06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 --2- 172.21.15.6:0/952900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc06cca0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0b4ab0 tx=0x7f97ac0091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 -- 172.21.15.6:0/952900934 shutdown_connections 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 --2- 172.21.15.6:0/952900934 >> v2:172.21.15.118:3300/0 conn(0x7f97bc0cf080 0x7f97bc06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 --2- 172.21.15.6:0/952900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc06cca0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 -- 172.21.15.6:0/952900934 >> 172.21.15.6:0/952900934 conn(0x7f97bc068110 msgr2=0x7f97bc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 -- 172.21.15.6:0/952900934 shutdown_connections 2023-10-09T11:46:53.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.149+0000 7f97c33dd700 1 -- 172.21.15.6:0/952900934 wait complete. 2023-10-09T11:46:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 Processor -- start 2023-10-09T11:46:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 -- start start 2023-10-09T11:46:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97bc0cf080 0x7f97bc0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc159cb0 0x7f97bc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0b4030 con 0x7f97bc06e4e0 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0b3420 con 0x7f97bc159cb0 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c33dd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0b3700 con 0x7f97bc0cf080 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c23db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c23db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54090/0 (socket says 172.21.15.6:54090) 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.151+0000 7f97c23db700 1 -- 172.21.15.6:0/928032706 learned_addr learned my addr 172.21.15.6:0/928032706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c2bdc700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc159cb0 0x7f97bc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c1bda700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97bc0cf080 0x7f97bc0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 -- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97bc0cf080 msgr2=0x7f97bc0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97bc0cf080 0x7f97bc0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 -- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc159cb0 msgr2=0x7f97bc0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc159cb0 0x7f97bc0c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 -- 172.21.15.6:0/928032706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac009420 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c23db700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c5b0 tx=0x7f97b8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8005b30 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8005c90 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc0b39e0 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8007300 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.152+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc0b3110 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.153+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc069c00 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.154+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97b801b3b0 con 0x7f97bc06e4e0 2023-10-09T11:46:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.154+0000 7f97b27fc700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 0x7f97a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.154+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f97b8083a00 con 0x7f97bc06e4e0 2023-10-09T11:46:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.154+0000 7f97c1bda700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 0x7f97a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.155+0000 7f97c1bda700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 0x7f97a00693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0c90f0 tx=0x7f97ac017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.159+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97b8050cd0 con 0x7f97bc06e4e0 2023-10-09T11:46:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.397+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f97bc0aabd0 con 0x7f97bc06e4e0 2023-10-09T11:46:54.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:53.996+0000 7f97b27fc700 1 -- 172.21.15.6:0/928032706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7f97b80170c0 con 0x7f97bc06e4e0 2023-10-09T11:46:54.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.014+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 msgr2=0x7f97a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.014+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 0x7f97a00693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0c90f0 tx=0x7f97ac017000 comp rx=0 tx=0).stop 2023-10-09T11:46:54.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.014+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 msgr2=0x7f97bc0b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.014+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c5b0 tx=0x7f97b8001070 comp rx=0 tx=0).stop 2023-10-09T11:46:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 shutdown_connections 2023-10-09T11:46:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f97a0066f30 0x7f97a00693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc159cb0 0x7f97bc0c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97bc06e4e0 0x7f97bc0b2bd0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 --2- 172.21.15.6:0/928032706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97bc0cf080 0x7f97bc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 >> 172.21.15.6:0/928032706 conn(0x7f97bc068110 msgr2=0x7f97bc06cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 shutdown_connections 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.015+0000 7f97c33dd700 1 -- 172.21.15.6:0/928032706 wait complete. 2023-10-09T11:46:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 22 and data pool 23 2023-10-09T11:46:54.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.153+0000 7fd1c0f44700 1 Processor -- start 2023-10-09T11:46:54.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.153+0000 7fd1c0f44700 1 -- start start 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1c0f44700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1bc159f10 0x7fd1bc068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1c0f44700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1c0f44700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc069120 con 0x7fd1bc159b40 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1c0f44700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cee10 con 0x7fd1bc068cc0 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1c0f44700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0cd040 con 0x7fd1bc159f10 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47390/0 (socket says 172.21.15.6:47390) 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 -- 172.21.15.6:0/2473083154 learned_addr learned my addr 172.21.15.6:0/2473083154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1baffd700 1 --2- 172.21.15.6:0/2473083154 >> v2:172.21.15.118:3300/0 conn(0x7fd1bc159f10 0x7fd1bc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 -- 172.21.15.6:0/2473083154 >> v2:172.21.15.118:3300/0 conn(0x7fd1bc159f10 msgr2=0x7fd1bc068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 --2- 172.21.15.6:0/2473083154 >> v2:172.21.15.118:3300/0 conn(0x7fd1bc159f10 0x7fd1bc068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 -- 172.21.15.6:0/2473083154 >> v1:172.21.15.118:6789/0 conn(0x7fd1bc159b40 legacy=0x7fd1bc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 -- 172.21.15.6:0/2473083154 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0cd320 con 0x7fd1bc068cc0 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.154+0000 7fd1bbfff700 1 --2- 172.21.15.6:0/2473083154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc06fd80 tx=0x7fd1b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d53b19b4e1d014 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1ba7fc700 1 -- 172.21.15.6:0/2473083154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400e070 con 0x7fd1bc068cc0 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1ba7fc700 1 -- 172.21.15.6:0/2473083154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400ba20 con 0x7fd1bc068cc0 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1ba7fc700 1 -- 172.21.15.6:0/2473083154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40092e0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2473083154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 msgr2=0x7fd1bc0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2473083154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc06fd80 tx=0x7fd1b4009840 comp rx=0 tx=0).stop 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2473083154 shutdown_connections 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2473083154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc0cf2a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2473083154 >> v2:172.21.15.118:3300/0 conn(0x7fd1bc159f10 0x7fd1bc068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2473083154 >> 172.21.15.6:0/2473083154 conn(0x7fd1bc0cd660 msgr2=0x7fd1bc0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2473083154 shutdown_connections 2023-10-09T11:46:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.155+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2473083154 wait complete. 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.156+0000 7fd1c0f44700 1 Processor -- start 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 -- start start 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1bc159b40 0x7fd1bc153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1bc159f10 0x7fd1bc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc158810 con 0x7fd1bc068cc0 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1565a0 con 0x7fd1bc159f10 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1c0f44700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc156880 con 0x7fd1bc159b40 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47400/0 (socket says 172.21.15.6:47400) 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.157+0000 7fd1bb7fe700 1 -- 172.21.15.6:0/2419060908 learned_addr learned my addr 172.21.15.6:0/2419060908 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1baffd700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1bc159b40 0x7fd1bc153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bbfff700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1bc159f10 0x7fd1bc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 -- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1bc159b40 msgr2=0x7fd1bc153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1bc159b40 0x7fd1bc153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 -- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1bc159f10 msgr2=0x7fd1bc06ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1bc159f10 0x7fd1bc06ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 -- 172.21.15.6:0/2419060908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009ae0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1bb7fe700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c590 tx=0x7fd1ac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011590 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0116f0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc156b60 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011ab0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.158+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc153fb0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.159+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc0d0130 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.159+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1ac01b3b0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.160+0000 7fd1a37fe700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 0x7fd1a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.160+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1ac083960 con 0x7fd1bc068cc0 2023-10-09T11:46:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.160+0000 7fd1baffd700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 0x7fd1a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.160+0000 7fd1baffd700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 0x7fd1a80693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006f00 tx=0x7fd1b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.164+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1ac050bd0 con 0x7fd1bc068cc0 2023-10-09T11:46:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.363+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1bc069120 con 0x7fd1bc068cc0 2023-10-09T11:46:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.364+0000 7fd1a37fe700 1 -- 172.21.15.6:0/2419060908 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fd1bc069120 con 0x7fd1bc068cc0 2023-10-09T11:46:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:54.364 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":177,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:53.398213+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 msgr2=0x7fd1a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 0x7fd1a80693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0006f00 tx=0x7fd1b0008040 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 msgr2=0x7fd1bc155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c590 tx=0x7fd1ac00c950 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 shutdown_connections 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd1a8066f30 0x7fd1a80693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1bc159f10 0x7fd1bc06ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc068cc0 0x7fd1bc155f00 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 --2- 172.21.15.6:0/2419060908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1bc159b40 0x7fd1bc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 >> 172.21.15.6:0/2419060908 conn(0x7fd1bc0cd660 msgr2=0x7fd1bc06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 shutdown_connections 2023-10-09T11:46:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.366+0000 7fd1c0f44700 1 -- 172.21.15.6:0/2419060908 wait complete. 2023-10-09T11:46:54.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.496+0000 7fa4f2425700 1 Processor -- start 2023-10-09T11:46:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.496+0000 7fa4f2425700 1 -- start start 2023-10-09T11:46:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4f2425700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4ec0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4f2425700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec0b0ca0 con 0x7fa4ec0cf240 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4f2425700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec0b00d0 con 0x7fa4ec15a2a0 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4f2425700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec06ea90 con 0x7fa4ec06dd60 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4eb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4ec0cf240 0x7fa4ec06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55794/0 (socket says 172.21.15.6:55794) 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.497+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/692618527 learned_addr learned my addr 172.21.15.6:0/692618527 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4f09c2700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4ec0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324466649 0 0) 0x7fa4ec0b0ca0 con 0x7fa4ec0cf240 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d8003570 con 0x7fa4ec0cf240 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618416731 0 0) 0x7fa4ec0b00d0 con 0x7fa4ec15a2a0 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ec0b0ca0 con 0x7fa4ec15a2a0 2023-10-09T11:46:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396470690 0 0) 0x7fa4d8003570 con 0x7fa4ec0cf240 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 msgr2=0x7fa4ec0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4ec0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 >> v1:172.21.15.118:6789/0 conn(0x7fa4ec15a2a0 legacy=0x7fa4ec0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0b0370 con 0x7fa4ec0cf240 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fa4d4001470 con 0x7fa4ec0cf240 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 >> v1:172.21.15.6:6789/0 conn(0x7fa4ec0cf240 legacy=0x7fa4ec06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8003c20 0x7fa4d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d8004810 0x7fa4d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec06ea90 con 0x7fa4d8004810 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d800bbf0 con 0x7fa4d8003c20 2023-10-09T11:46:54.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d800bdb0 con 0x7fa4ec06dd60 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d8004810 0x7fa4d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4ebfff700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8003c20 0x7fa4d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4f09c2700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.498+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 msgr2=0x7fa4d8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec06dd60 0x7fa4d8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8003c20 msgr2=0x7fa4d8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8003c20 0x7fa4d8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/692618527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8003570 con 0x7fa4d8004810 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d8004810 0x7fa4d8004c80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec06f960 tx=0x7fa4d4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79ae78fd7496fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400ca80 con 0x7fa4d8004810 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d400cc00 con 0x7fa4d8004810 2023-10-09T11:46:54.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4eaffd700 1 -- 172.21.15.6:0/692618527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4005920 con 0x7fa4d8004810 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 -- 172.21.15.6:0/692618527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d8004810 msgr2=0x7fa4d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 --2- 172.21.15.6:0/692618527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d8004810 0x7fa4d8004c80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec06f960 tx=0x7fa4d4001d40 comp rx=0 tx=0).stop 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f09c2700 1 -- 172.21.15.6:0/692618527 reap_dead start 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 -- 172.21.15.6:0/692618527 shutdown_connections 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 -- 172.21.15.6:0/692618527 >> 172.21.15.6:0/692618527 conn(0x7fa4ec067640 msgr2=0x7fa4ec067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 -- 172.21.15.6:0/692618527 shutdown_connections 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.499+0000 7fa4f2425700 1 -- 172.21.15.6:0/692618527 wait complete. 2023-10-09T11:46:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.501+0000 7fa4f2425700 1 Processor -- start 2023-10-09T11:46:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.501+0000 7fa4f2425700 1 -- start start 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.501+0000 7fa4f2425700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8004810 0x7fa4ec154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec158be0 0x7fa4ec159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1595a0 con 0x7fa4ec155540 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec16b170 con 0x7fa4d8004810 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec16a840 con 0x7fa4ec158be0 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47426/0 (socket says 172.21.15.6:47426) 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/3069216130 learned_addr learned my addr 172.21.15.6:0/3069216130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4ebfff700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8004810 0x7fa4ec154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f09c2700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec158be0 0x7fa4ec159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec158be0 msgr2=0x7fa4ec159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec158be0 0x7fa4ec159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8004810 msgr2=0x7fa4ec154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8004810 0x7fa4ec154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 -- 172.21.15.6:0/3069216130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec16ab20 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4eb7fe700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001120 tx=0x7fa4d4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4005c90 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4005df0 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec16ae00 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40072e0 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.502+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec0ceeb0 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.503+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec0cf0a0 con 0x7fa4ec155540 2023-10-09T11:46:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.504+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4d4019030 con 0x7fa4ec155540 2023-10-09T11:46:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.504+0000 7fa4e3fff700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 0x7fa4cc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.504+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4d4085640 con 0x7fa4ec155540 2023-10-09T11:46:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.504+0000 7fa4ebfff700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 0x7fa4cc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.505+0000 7fa4ebfff700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 0x7fa4cc069410 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000c00 tx=0x7fa4dc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.509+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4ec0cf0a0 con 0x7fa4ec155540 2023-10-09T11:46:54.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.701+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4ec0cf0a0 con 0x7fa4ec155540 2023-10-09T11:46:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.702+0000 7fa4e3fff700 1 -- 172.21.15.6:0/3069216130 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+15330 (secure 0 0 0) 0x7fa4ec0cf0a0 con 0x7fa4ec155540 2023-10-09T11:46:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:54.702 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":177,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:53.398213+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 msgr2=0x7fa4cc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 0x7fa4cc069410 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000c00 tx=0x7fa4dc007d30 comp rx=0 tx=0).stop 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 msgr2=0x7fa4ec0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001120 tx=0x7fa4d4015000 comp rx=0 tx=0).stop 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 shutdown_connections 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa4cc066f60 0x7fa4cc069410 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4ec158be0 0x7fa4ec159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d8004810 0x7fa4ec154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 --2- 172.21.15.6:0/3069216130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec155540 0x7fa4ec0ce970 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 >> 172.21.15.6:0/3069216130 conn(0x7fa4ec067640 msgr2=0x7fa4ec0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 shutdown_connections 2023-10-09T11:46:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.704+0000 7fa4f2425700 1 -- 172.21.15.6:0/3069216130 wait complete. 2023-10-09T11:46:54.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T11:46:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.838+0000 7f35375ac700 1 Processor -- start 2023-10-09T11:46:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.839+0000 7f35375ac700 1 -- start start 2023-10-09T11:46:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.839+0000 7f35375ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 0x7f35300cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.839+0000 7f35375ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f35300c71d0 0x7f35300c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.839+0000 7f35375ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300cb880 con 0x7f35300cc250 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f35375ac700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300c7bb0 con 0x7f35300c71d0 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f35375ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353006aa10 con 0x7f3530156420 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3534b47700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35300cc250 0x7f3530069440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55798/0 (socket says 172.21.15.6:55798) 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3534b47700 1 -- 172.21.15.6:0/4273206157 learned_addr learned my addr 172.21.15.6:0/4273206157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535348700 1 --2- 172.21.15.6:0/4273206157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 0x7f35300cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535b49700 1 --2- 172.21.15.6:0/4273206157 >> v2:172.21.15.118:3300/0 conn(0x7f35300c71d0 0x7f35300c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976941072 0 0) 0x7f35300cb880 con 0x7f35300cc250 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003570 con 0x7f35300cc250 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535348700 1 -- 172.21.15.6:0/4273206157 >> v2:172.21.15.118:3300/0 conn(0x7f35300c71d0 msgr2=0x7f35300c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535348700 1 --2- 172.21.15.6:0/4273206157 >> v2:172.21.15.118:3300/0 conn(0x7f35300c71d0 0x7f35300c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535348700 1 -- 172.21.15.6:0/4273206157 >> v1:172.21.15.6:6789/0 conn(0x7f35300cc250 legacy=0x7f3530069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189156668 0 0) 0x7f3518003570 con 0x7f35300cc250 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.840+0000 7f3535348700 1 -- 172.21.15.6:0/4273206157 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300cac70 con 0x7f3530156420 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f3535348700 1 --2- 172.21.15.6:0/4273206157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 0x7f35300cbd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f352800aa90 tx=0x7f352800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c1384c1da946700 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524001470 con 0x7f3530156420 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800c660 con 0x7f3530156420 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f352ffff700 1 -- 172.21.15.6:0/4273206157 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800ca00 con 0x7f3530156420 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 -- 172.21.15.6:0/4273206157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 msgr2=0x7f35300cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 --2- 172.21.15.6:0/4273206157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 0x7f35300cbd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f352800aa90 tx=0x7f352800a330 comp rx=0 tx=0).stop 2023-10-09T11:46:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 -- 172.21.15.6:0/4273206157 shutdown_connections 2023-10-09T11:46:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 --2- 172.21.15.6:0/4273206157 >> v2:172.21.15.118:3300/0 conn(0x7f35300c71d0 0x7f35300c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 --2- 172.21.15.6:0/4273206157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3530156420 0x7f35300cbd10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 -- 172.21.15.6:0/4273206157 >> 172.21.15.6:0/4273206157 conn(0x7f353006c660 msgr2=0x7f35300cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 -- 172.21.15.6:0/4273206157 shutdown_connections 2023-10-09T11:46:54.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.841+0000 7f35375ac700 1 -- 172.21.15.6:0/4273206157 wait complete. 2023-10-09T11:46:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.842+0000 7f35375ac700 1 Processor -- start 2023-10-09T11:46:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 -- start start 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35300c71d0 0x7f3530134eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300cc250 0x7f353014e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353014af60 con 0x7f3530156420 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353014b240 con 0x7f35300cc250 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f35375ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353014b520 con 0x7f35300c71d0 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.843+0000 7f3535b49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47440/0 (socket says 172.21.15.6:47440) 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 -- 172.21.15.6:0/2144307253 learned_addr learned my addr 172.21.15.6:0/2144307253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3534b47700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300cc250 0x7f353014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535348700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35300c71d0 0x7f3530134eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 -- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35300c71d0 msgr2=0x7f3530134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35300c71d0 0x7f3530134eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 -- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300cc250 msgr2=0x7f353014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300cc250 0x7f353014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 -- 172.21.15.6:0/2144307253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352800a5d0 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f3535b49700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3520009e90 tx=0x7f352000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000cc20 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000f040 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353014b800 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520014480 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.844+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301491e0 con 0x7f3530156420 2023-10-09T11:46:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.845+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300c7880 con 0x7f3530156420 2023-10-09T11:46:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.846+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3520014830 con 0x7f3530156420 2023-10-09T11:46:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.846+0000 7f352d7fa700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.846+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3520085060 con 0x7f3530156420 2023-10-09T11:46:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.846+0000 7f3535348700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.846+0000 7f3535348700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f352800a370 tx=0x7f3528019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:54.850+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3520055d60 con 0x7f3530156420 2023-10-09T11:46:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:55.091+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f35300caf50 con 0x7f3530156420 2023-10-09T11:46:56.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.024+0000 7f352d7fa700 1 -- 172.21.15.6:0/2144307253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7f35200558f0 con 0x7f3530156420 2023-10-09T11:46:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 msgr2=0x7f351c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f352800a370 tx=0x7f3528019000 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 msgr2=0x7f353014a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3520009e90 tx=0x7f352000b040 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 shutdown_connections 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3530156420 0x7f353014a580 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35300c71d0 0x7f3530134eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 --2- 172.21.15.6:0/2144307253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35300cc250 0x7f353014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 >> 172.21.15.6:0/2144307253 conn(0x7f353006c660 msgr2=0x7f353006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 shutdown_connections 2023-10-09T11:46:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.027+0000 7f35375ac700 1 -- 172.21.15.6:0/2144307253 wait complete. 2023-10-09T11:46:56.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T11:46:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.171+0000 7f09bca3f700 1 Processor -- start 2023-10-09T11:46:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.171+0000 7f09bca3f700 1 -- start start 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09bca3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09bca3f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09bca3f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b806dac0 con 0x7f09b81578d0 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09bca3f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80d07c0 con 0x7f09b806d120 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09bca3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80cfbb0 con 0x7f09b8157ca0 2023-10-09T11:46:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b6d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b659c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f09b81578d0 0x7f09b815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:35516/0 (socket says 172.21.15.6:35516) 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b6d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:51138/0 (socket says 172.21.15.6:51138) 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:60444/0 (socket says 172.21.15.6:60444) 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b659c700 1 -- 172.21.15.6:0/3935048181 learned_addr learned my addr 172.21.15.6:0/3935048181 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 -- 172.21.15.6:0/3935048181 >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 msgr2=0x7f09b806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/3935048181 >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 -- 172.21.15.6:0/3935048181 >> v1:172.21.15.118:6789/0 conn(0x7f09b81578d0 legacy=0x7f09b815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b5d9b700 1 -- 172.21.15.6:0/3935048181 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80cfe90 con 0x7f09b8157ca0 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.172+0000 7f09b6d9d700 1 --2- 172.21.15.6:0/3935048181 >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/3935048181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09a00098e0 tx=0x7f09a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82fdc57cb96c1d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09b559a700 1 -- 172.21.15.6:0/3935048181 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000b640 con 0x7f09b8157ca0 2023-10-09T11:46:56.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09b559a700 1 -- 172.21.15.6:0/3935048181 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000b7a0 con 0x7f09b8157ca0 2023-10-09T11:46:56.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09b559a700 1 -- 172.21.15.6:0/3935048181 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000bb40 con 0x7f09b8157ca0 2023-10-09T11:46:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 -- 172.21.15.6:0/3935048181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 msgr2=0x7f09b80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 --2- 172.21.15.6:0/3935048181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f09a00098e0 tx=0x7f09a00091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 -- 172.21.15.6:0/3935048181 shutdown_connections 2023-10-09T11:46:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 --2- 172.21.15.6:0/3935048181 >> v2:172.21.15.118:3300/0 conn(0x7f09b806d120 0x7f09b806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 --2- 172.21.15.6:0/3935048181 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b80cf4f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 -- 172.21.15.6:0/3935048181 >> 172.21.15.6:0/3935048181 conn(0x7f09b806bb90 msgr2=0x7f09b806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 -- 172.21.15.6:0/3935048181 shutdown_connections 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.173+0000 7f09bca3f700 1 -- 172.21.15.6:0/3935048181 wait complete. 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.174+0000 7f09bca3f700 1 Processor -- start 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 -- start start 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 0x7f09b816d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b816bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b816bc90 con 0x7f09b806d120 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80aac00 con 0x7f09b81578d0 2023-10-09T11:46:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09bca3f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80aaee0 con 0x7f09b8157ca0 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09b659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09b659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47454/0 (socket says 172.21.15.6:47454) 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.175+0000 7f09b659c700 1 -- 172.21.15.6:0/2938288438 learned_addr learned my addr 172.21.15.6:0/2938288438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b6d9d700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b816bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 0x7f09b816d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 -- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 msgr2=0x7f09b816bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b816bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 -- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 msgr2=0x7f09b816d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 0x7f09b816d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 -- 172.21.15.6:0/2938288438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009a20 con 0x7f09b806d120 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 0x7f09b816d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b6d9d700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b816bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09b659c700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f09b000c7c0 tx=0x7f09b0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0005b30 con 0x7f09b806d120 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0005cb0 con 0x7f09b806d120 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a0009420 con 0x7f09b806d120 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0004a80 con 0x7f09b806d120 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.176+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b80ab4a0 con 0x7f09b806d120 2023-10-09T11:46:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.177+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b8067ac0 con 0x7f09b806d120 2023-10-09T11:46:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.177+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09b00070f0 con 0x7f09b806d120 2023-10-09T11:46:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.178+0000 7f09ae7fc700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.178+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09b0083820 con 0x7f09b806d120 2023-10-09T11:46:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.178+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.178+0000 7f09b5d9b700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 0x7f09980693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09a00093f0 tx=0x7f09a0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.182+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09b0050b10 con 0x7f09b806d120 2023-10-09T11:46:56.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:56.422+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09b806dac0 con 0x7f09b806d120 2023-10-09T11:46:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.030+0000 7f09ae7fc700 1 -- 172.21.15.6:0/2938288438 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09b806dac0 con 0x7f09b806d120 2023-10-09T11:46:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 msgr2=0x7f09980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 0x7f09980693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09a00093f0 tx=0x7f09a0017000 comp rx=0 tx=0).stop 2023-10-09T11:46:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 msgr2=0x7f09b816b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f09b000c7c0 tx=0x7f09b0007f70 comp rx=0 tx=0).stop 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 shutdown_connections 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0998066f30 0x7f09980693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09b8157ca0 0x7f09b816bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09b806d120 0x7f09b816b750 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 --2- 172.21.15.6:0/2938288438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09b81578d0 0x7f09b816d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 >> 172.21.15.6:0/2938288438 conn(0x7f09b806bb90 msgr2=0x7f09b81549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 shutdown_connections 2023-10-09T11:46:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.033+0000 7f09bca3f700 1 -- 172.21.15.6:0/2938288438 wait complete. 2023-10-09T11:46:57.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.168+0000 7fbd1f31d700 1 Processor -- start 2023-10-09T11:46:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.168+0000 7fbd1f31d700 1 -- start start 2023-10-09T11:46:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1f31d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd18157ca0 0x7fbd180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1f31d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd1806d120 0x7fbd1806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1f31d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd180d07c0 con 0x7fbd181578d0 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1f31d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1806da50 con 0x7fbd18157ca0 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1f31d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180cfbb0 con 0x7fbd1806d120 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd18157ca0 0x7fbd180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd18157ca0 0x7fbd180cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47466/0 (socket says 172.21.15.6:47466) 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1110632549 learned_addr learned my addr 172.21.15.6:0/1110632549 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1d8ba700 1 --2- 172.21.15.6:0/1110632549 >> v2:172.21.15.118:3300/0 conn(0x7fbd1806d120 0x7fbd1806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1110632549 >> v2:172.21.15.118:3300/0 conn(0x7fbd1806d120 msgr2=0x7fbd1806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 --2- 172.21.15.6:0/1110632549 >> v2:172.21.15.118:3300/0 conn(0x7fbd1806d120 0x7fbd1806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1110632549 >> v1:172.21.15.118:6789/0 conn(0x7fbd181578d0 legacy=0x7fbd1815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1110632549 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180cfe90 con 0x7fbd18157ca0 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.169+0000 7fbd1c8b8700 1 --2- 172.21.15.6:0/1110632549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd18157ca0 0x7fbd180cf4f0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbd18068300 tx=0x7fbd0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6f0288dc6593a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd17fff700 1 -- 172.21.15.6:0/1110632549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00e070 con 0x7fbd18157ca0 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd17fff700 1 -- 172.21.15.6:0/1110632549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00ba20 con 0x7fbd18157ca0 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd17fff700 1 -- 172.21.15.6:0/1110632549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0092e0 con 0x7fbd18157ca0 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1110632549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd18157ca0 msgr2=0x7fbd180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1110632549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd18157ca0 0x7fbd180cf4f0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbd18068300 tx=0x7fbd0c009840 comp rx=0 tx=0).stop 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1110632549 shutdown_connections 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1110632549 >> v2:172.21.15.118:3300/0 conn(0x7fbd1806d120 0x7fbd1806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1110632549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd18157ca0 0x7fbd180cf4f0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1110632549 >> 172.21.15.6:0/1110632549 conn(0x7fbd1806bb90 msgr2=0x7fbd1806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1110632549 shutdown_connections 2023-10-09T11:46:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.170+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1110632549 wait complete. 2023-10-09T11:46:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.171+0000 7fbd1f31d700 1 Processor -- start 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.171+0000 7fbd1f31d700 1 -- start start 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 0x7fbd180cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd18157ca0 0x7fbd180c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c6b10 con 0x7fbd181578d0 2023-10-09T11:46:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c5f00 con 0x7fbd1806d120 2023-10-09T11:46:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1f31d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c61e0 con 0x7fbd18157ca0 2023-10-09T11:46:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1c8b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1c8b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47480/0 (socket says 172.21.15.6:47480) 2023-10-09T11:46:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.172+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1060436226 learned_addr learned my addr 172.21.15.6:0/1060436226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1d0b9700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 0x7fbd180cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd18157ca0 msgr2=0x7fbd180c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd18157ca0 0x7fbd180c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 msgr2=0x7fbd180cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 0x7fbd180cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 -- 172.21.15.6:0/1060436226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c009ae0 con 0x7fbd181578d0 2023-10-09T11:46:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1d0b9700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 0x7fbd180cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1c8b8700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c012000 tx=0x7fbd0c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c008a80 con 0x7fbd181578d0 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c008c00 con 0x7fbd181578d0 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180c64c0 con 0x7fbd181578d0 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c01c410 con 0x7fbd181578d0 2023-10-09T11:46:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.173+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd18154140 con 0x7fbd181578d0 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.174+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd180c6c80 con 0x7fbd181578d0 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.175+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd0c003040 con 0x7fbd181578d0 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.175+0000 7fbd157fa700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.175+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd0c085b80 con 0x7fbd181578d0 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.175+0000 7fbd1d0b9700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.176+0000 7fbd1d0b9700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001840 tx=0x7fbd08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.179+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd0c052df0 con 0x7fbd181578d0 2023-10-09T11:46:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.415+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd180d0170 con 0x7fbd181578d0 2023-10-09T11:46:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.416+0000 7fbd157fa700 1 -- 172.21.15.6:0/1060436226 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fbd0c056410 con 0x7fbd181578d0 2023-10-09T11:46:57.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:57.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:46:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 msgr2=0x7fbd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001840 tx=0x7fbd08009040 comp rx=0 tx=0).stop 2023-10-09T11:46:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 msgr2=0x7fbd18153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c012000 tx=0x7fbd0c018000 comp rx=0 tx=0).stop 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 shutdown_connections 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd18157ca0 0x7fbd180c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd1806d120 0x7fbd180cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 --2- 172.21.15.6:0/1060436226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd181578d0 0x7fbd18153c00 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 >> 172.21.15.6:0/1060436226 conn(0x7fbd1806bb90 msgr2=0x7fbd18069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 shutdown_connections 2023-10-09T11:46:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.418+0000 7fbd1f31d700 1 -- 172.21.15.6:0/1060436226 wait complete. 2023-10-09T11:46:57.420 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:46:57.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:46:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.549+0000 7fb6aacd4700 1 Processor -- start 2023-10-09T11:46:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.549+0000 7fb6aacd4700 1 -- start start 2023-10-09T11:46:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.549+0000 7fb6aacd4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb6a4157ca0 0x7fb6a40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.549+0000 7fb6aacd4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40d07c0 con 0x7fb6a406d120 2023-10-09T11:46:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.549+0000 7fb6aacd4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40cfbb0 con 0x7fb6a41578d0 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6aacd4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a40cfe90 con 0x7fb6a4157ca0 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a9271700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6a406d120 0x7fb6a406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55814/0 (socket says 172.21.15.6:55814) 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a9271700 1 -- 172.21.15.6:0/1974316524 learned_addr learned my addr 172.21.15.6:0/1974316524 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a3fff700 1 --2- 172.21.15.6:0/1974316524 >> v2:172.21.15.118:3300/0 conn(0x7fb6a4157ca0 0x7fb6a40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497731795 0 0) 0x7fb6a40d07c0 con 0x7fb6a406d120 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb690003570 con 0x7fb6a406d120 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a3fff700 1 -- 172.21.15.6:0/1974316524 >> v1:172.21.15.118:6789/0 conn(0x7fb6a41578d0 legacy=0x7fb6a415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841516902 0 0) 0x7fb6a40cfbb0 con 0x7fb6a41578d0 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a3fff700 1 -- 172.21.15.6:0/1974316524 >> v1:172.21.15.6:6789/0 conn(0x7fb6a406d120 legacy=0x7fb6a406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a3fff700 1 -- 172.21.15.6:0/1974316524 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40d0170 con 0x7fb6a4157ca0 2023-10-09T11:46:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.550+0000 7fb6a3fff700 1 --2- 172.21.15.6:0/1974316524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a4157ca0 0x7fb6a40cf4f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb6940098e0 tx=0x7fb6940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9845005957df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400b640 con 0x7fb6a4157ca0 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400b7a0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6a37fe700 1 -- 172.21.15.6:0/1974316524 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400bb40 con 0x7fb6a4157ca0 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 -- 172.21.15.6:0/1974316524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a4157ca0 msgr2=0x7fb6a40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/1974316524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a4157ca0 0x7fb6a40cf4f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb6940098e0 tx=0x7fb6940091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 -- 172.21.15.6:0/1974316524 shutdown_connections 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/1974316524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a4157ca0 0x7fb6a40cf4f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 -- 172.21.15.6:0/1974316524 >> 172.21.15.6:0/1974316524 conn(0x7fb6a406bb90 msgr2=0x7fb6a406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 -- 172.21.15.6:0/1974316524 shutdown_connections 2023-10-09T11:46:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.551+0000 7fb6aacd4700 1 -- 172.21.15.6:0/1974316524 wait complete. 2023-10-09T11:46:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.552+0000 7fb6aacd4700 1 Processor -- start 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.552+0000 7fb6aacd4700 1 -- start start 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6a406d120 0x7fb6a41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 0x7fb6a4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4153dd0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b5510 con 0x7fb6a41578d0 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6aacd4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b45d0 con 0x7fb6a406d120 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6a9271700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6a9271700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47484/0 (socket says 172.21.15.6:47484) 2023-10-09T11:46:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6a9271700 1 -- 172.21.15.6:0/4075748352 learned_addr learned my addr 172.21.15.6:0/4075748352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.553+0000 7fb6a3fff700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 0x7fb6a4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 -- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6a406d120 msgr2=0x7fb6a41525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a8a70700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6a406d120 0x7fb6a41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6a406d120 0x7fb6a41525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 -- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 msgr2=0x7fb6a4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 0x7fb6a4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 -- 172.21.15.6:0/4075748352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694009420 con 0x7fb6a4157ca0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a3fff700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 0x7fb6a4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a9271700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c790 tx=0x7fb68c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c005c00 con 0x7fb6a4157ca0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c005d60 con 0x7fb6a4157ca0 2023-10-09T11:46:57.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a41531c0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0072e0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.554+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a4153780 con 0x7fb6a4157ca0 2023-10-09T11:46:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.555+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a4067ac0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.556+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb68c007690 con 0x7fb6a4157ca0 2023-10-09T11:46:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.556+0000 7fb6a0ff9700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.556+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb68c083a00 con 0x7fb6a4157ca0 2023-10-09T11:46:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.556+0000 7fb6a8a70700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.556+0000 7fb6a8a70700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.560+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb68c04b5a0 con 0x7fb6a4157ca0 2023-10-09T11:46:57.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.754+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6a40d0450 con 0x7fb6a4157ca0 2023-10-09T11:46:57.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.755+0000 7fb6a0ff9700 1 -- 172.21.15.6:0/4075748352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+15317 (secure 0 0 0) 0x7fb68c017090 con 0x7fb6a4157ca0 2023-10-09T11:46:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:57.755 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":178,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:46:54.992431+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 msgr2=0x7fb6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c009040 comp rx=0 tx=0).stop 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 msgr2=0x7fb6a416ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c790 tx=0x7fb68c007dd0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 shutdown_connections 2023-10-09T11:46:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6a4157ca0 0x7fb6a416ab10 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6a406d120 0x7fb6a41525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 --2- 172.21.15.6:0/4075748352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a41578d0 0x7fb6a4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.756+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 >> 172.21.15.6:0/4075748352 conn(0x7fb6a406bb90 msgr2=0x7fb6a41604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.757+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 shutdown_connections 2023-10-09T11:46:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.757+0000 7fb6aacd4700 1 -- 172.21.15.6:0/4075748352 wait complete. 2023-10-09T11:46:57.769 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T11:46:57.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:46:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.887+0000 7f243fe2c700 1 Processor -- start 2023-10-09T11:46:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.888+0000 7f243fe2c700 1 -- start start 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.888+0000 7f243fe2c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f24380cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.888+0000 7f243fe2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380d07c0 con 0x7f2438157ca0 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.888+0000 7f243fe2c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380cfbb0 con 0x7f24381578d0 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.888+0000 7f243fe2c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380cfe90 con 0x7f243806d830 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243d3c7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2438157ca0 0x7f243806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55818/0 (socket says 172.21.15.6:55818) 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243d3c7700 1 -- 172.21.15.6:0/4165348618 learned_addr learned my addr 172.21.15.6:0/4165348618 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243e3c9700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f24380cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436969 0 0) 0x7f24380d07c0 con 0x7f2438157ca0 2023-10-09T11:46:57.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2420003570 con 0x7f2438157ca0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363849179 0 0) 0x7f24380cfbb0 con 0x7f24381578d0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24380d07c0 con 0x7f24381578d0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713002349 0 0) 0x7f2420003570 con 0x7f2438157ca0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 msgr2=0x7f24380cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f24380cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 >> v1:172.21.15.118:6789/0 conn(0x7f24381578d0 legacy=0x7f243815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380d0170 con 0x7f2438157ca0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f242c001470 con 0x7f2438157ca0 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 >> v1:172.21.15.6:6789/0 conn(0x7f2438157ca0 legacy=0x7f243806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2420003c20 0x7f2420004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f2420004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2420004d50 0x7f24200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380cfe90 con 0x7f2420004d50 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242000bbf0 con 0x7f2420003c20 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242000bd60 con 0x7f243806d830 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.889+0000 7f243e3c9700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2420004d50 0x7f24200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243d3c7700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f2420004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243dbc8700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2420003c20 0x7f2420004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 -- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 msgr2=0x7f2420004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f243806d830 0x7f2420004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 -- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2420003c20 msgr2=0x7f2420004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:57.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2420003c20 0x7f2420004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 -- 172.21.15.6:0/4165348618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420003570 con 0x7f2420004d50 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243dbc8700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2420003c20 0x7f2420004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2420004d50 0x7f24200051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f24280094d0 tx=0x7f242800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec860fecf90e4b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800ea00 con 0x7f2420004d50 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242800f040 con 0x7f2420004d50 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243cbc6700 1 -- 172.21.15.6:0/4165348618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242800ed90 con 0x7f2420004d50 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243fe2c700 1 -- 172.21.15.6:0/4165348618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2420004d50 msgr2=0x7f24200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243fe2c700 1 --2- 172.21.15.6:0/4165348618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2420004d50 0x7f24200051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f24280094d0 tx=0x7f242800b040 comp rx=0 tx=0).stop 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243e3c9700 1 -- 172.21.15.6:0/4165348618 reap_dead start 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243fe2c700 1 -- 172.21.15.6:0/4165348618 shutdown_connections 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.890+0000 7f243fe2c700 1 -- 172.21.15.6:0/4165348618 >> 172.21.15.6:0/4165348618 conn(0x7f243806bb90 msgr2=0x7f243806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:57.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.891+0000 7f243fe2c700 1 -- 172.21.15.6:0/4165348618 shutdown_connections 2023-10-09T11:46:57.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.891+0000 7f243fe2c700 1 -- 172.21.15.6:0/4165348618 wait complete. 2023-10-09T11:46:57.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 Processor -- start 2023-10-09T11:46:57.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 -- start start 2023-10-09T11:46:57.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2438153b00 0x7f243816a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 0x7f24380b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b3500 con 0x7f243816ab60 2023-10-09T11:46:57.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243816b600 con 0x7f24380b3060 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243fe2c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243816b040 con 0x7f2438153b00 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243d3c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243d3c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47504/0 (socket says 172.21.15.6:47504) 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.892+0000 7f243d3c7700 1 -- 172.21.15.6:0/1151276922 learned_addr learned my addr 172.21.15.6:0/1151276922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243dbc8700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2438153b00 0x7f243816a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243e3c9700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 0x7f24380b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 -- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2438153b00 msgr2=0x7f243816a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2438153b00 0x7f243816a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 -- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 msgr2=0x7f24380b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:57.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 0x7f24380b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 -- 172.21.15.6:0/1151276922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243816b320 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243e3c9700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 0x7f24380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243d3c7700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f242c0073c0 tx=0x7f243815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c018030 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c000f50 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24380c5c30 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00faa0 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.893+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2438153ed0 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.894+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24380c6150 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.895+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f242c01b070 con 0x7f243816ab60 2023-10-09T11:46:57.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.895+0000 7f2435ffb700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 0x7f24240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:57.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.895+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f242c019070 con 0x7f243816ab60 2023-10-09T11:46:57.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.895+0000 7f243dbc8700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 0x7f24240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:57.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.896+0000 7f243dbc8700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 0x7f24240693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2430000c00 tx=0x7f243000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:57.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:57.899+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24380c6150 con 0x7f243816ab60 2023-10-09T11:46:58.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.090+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24380c6150 con 0x7f2424066f30 2023-10-09T11:46:58.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.098+0000 7f2435ffb700 1 -- 172.21.15.6:0/1151276922 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282528 (secure 0 0 0) 0x7f24380c6150 con 0x7f2424066f30 2023-10-09T11:46:58.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 msgr2=0x7f24240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 0x7f24240693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2430000c00 tx=0x7f243000c040 comp rx=0 tx=0).stop 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 msgr2=0x7f24380b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f242c0073c0 tx=0x7f243815b610 comp rx=0 tx=0).stop 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 shutdown_connections 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f2424066f30 0x7f24240693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24380b3060 0x7f24380b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2438153b00 0x7f243816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 --2- 172.21.15.6:0/1151276922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f243816ab60 0x7f24380b2b20 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 >> 172.21.15.6:0/1151276922 conn(0x7f243806bb90 msgr2=0x7f2438155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.101+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 shutdown_connections 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.102+0000 7f243fe2c700 1 -- 172.21.15.6:0/1151276922 wait complete. 2023-10-09T11:46:58.106 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:46:58.114 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2023-10-09T11:46:56.293531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8782,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553717,"statfs":{"total":1600000000,"available":1591007197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.306936"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.995606+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:54.320542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000142+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:29.974468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994356+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:29.974468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994863+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:20.527679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000842+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:15.082641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.004443+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:48.851950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999377+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:19:53.018394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999725+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:42.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.001802+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.709390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000429+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:22.176652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999631+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:36.183811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.001249+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:31.661678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994026+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:36.183811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993747+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:06:04.266738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.995349+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:56.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997839+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:54:17.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.004831+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:59:38.136121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.003640+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:46:54.320542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.003472+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:05:53.614896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994462+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:22.176652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.003316+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:21.278803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000899+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:47.989187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002740+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:50:18.115888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002528+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:55.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994121+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:42.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997452+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:16:52.196689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993445+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:26.227257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.995101+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:15.082641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993448+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:49.092866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.996241+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:31.661678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997613+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:06.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002140+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:02.842150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.998639+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:19.777210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.998628+0000","last_change":"2023-10-09T11:46:52.998628+0000","last_active":"2023-10-09T11:46:52.998628+0000","last_peered":"2023-10-09T11:46:52.998628+0000","last_clean":"2023-10-09T11:46:52.998628+0000","last_became_active":"2023-10-09T11:46:52.997999+0000","last_became_peered":"2023-10-09T11:46:52.997999+0000","last_unstale":"2023-10-09T11:46:52.998628+0000","last_undegraded":"2023-10-09T11:46:52.998628+0000","last_fullsized":"2023-10-09T11:46:52.998628+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:57.976522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.998358+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:46.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004913+0000","last_change":"2023-10-09T11:46:53.004913+0000","last_active":"2023-10-09T11:46:53.004913+0000","last_peered":"2023-10-09T11:46:53.004913+0000","last_clean":"2023-10-09T11:46:53.004913+0000","last_became_active":"2023-10-09T11:46:53.004683+0000","last_became_peered":"2023-10-09T11:46:53.004683+0000","last_unstale":"2023-10-09T11:46:53.004913+0000","last_undegraded":"2023-10-09T11:46:53.004913+0000","last_fullsized":"2023-10-09T11:46:53.004913+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:19.525621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002900+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:35:40.803634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004450+0000","last_change":"2023-10-09T11:46:53.004450+0000","last_active":"2023-10-09T11:46:53.004450+0000","last_peered":"2023-10-09T11:46:53.004450+0000","last_clean":"2023-10-09T11:46:53.004450+0000","last_became_active":"2023-10-09T11:46:53.004189+0000","last_became_peered":"2023-10-09T11:46:53.004189+0000","last_unstale":"2023-10-09T11:46:53.004450+0000","last_undegraded":"2023-10-09T11:46:53.004450+0000","last_fullsized":"2023-10-09T11:46:53.004450+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:31.468385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993689+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:46.720770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.998884+0000","last_change":"2023-10-09T11:46:52.998884+0000","last_active":"2023-10-09T11:46:52.998884+0000","last_peered":"2023-10-09T11:46:52.998884+0000","last_clean":"2023-10-09T11:46:52.998884+0000","last_became_active":"2023-10-09T11:46:52.998280+0000","last_became_peered":"2023-10-09T11:46:52.998280+0000","last_unstale":"2023-10-09T11:46:52.998884+0000","last_undegraded":"2023-10-09T11:46:52.998884+0000","last_fullsized":"2023-10-09T11:46:52.998884+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:45.718711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.001530+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:23.893370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.002991+0000","last_change":"2023-10-09T11:46:53.002991+0000","last_active":"2023-10-09T11:46:53.002991+0000","last_peered":"2023-10-09T11:46:53.002991+0000","last_clean":"2023-10-09T11:46:53.002991+0000","last_became_active":"2023-10-09T11:46:53.002755+0000","last_became_peered":"2023-10-09T11:46:53.002755+0000","last_unstale":"2023-10-09T11:46:53.002991+0000","last_undegraded":"2023-10-09T11:46:53.002991+0000","last_fullsized":"2023-10-09T11:46:53.002991+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:19.649034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997749+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:06.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.995684+0000","last_change":"2023-10-09T11:46:52.995684+0000","last_active":"2023-10-09T11:46:52.995684+0000","last_peered":"2023-10-09T11:46:52.995684+0000","last_clean":"2023-10-09T11:46:52.995684+0000","last_became_active":"2023-10-09T11:46:52.995421+0000","last_became_peered":"2023-10-09T11:46:52.995421+0000","last_unstale":"2023-10-09T11:46:52.995684+0000","last_undegraded":"2023-10-09T11:46:52.995684+0000","last_fullsized":"2023-10-09T11:46:52.995684+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:17.193219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994672+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:22.176652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004831+0000","last_change":"2023-10-09T11:46:53.004831+0000","last_active":"2023-10-09T11:46:53.004831+0000","last_peered":"2023-10-09T11:46:53.004831+0000","last_clean":"2023-10-09T11:46:53.004831+0000","last_became_active":"2023-10-09T11:46:53.004042+0000","last_became_peered":"2023-10-09T11:46:53.004042+0000","last_unstale":"2023-10-09T11:46:53.004831+0000","last_undegraded":"2023-10-09T11:46:53.004831+0000","last_fullsized":"2023-10-09T11:46:53.004831+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:48.090808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002805+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:22.633136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.000929+0000","last_change":"2023-10-09T11:46:53.000929+0000","last_active":"2023-10-09T11:46:53.000929+0000","last_peered":"2023-10-09T11:46:53.000929+0000","last_clean":"2023-10-09T11:46:53.000929+0000","last_became_active":"2023-10-09T11:46:53.000689+0000","last_became_peered":"2023-10-09T11:46:53.000689+0000","last_unstale":"2023-10-09T11:46:53.000929+0000","last_undegraded":"2023-10-09T11:46:53.000929+0000","last_fullsized":"2023-10-09T11:46:53.000929+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:23.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999052+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:43.033099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.996065+0000","last_change":"2023-10-09T11:46:52.996065+0000","last_active":"2023-10-09T11:46:52.996065+0000","last_peered":"2023-10-09T11:46:52.996065+0000","last_clean":"2023-10-09T11:46:52.996065+0000","last_became_active":"2023-10-09T11:46:52.995807+0000","last_became_peered":"2023-10-09T11:46:52.995807+0000","last_unstale":"2023-10-09T11:46:52.996065+0000","last_undegraded":"2023-10-09T11:46:52.996065+0000","last_fullsized":"2023-10-09T11:46:52.996065+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:48.424459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000539+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:58.978581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.996619+0000","last_change":"2023-10-09T11:46:52.996619+0000","last_active":"2023-10-09T11:46:52.996619+0000","last_peered":"2023-10-09T11:46:52.996619+0000","last_clean":"2023-10-09T11:46:52.996619+0000","last_became_active":"2023-10-09T11:46:52.996355+0000","last_became_peered":"2023-10-09T11:46:52.996355+0000","last_unstale":"2023-10-09T11:46:52.996619+0000","last_undegraded":"2023-10-09T11:46:52.996619+0000","last_fullsized":"2023-10-09T11:46:52.996619+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:59.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997982+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:55.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004428+0000","last_change":"2023-10-09T11:46:53.004428+0000","last_active":"2023-10-09T11:46:53.004428+0000","last_peered":"2023-10-09T11:46:53.004428+0000","last_clean":"2023-10-09T11:46:53.004428+0000","last_became_active":"2023-10-09T11:46:53.003958+0000","last_became_peered":"2023-10-09T11:46:53.003958+0000","last_unstale":"2023-10-09T11:46:53.004428+0000","last_undegraded":"2023-10-09T11:46:53.004428+0000","last_fullsized":"2023-10-09T11:46:53.004428+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:21.174594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.998581+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:36.433860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.997772+0000","last_change":"2023-10-09T11:46:52.997772+0000","last_active":"2023-10-09T11:46:52.997772+0000","last_peered":"2023-10-09T11:46:52.997772+0000","last_clean":"2023-10-09T11:46:52.997772+0000","last_became_active":"2023-10-09T11:46:52.997608+0000","last_became_peered":"2023-10-09T11:46:52.997608+0000","last_unstale":"2023-10-09T11:46:52.997772+0000","last_undegraded":"2023-10-09T11:46:52.997772+0000","last_fullsized":"2023-10-09T11:46:52.997772+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:48.090808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999958+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:35.624270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.996820+0000","last_change":"2023-10-09T11:46:52.996820+0000","last_active":"2023-10-09T11:46:52.996820+0000","last_peered":"2023-10-09T11:46:52.996820+0000","last_clean":"2023-10-09T11:46:52.996820+0000","last_became_active":"2023-10-09T11:46:52.996562+0000","last_became_peered":"2023-10-09T11:46:52.996562+0000","last_unstale":"2023-10-09T11:46:52.996820+0000","last_undegraded":"2023-10-09T11:46:52.996820+0000","last_fullsized":"2023-10-09T11:46:52.996820+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:45.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994409+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:29.974468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004371+0000","last_change":"2023-10-09T11:46:53.004371+0000","last_active":"2023-10-09T11:46:53.004371+0000","last_peered":"2023-10-09T11:46:53.004371+0000","last_clean":"2023-10-09T11:46:53.004371+0000","last_became_active":"2023-10-09T11:46:53.004107+0000","last_became_peered":"2023-10-09T11:46:53.004107+0000","last_unstale":"2023-10-09T11:46:53.004371+0000","last_undegraded":"2023-10-09T11:46:53.004371+0000","last_fullsized":"2023-10-09T11:46:53.004371+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:13.866796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993056+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:14.868855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.001917+0000","last_change":"2023-10-09T11:46:53.001917+0000","last_active":"2023-10-09T11:46:53.001917+0000","last_peered":"2023-10-09T11:46:53.001917+0000","last_clean":"2023-10-09T11:46:53.001917+0000","last_became_active":"2023-10-09T11:46:53.001230+0000","last_became_peered":"2023-10-09T11:46:53.001230+0000","last_unstale":"2023-10-09T11:46:53.001917+0000","last_undegraded":"2023-10-09T11:46:53.001917+0000","last_fullsized":"2023-10-09T11:46:53.001917+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:28.972409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993935+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:36.183811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004800+0000","last_change":"2023-10-09T11:46:53.004800+0000","last_active":"2023-10-09T11:46:53.004800+0000","last_peered":"2023-10-09T11:46:53.004800+0000","last_clean":"2023-10-09T11:46:53.004800+0000","last_became_active":"2023-10-09T11:46:53.004576+0000","last_became_peered":"2023-10-09T11:46:53.004576+0000","last_unstale":"2023-10-09T11:46:53.004800+0000","last_undegraded":"2023-10-09T11:46:53.004800+0000","last_fullsized":"2023-10-09T11:46:53.004800+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:21.327342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.000153+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:57.118813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.998436+0000","last_change":"2023-10-09T11:46:52.998436+0000","last_active":"2023-10-09T11:46:52.998436+0000","last_peered":"2023-10-09T11:46:52.998436+0000","last_clean":"2023-10-09T11:46:52.998436+0000","last_became_active":"2023-10-09T11:46:52.998176+0000","last_became_peered":"2023-10-09T11:46:52.998176+0000","last_unstale":"2023-10-09T11:46:52.998436+0000","last_undegraded":"2023-10-09T11:46:52.998436+0000","last_fullsized":"2023-10-09T11:46:52.998436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:20.698499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.994387+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:42.666802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.001924+0000","last_change":"2023-10-09T11:46:53.001924+0000","last_active":"2023-10-09T11:46:53.001924+0000","last_peered":"2023-10-09T11:46:53.001924+0000","last_clean":"2023-10-09T11:46:53.001924+0000","last_became_active":"2023-10-09T11:46:53.001387+0000","last_became_peered":"2023-10-09T11:46:53.001387+0000","last_unstale":"2023-10-09T11:46:53.001924+0000","last_undegraded":"2023-10-09T11:46:53.001924+0000","last_fullsized":"2023-10-09T11:46:53.001924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:01.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997023+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:56.607818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.002567+0000","last_change":"2023-10-09T11:46:53.002567+0000","last_active":"2023-10-09T11:46:53.002567+0000","last_peered":"2023-10-09T11:46:53.002567+0000","last_clean":"2023-10-09T11:46:53.002567+0000","last_became_active":"2023-10-09T11:46:53.002329+0000","last_became_peered":"2023-10-09T11:46:53.002329+0000","last_unstale":"2023-10-09T11:46:53.002567+0000","last_undegraded":"2023-10-09T11:46:53.002567+0000","last_fullsized":"2023-10-09T11:46:53.002567+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:44.987900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993097+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:18.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.005958+0000","last_change":"2023-10-09T11:46:53.005958+0000","last_active":"2023-10-09T11:46:53.005958+0000","last_peered":"2023-10-09T11:46:53.005958+0000","last_clean":"2023-10-09T11:46:53.005958+0000","last_became_active":"2023-10-09T11:46:53.005685+0000","last_became_peered":"2023-10-09T11:46:53.005685+0000","last_unstale":"2023-10-09T11:46:53.005958+0000","last_undegraded":"2023-10-09T11:46:53.005958+0000","last_fullsized":"2023-10-09T11:46:53.005958+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:19.564514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.001161+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:46.904955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.998655+0000","last_change":"2023-10-09T11:46:52.998655+0000","last_active":"2023-10-09T11:46:52.998655+0000","last_peered":"2023-10-09T11:46:52.998655+0000","last_clean":"2023-10-09T11:46:52.998655+0000","last_became_active":"2023-10-09T11:46:52.998437+0000","last_became_peered":"2023-10-09T11:46:52.998437+0000","last_unstale":"2023-10-09T11:46:52.998655+0000","last_undegraded":"2023-10-09T11:46:52.998655+0000","last_fullsized":"2023-10-09T11:46:52.998655+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:56.116755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.995235+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:27.113644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.996483+0000","last_change":"2023-10-09T11:46:52.996483+0000","last_active":"2023-10-09T11:46:52.996483+0000","last_peered":"2023-10-09T11:46:52.996483+0000","last_clean":"2023-10-09T11:46:52.996483+0000","last_became_active":"2023-10-09T11:46:52.996090+0000","last_became_peered":"2023-10-09T11:46:52.996090+0000","last_unstale":"2023-10-09T11:46:52.996483+0000","last_undegraded":"2023-10-09T11:46:52.996483+0000","last_fullsized":"2023-10-09T11:46:52.996483+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:25.225198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002727+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:27:08.261966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.005350+0000","last_change":"2023-10-09T11:46:53.005350+0000","last_active":"2023-10-09T11:46:53.005350+0000","last_peered":"2023-10-09T11:46:53.005350+0000","last_clean":"2023-10-09T11:46:53.005350+0000","last_became_active":"2023-10-09T11:46:53.001704+0000","last_became_peered":"2023-10-09T11:46:53.001704+0000","last_unstale":"2023-10-09T11:46:53.005350+0000","last_undegraded":"2023-10-09T11:46:53.005350+0000","last_fullsized":"2023-10-09T11:46:53.005350+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:23.663505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999309+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:03.975466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004666+0000","last_change":"2023-10-09T11:46:53.004666+0000","last_active":"2023-10-09T11:46:53.004666+0000","last_peered":"2023-10-09T11:46:53.004666+0000","last_clean":"2023-10-09T11:46:53.004666+0000","last_became_active":"2023-10-09T11:46:53.004438+0000","last_became_peered":"2023-10-09T11:46:53.004438+0000","last_unstale":"2023-10-09T11:46:53.004666+0000","last_undegraded":"2023-10-09T11:46:53.004666+0000","last_fullsized":"2023-10-09T11:46:53.004666+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:45.751052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999008+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:39.517456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.001043+0000","last_change":"2023-10-09T11:46:53.001043+0000","last_active":"2023-10-09T11:46:53.001043+0000","last_peered":"2023-10-09T11:46:53.001043+0000","last_clean":"2023-10-09T11:46:53.001043+0000","last_became_active":"2023-10-09T11:46:53.000788+0000","last_became_peered":"2023-10-09T11:46:53.000788+0000","last_unstale":"2023-10-09T11:46:53.001043+0000","last_undegraded":"2023-10-09T11:46:53.001043+0000","last_fullsized":"2023-10-09T11:46:53.001043+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:28.305605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.002284+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:06:58.938804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004683+0000","last_change":"2023-10-09T11:46:53.004683+0000","last_active":"2023-10-09T11:46:53.004683+0000","last_peered":"2023-10-09T11:46:53.004683+0000","last_clean":"2023-10-09T11:46:53.004683+0000","last_became_active":"2023-10-09T11:46:53.003788+0000","last_became_peered":"2023-10-09T11:46:53.003788+0000","last_unstale":"2023-10-09T11:46:53.004683+0000","last_undegraded":"2023-10-09T11:46:53.004683+0000","last_fullsized":"2023-10-09T11:46:53.004683+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:31.468385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.999760+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:45.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:52.998373+0000","last_change":"2023-10-09T11:46:52.998373+0000","last_active":"2023-10-09T11:46:52.998373+0000","last_peered":"2023-10-09T11:46:52.998373+0000","last_clean":"2023-10-09T11:46:52.998373+0000","last_became_active":"2023-10-09T11:46:52.998126+0000","last_became_peered":"2023-10-09T11:46:52.998126+0000","last_unstale":"2023-10-09T11:46:52.998373+0000","last_undegraded":"2023-10-09T11:46:52.998373+0000","last_fullsized":"2023-10-09T11:46:52.998373+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:29.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.998631+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:57:23.893370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.005651+0000","last_change":"2023-10-09T11:46:53.005651+0000","last_active":"2023-10-09T11:46:53.005651+0000","last_peered":"2023-10-09T11:46:53.005651+0000","last_clean":"2023-10-09T11:46:53.005651+0000","last_became_active":"2023-10-09T11:46:53.005418+0000","last_became_peered":"2023-10-09T11:46:53.005418+0000","last_unstale":"2023-10-09T11:46:53.005651+0000","last_undegraded":"2023-10-09T11:46:53.005651+0000","last_fullsized":"2023-10-09T11:46:53.005651+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:41.664743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.997253+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.709390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.001263+0000","last_change":"2023-10-09T11:46:53.001263+0000","last_active":"2023-10-09T11:46:53.001263+0000","last_peered":"2023-10-09T11:46:53.001263+0000","last_clean":"2023-10-09T11:46:53.001263+0000","last_became_active":"2023-10-09T11:46:53.001104+0000","last_became_peered":"2023-10-09T11:46:53.001104+0000","last_unstale":"2023-10-09T11:46:53.001263+0000","last_undegraded":"2023-10-09T11:46:53.001263+0000","last_fullsized":"2023-10-09T11:46:53.001263+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:19.649034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.998269+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:25.951146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.003669+0000","last_change":"2023-10-09T11:46:53.003669+0000","last_active":"2023-10-09T11:46:53.003669+0000","last_peered":"2023-10-09T11:46:53.003669+0000","last_clean":"2023-10-09T11:46:53.003669+0000","last_became_active":"2023-10-09T11:46:53.003385+0000","last_became_peered":"2023-10-09T11:46:53.003385+0000","last_unstale":"2023-10-09T11:46:53.003669+0000","last_undegraded":"2023-10-09T11:46:53.003669+0000","last_fullsized":"2023-10-09T11:46:53.003669+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:45.718711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:52.993645+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:32.470443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.004195+0000","last_change":"2023-10-09T11:46:53.004195+0000","last_active":"2023-10-09T11:46:53.004195+0000","last_peered":"2023-10-09T11:46:53.004195+0000","last_clean":"2023-10-09T11:46:53.004195+0000","last_became_active":"2023-10-09T11:46:53.003684+0000","last_became_peered":"2023-10-09T11:46:53.003684+0000","last_unstale":"2023-10-09T11:46:53.004195+0000","last_undegraded":"2023-10-09T11:46:53.004195+0000","last_fullsized":"2023-10-09T11:46:53.004195+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:35.181752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T11:46:52.986053+0000","last_change":"2023-10-09T11:46:53.001766+0000","last_active":"2023-10-09T11:46:52.986053+0000","last_peered":"2023-10-09T11:46:52.986053+0000","last_clean":"2023-10-09T11:46:52.986053+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T11:46:52.986053+0000","last_undegraded":"2023-10-09T11:46:52.986053+0000","last_fullsized":"2023-10-09T11:46:52.986053+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:24.665564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.002512+0000","last_change":"2023-10-09T11:46:53.002512+0000","last_active":"2023-10-09T11:46:53.002512+0000","last_peered":"2023-10-09T11:46:53.002512+0000","last_clean":"2023-10-09T11:46:53.002512+0000","last_became_active":"2023-10-09T11:46:53.002175+0000","last_became_peered":"2023-10-09T11:46:53.002175+0000","last_unstale":"2023-10-09T11:46:53.002512+0000","last_undegraded":"2023-10-09T11:46:53.002512+0000","last_fullsized":"2023-10-09T11:46:53.002512+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:14.080583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":295,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-09T11:46:51.989626+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:46:51.989626+0000","last_peered":"2023-10-09T11:46:51.989626+0000","last_clean":"2023-10-09T11:46:51.989626+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:46:51.989626+0000","last_undegraded":"2023-10-09T11:46:51.989626+0000","last_fullsized":"2023-10-09T11:46:51.989626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1528,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193783,"statfs":{"total":200000000,"available":198434563,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.878},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.048},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.34300000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":1.079},"last":0.58499999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.442,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.59399999999999997,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.26400000000000001},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.66500000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.623}]},{"osd":6,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69899999999999995,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":3.7589999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57499999999999996,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":5.3540000000000001},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.6060000000000001},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.76100000000000001,"15min":1.617},"last":0.48999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":0.84499999999999997,"15min":5.46},"last":0.442},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":5.3949999999999996},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.65700000000000003,"5min":1.617,"15min":1.617},"last":0.311},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.36299999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.379}]},{"osd":7,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53900000000000003,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.64200000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.42299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35899999999999999,"15min":0.379},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.624,"15min":1.9370000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.41199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":2.004},"last":0.434}]},{"osd":2,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36499999999999999,"15min":0.39100000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53200000000000003,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60699999999999998,"5min":0.627,"15min":1.909},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.434,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":2.0369999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83099999999999996,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.869},"last":0.749}]},{"osd":5,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":2.1960000000000002},"last":0.625}]},{"osd":6,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.628,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.952},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.782},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":0.93700000000000006,"15min":1.819},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193784,"statfs":{"total":200000000,"available":198435574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.371,"15min":0.40799999999999997},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.32500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55800000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.27500000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.46400000000000002},"min":{"1min":0.28399999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":2.194},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86799999999999999,"15min":1.508},"last":0.437},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.78600000000000003,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.502}]},{"osd":5,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.67300000000000004},"min":{"1min":0.47699999999999998,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":3.976},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.03,"15min":2.1549999999999998},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.65200000000000002},"min":{"1min":0.51500000000000001,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.96699999999999997,"15min":1.5429999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.66400000000000003},"min":{"1min":0.54500000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":1.593},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.53300000000000003,"5min":0.44,"15min":0.432},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.34399999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":0.56899999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.36799999999999999},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.379,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.42499999999999999,"15min":0.64200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.54100000000000004,"5min":0.68000000000000005,"15min":11.055},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45100000000000001,"15min":0.40699999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":0.623,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.374}]},{"osd":4,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.49099999999999999,"5min":0.378,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.68000000000000005,"5min":0.85199999999999998,"15min":0.999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.80000000000000004,"5min":0.95299999999999996,"15min":1.097},"last":0.621}]},{"osd":6,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.69299999999999995,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.03,"15min":1.03},"last":0.65100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":2.2789999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.39600000000000002},"max":{"1min":0.751,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":958,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199018668,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.222,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.214},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.34999999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.374,"15min":0.374},"min":{"1min":0.26900000000000002,"5min":0.21299999999999999,"15min":0.20399999999999999},"max":{"1min":0.498,"5min":0.621,"15min":1.034},"last":0.314},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.435,"15min":0.432},"min":{"1min":0.34599999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52400000000000002,"5min":0.65400000000000003,"15min":1.335},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29299999999999998,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.64400000000000002,"15min":1.1200000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64500000000000002,"5min":0.82799999999999996,"15min":1.405},"last":0.375}]},{"osd":4,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.35699999999999998},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.876,"15min":0.98399999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88100000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.95799999999999996,"15min":1.387},"last":0.42899999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.93100000000000005,"5min":1.054,"15min":1.3819999999999999},"last":0.44}]},{"osd":7,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.96199999999999997,"5min":0.995,"15min":1.4570000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":958,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199018668,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.27300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58899999999999997,"15min":0.70799999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.90000000000000002,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.51100000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.46999999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.58199999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.626},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":5.274},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.69999999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.59599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46200000000000002,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.5,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82899999999999996},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.246},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.5,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.86099999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.624}]}]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024931,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":1.2729999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.70199999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.27100000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.85199999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"last":0.71999999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.41599999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.96399999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.48699999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":0.78700000000000003,"5min":0.81299999999999994,"15min":0.98899999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.442,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56299999999999994,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.66300000000000003,"5min":0.74099999999999999,"15min":0.88500000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.622,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.505,"15min":0.5},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67800000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.94799999999999995}]},{"osd":7,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":0.82999999999999996},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":1.004}]}]}],"pool_statfs":[]}} 2023-10-09T11:46:58.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:46:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.272+0000 7f58832ed700 1 Processor -- start 2023-10-09T11:46:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.273+0000 7f58832ed700 1 -- start start 2023-10-09T11:46:58.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.273+0000 7f58832ed700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f58832ed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0d07c0 con 0x7f587c06d120 2023-10-09T11:46:58.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f58832ed700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0cfbb0 con 0x7f587c157ca0 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f58832ed700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cfe90 con 0x7f587c1578d0 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f588188a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f587c06d120 0x7f587c15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55828/0 (socket says 172.21.15.6:55828) 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f588188a700 1 -- 172.21.15.6:0/2134146940 learned_addr learned my addr 172.21.15.6:0/2134146940 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f5881089700 1 --2- 172.21.15.6:0/2134146940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426100153 0 0) 0x7f587c0d07c0 con 0x7f587c06d120 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5864003570 con 0x7f587c06d120 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787310955 0 0) 0x7f587c0cfbb0 con 0x7f587c157ca0 2023-10-09T11:46:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c0d07c0 con 0x7f587c157ca0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f5881089700 1 -- 172.21.15.6:0/2134146940 >> v1:172.21.15.118:6789/0 conn(0x7f587c157ca0 legacy=0x7f587c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f5881089700 1 -- 172.21.15.6:0/2134146940 >> v1:172.21.15.6:6789/0 conn(0x7f587c06d120 legacy=0x7f587c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f5881089700 1 -- 172.21.15.6:0/2134146940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0d0170 con 0x7f587c1578d0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.274+0000 7f5881089700 1 --2- 172.21.15.6:0/2134146940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0cf4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5874009910 tx=0x7f58740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a54ed58523d645 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874011630 con 0x7f587c1578d0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874011790 con 0x7f587c1578d0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f587bfff700 1 -- 172.21.15.6:0/2134146940 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874011b30 con 0x7f587c1578d0 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 -- 172.21.15.6:0/2134146940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 msgr2=0x7f587c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 --2- 172.21.15.6:0/2134146940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0cf4f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5874009910 tx=0x7f58740091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 -- 172.21.15.6:0/2134146940 shutdown_connections 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 --2- 172.21.15.6:0/2134146940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0cf4f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 -- 172.21.15.6:0/2134146940 >> 172.21.15.6:0/2134146940 conn(0x7f587c06bb90 msgr2=0x7f587c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 -- 172.21.15.6:0/2134146940 shutdown_connections 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.275+0000 7f58832ed700 1 -- 172.21.15.6:0/2134146940 wait complete. 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.276+0000 7f58832ed700 1 Processor -- start 2023-10-09T11:46:58.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.276+0000 7f58832ed700 1 -- start start 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f587c157ca0 0x7f587c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c16b420 con 0x7f587c06d120 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b50d0 con 0x7f587c157ca0 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f58832ed700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c16a810 con 0x7f587c1578d0 2023-10-09T11:46:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f5881089700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f5881089700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47510/0 (socket says 172.21.15.6:47510) 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f5881089700 1 -- 172.21.15.6:0/3428427798 learned_addr learned my addr 172.21.15.6:0/3428427798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f588188a700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f587c157ca0 0x7f587c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.277+0000 7f5880888700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 -- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 msgr2=0x7f587c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 -- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f587c157ca0 msgr2=0x7f587c0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f587c157ca0 0x7f587c0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 -- 172.21.15.6:0/3428427798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009420 con 0x7f587c06d120 2023-10-09T11:46:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f5881089700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f5874009f00 tx=0x7f5874017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587401f070 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874002f70 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c16aaf0 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874011900 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.278+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c16b0b0 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.279+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c067ac0 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.279+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5874023070 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.280+0000 7f58797fa700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 0x7f58680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.280+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58740857f0 con 0x7f587c06d120 2023-10-09T11:46:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.280+0000 7f5880888700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 0x7f58680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.280+0000 7f5880888700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 0x7f58680693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f587c068d40 tx=0x7f5870007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.284+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5874052aa0 con 0x7f587c06d120 2023-10-09T11:46:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.472+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f587c16b560 con 0x7f5868066f30 2023-10-09T11:46:58.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.480+0000 7f58797fa700 1 -- 172.21.15.6:0/3428427798 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285597 (secure 0 0 0) 0x7f587000f620 con 0x7f5868066f30 2023-10-09T11:46:58.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 msgr2=0x7f58680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 0x7f58680693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f587c068d40 tx=0x7f5870007d50 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 msgr2=0x7f587c153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f5874009f00 tx=0x7f5874017000 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 shutdown_connections 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5868066f30 0x7f58680693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f587c157ca0 0x7f587c0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f587c06d120 0x7f587c153240 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 --2- 172.21.15.6:0/3428427798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f587c1578d0 0x7f587c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 >> 172.21.15.6:0/3428427798 conn(0x7f587c06bb90 msgr2=0x7f587c155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 shutdown_connections 2023-10-09T11:46:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.483+0000 7f58832ed700 1 -- 172.21.15.6:0/3428427798 wait complete. 2023-10-09T11:46:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:46:58.495 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":501,"stamp":"2023-10-09T11:46:58.293820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553574,"statfs":{"total":1600000000,"available":1590860599,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000873"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008002+0000","last_change":"2023-10-09T11:46:54.007651+0000","last_active":"2023-10-09T11:46:54.008002+0000","last_peered":"2023-10-09T11:46:54.008002+0000","last_clean":"2023-10-09T11:46:54.008002+0000","last_became_active":"2023-10-09T11:46:54.006969+0000","last_became_peered":"2023-10-09T11:46:54.006969+0000","last_unstale":"2023-10-09T11:46:54.008002+0000","last_undegraded":"2023-10-09T11:46:54.008002+0000","last_fullsized":"2023-10-09T11:46:54.008002+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:59.286951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.001612+0000","last_change":"2023-10-09T11:46:54.001439+0000","last_active":"2023-10-09T11:46:54.001612+0000","last_peered":"2023-10-09T11:46:54.001612+0000","last_clean":"2023-10-09T11:46:54.001612+0000","last_became_active":"2023-10-09T11:46:54.000884+0000","last_became_peered":"2023-10-09T11:46:54.000884+0000","last_unstale":"2023-10-09T11:46:54.001612+0000","last_undegraded":"2023-10-09T11:46:54.001612+0000","last_fullsized":"2023-10-09T11:46:54.001612+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:46.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.003877+0000","last_change":"2023-10-09T11:46:54.003806+0000","last_active":"2023-10-09T11:46:54.003877+0000","last_peered":"2023-10-09T11:46:54.003877+0000","last_clean":"2023-10-09T11:46:54.003877+0000","last_became_active":"2023-10-09T11:46:54.003180+0000","last_became_peered":"2023-10-09T11:46:54.003180+0000","last_unstale":"2023-10-09T11:46:54.003877+0000","last_undegraded":"2023-10-09T11:46:54.003877+0000","last_fullsized":"2023-10-09T11:46:54.003877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:34.692515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007917+0000","last_change":"2023-10-09T11:46:54.005366+0000","last_active":"2023-10-09T11:46:54.007917+0000","last_peered":"2023-10-09T11:46:54.007917+0000","last_clean":"2023-10-09T11:46:54.007917+0000","last_became_active":"2023-10-09T11:46:54.004836+0000","last_became_peered":"2023-10-09T11:46:54.004836+0000","last_unstale":"2023-10-09T11:46:54.007917+0000","last_undegraded":"2023-10-09T11:46:54.007917+0000","last_fullsized":"2023-10-09T11:46:54.007917+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:07.071787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002290+0000","last_change":"2023-10-09T11:46:54.002071+0000","last_active":"2023-10-09T11:46:54.002290+0000","last_peered":"2023-10-09T11:46:54.002290+0000","last_clean":"2023-10-09T11:46:54.002290+0000","last_became_active":"2023-10-09T11:46:54.001829+0000","last_became_peered":"2023-10-09T11:46:54.001829+0000","last_unstale":"2023-10-09T11:46:54.002290+0000","last_undegraded":"2023-10-09T11:46:54.002290+0000","last_fullsized":"2023-10-09T11:46:54.002290+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:34.692515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008755+0000","last_change":"2023-10-09T11:46:54.003033+0000","last_active":"2023-10-09T11:46:54.008755+0000","last_peered":"2023-10-09T11:46:54.008755+0000","last_clean":"2023-10-09T11:46:54.008755+0000","last_became_active":"2023-10-09T11:46:54.002790+0000","last_became_peered":"2023-10-09T11:46:54.002790+0000","last_unstale":"2023-10-09T11:46:54.008755+0000","last_undegraded":"2023-10-09T11:46:54.008755+0000","last_fullsized":"2023-10-09T11:46:54.008755+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:56.699420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.014454+0000","last_change":"2023-10-09T11:46:54.013642+0000","last_active":"2023-10-09T11:46:54.014454+0000","last_peered":"2023-10-09T11:46:54.014454+0000","last_clean":"2023-10-09T11:46:54.014454+0000","last_became_active":"2023-10-09T11:46:54.010369+0000","last_became_peered":"2023-10-09T11:46:54.010369+0000","last_unstale":"2023-10-09T11:46:54.014454+0000","last_undegraded":"2023-10-09T11:46:54.014454+0000","last_fullsized":"2023-10-09T11:46:54.014454+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:41:03.975466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002274+0000","last_change":"2023-10-09T11:46:54.001698+0000","last_active":"2023-10-09T11:46:54.002274+0000","last_peered":"2023-10-09T11:46:54.002274+0000","last_clean":"2023-10-09T11:46:54.002274+0000","last_became_active":"2023-10-09T11:46:54.001453+0000","last_became_peered":"2023-10-09T11:46:54.001453+0000","last_unstale":"2023-10-09T11:46:54.002274+0000","last_undegraded":"2023-10-09T11:46:54.002274+0000","last_fullsized":"2023-10-09T11:46:54.002274+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:07.071787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002965+0000","last_change":"2023-10-09T11:46:54.002744+0000","last_active":"2023-10-09T11:46:54.002965+0000","last_peered":"2023-10-09T11:46:54.002965+0000","last_clean":"2023-10-09T11:46:54.002965+0000","last_became_active":"2023-10-09T11:46:54.002243+0000","last_became_peered":"2023-10-09T11:46:54.002243+0000","last_unstale":"2023-10-09T11:46:54.002965+0000","last_undegraded":"2023-10-09T11:46:54.002965+0000","last_fullsized":"2023-10-09T11:46:54.002965+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:50.141459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010462+0000","last_change":"2023-10-09T11:46:54.010411+0000","last_active":"2023-10-09T11:46:54.010462+0000","last_peered":"2023-10-09T11:46:54.010462+0000","last_clean":"2023-10-09T11:46:54.010462+0000","last_became_active":"2023-10-09T11:46:54.010206+0000","last_became_peered":"2023-10-09T11:46:54.010206+0000","last_unstale":"2023-10-09T11:46:54.010462+0000","last_undegraded":"2023-10-09T11:46:54.010462+0000","last_fullsized":"2023-10-09T11:46:54.010462+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:24.531650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002305+0000","last_change":"2023-10-09T11:46:54.002193+0000","last_active":"2023-10-09T11:46:54.002305+0000","last_peered":"2023-10-09T11:46:54.002305+0000","last_clean":"2023-10-09T11:46:54.002305+0000","last_became_active":"2023-10-09T11:46:54.001938+0000","last_became_peered":"2023-10-09T11:46:54.001938+0000","last_unstale":"2023-10-09T11:46:54.002305+0000","last_undegraded":"2023-10-09T11:46:54.002305+0000","last_fullsized":"2023-10-09T11:46:54.002305+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:20.527679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002256+0000","last_change":"2023-10-09T11:46:54.001584+0000","last_active":"2023-10-09T11:46:54.002256+0000","last_peered":"2023-10-09T11:46:54.002256+0000","last_clean":"2023-10-09T11:46:54.002256+0000","last_became_active":"2023-10-09T11:46:54.001199+0000","last_became_peered":"2023-10-09T11:46:54.001199+0000","last_unstale":"2023-10-09T11:46:54.002256+0000","last_undegraded":"2023-10-09T11:46:54.002256+0000","last_fullsized":"2023-10-09T11:46:54.002256+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:25.159360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007750+0000","last_change":"2023-10-09T11:46:54.007007+0000","last_active":"2023-10-09T11:46:54.007750+0000","last_peered":"2023-10-09T11:46:54.007750+0000","last_clean":"2023-10-09T11:46:54.007750+0000","last_became_active":"2023-10-09T11:46:54.006641+0000","last_became_peered":"2023-10-09T11:46:54.006641+0000","last_unstale":"2023-10-09T11:46:54.007750+0000","last_undegraded":"2023-10-09T11:46:54.007750+0000","last_fullsized":"2023-10-09T11:46:54.007750+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:06.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000215+0000","last_change":"2023-10-09T11:46:54.000138+0000","last_active":"2023-10-09T11:46:54.000215+0000","last_peered":"2023-10-09T11:46:54.000215+0000","last_clean":"2023-10-09T11:46:54.000215+0000","last_became_active":"2023-10-09T11:46:53.999861+0000","last_became_peered":"2023-10-09T11:46:53.999861+0000","last_unstale":"2023-10-09T11:46:54.000215+0000","last_undegraded":"2023-10-09T11:46:54.000215+0000","last_fullsized":"2023-10-09T11:46:54.000215+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:15.082641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.011010+0000","last_change":"2023-10-09T11:46:54.010949+0000","last_active":"2023-10-09T11:46:54.011010+0000","last_peered":"2023-10-09T11:46:54.011010+0000","last_clean":"2023-10-09T11:46:54.011010+0000","last_became_active":"2023-10-09T11:46:54.010709+0000","last_became_peered":"2023-10-09T11:46:54.010709+0000","last_unstale":"2023-10-09T11:46:54.011010+0000","last_undegraded":"2023-10-09T11:46:54.011010+0000","last_fullsized":"2023-10-09T11:46:54.011010+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:53.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008206+0000","last_change":"2023-10-09T11:46:54.008113+0000","last_active":"2023-10-09T11:46:54.008206+0000","last_peered":"2023-10-09T11:46:54.008206+0000","last_clean":"2023-10-09T11:46:54.008206+0000","last_became_active":"2023-10-09T11:46:54.007838+0000","last_became_peered":"2023-10-09T11:46:54.007838+0000","last_unstale":"2023-10-09T11:46:54.008206+0000","last_undegraded":"2023-10-09T11:46:54.008206+0000","last_fullsized":"2023-10-09T11:46:54.008206+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:36.433860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000107+0000","last_change":"2023-10-09T11:46:53.999891+0000","last_active":"2023-10-09T11:46:54.000107+0000","last_peered":"2023-10-09T11:46:54.000107+0000","last_clean":"2023-10-09T11:46:54.000107+0000","last_became_active":"2023-10-09T11:46:53.999634+0000","last_became_peered":"2023-10-09T11:46:53.999634+0000","last_unstale":"2023-10-09T11:46:54.000107+0000","last_undegraded":"2023-10-09T11:46:54.000107+0000","last_fullsized":"2023-10-09T11:46:54.000107+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:15:13.479566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012815+0000","last_change":"2023-10-09T11:46:54.012748+0000","last_active":"2023-10-09T11:46:54.012815+0000","last_peered":"2023-10-09T11:46:54.012815+0000","last_clean":"2023-10-09T11:46:54.012815+0000","last_became_active":"2023-10-09T11:46:54.012580+0000","last_became_peered":"2023-10-09T11:46:54.012580+0000","last_unstale":"2023-10-09T11:46:54.012815+0000","last_undegraded":"2023-10-09T11:46:54.012815+0000","last_fullsized":"2023-10-09T11:46:54.012815+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:23:32.849547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000732+0000","last_change":"2023-10-09T11:46:54.000589+0000","last_active":"2023-10-09T11:46:54.000732+0000","last_peered":"2023-10-09T11:46:54.000732+0000","last_clean":"2023-10-09T11:46:54.000732+0000","last_became_active":"2023-10-09T11:46:54.000330+0000","last_became_peered":"2023-10-09T11:46:54.000330+0000","last_unstale":"2023-10-09T11:46:54.000732+0000","last_undegraded":"2023-10-09T11:46:54.000732+0000","last_fullsized":"2023-10-09T11:46:54.000732+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:07.261218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002669+0000","last_change":"2023-10-09T11:46:54.002149+0000","last_active":"2023-10-09T11:46:54.002669+0000","last_peered":"2023-10-09T11:46:54.002669+0000","last_clean":"2023-10-09T11:46:54.002669+0000","last_became_active":"2023-10-09T11:46:54.001608+0000","last_became_peered":"2023-10-09T11:46:54.001608+0000","last_unstale":"2023-10-09T11:46:54.002669+0000","last_undegraded":"2023-10-09T11:46:54.002669+0000","last_fullsized":"2023-10-09T11:46:54.002669+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:55.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.001744+0000","last_change":"2023-10-09T11:46:54.001587+0000","last_active":"2023-10-09T11:46:54.001744+0000","last_peered":"2023-10-09T11:46:54.001744+0000","last_clean":"2023-10-09T11:46:54.001744+0000","last_became_active":"2023-10-09T11:46:54.001307+0000","last_became_peered":"2023-10-09T11:46:54.001307+0000","last_unstale":"2023-10-09T11:46:54.001744+0000","last_undegraded":"2023-10-09T11:46:54.001744+0000","last_fullsized":"2023-10-09T11:46:54.001744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:08:58.646736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.005726+0000","last_change":"2023-10-09T11:46:54.005656+0000","last_active":"2023-10-09T11:46:54.005726+0000","last_peered":"2023-10-09T11:46:54.005726+0000","last_clean":"2023-10-09T11:46:54.005726+0000","last_became_active":"2023-10-09T11:46:54.005434+0000","last_became_peered":"2023-10-09T11:46:54.005434+0000","last_unstale":"2023-10-09T11:46:54.005726+0000","last_undegraded":"2023-10-09T11:46:54.005726+0000","last_fullsized":"2023-10-09T11:46:54.005726+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:11:06.621572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.996964+0000","last_change":"2023-10-09T11:46:53.996688+0000","last_active":"2023-10-09T11:46:53.996964+0000","last_peered":"2023-10-09T11:46:53.996964+0000","last_clean":"2023-10-09T11:46:53.996964+0000","last_became_active":"2023-10-09T11:46:53.996441+0000","last_became_peered":"2023-10-09T11:46:53.996441+0000","last_unstale":"2023-10-09T11:46:53.996964+0000","last_undegraded":"2023-10-09T11:46:53.996964+0000","last_fullsized":"2023-10-09T11:46:53.996964+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:01:38.547264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002984+0000","last_change":"2023-10-09T11:46:54.002888+0000","last_active":"2023-10-09T11:46:54.002984+0000","last_peered":"2023-10-09T11:46:54.002984+0000","last_clean":"2023-10-09T11:46:54.002984+0000","last_became_active":"2023-10-09T11:46:54.002530+0000","last_became_peered":"2023-10-09T11:46:54.002530+0000","last_unstale":"2023-10-09T11:46:54.002984+0000","last_undegraded":"2023-10-09T11:46:54.002984+0000","last_fullsized":"2023-10-09T11:46:54.002984+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:27.893313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002835+0000","last_change":"2023-10-09T11:46:54.002708+0000","last_active":"2023-10-09T11:46:54.002835+0000","last_peered":"2023-10-09T11:46:54.002835+0000","last_clean":"2023-10-09T11:46:54.002835+0000","last_became_active":"2023-10-09T11:46:54.001924+0000","last_became_peered":"2023-10-09T11:46:54.001924+0000","last_unstale":"2023-10-09T11:46:54.002835+0000","last_undegraded":"2023-10-09T11:46:54.002835+0000","last_fullsized":"2023-10-09T11:46:54.002835+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:25.159360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008189+0000","last_change":"2023-10-09T11:46:54.007610+0000","last_active":"2023-10-09T11:46:54.008189+0000","last_peered":"2023-10-09T11:46:54.008189+0000","last_clean":"2023-10-09T11:46:54.008189+0000","last_became_active":"2023-10-09T11:46:54.007256+0000","last_became_peered":"2023-10-09T11:46:54.007256+0000","last_unstale":"2023-10-09T11:46:54.008189+0000","last_undegraded":"2023-10-09T11:46:54.008189+0000","last_fullsized":"2023-10-09T11:46:54.008189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:02:13.842500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.009189+0000","last_change":"2023-10-09T11:46:54.009131+0000","last_active":"2023-10-09T11:46:54.009189+0000","last_peered":"2023-10-09T11:46:54.009189+0000","last_clean":"2023-10-09T11:46:54.009189+0000","last_became_active":"2023-10-09T11:46:54.008913+0000","last_became_peered":"2023-10-09T11:46:54.008913+0000","last_unstale":"2023-10-09T11:46:54.009189+0000","last_undegraded":"2023-10-09T11:46:54.009189+0000","last_fullsized":"2023-10-09T11:46:54.009189+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:46.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007956+0000","last_change":"2023-10-09T11:46:54.007897+0000","last_active":"2023-10-09T11:46:54.007956+0000","last_peered":"2023-10-09T11:46:54.007956+0000","last_clean":"2023-10-09T11:46:54.007956+0000","last_became_active":"2023-10-09T11:46:54.007634+0000","last_became_peered":"2023-10-09T11:46:54.007634+0000","last_unstale":"2023-10-09T11:46:54.007956+0000","last_undegraded":"2023-10-09T11:46:54.007956+0000","last_fullsized":"2023-10-09T11:46:54.007956+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:55.434133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.009936+0000","last_change":"2023-10-09T11:46:54.009878+0000","last_active":"2023-10-09T11:46:54.009936+0000","last_peered":"2023-10-09T11:46:54.009936+0000","last_clean":"2023-10-09T11:46:54.009936+0000","last_became_active":"2023-10-09T11:46:54.009651+0000","last_became_peered":"2023-10-09T11:46:54.009651+0000","last_unstale":"2023-10-09T11:46:54.009936+0000","last_undegraded":"2023-10-09T11:46:54.009936+0000","last_fullsized":"2023-10-09T11:46:54.009936+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.709390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.005954+0000","last_change":"2023-10-09T11:46:54.003734+0000","last_active":"2023-10-09T11:46:54.005954+0000","last_peered":"2023-10-09T11:46:54.005954+0000","last_clean":"2023-10-09T11:46:54.005954+0000","last_became_active":"2023-10-09T11:46:54.003321+0000","last_became_peered":"2023-10-09T11:46:54.003321+0000","last_unstale":"2023-10-09T11:46:54.005954+0000","last_undegraded":"2023-10-09T11:46:54.005954+0000","last_fullsized":"2023-10-09T11:46:54.005954+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:34.692515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010996+0000","last_change":"2023-10-09T11:46:54.010903+0000","last_active":"2023-10-09T11:46:54.010996+0000","last_peered":"2023-10-09T11:46:54.010996+0000","last_clean":"2023-10-09T11:46:54.010996+0000","last_became_active":"2023-10-09T11:46:54.008883+0000","last_became_peered":"2023-10-09T11:46:54.008883+0000","last_unstale":"2023-10-09T11:46:54.010996+0000","last_undegraded":"2023-10-09T11:46:54.010996+0000","last_fullsized":"2023-10-09T11:46:54.010996+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:50.141459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.003325+0000","last_change":"2023-10-09T11:46:54.002844+0000","last_active":"2023-10-09T11:46:54.003325+0000","last_peered":"2023-10-09T11:46:54.003325+0000","last_clean":"2023-10-09T11:46:54.003325+0000","last_became_active":"2023-10-09T11:46:54.002595+0000","last_became_peered":"2023-10-09T11:46:54.002595+0000","last_unstale":"2023-10-09T11:46:54.003325+0000","last_undegraded":"2023-10-09T11:46:54.003325+0000","last_fullsized":"2023-10-09T11:46:54.003325+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:22:42.125932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010021+0000","last_change":"2023-10-09T11:46:54.009899+0000","last_active":"2023-10-09T11:46:54.010021+0000","last_peered":"2023-10-09T11:46:54.010021+0000","last_clean":"2023-10-09T11:46:54.010021+0000","last_became_active":"2023-10-09T11:46:54.009342+0000","last_became_peered":"2023-10-09T11:46:54.009342+0000","last_unstale":"2023-10-09T11:46:54.010021+0000","last_undegraded":"2023-10-09T11:46:54.010021+0000","last_fullsized":"2023-10-09T11:46:54.010021+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:30.644761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.009456+0000","last_change":"2023-10-09T11:46:52.998628+0000","last_active":"2023-10-09T11:46:54.009456+0000","last_peered":"2023-10-09T11:46:54.009456+0000","last_clean":"2023-10-09T11:46:54.009456+0000","last_became_active":"2023-10-09T11:46:52.997999+0000","last_became_peered":"2023-10-09T11:46:52.997999+0000","last_unstale":"2023-10-09T11:46:54.009456+0000","last_undegraded":"2023-10-09T11:46:54.009456+0000","last_fullsized":"2023-10-09T11:46:54.009456+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:57.976522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008812+0000","last_change":"2023-10-09T11:46:54.007441+0000","last_active":"2023-10-09T11:46:54.008812+0000","last_peered":"2023-10-09T11:46:54.008812+0000","last_clean":"2023-10-09T11:46:54.008812+0000","last_became_active":"2023-10-09T11:46:54.007094+0000","last_became_peered":"2023-10-09T11:46:54.007094+0000","last_unstale":"2023-10-09T11:46:54.008812+0000","last_undegraded":"2023-10-09T11:46:54.008812+0000","last_fullsized":"2023-10-09T11:46:54.008812+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:24.531650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010190+0000","last_change":"2023-10-09T11:46:53.004913+0000","last_active":"2023-10-09T11:46:54.010190+0000","last_peered":"2023-10-09T11:46:54.010190+0000","last_clean":"2023-10-09T11:46:54.010190+0000","last_became_active":"2023-10-09T11:46:53.004683+0000","last_became_peered":"2023-10-09T11:46:53.004683+0000","last_unstale":"2023-10-09T11:46:54.010190+0000","last_undegraded":"2023-10-09T11:46:54.010190+0000","last_fullsized":"2023-10-09T11:46:54.010190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:19.525621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008859+0000","last_change":"2023-10-09T11:46:54.008491+0000","last_active":"2023-10-09T11:46:54.008859+0000","last_peered":"2023-10-09T11:46:54.008859+0000","last_clean":"2023-10-09T11:46:54.008859+0000","last_became_active":"2023-10-09T11:46:54.003799+0000","last_became_peered":"2023-10-09T11:46:54.003799+0000","last_unstale":"2023-10-09T11:46:54.008859+0000","last_undegraded":"2023-10-09T11:46:54.008859+0000","last_fullsized":"2023-10-09T11:46:54.008859+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:22:08.159924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.014841+0000","last_change":"2023-10-09T11:46:53.004450+0000","last_active":"2023-10-09T11:46:54.014841+0000","last_peered":"2023-10-09T11:46:54.014841+0000","last_clean":"2023-10-09T11:46:54.014841+0000","last_became_active":"2023-10-09T11:46:53.004189+0000","last_became_peered":"2023-10-09T11:46:53.004189+0000","last_unstale":"2023-10-09T11:46:54.014841+0000","last_undegraded":"2023-10-09T11:46:54.014841+0000","last_fullsized":"2023-10-09T11:46:54.014841+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:31.468385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.011585+0000","last_change":"2023-10-09T11:46:54.011524+0000","last_active":"2023-10-09T11:46:54.011585+0000","last_peered":"2023-10-09T11:46:54.011585+0000","last_clean":"2023-10-09T11:46:54.011585+0000","last_became_active":"2023-10-09T11:46:54.011322+0000","last_became_peered":"2023-10-09T11:46:54.011322+0000","last_unstale":"2023-10-09T11:46:54.011585+0000","last_undegraded":"2023-10-09T11:46:54.011585+0000","last_fullsized":"2023-10-09T11:46:54.011585+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:31.661678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.014482+0000","last_change":"2023-10-09T11:46:52.998884+0000","last_active":"2023-10-09T11:46:54.014482+0000","last_peered":"2023-10-09T11:46:54.014482+0000","last_clean":"2023-10-09T11:46:54.014482+0000","last_became_active":"2023-10-09T11:46:52.998280+0000","last_became_peered":"2023-10-09T11:46:52.998280+0000","last_unstale":"2023-10-09T11:46:54.014482+0000","last_undegraded":"2023-10-09T11:46:54.014482+0000","last_fullsized":"2023-10-09T11:46:54.014482+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:45.718711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.006405+0000","last_change":"2023-10-09T11:46:54.006197+0000","last_active":"2023-10-09T11:46:54.006405+0000","last_peered":"2023-10-09T11:46:54.006405+0000","last_clean":"2023-10-09T11:46:54.006405+0000","last_became_active":"2023-10-09T11:46:54.005902+0000","last_became_peered":"2023-10-09T11:46:54.005902+0000","last_unstale":"2023-10-09T11:46:54.006405+0000","last_undegraded":"2023-10-09T11:46:54.006405+0000","last_fullsized":"2023-10-09T11:46:54.006405+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:57.118813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010664+0000","last_change":"2023-10-09T11:46:53.002991+0000","last_active":"2023-10-09T11:46:54.010664+0000","last_peered":"2023-10-09T11:46:54.010664+0000","last_clean":"2023-10-09T11:46:54.010664+0000","last_became_active":"2023-10-09T11:46:53.002755+0000","last_became_peered":"2023-10-09T11:46:53.002755+0000","last_unstale":"2023-10-09T11:46:54.010664+0000","last_undegraded":"2023-10-09T11:46:54.010664+0000","last_fullsized":"2023-10-09T11:46:54.010664+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:19.649034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010927+0000","last_change":"2023-10-09T11:46:54.010542+0000","last_active":"2023-10-09T11:46:54.010927+0000","last_peered":"2023-10-09T11:46:54.010927+0000","last_clean":"2023-10-09T11:46:54.010927+0000","last_became_active":"2023-10-09T11:46:54.009155+0000","last_became_peered":"2023-10-09T11:46:54.009155+0000","last_unstale":"2023-10-09T11:46:54.010927+0000","last_undegraded":"2023-10-09T11:46:54.010927+0000","last_fullsized":"2023-10-09T11:46:54.010927+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:32:34.692515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.015137+0000","last_change":"2023-10-09T11:46:52.995684+0000","last_active":"2023-10-09T11:46:54.015137+0000","last_peered":"2023-10-09T11:46:54.015137+0000","last_clean":"2023-10-09T11:46:54.015137+0000","last_became_active":"2023-10-09T11:46:52.995421+0000","last_became_peered":"2023-10-09T11:46:52.995421+0000","last_unstale":"2023-10-09T11:46:54.015137+0000","last_undegraded":"2023-10-09T11:46:54.015137+0000","last_fullsized":"2023-10-09T11:46:54.015137+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:17:17.193219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007940+0000","last_change":"2023-10-09T11:46:54.007688+0000","last_active":"2023-10-09T11:46:54.007940+0000","last_peered":"2023-10-09T11:46:54.007940+0000","last_clean":"2023-10-09T11:46:54.007940+0000","last_became_active":"2023-10-09T11:46:54.007364+0000","last_became_peered":"2023-10-09T11:46:54.007364+0000","last_unstale":"2023-10-09T11:46:54.007940+0000","last_undegraded":"2023-10-09T11:46:54.007940+0000","last_fullsized":"2023-10-09T11:46:54.007940+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:59:58.709390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.997853+0000","last_change":"2023-10-09T11:46:53.004831+0000","last_active":"2023-10-09T11:46:53.997853+0000","last_peered":"2023-10-09T11:46:53.997853+0000","last_clean":"2023-10-09T11:46:53.997853+0000","last_became_active":"2023-10-09T11:46:53.004042+0000","last_became_peered":"2023-10-09T11:46:53.004042+0000","last_unstale":"2023-10-09T11:46:53.997853+0000","last_undegraded":"2023-10-09T11:46:53.997853+0000","last_fullsized":"2023-10-09T11:46:53.997853+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:48.090808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008772+0000","last_change":"2023-10-09T11:46:54.003449+0000","last_active":"2023-10-09T11:46:54.008772+0000","last_peered":"2023-10-09T11:46:54.008772+0000","last_clean":"2023-10-09T11:46:54.008772+0000","last_became_active":"2023-10-09T11:46:54.003241+0000","last_became_peered":"2023-10-09T11:46:54.003241+0000","last_unstale":"2023-10-09T11:46:54.008772+0000","last_undegraded":"2023-10-09T11:46:54.008772+0000","last_fullsized":"2023-10-09T11:46:54.008772+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:52.901533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000493+0000","last_change":"2023-10-09T11:46:53.000929+0000","last_active":"2023-10-09T11:46:54.000493+0000","last_peered":"2023-10-09T11:46:54.000493+0000","last_clean":"2023-10-09T11:46:54.000493+0000","last_became_active":"2023-10-09T11:46:53.000689+0000","last_became_peered":"2023-10-09T11:46:53.000689+0000","last_unstale":"2023-10-09T11:46:54.000493+0000","last_undegraded":"2023-10-09T11:46:54.000493+0000","last_fullsized":"2023-10-09T11:46:54.000493+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:34:23.529591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.006797+0000","last_change":"2023-10-09T11:46:54.006718+0000","last_active":"2023-10-09T11:46:54.006797+0000","last_peered":"2023-10-09T11:46:54.006797+0000","last_clean":"2023-10-09T11:46:54.006797+0000","last_became_active":"2023-10-09T11:46:54.006477+0000","last_became_peered":"2023-10-09T11:46:54.006477+0000","last_unstale":"2023-10-09T11:46:54.006797+0000","last_undegraded":"2023-10-09T11:46:54.006797+0000","last_fullsized":"2023-10-09T11:46:54.006797+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:42:53.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.994146+0000","last_change":"2023-10-09T11:46:52.996065+0000","last_active":"2023-10-09T11:46:53.994146+0000","last_peered":"2023-10-09T11:46:53.994146+0000","last_clean":"2023-10-09T11:46:53.994146+0000","last_became_active":"2023-10-09T11:46:52.995807+0000","last_became_peered":"2023-10-09T11:46:52.995807+0000","last_unstale":"2023-10-09T11:46:53.994146+0000","last_undegraded":"2023-10-09T11:46:53.994146+0000","last_fullsized":"2023-10-09T11:46:53.994146+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:48.424459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012230+0000","last_change":"2023-10-09T11:46:54.012155+0000","last_active":"2023-10-09T11:46:54.012230+0000","last_peered":"2023-10-09T11:46:54.012230+0000","last_clean":"2023-10-09T11:46:54.012230+0000","last_became_active":"2023-10-09T11:46:54.011718+0000","last_became_peered":"2023-10-09T11:46:54.011718+0000","last_unstale":"2023-10-09T11:46:54.012230+0000","last_undegraded":"2023-10-09T11:46:54.012230+0000","last_fullsized":"2023-10-09T11:46:54.012230+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:59.286951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012602+0000","last_change":"2023-10-09T11:46:52.996619+0000","last_active":"2023-10-09T11:46:54.012602+0000","last_peered":"2023-10-09T11:46:54.012602+0000","last_clean":"2023-10-09T11:46:54.012602+0000","last_became_active":"2023-10-09T11:46:52.996355+0000","last_became_peered":"2023-10-09T11:46:52.996355+0000","last_unstale":"2023-10-09T11:46:54.012602+0000","last_undegraded":"2023-10-09T11:46:54.012602+0000","last_fullsized":"2023-10-09T11:46:54.012602+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:59.177433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008794+0000","last_change":"2023-10-09T11:46:54.007318+0000","last_active":"2023-10-09T11:46:54.008794+0000","last_peered":"2023-10-09T11:46:54.008794+0000","last_clean":"2023-10-09T11:46:54.008794+0000","last_became_active":"2023-10-09T11:46:54.006115+0000","last_became_peered":"2023-10-09T11:46:54.006115+0000","last_unstale":"2023-10-09T11:46:54.008794+0000","last_undegraded":"2023-10-09T11:46:54.008794+0000","last_fullsized":"2023-10-09T11:46:54.008794+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:27.893313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"177'6","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.013746+0000","last_change":"2023-10-09T11:46:53.004428+0000","last_active":"2023-10-09T11:46:54.013746+0000","last_peered":"2023-10-09T11:46:54.013746+0000","last_clean":"2023-10-09T11:46:54.013746+0000","last_became_active":"2023-10-09T11:46:53.003958+0000","last_became_peered":"2023-10-09T11:46:53.003958+0000","last_unstale":"2023-10-09T11:46:54.013746+0000","last_undegraded":"2023-10-09T11:46:54.013746+0000","last_fullsized":"2023-10-09T11:46:54.013746+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:21:21.174594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002757+0000","last_change":"2023-10-09T11:46:54.002666+0000","last_active":"2023-10-09T11:46:54.002757+0000","last_peered":"2023-10-09T11:46:54.002757+0000","last_clean":"2023-10-09T11:46:54.002757+0000","last_became_active":"2023-10-09T11:46:54.002425+0000","last_became_peered":"2023-10-09T11:46:54.002425+0000","last_unstale":"2023-10-09T11:46:54.002757+0000","last_undegraded":"2023-10-09T11:46:54.002757+0000","last_fullsized":"2023-10-09T11:46:54.002757+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:17:56.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.015519+0000","last_change":"2023-10-09T11:46:52.997772+0000","last_active":"2023-10-09T11:46:54.015519+0000","last_peered":"2023-10-09T11:46:54.015519+0000","last_clean":"2023-10-09T11:46:54.015519+0000","last_became_active":"2023-10-09T11:46:52.997608+0000","last_became_peered":"2023-10-09T11:46:52.997608+0000","last_unstale":"2023-10-09T11:46:54.015519+0000","last_undegraded":"2023-10-09T11:46:54.015519+0000","last_fullsized":"2023-10-09T11:46:54.015519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:30:48.090808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.004323+0000","last_change":"2023-10-09T11:46:54.004220+0000","last_active":"2023-10-09T11:46:54.004323+0000","last_peered":"2023-10-09T11:46:54.004323+0000","last_clean":"2023-10-09T11:46:54.004323+0000","last_became_active":"2023-10-09T11:46:54.003961+0000","last_became_peered":"2023-10-09T11:46:54.003961+0000","last_unstale":"2023-10-09T11:46:54.004323+0000","last_undegraded":"2023-10-09T11:46:54.004323+0000","last_fullsized":"2023-10-09T11:46:54.004323+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:36:58.978581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.998145+0000","last_change":"2023-10-09T11:46:52.996820+0000","last_active":"2023-10-09T11:46:53.998145+0000","last_peered":"2023-10-09T11:46:53.998145+0000","last_clean":"2023-10-09T11:46:53.998145+0000","last_became_active":"2023-10-09T11:46:52.996562+0000","last_became_peered":"2023-10-09T11:46:52.996562+0000","last_unstale":"2023-10-09T11:46:53.998145+0000","last_undegraded":"2023-10-09T11:46:53.998145+0000","last_fullsized":"2023-10-09T11:46:53.998145+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:45.902896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008505+0000","last_change":"2023-10-09T11:46:54.008435+0000","last_active":"2023-10-09T11:46:54.008505+0000","last_peered":"2023-10-09T11:46:54.008505+0000","last_clean":"2023-10-09T11:46:54.008505+0000","last_became_active":"2023-10-09T11:46:54.008179+0000","last_became_peered":"2023-10-09T11:46:54.008179+0000","last_unstale":"2023-10-09T11:46:54.008505+0000","last_undegraded":"2023-10-09T11:46:54.008505+0000","last_fullsized":"2023-10-09T11:46:54.008505+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:38:31.661678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.999545+0000","last_change":"2023-10-09T11:46:53.004371+0000","last_active":"2023-10-09T11:46:53.999545+0000","last_peered":"2023-10-09T11:46:53.999545+0000","last_clean":"2023-10-09T11:46:53.999545+0000","last_became_active":"2023-10-09T11:46:53.004107+0000","last_became_peered":"2023-10-09T11:46:53.004107+0000","last_unstale":"2023-10-09T11:46:53.999545+0000","last_undegraded":"2023-10-09T11:46:53.999545+0000","last_fullsized":"2023-10-09T11:46:53.999545+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:29:13.866796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007697+0000","last_change":"2023-10-09T11:46:54.006350+0000","last_active":"2023-10-09T11:46:54.007697+0000","last_peered":"2023-10-09T11:46:54.007697+0000","last_clean":"2023-10-09T11:46:54.007697+0000","last_became_active":"2023-10-09T11:46:54.006100+0000","last_became_peered":"2023-10-09T11:46:54.006100+0000","last_unstale":"2023-10-09T11:46:54.007697+0000","last_undegraded":"2023-10-09T11:46:54.007697+0000","last_fullsized":"2023-10-09T11:46:54.007697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:47.989187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"177'8","reported_seq":18,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.011012+0000","last_change":"2023-10-09T11:46:53.001917+0000","last_active":"2023-10-09T11:46:54.011012+0000","last_peered":"2023-10-09T11:46:54.011012+0000","last_clean":"2023-10-09T11:46:54.011012+0000","last_became_active":"2023-10-09T11:46:53.001230+0000","last_became_peered":"2023-10-09T11:46:53.001230+0000","last_unstale":"2023-10-09T11:46:54.011012+0000","last_undegraded":"2023-10-09T11:46:54.011012+0000","last_fullsized":"2023-10-09T11:46:54.011012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:04:28.972409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012567+0000","last_change":"2023-10-09T11:46:54.012495+0000","last_active":"2023-10-09T11:46:54.012567+0000","last_peered":"2023-10-09T11:46:54.012567+0000","last_clean":"2023-10-09T11:46:54.012567+0000","last_became_active":"2023-10-09T11:46:54.011231+0000","last_became_peered":"2023-10-09T11:46:54.011231+0000","last_unstale":"2023-10-09T11:46:54.012567+0000","last_undegraded":"2023-10-09T11:46:54.012567+0000","last_fullsized":"2023-10-09T11:46:54.012567+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:47.989187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.009412+0000","last_change":"2023-10-09T11:46:53.004800+0000","last_active":"2023-10-09T11:46:54.009412+0000","last_peered":"2023-10-09T11:46:54.009412+0000","last_clean":"2023-10-09T11:46:54.009412+0000","last_became_active":"2023-10-09T11:46:53.004576+0000","last_became_peered":"2023-10-09T11:46:53.004576+0000","last_unstale":"2023-10-09T11:46:54.009412+0000","last_undegraded":"2023-10-09T11:46:54.009412+0000","last_fullsized":"2023-10-09T11:46:54.009412+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:21.327342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.003347+0000","last_change":"2023-10-09T11:46:54.003013+0000","last_active":"2023-10-09T11:46:54.003347+0000","last_peered":"2023-10-09T11:46:54.003347+0000","last_clean":"2023-10-09T11:46:54.003347+0000","last_became_active":"2023-10-09T11:46:54.002767+0000","last_became_peered":"2023-10-09T11:46:54.002767+0000","last_unstale":"2023-10-09T11:46:54.003347+0000","last_undegraded":"2023-10-09T11:46:54.003347+0000","last_fullsized":"2023-10-09T11:46:54.003347+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:28:30.043185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007890+0000","last_change":"2023-10-09T11:46:52.998436+0000","last_active":"2023-10-09T11:46:54.007890+0000","last_peered":"2023-10-09T11:46:54.007890+0000","last_clean":"2023-10-09T11:46:54.007890+0000","last_became_active":"2023-10-09T11:46:52.998176+0000","last_became_peered":"2023-10-09T11:46:52.998176+0000","last_unstale":"2023-10-09T11:46:54.007890+0000","last_undegraded":"2023-10-09T11:46:54.007890+0000","last_fullsized":"2023-10-09T11:46:54.007890+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T13:02:20.698499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.009877+0000","last_change":"2023-10-09T11:46:54.009596+0000","last_active":"2023-10-09T11:46:54.009877+0000","last_peered":"2023-10-09T11:46:54.009877+0000","last_clean":"2023-10-09T11:46:54.009877+0000","last_became_active":"2023-10-09T11:46:54.008841+0000","last_became_peered":"2023-10-09T11:46:54.008841+0000","last_unstale":"2023-10-09T11:46:54.009877+0000","last_undegraded":"2023-10-09T11:46:54.009877+0000","last_fullsized":"2023-10-09T11:46:54.009877+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:46.787478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.011286+0000","last_change":"2023-10-09T11:46:53.001924+0000","last_active":"2023-10-09T11:46:54.011286+0000","last_peered":"2023-10-09T11:46:54.011286+0000","last_clean":"2023-10-09T11:46:54.011286+0000","last_became_active":"2023-10-09T11:46:53.001387+0000","last_became_peered":"2023-10-09T11:46:53.001387+0000","last_unstale":"2023-10-09T11:46:54.011286+0000","last_undegraded":"2023-10-09T11:46:54.011286+0000","last_fullsized":"2023-10-09T11:46:54.011286+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:19:01.840092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.007518+0000","last_change":"2023-10-09T11:46:54.007450+0000","last_active":"2023-10-09T11:46:54.007518+0000","last_peered":"2023-10-09T11:46:54.007518+0000","last_clean":"2023-10-09T11:46:54.007518+0000","last_became_active":"2023-10-09T11:46:54.006861+0000","last_became_peered":"2023-10-09T11:46:54.006861+0000","last_unstale":"2023-10-09T11:46:54.007518+0000","last_undegraded":"2023-10-09T11:46:54.007518+0000","last_fullsized":"2023-10-09T11:46:54.007518+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:51.160391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.999608+0000","last_change":"2023-10-09T11:46:53.002567+0000","last_active":"2023-10-09T11:46:53.999608+0000","last_peered":"2023-10-09T11:46:53.999608+0000","last_clean":"2023-10-09T11:46:53.999608+0000","last_became_active":"2023-10-09T11:46:53.002329+0000","last_became_peered":"2023-10-09T11:46:53.002329+0000","last_unstale":"2023-10-09T11:46:53.999608+0000","last_undegraded":"2023-10-09T11:46:53.999608+0000","last_fullsized":"2023-10-09T11:46:53.999608+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:44.987900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.003740+0000","last_change":"2023-10-09T11:46:54.003591+0000","last_active":"2023-10-09T11:46:54.003740+0000","last_peered":"2023-10-09T11:46:54.003740+0000","last_clean":"2023-10-09T11:46:54.003740+0000","last_became_active":"2023-10-09T11:46:54.003217+0000","last_became_peered":"2023-10-09T11:46:54.003217+0000","last_unstale":"2023-10-09T11:46:54.003740+0000","last_undegraded":"2023-10-09T11:46:54.003740+0000","last_fullsized":"2023-10-09T11:46:54.003740+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:16:07.071787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012314+0000","last_change":"2023-10-09T11:46:53.005958+0000","last_active":"2023-10-09T11:46:54.012314+0000","last_peered":"2023-10-09T11:46:54.012314+0000","last_clean":"2023-10-09T11:46:54.012314+0000","last_became_active":"2023-10-09T11:46:53.005685+0000","last_became_peered":"2023-10-09T11:46:53.005685+0000","last_unstale":"2023-10-09T11:46:54.012314+0000","last_undegraded":"2023-10-09T11:46:54.012314+0000","last_fullsized":"2023-10-09T11:46:54.012314+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:19.564514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.002261+0000","last_change":"2023-10-09T11:46:54.002054+0000","last_active":"2023-10-09T11:46:54.002261+0000","last_peered":"2023-10-09T11:46:54.002261+0000","last_clean":"2023-10-09T11:46:54.002261+0000","last_became_active":"2023-10-09T11:46:54.001780+0000","last_became_peered":"2023-10-09T11:46:54.001780+0000","last_unstale":"2023-10-09T11:46:54.002261+0000","last_undegraded":"2023-10-09T11:46:54.002261+0000","last_fullsized":"2023-10-09T11:46:54.002261+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:45.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.999167+0000","last_change":"2023-10-09T11:46:52.998655+0000","last_active":"2023-10-09T11:46:53.999167+0000","last_peered":"2023-10-09T11:46:53.999167+0000","last_clean":"2023-10-09T11:46:53.999167+0000","last_became_active":"2023-10-09T11:46:52.998437+0000","last_became_peered":"2023-10-09T11:46:52.998437+0000","last_unstale":"2023-10-09T11:46:53.999167+0000","last_undegraded":"2023-10-09T11:46:53.999167+0000","last_fullsized":"2023-10-09T11:46:53.999167+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:05:56.116755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008061+0000","last_change":"2023-10-09T11:46:54.007799+0000","last_active":"2023-10-09T11:46:54.008061+0000","last_peered":"2023-10-09T11:46:54.008061+0000","last_clean":"2023-10-09T11:46:54.008061+0000","last_became_active":"2023-10-09T11:46:54.007284+0000","last_became_peered":"2023-10-09T11:46:54.007284+0000","last_unstale":"2023-10-09T11:46:54.008061+0000","last_undegraded":"2023-10-09T11:46:54.008061+0000","last_fullsized":"2023-10-09T11:46:54.008061+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.004434+0000","last_change":"2023-10-09T11:46:52.996483+0000","last_active":"2023-10-09T11:46:54.004434+0000","last_peered":"2023-10-09T11:46:54.004434+0000","last_clean":"2023-10-09T11:46:54.004434+0000","last_became_active":"2023-10-09T11:46:52.996090+0000","last_became_peered":"2023-10-09T11:46:52.996090+0000","last_unstale":"2023-10-09T11:46:54.004434+0000","last_undegraded":"2023-10-09T11:46:54.004434+0000","last_fullsized":"2023-10-09T11:46:54.004434+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:25.225198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.996986+0000","last_change":"2023-10-09T11:46:53.996722+0000","last_active":"2023-10-09T11:46:53.996986+0000","last_peered":"2023-10-09T11:46:53.996986+0000","last_clean":"2023-10-09T11:46:53.996986+0000","last_became_active":"2023-10-09T11:46:53.996497+0000","last_became_peered":"2023-10-09T11:46:53.996497+0000","last_unstale":"2023-10-09T11:46:53.996986+0000","last_undegraded":"2023-10-09T11:46:53.996986+0000","last_fullsized":"2023-10-09T11:46:53.996986+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T11:48:27.210044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000438+0000","last_change":"2023-10-09T11:46:53.005350+0000","last_active":"2023-10-09T11:46:54.000438+0000","last_peered":"2023-10-09T11:46:54.000438+0000","last_clean":"2023-10-09T11:46:54.000438+0000","last_became_active":"2023-10-09T11:46:53.001704+0000","last_became_peered":"2023-10-09T11:46:53.001704+0000","last_unstale":"2023-10-09T11:46:54.000438+0000","last_undegraded":"2023-10-09T11:46:54.000438+0000","last_fullsized":"2023-10-09T11:46:54.000438+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:09:23.663505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008892+0000","last_change":"2023-10-09T11:46:54.008817+0000","last_active":"2023-10-09T11:46:54.008892+0000","last_peered":"2023-10-09T11:46:54.008892+0000","last_clean":"2023-10-09T11:46:54.008892+0000","last_became_active":"2023-10-09T11:46:54.008576+0000","last_became_peered":"2023-10-09T11:46:54.008576+0000","last_unstale":"2023-10-09T11:46:54.008892+0000","last_undegraded":"2023-10-09T11:46:54.008892+0000","last_fullsized":"2023-10-09T11:46:54.008892+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:58:30.832528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.005490+0000","last_change":"2023-10-09T11:46:53.004666+0000","last_active":"2023-10-09T11:46:54.005490+0000","last_peered":"2023-10-09T11:46:54.005490+0000","last_clean":"2023-10-09T11:46:54.005490+0000","last_became_active":"2023-10-09T11:46:53.004438+0000","last_became_peered":"2023-10-09T11:46:53.004438+0000","last_unstale":"2023-10-09T11:46:54.005490+0000","last_undegraded":"2023-10-09T11:46:54.005490+0000","last_fullsized":"2023-10-09T11:46:54.005490+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:45.751052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008675+0000","last_change":"2023-10-09T11:46:54.008615+0000","last_active":"2023-10-09T11:46:54.008675+0000","last_peered":"2023-10-09T11:46:54.008675+0000","last_clean":"2023-10-09T11:46:54.008675+0000","last_became_active":"2023-10-09T11:46:54.008197+0000","last_became_peered":"2023-10-09T11:46:54.008197+0000","last_unstale":"2023-10-09T11:46:54.008675+0000","last_undegraded":"2023-10-09T11:46:54.008675+0000","last_fullsized":"2023-10-09T11:46:54.008675+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:36:43.033099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.995029+0000","last_change":"2023-10-09T11:46:53.001043+0000","last_active":"2023-10-09T11:46:53.995029+0000","last_peered":"2023-10-09T11:46:53.995029+0000","last_clean":"2023-10-09T11:46:53.995029+0000","last_became_active":"2023-10-09T11:46:53.000788+0000","last_became_peered":"2023-10-09T11:46:53.000788+0000","last_unstale":"2023-10-09T11:46:53.995029+0000","last_undegraded":"2023-10-09T11:46:53.995029+0000","last_fullsized":"2023-10-09T11:46:53.995029+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:14:28.305605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.008823+0000","last_change":"2023-10-09T11:46:54.007522+0000","last_active":"2023-10-09T11:46:54.008823+0000","last_peered":"2023-10-09T11:46:54.008823+0000","last_clean":"2023-10-09T11:46:54.008823+0000","last_became_active":"2023-10-09T11:46:54.007289+0000","last_became_peered":"2023-10-09T11:46:54.007289+0000","last_unstale":"2023-10-09T11:46:54.008823+0000","last_undegraded":"2023-10-09T11:46:54.008823+0000","last_fullsized":"2023-10-09T11:46:54.008823+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:37:28.499779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.997943+0000","last_change":"2023-10-09T11:46:53.004683+0000","last_active":"2023-10-09T11:46:53.997943+0000","last_peered":"2023-10-09T11:46:53.997943+0000","last_clean":"2023-10-09T11:46:53.997943+0000","last_became_active":"2023-10-09T11:46:53.003788+0000","last_became_peered":"2023-10-09T11:46:53.003788+0000","last_unstale":"2023-10-09T11:46:53.997943+0000","last_undegraded":"2023-10-09T11:46:53.997943+0000","last_fullsized":"2023-10-09T11:46:53.997943+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:35:31.468385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012074+0000","last_change":"2023-10-09T11:46:54.012002+0000","last_active":"2023-10-09T11:46:54.012074+0000","last_peered":"2023-10-09T11:46:54.012074+0000","last_clean":"2023-10-09T11:46:54.012074+0000","last_became_active":"2023-10-09T11:46:54.011388+0000","last_became_peered":"2023-10-09T11:46:54.011388+0000","last_unstale":"2023-10-09T11:46:54.012074+0000","last_undegraded":"2023-10-09T11:46:54.012074+0000","last_fullsized":"2023-10-09T11:46:54.012074+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:29.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.997075+0000","last_change":"2023-10-09T11:46:52.998373+0000","last_active":"2023-10-09T11:46:53.997075+0000","last_peered":"2023-10-09T11:46:53.997075+0000","last_clean":"2023-10-09T11:46:53.997075+0000","last_became_active":"2023-10-09T11:46:52.998126+0000","last_became_peered":"2023-10-09T11:46:52.998126+0000","last_unstale":"2023-10-09T11:46:53.997075+0000","last_undegraded":"2023-10-09T11:46:53.997075+0000","last_fullsized":"2023-10-09T11:46:53.997075+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:06:29.642703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.012272+0000","last_change":"2023-10-09T11:46:54.012211+0000","last_active":"2023-10-09T11:46:54.012272+0000","last_peered":"2023-10-09T11:46:54.012272+0000","last_clean":"2023-10-09T11:46:54.012272+0000","last_became_active":"2023-10-09T11:46:54.011953+0000","last_became_peered":"2023-10-09T11:46:54.011953+0000","last_unstale":"2023-10-09T11:46:54.012272+0000","last_undegraded":"2023-10-09T11:46:54.012272+0000","last_fullsized":"2023-10-09T11:46:54.012272+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:01:12.614080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000686+0000","last_change":"2023-10-09T11:46:53.005651+0000","last_active":"2023-10-09T11:46:54.000686+0000","last_peered":"2023-10-09T11:46:54.000686+0000","last_clean":"2023-10-09T11:46:54.000686+0000","last_became_active":"2023-10-09T11:46:53.005418+0000","last_became_peered":"2023-10-09T11:46:53.005418+0000","last_unstale":"2023-10-09T11:46:54.000686+0000","last_undegraded":"2023-10-09T11:46:54.000686+0000","last_fullsized":"2023-10-09T11:46:54.000686+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T14:29:41.664743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010682+0000","last_change":"2023-10-09T11:46:54.010614+0000","last_active":"2023-10-09T11:46:54.010682+0000","last_peered":"2023-10-09T11:46:54.010682+0000","last_clean":"2023-10-09T11:46:54.010682+0000","last_became_active":"2023-10-09T11:46:54.008502+0000","last_became_peered":"2023-10-09T11:46:54.008502+0000","last_unstale":"2023-10-09T11:46:54.010682+0000","last_undegraded":"2023-10-09T11:46:54.010682+0000","last_fullsized":"2023-10-09T11:46:54.010682+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:25.159360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.999640+0000","last_change":"2023-10-09T11:46:53.001263+0000","last_active":"2023-10-09T11:46:53.999640+0000","last_peered":"2023-10-09T11:46:53.999640+0000","last_clean":"2023-10-09T11:46:53.999640+0000","last_became_active":"2023-10-09T11:46:53.001104+0000","last_became_peered":"2023-10-09T11:46:53.001104+0000","last_unstale":"2023-10-09T11:46:53.999640+0000","last_undegraded":"2023-10-09T11:46:53.999640+0000","last_fullsized":"2023-10-09T11:46:53.999640+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T12:29:19.649034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.010229+0000","last_change":"2023-10-09T11:46:54.010101+0000","last_active":"2023-10-09T11:46:54.010229+0000","last_peered":"2023-10-09T11:46:54.010229+0000","last_clean":"2023-10-09T11:46:54.010229+0000","last_became_active":"2023-10-09T11:46:54.009670+0000","last_became_peered":"2023-10-09T11:46:54.009670+0000","last_unstale":"2023-10-09T11:46:54.010229+0000","last_undegraded":"2023-10-09T11:46:54.010229+0000","last_fullsized":"2023-10-09T11:46:54.010229+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:00:46.753111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.995144+0000","last_change":"2023-10-09T11:46:53.003669+0000","last_active":"2023-10-09T11:46:53.995144+0000","last_peered":"2023-10-09T11:46:53.995144+0000","last_clean":"2023-10-09T11:46:53.995144+0000","last_became_active":"2023-10-09T11:46:53.003385+0000","last_became_peered":"2023-10-09T11:46:53.003385+0000","last_unstale":"2023-10-09T11:46:53.995144+0000","last_undegraded":"2023-10-09T11:46:53.995144+0000","last_fullsized":"2023-10-09T11:46:53.995144+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:45.718711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.997164+0000","last_change":"2023-10-09T11:46:53.997011+0000","last_active":"2023-10-09T11:46:53.997164+0000","last_peered":"2023-10-09T11:46:53.997164+0000","last_clean":"2023-10-09T11:46:53.997164+0000","last_became_active":"2023-10-09T11:46:53.996789+0000","last_became_peered":"2023-10-09T11:46:53.996789+0000","last_unstale":"2023-10-09T11:46:53.997164+0000","last_undegraded":"2023-10-09T11:46:53.997164+0000","last_fullsized":"2023-10-09T11:46:53.997164+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:20.527679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.998354+0000","last_change":"2023-10-09T11:46:53.004195+0000","last_active":"2023-10-09T11:46:53.998354+0000","last_peered":"2023-10-09T11:46:53.998354+0000","last_clean":"2023-10-09T11:46:53.998354+0000","last_became_active":"2023-10-09T11:46:53.003684+0000","last_became_peered":"2023-10-09T11:46:53.003684+0000","last_unstale":"2023-10-09T11:46:53.998354+0000","last_undegraded":"2023-10-09T11:46:53.998354+0000","last_fullsized":"2023-10-09T11:46:53.998354+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:35.181752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.005705+0000","last_change":"2023-10-09T11:46:54.005636+0000","last_active":"2023-10-09T11:46:54.005705+0000","last_peered":"2023-10-09T11:46:54.005705+0000","last_clean":"2023-10-09T11:46:54.005705+0000","last_became_active":"2023-10-09T11:46:54.005094+0000","last_became_peered":"2023-10-09T11:46:54.005094+0000","last_unstale":"2023-10-09T11:46:54.005705+0000","last_undegraded":"2023-10-09T11:46:54.005705+0000","last_fullsized":"2023-10-09T11:46:54.005705+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:52.986053+0000","last_clean_scrub_stamp":"2023-10-09T11:46:52.986053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:27.113644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:54.000594+0000","last_change":"2023-10-09T11:46:53.002512+0000","last_active":"2023-10-09T11:46:54.000594+0000","last_peered":"2023-10-09T11:46:54.000594+0000","last_clean":"2023-10-09T11:46:54.000594+0000","last_became_active":"2023-10-09T11:46:53.002175+0000","last_became_peered":"2023-10-09T11:46:53.002175+0000","last_unstale":"2023-10-09T11:46:54.000594+0000","last_undegraded":"2023-10-09T11:46:54.000594+0000","last_fullsized":"2023-10-09T11:46:54.000594+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:46:51.983994+0000","last_clean_scrub_stamp":"2023-10-09T11:46:51.983994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:14.080583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":297,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-09T11:46:53.999266+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:46:53.999266+0000","last_peered":"2023-10-09T11:46:53.999266+0000","last_clean":"2023-10-09T11:46:53.999266+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:46:53.999266+0000","last_undegraded":"2023-10-09T11:46:53.999266+0000","last_fullsized":"2023-10-09T11:46:53.999266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1549,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193762,"statfs":{"total":200000000,"available":198412999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.35399999999999998,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.495}]},{"osd":1,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.53900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.57399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.878},"last":0.41199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.42199999999999999,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.52100000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.048},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.34300000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":1.079},"last":0.504}]},{"osd":4,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.442,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.59399999999999997,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.26400000000000001},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.29499999999999998},"max":{"1min":0.66500000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.503,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69899999999999995,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":971,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194341,"statfs":{"total":200000000,"available":199005595,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.57599999999999996},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73099999999999998,"5min":0.77300000000000002,"15min":3.7589999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67500000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.437}]},{"osd":1,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57499999999999996,"15min":0.63200000000000001},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":5.3540000000000001},"last":0.629}]},{"osd":2,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.6060000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59299999999999997,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.76100000000000001,"15min":1.617},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":0.84499999999999997,"15min":5.46},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":5.3949999999999996},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.23499999999999999},"max":{"1min":0.65700000000000003,"5min":1.617,"15min":1.617},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.46400000000000002},"min":{"1min":0.29799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68100000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66700000000000004,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.72099999999999997,"15min":0.83699999999999997},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:46:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53900000000000003,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.64200000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.70799999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.747}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":971,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194341,"statfs":{"total":200000000,"available":199005583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.35899999999999999,"15min":0.379},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53300000000000003,"5min":0.624,"15min":1.9370000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.41199999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":2.004},"last":0.26700000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36499999999999999,"15min":0.39100000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.53200000000000003,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.67600000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.46400000000000002},"min":{"1min":0.32100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60699999999999998,"5min":0.627,"15min":1.909},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42299999999999999,"15min":0.44600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":2.0369999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83099999999999996,"5min":0.91300000000000003,"15min":2.1509999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.869},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.495},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":2.1960000000000002},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.628,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.952},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86599999999999999,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.782},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":0.88600000000000001,"5min":0.93700000000000006,"15min":1.819},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193765,"statfs":{"total":200000000,"available":198416260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.371,"15min":0.40799999999999997},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.38800000000000001},"min":{"1min":0.28699999999999998,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41999999999999998},"min":{"1min":0.32500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55800000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59899999999999998,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.46400000000000002},"min":{"1min":0.28399999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":2.194},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86799999999999999,"15min":1.508},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.78600000000000003,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.67300000000000004},"min":{"1min":0.47699999999999998,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":3.976},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":1.03,"15min":2.1549999999999998},"last":0.76800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.65200000000000002},"min":{"1min":0.51500000000000001,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":0.96699999999999997,"15min":1.5429999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.66400000000000003},"min":{"1min":0.54500000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84099999999999997,"5min":0.92900000000000005,"15min":1.593},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70899999999999996,"15min":0.74299999999999999},"min":{"1min":0.53300000000000003,"5min":0.44,"15min":0.432},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":971,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194341,"statfs":{"total":200000000,"available":199005527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.34399999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.20999999999999999},"max":{"1min":0.56899999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.36799999999999999},"min":{"1min":0.24399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.379,"15min":0.35499999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.60099999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.42499999999999999,"15min":0.64200000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.54100000000000004,"5min":0.68000000000000005,"15min":11.055},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45100000000000001,"15min":0.40699999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27000000000000002},"max":{"1min":0.623,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58799999999999997,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.49099999999999999,"5min":0.378,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.68000000000000005,"5min":0.85199999999999998,"15min":0.999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.80000000000000004,"5min":0.95299999999999996,"15min":1.097},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.69299999999999995,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.03,"15min":1.03},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64100000000000001,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":2.2789999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.39600000000000002},"max":{"1min":0.751,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":971,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194341,"statfs":{"total":200000000,"available":199005583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.222,"5min":0.20899999999999999,"15min":0.19},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.315},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.214},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.374,"15min":0.374},"min":{"1min":0.26900000000000002,"5min":0.21299999999999999,"15min":0.20399999999999999},"max":{"1min":0.498,"5min":0.621,"15min":1.034},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.435,"15min":0.432},"min":{"1min":0.34599999999999997,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52400000000000002,"5min":0.65400000000000003,"15min":1.335},"last":0.35499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29299999999999998,"5min":0.23899999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.64400000000000002,"15min":1.1200000000000001},"last":0.374},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64500000000000002,"5min":0.82799999999999996,"15min":1.405},"last":0.39800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.35699999999999998},"max":{"1min":0.90500000000000003,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.876,"15min":0.98399999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88100000000000001,"5min":1.0860000000000001,"15min":1.3600000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.95799999999999996,"15min":1.387},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.93100000000000005,"5min":1.054,"15min":1.3819999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:46:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.371,"15min":0.371},"max":{"1min":0.96199999999999997,"5min":0.995,"15min":1.4570000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.623}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":972,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194339,"statfs":{"total":200000000,"available":199004011,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.66700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35199999999999998,"15min":0.27300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58899999999999997,"15min":0.70799999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.90000000000000002,"5min":0.90900000000000003,"15min":7.4459999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.55400000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.55000000000000004},"min":{"1min":0.46999999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.58199999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":4.1609999999999996},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.626},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":5.274},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.69999999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":7.5679999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.59599999999999997,"15min":0.72099999999999997},"min":{"1min":0.46200000000000002,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.5,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.751,"15min":0.82899999999999996},"last":0.505}]},{"osd":6,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.246},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.28100000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.86099999999999999},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:46:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.5},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.31,"15min":0.31},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":971,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194340,"statfs":{"total":200000000,"available":199005041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":1.2729999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51300000000000001},"min":{"1min":0.34399999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.27100000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.39800000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34200000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.85199999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"last":0.50700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.41599999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.96399999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.48699999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":0.78700000000000003,"5min":0.81299999999999994,"15min":0.98899999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.442,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.56299999999999994,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.66300000000000003,"5min":0.74099999999999999,"15min":0.88500000000000001},"last":0.55800000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.622,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.505,"15min":0.5},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67800000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.49299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:46:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.51700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.78800000000000003,"15min":0.82999999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61599999999999999}]}]}],"pool_statfs":[]}} 2023-10-09T11:46:58.501 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T11:46:58.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T11:46:58.626 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-10-09T11:46:58.626+0000 7f8fc3c80700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:46:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.662+0000 7f4c2a390700 1 Processor -- start 2023-10-09T11:46:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.662+0000 7f4c2a390700 1 -- start start 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2a390700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 0x7f4c240cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2a390700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c24157b90 0x7f4c240cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2a390700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240cca80 con 0x7f4c241577c0 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2a390700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240cedd0 con 0x7f4c24157b90 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2a390700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240cc210 con 0x7f4c24068f20 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c24157b90 0x7f4c240cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c24157b90 0x7f4c240cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47526/0 (socket says 172.21.15.6:47526) 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 -- 172.21.15.6:0/2726583366 learned_addr learned my addr 172.21.15.6:0/2726583366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c1bfff700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 0x7f4c240cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 -- 172.21.15.6:0/2726583366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 msgr2=0x7f4c240cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 0x7f4c240cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 -- 172.21.15.6:0/2726583366 >> v1:172.21.15.118:6789/0 conn(0x7f4c241577c0 legacy=0x7f4c24068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c2892d700 1 -- 172.21.15.6:0/2726583366 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240cc4c0 con 0x7f4c24157b90 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.663+0000 7f4c1bfff700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 0x7f4c240cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2892d700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240cbcd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009f20 tx=0x7f4c1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826ea2eb515baa43 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c237fe700 1 -- 172.21.15.6:0/2726583366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00e070 con 0x7f4c24157b90 2023-10-09T11:46:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c237fe700 1 -- 172.21.15.6:0/2726583366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00ba40 con 0x7f4c24157b90 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c237fe700 1 -- 172.21.15.6:0/2726583366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0092e0 con 0x7f4c24157b90 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 -- 172.21.15.6:0/2726583366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 msgr2=0x7f4c240cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240cbcd0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009f20 tx=0x7f4c1c009840 comp rx=0 tx=0).stop 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 -- 172.21.15.6:0/2726583366 shutdown_connections 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240cbcd0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 --2- 172.21.15.6:0/2726583366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c24068f20 0x7f4c240cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 -- 172.21.15.6:0/2726583366 >> 172.21.15.6:0/2726583366 conn(0x7f4c240d0df0 msgr2=0x7f4c240d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 -- 172.21.15.6:0/2726583366 shutdown_connections 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.664+0000 7f4c2a390700 1 -- 172.21.15.6:0/2726583366 wait complete. 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.665+0000 7f4c2a390700 1 Processor -- start 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 -- start start 2023-10-09T11:46:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 0x7f4c2415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c241577c0 0x7f4c2414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24154380 con 0x7f4c24157b90 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24155130 con 0x7f4c24068f20 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2a390700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24154560 con 0x7f4c241577c0 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2892d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2892d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47530/0 (socket says 172.21.15.6:47530) 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.666+0000 7f4c2892d700 1 -- 172.21.15.6:0/385631586 learned_addr learned my addr 172.21.15.6:0/385631586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c1bfff700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c241577c0 0x7f4c2414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c23fff700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 0x7f4c2415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 -- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c241577c0 msgr2=0x7f4c2414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c241577c0 0x7f4c2414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 -- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 msgr2=0x7f4c2415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 0x7f4c2415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 -- 172.21.15.6:0/385631586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c009ae0 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c23fff700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 0x7f4c2415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2892d700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c003000 tx=0x7f4c1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0032f0 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c012e60 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24154800 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c01d670 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.667+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c24154dc0 con 0x7f4c24157b90 2023-10-09T11:46:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.668+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c241552e0 con 0x7f4c24157b90 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.668+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c1c01da60 con 0x7f4c24157b90 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.669+0000 7f4c20ff9700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.669+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c1c085eb0 con 0x7f4c24157b90 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.669+0000 7f4c23fff700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.669+0000 7f4c23fff700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4c14002880 tx=0x7f4c14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.673+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c241552e0 con 0x7f4c24157b90 2023-10-09T11:46:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.948+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4c241554c0 con 0x7f4c24157b90 2023-10-09T11:46:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.951+0000 7f4c20ff9700 1 -- 172.21.15.6:0/385631586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4c241554c0 con 0x7f4c24157b90 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 msgr2=0x7f4c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4c14002880 tx=0x7f4c14009040 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 msgr2=0x7f4c240b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c003000 tx=0x7f4c1c017000 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 shutdown_connections 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c24157b90 0x7f4c240b4770 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c24068f20 0x7f4c2415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 --2- 172.21.15.6:0/385631586 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c241577c0 0x7f4c2414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 >> 172.21.15.6:0/385631586 conn(0x7f4c240d0df0 msgr2=0x7f4c24158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 shutdown_connections 2023-10-09T11:46:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:58.954+0000 7f4c2a390700 1 -- 172.21.15.6:0/385631586 wait complete. 2023-10-09T11:46:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-10-09T11:46:58.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:46:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.085+0000 7f8880bb0700 1 Processor -- start 2023-10-09T11:46:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.085+0000 7f8880bb0700 1 -- start start 2023-10-09T11:46:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8880bb0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f887c1578d0 0x7f887c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8880bb0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c06d120 0x7f887c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8880bb0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0d07c0 con 0x7f887c157ca0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8880bb0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c06daa0 con 0x7f887c1578d0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8880bb0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0cfbb0 con 0x7f887c06d120 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f887a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f887c1578d0 0x7f887c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8879d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f887c157ca0 0x7f887c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55836/0 (socket says 172.21.15.6:55836) 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f8879d9b700 1 -- 172.21.15.6:0/1751603742 learned_addr learned my addr 172.21.15.6:0/1751603742 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f887ad9d700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c06d120 0x7f887c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.086+0000 7f887959a700 1 -- 172.21.15.6:0/1751603742 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362462780 0 0) 0x7f887c0d07c0 con 0x7f887c157ca0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887959a700 1 -- 172.21.15.6:0/1751603742 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868003570 con 0x7f887c157ca0 2023-10-09T11:46:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887a59c700 1 -- 172.21.15.6:0/1751603742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c06d120 msgr2=0x7f887c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887a59c700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c06d120 0x7f887c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887a59c700 1 -- 172.21.15.6:0/1751603742 >> v1:172.21.15.6:6789/0 conn(0x7f887c157ca0 legacy=0x7f887c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887a59c700 1 -- 172.21.15.6:0/1751603742 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0cfe90 con 0x7f887c1578d0 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887a59c700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c1578d0 0x7f887c0cf4f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f88740098e0 tx=0x7f88740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8b41a82edd00bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887959a700 1 -- 172.21.15.6:0/1751603742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874011630 con 0x7f887c1578d0 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887959a700 1 -- 172.21.15.6:0/1751603742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874011790 con 0x7f887c1578d0 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f887959a700 1 -- 172.21.15.6:0/1751603742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874011b30 con 0x7f887c1578d0 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f8880bb0700 1 -- 172.21.15.6:0/1751603742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c1578d0 msgr2=0x7f887c0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.087+0000 7f8880bb0700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c1578d0 0x7f887c0cf4f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f88740098e0 tx=0x7f88740091a0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 -- 172.21.15.6:0/1751603742 shutdown_connections 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c06d120 0x7f887c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 --2- 172.21.15.6:0/1751603742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c1578d0 0x7f887c0cf4f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 -- 172.21.15.6:0/1751603742 >> 172.21.15.6:0/1751603742 conn(0x7f887c06bb90 msgr2=0x7f887c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 -- 172.21.15.6:0/1751603742 shutdown_connections 2023-10-09T11:46:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.088+0000 7f8880bb0700 1 -- 172.21.15.6:0/1751603742 wait complete. 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 Processor -- start 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 -- start start 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f887c1578d0 0x7f887c16a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c157ca0 0x7f887c0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.089+0000 7f8880bb0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c153ce0 con 0x7f887c06d120 2023-10-09T11:46:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f8880bb0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0b5530 con 0x7f887c1578d0 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f8880bb0700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0b4920 con 0x7f887c157ca0 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47554/0 (socket says 172.21.15.6:47554) 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 -- 172.21.15.6:0/3361069372 learned_addr learned my addr 172.21.15.6:0/3361069372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 -- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c157ca0 msgr2=0x7f887c0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c157ca0 0x7f887c0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 -- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f887c1578d0 msgr2=0x7f887c16a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f887c1578d0 0x7f887c16a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 -- 172.21.15.6:0/3361069372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8874009420 con 0x7f887c06d120 2023-10-09T11:46:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f887a59c700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f887c06fe20 tx=0x7f8874017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874011b10 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88740253f0 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c0b4c00 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874025790 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.090+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c0b51c0 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.091+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c067ac0 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.092+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8874025b80 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.092+0000 7f88727fc700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 0x7f885c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.092+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8874085e50 con 0x7f887c06d120 2023-10-09T11:46:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.092+0000 7f8879d9b700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 0x7f885c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.092+0000 7f8879d9b700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 0x7f885c0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f88640058d0 tx=0x7f88640079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.096+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88740530c0 con 0x7f887c06d120 2023-10-09T11:46:59.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.336+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f887c0d0170 con 0x7f887c06d120 2023-10-09T11:46:59.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.337+0000 7f88727fc700 1 -- 172.21.15.6:0/3361069372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f8874015090 con 0x7f887c06d120 2023-10-09T11:46:59.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:46:59.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 msgr2=0x7f885c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 0x7f885c0693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f88640058d0 tx=0x7f88640079d0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 msgr2=0x7f887c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f887c06fe20 tx=0x7f8874017000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 shutdown_connections 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f885c066f30 0x7f885c0693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f887c157ca0 0x7f887c0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887c06d120 0x7f887c1537a0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 --2- 172.21.15.6:0/3361069372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f887c1578d0 0x7f887c16a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 >> 172.21.15.6:0/3361069372 conn(0x7f887c06bb90 msgr2=0x7f887c15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 shutdown_connections 2023-10-09T11:46:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.339+0000 7f8880bb0700 1 -- 172.21.15.6:0/3361069372 wait complete. 2023-10-09T11:46:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:46:59.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T11:46:53.398523+0000', 'modified': '2023-10-09T11:46:57.023203+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8136}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8136': {'gid': 8136, 'name': 'a', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/3906530469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6835', 'nonce': 3906530469}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 3906530469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T11:46:59.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T11:46:59.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T11:46:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.876+0000 7f7328d9a700 1 Processor -- start 2023-10-09T11:46:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.876+0000 7f7328d9a700 1 -- start start 2023-10-09T11:46:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7324159b40 0x7f73240cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7324159f10 0x7f7324068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73240ccb40 0x7f7324068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240cee10 con 0x7f7324159b40 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240cd040 con 0x7f73240ccb40 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7328d9a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73240cd320 con 0x7f7324159f10 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7324159b40 0x7f73240cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7324159b40 0x7f73240cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47558/0 (socket says 172.21.15.6:47558) 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 -- 172.21.15.6:0/411524392 learned_addr learned my addr 172.21.15.6:0/411524392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f7323fff700 1 --2- 172.21.15.6:0/411524392 >> v2:172.21.15.118:3300/0 conn(0x7f73240ccb40 0x7f7324068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 -- 172.21.15.6:0/411524392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7324159f10 msgr2=0x7f7324068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 --2- 172.21.15.6:0/411524392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7324159f10 0x7f7324068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 -- 172.21.15.6:0/411524392 >> v2:172.21.15.118:3300/0 conn(0x7f73240ccb40 msgr2=0x7f7324068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 --2- 172.21.15.6:0/411524392 >> v2:172.21.15.118:3300/0 conn(0x7f73240ccb40 0x7f7324068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.877+0000 7f73237fe700 1 -- 172.21.15.6:0/411524392 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240ce7c0 con 0x7f7324159b40 2023-10-09T11:46:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f73237fe700 1 --2- 172.21.15.6:0/411524392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240cc600 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6bf0 tx=0x7f7314009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472725d319ad3793 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f73227fc700 1 -- 172.21.15.6:0/411524392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400b860 con 0x7f7324159b40 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f73227fc700 1 -- 172.21.15.6:0/411524392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400b9c0 con 0x7f7324159b40 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f73227fc700 1 -- 172.21.15.6:0/411524392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400bd60 con 0x7f7324159b40 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 -- 172.21.15.6:0/411524392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 msgr2=0x7f73240cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 --2- 172.21.15.6:0/411524392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240cc600 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6bf0 tx=0x7f7314009250 comp rx=0 tx=0).stop 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 -- 172.21.15.6:0/411524392 shutdown_connections 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 --2- 172.21.15.6:0/411524392 >> v2:172.21.15.118:3300/0 conn(0x7f73240ccb40 0x7f7324068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 --2- 172.21.15.6:0/411524392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240cc600 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 --2- 172.21.15.6:0/411524392 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7324159f10 0x7f7324068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 -- 172.21.15.6:0/411524392 >> 172.21.15.6:0/411524392 conn(0x7f73240cd660 msgr2=0x7f73240cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 -- 172.21.15.6:0/411524392 shutdown_connections 2023-10-09T11:46:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.878+0000 7f7328d9a700 1 -- 172.21.15.6:0/411524392 wait complete. 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 Processor -- start 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 -- start start 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73240ccb40 0x7f73241547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7324159f10 0x7f73240b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324158610 con 0x7f7324159b40 2023-10-09T11:46:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324157a40 con 0x7f7324159f10 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7328d9a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7324157ce0 con 0x7f73240ccb40 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47572/0 (socket says 172.21.15.6:47572) 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7322ffd700 1 -- 172.21.15.6:0/2136362420 learned_addr learned my addr 172.21.15.6:0/2136362420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f73237fe700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73240ccb40 0x7f73241547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.880+0000 7f7323fff700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7324159f10 0x7f73240b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 -- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73240ccb40 msgr2=0x7f73241547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73240ccb40 0x7f73241547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 -- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7324159f10 msgr2=0x7f73240b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7324159f10 0x7f73240b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 -- 172.21.15.6:0/2136362420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140094f0 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f731800b810 tx=0x7f73180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f730b7fe700 1 -- 172.21.15.6:0/2136362420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800f510 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f730b7fe700 1 -- 172.21.15.6:0/2136362420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800f670 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7324157fc0 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f730b7fe700 1 -- 172.21.15.6:0/2136362420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800fa30 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.881+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7324154d00 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.882+0000 7f730b7fe700 1 -- 172.21.15.6:0/2136362420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f731801a400 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.883+0000 7f730b7fe700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.883+0000 7f730b7fe700 1 -- 172.21.15.6:0/2136362420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7318083f10 con 0x7f7324159b40 2023-10-09T11:46:59.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.883+0000 7f73237fe700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.883+0000 7f73237fe700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 0x7f73100693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6bf0 tx=0x7f7314017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.885+0000 7f73332f4b80 1 Processor -- start 2023-10-09T11:46:59.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.885+0000 7f73332f4b80 1 -- start start 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.885+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe59e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5725f0 0x55b7fe5bf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73332f4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe4cba70 con 0x55b7fe574b80 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe4c9270 con 0x55b7fe5725f0 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe4c5060 con 0x55b7fe5bf480 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47578/0 (socket says 172.21.15.6:47578) 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 -- 172.21.15.6:0/1937703625 learned_addr learned my addr 172.21.15.6:0/1937703625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f73237fe700 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe59e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7322ffd700 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5725f0 0x55b7fe5bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 -- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 msgr2=0x55b7fe59e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe59e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 -- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5725f0 msgr2=0x55b7fe5bf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5725f0 0x55b7fe5bf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 -- 172.21.15.6:0/1937703625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7fe35f270 con 0x55b7fe574b80 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7323fff700 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f731c00f5d0 tx=0x7f731c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1dd7b050005c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7308ff9700 1 -- 172.21.15.6:0/1937703625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00d670 con 0x55b7fe574b80 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7308ff9700 1 -- 172.21.15.6:0/1937703625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00d7d0 con 0x55b7fe574b80 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.886+0000 7f7308ff9700 1 -- 172.21.15.6:0/1937703625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00db50 con 0x55b7fe574b80 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 -- 172.21.15.6:0/1937703625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 msgr2=0x55b7fe574ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f731c00f5d0 tx=0x7f731c0077b0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 -- 172.21.15.6:0/1937703625 shutdown_connections 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe574ff0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe59e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1937703625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5725f0 0x55b7fe5bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 -- 172.21.15.6:0/1937703625 >> 172.21.15.6:0/1937703625 conn(0x55b7fe5760c0 msgr2=0x55b7fe5768f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 -- 172.21.15.6:0/1937703625 shutdown_connections 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.887+0000 7f73332f4b80 1 -- 172.21.15.6:0/1937703625 wait complete. 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.888+0000 7f73332f4b80 1 -- start start 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.888+0000 7f73332f4b80 1 Processor -- start 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.888+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.888+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe574b80 0x55b7fe59fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.888+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe5bc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe470890 con 0x55b7fe5725f0 2023-10-09T11:46:59.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe48bea0 con 0x55b7fe5bf480 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe347e30 con 0x55b7fe574b80 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 10 client.0 _ll_register_callbacks cb 0x55b7fe5382c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47582/0 (socket says 172.21.15.6:47582) 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 -- 172.21.15.6:0/2857346445 learned_addr learned my addr 172.21.15.6:0/2857346445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe574b80 0x55b7fe59fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7323fff700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe5bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 -- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe574b80 msgr2=0x55b7fe59fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe574b80 0x55b7fe59fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 -- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 msgr2=0x55b7fe5bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe5bc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 -- 172.21.15.6:0/2857346445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c007e50 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73237fe700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f731400bf60 tx=0x7f7314020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b57dbe2fd09694 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314020070 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f731401a630 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7fe569cd0 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7314011e70 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 10 client.8277 fetch_fsmap learned FSMap version 92 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.889+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55b7fe301fe0 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b7fe569cd0 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f731401aa00 con 0x55b7fe5725f0 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 10 client.8277 fetch_fsmap finished waiting for FSMap version 92 2023-10-09T11:46:59.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 10 client.8277 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 20 client.8277 populate_metadata read hostname 'smithi006' 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5bb4c0 0x55b7fe59ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 4 client.8277 mds_command: new command op to 8136 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 --> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7fe546aa0 con 0x55b7fe5bb4c0 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5bb4c0 0x55b7fe59ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f7322ffd700 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5bb4c0 0x55b7fe59ece0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b78712652f42ab server_cookie=37c07f3c9ec17979 in_seq=0 out_seq=0 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.890+0000 7f7301ffb700 10 client.8277 ms_handle_connect on v2:172.21.15.6:6835/3906530469 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f7301ffb700 1 -- 172.21.15.6:0/2857346445 <== mds.0 v2:172.21.15.6:6835/3906530469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b7fe546aa0 con 0x55b7fe5bb4c0 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f7301ffb700 10 client.8277 handle_command_reply: tid=0 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 client.8277 shutdown 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 msgr2=0x55b7fe5a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f731400bf60 tx=0x7f7314020000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 shutdown_connections 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5bb4c0 0x55b7fe59ece0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe5bc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f7301ffb700 0 client.8277 ms_handle_reset on v2:172.21.15.6:6835/3906530469 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe5a0270 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 --2- 172.21.15.6:0/2857346445 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe574b80 0x55b7fe59fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 >> 172.21.15.6:0/2857346445 conn(0x55b7fe5760c0 msgr2=0x55b7fe578560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 shutdown_connections 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 1 -- 172.21.15.6:0/2857346445 wait complete. 2023-10-09T11:46:59.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.891+0000 7f73332f4b80 20 client.8277 trim_cache size 0 max 16384 2023-10-09T11:46:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.908+0000 7f73332f4b80 1 Processor -- start 2023-10-09T11:46:59.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.908+0000 7f73332f4b80 1 -- start start 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5725f0 0x55b7fe571a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe59ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe569d00 con 0x55b7fe574b80 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe554510 con 0x55b7fe5bf480 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe571790 con 0x55b7fe5725f0 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47596/0 (socket says 172.21.15.6:47596) 2023-10-09T11:46:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73237fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5725f0 0x55b7fe571a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 -- 172.21.15.6:0/4048864060 learned_addr learned my addr 172.21.15.6:0/4048864060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7323fff700 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe59ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 -- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5725f0 msgr2=0x55b7fe571a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5725f0 0x55b7fe571a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 -- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 msgr2=0x55b7fe59ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe59ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 -- 172.21.15.6:0/4048864060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7fe493780 con 0x55b7fe574b80 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f7322ffd700 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f73180513c0 tx=0x7f731805a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db888f3e56dc8da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73097fa700 1 -- 172.21.15.6:0/4048864060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318058110 con 0x55b7fe574b80 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73097fa700 1 -- 172.21.15.6:0/4048864060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731806b070 con 0x55b7fe574b80 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.909+0000 7f73097fa700 1 -- 172.21.15.6:0/4048864060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731805be60 con 0x55b7fe574b80 2023-10-09T11:46:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 -- 172.21.15.6:0/4048864060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 msgr2=0x55b7fe571f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f73180513c0 tx=0x7f731805a040 comp rx=0 tx=0).stop 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 -- 172.21.15.6:0/4048864060 shutdown_connections 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe5bf480 0x55b7fe59ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5725f0 0x55b7fe571a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 --2- 172.21.15.6:0/4048864060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe574b80 0x55b7fe571f80 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 -- 172.21.15.6:0/4048864060 >> 172.21.15.6:0/4048864060 conn(0x55b7fe5760c0 msgr2=0x55b7fe5784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 -- 172.21.15.6:0/4048864060 shutdown_connections 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.910+0000 7f73332f4b80 1 -- 172.21.15.6:0/4048864060 wait complete. 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 -- start start 2023-10-09T11:46:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 Processor -- start 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe574b80 0x55b7fe59f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe571a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe622960 con 0x55b7fe5725f0 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe621530 con 0x55b7fe574b80 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7fe622390 con 0x55b7fe5bf480 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73332f4b80 10 client.0 _ll_register_callbacks cb 0x55b7fe5382c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47604/0 (socket says 172.21.15.6:47604) 2023-10-09T11:46:59.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.911+0000 7f73237fe700 1 -- 172.21.15.6:0/1958743035 learned_addr learned my addr 172.21.15.6:0/1958743035 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7323fff700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe571a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7322ffd700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe574b80 0x55b7fe59f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 -- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 msgr2=0x55b7fe571a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe571a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 -- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe574b80 msgr2=0x55b7fe59f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe574b80 0x55b7fe59f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 -- 172.21.15.6:0/1958743035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7324154d00 con 0x55b7fe5725f0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73237fe700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f7314009340 tx=0x7f731402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686cd15f5e9a1777 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314020040 con 0x55b7fe5725f0 2023-10-09T11:46:59.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f731401a630 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f731c00d7d0 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f731401ae70 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 10 client.8283 fetch_fsmap learned FSMap version 92 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55b7fe47a470 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00d7d0 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7314026830 con 0x55b7fe5725f0 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 10 client.8283 fetch_fsmap finished waiting for FSMap version 92 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 10 client.8283 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 20 client.8283 populate_metadata read hostname 'smithi006' 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5b9c00 0x55b7fe5b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 4 client.8283 mds_command: new command op to 8136 tid=0[{"prefix": "status"}] 2023-10-09T11:46:59.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.912+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 --> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b7fe467e00 con 0x55b7fe5b9c00 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7322ffd700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5b9c00 0x55b7fe5b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7301ffb700 10 client.8283 ms_handle_connect on v2:172.21.15.6:6835/3906530469 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7322ffd700 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5b9c00 0x55b7fe5b9fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b95039f99f00553 server_cookie=46c00d0cba327a48 in_seq=0 out_seq=0 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7301ffb700 1 -- 172.21.15.6:0/1958743035 <== mds.0 v2:172.21.15.6:6835/3906530469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b7fe467e00 con 0x55b7fe5b9c00 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7301ffb700 10 client.8283 handle_command_reply: tid=0 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 client.8283 shutdown 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 msgr2=0x55b7fe61b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f7314009340 tx=0x7f731402e000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 shutdown_connections 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55b7fe5bf480 0x55b7fe571a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b7fe5725f0 0x55b7fe61b470 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.6:6835/3906530469,v1:172.21.15.6:6837/3906530469] conn(0x55b7fe5b9c00 0x55b7fe5b9fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 --2- 172.21.15.6:0/1958743035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7fe574b80 0x55b7fe59f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f7301ffb700 0 client.8283 ms_handle_reset on v2:172.21.15.6:6835/3906530469 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 >> 172.21.15.6:0/1958743035 conn(0x55b7fe5760c0 msgr2=0x55b7fe570e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 shutdown_connections 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 1 -- 172.21.15.6:0/1958743035 wait complete. 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.913+0000 7f73332f4b80 20 client.8283 trim_cache size 0 max 16384 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:46:59.921 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8136, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.9208887539999999, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 92, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 178, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 178, 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.681417069 2023-10-09T11:46:59.922 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 msgr2=0x7f73100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 0x7f73100693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6bf0 tx=0x7f7314017000 comp rx=0 tx=0).stop 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 msgr2=0x7f73240b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f731800b810 tx=0x7f73180091d0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 shutdown_connections 2023-10-09T11:46:59.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7324159f10 0x7f73240b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f73240ccb40 0x7f73241547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 --2- 172.21.15.6:0/2136362420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7324159b40 0x7f73240b3990 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 >> 172.21.15.6:0/2136362420 conn(0x7f73240cd660 msgr2=0x7f732406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 shutdown_connections 2023-10-09T11:46:59.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:46:59.914+0000 7f7328d9a700 1 -- 172.21.15.6:0/2136362420 wait complete. 2023-10-09T11:46:59.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:47:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.045+0000 7fc0a5910700 1 Processor -- start 2023-10-09T11:47:00.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.045+0000 7fc0a5910700 1 -- start start 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a5910700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc0a0159f10 0x7fc0a0068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a5910700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a0069120 con 0x7fc0a0068cc0 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a5910700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a00cee10 con 0x7fc0a0159b40 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a5910700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00cd040 con 0x7fc0a0159f10 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a510f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc0a0068cc0 0x7fc0a00cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55844/0 (socket says 172.21.15.6:55844) 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc0a510f700 1 -- 172.21.15.6:0/4225056087 learned_addr learned my addr 172.21.15.6:0/4225056087 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc09ffff700 1 --2- 172.21.15.6:0/4225056087 >> v2:172.21.15.118:3300/0 conn(0x7fc0a0159f10 0x7fc0a0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548127696 0 0) 0x7fc088001110 con 0x7fc0a0068cc0 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.046+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c003570 con 0x7fc0a0068cc0 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456725466 0 0) 0x7fc0a00cee10 con 0x7fc0a0159b40 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc088001110 con 0x7fc0a0159b40 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 195787096 0 0) 0x7fc08c003570 con 0x7fc0a0068cc0 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09ffff700 1 -- 172.21.15.6:0/4225056087 >> v1:172.21.15.118:6789/0 conn(0x7fc0a0159b40 legacy=0x7fc0a00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09ffff700 1 -- 172.21.15.6:0/4225056087 >> v1:172.21.15.6:6789/0 conn(0x7fc0a0068cc0 legacy=0x7fc0a00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09ffff700 1 -- 172.21.15.6:0/4225056087 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00cd320 con 0x7fc0a0159f10 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09ffff700 1 --2- 172.21.15.6:0/4225056087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0159f10 0x7fc0a0068780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc0900098e0 tx=0x7fc0900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b22dda7cf827f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088001600 con 0x7fc0a0159f10 2023-10-09T11:47:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090011420 con 0x7fc0a0159f10 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc09f7fe700 1 -- 172.21.15.6:0/4225056087 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900117c0 con 0x7fc0a0159f10 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.047+0000 7fc0a5910700 1 -- 172.21.15.6:0/4225056087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0159f10 msgr2=0x7fc0a0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 --2- 172.21.15.6:0/4225056087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0159f10 0x7fc0a0068780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc0900098e0 tx=0x7fc0900091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 -- 172.21.15.6:0/4225056087 shutdown_connections 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 --2- 172.21.15.6:0/4225056087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0159f10 0x7fc0a0068780 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 -- 172.21.15.6:0/4225056087 >> 172.21.15.6:0/4225056087 conn(0x7fc0a00cd660 msgr2=0x7fc0a00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 -- 172.21.15.6:0/4225056087 shutdown_connections 2023-10-09T11:47:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.048+0000 7fc0a5910700 1 -- 172.21.15.6:0/4225056087 wait complete. 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.049+0000 7fc0a5910700 1 Processor -- start 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.049+0000 7fc0a5910700 1 -- start start 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 0x7fc0a00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0a0159b40 0x7fc0a014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00ca890 con 0x7fc0a0159f10 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00cab70 con 0x7fc0a0068cc0 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00c8d10 con 0x7fc0a0159b40 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47618/0 (socket says 172.21.15.6:47618) 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 -- 172.21.15.6:0/3990419535 learned_addr learned my addr 172.21.15.6:0/3990419535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc09ffff700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0a0159b40 0x7fc0a014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a490e700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 0x7fc0a00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 -- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0a0159b40 msgr2=0x7fc0a014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0a0159b40 0x7fc0a014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 -- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 msgr2=0x7fc0a00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 0x7fc0a00c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 -- 172.21.15.6:0/3990419535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009420 con 0x7fc0a0159f10 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a490e700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 0x7fc0a00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a510f700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc088001510 tx=0x7fc088001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088007360 con 0x7fc0a0159f10 2023-10-09T11:47:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880074c0 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088004830 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a00c8ff0 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.050+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a014da80 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.051+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00ce7c0 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.052+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc088004ba0 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.052+0000 7fc09cff9700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 0x7fc0800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.052+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc088083830 con 0x7fc0a0159f10 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.052+0000 7fc0a490e700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 0x7fc0800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.053+0000 7fc0a490e700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 0x7fc0800693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc098004040 tx=0x7fc098009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.056+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc088050b20 con 0x7fc0a0159f10 2023-10-09T11:47:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.296+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc0a0069120 con 0x7fc0a0159f10 2023-10-09T11:47:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.296+0000 7fc09cff9700 1 -- 172.21.15.6:0/3990419535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc0a0069120 con 0x7fc0a0159f10 2023-10-09T11:47:00.297 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 msgr2=0x7fc0800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 0x7fc0800693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc098004040 tx=0x7fc098009040 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 msgr2=0x7fc0a00c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc088001510 tx=0x7fc088001c10 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 shutdown_connections 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc080066f30 0x7fc0800693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0a0159f10 0x7fc0a00c9f20 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0a0068cc0 0x7fc0a00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 --2- 172.21.15.6:0/3990419535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0a0159b40 0x7fc0a014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 >> 172.21.15.6:0/3990419535 conn(0x7fc0a00cd660 msgr2=0x7fc0a006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 shutdown_connections 2023-10-09T11:47:00.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:00.298+0000 7fc0a5910700 1 -- 172.21.15.6:0/3990419535 wait complete. 2023-10-09T11:47:00.310 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:47:00.311 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:47:00.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.312 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-09T11:47:00.326 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-10-09T11:47:00.327 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41841sec preferred_lft 41841sec 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:00.328 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::3418:5dff:fe65:7f84/64 scope link 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 3a:ce:9d:f9:02:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:47:00.329 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::38ce:9dff:fef9:224/64 scope link 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ae:ab:6f:8d:ab:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::acab:6fff:fe8d:ab43/64 scope link 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:00.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.330 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:47:00.391 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-09T11:47:00.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.392 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-09T11:47:00.448 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-09T11:47:00.448 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:47:00.448 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T11:47:00.448 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T11:47:00.449 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:47:00.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T11:47:00.449 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-09T11:47:00.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.550 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:47:00.565 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:47:00.565 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:47:00.565 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:47:00.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-09T11:47:00.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:47:00.630 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T11:47:00.684 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T11:47:00.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:47:00.685 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:47:00.739 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-09T11:47:00.739 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:47:00.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:00.820 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:00.821 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:47:00.840 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:47:00.861 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:00.861 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:47:00.862 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:47:00.863 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:47:00.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:00.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T11:47:00.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T11:47:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.089+0000 7f564d29b700 1 Processor -- start 2023-10-09T11:47:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.089+0000 7f564d29b700 1 -- start start 2023-10-09T11:47:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f564d29b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f564815a2a0 0x7f56480b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f564d29b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b0ca0 con 0x7f564806dd60 2023-10-09T11:47:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f564d29b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b00d0 con 0x7f56480ceb30 2023-10-09T11:47:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f564d29b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564806e160 con 0x7f564815a2a0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5646ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f564815a2a0 0x7f56480b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f56477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f564806dd60 0x7f56480b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55850/0 (socket says 172.21.15.6:55850) 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f56477fe700 1 -- 172.21.15.6:0/1849537681 learned_addr learned my addr 172.21.15.6:0/1849537681 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5646ffd700 1 -- 172.21.15.6:0/1849537681 >> v1:172.21.15.118:6789/0 conn(0x7f56480ceb30 legacy=0x7f564806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5646ffd700 1 -- 172.21.15.6:0/1849537681 >> v1:172.21.15.6:6789/0 conn(0x7f564806dd60 legacy=0x7f56480b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5645ffb700 1 -- 172.21.15.6:0/1849537681 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285857898 0 0) 0x7f56480b0ca0 con 0x7f564806dd60 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5646ffd700 1 -- 172.21.15.6:0/1849537681 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480b0370 con 0x7f564815a2a0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5646ffd700 1 --2- 172.21.15.6:0/1849537681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564815a2a0 0x7f56480b1130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0bcc80c311f172 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5645ffb700 1 -- 172.21.15.6:0/1849537681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638009e80 con 0x7f564815a2a0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5645ffb700 1 -- 172.21.15.6:0/1849537681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800b860 con 0x7f564815a2a0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.090+0000 7f5645ffb700 1 -- 172.21.15.6:0/1849537681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800bbe0 con 0x7f564815a2a0 2023-10-09T11:47:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 -- 172.21.15.6:0/1849537681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564815a2a0 msgr2=0x7f56480b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 --2- 172.21.15.6:0/1849537681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564815a2a0 0x7f56480b1130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f56380098e0 tx=0x7f56380091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 -- 172.21.15.6:0/1849537681 shutdown_connections 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 --2- 172.21.15.6:0/1849537681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564815a2a0 0x7f56480b1130 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 -- 172.21.15.6:0/1849537681 >> 172.21.15.6:0/1849537681 conn(0x7f5648067640 msgr2=0x7f5648067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 -- 172.21.15.6:0/1849537681 shutdown_connections 2023-10-09T11:47:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.091+0000 7f564d29b700 1 -- 172.21.15.6:0/1849537681 wait complete. 2023-10-09T11:47:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.092+0000 7f564d29b700 1 Processor -- start 2023-10-09T11:47:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.092+0000 7f564d29b700 1 -- start start 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56480ceb30 0x7f564814f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 0x7f56480b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b3ff0 con 0x7f564806dd60 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b33e0 con 0x7f564815a2a0 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f564d29b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b36c0 con 0x7f56480ceb30 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f5646ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47632/0 (socket says 172.21.15.6:47632) 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f5646ffd700 1 -- 172.21.15.6:0/1782900311 learned_addr learned my addr 172.21.15.6:0/1782900311 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f56467fc700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56480ceb30 0x7f564814f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f56477fe700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 0x7f56480b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.093+0000 7f5646ffd700 1 -- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56480ceb30 msgr2=0x7f564814f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f5646ffd700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56480ceb30 0x7f564814f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f5646ffd700 1 -- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 msgr2=0x7f56480b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f5646ffd700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 0x7f56480b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f5646ffd700 1 -- 172.21.15.6:0/1782900311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009420 con 0x7f564806dd60 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f56477fe700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 0x7f56480b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f5646ffd700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f564806f990 tx=0x7f5638017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563801f070 con 0x7f564806dd60 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638000c90 con 0x7f564806dd60 2023-10-09T11:47:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638025420 con 0x7f564806dd60 2023-10-09T11:47:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480b39a0 con 0x7f564806dd60 2023-10-09T11:47:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.094+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564814fe90 con 0x7f564806dd60 2023-10-09T11:47:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.095+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648069e40 con 0x7f564806dd60 2023-10-09T11:47:01.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.095+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5638023070 con 0x7f564806dd60 2023-10-09T11:47:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.096+0000 7f562effd700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 0x7f56340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.096+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56380859b0 con 0x7f564806dd60 2023-10-09T11:47:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.096+0000 7f56467fc700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 0x7f56340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:01.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.096+0000 7f56467fc700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 0x7f56340693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f56480b2350 tx=0x7f563c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:01.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.100+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5638052c20 con 0x7f564806dd60 2023-10-09T11:47:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.338+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56480b42d0 con 0x7f564806dd60 2023-10-09T11:47:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.338+0000 7f562effd700 1 -- 172.21.15.6:0/1782900311 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5638015070 con 0x7f564806dd60 2023-10-09T11:47:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T11:47:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 msgr2=0x7f56340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 0x7f56340693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f56480b2350 tx=0x7f563c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 msgr2=0x7f56480b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f564806f990 tx=0x7f5638017000 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 shutdown_connections 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5634066f30 0x7f56340693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f564815a2a0 0x7f56480b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f564806dd60 0x7f56480b4480 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 --2- 172.21.15.6:0/1782900311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56480ceb30 0x7f564814f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 >> 172.21.15.6:0/1782900311 conn(0x7f5648067640 msgr2=0x7f56481502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 shutdown_connections 2023-10-09T11:47:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:01.340+0000 7f564d29b700 1 -- 172.21.15.6:0/1782900311 wait complete. 2023-10-09T11:47:01.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T11:47:01.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T11:47:01.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T11:47:01.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:47:01.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.353 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-10-09T11:47:01.371 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 41853sec preferred_lft 41853sec 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.372 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4c36:a1ff:fe04:3e64/64 scope link 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 12:9b:b7:79:83:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::109b:b7ff:fe79:8320/64 scope link 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 7a:b7:e9:e6:51:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:47:01.373 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::78b7:e9ff:fee6:515d/64 scope link 2023-10-09T11:47:01.374 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-10-09T11:47:01.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.374 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T11:47:01.437 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-10-09T11:47:01.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.439 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-10-09T11:47:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-10-09T11:47:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T11:47:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-09T11:47:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-09T11:47:01.496 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T11:47:01.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-09T11:47:01.497 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-10-09T11:47:01.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.599 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:47:01.614 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:47:01.614 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:47:01.614 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:47:01.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.614 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-10-09T11:47:01.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:47:01.678 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T11:47:01.733 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T11:47:01.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T11:47:01.733 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:47:01.787 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-09T11:47:01.787 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T11:47:01.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:47:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:47:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:47:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:47:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.118:3300,172.21.15.118:3301" 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with new device syntax: 1@7857a25d-47fa-49eb-8e61-2818cdc55761.cephfs=/ 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.118:3300/172.21.15.118:3301" will pass to kernel 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: v2 mount support check returned 2 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790" 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.118:6789,172.21.15.118:6790:/ 2023-10-09T11:47:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=7857a25d-47fa-49eb-8e61-2818cdc55761" will pass to kernel 2023-10-09T11:47:01.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T11:47:01.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:01.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T11:47:01.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:02.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.101+0000 7fdfadb0d700 1 Processor -- start 2023-10-09T11:47:02.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.101+0000 7fdfadb0d700 1 -- start start 2023-10-09T11:47:02.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfadb0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfa81578d0 0x7fdfa80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfadb0d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdfa806d120 0x7fdfa806d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfadb0d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa80d07c0 con 0x7fdfa8157ca0 2023-10-09T11:47:02.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfadb0d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa806da50 con 0x7fdfa81578d0 2023-10-09T11:47:02.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfadb0d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa80cfbb0 con 0x7fdfa806d120 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfa77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfa81578d0 0x7fdfa80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfa77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfa81578d0 0x7fdfa80cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47638/0 (socket says 172.21.15.6:47638) 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfa77fe700 1 -- 172.21.15.6:0/2289050257 learned_addr learned my addr 172.21.15.6:0/2289050257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.102+0000 7fdfa7fff700 1 --2- 172.21.15.6:0/2289050257 >> v2:172.21.15.118:3300/0 conn(0x7fdfa806d120 0x7fdfa806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa77fe700 1 -- 172.21.15.6:0/2289050257 >> v2:172.21.15.118:3300/0 conn(0x7fdfa806d120 msgr2=0x7fdfa806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa77fe700 1 --2- 172.21.15.6:0/2289050257 >> v2:172.21.15.118:3300/0 conn(0x7fdfa806d120 0x7fdfa806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa77fe700 1 -- 172.21.15.6:0/2289050257 >> v1:172.21.15.118:6789/0 conn(0x7fdfa8157ca0 legacy=0x7fdfa815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa77fe700 1 -- 172.21.15.6:0/2289050257 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80cfe90 con 0x7fdfa81578d0 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa77fe700 1 --2- 172.21.15.6:0/2289050257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa81578d0 0x7fdfa80cf4f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8068300 tx=0x7fdf98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165932f71add78f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa67fc700 1 -- 172.21.15.6:0/2289050257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98009e70 con 0x7fdfa81578d0 2023-10-09T11:47:02.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa67fc700 1 -- 172.21.15.6:0/2289050257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800b860 con 0x7fdfa81578d0 2023-10-09T11:47:02.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfa67fc700 1 -- 172.21.15.6:0/2289050257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800bc00 con 0x7fdfa81578d0 2023-10-09T11:47:02.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfadb0d700 1 -- 172.21.15.6:0/2289050257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa81578d0 msgr2=0x7fdfa80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/2289050257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa81578d0 0x7fdfa80cf4f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8068300 tx=0x7fdf98009250 comp rx=0 tx=0).stop 2023-10-09T11:47:02.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfadb0d700 1 -- 172.21.15.6:0/2289050257 shutdown_connections 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.103+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/2289050257 >> v2:172.21.15.118:3300/0 conn(0x7fdfa806d120 0x7fdfa806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.104+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/2289050257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa81578d0 0x7fdfa80cf4f0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.104+0000 7fdfadb0d700 1 -- 172.21.15.6:0/2289050257 >> 172.21.15.6:0/2289050257 conn(0x7fdfa806bb90 msgr2=0x7fdfa806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.104+0000 7fdfadb0d700 1 -- 172.21.15.6:0/2289050257 shutdown_connections 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.104+0000 7fdfadb0d700 1 -- 172.21.15.6:0/2289050257 wait complete. 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.105+0000 7fdfadb0d700 1 Processor -- start 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.105+0000 7fdfadb0d700 1 -- start start 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdfa81578d0 0x7fdfa80ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfa8157ca0 0x7fdfa81453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa816b530 con 0x7fdfa806d120 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80abd30 con 0x7fdfa8157ca0 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80aaa30 con 0x7fdfa81578d0 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47648/0 (socket says 172.21.15.6:47648) 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 -- 172.21.15.6:0/260284161 learned_addr learned my addr 172.21.15.6:0/260284161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa7fff700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfa8157ca0 0x7fdfa81453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa6ffd700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdfa81578d0 0x7fdfa80ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 -- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdfa81578d0 msgr2=0x7fdfa80ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdfa81578d0 0x7fdfa80ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 -- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfa8157ca0 msgr2=0x7fdfa81453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfa8157ca0 0x7fdfa81453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 -- 172.21.15.6:0/260284161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980094f0 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfa77fe700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdfa806fe20 tx=0x7fdf98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800bbe0 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98011420 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa80aad10 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf980117e0 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.106+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa80ab2d0 con 0x7fdfa806d120 2023-10-09T11:47:02.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.107+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa8067ac0 con 0x7fdfa806d120 2023-10-09T11:47:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.108+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf98011c10 con 0x7fdfa806d120 2023-10-09T11:47:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.108+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.108+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf98085da0 con 0x7fdfa806d120 2023-10-09T11:47:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.108+0000 7fdfa6ffd700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.109+0000 7fdfa6ffd700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdfa81580c0 tx=0x7fdf9c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.113+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf98053010 con 0x7fdfa806d120 2023-10-09T11:47:02.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.350+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfa80d0170 con 0x7fdfa806d120 2023-10-09T11:47:02.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.350+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/260284161 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fdf98056630 con 0x7fdfa806d120 2023-10-09T11:47:02.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:02.351 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 msgr2=0x7fdf940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fdfa81580c0 tx=0x7fdf9c007ec0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 msgr2=0x7fdfa80ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdfa806fe20 tx=0x7fdf98017000 comp rx=0 tx=0).stop 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 shutdown_connections 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdfa8157ca0 0x7fdfa81453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa806d120 0x7fdfa80ab7f0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 --2- 172.21.15.6:0/260284161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdfa81578d0 0x7fdfa80ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 >> 172.21.15.6:0/260284161 conn(0x7fdfa806bb90 msgr2=0x7fdfa81567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 shutdown_connections 2023-10-09T11:47:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.352+0000 7fdfadb0d700 1 -- 172.21.15.6:0/260284161 wait complete. 2023-10-09T11:47:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:02.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:47:02.502 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":8136,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.499958801,"mdsmap_epoch":92,"osdmap_epoch":178,"osdmap_epoch_barrier":178,"uptime":14.260489590000001} 2023-10-09T11:47:02.503 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 8136, "mdsmap_epoch": 92, "osdmap_epoch": 178, "osdmap_epoch_barrier": 178, "rank_uptime": 8.499958801, "state": "up:active", "uptime": 14.26048959, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:47:02.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-09T11:47:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.626+0000 7f63f33ee700 1 Processor -- start 2023-10-09T11:47:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.626+0000 7f63f33ee700 1 -- start start 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f33ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 0x7f63ec0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f33ee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0cadb0 con 0x7f63ec0cb240 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f33ee700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0cf000 con 0x7f63ec0b43c0 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f33ee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0cf2e0 con 0x7f63ec0cddd0 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f2bed700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f63ec0cb240 0x7f63ec0cb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55852/0 (socket says 172.21.15.6:55852) 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f2bed700 1 -- 172.21.15.6:0/3918749428 learned_addr learned my addr 172.21.15.6:0/3918749428 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f1beb700 1 --2- 172.21.15.6:0/3918749428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 0x7f63ec0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144436537 0 0) 0x7f63ec0cadb0 con 0x7f63ec0cb240 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d4003570 con 0x7f63ec0cb240 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745209896 0 0) 0x7f63ec0cf000 con 0x7f63ec0b43c0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.627+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ec0cadb0 con 0x7f63ec0b43c0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f1beb700 1 -- 172.21.15.6:0/3918749428 >> v1:172.21.15.118:6789/0 conn(0x7f63ec0b43c0 legacy=0x7f63ec0cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f1beb700 1 -- 172.21.15.6:0/3918749428 >> v1:172.21.15.6:6789/0 conn(0x7f63ec0cb240 legacy=0x7f63ec0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f1beb700 1 -- 172.21.15.6:0/3918749428 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0ca760 con 0x7f63ec0cddd0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f1beb700 1 --2- 172.21.15.6:0/3918749428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 0x7f63ec0cccc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009910 tx=0x7f63e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5546c0145abf617f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011630 con 0x7f63ec0cddd0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0011790 con 0x7f63ec0cddd0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f13ea700 1 -- 172.21.15.6:0/3918749428 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011b30 con 0x7f63ec0cddd0 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f33ee700 1 -- 172.21.15.6:0/3918749428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 msgr2=0x7f63ec0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.628+0000 7f63f33ee700 1 --2- 172.21.15.6:0/3918749428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 0x7f63ec0cccc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009910 tx=0x7f63e00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.629+0000 7f63f33ee700 1 -- 172.21.15.6:0/3918749428 shutdown_connections 2023-10-09T11:47:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.629+0000 7f63f33ee700 1 --2- 172.21.15.6:0/3918749428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cddd0 0x7f63ec0cccc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.629+0000 7f63f33ee700 1 -- 172.21.15.6:0/3918749428 >> 172.21.15.6:0/3918749428 conn(0x7f63ec068110 msgr2=0x7f63ec06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.629+0000 7f63f33ee700 1 -- 172.21.15.6:0/3918749428 shutdown_connections 2023-10-09T11:47:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.629+0000 7f63f33ee700 1 -- 172.21.15.6:0/3918749428 wait complete. 2023-10-09T11:47:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 Processor -- start 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 -- start start 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cb240 0x7f63ec15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63ec0cddd0 0x7f63ec0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec156bd0 con 0x7f63ec0b43c0 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c5b50 con 0x7f63ec0cddd0 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.630+0000 7f63f33ee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c74b0 con 0x7f63ec0cb240 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47662/0 (socket says 172.21.15.6:47662) 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 -- 172.21.15.6:0/1790751446 learned_addr learned my addr 172.21.15.6:0/1790751446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f2bed700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63ec0cddd0 0x7f63ec0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f1beb700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cb240 0x7f63ec15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 -- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cb240 msgr2=0x7f63ec15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cb240 0x7f63ec15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 -- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63ec0cddd0 msgr2=0x7f63ec0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63ec0cddd0 0x7f63ec0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 -- 172.21.15.6:0/1790751446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009420 con 0x7f63ec0b43c0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f23ec700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c790 tx=0x7f63e4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010510 con 0x7f63ec0b43c0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4010670 con 0x7f63ec0b43c0 2023-10-09T11:47:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec16bd30 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010a10 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.631+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec16c2f0 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.632+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec069c00 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.633+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63e401b3b0 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.633+0000 7f63ea7fc700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 0x7f63d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.633+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63e4083dd0 con 0x7f63ec0b43c0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.633+0000 7f63f1beb700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 0x7f63d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.634+0000 7f63f1beb700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 0x7f63d80693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009860 tx=0x7f63e0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.637+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e4051040 con 0x7f63ec0b43c0 2023-10-09T11:47:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:02.830+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f63ec071b10 con 0x7f63ec0b43c0 2023-10-09T11:47:03.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.049+0000 7f63ea7fc700 1 -- 172.21.15.6:0/1790751446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v179) v1 ==== 181+0+0 (secure 0 0 0) 0x7f63e40850c0 con 0x7f63ec0b43c0 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 msgr2=0x7f63d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 0x7f63d80693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009860 tx=0x7f63e0017000 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 msgr2=0x7f63ec0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c790 tx=0x7f63e4007e10 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 shutdown_connections 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f63d8066f30 0x7f63d80693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63ec0cddd0 0x7f63ec0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec0b43c0 0x7f63ec0c8020 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 --2- 172.21.15.6:0/1790751446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f63ec0cb240 0x7f63ec15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 >> 172.21.15.6:0/1790751446 conn(0x7f63ec068110 msgr2=0x7f63ec157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:03.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 shutdown_connections 2023-10-09T11:47:03.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.051+0000 7f63f33ee700 1 -- 172.21.15.6:0/1790751446 wait complete. 2023-10-09T11:47:03.053 INFO:teuthology.orchestra.run.smithi006.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-09T11:47:03.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-09T11:47:03.199 INFO:teuthology.orchestra.run.smithi006.stdout:{"osd_mon_report_interval":"5"} 2023-10-09T11:47:03.199 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-09T11:47:03.199 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-09T11:47:03.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:03.199 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-09T11:47:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:16+0 records in 2023-10-09T11:47:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:16+0 records out 2023-10-09T11:47:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0939811 s, 179 MB/s 2023-10-09T11:47:03.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:03.312 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-09T11:47:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:17+0 records in 2023-10-09T11:47:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:17+0 records out 2023-10-09T11:47:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0924005 s, 193 MB/s 2023-10-09T11:47:03.421 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-09T11:47:03.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:03.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.540+0000 7f18e359e700 1 Processor -- start 2023-10-09T11:47:03.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.540+0000 7f18e359e700 1 -- start start 2023-10-09T11:47:03.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e4159b40 0x7f18e40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e359e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18e4159f10 0x7f18e4068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e40cee10 con 0x7f18e40ccb40 2023-10-09T11:47:03.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e359e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e40cd040 con 0x7f18e4159f10 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40cd320 con 0x7f18e4159b40 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e2d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18e40ccb40 0x7f18e415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39196/0 (socket says 172.21.15.6:39196) 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e2d9d700 1 -- 172.21.15.6:0/2445356221 learned_addr learned my addr 172.21.15.6:0/2445356221 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2445356221 >> v2:172.21.15.118:3300/0 conn(0x7f18e4159f10 0x7f18e4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e259c700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e4159b40 0x7f18e40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516619664 0 0) 0x7f18e40cee10 con 0x7f18e40ccb40 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.541+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d0003570 con 0x7f18e40ccb40 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791919367 0 0) 0x7f18d0003570 con 0x7f18e40ccb40 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e4159b40 msgr2=0x7f18e40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e4159b40 0x7f18e40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2445356221 >> v1:172.21.15.6:6789/0 conn(0x7f18e40ccb40 legacy=0x7f18e415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2445356221 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40ce7c0 con 0x7f18e4159f10 2023-10-09T11:47:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e4068780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0098e0 tx=0x7f18cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42f1253abffd33e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40017f0 con 0x7f18e4159f10 2023-10-09T11:47:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc011420 con 0x7f18e4159f10 2023-10-09T11:47:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.542+0000 7f18e159a700 1 -- 172.21.15.6:0/2445356221 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0117c0 con 0x7f18e4159f10 2023-10-09T11:47:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 -- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 msgr2=0x7f18e4068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e4068780 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0098e0 tx=0x7f18cc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 -- 172.21.15.6:0/2445356221 shutdown_connections 2023-10-09T11:47:03.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e4159b40 0x7f18e40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 --2- 172.21.15.6:0/2445356221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e4068780 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 -- 172.21.15.6:0/2445356221 >> 172.21.15.6:0/2445356221 conn(0x7f18e40cd660 msgr2=0x7f18e40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 -- 172.21.15.6:0/2445356221 shutdown_connections 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.543+0000 7f18e359e700 1 -- 172.21.15.6:0/2445356221 wait complete. 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 Processor -- start 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 -- start start 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e40ccb40 0x7f18e415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e416e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4156e50 con 0x7f18e4159b40 2023-10-09T11:47:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40ca3b0 con 0x7f18e4159f10 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.544+0000 7f18e359e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4156800 con 0x7f18e40ccb40 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38746/0 (socket says 172.21.15.6:38746) 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2919124748 learned_addr learned my addr 172.21.15.6:0/2919124748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e2d9d700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e416e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e259c700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e40ccb40 0x7f18e415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e40ccb40 msgr2=0x7f18e415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e40ccb40 0x7f18e415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 msgr2=0x7f18e416e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e416e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 -- 172.21.15.6:0/2919124748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009420 con 0x7f18e4159b40 2023-10-09T11:47:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e1d9b700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0093f0 tx=0x7f18cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc01cb30 con 0x7f18e4159b40 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc01cc90 con 0x7f18e4159b40 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e4156ae0 con 0x7f18e4159b40 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc01a660 con 0x7f18e4159b40 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.545+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e416e790 con 0x7f18e4159b40 2023-10-09T11:47:03.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.546+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4156660 con 0x7f18e4159b40 2023-10-09T11:47:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.547+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18cc01aa90 con 0x7f18e4159b40 2023-10-09T11:47:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.547+0000 7f18da7fc700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 0x7f18c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.547+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18cc085ca0 con 0x7f18e4159b40 2023-10-09T11:47:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.547+0000 7f18e259c700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 0x7f18c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:03.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.548+0000 7f18e259c700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 0x7f18c40693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f18e40b5e70 tx=0x7f18dc0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.551+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e4156660 con 0x7f18e4159b40 2023-10-09T11:47:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.745+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f18e4156660 con 0x7f18e4159b40 2023-10-09T11:47:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.746+0000 7f18da7fc700 1 -- 172.21.15.6:0/2919124748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f18e4156660 con 0x7f18e4159b40 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 179, 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:03.044353+0000", 2023-10-09T11:47:03.747 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:03.748 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:03.749 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:03.750 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:03.751 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:03.752 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:03.753 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:03.754 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:03.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:03.756 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:03.757 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:03.758 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:03.759 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.760 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:03.761 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.762 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:03.763 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:03.764 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "179", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:03.765 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:03.766 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:03.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:03.768 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.769 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.772 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:03.777 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.778 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.779 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.781 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.782 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:03.783 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.785 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.790 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.797 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.799 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.800 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:03.801 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.803 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.804 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:03.807 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.823 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:03.829 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:03.831 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:03.832 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 msgr2=0x7f18c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 0x7f18c40693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f18e40b5e70 tx=0x7f18dc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 msgr2=0x7f18e415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0093f0 tx=0x7f18cc016000 comp rx=0 tx=0).stop 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 shutdown_connections 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f18c4066f30 0x7f18c40693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18e4159f10 0x7f18e416e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18e40ccb40 0x7f18e415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 --2- 172.21.15.6:0/2919124748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e4159b40 0x7f18e415a880 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.748+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 >> 172.21.15.6:0/2919124748 conn(0x7f18e40cd660 msgr2=0x7f18e40cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.749+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 shutdown_connections 2023-10-09T11:47:03.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:03.749+0000 7f18e359e700 1 -- 172.21.15.6:0/2919124748 wait complete. 2023-10-09T11:47:03.835 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:47:05.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:05.488 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:08.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.969+0000 7fa11bf7c700 1 Processor -- start 2023-10-09T11:47:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.969+0000 7fa11bf7c700 1 -- start start 2023-10-09T11:47:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11bf7c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa1140cf240 0x7fa1140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11bf7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa11406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11bf7c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140b0ca0 con 0x7fa11415a2a0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11bf7c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11406ea90 con 0x7fa1140cf240 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11bf7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140b00d0 con 0x7fa11406d650 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa119d18700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa11415a2a0 0x7fa1140ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39202/0 (socket says 172.21.15.6:39202) 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa119d18700 1 -- 172.21.15.6:0/307720984 learned_addr learned my addr 172.21.15.6:0/307720984 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa11a519700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa11406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa119517700 1 --2- 172.21.15.6:0/307720984 >> v2:172.21.15.118:3300/0 conn(0x7fa1140cf240 0x7fa1140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460147302 0 0) 0x7fa1140b0ca0 con 0x7fa11415a2a0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa100003570 con 0x7fa11415a2a0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902315840 0 0) 0x7fa100003570 con 0x7fa11415a2a0 2023-10-09T11:47:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 msgr2=0x7fa11406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa11406da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 >> v2:172.21.15.118:3300/0 conn(0x7fa1140cf240 msgr2=0x7fa1140b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 --2- 172.21.15.6:0/307720984 >> v2:172.21.15.118:3300/0 conn(0x7fa1140cf240 0x7fa1140b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140b0370 con 0x7fa11415a2a0 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fa110001470 con 0x7fa11415a2a0 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.970+0000 7fa119517700 1 --2- 172.21.15.6:0/307720984 >> v2:172.21.15.118:3300/0 conn(0x7fa1140cf240 0x7fa1140b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 >> v1:172.21.15.6:6789/0 conn(0x7fa11415a2a0 legacy=0x7fa1140ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa100003a60 0x7fa100003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa100004810 0x7fa100004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa1000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406ea90 con 0x7fa100003a60 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140b00d0 con 0x7fa100004810 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10000ba60 con 0x7fa11406d650 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa100003a60 0x7fa100003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa11a519700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa1000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119517700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa100004810 0x7fa100004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 -- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 msgr2=0x7fa1000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa11406d650 0x7fa1000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 -- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa100004810 msgr2=0x7fa100004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa100004810 0x7fa100004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 -- 172.21.15.6:0/307720984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100003570 con 0x7fa100003a60 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa119d18700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa100003a60 0x7fa100003e70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c3f0 tx=0x7fa110001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83315dfaaf5eac06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11000cc80 con 0x7fa100003a60 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11000ce20 con 0x7fa100003a60 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.971+0000 7fa118d16700 1 -- 172.21.15.6:0/307720984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110005b70 con 0x7fa100003a60 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 -- 172.21.15.6:0/307720984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa100003a60 msgr2=0x7fa100003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/307720984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa100003a60 0x7fa100003e70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c3f0 tx=0x7fa110001e90 comp rx=0 tx=0).stop 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11a519700 1 -- 172.21.15.6:0/307720984 reap_dead start 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 -- 172.21.15.6:0/307720984 shutdown_connections 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 -- 172.21.15.6:0/307720984 >> 172.21.15.6:0/307720984 conn(0x7fa114067640 msgr2=0x7fa114067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 -- 172.21.15.6:0/307720984 shutdown_connections 2023-10-09T11:47:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.972+0000 7fa11bf7c700 1 -- 172.21.15.6:0/307720984 wait complete. 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.973+0000 7fa11bf7c700 1 Processor -- start 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.973+0000 7fa11bf7c700 1 -- start start 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa100003a60 0x7fa11414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1140b2b40 0x7fa1140b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11415e250 con 0x7fa11415d8a0 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140b1b30 con 0x7fa1140b2b40 2023-10-09T11:47:08.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11bf7c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1140b1d80 con 0x7fa100003a60 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38778/0 (socket says 172.21.15.6:38778) 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 -- 172.21.15.6:0/3233868446 learned_addr learned my addr 172.21.15.6:0/3233868446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa119d18700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa100003a60 0x7fa11414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa119517700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1140b2b40 0x7fa1140b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 -- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa100003a60 msgr2=0x7fa11414ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa100003a60 0x7fa11414ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 -- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1140b2b40 msgr2=0x7fa1140b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1140b2b40 0x7fa1140b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.974+0000 7fa11a519700 1 -- 172.21.15.6:0/3233868446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140b2060 con 0x7fa11415d8a0 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa11a519700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa11406ab90 tx=0x7fa10c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00e040 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00f040 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00fe20 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1140b2340 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.975+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114150520 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.976+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1140b2860 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.976+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa10c015640 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.977+0000 7fa109ffb700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 0x7fa0f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.977+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa10c084ee0 con 0x7fa11415d8a0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.977+0000 7fa119d18700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 0x7fa0f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.977+0000 7fa119d18700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 0x7fa0f80693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c3f0 tx=0x7fa110015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:08.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:08.981+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1140b2860 con 0x7fa11415d8a0 2023-10-09T11:47:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.177+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa1140b2860 con 0x7fa11415d8a0 2023-10-09T11:47:09.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.178+0000 7fa109ffb700 1 -- 172.21.15.6:0/3233868446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v179) v1 ==== 81+0+32234 (secure 0 0 0) 0x7fa1140b2860 con 0x7fa11415d8a0 2023-10-09T11:47:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:09.178 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 179, 2023-10-09T11:47:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:03.044353+0000", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "179", 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.234 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.236 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.240 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:09.242 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:09.243 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.244 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:09.247 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.251 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.252 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:09.255 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:09.256 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 msgr2=0x7fa0f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 0x7fa0f80693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa11000c3f0 tx=0x7fa110015000 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 msgr2=0x7fa11415dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa11406ab90 tx=0x7fa10c00b040 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 shutdown_connections 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa0f8066f30 0x7fa0f80693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa11415d8a0 0x7fa11415dd10 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa100003a60 0x7fa11414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 --2- 172.21.15.6:0/3233868446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1140b2b40 0x7fa1140b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 >> 172.21.15.6:0/3233868446 conn(0x7fa114067640 msgr2=0x7fa114067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:09.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 shutdown_connections 2023-10-09T11:47:09.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:09.180+0000 7fa11bf7c700 1 -- 172.21.15.6:0/3233868446 wait complete. 2023-10-09T11:47:09.260 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:47:14.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.394+0000 7f5cac4be700 1 Processor -- start 2023-10-09T11:47:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.394+0000 7f5cac4be700 1 -- start start 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5cac4be700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ca4157ca0 0x7f5ca40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5cac4be700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5cac4be700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40d07c0 con 0x7f5ca41578d0 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5cac4be700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca406daa0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5cac4be700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40cfbb0 con 0x7f5ca406d120 2023-10-09T11:47:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5ca9a59700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5ca4157ca0 0x7f5ca40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5caa25a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ca41578d0 0x7f5ca415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49768/0 (socket says 172.21.15.6:49768) 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.395+0000 7f5caa25a700 1 -- 172.21.15.6:0/250584266 learned_addr learned my addr 172.21.15.6:0/250584266 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5caaa5b700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9a59700 1 -- 172.21.15.6:0/250584266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 msgr2=0x7f5ca406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9a59700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9a59700 1 -- 172.21.15.6:0/250584266 >> v1:172.21.15.6:6789/0 conn(0x7f5ca41578d0 legacy=0x7f5ca415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9a59700 1 -- 172.21.15.6:0/250584266 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40cfe90 con 0x7f5ca4157ca0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9258700 1 -- 172.21.15.6:0/250584266 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655764665 0 0) 0x7f5ca40d07c0 con 0x7f5ca41578d0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9a59700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca40cf4f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5c980098e0 tx=0x7f5c980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40106d516cb154b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9258700 1 -- 172.21.15.6:0/250584266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98009e80 con 0x7f5ca4157ca0 2023-10-09T11:47:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9258700 1 -- 172.21.15.6:0/250584266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800b860 con 0x7f5ca4157ca0 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.396+0000 7f5ca9258700 1 -- 172.21.15.6:0/250584266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800bbe0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 -- 172.21.15.6:0/250584266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 msgr2=0x7f5ca40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca40cf4f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5c980098e0 tx=0x7f5c980091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 -- 172.21.15.6:0/250584266 shutdown_connections 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca406d120 0x7f5ca406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 --2- 172.21.15.6:0/250584266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca40cf4f0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 -- 172.21.15.6:0/250584266 >> 172.21.15.6:0/250584266 conn(0x7f5ca406bb90 msgr2=0x7f5ca406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 -- 172.21.15.6:0/250584266 shutdown_connections 2023-10-09T11:47:14.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.397+0000 7f5cac4be700 1 -- 172.21.15.6:0/250584266 wait complete. 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.398+0000 7f5cac4be700 1 Processor -- start 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.398+0000 7f5cac4be700 1 -- start start 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca406d120 0x7f5ca40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca41578d0 0x7f5ca40b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca416d5e0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca416d7f0 con 0x7f5ca406d120 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5cac4be700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca416dad0 con 0x7f5ca41578d0 2023-10-09T11:47:14.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40170/0 (socket says 172.21.15.6:40170) 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 -- 172.21.15.6:0/3776776609 learned_addr learned my addr 172.21.15.6:0/3776776609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5ca9a59700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca41578d0 0x7f5ca40b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caa25a700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca406d120 0x7f5ca40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 -- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca41578d0 msgr2=0x7f5ca40b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca41578d0 0x7f5ca40b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 -- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca406d120 msgr2=0x7f5ca40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca406d120 0x7f5ca40b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009420 con 0x7f5ca4157ca0 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5caaa5b700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009fa0 tx=0x7f5c94009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:14.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.399+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400eb60 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.400+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400ecc0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.400+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca416ddb0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.400+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94014670 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.400+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4154330 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.401+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca416e2d0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.401+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c940149e0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.401+0000 7f5ca27fc700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.402+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c94084b70 con 0x7f5ca4157ca0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.402+0000 7f5caa25a700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:14.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.402+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f5c9006ea50 con 0x7f5ca4157ca0 2023-10-09T11:47:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.402+0000 7f5caa25a700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007fd0 tx=0x7f5c9c007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:14.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.406+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca416e2d0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.601+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5ca416e2d0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.602+0000 7f5ca27fc700 1 -- 172.21.15.6:0/3776776609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f5ca416e2d0 con 0x7f5ca4157ca0 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 180, 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:10.986370+0000", 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "180", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:14.686 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 msgr2=0x7f5c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c007fd0 tx=0x7f5c9c007d30 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 msgr2=0x7f5ca41580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009fa0 tx=0x7f5c94009900 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 shutdown_connections 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5c90066f30 0x7f5c900693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ca4157ca0 0x7f5ca41580f0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ca406d120 0x7f5ca40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 --2- 172.21.15.6:0/3776776609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ca41578d0 0x7f5ca40b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 >> 172.21.15.6:0/3776776609 conn(0x7f5ca406bb90 msgr2=0x7f5ca4070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 shutdown_connections 2023-10-09T11:47:14.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:14.604+0000 7f5cac4be700 1 -- 172.21.15.6:0/3776776609 wait complete. 2023-10-09T11:47:14.689 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T11:47:14.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:14.689 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-09T11:47:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-09T11:47:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:47:14.940 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:47:14.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.232262 s, 226 MB/s 2023-10-09T11:47:14.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.070+0000 7fafb032a700 1 Processor -- start 2023-10-09T11:47:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.070+0000 7fafb032a700 1 -- start start 2023-10-09T11:47:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.071+0000 7fafb032a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa8157fe0 0x7fafa80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.071+0000 7fafb032a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafa80cf240 0x7fafa80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.071+0000 7fafb032a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa80b2890 con 0x7fafa81583b0 2023-10-09T11:47:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.071+0000 7fafb032a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa80b4070 con 0x7fafa80cf240 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.071+0000 7fafb032a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80b4350 con 0x7fafa8157fe0 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafa80cf240 0x7fafa80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafa80cf240 0x7fafa80b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40176/0 (socket says 172.21.15.6:40176) 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 -- 172.21.15.6:0/4071472765 learned_addr learned my addr 172.21.15.6:0/4071472765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae0c6700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa8157fe0 0x7fafa80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 -- 172.21.15.6:0/4071472765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa8157fe0 msgr2=0x7fafa80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa8157fe0 0x7fafa80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 -- 172.21.15.6:0/4071472765 >> v1:172.21.15.118:6789/0 conn(0x7fafa81583b0 legacy=0x7fafa80ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 -- 172.21.15.6:0/4071472765 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80b4630 con 0x7fafa80cf240 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafae8c7700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa80cf240 0x7fafa80b3a00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009f20 tx=0x7fafa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0f52dc91d8e2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafad0c4700 1 -- 172.21.15.6:0/4071472765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa000e070 con 0x7fafa80cf240 2023-10-09T11:47:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafad0c4700 1 -- 172.21.15.6:0/4071472765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa000b9d0 con 0x7fafa80cf240 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.072+0000 7fafad0c4700 1 -- 172.21.15.6:0/4071472765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00092e0 con 0x7fafa80cf240 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 -- 172.21.15.6:0/4071472765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa80cf240 msgr2=0x7fafa80b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa80cf240 0x7fafa80b3a00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009f20 tx=0x7fafa0009840 comp rx=0 tx=0).stop 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 -- 172.21.15.6:0/4071472765 shutdown_connections 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa80cf240 0x7fafa80b3a00 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 --2- 172.21.15.6:0/4071472765 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa8157fe0 0x7fafa80b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 -- 172.21.15.6:0/4071472765 >> 172.21.15.6:0/4071472765 conn(0x7fafa8067640 msgr2=0x7fafa8067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 -- 172.21.15.6:0/4071472765 shutdown_connections 2023-10-09T11:47:15.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.073+0000 7fafb032a700 1 -- 172.21.15.6:0/4071472765 wait complete. 2023-10-09T11:47:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.074+0000 7fafb032a700 1 Processor -- start 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.074+0000 7fafb032a700 1 -- start start 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa80cf240 0x7fafa80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa81583b0 0x7fafa815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80c7c10 con 0x7fafa8157fe0 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8169900 con 0x7fafa80cf240 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafb032a700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8169be0 con 0x7fafa81583b0 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40184/0 (socket says 172.21.15.6:40184) 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 -- 172.21.15.6:0/198904815 learned_addr learned my addr 172.21.15.6:0/198904815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafae0c6700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa80cf240 0x7fafa80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafae8c7700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa81583b0 0x7fafa815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 -- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa81583b0 msgr2=0x7fafa815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa81583b0 0x7fafa815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 -- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa80cf240 msgr2=0x7fafa80c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa80cf240 0x7fafa80c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0009ae0 con 0x7fafa8157fe0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.075+0000 7fafad8c5700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7faf9800c590 tx=0x7faf9800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.076+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011590 con 0x7fafa8157fe0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.076+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98011710 con 0x7fafa8157fe0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.076+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa8169ec0 con 0x7fafa8157fe0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.076+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011ad0 con 0x7fafa8157fe0 2023-10-09T11:47:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.076+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa816a480 con 0x7fafa8157fe0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.077+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa816a670 con 0x7fafa8157fe0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.077+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf9801b3b0 con 0x7fafa8157fe0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.077+0000 7faf9e7fc700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 0x7faf8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.077+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf980839a0 con 0x7fafa8157fe0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.077+0000 7fafae0c6700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 0x7faf8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.078+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7faf8c06ea50 con 0x7fafa8157fe0 2023-10-09T11:47:15.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.078+0000 7fafae0c6700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 0x7faf8c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fafa80ce9c0 tx=0x7fafa40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.082+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf98017070 con 0x7fafa8157fe0 2023-10-09T11:47:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.274+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fafa80b0e50 con 0x7fafa8157fe0 2023-10-09T11:47:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.275+0000 7faf9e7fc700 1 -- 172.21.15.6:0/198904815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) v1 ==== 81+0+32253 (secure 0 0 0) 0x7faf98050c10 con 0x7fafa8157fe0 2023-10-09T11:47:15.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 180, 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:10.986370+0000", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:15.276 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:15.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:15.278 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:15.279 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:15.280 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:15.282 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:15.283 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:15.285 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:15.287 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:15.288 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:15.290 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:15.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:15.292 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:15.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "180", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:15.294 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:15.295 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:15.296 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:15.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:15.299 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.301 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:15.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.305 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.306 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:15.307 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.308 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:15.311 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.312 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.314 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.315 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:15.317 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.318 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:15.319 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.321 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.322 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:15.323 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.325 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.328 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.329 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:15.331 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:15.334 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:15.341 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.342 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:15.344 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:15.345 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:15.347 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.348 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.349 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:15.350 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:15.351 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.352 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:15.356 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:15.357 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:15.358 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:15.359 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:15.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 msgr2=0x7faf8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 0x7faf8c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fafa80ce9c0 tx=0x7fafa40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 msgr2=0x7fafa8143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7faf9800c590 tx=0x7faf9800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 shutdown_connections 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faf8c066f30 0x7faf8c0693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafa81583b0 0x7fafa815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafa80cf240 0x7fafa80c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 --2- 172.21.15.6:0/198904815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafa8157fe0 0x7fafa8143700 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 >> 172.21.15.6:0/198904815 conn(0x7fafa8067640 msgr2=0x7fafa80ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:15.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 shutdown_connections 2023-10-09T11:47:15.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.277+0000 7fafb032a700 1 -- 172.21.15.6:0/198904815 wait complete. 2023-10-09T11:47:15.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:15.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.481+0000 7facf932f700 1 Processor -- start 2023-10-09T11:47:15.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.481+0000 7facf932f700 1 -- start start 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf932f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facf4159b40 0x7facf40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf932f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf932f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf40cee10 con 0x7facf4159f10 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf932f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf40cd040 con 0x7facf4159b40 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf932f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40cd320 con 0x7facf4068e90 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf3fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facf4159b40 0x7facf40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf37fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7facf4159f10 0x7facf4068780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:44864/0 (socket says 172.21.15.6:44864) 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf8b2e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf37fe700 1 -- 172.21.15.6:0/391190677 learned_addr learned my addr 172.21.15.6:0/391190677 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf3fff700 1 -- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 msgr2=0x7facf40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf3fff700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.482+0000 7facf3fff700 1 -- 172.21.15.6:0/391190677 >> v1:172.21.15.118:6789/0 conn(0x7facf4159f10 legacy=0x7facf4068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf2ffd700 1 -- 172.21.15.6:0/391190677 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953667554 0 0) 0x7facf40cee10 con 0x7facf4159f10 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf3fff700 1 -- 172.21.15.6:0/391190677 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40ce7c0 con 0x7facf4159b40 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf8b2e700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf3fff700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159b40 0x7facf40cc600 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7face40098e0 tx=0x7face40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c09515bbf55b222 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf2ffd700 1 -- 172.21.15.6:0/391190677 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400b640 con 0x7facf4159b40 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf2ffd700 1 -- 172.21.15.6:0/391190677 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400b7a0 con 0x7facf4159b40 2023-10-09T11:47:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf2ffd700 1 -- 172.21.15.6:0/391190677 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400bb40 con 0x7facf4159b40 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 -- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159b40 msgr2=0x7facf40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159b40 0x7facf40cc600 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7face40098e0 tx=0x7face40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 -- 172.21.15.6:0/391190677 shutdown_connections 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 --2- 172.21.15.6:0/391190677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159b40 0x7facf40cc600 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.483+0000 7facf932f700 1 -- 172.21.15.6:0/391190677 >> 172.21.15.6:0/391190677 conn(0x7facf40cd660 msgr2=0x7facf40cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.484+0000 7facf932f700 1 -- 172.21.15.6:0/391190677 shutdown_connections 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.484+0000 7facf932f700 1 -- 172.21.15.6:0/391190677 wait complete. 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.485+0000 7facf932f700 1 Processor -- start 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.485+0000 7facf932f700 1 -- start start 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.485+0000 7facf932f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf416b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.485+0000 7facf932f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.485+0000 7facf932f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159f10 0x7facf4157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf932f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4155d50 con 0x7facf4159b40 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf932f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4156030 con 0x7facf4159f10 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf932f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4156310 con 0x7facf4068e90 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40194/0 (socket says 172.21.15.6:40194) 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf3fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf416b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 -- 172.21.15.6:0/2052572747 learned_addr learned my addr 172.21.15.6:0/2052572747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf8b2e700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159f10 0x7facf4157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 -- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 msgr2=0x7facf416b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf416b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 -- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159f10 msgr2=0x7facf4157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159f10 0x7facf4157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009a20 con 0x7facf4159b40 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf37fe700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7face800c5b0 tx=0x7face8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8005b30 con 0x7facf4159b40 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8005c90 con 0x7facf4159b40 2023-10-09T11:47:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4009420 con 0x7facf4159b40 2023-10-09T11:47:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8007300 con 0x7facf4159b40 2023-10-09T11:47:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.486+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf41568d0 con 0x7facf4159b40 2023-10-09T11:47:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.487+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4156af0 con 0x7facf4159b40 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.488+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face801b3b0 con 0x7facf4159b40 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.488+0000 7facdbfff700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.488+0000 7facf3fff700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.488+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7face8083960 con 0x7facf4159b40 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.489+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7face006ea50 con 0x7facf4159b40 2023-10-09T11:47:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.489+0000 7facf3fff700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7face40091e0 tx=0x7face4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:15.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.493+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face8017060 con 0x7facf4159b40 2023-10-09T11:47:15.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.732+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facf40cb890 con 0x7facf4159b40 2023-10-09T11:47:15.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.733+0000 7facdbfff700 1 -- 172.21.15.6:0/2052572747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7face8050bd0 con 0x7facf4159b40 2023-10-09T11:47:15.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:15.734 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:15.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 msgr2=0x7face00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7face40091e0 tx=0x7face4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 msgr2=0x7facf40c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7face800c5b0 tx=0x7face8001070 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 shutdown_connections 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf4159f10 0x7facf4157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7facf4068e90 0x7facf416b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 --2- 172.21.15.6:0/2052572747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4159b40 0x7facf40c9290 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 >> 172.21.15.6:0/2052572747 conn(0x7facf40cd660 msgr2=0x7facf406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 shutdown_connections 2023-10-09T11:47:15.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:15.735+0000 7facf932f700 1 -- 172.21.15.6:0/2052572747 wait complete. 2023-10-09T11:47:15.737 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:15.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:47:15.885 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":8136,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.882707587999999,"mdsmap_epoch":92,"osdmap_epoch":180,"osdmap_epoch_barrier":180,"uptime":27.643237893999999} 2023-10-09T11:47:15.885 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 8136, "mdsmap_epoch": 92, "osdmap_epoch": 180, "osdmap_epoch_barrier": 180, "rank_uptime": 21.882707588, "state": "up:active", "uptime": 27.643237894, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:47:15.885 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:47:15.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:15.886 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-09T11:47:15.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:15.902 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-09T11:47:15.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:16.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.124+0000 7f8c35abd700 1 Processor -- start 2023-10-09T11:47:16.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 -- start start 2023-10-09T11:47:16.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c301578d0 0x7f8c300cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30157ca0 0x7f8c3015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c300d07c0 con 0x7f8c3006d120 2023-10-09T11:47:16.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300cfbb0 con 0x7f8c301578d0 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c35abd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300cfe90 con 0x7f8c30157ca0 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.125+0000 7f8c2ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c3006d120 0x7f8c3015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49770/0 (socket says 172.21.15.6:49770) 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c301578d0 0x7f8c300cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2ffff700 1 -- 172.21.15.6:0/1453684008 learned_addr learned my addr 172.21.15.6:0/1453684008 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2effd700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30157ca0 0x7f8c3015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2e7fc700 1 -- 172.21.15.6:0/1453684008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917806450 0 0) 0x7f8c300d07c0 con 0x7f8c3006d120 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2e7fc700 1 -- 172.21.15.6:0/1453684008 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c18003570 con 0x7f8c3006d120 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/1453684008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30157ca0 msgr2=0x7f8c3015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30157ca0 0x7f8c3015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/1453684008 >> v1:172.21.15.6:6789/0 conn(0x7f8c3006d120 legacy=0x7f8c3015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/1453684008 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c300d0170 con 0x7f8c301578d0 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2f7fe700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c301578d0 0x7f8c300cf4f0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098e0 tx=0x7f8c200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ad5f7fc9fcd03b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2e7fc700 1 -- 172.21.15.6:0/1453684008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011630 con 0x7f8c301578d0 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2e7fc700 1 -- 172.21.15.6:0/1453684008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20011790 con 0x7f8c301578d0 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.126+0000 7f8c2e7fc700 1 -- 172.21.15.6:0/1453684008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011b10 con 0x7f8c301578d0 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 -- 172.21.15.6:0/1453684008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c301578d0 msgr2=0x7f8c300cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c301578d0 0x7f8c300cf4f0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8c200098e0 tx=0x7f8c200091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 -- 172.21.15.6:0/1453684008 shutdown_connections 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c301578d0 0x7f8c300cf4f0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 --2- 172.21.15.6:0/1453684008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30157ca0 0x7f8c3015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 -- 172.21.15.6:0/1453684008 >> 172.21.15.6:0/1453684008 conn(0x7f8c3006bb90 msgr2=0x7f8c3006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 -- 172.21.15.6:0/1453684008 shutdown_connections 2023-10-09T11:47:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.127+0000 7f8c35abd700 1 -- 172.21.15.6:0/1453684008 wait complete. 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.128+0000 7f8c35abd700 1 Processor -- start 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.128+0000 7f8c35abd700 1 -- start start 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c301578d0 0x7f8c30153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 0x7f8c300ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3016a690 con 0x7f8c3006d120 2023-10-09T11:47:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300b2790 con 0x7f8c30157ca0 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c35abd700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300abf00 con 0x7f8c301578d0 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40214/0 (socket says 172.21.15.6:40214) 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/3604667358 learned_addr learned my addr 172.21.15.6:0/3604667358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2ffff700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 0x7f8c300ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2effd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c301578d0 0x7f8c30153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c301578d0 msgr2=0x7f8c30153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c301578d0 0x7f8c30153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 msgr2=0x7f8c300ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 0x7f8c300ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009420 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2ffff700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 0x7f8c300ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.129+0000 7f8c2f7fe700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009ed0 tx=0x7f8c20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.130+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011900 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.130+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20011a60 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.130+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2001a680 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.130+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3016aec0 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.130+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3016a870 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.131+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30067ac0 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.131+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c2001aa30 con 0x7f8c3006d120 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.132+0000 7f8c177fe700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.132+0000 7f8c2effd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.132+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c20086090 con 0x7f8c3006d120 2023-10-09T11:47:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.132+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f8c1c06ea50 con 0x7f8c3006d120 2023-10-09T11:47:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.132+0000 7f8c2effd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 0x7f8c1c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c301593e0 tx=0x7f8c240091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.136+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c20053300 con 0x7f8c3006d120 2023-10-09T11:47:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.335+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8c300d0450 con 0x7f8c3006d120 2023-10-09T11:47:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.336+0000 7f8c177fe700 1 -- 172.21.15.6:0/3604667358 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) v1 ==== 81+0+32253 (secure 0 0 0) 0x7f8c20015020 con 0x7f8c3006d120 2023-10-09T11:47:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 180, 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:10.986370+0000", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "180", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:16.417 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 msgr2=0x7f8c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 0x7f8c1c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c301593e0 tx=0x7f8c240091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 msgr2=0x7f8c30153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009ed0 tx=0x7f8c20017000 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 shutdown_connections 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30157ca0 0x7f8c300ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3006d120 0x7f8c30153a40 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 --2- 172.21.15.6:0/3604667358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c301578d0 0x7f8c30153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 >> 172.21.15.6:0/3604667358 conn(0x7f8c3006bb90 msgr2=0x7f8c30155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 shutdown_connections 2023-10-09T11:47:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:16.338+0000 7f8c35abd700 1 -- 172.21.15.6:0/3604667358 wait complete. 2023-10-09T11:47:16.420 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:47:21.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.553+0000 7ff79759e700 1 Processor -- start 2023-10-09T11:47:21.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.553+0000 7ff79759e700 1 -- start start 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff798157860 0x7ff79806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7980ce270 0x7ff79815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980cbec0 con 0x7ff79806a020 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980cb9d0 con 0x7ff7980ce270 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79815b2d0 con 0x7ff798157860 2023-10-09T11:47:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7980ce270 0x7ff79815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff795d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff79806a020 0x7ff7980cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49782/0 (socket says 172.21.15.6:49782) 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7980ce270 0x7ff79815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40230/0 (socket says 172.21.15.6:40230) 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff795d9b700 1 -- 172.21.15.6:0/3999272691 learned_addr learned my addr 172.21.15.6:0/3999272691 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79659c700 1 --2- 172.21.15.6:0/3999272691 >> v2:172.21.15.118:3300/0 conn(0x7ff798157860 0x7ff79806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 -- 172.21.15.6:0/3999272691 >> v2:172.21.15.118:3300/0 conn(0x7ff798157860 msgr2=0x7ff79806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 --2- 172.21.15.6:0/3999272691 >> v2:172.21.15.118:3300/0 conn(0x7ff798157860 0x7ff79806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 -- 172.21.15.6:0/3999272691 >> v1:172.21.15.6:6789/0 conn(0x7ff79806a020 legacy=0x7ff7980cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff79559a700 1 -- 172.21.15.6:0/3999272691 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882747267 0 0) 0x7ff7980cbec0 con 0x7ff79806a020 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.554+0000 7ff796d9d700 1 -- 172.21.15.6:0/3999272691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980cc180 con 0x7ff7980ce270 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff796d9d700 1 --2- 172.21.15.6:0/3999272691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff79815a300 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff798068620 tx=0x7ff7900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94547388978aa2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79559a700 1 -- 172.21.15.6:0/3999272691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790009e80 con 0x7ff7980ce270 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79559a700 1 -- 172.21.15.6:0/3999272691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000b820 con 0x7ff7980ce270 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79559a700 1 -- 172.21.15.6:0/3999272691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000bba0 con 0x7ff7980ce270 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 -- 172.21.15.6:0/3999272691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 msgr2=0x7ff79815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 --2- 172.21.15.6:0/3999272691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff79815a300 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ff798068620 tx=0x7ff7900091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 -- 172.21.15.6:0/3999272691 shutdown_connections 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 --2- 172.21.15.6:0/3999272691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff79815a300 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 --2- 172.21.15.6:0/3999272691 >> v2:172.21.15.118:3300/0 conn(0x7ff798157860 0x7ff79806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.555+0000 7ff79759e700 1 -- 172.21.15.6:0/3999272691 >> 172.21.15.6:0/3999272691 conn(0x7ff798063230 msgr2=0x7ff798063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.556+0000 7ff79759e700 1 -- 172.21.15.6:0/3999272691 shutdown_connections 2023-10-09T11:47:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.556+0000 7ff79759e700 1 -- 172.21.15.6:0/3999272691 wait complete. 2023-10-09T11:47:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 Processor -- start 2023-10-09T11:47:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 -- start start 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 0x7ff7980b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff798157860 0x7ff798155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980b1800 con 0x7ff7980ce270 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79815d540 con 0x7ff79806a020 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff79759e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980b0f60 con 0x7ff798157860 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.557+0000 7ff795d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40244/0 (socket says 172.21.15.6:40244) 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 -- 172.21.15.6:0/2385710296 learned_addr learned my addr 172.21.15.6:0/2385710296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff79659c700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 0x7ff7980b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff796d9d700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff798157860 0x7ff798155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 -- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff798157860 msgr2=0x7ff798155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff798157860 0x7ff798155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 -- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 msgr2=0x7ff7980b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 0x7ff7980b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009420 con 0x7ff7980ce270 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff79659c700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 0x7ff7980b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff795d9b700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c7e0 tx=0x7ff780007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780005b30 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780005c90 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980b1240 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780007300 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.558+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff798156300 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.559+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79815d6b0 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.559+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff78001b400 con 0x7ff7980ce270 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.560+0000 7ff78e7fc700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.560+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff780084020 con 0x7ff7980ce270 2023-10-09T11:47:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.560+0000 7ff79659c700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.560+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7ff77806ea50 con 0x7ff7980ce270 2023-10-09T11:47:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.560+0000 7ff79659c700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 0x7ff7780693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff788009fd0 tx=0x7ff788009740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.564+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7800513c0 con 0x7ff7980ce270 2023-10-09T11:47:21.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.759+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff798071b10 con 0x7ff7980ce270 2023-10-09T11:47:21.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.760+0000 7ff78e7fc700 1 -- 172.21.15.6:0/2385710296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v180) v1 ==== 81+0+32253 (secure 0 0 0) 0x7ff780007730 con 0x7ff7980ce270 2023-10-09T11:47:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:21.762 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 180, 2023-10-09T11:47:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:10.986370+0000", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1027, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "180", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.813 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.815 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.816 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.817 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:21.821 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.822 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:21.823 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.825 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:21.827 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:21.829 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:21.830 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.831 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:21.833 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:21.834 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.835 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.836 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.839 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.840 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:21.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:21.842 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:21.843 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:21.844 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:21.844 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:21.844 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:21.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:21.844 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 msgr2=0x7ff7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 0x7ff7780693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff788009fd0 tx=0x7ff788009740 comp rx=0 tx=0).stop 2023-10-09T11:47:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 msgr2=0x7ff7980b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c7e0 tx=0x7ff780007df0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 shutdown_connections 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff798157860 0x7ff798155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff79806a020 0x7ff7980b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 --2- 172.21.15.6:0/2385710296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7980ce270 0x7ff7980b0880 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 >> 172.21.15.6:0/2385710296 conn(0x7ff798063230 msgr2=0x7ff79806eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 shutdown_connections 2023-10-09T11:47:21.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:21.763+0000 7ff79759e700 1 -- 172.21.15.6:0/2385710296 wait complete. 2023-10-09T11:47:21.847 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-09T11:47:26.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.980+0000 7faaf32e5700 1 Processor -- start 2023-10-09T11:47:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 -- start start 2023-10-09T11:47:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faaec1578d0 0x7faaec0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faaec06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0d07c0 con 0x7faaec157ca0 2023-10-09T11:47:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec06daa0 con 0x7faaec1578d0 2023-10-09T11:47:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.981+0000 7faaf32e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0cfbb0 con 0x7faaec06d120 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf0880700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faaec157ca0 0x7faaec15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44912/0 (socket says 172.21.15.6:44912) 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf0880700 1 -- 172.21.15.6:0/387317746 learned_addr learned my addr 172.21.15.6:0/387317746 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> v2:172.21.15.118:3300/0 conn(0x7faaec1578d0 0x7faaec0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf1882700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faaec06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672148482 0 0) 0x7faaec0d07c0 con 0x7faaec157ca0 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad4003570 con 0x7faaec157ca0 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929435083 0 0) 0x7faad4003570 con 0x7faaec157ca0 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 msgr2=0x7faaec06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faaec06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 >> v2:172.21.15.118:3300/0 conn(0x7faaec1578d0 msgr2=0x7faaec0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 --2- 172.21.15.6:0/387317746 >> v2:172.21.15.118:3300/0 conn(0x7faaec1578d0 0x7faaec0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0cfe90 con 0x7faaec157ca0 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> v2:172.21.15.118:3300/0 conn(0x7faaec1578d0 0x7faaec0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7faae0001470 con 0x7faaec157ca0 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 >> v1:172.21.15.6:6789/0 conn(0x7faaec157ca0 legacy=0x7faaec15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faad4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad4003fe0 0x7faad4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad4004d50 0x7faad40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec06daa0 con 0x7faad4004d50 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0cfbb0 con 0x7faad4003fe0 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad400ba90 con 0x7faaec06d120 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faad4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf1882700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad4004d50 0x7faad40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.982+0000 7faaf0880700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad4003fe0 0x7faad4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 -- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad4003fe0 msgr2=0x7faad4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faad4003fe0 0x7faad4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 -- 172.21.15.6:0/387317746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad4004d50 msgr2=0x7faad40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad4004d50 0x7faad40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 -- 172.21.15.6:0/387317746 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4003570 con 0x7faaec06d120 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1882700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad4004d50 0x7faad40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaf1081700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faad4003a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faae4009df0 tx=0x7faae40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e7b081864eb2c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400e8c0 con 0x7faaec06d120 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400ea20 con 0x7faaec06d120 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.983+0000 7faaebfff700 1 -- 172.21.15.6:0/387317746 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400edc0 con 0x7faaec06d120 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 -- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 msgr2=0x7faad4003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 --2- 172.21.15.6:0/387317746 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec06d120 0x7faad4003a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faae4009df0 tx=0x7faae40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf1882700 1 -- 172.21.15.6:0/387317746 reap_dead start 2023-10-09T11:47:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 -- 172.21.15.6:0/387317746 shutdown_connections 2023-10-09T11:47:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 -- 172.21.15.6:0/387317746 >> 172.21.15.6:0/387317746 conn(0x7faaec06bb90 msgr2=0x7faaec06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 -- 172.21.15.6:0/387317746 shutdown_connections 2023-10-09T11:47:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.984+0000 7faaf32e5700 1 -- 172.21.15.6:0/387317746 wait complete. 2023-10-09T11:47:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.985+0000 7faaf32e5700 1 Processor -- start 2023-10-09T11:47:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.985+0000 7faaf32e5700 1 -- start start 2023-10-09T11:47:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec0ad280 0x7faaec0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaec0b4b70 0x7faaec0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0adc30 con 0x7faaec06d120 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b6440 con 0x7faaec0b4b70 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf32e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b5830 con 0x7faaec0ad280 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36342/0 (socket says 172.21.15.6:36342) 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 -- 172.21.15.6:0/1604113166 learned_addr learned my addr 172.21.15.6:0/1604113166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf0880700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec0ad280 0x7faaec0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1882700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaec0b4b70 0x7faaec0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 -- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec0ad280 msgr2=0x7faaec0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec0ad280 0x7faaec0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 -- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaec0b4b70 msgr2=0x7faaec0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaec0b4b70 0x7faaec0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 -- 172.21.15.6:0/1604113166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0b5b10 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.986+0000 7faaf1081700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7faad400bc20 tx=0x7faae401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.987+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4022070 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.987+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4013a00 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.987+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec0b5df0 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.987+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4013e00 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.987+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec16d540 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.988+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec16b460 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.988+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faae4026070 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.988+0000 7faae97fa700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.989+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faae4085b90 con 0x7faaec06d120 2023-10-09T11:47:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.989+0000 7faaf0880700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.989+0000 7faaf0880700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 0x7faad80693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faaec06e900 tx=0x7faaec0d0730 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:26.993+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae4052ec0 con 0x7faaec06d120 2023-10-09T11:47:27.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.190+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7faaec0d0170 con 0x7faaec06d120 2023-10-09T11:47:27.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.191+0000 7faae97fa700 1 -- 172.21.15.6:0/1604113166 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+32234 (secure 0 0 0) 0x7faae4017020 con 0x7faaec06d120 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 181, 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:25.989821+0000", 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:27.194 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:27.195 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.196 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.197 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.198 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.199 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.202 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.204 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.205 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:27.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:27.209 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "181", 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.210 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.211 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:27.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.215 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.217 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:27.220 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.221 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.223 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.228 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:27.231 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:27.233 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.234 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:27.239 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.241 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:27.246 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.247 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.248 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.250 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.252 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:27.253 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.254 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.255 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.256 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.258 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:27.259 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.260 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:27.261 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.263 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:27.268 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.269 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.270 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.273 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.274 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:27.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:27.276 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.277 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 msgr2=0x7faad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 0x7faad80693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faaec06e900 tx=0x7faaec0d0730 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 msgr2=0x7faaec16d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7faad400bc20 tx=0x7faae401a000 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 shutdown_connections 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaec0b4b70 0x7faaec0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaec06d120 0x7faaec16d000 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 --2- 172.21.15.6:0/1604113166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaec0ad280 0x7faaec0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 >> 172.21.15.6:0/1604113166 conn(0x7faaec06bb90 msgr2=0x7faaec155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 shutdown_connections 2023-10-09T11:47:27.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.193+0000 7faaf32e5700 1 -- 172.21.15.6:0/1604113166 wait complete. 2023-10-09T11:47:27.280 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-09T11:47:27.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-09T11:47:27.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.398+0000 7f34f7485700 1 Processor -- start 2023-10-09T11:47:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.398+0000 7f34f7485700 1 -- start start 2023-10-09T11:47:27.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f7485700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f7485700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f00d07c0 con 0x7f34f01578d0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f7485700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f00cfbb0 con 0x7f34f0157ca0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f7485700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00cfe90 con 0x7f34f006d830 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f5221700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34f01578d0 0x7f34f015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44916/0 (socket says 172.21.15.6:44916) 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f5221700 1 -- 172.21.15.6:0/3567309691 learned_addr learned my addr 172.21.15.6:0/3567309691 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.399+0000 7f34f5a22700 1 --2- 172.21.15.6:0/3567309691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229036709 0 0) 0x7f34f00d07c0 con 0x7f34f01578d0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8003570 con 0x7f34f01578d0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804719732 0 0) 0x7f34f00cfbb0 con 0x7f34f0157ca0 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34f5a22700 1 -- 172.21.15.6:0/3567309691 >> v1:172.21.15.118:6789/0 conn(0x7f34f0157ca0 legacy=0x7f34f006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34f5a22700 1 -- 172.21.15.6:0/3567309691 >> v1:172.21.15.6:6789/0 conn(0x7f34f01578d0 legacy=0x7f34f015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34f5a22700 1 -- 172.21.15.6:0/3567309691 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00d0170 con 0x7f34f006d830 2023-10-09T11:47:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34f5a22700 1 --2- 172.21.15.6:0/3567309691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f00cf4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009e90 tx=0x7f34e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e532c5a03bd1bd7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000e070 con 0x7f34f006d830 2023-10-09T11:47:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000bc30 con 0x7f34f006d830 2023-10-09T11:47:27.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.400+0000 7f34effff700 1 -- 172.21.15.6:0/3567309691 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0012430 con 0x7f34f006d830 2023-10-09T11:47:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 -- 172.21.15.6:0/3567309691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 msgr2=0x7f34f00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 --2- 172.21.15.6:0/3567309691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f00cf4f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009e90 tx=0x7f34e0009780 comp rx=0 tx=0).stop 2023-10-09T11:47:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 -- 172.21.15.6:0/3567309691 shutdown_connections 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 --2- 172.21.15.6:0/3567309691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f00cf4f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 -- 172.21.15.6:0/3567309691 >> 172.21.15.6:0/3567309691 conn(0x7f34f006bb90 msgr2=0x7f34f006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 -- 172.21.15.6:0/3567309691 shutdown_connections 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.401+0000 7f34f7485700 1 -- 172.21.15.6:0/3567309691 wait complete. 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.402+0000 7f34f7485700 1 Processor -- start 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.402+0000 7f34f7485700 1 -- start start 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f0157ca0 0x7f34f00acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f016b180 con 0x7f34f01578d0 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00b3f10 con 0x7f34f0157ca0 2023-10-09T11:47:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f7485700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00ab5c0 con 0x7f34f006d830 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36356/0 (socket says 172.21.15.6:36356) 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 -- 172.21.15.6:0/2656915872 learned_addr learned my addr 172.21.15.6:0/2656915872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f5a22700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f0157ca0 0x7f34f00acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f5221700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 -- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 msgr2=0x7f34f0148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f0148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 -- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f0157ca0 msgr2=0x7f34f00acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f0157ca0 0x7f34f00acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 -- 172.21.15.6:0/2656915872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009a20 con 0x7f34f01578d0 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.403+0000 7f34f4a20700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c510 tx=0x7f34e4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.404+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4011590 con 0x7f34f01578d0 2023-10-09T11:47:27.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.404+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e4011710 con 0x7f34f01578d0 2023-10-09T11:47:27.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.404+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f00ab8a0 con 0x7f34f01578d0 2023-10-09T11:47:27.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.404+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4011ad0 con 0x7f34f01578d0 2023-10-09T11:47:27.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.404+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f00b3ba0 con 0x7f34f01578d0 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.405+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0067ac0 con 0x7f34f01578d0 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.405+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34e401b3b0 con 0x7f34f01578d0 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.405+0000 7f34ed7fa700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 0x7f34dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.405+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34e4083980 con 0x7f34f01578d0 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.406+0000 7f34f5221700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 0x7f34dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.406+0000 7f34f5221700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 0x7f34dc0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f34f0159a80 tx=0x7f34e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.410+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34e4050bf0 con 0x7f34f01578d0 2023-10-09T11:47:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.604+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f34f00b4050 con 0x7f34f01578d0 2023-10-09T11:47:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.605+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2656915872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v181) v1 ==== 81+0+32234 (secure 0 0 0) 0x7f34e4017070 con 0x7f34f01578d0 2023-10-09T11:47:27.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 181, 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2023-10-09T11:35:46.107243+0000", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2023-10-09T11:47:25.989821+0000", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2023-10-09T11:35:51.507729+0000", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2023-10-09T11:35:48.488373+0000", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2023-10-09T11:47:27.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 4, 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.69999998807907104, 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 23, 2023-10-09T11:47:27.608 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "quincy", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:35:52.198753+0000", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.609 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2023-10-09T11:47:27.610 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "103", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.612 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.613 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.614 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.615 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 22, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_metadata", 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:51.111141+0000", 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.616 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "177", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.618 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.620 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_bias": 4, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 16, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_priority": 5 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.621 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": "cephfs" 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 23, 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "cephfs_data", 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2023-10-09T11:46:52.381082+0000", 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2023-10-09T11:47:27.622 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 64, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 64, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 64, 2023-10-09T11:47:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 64, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 64, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "181", 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-09T11:47:27.624 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 33554432, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2023-10-09T11:47:27.625 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2023-10-09T11:47:27.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2023-10-09T11:47:27.627 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 64, 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "target_size_ratio": 0.89999997615814209 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs": { 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "data": "cephfs" 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2023-10-09T11:47:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2023-10-09T11:47:27.631 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86385 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6823/86385", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6826/86385", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/86385", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/86385", 2023-10-09T11:47:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2023-10-09T11:47:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86376 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.640 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/86376", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/86376", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6815/86376", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6813/86376", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.641 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.644 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86375 2023-10-09T11:47:27.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/86375", 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/86375", 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/86375", 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/86375", 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.648 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2023-10-09T11:47:27.650 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.652 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.653 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2023-10-09T11:47:27.653 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86387 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6817/86387", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/86387", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6827/86387", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6822/86387", 2023-10-09T11:47:27.654 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.655 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6800", 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6801", 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.657 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6802", 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6804", 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6809", 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6811", 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.659 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6806", 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6808", 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86573 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6801/86573", 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6804/86573", 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6811/86573", 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6808/86573", 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:27.661 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.662 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6803", 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6805", 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6807", 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6810", 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6816", 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.665 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6818", 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6812", 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6814", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86574 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6805/86574", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6810/86574", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6818/86574", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6814/86574", 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.668 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6813", 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.670 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6815", 2023-10-09T11:47:27.670 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6817", 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6819", 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6822", 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6824", 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.673 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6820", 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6821", 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86575 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.675 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6815/86575", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6819/86575", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6824/86575", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6821/86575", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-09T11:47:27.676 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 13, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 176, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6823", 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6825", 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.678 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6826", 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6827", 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6830", 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6831", 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6828", 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.118:6829", 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 86576 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.118:6825/86576", 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.118:6827/86576", 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.118:6831/86576", 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.118:6829/86576", 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.684 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.686444+0000", 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.685 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.593031+0000", 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.686 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.594227+0000", 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.687 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.618110+0000", 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.688 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.562611+0000", 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.689 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.569195+0000", 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.597443+0000", 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540138320759226367, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2023-10-09T11:35:49.567810+0000", 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-09T11:47:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2023-10-09T11:47:27.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2023-10-09T11:47:27.693 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2023-10-09T11:47:27.694 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-09T11:47:27.694 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 msgr2=0x7f34dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 0x7f34dc0693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f34f0159a80 tx=0x7f34e8009040 comp rx=0 tx=0).stop 2023-10-09T11:47:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 msgr2=0x7f34f00ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c510 tx=0x7f34e4007f50 comp rx=0 tx=0).stop 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 shutdown_connections 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f34dc066f30 0x7f34dc0693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34f0157ca0 0x7f34f00acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34f006d830 0x7f34f0148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 --2- 172.21.15.6:0/2656915872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f01578d0 0x7f34f00ac650 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 >> 172.21.15.6:0/2656915872 conn(0x7f34f006bb90 msgr2=0x7f34f006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 shutdown_connections 2023-10-09T11:47:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.607+0000 7f34f7485700 1 -- 172.21.15.6:0/2656915872 wait complete. 2023-10-09T11:47:27.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.815+0000 7f6901828700 1 Processor -- start 2023-10-09T11:47:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.815+0000 7f6901828700 1 -- start start 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f6901828700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f68fc06d990 0x7f68fc159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f6901828700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f6901828700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc06e280 con 0x7f68fc159a90 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f6901828700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc068d60 con 0x7f68fc06d990 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f6901828700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc06dfa0 con 0x7f68fc0691f0 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68faffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f68fc159a90 0x7f68fc06a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44918/0 (socket says 172.21.15.6:44918) 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68faffd700 1 -- 172.21.15.6:0/2915036597 learned_addr learned my addr 172.21.15.6:0/2915036597 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2915036597 >> v2:172.21.15.6:3300/0 conn(0x7f68fc06d990 0x7f68fc159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fb7fe700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68f9ffb700 1 -- 172.21.15.6:0/2915036597 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348143031 0 0) 0x7f68fc06e280 con 0x7f68fc159a90 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68f9ffb700 1 -- 172.21.15.6:0/2915036597 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e8003570 con 0x7f68fc159a90 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2915036597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 msgr2=0x7f68fc0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2915036597 >> v1:172.21.15.6:6789/0 conn(0x7f68fc159a90 legacy=0x7f68fc06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.816+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2915036597 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc068710 con 0x7f68fc06d990 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc159e60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f68e40098e0 tx=0x7f68e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cfb779d6f2177 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f68f9ffb700 1 -- 172.21.15.6:0/2915036597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011630 con 0x7f68fc06d990 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f68f9ffb700 1 -- 172.21.15.6:0/2915036597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4011790 con 0x7f68fc06d990 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f68f9ffb700 1 -- 172.21.15.6:0/2915036597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011b30 con 0x7f68fc06d990 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 -- 172.21.15.6:0/2915036597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 msgr2=0x7f68fc159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc159e60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f68e40098e0 tx=0x7f68e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 -- 172.21.15.6:0/2915036597 shutdown_connections 2023-10-09T11:47:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 --2- 172.21.15.6:0/2915036597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc159e60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 -- 172.21.15.6:0/2915036597 >> 172.21.15.6:0/2915036597 conn(0x7f68fc06bb90 msgr2=0x7f68fc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 -- 172.21.15.6:0/2915036597 shutdown_connections 2023-10-09T11:47:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.817+0000 7f6901828700 1 -- 172.21.15.6:0/2915036597 wait complete. 2023-10-09T11:47:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 Processor -- start 2023-10-09T11:47:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 -- start start 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 0x7f68fc0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0b0990 con 0x7f68fc06d990 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0ac100 con 0x7f68fc159a90 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.819+0000 7f6901828700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0aeb40 con 0x7f68fc0691f0 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36374/0 (socket says 172.21.15.6:36374) 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2749465254 learned_addr learned my addr 172.21.15.6:0/2749465254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68faffd700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fb7fe700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 0x7f68fc0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 msgr2=0x7f68fc0b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 msgr2=0x7f68fc0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 0x7f68fc0b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 -- 172.21.15.6:0/2749465254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009420 con 0x7f68fc06d990 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fb7fe700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 0x7f68fc0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68fa7fc700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009ed0 tx=0x7f68e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011b10 con 0x7f68fc06d990 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4006af0 con 0x7f68fc06d990 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc0aee20 con 0x7f68fc06d990 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4025640 con 0x7f68fc06d990 2023-10-09T11:47:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.820+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc0abd90 con 0x7f68fc06d990 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.821+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0ac2b0 con 0x7f68fc06d990 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.822+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68e4025a70 con 0x7f68fc06d990 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.822+0000 7f68f2ffd700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.822+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68e4085c30 con 0x7f68fc06d990 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.822+0000 7f68faffd700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.823+0000 7f68faffd700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 0x7f68dc0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f68f40058d0 tx=0x7f68f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:27.827+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68fc0ac2b0 con 0x7f68fc06d990 2023-10-09T11:47:28.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.063+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68fc0ac270 con 0x7f68fc06d990 2023-10-09T11:47:28.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.064+0000 7f68f2ffd700 1 -- 172.21.15.6:0/2749465254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f68e4015020 con 0x7f68fc06d990 2023-10-09T11:47:28.065 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:28.065 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:28.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 msgr2=0x7f68dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 0x7f68dc0693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f68f40058d0 tx=0x7f68f4009040 comp rx=0 tx=0).stop 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 msgr2=0x7f68fc154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009ed0 tx=0x7f68e4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 shutdown_connections 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f68dc066f30 0x7f68dc0693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68fc159a90 0x7f68fc0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f68fc0691f0 0x7f68fc0b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 --2- 172.21.15.6:0/2749465254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68fc06d990 0x7f68fc154ad0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 >> 172.21.15.6:0/2749465254 conn(0x7f68fc06bb90 msgr2=0x7f68fc15a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 shutdown_connections 2023-10-09T11:47:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.066+0000 7f6901828700 1 -- 172.21.15.6:0/2749465254 wait complete. 2023-10-09T11:47:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:28.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-09T11:47:28.219 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","whoami":0,"id":8136,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.216642503000003,"mdsmap_epoch":92,"osdmap_epoch":181,"osdmap_epoch_barrier":180,"uptime":39.977176559999997} 2023-10-09T11:47:28.220 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "7857a25d-47fa-49eb-8e61-2818cdc55761", "fs_name": "cephfs", "id": 8136, "mdsmap_epoch": 92, "osdmap_epoch": 181, "osdmap_epoch_barrier": 180, "rank_uptime": 34.216642503, "state": "up:active", "uptime": 39.97717656, "want_state": "up:active", "whoami": 0 } 2023-10-09T11:47:28.220 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-09T11:47:28.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:28.220 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-09T11:47:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records in 2023-10-09T11:47:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:50+0 records out 2023-10-09T11:47:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.273437 s, 192 MB/s 2023-10-09T11:47:28.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T11:47:28.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:47:28.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T11:47:28.588 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T11:47:28.588 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T11:47:28.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:28.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T11:47:28.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:47:28.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:28.656 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T11:47:28.672 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T11:47:28.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T11:47:28.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T11:47:28.707 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:47:28.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:28.707 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T11:47:28.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.880+0000 7f4683aee700 1 Processor -- start 2023-10-09T11:47:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.880+0000 7f4683aee700 1 -- start start 2023-10-09T11:47:28.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4683aee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 0x7f467c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4683aee700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f467c06d120 0x7f467c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4683aee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c06dac0 con 0x7f467c1578d0 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4683aee700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0d07c0 con 0x7f467c06d120 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4683aee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0cfbb0 con 0x7f467c157ca0 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468188a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f467c1578d0 0x7f467c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44926/0 (socket says 172.21.15.6:44926) 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468188a700 1 -- 172.21.15.6:0/2308262691 learned_addr learned my addr 172.21.15.6:0/2308262691 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 --2- 172.21.15.6:0/2308262691 >> v2:172.21.15.118:3300/0 conn(0x7f467c06d120 0x7f467c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4681089700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 0x7f467c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4680888700 1 -- 172.21.15.6:0/2308262691 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822208315 0 0) 0x7f4678001110 con 0x7f467c1578d0 2023-10-09T11:47:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4680888700 1 -- 172.21.15.6:0/2308262691 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003570 con 0x7f467c1578d0 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 -- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 msgr2=0x7f467c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 0x7f467c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 -- 172.21.15.6:0/2308262691 >> v1:172.21.15.6:6789/0 conn(0x7f467c1578d0 legacy=0x7f467c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 -- 172.21.15.6:0/2308262691 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0cfe90 con 0x7f467c06d120 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f4681089700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 0x7f467c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.881+0000 7f468208b700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c06d580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4674009e60 tx=0x7f4674009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c5c4f05cf56ddd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4680888700 1 -- 172.21.15.6:0/2308262691 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400e070 con 0x7f467c06d120 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4680888700 1 -- 172.21.15.6:0/2308262691 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400bab0 con 0x7f467c06d120 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4680888700 1 -- 172.21.15.6:0/2308262691 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400be30 con 0x7f467c06d120 2023-10-09T11:47:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 -- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 msgr2=0x7f467c06d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c06d580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4674009e60 tx=0x7f4674009780 comp rx=0 tx=0).stop 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 -- 172.21.15.6:0/2308262691 shutdown_connections 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c06d580 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 --2- 172.21.15.6:0/2308262691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c157ca0 0x7f467c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 -- 172.21.15.6:0/2308262691 >> 172.21.15.6:0/2308262691 conn(0x7f467c06bb90 msgr2=0x7f467c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 -- 172.21.15.6:0/2308262691 shutdown_connections 2023-10-09T11:47:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.882+0000 7f4683aee700 1 -- 172.21.15.6:0/2308262691 wait complete. 2023-10-09T11:47:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.883+0000 7f4683aee700 1 Processor -- start 2023-10-09T11:47:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.883+0000 7f4683aee700 1 -- start start 2023-10-09T11:47:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c1578d0 0x7f467c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ad890 con 0x7f467c157ca0 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ac6f0 con 0x7f467c06d120 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4683aee700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ac9d0 con 0x7f467c1578d0 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f468208b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f468208b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36390/0 (socket says 172.21.15.6:36390) 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f468208b700 1 -- 172.21.15.6:0/2312868798 learned_addr learned my addr 172.21.15.6:0/2312868798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f468188a700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.884+0000 7f4681089700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c1578d0 0x7f467c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 -- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c1578d0 msgr2=0x7f467c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c1578d0 0x7f467c0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 -- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 msgr2=0x7f467c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 -- 172.21.15.6:0/2312868798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009420 con 0x7f467c157ca0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f468208b700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f467c06fe20 tx=0x7f4674019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674012e50 con 0x7f467c157ca0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674027470 con 0x7f467c157ca0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4674009a20 con 0x7f467c157ca0 2023-10-09T11:47:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674027830 con 0x7f467c157ca0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.885+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c155650 con 0x7f467c157ca0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.886+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c0ada40 con 0x7f467c157ca0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.886+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4674024070 con 0x7f467c157ca0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.887+0000 7f4671ffb700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 0x7f46600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.887+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4674086be0 con 0x7f467c157ca0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.887+0000 7f468188a700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 0x7f46600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.887+0000 7f468188a700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 0x7f46600693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4678001270 tx=0x7f4678000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:28.891+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f467c0ada40 con 0x7f467c157ca0 2023-10-09T11:47:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.130+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467c0ad9d0 con 0x7f467c157ca0 2023-10-09T11:47:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.131+0000 7f4671ffb700 1 -- 172.21.15.6:0/2312868798 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f467402c020 con 0x7f467c157ca0 2023-10-09T11:47:29.132 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:29.132 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 msgr2=0x7f46600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 0x7f46600693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4678001270 tx=0x7f4678000bc0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 msgr2=0x7f467c15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f467c06fe20 tx=0x7f4674019000 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 shutdown_connections 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4660066f30 0x7f46600693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c157ca0 0x7f467c15df50 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c06d120 0x7f467c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 --2- 172.21.15.6:0/2312868798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c1578d0 0x7f467c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 >> 172.21.15.6:0/2312868798 conn(0x7f467c06bb90 msgr2=0x7f467c155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 shutdown_connections 2023-10-09T11:47:29.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.133+0000 7f4683aee700 1 -- 172.21.15.6:0/2312868798 wait complete. 2023-10-09T11:47:29.136 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:29.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.264+0000 7fc9950e3700 1 Processor -- start 2023-10-09T11:47:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.264+0000 7fc9950e3700 1 -- start start 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9950e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc990068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9950e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc990068cc0 0x7fc9900cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9950e3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900cee10 con 0x7fc990159b40 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9950e3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc990069140 con 0x7fc990068cc0 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9950e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900cd040 con 0x7fc990159f10 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc990068cc0 0x7fc9900cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc990068cc0 0x7fc9900cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36396/0 (socket says 172.21.15.6:36396) 2023-10-09T11:47:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 -- 172.21.15.6:0/4170896750 learned_addr learned my addr 172.21.15.6:0/4170896750 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc990068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 -- 172.21.15.6:0/4170896750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 msgr2=0x7fc990068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc990068780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 -- 172.21.15.6:0/4170896750 >> v1:172.21.15.118:6789/0 conn(0x7fc990159b40 legacy=0x7fc9900cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc9948e2700 1 -- 172.21.15.6:0/4170896750 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900cd320 con 0x7fc990068cc0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.265+0000 7fc98effd700 1 -- 172.21.15.6:0/4170896750 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719986394 0 0) 0x7fc9900cee10 con 0x7fc990159b40 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9948e2700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc9900cf2a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc988009f20 tx=0x7fc988009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a385f78f526a7142 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc98effd700 1 -- 172.21.15.6:0/4170896750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800e070 con 0x7fc990068cc0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc98effd700 1 -- 172.21.15.6:0/4170896750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800b9d0 con 0x7fc990068cc0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc98effd700 1 -- 172.21.15.6:0/4170896750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880092e0 con 0x7fc990068cc0 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 -- 172.21.15.6:0/4170896750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 msgr2=0x7fc9900cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc9900cf2a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fc988009f20 tx=0x7fc988009840 comp rx=0 tx=0).stop 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 -- 172.21.15.6:0/4170896750 shutdown_connections 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc9900cf2a0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 --2- 172.21.15.6:0/4170896750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc990068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 -- 172.21.15.6:0/4170896750 >> 172.21.15.6:0/4170896750 conn(0x7fc9900cd660 msgr2=0x7fc9900cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 -- 172.21.15.6:0/4170896750 shutdown_connections 2023-10-09T11:47:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.266+0000 7fc9950e3700 1 -- 172.21.15.6:0/4170896750 wait complete. 2023-10-09T11:47:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.267+0000 7fc9950e3700 1 Processor -- start 2023-10-09T11:47:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 -- start start 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990159b40 0x7fc990157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc99016aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99015a9a0 con 0x7fc990068cc0 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99016b000 con 0x7fc990159b40 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc9950e3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99015a6c0 con 0x7fc990159f10 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.268+0000 7fc98ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36398/0 (socket says 172.21.15.6:36398) 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 -- 172.21.15.6:0/674972170 learned_addr learned my addr 172.21.15.6:0/674972170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 -- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 msgr2=0x7fc99016aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc99016aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 -- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990159b40 msgr2=0x7fc990157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990159b40 0x7fc990157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 -- 172.21.15.6:0/674972170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988009ae0 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc98ffff700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7e0 tx=0x7fc980007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980012700 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980012880 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980012c40 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900c8d10 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.269+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900c92d0 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.270+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc990063e90 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.271+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc98001b400 con 0x7fc990068cc0 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.271+0000 7fc987fff700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 0x7fc9700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.271+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc980084130 con 0x7fc990068cc0 2023-10-09T11:47:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.271+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 0x7fc9700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.271+0000 7fc98f7fe700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 0x7fc9700693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc9900cda50 tx=0x7fc9780091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.275+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9800513a0 con 0x7fc990068cc0 2023-10-09T11:47:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.467+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9900ce7c0 con 0x7fc990068cc0 2023-10-09T11:47:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.468+0000 7fc987fff700 1 -- 172.21.15.6:0/674972170 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+15324 (secure 0 0 0) 0x7fc9800549c0 con 0x7fc990068cc0 2023-10-09T11:47:29.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:29.469 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":181,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:47:25.989821+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 msgr2=0x7fc9700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 0x7fc9700693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc9900cda50 tx=0x7fc9780091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 msgr2=0x7fc990154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7e0 tx=0x7fc980007df0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 shutdown_connections 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc970066f30 0x7fc9700693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc990159f10 0x7fc99016aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc990068cc0 0x7fc990154b80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 --2- 172.21.15.6:0/674972170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc990159b40 0x7fc990157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 >> 172.21.15.6:0/674972170 conn(0x7fc9900cd660 msgr2=0x7fc9900c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 shutdown_connections 2023-10-09T11:47:29.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.470+0000 7fc9950e3700 1 -- 172.21.15.6:0/674972170 wait complete. 2023-10-09T11:47:29.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T11:35:52.198753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T11:46:51.111141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T11:46:52.381082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T11:47:29.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T11:47:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.604+0000 7f22fc4e6700 1 Processor -- start 2023-10-09T11:47:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.604+0000 7f22fc4e6700 1 -- start start 2023-10-09T11:47:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fc4e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22f415a2a0 0x7f22f40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fc4e6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f40b0ca0 con 0x7f22f406dd60 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fc4e6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f40b00d0 con 0x7f22f40ceb30 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fc4e6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f406e160 con 0x7f22f415a2a0 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22faa83700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22f406dd60 0x7f22f40b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44934/0 (socket says 172.21.15.6:44934) 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22faa83700 1 -- 172.21.15.6:0/3247437720 learned_addr learned my addr 172.21.15.6:0/3247437720 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fa282700 1 --2- 172.21.15.6:0/3247437720 >> v2:172.21.15.118:3300/0 conn(0x7f22f415a2a0 0x7f22f40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348883267 0 0) 0x7f22f40b0ca0 con 0x7f22f406dd60 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22dc003570 con 0x7f22f406dd60 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fa282700 1 -- 172.21.15.6:0/3247437720 >> v1:172.21.15.118:6789/0 conn(0x7f22f40ceb30 legacy=0x7f22f406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400660087 0 0) 0x7f22dc003570 con 0x7f22f406dd60 2023-10-09T11:47:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fa282700 1 -- 172.21.15.6:0/3247437720 >> v1:172.21.15.6:6789/0 conn(0x7f22f406dd60 legacy=0x7f22f40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.605+0000 7f22fa282700 1 -- 172.21.15.6:0/3247437720 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40b0370 con 0x7f22f415a2a0 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fa282700 1 --2- 172.21.15.6:0/3247437720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f415a2a0 0x7f22f40b1130 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0098e0 tx=0x7f22ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eaf4716300c8823 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40017f0 con 0x7f22f415a2a0 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec011420 con 0x7f22f415a2a0 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22f9280700 1 -- 172.21.15.6:0/3247437720 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0117c0 con 0x7f22f415a2a0 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 -- 172.21.15.6:0/3247437720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f415a2a0 msgr2=0x7f22f40b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/3247437720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f415a2a0 0x7f22f40b1130 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0098e0 tx=0x7f22ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 -- 172.21.15.6:0/3247437720 shutdown_connections 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/3247437720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f415a2a0 0x7f22f40b1130 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 -- 172.21.15.6:0/3247437720 >> 172.21.15.6:0/3247437720 conn(0x7f22f4067640 msgr2=0x7f22f4067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 -- 172.21.15.6:0/3247437720 shutdown_connections 2023-10-09T11:47:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.606+0000 7f22fc4e6700 1 -- 172.21.15.6:0/3247437720 wait complete. 2023-10-09T11:47:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.607+0000 7f22fc4e6700 1 Processor -- start 2023-10-09T11:47:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.607+0000 7f22fc4e6700 1 -- start start 2023-10-09T11:47:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 0x7f22f4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40ceb30 0x7f22f40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40b3da0 con 0x7f22f415a2a0 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40b4080 con 0x7f22f40ceb30 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fc4e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f415d560 con 0x7f22f406dd60 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22faa83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22faa83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36414/0 (socket says 172.21.15.6:36414) 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22faa83700 1 -- 172.21.15.6:0/467493138 learned_addr learned my addr 172.21.15.6:0/467493138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22f9a81700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40ceb30 0x7f22f40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.608+0000 7f22fa282700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 0x7f22f4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 -- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 msgr2=0x7f22f4142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 0x7f22f4142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 -- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40ceb30 msgr2=0x7f22f40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40ceb30 0x7f22f40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 -- 172.21.15.6:0/467493138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009420 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22fa282700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 0x7f22f4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22faa83700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001920 tx=0x7f22e4007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4004dc0 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400a750 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f415d840 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400ab10 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.609+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f41570a0 con 0x7f22f415a2a0 2023-10-09T11:47:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.610+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f4069e40 con 0x7f22f415a2a0 2023-10-09T11:47:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.611+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22e4007150 con 0x7f22f415a2a0 2023-10-09T11:47:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.611+0000 7f22f27fc700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 0x7f22e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.611+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22e4083fc0 con 0x7f22f415a2a0 2023-10-09T11:47:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.611+0000 7f22fa282700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 0x7f22e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.611+0000 7f22fa282700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 0x7f22e00693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0091e0 tx=0x7f22ec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.615+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22e40512b0 con 0x7f22f415a2a0 2023-10-09T11:47:29.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.807+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22f404bb80 con 0x7f22f415a2a0 2023-10-09T11:47:29.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.807+0000 7f22f27fc700 1 -- 172.21.15.6:0/467493138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22e4018020 con 0x7f22f415a2a0 2023-10-09T11:47:29.808 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 msgr2=0x7f22e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 0x7f22e00693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0091e0 tx=0x7f22ec017000 comp rx=0 tx=0).stop 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 msgr2=0x7f22f40c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001920 tx=0x7f22e4007d20 comp rx=0 tx=0).stop 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 shutdown_connections 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f22e0066f30 0x7f22e00693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22f415a2a0 0x7f22f40c7d50 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f22f406dd60 0x7f22f4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 --2- 172.21.15.6:0/467493138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22f40ceb30 0x7f22f40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 >> 172.21.15.6:0/467493138 conn(0x7f22f4067640 msgr2=0x7f22f406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 shutdown_connections 2023-10-09T11:47:29.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.809+0000 7f22fc4e6700 1 -- 172.21.15.6:0/467493138 wait complete. 2023-10-09T11:47:29.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T11:47:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.942+0000 7fd074963700 1 Processor -- start 2023-10-09T11:47:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.942+0000 7fd074963700 1 -- start start 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.943+0000 7fd074963700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 0x7fd0700cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.943+0000 7fd074963700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0700d07c0 con 0x7fd070157ca0 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd074963700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0700cfbb0 con 0x7fd0701578d0 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd074963700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700cfe90 con 0x7fd07006d830 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd070157ca0 0x7fd07006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06dd9b700 1 -- 172.21.15.6:0/842651330 learned_addr learned my addr 172.21.15.6:0/842651330 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06ed9d700 1 --2- 172.21.15.6:0/842651330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 0x7fd0700cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751770064 0 0) 0x7fd0700d07c0 con 0x7fd070157ca0 2023-10-09T11:47:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c003570 con 0x7fd070157ca0 2023-10-09T11:47:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381446196 0 0) 0x7fd0700cfbb0 con 0x7fd0701578d0 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0700d07c0 con 0x7fd0701578d0 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06ed9d700 1 -- 172.21.15.6:0/842651330 >> v1:172.21.15.118:6789/0 conn(0x7fd0701578d0 legacy=0x7fd07015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06ed9d700 1 -- 172.21.15.6:0/842651330 >> v1:172.21.15.6:6789/0 conn(0x7fd070157ca0 legacy=0x7fd07006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06ed9d700 1 -- 172.21.15.6:0/842651330 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700d0170 con 0x7fd07006d830 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.944+0000 7fd06ed9d700 1 --2- 172.21.15.6:0/842651330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 0x7fd0700cf4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd060009910 tx=0x7fd0600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5451f30a4f38c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011630 con 0x7fd07006d830 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060011790 con 0x7fd07006d830 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd06d59a700 1 -- 172.21.15.6:0/842651330 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011b30 con 0x7fd07006d830 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 -- 172.21.15.6:0/842651330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 msgr2=0x7fd0700cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 --2- 172.21.15.6:0/842651330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 0x7fd0700cf4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd060009910 tx=0x7fd0600091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 -- 172.21.15.6:0/842651330 shutdown_connections 2023-10-09T11:47:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 --2- 172.21.15.6:0/842651330 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd07006d830 0x7fd0700cf4f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 -- 172.21.15.6:0/842651330 >> 172.21.15.6:0/842651330 conn(0x7fd07006bb90 msgr2=0x7fd07006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 -- 172.21.15.6:0/842651330 shutdown_connections 2023-10-09T11:47:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.945+0000 7fd074963700 1 -- 172.21.15.6:0/842651330 wait complete. 2023-10-09T11:47:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.946+0000 7fd074963700 1 Processor -- start 2023-10-09T11:47:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.946+0000 7fd074963700 1 -- start start 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd07006d830 0x7fd0701590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0701578d0 0x7fd0700acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700ae160 con 0x7fd070157ca0 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07016b840 con 0x7fd07006d830 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd074963700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700ad300 con 0x7fd0701578d0 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36420/0 (socket says 172.21.15.6:36420) 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06ed9d700 1 -- 172.21.15.6:0/4181403951 learned_addr learned my addr 172.21.15.6:0/4181403951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06e59c700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd07006d830 0x7fd0701590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06dd9b700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0701578d0 0x7fd0700acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06ed9d700 1 -- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0701578d0 msgr2=0x7fd0700acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.947+0000 7fd06ed9d700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0701578d0 0x7fd0700acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd06ed9d700 1 -- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd07006d830 msgr2=0x7fd0701590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd06ed9d700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd07006d830 0x7fd0701590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd06ed9d700 1 -- 172.21.15.6:0/4181403951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009420 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd06ed9d700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd07006fe20 tx=0x7fd060017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06001f070 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060002f70 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0700b68c0 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060025420 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.948+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700ae630 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.949+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd070067ac0 con 0x7fd070157ca0 2023-10-09T11:47:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.949+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd060023070 con 0x7fd070157ca0 2023-10-09T11:47:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.950+0000 7fd0667fc700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.950+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd060085a80 con 0x7fd070157ca0 2023-10-09T11:47:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.950+0000 7fd06e59c700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.950+0000 7fd06e59c700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd068004140 tx=0x7fd068002730 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:29.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:29.954+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd060052cf0 con 0x7fd070157ca0 2023-10-09T11:47:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.146+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd07016b980 con 0x7fd070157ca0 2023-10-09T11:47:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.147+0000 7fd0667fc700 1 -- 172.21.15.6:0/4181403951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd06002a020 con 0x7fd070157ca0 2023-10-09T11:47:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-09T11:47:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 msgr2=0x7fd0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 0x7fd0500693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd068004140 tx=0x7fd068002730 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 msgr2=0x7fd07016a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd07006fe20 tx=0x7fd060017000 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 shutdown_connections 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd050066f30 0x7fd0500693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd070157ca0 0x7fd07016a670 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd07006d830 0x7fd0701590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 --2- 172.21.15.6:0/4181403951 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0701578d0 0x7fd0700acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 >> 172.21.15.6:0/4181403951 conn(0x7fd07006bb90 msgr2=0x7fd07015c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 shutdown_connections 2023-10-09T11:47:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.149+0000 7fd074963700 1 -- 172.21.15.6:0/4181403951 wait complete. 2023-10-09T11:47:30.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T11:47:30.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.283+0000 7fcdff4c7700 1 Processor -- start 2023-10-09T11:47:30.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.283+0000 7fcdff4c7700 1 -- start start 2023-10-09T11:47:30.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdff4c7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcdf80c8b60 0x7fcdf80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdff4c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 0x7fcdf80ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdff4c7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf806ee10 con 0x7fcdf806f2a0 2023-10-09T11:47:30.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdff4c7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf806e200 con 0x7fcdf80c8b60 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdff4c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf806e4e0 con 0x7fcdf815b2f0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfecc6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcdf806f2a0 0x7fcdf80ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44954/0 (socket says 172.21.15.6:44954) 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfecc6700 1 -- 172.21.15.6:0/2706948933 learned_addr learned my addr 172.21.15.6:0/2706948933 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/2706948933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 0x7fcdf80ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfe4c5700 1 --2- 172.21.15.6:0/2706948933 >> v2:172.21.15.118:3300/0 conn(0x7fcdf80c8b60 0x7fcdf80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfd4c3700 1 -- 172.21.15.6:0/2706948933 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544796436 0 0) 0x7fcdf806ee10 con 0x7fcdf806f2a0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.284+0000 7fcdfd4c3700 1 -- 172.21.15.6:0/2706948933 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde0003570 con 0x7fcdf806f2a0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfdcc4700 1 -- 172.21.15.6:0/2706948933 >> v2:172.21.15.118:3300/0 conn(0x7fcdf80c8b60 msgr2=0x7fcdf80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/2706948933 >> v2:172.21.15.118:3300/0 conn(0x7fcdf80c8b60 0x7fcdf80c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfdcc4700 1 -- 172.21.15.6:0/2706948933 >> v1:172.21.15.6:6789/0 conn(0x7fcdf806f2a0 legacy=0x7fcdf80ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfdcc4700 1 -- 172.21.15.6:0/2706948933 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf806e7c0 con 0x7fcdf815b2f0 2023-10-09T11:47:30.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/2706948933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 0x7fcdf80ca720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0098e0 tx=0x7fcdec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd4f7d2a6641e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfd4c3700 1 -- 172.21.15.6:0/2706948933 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec011630 con 0x7fcdf815b2f0 2023-10-09T11:47:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfd4c3700 1 -- 172.21.15.6:0/2706948933 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec011790 con 0x7fcdf815b2f0 2023-10-09T11:47:30.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdfd4c3700 1 -- 172.21.15.6:0/2706948933 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec011b30 con 0x7fcdf815b2f0 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdff4c7700 1 -- 172.21.15.6:0/2706948933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 msgr2=0x7fcdf80ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.285+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/2706948933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 0x7fcdf80ca720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0098e0 tx=0x7fcdec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 -- 172.21.15.6:0/2706948933 shutdown_connections 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/2706948933 >> v2:172.21.15.118:3300/0 conn(0x7fcdf80c8b60 0x7fcdf80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/2706948933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf815b2f0 0x7fcdf80ca720 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 -- 172.21.15.6:0/2706948933 >> 172.21.15.6:0/2706948933 conn(0x7fcdf806cca0 msgr2=0x7fcdf806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 -- 172.21.15.6:0/2706948933 shutdown_connections 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.286+0000 7fcdff4c7700 1 -- 172.21.15.6:0/2706948933 wait complete. 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 Processor -- start 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 -- start start 2023-10-09T11:47:30.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf80c8b60 0x7fcdf80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdf815b2f0 0x7fcdf80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80b33d0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80b2580 con 0x7fcdf815b2f0 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.287+0000 7fcdff4c7700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80b2850 con 0x7fcdf80c8b60 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36434/0 (socket says 172.21.15.6:36434) 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 -- 172.21.15.6:0/840713712 learned_addr learned my addr 172.21.15.6:0/840713712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf80c8b60 0x7fcdf80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfecc6700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdf815b2f0 0x7fcdf80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 -- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf80c8b60 msgr2=0x7fcdf80b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf80c8b60 0x7fcdf80b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 -- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdf815b2f0 msgr2=0x7fcdf80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdf815b2f0 0x7fcdf80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 -- 172.21.15.6:0/840713712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec009420 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdfe4c5700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000ec80 tx=0x7fcdf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000c9d0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000cb30 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80b2b30 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0013470 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.288+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf80b30f0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.289+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf814e660 con 0x7fcdf806f2a0 2023-10-09T11:47:30.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.290+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdf0013820 con 0x7fcdf806f2a0 2023-10-09T11:47:30.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.290+0000 7fcdf67fc700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.290+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdf00849b0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.290+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.290+0000 7fcdfdcc4700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 0x7fcde40693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815b6c0 tx=0x7fcdec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.294+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdf0051c20 con 0x7fcdf806f2a0 2023-10-09T11:47:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.488+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcdf80684e0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.488+0000 7fcdf67fc700 1 -- 172.21.15.6:0/840713712 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdf00170a0 con 0x7fcdf806f2a0 2023-10-09T11:47:30.489 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 msgr2=0x7fcde40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 0x7fcde40693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcdf815b6c0 tx=0x7fcdec017000 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 msgr2=0x7fcdf80b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000ec80 tx=0x7fcdf00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 shutdown_connections 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdf815b2f0 0x7fcdf80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdf806f2a0 0x7fcdf80b1b00 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 --2- 172.21.15.6:0/840713712 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdf80c8b60 0x7fcdf80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 >> 172.21.15.6:0/840713712 conn(0x7fcdf806cca0 msgr2=0x7fcdf80af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 shutdown_connections 2023-10-09T11:47:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.490+0000 7fcdff4c7700 1 -- 172.21.15.6:0/840713712 wait complete. 2023-10-09T11:47:30.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.620+0000 7f4475a03700 1 Processor -- start 2023-10-09T11:47:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.620+0000 7f4475a03700 1 -- start start 2023-10-09T11:47:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.621+0000 7f4475a03700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44701576d0 0x7f447006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.621+0000 7f4475a03700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700abd20 con 0x7f447006db90 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.621+0000 7f4475a03700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700cadc0 con 0x7f447006d2b0 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.621+0000 7f4475a03700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44700ac350 con 0x7f44701576d0 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.621+0000 7f446e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f447006db90 0x7f447006cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44960/0 (socket says 172.21.15.6:44960) 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446e7fc700 1 -- 172.21.15.6:0/4244568193 learned_addr learned my addr 172.21.15.6:0/4244568193 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446effd700 1 --2- 172.21.15.6:0/4244568193 >> v2:172.21.15.118:3300/0 conn(0x7f44701576d0 0x7f447006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446dffb700 1 -- 172.21.15.6:0/4244568193 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904000299 0 0) 0x7f44700abd20 con 0x7f447006db90 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446dffb700 1 -- 172.21.15.6:0/4244568193 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f445c003570 con 0x7f447006db90 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446effd700 1 -- 172.21.15.6:0/4244568193 >> v1:172.21.15.118:6789/0 conn(0x7f447006d2b0 legacy=0x7f44700aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446effd700 1 -- 172.21.15.6:0/4244568193 >> v1:172.21.15.6:6789/0 conn(0x7f447006db90 legacy=0x7f447006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446effd700 1 -- 172.21.15.6:0/4244568193 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700cb0a0 con 0x7f44701576d0 2023-10-09T11:47:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446effd700 1 --2- 172.21.15.6:0/4244568193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44701576d0 0x7f447006f6c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f44680098e0 tx=0x7f44680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94146b3140f67ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446dffb700 1 -- 172.21.15.6:0/4244568193 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800b640 con 0x7f44701576d0 2023-10-09T11:47:30.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446dffb700 1 -- 172.21.15.6:0/4244568193 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800b7a0 con 0x7f44701576d0 2023-10-09T11:47:30.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.622+0000 7f446dffb700 1 -- 172.21.15.6:0/4244568193 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800bb40 con 0x7f44701576d0 2023-10-09T11:47:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 -- 172.21.15.6:0/4244568193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44701576d0 msgr2=0x7f447006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 --2- 172.21.15.6:0/4244568193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44701576d0 0x7f447006f6c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f44680098e0 tx=0x7f44680091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 -- 172.21.15.6:0/4244568193 shutdown_connections 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 --2- 172.21.15.6:0/4244568193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44701576d0 0x7f447006f6c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 -- 172.21.15.6:0/4244568193 >> 172.21.15.6:0/4244568193 conn(0x7f44700c9ac0 msgr2=0x7f44700c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 -- 172.21.15.6:0/4244568193 shutdown_connections 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.623+0000 7f4475a03700 1 -- 172.21.15.6:0/4244568193 wait complete. 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.624+0000 7f4475a03700 1 Processor -- start 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.624+0000 7f4475a03700 1 -- start start 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f447006d2b0 0x7f447014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44701576d0 0x7f44700c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700addb0 con 0x7f447006db90 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700ad1a0 con 0x7f447006d2b0 2023-10-09T11:47:30.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f4475a03700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44700ad480 con 0x7f44701576d0 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36450/0 (socket says 172.21.15.6:36450) 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 -- 172.21.15.6:0/60416652 learned_addr learned my addr 172.21.15.6:0/60416652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446effd700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f447006d2b0 0x7f447014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446f7fe700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44701576d0 0x7f44700c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 -- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44701576d0 msgr2=0x7f44700c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44701576d0 0x7f44700c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 -- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f447006d2b0 msgr2=0x7f447014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f447006d2b0 0x7f447014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 -- 172.21.15.6:0/60416652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468009420 con 0x7f447006db90 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.625+0000 7f446e7fc700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f445800c7c0 tx=0x7f4458007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.626+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458005c00 con 0x7f447006db90 2023-10-09T11:47:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.626+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4458005d60 con 0x7f447006db90 2023-10-09T11:47:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.626+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44700ad760 con 0x7f447006db90 2023-10-09T11:47:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.626+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458007320 con 0x7f447006db90 2023-10-09T11:47:30.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.626+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4470150150 con 0x7f447006db90 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.627+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44700684b0 con 0x7f447006db90 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.627+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f445801b3b0 con 0x7f447006db90 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.627+0000 7f4466ffd700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.628+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4458083a10 con 0x7f447006db90 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.628+0000 7f446effd700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.628+0000 7f446effd700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 0x7f44500693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f44680093f0 tx=0x7f4468017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:30.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.632+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4458050c80 con 0x7f447006db90 2023-10-09T11:47:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.868+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44700abf70 con 0x7f447006db90 2023-10-09T11:47:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.869+0000 7f4466ffd700 1 -- 172.21.15.6:0/60416652 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f4458017070 con 0x7f447006db90 2023-10-09T11:47:30.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:30.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 msgr2=0x7f44500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 0x7f44500693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f44680093f0 tx=0x7f4468017000 comp rx=0 tx=0).stop 2023-10-09T11:47:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 msgr2=0x7f44700b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f445800c7c0 tx=0x7f4458007dd0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 shutdown_connections 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4450066f30 0x7f44500693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44701576d0 0x7f44700c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f447006d2b0 0x7f447014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 --2- 172.21.15.6:0/60416652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f447006db90 0x7f44700b2750 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 >> 172.21.15.6:0/60416652 conn(0x7f44700c9ac0 msgr2=0x7f447006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 shutdown_connections 2023-10-09T11:47:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:30.871+0000 7f4475a03700 1 -- 172.21.15.6:0/60416652 wait complete. 2023-10-09T11:47:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:30.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 Processor -- start 2023-10-09T11:47:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 -- start start 2023-10-09T11:47:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 0x7f6fcc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc06dac0 con 0x7f6fcc1578d0 2023-10-09T11:47:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0d07c0 con 0x7f6fcc06d120 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.003+0000 7f6fd1a4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0cfbb0 con 0x7f6fcc157ca0 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fcb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 0x7f6fcc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:56980/0 (socket says 172.21.15.6:56980) 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 -- 172.21.15.6:0/127625753 learned_addr learned my addr 172.21.15.6:0/127625753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fcb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 0x7f6fcc06d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:56432/0 (socket says 172.21.15.6:56432) 2023-10-09T11:47:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fcaffd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6fcc1578d0 0x7f6fcc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:33784/0 (socket says 172.21.15.6:33784) 2023-10-09T11:47:31.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 -- 172.21.15.6:0/127625753 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 msgr2=0x7f6fcc06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:31.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 --2- 172.21.15.6:0/127625753 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 0x7f6fcc06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 -- 172.21.15.6:0/127625753 >> v1:172.21.15.118:6789/0 conn(0x7f6fcc1578d0 legacy=0x7f6fcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fc9ffb700 1 -- 172.21.15.6:0/127625753 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979812381 0 0) 0x7f6fc4001490 con 0x7f6fcc1578d0 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 -- 172.21.15.6:0/127625753 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0cfe90 con 0x7f6fcc157ca0 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.004+0000 7f6fca7fc700 1 --2- 172.21.15.6:0/127625753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40099b0 tx=0x7f6fb4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ff6408d80389b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fc9ffb700 1 -- 172.21.15.6:0/127625753 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4009ea0 con 0x7f6fcc157ca0 2023-10-09T11:47:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fc9ffb700 1 -- 172.21.15.6:0/127625753 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400b860 con 0x7f6fcc157ca0 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fc9ffb700 1 -- 172.21.15.6:0/127625753 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400bc00 con 0x7f6fcc157ca0 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/127625753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 msgr2=0x7f6fcc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/127625753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40099b0 tx=0x7f6fb4009250 comp rx=0 tx=0).stop 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/127625753 shutdown_connections 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/127625753 >> v2:172.21.15.118:3300/0 conn(0x7f6fcc06d120 0x7f6fcc06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/127625753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc0cf4f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/127625753 >> 172.21.15.6:0/127625753 conn(0x7f6fcc06bb90 msgr2=0x7f6fcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/127625753 shutdown_connections 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.005+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/127625753 wait complete. 2023-10-09T11:47:31.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.006+0000 7f6fd1a4e700 1 Processor -- start 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.006+0000 7f6fd1a4e700 1 -- start start 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc1578d0 0x7f6fcc15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c6510 con 0x7f6fcc06d120 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c67b0 con 0x7f6fcc1578d0 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fd1a4e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c6a90 con 0x7f6fcc157ca0 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36466/0 (socket says 172.21.15.6:36466) 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.007+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1981018851 learned_addr learned my addr 172.21.15.6:0/1981018851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fca7fc700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc1578d0 0x7f6fcc15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 msgr2=0x7f6fcc15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc1578d0 msgr2=0x7f6fcc15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc1578d0 0x7f6fcc15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 -- 172.21.15.6:0/1981018851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40094f0 con 0x7f6fcc06d120 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcb7fe700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fcaffd700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cdd0 tx=0x7f6fc4001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4005df0 con 0x7f6fcc06d120 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400a960 con 0x7f6fcc06d120 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0c6d70 con 0x7f6fcc06d120 2023-10-09T11:47:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ad20 con 0x7f6fcc06d120 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.008+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0c8fc0 con 0x7f6fcc06d120 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.009+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc067ac0 con 0x7f6fcc06d120 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.009+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fc4007300 con 0x7f6fcc06d120 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.010+0000 7f6fc2ffd700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.010+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6fc4084600 con 0x7f6fcc06d120 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.010+0000 7f6fca7fc700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.010+0000 7f6fca7fc700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 0x7f6fac0693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40099b0 tx=0x7f6fb4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.014+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fc40518f0 con 0x7f6fcc06d120 2023-10-09T11:47:31.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.212+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fcc06dac0 con 0x7f6fcc06d120 2023-10-09T11:47:31.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.213+0000 7f6fc2ffd700 1 -- 172.21.15.6:0/1981018851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f6fcc06dac0 con 0x7f6fcc06d120 2023-10-09T11:47:31.214 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:31.214 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":181,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:47:25.989821+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 msgr2=0x7f6fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 0x7f6fac0693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40099b0 tx=0x7f6fb4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 msgr2=0x7f6fcc0c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cdd0 tx=0x7f6fc4001b90 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 shutdown_connections 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6fac066f30 0x7f6fac0693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fcc157ca0 0x7f6fcc15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fcc06d120 0x7f6fcc0c8a80 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 --2- 172.21.15.6:0/1981018851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fcc1578d0 0x7f6fcc15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 >> 172.21.15.6:0/1981018851 conn(0x7f6fcc06bb90 msgr2=0x7f6fcc156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 shutdown_connections 2023-10-09T11:47:31.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.215+0000 7f6fd1a4e700 1 -- 172.21.15.6:0/1981018851 wait complete. 2023-10-09T11:47:31.229 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:47:31.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.346+0000 7f6b2edf9700 1 Processor -- start 2023-10-09T11:47:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.346+0000 7f6b2edf9700 1 -- start start 2023-10-09T11:47:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.347+0000 7f6b2edf9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b2815a2a0 0x7f6b280b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.347+0000 7f6b2edf9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 0x7f6b280cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.347+0000 7f6b2edf9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280b0ca0 con 0x7f6b2806d650 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.347+0000 7f6b2edf9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2806ea90 con 0x7f6b2815a2a0 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.347+0000 7f6b2edf9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280cf4c0 con 0x7f6b280ceb30 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b2815a2a0 0x7f6b280b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b27fff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 0x7f6b280cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2d396700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6b2806d650 0x7f6b2806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:33794/0 (socket says 172.21.15.6:33794) 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2d396700 1 -- 172.21.15.6:0/121936852 learned_addr learned my addr 172.21.15.6:0/121936852 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 -- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 msgr2=0x7f6b280cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 0x7f6b280cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 -- 172.21.15.6:0/121936852 >> v1:172.21.15.118:6789/0 conn(0x7f6b2806d650 legacy=0x7f6b2806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 -- 172.21.15.6:0/121936852 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280b00d0 con 0x7f6b2815a2a0 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b277fe700 1 -- 172.21.15.6:0/121936852 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815640034 0 0) 0x7f6b280b0ca0 con 0x7f6b2806d650 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b27fff700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 0x7f6b280cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b2cb95700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2815a2a0 0x7f6b280b1130 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098e0 tx=0x7f6b200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5dd1e6d387f9be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b277fe700 1 -- 172.21.15.6:0/121936852 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000b640 con 0x7f6b2815a2a0 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b277fe700 1 -- 172.21.15.6:0/121936852 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000b7a0 con 0x7f6b2815a2a0 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.348+0000 7f6b277fe700 1 -- 172.21.15.6:0/121936852 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000bb40 con 0x7f6b2815a2a0 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 -- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2815a2a0 msgr2=0x7f6b280b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2815a2a0 0x7f6b280b1130 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098e0 tx=0x7f6b200091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 -- 172.21.15.6:0/121936852 shutdown_connections 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b2815a2a0 0x7f6b280b1130 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/121936852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b280ceb30 0x7f6b280cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 -- 172.21.15.6:0/121936852 >> 172.21.15.6:0/121936852 conn(0x7f6b28067640 msgr2=0x7f6b28067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 -- 172.21.15.6:0/121936852 shutdown_connections 2023-10-09T11:47:31.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.349+0000 7f6b2edf9700 1 -- 172.21.15.6:0/121936852 wait complete. 2023-10-09T11:47:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.350+0000 7f6b2edf9700 1 Processor -- start 2023-10-09T11:47:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.350+0000 7f6b2edf9700 1 -- start start 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d650 0x7f6b2815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b280ceb30 0x7f6b2815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28147d10 con 0x7f6b2815a2a0 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815cac0 con 0x7f6b280ceb30 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2edf9700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2815afd0 con 0x7f6b2806d650 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36470/0 (socket says 172.21.15.6:36470) 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 -- 172.21.15.6:0/1737907302 learned_addr learned my addr 172.21.15.6:0/1737907302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2cb95700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d650 0x7f6b2815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b27fff700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b280ceb30 0x7f6b2815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 -- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d650 msgr2=0x7f6b2815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d650 0x7f6b2815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 -- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b280ceb30 msgr2=0x7f6b2815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b280ceb30 0x7f6b2815a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.351+0000 7f6b2d396700 1 -- 172.21.15.6:0/1737907302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18009a20 con 0x7f6b2815a2a0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b2d396700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7e0 tx=0x7f6b10007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005c00 con 0x7f6b2815a2a0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10005d80 con 0x7f6b2815a2a0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b20009420 con 0x7f6b2815a2a0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10007320 con 0x7f6b2815a2a0 2023-10-09T11:47:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.352+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2815b590 con 0x7f6b2815a2a0 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.353+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b28069e40 con 0x7f6b2815a2a0 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.353+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b1001b3b0 con 0x7f6b2815a2a0 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.354+0000 7f6b24ff9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.354+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b10083ac0 con 0x7f6b2815a2a0 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.354+0000 7f6b2cb95700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.354+0000 7f6b2cb95700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 0x7f6b080693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6b200093f0 tx=0x7f6b20017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.358+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b10050c90 con 0x7f6b2815a2a0 2023-10-09T11:47:31.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.596+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b2804bb80 con 0x7f6b2815a2a0 2023-10-09T11:47:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.596+0000 7f6b24ff9700 1 -- 172.21.15.6:0/1737907302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f6b10017070 con 0x7f6b2815a2a0 2023-10-09T11:47:31.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:31.598 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 msgr2=0x7f6b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 0x7f6b080693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6b200093f0 tx=0x7f6b20017000 comp rx=0 tx=0).stop 2023-10-09T11:47:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 msgr2=0x7f6b281477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7e0 tx=0x7f6b10007d90 comp rx=0 tx=0).stop 2023-10-09T11:47:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 shutdown_connections 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f6b08066f30 0x7f6b080693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b2815a2a0 0x7f6b281477d0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b2806d650 0x7f6b2815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 --2- 172.21.15.6:0/1737907302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b280ceb30 0x7f6b2815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.598+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 >> 172.21.15.6:0/1737907302 conn(0x7f6b28067640 msgr2=0x7f6b280ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.599+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 shutdown_connections 2023-10-09T11:47:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.599+0000 7f6b2edf9700 1 -- 172.21.15.6:0/1737907302 wait complete. 2023-10-09T11:47:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:31.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:47:31.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.729+0000 7f3e7a27f700 1 Processor -- start 2023-10-09T11:47:31.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.729+0000 7f3e7a27f700 1 -- start start 2023-10-09T11:47:31.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7a27f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e7406d830 0x7f3e740cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7a27f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740d07c0 con 0x7f3e741578d0 2023-10-09T11:47:31.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7a27f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740cfbb0 con 0x7f3e74157ca0 2023-10-09T11:47:31.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7a27f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740cfe90 con 0x7f3e7406d830 2023-10-09T11:47:31.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e73fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3e741578d0 0x7f3e7415af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44968/0 (socket says 172.21.15.6:44968) 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e73fff700 1 -- 172.21.15.6:0/621520224 learned_addr learned my addr 172.21.15.6:0/621520224 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7881c700 1 --2- 172.21.15.6:0/621520224 >> v2:172.21.15.6:3300/0 conn(0x7f3e7406d830 0x7f3e740cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7881c700 1 -- 172.21.15.6:0/621520224 >> v1:172.21.15.118:6789/0 conn(0x7f3e74157ca0 legacy=0x7f3e7406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.730+0000 7f3e7881c700 1 -- 172.21.15.6:0/621520224 >> v1:172.21.15.6:6789/0 conn(0x7f3e741578d0 legacy=0x7f3e7415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e72ffd700 1 -- 172.21.15.6:0/621520224 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820553391 0 0) 0x7f3e740d07c0 con 0x7f3e741578d0 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7881c700 1 -- 172.21.15.6:0/621520224 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740d0170 con 0x7f3e7406d830 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7881c700 1 --2- 172.21.15.6:0/621520224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e7406d830 0x7f3e740cf4f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009e60 tx=0x7f3e6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149af0413dbb4e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e72ffd700 1 -- 172.21.15.6:0/621520224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00e070 con 0x7f3e7406d830 2023-10-09T11:47:31.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e72ffd700 1 -- 172.21.15.6:0/621520224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c00bc30 con 0x7f3e7406d830 2023-10-09T11:47:31.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e72ffd700 1 -- 172.21.15.6:0/621520224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c012430 con 0x7f3e7406d830 2023-10-09T11:47:31.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 -- 172.21.15.6:0/621520224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e7406d830 msgr2=0x7f3e740cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/621520224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e7406d830 0x7f3e740cf4f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009e60 tx=0x7f3e6c009780 comp rx=0 tx=0).stop 2023-10-09T11:47:31.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 -- 172.21.15.6:0/621520224 shutdown_connections 2023-10-09T11:47:31.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/621520224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e7406d830 0x7f3e740cf4f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 -- 172.21.15.6:0/621520224 >> 172.21.15.6:0/621520224 conn(0x7f3e7406bb90 msgr2=0x7f3e7406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 -- 172.21.15.6:0/621520224 shutdown_connections 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.731+0000 7f3e7a27f700 1 -- 172.21.15.6:0/621520224 wait complete. 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.732+0000 7f3e7a27f700 1 Processor -- start 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 -- start start 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 0x7f3e741598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e741578d0 0x7f3e740b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74152b20 con 0x7f3e74157ca0 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7414c0b0 con 0x7f3e7406d830 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.733+0000 7f3e7a27f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740b5e80 con 0x7f3e741578d0 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36486/0 (socket says 172.21.15.6:36486) 2023-10-09T11:47:31.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 -- 172.21.15.6:0/1181536917 learned_addr learned my addr 172.21.15.6:0/1181536917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e73fff700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 0x7f3e741598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e737fe700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e741578d0 0x7f3e740b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 -- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e741578d0 msgr2=0x7f3e740b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e741578d0 0x7f3e740b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 -- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 msgr2=0x7f3e741598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 0x7f3e741598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 -- 172.21.15.6:0/1181536917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009a20 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e73fff700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 0x7f3e741598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7881c700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b6c0 tx=0x7f3e6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c01b630 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c01b790 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c01bb50 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e74151ea0 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.734+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e74152740 con 0x7f3e74157ca0 2023-10-09T11:47:31.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.735+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e74152290 con 0x7f3e74157ca0 2023-10-09T11:47:31.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.736+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e6c01c400 con 0x7f3e74157ca0 2023-10-09T11:47:31.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.736+0000 7f3e5bfff700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:31.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.736+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e6c0864b0 con 0x7f3e74157ca0 2023-10-09T11:47:31.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.736+0000 7f3e73fff700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:31.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.736+0000 7f3e73fff700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 0x7f3e600693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3e640011e0 tx=0x7f3e64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:31.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.740+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e6c053720 con 0x7f3e74157ca0 2023-10-09T11:47:31.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.975+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e740b3ba0 con 0x7f3e74157ca0 2023-10-09T11:47:31.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.976+0000 7f3e5bfff700 1 -- 172.21.15.6:0/1181536917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f3e6c056d40 con 0x7f3e74157ca0 2023-10-09T11:47:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:31.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T11:46:53.398523+0000","modified":"2023-10-09T11:46:57.023203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8136},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8136":{"gid":8136,"name":"a","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/3906530469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":3906530469},{"type":"v1","addr":"172.21.15.6:6837","nonce":3906530469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-09T11:47:31.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 msgr2=0x7f3e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 0x7f3e600693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3e640011e0 tx=0x7f3e64009040 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 msgr2=0x7f3e74151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b6c0 tx=0x7f3e6c019000 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 shutdown_connections 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e74157ca0 0x7f3e74151620 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e7406d830 0x7f3e741598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 --2- 172.21.15.6:0/1181536917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e741578d0 0x7f3e740b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 >> 172.21.15.6:0/1181536917 conn(0x7f3e7406bb90 msgr2=0x7f3e74156830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 shutdown_connections 2023-10-09T11:47:31.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:31.978+0000 7f3e7a27f700 1 -- 172.21.15.6:0/1181536917 wait complete. 2023-10-09T11:47:31.981 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 92 2023-10-09T11:47:31.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.108+0000 7f73764e5700 1 Processor -- start 2023-10-09T11:47:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.108+0000 7f73764e5700 1 -- start start 2023-10-09T11:47:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f73764e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7370159f10 0x7f7370068780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f73764e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7370069120 con 0x7f7370068cc0 2023-10-09T11:47:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f73764e5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700cee10 con 0x7f7370159b40 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f73764e5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700cd040 con 0x7f7370159f10 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f7374ce2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7370159f10 0x7f7370068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f7375ce4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7370068cc0 0x7f73700cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44978/0 (socket says 172.21.15.6:44978) 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f7375ce4700 1 -- 172.21.15.6:0/1676082012 learned_addr learned my addr 172.21.15.6:0/1676082012 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f736ffff700 1 -- 172.21.15.6:0/1676082012 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287789078 0 0) 0x7f7360001490 con 0x7f7370068cc0 2023-10-09T11:47:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f736ffff700 1 -- 172.21.15.6:0/1676082012 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7358003570 con 0x7f7370068cc0 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f7374ce2700 1 -- 172.21.15.6:0/1676082012 >> v1:172.21.15.118:6789/0 conn(0x7f7370159b40 legacy=0x7f73700cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.109+0000 7f7374ce2700 1 -- 172.21.15.6:0/1676082012 >> v1:172.21.15.6:6789/0 conn(0x7f7370068cc0 legacy=0x7f73700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f7374ce2700 1 -- 172.21.15.6:0/1676082012 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700cd320 con 0x7f7370159f10 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f7374ce2700 1 --2- 172.21.15.6:0/1676082012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f7370068780 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f73640098e0 tx=0x7f73640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0414a7e5c01060d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f736ffff700 1 -- 172.21.15.6:0/1676082012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364011630 con 0x7f7370159f10 2023-10-09T11:47:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f736ffff700 1 -- 172.21.15.6:0/1676082012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364011790 con 0x7f7370159f10 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f736ffff700 1 -- 172.21.15.6:0/1676082012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364011b30 con 0x7f7370159f10 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 -- 172.21.15.6:0/1676082012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 msgr2=0x7f7370068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 --2- 172.21.15.6:0/1676082012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f7370068780 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f73640098e0 tx=0x7f73640091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 -- 172.21.15.6:0/1676082012 shutdown_connections 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 --2- 172.21.15.6:0/1676082012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f7370068780 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 -- 172.21.15.6:0/1676082012 >> 172.21.15.6:0/1676082012 conn(0x7f73700cd660 msgr2=0x7f73700cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 -- 172.21.15.6:0/1676082012 shutdown_connections 2023-10-09T11:47:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.110+0000 7f73764e5700 1 -- 172.21.15.6:0/1676082012 wait complete. 2023-10-09T11:47:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.111+0000 7f73764e5700 1 Processor -- start 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.111+0000 7f73764e5700 1 -- start start 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 0x7f7370158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7370159b40 0x7f73700c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701482c0 con 0x7f7370159f10 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701476b0 con 0x7f7370159b40 2023-10-09T11:47:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f73764e5700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7370147990 con 0x7f7370068cc0 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f7375ce4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f7375ce4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36500/0 (socket says 172.21.15.6:36500) 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.112+0000 7f7375ce4700 1 -- 172.21.15.6:0/1893646548 learned_addr learned my addr 172.21.15.6:0/1893646548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f73754e3700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 0x7f7370158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 -- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 msgr2=0x7f7370158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7374ce2700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7370159b40 0x7f73700c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 0x7f7370158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 -- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7370159b40 msgr2=0x7f73700c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7370159b40 0x7f73700c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 -- 172.21.15.6:0/1893646548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364009420 con 0x7f7370159f10 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f73754e3700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 0x7f7370158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f7375ce4700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f736000cd00 tx=0x7f7360001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736000ab70 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736000acd0 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370147c70 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360007300 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.113+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7370158990 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.114+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7370148430 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.114+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73600076f0 con 0x7f7370159f10 2023-10-09T11:47:32.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.115+0000 7f736d7fa700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 0x7f735c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.115+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7360084880 con 0x7f7370159f10 2023-10-09T11:47:32.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.115+0000 7f73754e3700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 0x7f735c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.115+0000 7f73754e3700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 0x7f735c069410 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7368002880 tx=0x7f7368009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.119+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7360051ae0 con 0x7f7370159f10 2023-10-09T11:47:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.312+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7370069120 con 0x7f7370159f10 2023-10-09T11:47:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.313+0000 7f736d7fa700 1 -- 172.21.15.6:0/1893646548 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+15324 (secure 0 0 0) 0x7f7370069120 con 0x7f7370159f10 2023-10-09T11:47:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:32.315 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":181,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:47:25.989821+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-09T11:46:51.111141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-09T11:46:52.381082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 msgr2=0x7f735c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 0x7f735c069410 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7368002880 tx=0x7f7368009040 comp rx=0 tx=0).stop 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 msgr2=0x7f73700c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f736000cd00 tx=0x7f7360001ad0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 shutdown_connections 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f735c066f60 0x7f735c069410 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7370159f10 0x7f73700c9c70 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7370068cc0 0x7f7370158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 --2- 172.21.15.6:0/1893646548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7370159b40 0x7f73700c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 >> 172.21.15.6:0/1893646548 conn(0x7f73700cd660 msgr2=0x7f737006eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 shutdown_connections 2023-10-09T11:47:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.315+0000 7f73764e5700 1 -- 172.21.15.6:0/1893646548 wait complete. 2023-10-09T11:47:32.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T11:47:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.447+0000 7fdbb5386700 1 Processor -- start 2023-10-09T11:47:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.447+0000 7fdbb5386700 1 -- start start 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbb5386700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb0159a90 0x7fdbb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbb5386700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb0159e60 0x7fdbb006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbb5386700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb006e280 con 0x7fdbb00691f0 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbb5386700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb0068d60 con 0x7fdbb0159e60 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbb5386700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb006a9a0 con 0x7fdbb0159a90 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb0159e60 0x7fdbb006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb0159e60 0x7fdbb006a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36502/0 (socket says 172.21.15.6:36502) 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 -- 172.21.15.6:0/2839325802 learned_addr learned my addr 172.21.15.6:0/2839325802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbaeffd700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb0159a90 0x7fdbb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 -- 172.21.15.6:0/2839325802 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb0159a90 msgr2=0x7fdbb006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb0159a90 0x7fdbb006d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.448+0000 7fdbae7fc700 1 -- 172.21.15.6:0/2839325802 >> v1:172.21.15.118:6789/0 conn(0x7fdbb00691f0 legacy=0x7fdbb00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbae7fc700 1 -- 172.21.15.6:0/2839325802 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb006dfa0 con 0x7fdbb0159e60 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbae7fc700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159e60 0x7fdbb006a460 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdb980099b0 tx=0x7fdb98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390317790fe871c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbadffb700 1 -- 172.21.15.6:0/2839325802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98009ea0 con 0x7fdbb0159e60 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbadffb700 1 -- 172.21.15.6:0/2839325802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800b860 con 0x7fdbb0159e60 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbadffb700 1 -- 172.21.15.6:0/2839325802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800bc20 con 0x7fdbb0159e60 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 -- 172.21.15.6:0/2839325802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159e60 msgr2=0x7fdbb006a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159e60 0x7fdbb006a460 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fdb980099b0 tx=0x7fdb98009250 comp rx=0 tx=0).stop 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 -- 172.21.15.6:0/2839325802 shutdown_connections 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb0159a90 0x7fdbb006d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 --2- 172.21.15.6:0/2839325802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159e60 0x7fdbb006a460 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 -- 172.21.15.6:0/2839325802 >> 172.21.15.6:0/2839325802 conn(0x7fdbb006bb90 msgr2=0x7fdbb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 -- 172.21.15.6:0/2839325802 shutdown_connections 2023-10-09T11:47:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.449+0000 7fdbb5386700 1 -- 172.21.15.6:0/2839325802 wait complete. 2023-10-09T11:47:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 Processor -- start 2023-10-09T11:47:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 -- start start 2023-10-09T11:47:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb00691f0 0x7fdbb0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0159e60 0x7fdbb0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00cc370 con 0x7fdbb0159a90 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00c7b80 con 0x7fdbb0159e60 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbb5386700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00ca560 con 0x7fdbb00691f0 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbae7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.451+0000 7fdbae7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36518/0 (socket says 172.21.15.6:36518) 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 -- 172.21.15.6:0/3831523502 learned_addr learned my addr 172.21.15.6:0/3831523502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbaeffd700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb00691f0 0x7fdbb0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbaf7fe700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0159e60 0x7fdbb0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 -- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb00691f0 msgr2=0x7fdbb0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb00691f0 0x7fdbb0154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 -- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0159e60 msgr2=0x7fdbb0158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0159e60 0x7fdbb0158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 -- 172.21.15.6:0/3831523502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980094f0 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbae7fc700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0063da0 tx=0x7fdb98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9801f070 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800b9d0 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb00c7530 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98011420 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.452+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb00ca840 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.453+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb00c7d30 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.454+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb98011830 con 0x7fdbb0159a90 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.454+0000 7fdba6ffd700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 0x7fdb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.454+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb98085880 con 0x7fdbb0159a90 2023-10-09T11:47:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.454+0000 7fdbaeffd700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 0x7fdb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.454+0000 7fdbaeffd700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 0x7fdb900693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009db0 tx=0x7fdba80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.458+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbb00c7d30 con 0x7fdbb0159a90 2023-10-09T11:47:32.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.695+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdbb00c7cf0 con 0x7fdbb0159a90 2023-10-09T11:47:32.697 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-10-09T11:47:32.696+0000 7ff16d325700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T11:47:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.701+0000 7fdba6ffd700 1 -- 172.21.15.6:0/3831523502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdb98052b70 con 0x7fdbb0159a90 2023-10-09T11:47:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 msgr2=0x7fdb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 0x7fdb900693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009db0 tx=0x7fdba80091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 msgr2=0x7fdbb00cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0063da0 tx=0x7fdb98017000 comp rx=0 tx=0).stop 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 shutdown_connections 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fdb90066f30 0x7fdb900693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0159e60 0x7fdbb0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbb00691f0 0x7fdbb0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 --2- 172.21.15.6:0/3831523502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb0159a90 0x7fdbb00cbe30 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 >> 172.21.15.6:0/3831523502 conn(0x7fdbb006bb90 msgr2=0x7fdbb00b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 shutdown_connections 2023-10-09T11:47:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.704+0000 7fdbb5386700 1 -- 172.21.15.6:0/3831523502 wait complete. 2023-10-09T11:47:32.707 INFO:tasks.ceph.mds.a.smithi006.stderr: -7820> 2023-10-09T11:46:58.626+0000 7f8fc3c80700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T11:47:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T11:47:32.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T11:47:32.734 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-10-09T11:47:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 Processor -- start 2023-10-09T11:47:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 -- start start 2023-10-09T11:47:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480d07c0 con 0x7fa248157ca0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480cfbb0 con 0x7fa2481578d0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.838+0000 7fa24e1d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480cfe90 con 0x7fa24806d830 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa246ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa248157ca0 0x7fa24806d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44980/0 (socket says 172.21.15.6:44980) 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa246ffd700 1 -- 172.21.15.6:0/3888442360 learned_addr learned my addr 172.21.15.6:0/3888442360 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa247fff700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358840310 0 0) 0x7fa2480d07c0 con 0x7fa248157ca0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa230003570 con 0x7fa248157ca0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208372188 0 0) 0x7fa230003570 con 0x7fa248157ca0 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 msgr2=0x7fa2480cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2480cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 >> v1:172.21.15.118:6789/0 conn(0x7fa2481578d0 legacy=0x7fa24815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480d0170 con 0x7fa248157ca0 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7fa23c001470 con 0x7fa248157ca0 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa247fff700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2480cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 >> v1:172.21.15.6:6789/0 conn(0x7fa248157ca0 legacy=0x7fa24806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230003a90 0x7fa230003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230004810 0x7fa230004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480cfe90 con 0x7fa230004810 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000bb10 con 0x7fa230003a90 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23000bc80 con 0x7fa24806d830 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa246ffd700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230004810 0x7fa230004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa2477fe700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230003a90 0x7fa230003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.839+0000 7fa247fff700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 -- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 msgr2=0x7fa2300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24806d830 0x7fa2300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 -- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230003a90 msgr2=0x7fa230003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230003a90 0x7fa230003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 -- 172.21.15.6:0/3888442360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009a20 con 0x7fa230004810 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa246ffd700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230004810 0x7fa230004c80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa2481580c0 tx=0x7fa24815b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172abae18ffbc319 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00cbd0 con 0x7fa230004810 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00cd30 con 0x7fa230004810 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa2467fc700 1 -- 172.21.15.6:0/3888442360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00cea0 con 0x7fa230004810 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa24e1d3700 1 -- 172.21.15.6:0/3888442360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230004810 msgr2=0x7fa230004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/3888442360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230004810 0x7fa230004c80 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa2481580c0 tx=0x7fa24815b610 comp rx=0 tx=0).stop 2023-10-09T11:47:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.840+0000 7fa247fff700 1 -- 172.21.15.6:0/3888442360 reap_dead start 2023-10-09T11:47:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.841+0000 7fa24e1d3700 1 -- 172.21.15.6:0/3888442360 shutdown_connections 2023-10-09T11:47:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.841+0000 7fa24e1d3700 1 -- 172.21.15.6:0/3888442360 >> 172.21.15.6:0/3888442360 conn(0x7fa24806bb90 msgr2=0x7fa24806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.841+0000 7fa24e1d3700 1 -- 172.21.15.6:0/3888442360 shutdown_connections 2023-10-09T11:47:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.841+0000 7fa24e1d3700 1 -- 172.21.15.6:0/3888442360 wait complete. 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.842+0000 7fa24e1d3700 1 Processor -- start 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.842+0000 7fa24e1d3700 1 -- start start 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.842+0000 7fa24e1d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230004810 0x7fa24814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.842+0000 7fa24e1d3700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24814cc00 0x7fa24815c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24816a6a0 con 0x7fa24814d070 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248153f10 con 0x7fa230004810 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24814ee80 con 0x7fa24814cc00 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36566/0 (socket says 172.21.15.6:36566) 2023-10-09T11:47:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 -- 172.21.15.6:0/2390613092 learned_addr learned my addr 172.21.15.6:0/2390613092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa246ffd700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24814cc00 0x7fa24815c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa2477fe700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230004810 0x7fa24814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 -- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24814cc00 msgr2=0x7fa24815c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24814cc00 0x7fa24815c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 -- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230004810 msgr2=0x7fa24814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230004810 0x7fa24814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 -- 172.21.15.6:0/2390613092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248153950 con 0x7fa24814d070 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa247fff700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa24806dc30 tx=0x7fa24000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000e040 con 0x7fa24814d070 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24000f040 con 0x7fa24814d070 2023-10-09T11:47:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248153c30 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000fe80 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.843+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248151110 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.844+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248151330 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.845+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa240015640 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.845+0000 7fa22f7fe700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 0x7fa2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.845+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa2400848e0 con 0x7fa24814d070 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.845+0000 7fa2477fe700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 0x7fa2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.846+0000 7fa2477fe700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 0x7fa2340693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa24815a1e0 tx=0x7fa238007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:32.849+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa240051b00 con 0x7fa24814d070 2023-10-09T11:47:33.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.085+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2480d0450 con 0x7fa24814d070 2023-10-09T11:47:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.701+0000 7fa22f7fe700 1 -- 172.21.15.6:0/2390613092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa240055120 con 0x7fa24814d070 2023-10-09T11:47:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 msgr2=0x7fa2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 0x7fa2340693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa24815a1e0 tx=0x7fa238007d10 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 msgr2=0x7fa24815cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa24806dc30 tx=0x7fa24000b040 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 shutdown_connections 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa234066f30 0x7fa2340693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24814d070 0x7fa24815cd20 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa230004810 0x7fa24814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 --2- 172.21.15.6:0/2390613092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa24814cc00 0x7fa24815c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 >> 172.21.15.6:0/2390613092 conn(0x7fa24806bb90 msgr2=0x7fa24806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:33.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 shutdown_connections 2023-10-09T11:47:33.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.704+0000 7fa24e1d3700 1 -- 172.21.15.6:0/2390613092 wait complete. 2023-10-09T11:47:33.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T11:47:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.883+0000 7fbff49ac700 1 Processor -- start 2023-10-09T11:47:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.883+0000 7fbff49ac700 1 -- start start 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbff49ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbff49ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 0x7fbff006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbff49ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff006dac0 con 0x7fbff0157ca0 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbff49ac700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00d07c0 con 0x7fbff006d120 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbff49ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00cfbb0 con 0x7fbff01578d0 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbfedd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbff0157ca0 0x7fbff015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35678/0 (socket says 172.21.15.6:35678) 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.884+0000 7fbfedd9b700 1 -- 172.21.15.6:0/3868313365 learned_addr learned my addr 172.21.15.6:0/3868313365 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 --2- 172.21.15.6:0/3868313365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfeed9d700 1 --2- 172.21.15.6:0/3868313365 >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 0x7fbff006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805446775 0 0) 0x7fbfd8001110 con 0x7fbff0157ca0 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfdc003570 con 0x7fbff0157ca0 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 -- 172.21.15.6:0/3868313365 >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 msgr2=0x7fbff006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 --2- 172.21.15.6:0/3868313365 >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 0x7fbff006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362347364 0 0) 0x7fbfdc003570 con 0x7fbff0157ca0 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 -- 172.21.15.6:0/3868313365 >> v1:172.21.15.6:6789/0 conn(0x7fbff0157ca0 legacy=0x7fbff015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 -- 172.21.15.6:0/3868313365 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00cfe90 con 0x7fbff01578d0 2023-10-09T11:47:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfeed9d700 1 --2- 172.21.15.6:0/3868313365 >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 0x7fbff006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfee59c700 1 --2- 172.21.15.6:0/3868313365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00cf4f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009e60 tx=0x7fbfe0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b863c1b2d8f76112 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000e070 con 0x7fbff01578d0 2023-10-09T11:47:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000b7a0 con 0x7fbff01578d0 2023-10-09T11:47:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.885+0000 7fbfed59a700 1 -- 172.21.15.6:0/3868313365 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8001600 con 0x7fbff01578d0 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 -- 172.21.15.6:0/3868313365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 msgr2=0x7fbff00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 --2- 172.21.15.6:0/3868313365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00cf4f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009e60 tx=0x7fbfe0009780 comp rx=0 tx=0).stop 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 -- 172.21.15.6:0/3868313365 shutdown_connections 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 --2- 172.21.15.6:0/3868313365 >> v2:172.21.15.118:3300/0 conn(0x7fbff006d120 0x7fbff006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 --2- 172.21.15.6:0/3868313365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00cf4f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 -- 172.21.15.6:0/3868313365 >> 172.21.15.6:0/3868313365 conn(0x7fbff006bb90 msgr2=0x7fbff006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 -- 172.21.15.6:0/3868313365 shutdown_connections 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.886+0000 7fbff49ac700 1 -- 172.21.15.6:0/3868313365 wait complete. 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.887+0000 7fbff49ac700 1 Processor -- start 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.887+0000 7fbff49ac700 1 -- start start 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 0x7fbff0153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00b6aa0 con 0x7fbff006d120 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff015c0b0 con 0x7fbff0157ca0 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbff49ac700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00b67c0 con 0x7fbff01578d0 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39640/0 (socket says 172.21.15.6:39640) 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 -- 172.21.15.6:0/2005113348 learned_addr learned my addr 172.21.15.6:0/2005113348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfedd9b700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfeed9d700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 0x7fbff0153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 -- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 msgr2=0x7fbff00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 -- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 msgr2=0x7fbff0153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 0x7fbff0153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 -- 172.21.15.6:0/2005113348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8009420 con 0x7fbff006d120 2023-10-09T11:47:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfedd9b700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfeed9d700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 0x7fbff0153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.888+0000 7fbfee59c700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fbff0068330 tx=0x7fbfe0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.889+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0012c50 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.889+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0012db0 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.889+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe0009a20 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.889+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe001d680 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.889+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff015bd40 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.890+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff015b8c0 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.890+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfe0024070 con 0x7fbff006d120 2023-10-09T11:47:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.890+0000 7fbfe67fc700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.891+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbfe0086690 con 0x7fbff006d120 2023-10-09T11:47:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.891+0000 7fbfedd9b700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.891+0000 7fbfedd9b700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 0x7fbfd00693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80017b0 tx=0x7fbfd8001650 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:33.895+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbff015b8c0 con 0x7fbff006d120 2023-10-09T11:47:34.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.089+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbff015b8c0 con 0x7fbff006d120 2023-10-09T11:47:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.702+0000 7fbfe67fc700 1 -- 172.21.15.6:0/2005113348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v183) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbff015b8c0 con 0x7fbff006d120 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 msgr2=0x7fbfd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 0x7fbfd00693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80017b0 tx=0x7fbfd8001650 comp rx=0 tx=0).stop 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 msgr2=0x7fbff0145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fbff0068330 tx=0x7fbfe0018000 comp rx=0 tx=0).stop 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 shutdown_connections 2023-10-09T11:47:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fbfd0066f30 0x7fbfd00693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbff0157ca0 0x7fbff0153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff006d120 0x7fbff0145010 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 --2- 172.21.15.6:0/2005113348 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbff01578d0 0x7fbff00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 >> 172.21.15.6:0/2005113348 conn(0x7fbff006bb90 msgr2=0x7fbff01558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 shutdown_connections 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.705+0000 7fbff49ac700 1 -- 172.21.15.6:0/2005113348 wait complete. 2023-10-09T11:47:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-09T11:47:34.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T11:47:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.844+0000 7f4bd1b83700 1 Processor -- start 2023-10-09T11:47:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.844+0000 7f4bd1b83700 1 -- start start 2023-10-09T11:47:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.845+0000 7f4bd1b83700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.845+0000 7f4bd1b83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 0x7f4bcc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.845+0000 7f4bd1b83700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0d07c0 con 0x7f4bcc1578d0 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.845+0000 7f4bd1b83700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc06daa0 con 0x7f4bcc157ca0 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.845+0000 7f4bd1b83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cfbb0 con 0x7f4bcc06d120 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcbfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 0x7f4bcc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcb7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4bcc1578d0 0x7f4bcc15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.6:37760/0 (socket says 172.21.15.6:37760) 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.6:58938/0 (socket says 172.21.15.6:58938) 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcb7fe700 1 -- 172.21.15.6:0/33091535 learned_addr learned my addr 172.21.15.6:0/33091535 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bca7fc700 1 -- 172.21.15.6:0/33091535 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788248401 0 0) 0x7f4bcc0d07c0 con 0x7f4bcc1578d0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bca7fc700 1 -- 172.21.15.6:0/33091535 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb4003570 con 0x7f4bcc1578d0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 -- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 msgr2=0x7f4bcc06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 0x7f4bcc06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 -- 172.21.15.6:0/33091535 >> v1:172.21.15.118:6789/0 conn(0x7f4bcc1578d0 legacy=0x7f4bcc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 -- 172.21.15.6:0/33091535 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0cfe90 con 0x7f4bcc157ca0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcbfff700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 0x7f4bcc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bcaffd700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098e0 tx=0x7f4bc00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e966d7991acaa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bca7fc700 1 -- 172.21.15.6:0/33091535 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011630 con 0x7f4bcc157ca0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bca7fc700 1 -- 172.21.15.6:0/33091535 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0011790 con 0x7f4bcc157ca0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.846+0000 7f4bca7fc700 1 -- 172.21.15.6:0/33091535 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011b30 con 0x7f4bcc157ca0 2023-10-09T11:47:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 -- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc157ca0 msgr2=0x7f4bcc0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098e0 tx=0x7f4bc00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 -- 172.21.15.6:0/33091535 shutdown_connections 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc06d120 0x7f4bcc06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/33091535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc157ca0 0x7f4bcc0cf4f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 -- 172.21.15.6:0/33091535 >> 172.21.15.6:0/33091535 conn(0x7f4bcc06bb90 msgr2=0x7f4bcc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 -- 172.21.15.6:0/33091535 shutdown_connections 2023-10-09T11:47:34.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.847+0000 7f4bd1b83700 1 -- 172.21.15.6:0/33091535 wait complete. 2023-10-09T11:47:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.848+0000 7f4bd1b83700 1 Processor -- start 2023-10-09T11:47:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.848+0000 7f4bd1b83700 1 -- start start 2023-10-09T11:47:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc06d120 0x7f4bcc1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc157ca0 0x7f4bcc0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b6a90 con 0x7f4bcc1578d0 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0ad1a0 con 0x7f4bcc06d120 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bd1b83700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b67b0 con 0x7f4bcc157ca0 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39648/0 (socket says 172.21.15.6:39648) 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc06d120 0x7f4bcc1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 -- 172.21.15.6:0/324078634 learned_addr learned my addr 172.21.15.6:0/324078634 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcbfff700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc157ca0 0x7f4bcc0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 -- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc157ca0 msgr2=0x7f4bcc0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc157ca0 0x7f4bcc0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 -- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc06d120 msgr2=0x7f4bcc1538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc06d120 0x7f4bcc1538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.849+0000 7f4bcaffd700 1 -- 172.21.15.6:0/324078634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009a20 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bcaffd700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0013000 tx=0x7f4bc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011b10 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0000cc0 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc0009420 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0025620 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.850+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc0ace30 con 0x7f4bcc1578d0 2023-10-09T11:47:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.851+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc0ad330 con 0x7f4bcc1578d0 2023-10-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.851+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bc0025a10 con 0x7f4bcc1578d0 2023-10-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.852+0000 7f4bb37fe700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 0x7f4bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.852+0000 7f4bcb7fe700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 0x7f4bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.852+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f4bc0085a20 con 0x7f4bcc1578d0 2023-10-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.852+0000 7f4bcb7fe700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 0x7f4bb80693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007fd0 tx=0x7f4bbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:34.856+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bc0052eb0 con 0x7f4bcc1578d0 2023-10-09T11:47:35.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.048+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bcc0d0170 con 0x7f4bcc1578d0 2023-10-09T11:47:35.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:35.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:47:35.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.706+0000 7f4bb37fe700 1 -- 172.21.15.6:0/324078634 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v184) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4bc00564d0 con 0x7f4bcc1578d0 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.709+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 msgr2=0x7f4bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.709+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 0x7f4bb80693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007fd0 tx=0x7f4bbc009040 comp rx=0 tx=0).stop 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.709+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 msgr2=0x7f4bcc0aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.709+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0013000 tx=0x7f4bc0017000 comp rx=0 tx=0).stop 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 shutdown_connections 2023-10-09T11:47:35.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4bb8066f30 0x7f4bb80693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bcc157ca0 0x7f4bcc0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bcc06d120 0x7f4bcc1538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 --2- 172.21.15.6:0/324078634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc1578d0 0x7f4bcc0aa890 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 >> 172.21.15.6:0/324078634 conn(0x7f4bcc06bb90 msgr2=0x7f4bcc070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 shutdown_connections 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.710+0000 7f4bd1b83700 1 -- 172.21.15.6:0/324078634 wait complete. 2023-10-09T11:47:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-09T11:47:35.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T11:47:35.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.855+0000 7f3be9fe4700 1 Processor -- start 2023-10-09T11:47:35.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.855+0000 7f3be9fe4700 1 -- start start 2023-10-09T11:47:35.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be9fe4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be41578d0 0x7f3be40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be9fe4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3be406d120 0x7f3be406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be9fe4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be40d07c0 con 0x7f3be4157ca0 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be9fe4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be406da50 con 0x7f3be41578d0 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be9fe4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be40cfbb0 con 0x7f3be406d120 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be41578d0 0x7f3be40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be41578d0 0x7f3be40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39650/0 (socket says 172.21.15.6:39650) 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 -- 172.21.15.6:0/3281069298 learned_addr learned my addr 172.21.15.6:0/3281069298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be3fff700 1 --2- 172.21.15.6:0/3281069298 >> v2:172.21.15.118:3300/0 conn(0x7f3be406d120 0x7f3be406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 -- 172.21.15.6:0/3281069298 >> v2:172.21.15.118:3300/0 conn(0x7f3be406d120 msgr2=0x7f3be406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:35.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 --2- 172.21.15.6:0/3281069298 >> v2:172.21.15.118:3300/0 conn(0x7f3be406d120 0x7f3be406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 -- 172.21.15.6:0/3281069298 >> v1:172.21.15.118:6789/0 conn(0x7f3be4157ca0 legacy=0x7f3be415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 -- 172.21.15.6:0/3281069298 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40cfe90 con 0x7f3be41578d0 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.856+0000 7f3be37fe700 1 --2- 172.21.15.6:0/3281069298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be41578d0 0x7f3be40cf4f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3be4068300 tx=0x7f3bd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd090ebae752507 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be27fc700 1 -- 172.21.15.6:0/3281069298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400e070 con 0x7f3be41578d0 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be27fc700 1 -- 172.21.15.6:0/3281069298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd400ba10 con 0x7f3be41578d0 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be27fc700 1 -- 172.21.15.6:0/3281069298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40092e0 con 0x7f3be41578d0 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 -- 172.21.15.6:0/3281069298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be41578d0 msgr2=0x7f3be40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/3281069298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be41578d0 0x7f3be40cf4f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3be4068300 tx=0x7f3bd4009840 comp rx=0 tx=0).stop 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 -- 172.21.15.6:0/3281069298 shutdown_connections 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/3281069298 >> v2:172.21.15.118:3300/0 conn(0x7f3be406d120 0x7f3be406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/3281069298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be41578d0 0x7f3be40cf4f0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 -- 172.21.15.6:0/3281069298 >> 172.21.15.6:0/3281069298 conn(0x7f3be406bb90 msgr2=0x7f3be406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 -- 172.21.15.6:0/3281069298 shutdown_connections 2023-10-09T11:47:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.857+0000 7f3be9fe4700 1 -- 172.21.15.6:0/3281069298 wait complete. 2023-10-09T11:47:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.858+0000 7f3be9fe4700 1 Processor -- start 2023-10-09T11:47:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.858+0000 7f3be9fe4700 1 -- start start 2023-10-09T11:47:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 0x7f3be415cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3be41578d0 0x7f3be416a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be416e340 con 0x7f3be4157ca0 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40ad540 con 0x7f3be41578d0 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be9fe4700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40aa9c0 con 0x7f3be406d120 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39658/0 (socket says 172.21.15.6:39658) 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 -- 172.21.15.6:0/1557874102 learned_addr learned my addr 172.21.15.6:0/1557874102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be2ffd700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3be41578d0 0x7f3be416a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be37fe700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 0x7f3be415cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 -- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 msgr2=0x7f3be415cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 0x7f3be415cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 -- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3be41578d0 msgr2=0x7f3be416a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.859+0000 7f3be3fff700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3be41578d0 0x7f3be416a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3be3fff700 1 -- 172.21.15.6:0/1557874102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009ae0 con 0x7f3be4157ca0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3be37fe700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 0x7f3be415cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3be3fff700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c880 tx=0x7f3bdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011600 con 0x7f3be4157ca0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011760 con 0x7f3be4157ca0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be40aaca0 con 0x7f3be4157ca0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011b00 con 0x7f3be4157ca0 2023-10-09T11:47:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.860+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be40ad820 con 0x7f3be4157ca0 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.861+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be4067ac0 con 0x7f3be4157ca0 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.861+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bdc018350 con 0x7f3be4157ca0 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.861+0000 7f3bdb7fe700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.862+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3bdc0841e0 con 0x7f3be4157ca0 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.862+0000 7f3be37fe700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.862+0000 7f3be37fe700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 0x7f3bc40693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009ab0 tx=0x7f3bd4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:35.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:35.866+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bdc0516b0 con 0x7f3be4157ca0 2023-10-09T11:47:36.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.058+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3be40d0170 con 0x7f3be4157ca0 2023-10-09T11:47:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.061+0000 7f3bdb7fe700 1 -- 172.21.15.6:0/1557874102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bdc054cd0 con 0x7f3be4157ca0 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 msgr2=0x7f3bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 0x7f3bc40693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009ab0 tx=0x7f3bd4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 msgr2=0x7f3be40ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c880 tx=0x7f3bdc008040 comp rx=0 tx=0).stop 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 shutdown_connections 2023-10-09T11:47:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f3bc4066f30 0x7f3bc40693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be4157ca0 0x7f3be40ac980 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3be406d120 0x7f3be415cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 --2- 172.21.15.6:0/1557874102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3be41578d0 0x7f3be416a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.063+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 >> 172.21.15.6:0/1557874102 conn(0x7f3be406bb90 msgr2=0x7f3be4155e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.064+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 shutdown_connections 2023-10-09T11:47:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.064+0000 7f3be9fe4700 1 -- 172.21.15.6:0/1557874102 wait complete. 2023-10-09T11:47:36.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-09T11:47:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.194+0000 7fa6fc551700 1 Processor -- start 2023-10-09T11:47:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.195+0000 7fa6fc551700 1 -- start start 2023-10-09T11:47:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.195+0000 7fa6fc551700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6f41578d0 0x7fa6f40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6fc551700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6f406d120 0x7fa6f406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6fc551700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40d07c0 con 0x7fa6f4157ca0 2023-10-09T11:47:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6fc551700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f406da50 con 0x7fa6f406d120 2023-10-09T11:47:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6fc551700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40cfbb0 con 0x7fa6f41578d0 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6f406d120 0x7fa6f406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6f406d120 0x7fa6f406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39674/0 (socket says 172.21.15.6:39674) 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 -- 172.21.15.6:0/3008414866 learned_addr learned my addr 172.21.15.6:0/3008414866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6fa2ed700 1 --2- 172.21.15.6:0/3008414866 >> v2:172.21.15.118:3300/0 conn(0x7fa6f41578d0 0x7fa6f40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 -- 172.21.15.6:0/3008414866 >> v2:172.21.15.118:3300/0 conn(0x7fa6f41578d0 msgr2=0x7fa6f40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 --2- 172.21.15.6:0/3008414866 >> v2:172.21.15.118:3300/0 conn(0x7fa6f41578d0 0x7fa6f40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 -- 172.21.15.6:0/3008414866 >> v1:172.21.15.118:6789/0 conn(0x7fa6f4157ca0 legacy=0x7fa6f415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 -- 172.21.15.6:0/3008414866 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40cfe90 con 0x7fa6f406d120 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6faaee700 1 --2- 172.21.15.6:0/3008414866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f406d510 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40646b0 tx=0x7fa6e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded857cb1f79f866 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6f92eb700 1 -- 172.21.15.6:0/3008414866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400e070 con 0x7fa6f406d120 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6f92eb700 1 -- 172.21.15.6:0/3008414866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e400ba20 con 0x7fa6f406d120 2023-10-09T11:47:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.196+0000 7fa6f92eb700 1 -- 172.21.15.6:0/3008414866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40092e0 con 0x7fa6f406d120 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 -- 172.21.15.6:0/3008414866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 msgr2=0x7fa6f406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3008414866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f406d510 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40646b0 tx=0x7fa6e4009840 comp rx=0 tx=0).stop 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 -- 172.21.15.6:0/3008414866 shutdown_connections 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3008414866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f406d510 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3008414866 >> v2:172.21.15.118:3300/0 conn(0x7fa6f41578d0 0x7fa6f40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 -- 172.21.15.6:0/3008414866 >> 172.21.15.6:0/3008414866 conn(0x7fa6f406bb90 msgr2=0x7fa6f406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 -- 172.21.15.6:0/3008414866 shutdown_connections 2023-10-09T11:47:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.197+0000 7fa6fc551700 1 -- 172.21.15.6:0/3008414866 wait complete. 2023-10-09T11:47:36.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.198+0000 7fa6fc551700 1 Processor -- start 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.198+0000 7fa6fc551700 1 -- start start 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6f41578d0 0x7fa6f40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4157ca0 0x7fa6f40b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4153f40 con 0x7fa6f406d120 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b4760 con 0x7fa6f4157ca0 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fc551700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b4de0 con 0x7fa6f41578d0 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39690/0 (socket says 172.21.15.6:39690) 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 -- 172.21.15.6:0/3455402275 learned_addr learned my addr 172.21.15.6:0/3455402275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:36.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6f9aec700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6f41578d0 0x7fa6f40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6faaee700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4157ca0 0x7fa6f40b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 -- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6f41578d0 msgr2=0x7fa6f40b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6f41578d0 0x7fa6f40b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 -- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4157ca0 msgr2=0x7fa6f40b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4157ca0 0x7fa6f40b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 -- 172.21.15.6:0/3455402275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4009ae0 con 0x7fa6f406d120 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.199+0000 7fa6fa2ed700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00ec80 tx=0x7fa6ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.200+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00c850 con 0x7fa6f406d120 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.200+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00c9b0 con 0x7fa6f406d120 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.200+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40b50c0 con 0x7fa6f406d120 2023-10-09T11:47:36.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.200+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00cd50 con 0x7fa6f406d120 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.200+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f40b4a40 con 0x7fa6f406d120 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.201+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f40ceb10 con 0x7fa6f406d120 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.201+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6ec013680 con 0x7fa6f406d120 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.201+0000 7fa6f27fc700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 0x7fa6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.201+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa6ec0844f0 con 0x7fa6f406d120 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.201+0000 7fa6f9aec700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 0x7fa6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.202+0000 7fa6f9aec700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 0x7fa6e00693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa6f41580c0 tx=0x7fa6e8007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:36.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.206+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6ec051a60 con 0x7fa6f406d120 2023-10-09T11:47:36.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.478+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fa6f40d0170 con 0x7fa6f406d120 2023-10-09T11:47:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.712+0000 7fa6f27fc700 1 -- 172.21.15.6:0/3455402275 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v534) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa6ec055080 con 0x7fa6f406d120 2023-10-09T11:47:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 msgr2=0x7fa6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 0x7fa6e00693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa6f41580c0 tx=0x7fa6e8007ec0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 msgr2=0x7fa6f41595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00ec80 tx=0x7fa6ec0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 shutdown_connections 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fa6e0066f30 0x7fa6e00693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6f4157ca0 0x7fa6f40b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6f406d120 0x7fa6f41595f0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 --2- 172.21.15.6:0/3455402275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa6f41578d0 0x7fa6f40b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 >> 172.21.15.6:0/3455402275 conn(0x7fa6f406bb90 msgr2=0x7fa6f4156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 shutdown_connections 2023-10-09T11:47:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:36.714+0000 7fa6fc551700 1 -- 172.21.15.6:0/3455402275 wait complete. 2023-10-09T11:47:36.728 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-09T11:47:36.728 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:36.728 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T11:47:36.729 INFO:tasks.cephfs_test_runner:Ran 10 tests in 660.040s 2023-10-09T11:47:36.729 INFO:tasks.cephfs_test_runner: 2023-10-09T11:47:36.729 INFO:tasks.cephfs_test_runner:OK 2023-10-09T11:47:36.729 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T11:47:36.739 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T11:47:36.747 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T11:47:36.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:36.747 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:47:36.762 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T11:47:36.763 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T11:47:36.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:36.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T11:47:36.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:36.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T11:47:36.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:36.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-09T11:47:37.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.038 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-09T11:47:37.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-09T11:47:37.123 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-10-09T11:47:37.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:37.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.125 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:47:37.143 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T11:47:37.143 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T11:47:37.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T11:47:37.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T11:47:37.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.303 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-10-09T11:47:37.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.398 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-10-09T11:47:37.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T11:47:37.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-10-09T11:47:37.481 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-10-09T11:47:37.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:47:37.482 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T11:47:37.492 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T11:47:37.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.611+0000 7f7da83fe700 1 Processor -- start 2023-10-09T11:47:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.612+0000 7f7da83fe700 1 -- start start 2023-10-09T11:47:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.612+0000 7f7da83fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7da0156420 0x7f7da00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.612+0000 7f7da83fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7da00cc250 0x7f7da0069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.612+0000 7f7da83fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da00cb880 con 0x7f7da0069980 2023-10-09T11:47:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.612+0000 7f7da83fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da006aa10 con 0x7f7da0156420 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da83fe700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00cac70 con 0x7f7da00cc250 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7da0156420 0x7f7da00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7da0156420 0x7f7da00cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39702/0 (socket says 172.21.15.6:39702) 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 -- 172.21.15.6:0/2527089636 learned_addr learned my addr 172.21.15.6:0/2527089636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da5999700 1 --2- 172.21.15.6:0/2527089636 >> v2:172.21.15.118:3300/0 conn(0x7f7da00cc250 0x7f7da0069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 -- 172.21.15.6:0/2527089636 >> v2:172.21.15.118:3300/0 conn(0x7f7da00cc250 msgr2=0x7f7da0069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 --2- 172.21.15.6:0/2527089636 >> v2:172.21.15.118:3300/0 conn(0x7f7da00cc250 0x7f7da0069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 -- 172.21.15.6:0/2527089636 >> v1:172.21.15.118:6789/0 conn(0x7f7da0069980 legacy=0x7f7da00c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 -- 172.21.15.6:0/2527089636 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00caf50 con 0x7f7da0156420 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da619a700 1 --2- 172.21.15.6:0/2527089636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da00cbd10 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7da0159f00 tx=0x7f7d9800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8869a0637c59d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da5198700 1 -- 172.21.15.6:0/2527089636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800dba0 con 0x7f7da0156420 2023-10-09T11:47:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da5198700 1 -- 172.21.15.6:0/2527089636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800dd00 con 0x7f7da0156420 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.613+0000 7f7da5198700 1 -- 172.21.15.6:0/2527089636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980196d0 con 0x7f7da0156420 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 -- 172.21.15.6:0/2527089636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 msgr2=0x7f7da00cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 --2- 172.21.15.6:0/2527089636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da00cbd10 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7da0159f00 tx=0x7f7d9800b4f0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 -- 172.21.15.6:0/2527089636 shutdown_connections 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 --2- 172.21.15.6:0/2527089636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da00cbd10 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 --2- 172.21.15.6:0/2527089636 >> v2:172.21.15.118:3300/0 conn(0x7f7da00cc250 0x7f7da0069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 -- 172.21.15.6:0/2527089636 >> 172.21.15.6:0/2527089636 conn(0x7f7da006c660 msgr2=0x7f7da00cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 -- 172.21.15.6:0/2527089636 shutdown_connections 2023-10-09T11:47:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.614+0000 7f7da83fe700 1 -- 172.21.15.6:0/2527089636 wait complete. 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.615+0000 7f7da83fe700 1 Processor -- start 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.615+0000 7f7da83fe700 1 -- start start 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7da0069980 0x7f7da0141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da00cc250 0x7f7da014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0156d00 con 0x7f7da0156420 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da014d350 con 0x7f7da00cc250 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da83fe700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da014d630 con 0x7f7da0069980 2023-10-09T11:47:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39708/0 (socket says 172.21.15.6:39708) 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da5999700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da00cc250 0x7f7da014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 -- 172.21.15.6:0/719994653 learned_addr learned my addr 172.21.15.6:0/719994653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da619a700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7da0069980 0x7f7da0141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 -- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7da0069980 msgr2=0x7f7da0141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7da0069980 0x7f7da0141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 -- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da00cc250 msgr2=0x7f7da014c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da00cc250 0x7f7da014c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 -- 172.21.15.6:0/719994653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9800b790 con 0x7f7da0156420 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.616+0000 7f7da699b700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c8e0 tx=0x7f7d90001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90012630 con 0x7f7da0156420 2023-10-09T11:47:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90012790 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90012b50 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da0156990 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da0159360 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.617+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da01567f0 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.618+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d9001a3a0 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.618+0000 7f7d9e7fc700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 0x7f7d8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.618+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7d900843a0 con 0x7f7da0156420 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.618+0000 7f7da619a700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 0x7f7d8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.619+0000 7f7da619a700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 0x7f7d8c0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7da0159f00 tx=0x7f7d9801b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.623+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7da01567f0 con 0x7f7da0156420 2023-10-09T11:47:37.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.818+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7da01567f0 con 0x7f7da0156420 2023-10-09T11:47:37.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.819+0000 7f7d9e7fc700 1 -- 172.21.15.6:0/719994653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+12224 (secure 0 0 0) 0x7f7da01567f0 con 0x7f7da0156420 2023-10-09T11:47:37.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:37.820 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":184,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:47:35.702010+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6837/3906530469":"2023-10-10T11:47:32.697648+0000","172.21.15.6:6835/3906530469":"2023-10-10T11:47:32.697648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 msgr2=0x7f7d8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 0x7f7d8c0693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7da0159f00 tx=0x7f7d9801b000 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 msgr2=0x7f7da014e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c8e0 tx=0x7f7d90001710 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 shutdown_connections 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f7d8c066f30 0x7f7d8c0693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7da0156420 0x7f7da014e2c0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7da0069980 0x7f7da0141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 --2- 172.21.15.6:0/719994653 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7da00cc250 0x7f7da014c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 >> 172.21.15.6:0/719994653 conn(0x7f7da006c660 msgr2=0x7f7da00c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:37.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 shutdown_connections 2023-10-09T11:47:37.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.821+0000 7f7da83fe700 1 -- 172.21.15.6:0/719994653 wait complete. 2023-10-09T11:47:37.834 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T11:47:37.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.951+0000 7f8ad64e1700 1 Processor -- start 2023-10-09T11:47:37.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.951+0000 7f8ad64e1700 1 -- start start 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad0157fe0 0x7f8ad00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ad01583b0 0x7f8ad00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ad00ceb30 0x7f8ad00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00cf4d0 con 0x7f8ad01583b0 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00b2890 con 0x7f8ad00ceb30 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad64e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00b4070 con 0x7f8ad0157fe0 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ad01583b0 0x7f8ad00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ad01583b0 0x7f8ad00b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39720/0 (socket says 172.21.15.6:39720) 2023-10-09T11:47:37.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 -- 172.21.15.6:0/241119684 learned_addr learned my addr 172.21.15.6:0/241119684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acffff700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad0157fe0 0x7f8ad00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8ad4a7e700 1 --2- 172.21.15.6:0/241119684 >> v2:172.21.15.118:3300/0 conn(0x7f8ad00ceb30 0x7f8ad00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 -- 172.21.15.6:0/241119684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad0157fe0 msgr2=0x7f8ad00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad0157fe0 0x7f8ad00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 -- 172.21.15.6:0/241119684 >> v2:172.21.15.118:3300/0 conn(0x7f8ad00ceb30 msgr2=0x7f8ad00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/241119684 >> v2:172.21.15.118:3300/0 conn(0x7f8ad00ceb30 0x7f8ad00cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 -- 172.21.15.6:0/241119684 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00b4350 con 0x7f8ad01583b0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad01583b0 0x7f8ad00b3a00 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f8ad006b970 tx=0x7f8ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca6ffccbd6a87e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8aceffd700 1 -- 172.21.15.6:0/241119684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400b640 con 0x7f8ad01583b0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8aceffd700 1 -- 172.21.15.6:0/241119684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac400b7a0 con 0x7f8ad01583b0 2023-10-09T11:47:37.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.952+0000 7f8aceffd700 1 -- 172.21.15.6:0/241119684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400bb40 con 0x7f8ad01583b0 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 -- 172.21.15.6:0/241119684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad01583b0 msgr2=0x7f8ad00b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad01583b0 0x7f8ad00b3a00 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f8ad006b970 tx=0x7f8ac4009250 comp rx=0 tx=0).stop 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 -- 172.21.15.6:0/241119684 shutdown_connections 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/241119684 >> v2:172.21.15.118:3300/0 conn(0x7f8ad00ceb30 0x7f8ad00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad0157fe0 0x7f8ad00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/241119684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad01583b0 0x7f8ad00b3a00 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 -- 172.21.15.6:0/241119684 >> 172.21.15.6:0/241119684 conn(0x7f8ad0067640 msgr2=0x7f8ad0067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 -- 172.21.15.6:0/241119684 shutdown_connections 2023-10-09T11:47:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.953+0000 7f8ad64e1700 1 -- 172.21.15.6:0/241119684 wait complete. 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.954+0000 7f8ad64e1700 1 Processor -- start 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.954+0000 7f8ad64e1700 1 -- start start 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00ceb30 0x7f8ad015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad01583b0 0x7f8ad0169110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0168720 con 0x7f8ad0157fe0 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0169650 con 0x7f8ad01583b0 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad64e1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad0168c80 con 0x7f8ad00ceb30 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39730/0 (socket says 172.21.15.6:39730) 2023-10-09T11:47:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 -- 172.21.15.6:0/3733095365 learned_addr learned my addr 172.21.15.6:0/3733095365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8ad4a7e700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad01583b0 0x7f8ad0169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acffff700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00ceb30 0x7f8ad015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 -- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00ceb30 msgr2=0x7f8ad015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00ceb30 0x7f8ad015ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 -- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad01583b0 msgr2=0x7f8ad0169110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad01583b0 0x7f8ad0169110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.955+0000 7f8acf7fe700 1 -- 172.21.15.6:0/3733095365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40094f0 con 0x7f8ad0157fe0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8acf7fe700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009f70 tx=0x7f8ac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400b910 con 0x7f8ad0157fe0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac400ba70 con 0x7f8ad0157fe0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad015b420 con 0x7f8ad0157fe0 2023-10-09T11:47:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4011670 con 0x7f8ad0157fe0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.956+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0168910 con 0x7f8ad0157fe0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.957+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad0168df0 con 0x7f8ad0157fe0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.957+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ac4011a60 con 0x7f8ad0157fe0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.958+0000 7f8ab7fff700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 0x7f8abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.958+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8ac40859b0 con 0x7f8ad0157fe0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.958+0000 7f8acffff700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 0x7f8abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:37.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.958+0000 7f8acffff700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 0x7f8abc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00093f0 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:37.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:37.962+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ac4052f20 con 0x7f8ad0157fe0 2023-10-09T11:47:38.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.155+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ad01565d0 con 0x7f8abc066f30 2023-10-09T11:47:38.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.157+0000 7f8ab7fff700 1 -- 172.21.15.6:0/3733095365 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50167 (secure 0 0 0) 0x7f8ad01565d0 con 0x7f8abc066f30 2023-10-09T11:47:38.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 msgr2=0x7f8abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 0x7f8abc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00093f0 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 msgr2=0x7f8ad00cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009f70 tx=0x7f8ac4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 shutdown_connections 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8abc066f30 0x7f8abc0693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ad01583b0 0x7f8ad0169110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8ad00ceb30 0x7f8ad015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 --2- 172.21.15.6:0/3733095365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ad0157fe0 0x7f8ad00cbd90 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 >> 172.21.15.6:0/3733095365 conn(0x7f8ad0067640 msgr2=0x7f8ad00ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 shutdown_connections 2023-10-09T11:47:38.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.159+0000 7f8ad64e1700 1 -- 172.21.15.6:0/3733095365 wait complete. 2023-10-09T11:47:38.162 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:47:38.172 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2023-10-09T11:47:36.302160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450880,"statfs":{"total":1600000000,"available":1485702026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45750,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-101,"num_write_kb":-33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001115"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":301,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-09T11:47:25.994390+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:47:25.994390+0000","last_peered":"2023-10-09T11:47:25.994390+0000","last_clean":"2023-10-09T11:47:25.994390+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:47:25.994390+0000","last_undegraded":"2023-10-09T11:47:25.994390+0000","last_fullsized":"2023-10-09T11:47:25.994390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185488,"statfs":{"total":200000000,"available":189939802,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.27500000000000002},"max":{"1min":0.70999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.497}]},{"osd":1,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.878},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.53300000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":1.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.81100000000000005,"15min":1.079},"last":0.51800000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.45500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26400000000000001},"max":{"1min":0.53000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.439}]},{"osd":5,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64700000000000002,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59399999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175890,"statfs":{"total":200000000,"available":180112161,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":3.7589999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.73499999999999999,"15min":0.78400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.61799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":5.3540000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.6060000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.617},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.46},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":5.3949999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":1.2170000000000001,"5min":1.617,"15min":1.617},"last":0.313},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.82999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.438},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42699999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.93300000000000005,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.46600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13283,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":182029,"statfs":{"total":200000000,"available":186397738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46000000000000002,"5min":0.624,"15min":1.9370000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.38,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":2.004},"last":0.44}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.58299999999999996,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.253},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.622,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.376}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59199999999999997,"5min":0.627,"15min":1.909},"last":0.309},{"interface":"front","average":{"1min":0.437,"5min":0.432,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":2.0369999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":2.1509999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.869},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.94499999999999995,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.873,"15min":2.1960000000000002},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.952},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":0.90100000000000002,"15min":1.782},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.819},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9757,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185555,"statfs":{"total":200000000,"available":190008788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.25700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39400000000000002,"15min":0.45100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.83999999999999997,"15min":2.194},"last":0.36899999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.508},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.63,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.82599999999999996,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.629,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":2.5049999999999999,"15min":3.976},"last":0.497},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":1.03,"15min":2.1549999999999998},"last":0.53000000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.5429999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":1.593},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44,"15min":0.432},"max":{"1min":0.81599999999999995,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173836,"statfs":{"total":200000000,"available":178009074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36699999999999999,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.28799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.60599999999999998},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":11.055},"last":0.32700000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.41399999999999998},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.747,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.44}]},{"osd":5,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.77600000000000002,"5min":0.95099999999999996,"15min":1.097},"last":0.43099999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.53800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":2.2789999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9187,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186124,"statfs":{"total":200000000,"available":190591840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36499999999999999},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.19},"max":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.311},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.32600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.20399999999999999},"max":{"1min":0.502,"5min":0.621,"15min":1.034},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":1.335},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.26200000000000001,"15min":0.20499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":1.1200000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.82799999999999996,"15min":1.405},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.495}]},{"osd":5,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":1.3600000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":0.95799999999999996,"15min":1.387},"last":0.433}]},{"osd":6,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.38600000000000001},"max":{"1min":0.873,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":1.3819999999999999},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.371},"max":{"1min":0.85499999999999998,"5min":0.995,"15min":1.4570000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7199,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188113,"statfs":{"total":200000000,"available":192627966,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.27300000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.68700000000000006},"min":{"1min":0.44700000000000001,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.73699999999999999,"5min":0.90000000000000002,"15min":7.4459999999999997},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":4.1609999999999996},"last":0.373},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":5.274},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.67700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79700000000000004,"15min":7.5679999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.69899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.33300000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.82899999999999996},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48299999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.86099999999999999},"last":0.34699999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173842,"statfs":{"total":200000000,"available":178014657,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.2729999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.85199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.40899999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.96399999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.51200000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88500000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.41799999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.46400000000000002}]}]}],"pool_statfs":[]}} 2023-10-09T11:47:38.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.293+0000 7f911dcf2700 1 Processor -- start 2023-10-09T11:47:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.293+0000 7f911dcf2700 1 -- start start 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.293+0000 7f911dcf2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f911815a2a0 0x7f91180b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.293+0000 7f911dcf2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f911806dd60 0x7f91180cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.293+0000 7f911dcf2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91180b0ca0 con 0x7f91180ceb30 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f911dcf2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911806e160 con 0x7f911815a2a0 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f911dcf2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911806ea90 con 0x7f911806dd60 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f911815a2a0 0x7f91180b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f911815a2a0 0x7f91180b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39734/0 (socket says 172.21.15.6:39734) 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 -- 172.21.15.6:0/939249348 learned_addr learned my addr 172.21.15.6:0/939249348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f9117fff700 1 --2- 172.21.15.6:0/939249348 >> v2:172.21.15.118:3300/0 conn(0x7f911806dd60 0x7f91180cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 -- 172.21.15.6:0/939249348 >> v2:172.21.15.118:3300/0 conn(0x7f911806dd60 msgr2=0x7f91180cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 --2- 172.21.15.6:0/939249348 >> v2:172.21.15.118:3300/0 conn(0x7f911806dd60 0x7f91180cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 -- 172.21.15.6:0/939249348 >> v1:172.21.15.118:6789/0 conn(0x7f91180ceb30 legacy=0x7f911806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 -- 172.21.15.6:0/939249348 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91180b00d0 con 0x7f911815a2a0 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91177fe700 1 --2- 172.21.15.6:0/939249348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911815a2a0 0x7f91180b1130 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9118069790 tx=0x7f9100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc161e23b32024 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91167fc700 1 -- 172.21.15.6:0/939249348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100009e70 con 0x7f911815a2a0 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91167fc700 1 -- 172.21.15.6:0/939249348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000b860 con 0x7f911815a2a0 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.294+0000 7f91167fc700 1 -- 172.21.15.6:0/939249348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000bc00 con 0x7f911815a2a0 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 -- 172.21.15.6:0/939249348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911815a2a0 msgr2=0x7f91180b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 --2- 172.21.15.6:0/939249348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911815a2a0 0x7f91180b1130 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9118069790 tx=0x7f9100009250 comp rx=0 tx=0).stop 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 -- 172.21.15.6:0/939249348 shutdown_connections 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 --2- 172.21.15.6:0/939249348 >> v2:172.21.15.118:3300/0 conn(0x7f911806dd60 0x7f91180cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 --2- 172.21.15.6:0/939249348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f911815a2a0 0x7f91180b1130 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 -- 172.21.15.6:0/939249348 >> 172.21.15.6:0/939249348 conn(0x7f9118067640 msgr2=0x7f9118067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 -- 172.21.15.6:0/939249348 shutdown_connections 2023-10-09T11:47:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.295+0000 7f911dcf2700 1 -- 172.21.15.6:0/939249348 wait complete. 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.296+0000 7f911dcf2700 1 Processor -- start 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.296+0000 7f911dcf2700 1 -- start start 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f911806dd60 0x7f911814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f911815a2a0 0x7f91180b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911815e070 con 0x7f91180ceb30 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118153720 con 0x7f911815a2a0 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f911dcf2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9118153a00 con 0x7f911806dd60 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39748/0 (socket says 172.21.15.6:39748) 2023-10-09T11:47:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 -- 172.21.15.6:0/4091721605 learned_addr learned my addr 172.21.15.6:0/4091721605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f91177fe700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f911806dd60 0x7f911814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9117fff700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f911815a2a0 0x7f91180b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 -- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f911806dd60 msgr2=0x7f911814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f911806dd60 0x7f911814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 -- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f911815a2a0 msgr2=0x7f91180b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f911815a2a0 0x7f91180b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.297+0000 7f9116ffd700 1 -- 172.21.15.6:0/4091721605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000094f0 con 0x7f91180ceb30 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f9116ffd700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f910800c590 tx=0x7f910800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108011590 con 0x7f91180ceb30 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108011710 con 0x7f91180ceb30 2023-10-09T11:47:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9118153ce0 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108011ad0 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.298+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911814fd90 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.299+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911815e500 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.299+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f910801b3b0 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.299+0000 7f910f7fe700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.300+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f91080835c0 con 0x7f91180ceb30 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.300+0000 7f91177fe700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.300+0000 7f91177fe700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 0x7f90f80693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9118069790 tx=0x7f9100017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.304+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f911815e500 con 0x7f91180ceb30 2023-10-09T11:47:38.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.490+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f911815e500 con 0x7f90f8066f30 2023-10-09T11:47:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.492+0000 7f910f7fe700 1 -- 172.21.15.6:0/4091721605 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50209 (secure 0 0 0) 0x7f911815e500 con 0x7f90f8066f30 2023-10-09T11:47:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 msgr2=0x7f90f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 0x7f90f80693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9118069790 tx=0x7f9100017000 comp rx=0 tx=0).stop 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 msgr2=0x7f91181515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f910800c590 tx=0x7f910800c8a0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 shutdown_connections 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f911815a2a0 0x7f91180b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f911806dd60 0x7f911814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 --2- 172.21.15.6:0/4091721605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91180ceb30 0x7f91181515f0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 >> 172.21.15.6:0/4091721605 conn(0x7f9118067640 msgr2=0x7f91181502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 shutdown_connections 2023-10-09T11:47:38.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.494+0000 7f911dcf2700 1 -- 172.21.15.6:0/4091721605 wait complete. 2023-10-09T11:47:38.497 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:47:38.509 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":527,"stamp":"2023-10-09T11:47:38.302429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553294,"statfs":{"total":1600000000,"available":1590573395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45750,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-101,"num_write_kb":-33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001119"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":302,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:47:32.703130+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:47:32.703130+0000","last_peered":"2023-10-09T11:47:32.703130+0000","last_clean":"2023-10-09T11:47:32.703130+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:47:32.703130+0000","last_undegraded":"2023-10-09T11:47:32.703130+0000","last_fullsized":"2023-10-09T11:47:32.703130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198378772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.27500000000000002},"max":{"1min":0.70999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.436},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.878},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":1.048},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.81100000000000005,"15min":1.079},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.45500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26400000000000001},"max":{"1min":0.53000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64700000000000002,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59399999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":3.7589999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.73499999999999999,"15min":0.78400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.61799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":5.3540000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.6060000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.617},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.46},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":5.3949999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":1.2170000000000001,"5min":1.617,"15min":1.617},"last":0.313},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.82999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.438},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42699999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.93300000000000005,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.46600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46000000000000002,"5min":0.624,"15min":1.9370000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.38,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":2.004},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.58299999999999996,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.622,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59199999999999997,"5min":0.627,"15min":1.909},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.432,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":2.0369999999999999},"last":0.374}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":2.1509999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.869},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.94499999999999995,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.873,"15min":2.1960000000000002},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.952},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":0.90100000000000002,"15min":1.782},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.819},"last":0.75600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193730,"statfs":{"total":200000000,"available":198379783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.499},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39400000000000002,"15min":0.45100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.83999999999999997,"15min":2.194},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.508},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.63,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.82599999999999996,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.629,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":2.5049999999999999,"15min":3.976},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":1.03,"15min":2.1549999999999998},"last":0.72199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.5429999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":1.593},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44,"15min":0.432},"max":{"1min":0.81599999999999995,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36699999999999999,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.60599999999999998},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":11.055},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.41399999999999998},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.747,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.77600000000000002,"5min":0.95099999999999996,"15min":1.097},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":2.2789999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36499999999999999},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.19},"max":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.20399999999999999},"max":{"1min":0.502,"5min":0.621,"15min":1.034},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":1.335},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.26200000000000001,"15min":0.20499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":1.1200000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.82799999999999996,"15min":1.405},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.625}]},{"osd":5,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":1.3600000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":0.95799999999999996,"15min":1.387},"last":0.58899999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.38600000000000001},"max":{"1min":0.873,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":1.3819999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.371},"max":{"1min":0.85499999999999998,"5min":0.995,"15min":1.4570000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.27300000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.68700000000000006},"min":{"1min":0.44700000000000001,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.73699999999999999,"5min":0.90000000000000002,"15min":7.4459999999999997},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":4.1609999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":5.274},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.67700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79700000000000004,"15min":7.5679999999999996},"last":0.5},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.69899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.82899999999999996},"last":0.39800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48299999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.86099999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.2729999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.37}]},{"osd":1,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.438},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.85199999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.96399999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88500000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54200000000000004}]}]}],"pool_statfs":[]}} 2023-10-09T11:47:38.511 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T11:47:38.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:38.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.629+0000 7fef59265700 1 Processor -- start 2023-10-09T11:47:38.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.629+0000 7fef59265700 1 -- start start 2023-10-09T11:47:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef59265700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef59265700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5406d8b0 con 0x7fef5415a010 2023-10-09T11:47:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef59265700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5406cca0 con 0x7fef5406ea20 2023-10-09T11:47:38.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef59265700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5406cf80 con 0x7fef5406dd40 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef52ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef5415a010 0x7fef540b17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35688/0 (socket says 172.21.15.6:35688) 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef52ffd700 1 -- 172.21.15.6:0/295226596 learned_addr learned my addr 172.21.15.6:0/295226596 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef527fc700 1 --2- 172.21.15.6:0/295226596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219912092 0 0) 0x7fef5406d8b0 con 0x7fef5415a010 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003570 con 0x7fef5415a010 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347396310 0 0) 0x7fef5406cca0 con 0x7fef5406ea20 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef5406d8b0 con 0x7fef5406ea20 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef527fc700 1 -- 172.21.15.6:0/295226596 >> v1:172.21.15.118:6789/0 conn(0x7fef5406ea20 legacy=0x7fef540b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef527fc700 1 -- 172.21.15.6:0/295226596 >> v1:172.21.15.6:6789/0 conn(0x7fef5415a010 legacy=0x7fef540b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128430068 0 0) 0x7fef40003570 con 0x7fef5415a010 2023-10-09T11:47:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef527fc700 1 -- 172.21.15.6:0/295226596 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5406d260 con 0x7fef5406dd40 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.630+0000 7fef527fc700 1 --2- 172.21.15.6:0/295226596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540b0420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009910 tx=0x7fef3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e107aa29f8749cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c011630 con 0x7fef5406dd40 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c011790 con 0x7fef5406dd40 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef51ffb700 1 -- 172.21.15.6:0/295226596 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c011b30 con 0x7fef5406dd40 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 -- 172.21.15.6:0/295226596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 msgr2=0x7fef540b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 --2- 172.21.15.6:0/295226596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540b0420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009910 tx=0x7fef3c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 -- 172.21.15.6:0/295226596 shutdown_connections 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 --2- 172.21.15.6:0/295226596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540b0420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 -- 172.21.15.6:0/295226596 >> 172.21.15.6:0/295226596 conn(0x7fef540680d0 msgr2=0x7fef5406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 -- 172.21.15.6:0/295226596 shutdown_connections 2023-10-09T11:47:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.631+0000 7fef59265700 1 -- 172.21.15.6:0/295226596 wait complete. 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.632+0000 7fef59265700 1 Processor -- start 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.632+0000 7fef59265700 1 -- start start 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5406ea20 0x7fef5416ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ca5c0 con 0x7fef5415a010 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540cc3e0 con 0x7fef5406ea20 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef59265700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef54155b50 con 0x7fef5406dd40 2023-10-09T11:47:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39754/0 (socket says 172.21.15.6:39754) 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef537fe700 1 -- 172.21.15.6:0/1460100481 learned_addr learned my addr 172.21.15.6:0/1460100481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef527fc700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5406ea20 0x7fef5416ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.633+0000 7fef52ffd700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 -- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 msgr2=0x7fef540c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 -- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5406ea20 msgr2=0x7fef5416ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5406ea20 0x7fef5416ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 -- 172.21.15.6:0/1460100481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c009420 con 0x7fef5415a010 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef537fe700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c560 tx=0x7fef4c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c011590 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0116f0 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540cc680 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c011a90 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.634+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540ccc40 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.635+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540cce30 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.635+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef4c01c460 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.636+0000 7fef4affd700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 0x7fef34069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.636+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fef4c083f40 con 0x7fef5415a010 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.636+0000 7fef52ffd700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 0x7fef34069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.636+0000 7fef52ffd700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 0x7fef34069410 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fef44005fd0 tx=0x7fef44007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.640+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef4c0514b0 con 0x7fef5415a010 2023-10-09T11:47:38.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.828+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef54071b10 con 0x7fef34066f60 2023-10-09T11:47:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.830+0000 7fef4affd700 1 -- 172.21.15.6:0/1460100481 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50209 (secure 0 0 0) 0x7fef54071b10 con 0x7fef34066f60 2023-10-09T11:47:38.832 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 msgr2=0x7fef34069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 0x7fef34069410 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fef44005fd0 tx=0x7fef44007f30 comp rx=0 tx=0).stop 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 msgr2=0x7fef54155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c560 tx=0x7fef4c007d50 comp rx=0 tx=0).stop 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 shutdown_connections 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fef34066f60 0x7fef34069410 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef5415a010 0x7fef54155610 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fef5406dd40 0x7fef540c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 --2- 172.21.15.6:0/1460100481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef5406ea20 0x7fef5416ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 >> 172.21.15.6:0/1460100481 conn(0x7fef540680d0 msgr2=0x7fef54159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 shutdown_connections 2023-10-09T11:47:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.832+0000 7fef59265700 1 -- 172.21.15.6:0/1460100481 wait complete. 2023-10-09T11:47:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:47:38.845 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":527,"stamp":"2023-10-09T11:47:38.302429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553294,"statfs":{"total":1600000000,"available":1590573395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45750,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-101,"num_write_kb":-33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001119"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":302,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:47:32.703130+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:47:32.703130+0000","last_peered":"2023-10-09T11:47:32.703130+0000","last_clean":"2023-10-09T11:47:32.703130+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:47:32.703130+0000","last_undegraded":"2023-10-09T11:47:32.703130+0000","last_fullsized":"2023-10-09T11:47:32.703130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198378772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.27500000000000002},"max":{"1min":0.70999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.436},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.878},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":1.048},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.81100000000000005,"15min":1.079},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.45500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26400000000000001},"max":{"1min":0.53000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65000000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64700000000000002,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59399999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":3.7589999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.73499999999999999,"15min":0.78400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.61799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":5.3540000000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.6060000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.617},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.46},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":5.3949999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":1.2170000000000001,"5min":1.617,"15min":1.617},"last":0.313},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44900000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.82999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.438},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.42699999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.93300000000000005,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.46600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46000000000000002,"5min":0.624,"15min":1.9370000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.38,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":2.004},"last":0.30399999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.58299999999999996,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.622,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59199999999999997,"5min":0.627,"15min":1.909},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.432,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":2.0369999999999999},"last":0.374}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":2.1509999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.869},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.94499999999999995,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.873,"15min":2.1960000000000002},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.952},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":0.90100000000000002,"15min":1.782},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.819},"last":0.75600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193730,"statfs":{"total":200000000,"available":198379783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.499},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39400000000000002,"15min":0.45100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.83999999999999997,"15min":2.194},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.508},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.63,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.82599999999999996,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.629,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":2.5049999999999999,"15min":3.976},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":1.03,"15min":2.1549999999999998},"last":0.72199999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.5429999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":1.593},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44,"15min":0.432},"max":{"1min":0.81599999999999995,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36699999999999999,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.60599999999999998},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":11.055},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.41399999999999998},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.747,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.77600000000000002,"5min":0.95099999999999996,"15min":1.097},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":2.2789999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36499999999999999},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.19},"max":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.20399999999999999},"max":{"1min":0.502,"5min":0.621,"15min":1.034},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":1.335},"last":0.38400000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.26200000000000001,"15min":0.20499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":1.1200000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.82799999999999996,"15min":1.405},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.625}]},{"osd":5,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":1.3600000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":0.95799999999999996,"15min":1.387},"last":0.58899999999999997}]},{"osd":6,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.38600000000000001},"max":{"1min":0.873,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":1.3819999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.371},"max":{"1min":0.85499999999999998,"5min":0.995,"15min":1.4570000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.27300000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.68700000000000006},"min":{"1min":0.44700000000000001,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.73699999999999999,"5min":0.90000000000000002,"15min":7.4459999999999997},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":4.1609999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":5.274},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.67700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79700000000000004,"15min":7.5679999999999996},"last":0.5},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.69899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.82899999999999996},"last":0.39800000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48299999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.86099999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.2729999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.37}]},{"osd":1,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.438},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.85199999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.96399999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88500000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.54200000000000004}]}]}],"pool_statfs":[]}} 2023-10-09T11:47:38.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T11:47:38.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.964+0000 7f828caf8700 1 Processor -- start 2023-10-09T11:47:38.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.964+0000 7f828caf8700 1 -- start start 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828caf8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f828806d830 0x7f82880cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828caf8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880d07c0 con 0x7f82881578d0 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828caf8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880cfbb0 con 0x7f8288157ca0 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828caf8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82880cfe90 con 0x7f828806d830 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f82881578d0 0x7f828815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35698/0 (socket says 172.21.15.6:35698) 2023-10-09T11:47:38.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f828659c700 1 -- 172.21.15.6:0/418567203 learned_addr learned my addr 172.21.15.6:0/418567203 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.965+0000 7f8286d9d700 1 --2- 172.21.15.6:0/418567203 >> v2:172.21.15.6:3300/0 conn(0x7f828806d830 0x7f82880cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f8286d9d700 1 -- 172.21.15.6:0/418567203 >> v1:172.21.15.118:6789/0 conn(0x7f8288157ca0 legacy=0x7f828806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f8286d9d700 1 -- 172.21.15.6:0/418567203 >> v1:172.21.15.6:6789/0 conn(0x7f82881578d0 legacy=0x7f828815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f8286d9d700 1 -- 172.21.15.6:0/418567203 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880d0170 con 0x7f828806d830 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f828559a700 1 -- 172.21.15.6:0/418567203 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936677406 0 0) 0x7f82880d07c0 con 0x7f82881578d0 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f8286d9d700 1 --2- 172.21.15.6:0/418567203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880cf4f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f8280009e60 tx=0x7f8280009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534315bce5855ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f828559a700 1 -- 172.21.15.6:0/418567203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000e070 con 0x7f828806d830 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f828559a700 1 -- 172.21.15.6:0/418567203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000bbf0 con 0x7f828806d830 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.966+0000 7f828559a700 1 -- 172.21.15.6:0/418567203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280012430 con 0x7f828806d830 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 -- 172.21.15.6:0/418567203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 msgr2=0x7f82880cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 --2- 172.21.15.6:0/418567203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880cf4f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f8280009e60 tx=0x7f8280009780 comp rx=0 tx=0).stop 2023-10-09T11:47:38.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 -- 172.21.15.6:0/418567203 shutdown_connections 2023-10-09T11:47:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 --2- 172.21.15.6:0/418567203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880cf4f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 -- 172.21.15.6:0/418567203 >> 172.21.15.6:0/418567203 conn(0x7f828806bb90 msgr2=0x7f828806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 -- 172.21.15.6:0/418567203 shutdown_connections 2023-10-09T11:47:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.967+0000 7f828caf8700 1 -- 172.21.15.6:0/418567203 wait complete. 2023-10-09T11:47:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.968+0000 7f828caf8700 1 Processor -- start 2023-10-09T11:47:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.968+0000 7f828caf8700 1 -- start start 2023-10-09T11:47:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 0x7f82880b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 0x7f828816a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b3d60 con 0x7f828806d830 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b4040 con 0x7f8288157ca0 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b4320 con 0x7f82881578d0 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39776/0 (socket says 172.21.15.6:39776) 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 -- 172.21.15.6:0/2555253918 learned_addr learned my addr 172.21.15.6:0/2555253918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f8286d9d700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 0x7f828816a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f8285d9b700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 0x7f82880b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 -- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 msgr2=0x7f82880b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 0x7f82880b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 -- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 msgr2=0x7f828816a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 0x7f828816a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 -- 172.21.15.6:0/2555253918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009a20 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f8286d9d700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 0x7f828816a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f8285d9b700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 0x7f82880b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828659c700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f827800c7e0 tx=0x7f8278007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278005b30 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8278005c90 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82880b4600 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.969+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278007300 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.970+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82880b2460 con 0x7f828806d830 2023-10-09T11:47:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.970+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82880b4b20 con 0x7f828806d830 2023-10-09T11:47:38.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.971+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f827801b400 con 0x7f828806d830 2023-10-09T11:47:38.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.971+0000 7f827e7fc700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 0x7f82680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:38.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.971+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8278083df0 con 0x7f828806d830 2023-10-09T11:47:38.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.971+0000 7f8285d9b700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 0x7f82680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:38.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.972+0000 7f8285d9b700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 0x7f82680693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:38.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:38.976+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82880b4b20 con 0x7f828806d830 2023-10-09T11:47:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.169+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82880b4b20 con 0x7f828806d830 2023-10-09T11:47:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.170+0000 7f827e7fc700 1 -- 172.21.15.6:0/2555253918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+12224 (secure 0 0 0) 0x7f8278054e70 con 0x7f828806d830 2023-10-09T11:47:39.171 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:39.171 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":184,"fsid":"7857a25d-47fa-49eb-8e61-2818cdc55761","created":"2023-10-09T11:35:46.107243+0000","modified":"2023-10-09T11:47:35.702010+0000","last_up_change":"2023-10-09T11:35:51.507729+0000","last_in_change":"2023-10-09T11:35:48.488373+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T11:35:52.198753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":86385},{"type":"v1","addr":"172.21.15.6:6823","nonce":86385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":86385},{"type":"v1","addr":"172.21.15.6:6826","nonce":86385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":86385},{"type":"v1","addr":"172.21.15.6:6831","nonce":86385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":86385},{"type":"v1","addr":"172.21.15.6:6829","nonce":86385}]},"public_addr":"172.21.15.6:6823/86385","cluster_addr":"172.21.15.6:6826/86385","heartbeat_back_addr":"172.21.15.6:6831/86385","heartbeat_front_addr":"172.21.15.6:6829/86385","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":86376},{"type":"v1","addr":"172.21.15.6:6809","nonce":86376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":86376},{"type":"v1","addr":"172.21.15.6:6811","nonce":86376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":86376},{"type":"v1","addr":"172.21.15.6:6815","nonce":86376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":86376},{"type":"v1","addr":"172.21.15.6:6813","nonce":86376}]},"public_addr":"172.21.15.6:6809/86376","cluster_addr":"172.21.15.6:6811/86376","heartbeat_back_addr":"172.21.15.6:6815/86376","heartbeat_front_addr":"172.21.15.6:6813/86376","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":86375},{"type":"v1","addr":"172.21.15.6:6801","nonce":86375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":86375},{"type":"v1","addr":"172.21.15.6:6803","nonce":86375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":86375},{"type":"v1","addr":"172.21.15.6:6807","nonce":86375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":86375},{"type":"v1","addr":"172.21.15.6:6805","nonce":86375}]},"public_addr":"172.21.15.6:6801/86375","cluster_addr":"172.21.15.6:6803/86375","heartbeat_back_addr":"172.21.15.6:6807/86375","heartbeat_front_addr":"172.21.15.6:6805/86375","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":86387},{"type":"v1","addr":"172.21.15.6:6817","nonce":86387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":86387},{"type":"v1","addr":"172.21.15.6:6819","nonce":86387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":86387},{"type":"v1","addr":"172.21.15.6:6827","nonce":86387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":86387},{"type":"v1","addr":"172.21.15.6:6822","nonce":86387}]},"public_addr":"172.21.15.6:6817/86387","cluster_addr":"172.21.15.6:6819/86387","heartbeat_back_addr":"172.21.15.6:6827/86387","heartbeat_front_addr":"172.21.15.6:6822/86387","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":86573},{"type":"v1","addr":"172.21.15.118:6801","nonce":86573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":86573},{"type":"v1","addr":"172.21.15.118:6804","nonce":86573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":86573},{"type":"v1","addr":"172.21.15.118:6811","nonce":86573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":86573},{"type":"v1","addr":"172.21.15.118:6808","nonce":86573}]},"public_addr":"172.21.15.118:6801/86573","cluster_addr":"172.21.15.118:6804/86573","heartbeat_back_addr":"172.21.15.118:6811/86573","heartbeat_front_addr":"172.21.15.118:6808/86573","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":86574},{"type":"v1","addr":"172.21.15.118:6805","nonce":86574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":86574},{"type":"v1","addr":"172.21.15.118:6810","nonce":86574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":86574},{"type":"v1","addr":"172.21.15.118:6818","nonce":86574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":86574},{"type":"v1","addr":"172.21.15.118:6814","nonce":86574}]},"public_addr":"172.21.15.118:6805/86574","cluster_addr":"172.21.15.118:6810/86574","heartbeat_back_addr":"172.21.15.118:6818/86574","heartbeat_front_addr":"172.21.15.118:6814/86574","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":86575},{"type":"v1","addr":"172.21.15.118:6815","nonce":86575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":86575},{"type":"v1","addr":"172.21.15.118:6819","nonce":86575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":86575},{"type":"v1","addr":"172.21.15.118:6824","nonce":86575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":86575},{"type":"v1","addr":"172.21.15.118:6821","nonce":86575}]},"public_addr":"172.21.15.118:6815/86575","cluster_addr":"172.21.15.118:6819/86575","heartbeat_back_addr":"172.21.15.118:6824/86575","heartbeat_front_addr":"172.21.15.118:6821/86575","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":86576},{"type":"v1","addr":"172.21.15.118:6825","nonce":86576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":86576},{"type":"v1","addr":"172.21.15.118:6827","nonce":86576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":86576},{"type":"v1","addr":"172.21.15.118:6831","nonce":86576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":86576},{"type":"v1","addr":"172.21.15.118:6829","nonce":86576}]},"public_addr":"172.21.15.118:6825/86576","cluster_addr":"172.21.15.118:6827/86576","heartbeat_back_addr":"172.21.15.118:6831/86576","heartbeat_front_addr":"172.21.15.118:6829/86576","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.686444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.593031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.594227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.618110+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.562611+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.569195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.597443+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T11:35:49.567810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6837/3906530469":"2023-10-10T11:47:32.697648+0000","172.21.15.6:6835/3906530469":"2023-10-10T11:47:32.697648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T11:47:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 msgr2=0x7f82680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 0x7f82680693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270008040 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 msgr2=0x7f82880b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f827800c7e0 tx=0x7f8278007df0 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 shutdown_connections 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f8268066f30 0x7f82680693e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8288157ca0 0x7f828816a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828806d830 0x7f82880b1f20 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 --2- 172.21.15.6:0/2555253918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82881578d0 0x7f82880b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 >> 172.21.15.6:0/2555253918 conn(0x7f828806bb90 msgr2=0x7f828806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 shutdown_connections 2023-10-09T11:47:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:39.172+0000 7f828caf8700 1 -- 172.21.15.6:0/2555253918 wait complete. 2023-10-09T11:47:40.186 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T11:47:40.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.318+0000 7fe60609d700 1 Processor -- start 2023-10-09T11:47:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.318+0000 7fe60609d700 1 -- start start 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe60609d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 0x7fe6000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe60609d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe60006d120 0x7fe60006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe60609d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60006dac0 con 0x7fe600157ca0 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe60609d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000d07c0 con 0x7fe60006d120 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe60609d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000cfbb0 con 0x7fe6001578d0 2023-10-09T11:47:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe60006d120 0x7fe60006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe60006d120 0x7fe60006d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39790/0 (socket says 172.21.15.6:39790) 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 -- 172.21.15.6:0/963771214 learned_addr learned my addr 172.21.15.6:0/963771214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 0x7fe6000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 -- 172.21.15.6:0/963771214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 msgr2=0x7fe6000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 0x7fe6000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 -- 172.21.15.6:0/963771214 >> v1:172.21.15.118:6789/0 conn(0x7fe600157ca0 legacy=0x7fe60015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5fffff700 1 -- 172.21.15.6:0/963771214 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000cfe90 con 0x7fe60006d120 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.319+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 0x7fe6000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe5fffff700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe60006d120 0x7fe60006d580 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f20 tx=0x7fe5f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad2727f31930b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe5fe7fc700 1 -- 172.21.15.6:0/963771214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e070 con 0x7fe60006d120 2023-10-09T11:47:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe5fe7fc700 1 -- 172.21.15.6:0/963771214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800ba80 con 0x7fe60006d120 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe5fe7fc700 1 -- 172.21.15.6:0/963771214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80092e0 con 0x7fe60006d120 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 -- 172.21.15.6:0/963771214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe60006d120 msgr2=0x7fe60006d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe60006d120 0x7fe60006d580 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f20 tx=0x7fe5f8009840 comp rx=0 tx=0).stop 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 -- 172.21.15.6:0/963771214 shutdown_connections 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe60006d120 0x7fe60006d580 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 --2- 172.21.15.6:0/963771214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6001578d0 0x7fe6000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 -- 172.21.15.6:0/963771214 >> 172.21.15.6:0/963771214 conn(0x7fe60006bb90 msgr2=0x7fe60006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 -- 172.21.15.6:0/963771214 shutdown_connections 2023-10-09T11:47:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.320+0000 7fe60609d700 1 -- 172.21.15.6:0/963771214 wait complete. 2023-10-09T11:47:40.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 Processor -- start 2023-10-09T11:47:40.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 -- start start 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60006d120 0x7fe600148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 0x7fe6000b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe600157ca0 0x7fe6000b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000ab260 con 0x7fe6001578d0 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60016b380 con 0x7fe600157ca0 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe60609d700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000b6a80 con 0x7fe60006d120 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 0x7fe6000b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.322+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 0x7fe6000b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39802/0 (socket says 172.21.15.6:39802) 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 -- 172.21.15.6:0/1549218816 learned_addr learned my addr 172.21.15.6:0/1549218816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:40.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5fffff700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe600157ca0 0x7fe6000b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60006d120 0x7fe600148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 -- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60006d120 msgr2=0x7fe600148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60006d120 0x7fe600148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 -- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe600157ca0 msgr2=0x7fe6000b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe600157ca0 0x7fe6000b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009ae0 con 0x7fe6001578d0 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe60006d120 0x7fe600148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5fffff700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe600157ca0 0x7fe6000b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5feffd700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 0x7fe6000b5ee0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c4e0 tx=0x7fe5f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011590 con 0x7fe6001578d0 2023-10-09T11:47:40.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4011710 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4011ad0 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000aa930 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.323+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6000aaef0 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.324+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe600067ac0 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f401b3b0 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe5ec066f30 0x7fe5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe5f4083560 con 0x7fe6001578d0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe5ec066f30 0x7fe5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fe5ec06cd80 0x7fe5ec06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5ec06f860 con 0x7fe5ec06cd80 2023-10-09T11:47:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f4085ba0 con 0x7fe6001578d0 2023-10-09T11:47:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5fffff700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fe5ec06cd80 0x7fe5ec06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.325+0000 7fe5ff7fe700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe5ec066f30 0x7fe5ec0693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0006f00 tx=0x7fe5f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.326+0000 7fe5fffff700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fe5ec06cd80 0x7fe5ec06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.326+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== osd.0 v2:172.21.15.6:6821/86385 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe5ec06f860 con 0x7fe5ec06cd80 2023-10-09T11:47:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 --> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe60006dac0 con 0x7fe5ec06cd80 2023-10-09T11:47:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe5e77fe700 1 -- 172.21.15.6:0/1549218816 <== osd.0 v2:172.21.15.6:6821/86385 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fe60006dac0 con 0x7fe5ec06cd80 2023-10-09T11:47:40.340 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:40.340 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:40.341 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fe5ec06cd80 msgr2=0x7fe5ec06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6821/86385,v1:172.21.15.6:6823/86385] conn(0x7fe5ec06cd80 0x7fe5ec06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe5ec066f30 msgr2=0x7fe5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fe5ec066f30 0x7fe5ec0693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0006f00 tx=0x7fe5f0008040 comp rx=0 tx=0).stop 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 msgr2=0x7fe6000b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 --2- 172.21.15.6:0/1549218816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6001578d0 0x7fe6000b5ee0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c4e0 tx=0x7fe5f400c8a0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe5fffff700 1 -- 172.21.15.6:0/1549218816 reap_dead start 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 shutdown_connections 2023-10-09T11:47:40.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 >> 172.21.15.6:0/1549218816 conn(0x7fe60006bb90 msgr2=0x7fe600156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 shutdown_connections 2023-10-09T11:47:40.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.339+0000 7fe60609d700 1 -- 172.21.15.6:0/1549218816 wait complete. 2023-10-09T11:47:40.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T11:47:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 Processor -- start 2023-10-09T11:47:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 -- start start 2023-10-09T11:47:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fcc0c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9fcc155940 0x7f9fcc155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0ca680 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c2800 con 0x7f9fcc155940 2023-10-09T11:47:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.473+0000 7f9fd2052700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c2ae0 con 0x7f9fcc0c7210 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fcaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9fcc0c75e0 0x7f9fcc0abc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35714/0 (socket says 172.21.15.6:35714) 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fcaffd700 1 -- 172.21.15.6:0/15186633 learned_addr learned my addr 172.21.15.6:0/15186633 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fcbfff700 1 --2- 172.21.15.6:0/15186633 >> v2:172.21.15.118:3300/0 conn(0x7f9fcc155940 0x7f9fcc155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383719785 0 0) 0x7f9fcc0ca680 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fcb7fe700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fcc0c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb8003570 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506606032 0 0) 0x7f9fb8003570 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 msgr2=0x7f9fcc0c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fcc0c2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 >> v2:172.21.15.118:3300/0 conn(0x7f9fcc155940 msgr2=0x7f9fcc155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 --2- 172.21.15.6:0/15186633 >> v2:172.21.15.118:3300/0 conn(0x7f9fcc155940 0x7f9fcc155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0c2dc0 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f9fb4001470 con 0x7f9fcc0c75e0 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 >> v1:172.21.15.6:6789/0 conn(0x7f9fcc0c75e0 legacy=0x7f9fcc0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8003a60 0x7f9fb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb8004810 0x7f9fb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c2800 con 0x7f9fb8004810 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c2ae0 con 0x7f9fb8003a60 2023-10-09T11:47:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb800ba60 con 0x7f9fcc0c7210 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.474+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb8004810 0x7f9fb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcb7fe700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8003a60 0x7f9fb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcbfff700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 -- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 msgr2=0x7f9fb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0c7210 0x7f9fb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 -- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8003a60 msgr2=0x7f9fb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8003a60 0x7f9fb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 -- 172.21.15.6:0/15186633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8003570 con 0x7f9fb8004810 2023-10-09T11:47:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb8004810 0x7f9fb8004c80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c3f0 tx=0x7f9fb4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940129be60b4efed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400cc80 con 0x7f9fb8004810 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb400ce00 con 0x7f9fb8004810 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.475+0000 7f9fca7fc700 1 -- 172.21.15.6:0/15186633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4005b70 con 0x7f9fb8004810 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 -- 172.21.15.6:0/15186633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb8004810 msgr2=0x7f9fb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 --2- 172.21.15.6:0/15186633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fb8004810 0x7f9fb8004c80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c3f0 tx=0x7f9fb4001e90 comp rx=0 tx=0).stop 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fcbfff700 1 -- 172.21.15.6:0/15186633 reap_dead start 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 -- 172.21.15.6:0/15186633 shutdown_connections 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 -- 172.21.15.6:0/15186633 >> 172.21.15.6:0/15186633 conn(0x7f9fcc06c660 msgr2=0x7f9fcc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 -- 172.21.15.6:0/15186633 shutdown_connections 2023-10-09T11:47:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.476+0000 7f9fd2052700 1 -- 172.21.15.6:0/15186633 wait complete. 2023-10-09T11:47:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.477+0000 7f9fd2052700 1 Processor -- start 2023-10-09T11:47:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.477+0000 7f9fd2052700 1 -- start start 2023-10-09T11:47:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8004810 0x7f9fcc1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0adcf0 0x7f9fcc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0af300 con 0x7f9fcc0ad880 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0aee70 con 0x7f9fb8004810 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fd2052700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc151a30 con 0x7f9fcc0adcf0 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39830/0 (socket says 172.21.15.6:39830) 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 -- 172.21.15.6:0/4076253685 learned_addr learned my addr 172.21.15.6:0/4076253685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcb7fe700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8004810 0x7f9fcc1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcbfff700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0adcf0 0x7f9fcc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 -- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0adcf0 msgr2=0x7f9fcc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0adcf0 0x7f9fcc0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 -- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8004810 msgr2=0x7f9fcc1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8004810 0x7f9fcc1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 -- 172.21.15.6:0/4076253685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0ae260 con 0x7f9fcc0ad880 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.478+0000 7f9fcaffd700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c9e0 tx=0x7f9fb4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.479+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400cc80 con 0x7f9fcc0ad880 2023-10-09T11:47:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.479+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4001430 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.479+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc0ae540 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.479+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4007530 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.479+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc0aeb00 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.480+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc0af000 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.480+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fb4019030 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.480+0000 7f9fc37fe700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 0x7f9fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.481+0000 7f9fcb7fe700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 0x7f9fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.481+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9fb40851d0 con 0x7f9fcc0ad880 2023-10-09T11:47:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.481+0000 7f9fcb7fe700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 0x7f9fac0693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc006f00 tx=0x7f9fbc00a330 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.485+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fb4052740 con 0x7f9fcc0ad880 2023-10-09T11:47:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.677+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fcc0c86c0 con 0x7f9fac066f30 2023-10-09T11:47:40.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.677+0000 7f9fc37fe700 1 -- 172.21.15.6:0/4076253685 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9fcc0c86c0 con 0x7f9fac066f30 2023-10-09T11:47:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 msgr2=0x7f9fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 0x7f9fac0693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc006f00 tx=0x7f9fbc00a330 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 msgr2=0x7f9fcc0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400c9e0 tx=0x7f9fb4015000 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 shutdown_connections 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9fac066f30 0x7f9fac0693e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9fcc0adcf0 0x7f9fcc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fb8004810 0x7f9fcc1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 --2- 172.21.15.6:0/4076253685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fcc0ad880 0x7f9fcc0b0de0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 >> 172.21.15.6:0/4076253685 conn(0x7f9fcc06c660 msgr2=0x7f9fcc154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 shutdown_connections 2023-10-09T11:47:40.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.679+0000 7f9fd2052700 1 -- 172.21.15.6:0/4076253685 wait complete. 2023-10-09T11:47:40.682 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T11:47:40.692 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T11:47:40.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.814+0000 7fd4d007f700 1 Processor -- start 2023-10-09T11:47:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.814+0000 7fd4d007f700 1 -- start start 2023-10-09T11:47:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4d007f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4c806d830 0x7fd4c80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4d007f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c80d07c0 con 0x7fd4c81578d0 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4d007f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c80cfbb0 con 0x7fd4c8157ca0 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4d007f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80cfe90 con 0x7fd4c806d830 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4ce61c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4c806d830 0x7fd4c80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4cde1b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4c81578d0 0x7fd4c815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35728/0 (socket says 172.21.15.6:35728) 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4cde1b700 1 -- 172.21.15.6:0/956047967 learned_addr learned my addr 172.21.15.6:0/956047967 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4ce61c700 1 -- 172.21.15.6:0/956047967 >> v1:172.21.15.118:6789/0 conn(0x7fd4c8157ca0 legacy=0x7fd4c806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4ce61c700 1 -- 172.21.15.6:0/956047967 >> v1:172.21.15.6:6789/0 conn(0x7fd4c81578d0 legacy=0x7fd4c815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4ce61c700 1 -- 172.21.15.6:0/956047967 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c80d0170 con 0x7fd4c806d830 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4cce19700 1 -- 172.21.15.6:0/956047967 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66580043 0 0) 0x7fd4c80d07c0 con 0x7fd4c81578d0 2023-10-09T11:47:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.815+0000 7fd4ce61c700 1 --2- 172.21.15.6:0/956047967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c806d830 0x7fd4c80cf4f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098e0 tx=0x7fd4c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a7d269b1302853 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4cce19700 1 -- 172.21.15.6:0/956047967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0009e80 con 0x7fd4c806d830 2023-10-09T11:47:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4cce19700 1 -- 172.21.15.6:0/956047967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c000b860 con 0x7fd4c806d830 2023-10-09T11:47:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4cce19700 1 -- 172.21.15.6:0/956047967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000bbe0 con 0x7fd4c806d830 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 -- 172.21.15.6:0/956047967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c806d830 msgr2=0x7fd4c80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 --2- 172.21.15.6:0/956047967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c806d830 0x7fd4c80cf4f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098e0 tx=0x7fd4c00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 -- 172.21.15.6:0/956047967 shutdown_connections 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 --2- 172.21.15.6:0/956047967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c806d830 0x7fd4c80cf4f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 -- 172.21.15.6:0/956047967 >> 172.21.15.6:0/956047967 conn(0x7fd4c806bb90 msgr2=0x7fd4c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 -- 172.21.15.6:0/956047967 shutdown_connections 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.816+0000 7fd4d007f700 1 -- 172.21.15.6:0/956047967 wait complete. 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.817+0000 7fd4d007f700 1 Processor -- start 2023-10-09T11:47:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.817+0000 7fd4d007f700 1 -- start start 2023-10-09T11:47:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4c806d830 0x7fd4c8153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 0x7fd4c8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c8157ca0 0x7fd4c80ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8153790 con 0x7fd4c81578d0 2023-10-09T11:47:40.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80b57c0 con 0x7fd4c8157ca0 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4d007f700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c80b51b0 con 0x7fd4c806d830 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 0x7fd4c8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 0x7fd4c8153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39848/0 (socket says 172.21.15.6:39848) 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 -- 172.21.15.6:0/3351077337 learned_addr learned my addr 172.21.15.6:0/3351077337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4ce61c700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c8157ca0 0x7fd4c80ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cde1b700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4c806d830 0x7fd4c8153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 -- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4c806d830 msgr2=0x7fd4c8153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4c806d830 0x7fd4c8153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 -- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c8157ca0 msgr2=0x7fd4c80ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c8157ca0 0x7fd4c80ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cd61a700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0009420 con 0x7fd4c81578d0 2023-10-09T11:47:40.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.818+0000 7fd4cde1b700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd4c806d830 0x7fd4c8153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4cd61a700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 0x7fd4c8153250 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011590 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8011710 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c80abd40 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011ad0 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.819+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c80aba30 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.820+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4c80684b0 con 0x7fd4c81578d0 2023-10-09T11:47:40.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.820+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4b801b3b0 con 0x7fd4c81578d0 2023-10-09T11:47:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4bdffb700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4ac066f30 0x7fd4ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd4b8083630 con 0x7fd4c81578d0 2023-10-09T11:47:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4cde1b700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4ac066f30 0x7fd4ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4bdffb700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7fd4ac06cd80 0x7fd4ac06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4ac06f860 con 0x7fd4ac06cd80 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4b8085b90 con 0x7fd4c81578d0 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4ce61c700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7fd4ac06cd80 0x7fd4ac06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4cde1b700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4ac066f30 0x7fd4ac0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4001560 tx=0x7fd4c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.821+0000 7fd4ce61c700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7fd4ac06cd80 0x7fd4ac06f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.822+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== osd.1 v2:172.21.15.6:6808/86376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fd4ac06f860 con 0x7fd4ac06cd80 2023-10-09T11:47:40.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.834+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 --> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4c8067ac0 con 0x7fd4ac06cd80 2023-10-09T11:47:40.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4bdffb700 1 -- 172.21.15.6:0/3351077337 <== osd.1 v2:172.21.15.6:6808/86376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fd4c8067ac0 con 0x7fd4ac06cd80 2023-10-09T11:47:40.836 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:40.836 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:40.836 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7fd4ac06cd80 msgr2=0x7fd4ac06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6808/86376,v1:172.21.15.6:6809/86376] conn(0x7fd4ac06cd80 0x7fd4ac06f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4ac066f30 msgr2=0x7fd4ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd4ac066f30 0x7fd4ac0693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4001560 tx=0x7fd4c4009040 comp rx=0 tx=0).stop 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 msgr2=0x7fd4c8153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 --2- 172.21.15.6:0/3351077337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c81578d0 0x7fd4c8153250 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f50 comp rx=0 tx=0).stop 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4ce61c700 1 -- 172.21.15.6:0/3351077337 reap_dead start 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 shutdown_connections 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 >> 172.21.15.6:0/3351077337 conn(0x7fd4c806bb90 msgr2=0x7fd4c8155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 shutdown_connections 2023-10-09T11:47:40.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.835+0000 7fd4d007f700 1 -- 172.21.15.6:0/3351077337 wait complete. 2023-10-09T11:47:40.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T11:47:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.966+0000 7f05d0c29700 1 Processor -- start 2023-10-09T11:47:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.966+0000 7f05d0c29700 1 -- start start 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05d0c29700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05cc06dd60 0x7f05cc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05d0c29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc0b0ca0 con 0x7f05cc0cf240 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05d0c29700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc0b00d0 con 0x7f05cc15a2a0 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05d0c29700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc06ea90 con 0x7f05cc06dd60 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05c9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f05cc0cf240 0x7f05cc06d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35730/0 (socket says 172.21.15.6:35730) 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.967+0000 7f05c9d9b700 1 -- 172.21.15.6:0/2509553631 learned_addr learned my addr 172.21.15.6:0/2509553631 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> v2:172.21.15.118:3300/0 conn(0x7f05cc06dd60 0x7f05cc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045011980 0 0) 0x7f05cc0b0ca0 con 0x7f05cc0cf240 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b8003570 con 0x7f05cc0cf240 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4118749641 0 0) 0x7f05b8003570 con 0x7f05cc0cf240 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 >> v2:172.21.15.118:3300/0 conn(0x7f05cc06dd60 msgr2=0x7f05cc0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 --2- 172.21.15.6:0/2509553631 >> v2:172.21.15.118:3300/0 conn(0x7f05cc06dd60 0x7f05cc0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 >> v1:172.21.15.118:6789/0 conn(0x7f05cc15a2a0 legacy=0x7f05cc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0b0370 con 0x7f05cc0cf240 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f05b4001470 con 0x7f05cc0cf240 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> v2:172.21.15.118:3300/0 conn(0x7f05cc06dd60 0x7f05cc0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 >> v1:172.21.15.6:6789/0 conn(0x7f05cc0cf240 legacy=0x7f05cc06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05b8003a60 0x7f05b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05b8004810 0x7f05b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc06ea90 con 0x7f05b80051c0 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b800c0d0 con 0x7f05b8004810 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b800c290 con 0x7f05b8003a60 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05ca59c700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05b8003a60 0x7f05b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05c9d9b700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05b8004810 0x7f05b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 -- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05b8003a60 msgr2=0x7f05b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05b8003a60 0x7f05b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 -- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05b8004810 msgr2=0x7f05b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05b8004810 0x7f05b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05cad9d700 1 -- 172.21.15.6:0/2509553631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8003570 con 0x7f05b80051c0 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.968+0000 7f05ca59c700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05b8003a60 0x7f05b8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05cad9d700 1 -- 172.21.15.6:0/2509553631 reap_dead start 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05cad9d700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05b800ba60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009df0 tx=0x7f05bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e646957caef2e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc009740 con 0x7f05b80051c0 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00e920 con 0x7f05b80051c0 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05c959a700 1 -- 172.21.15.6:0/2509553631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00ece0 con 0x7f05b80051c0 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 -- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 msgr2=0x7f05b800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05b800ba60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009df0 tx=0x7f05bc0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 -- 172.21.15.6:0/2509553631 shutdown_connections 2023-10-09T11:47:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 --2- 172.21.15.6:0/2509553631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05b800ba60 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 -- 172.21.15.6:0/2509553631 >> 172.21.15.6:0/2509553631 conn(0x7f05cc067640 msgr2=0x7f05cc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 -- 172.21.15.6:0/2509553631 shutdown_connections 2023-10-09T11:47:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.969+0000 7f05d0c29700 1 -- 172.21.15.6:0/2509553631 wait complete. 2023-10-09T11:47:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.970+0000 7f05d0c29700 1 Processor -- start 2023-10-09T11:47:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 -- start start 2023-10-09T11:47:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 0x7f05cc152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05cc0b2a70 0x7f05cc0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc13d0a0 con 0x7f05b80051c0 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0b25e0 con 0x7f05cc0b2a70 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05d0c29700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0b1cf0 con 0x7f05cc152760 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39870/0 (socket says 172.21.15.6:39870) 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.971+0000 7f05ca59c700 1 -- 172.21.15.6:0/3400305634 learned_addr learned my addr 172.21.15.6:0/3400305634 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05cad9d700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05cc0b2a70 0x7f05cc0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05c9d9b700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 0x7f05cc152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 -- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 msgr2=0x7f05cc152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 0x7f05cc152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 -- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05cc0b2a70 msgr2=0x7f05cc0b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05cc0b2a70 0x7f05cc0b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 -- 172.21.15.6:0/3400305634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc15f480 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05c9d9b700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 0x7f05cc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05ca59c700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f05c4002230 tx=0x7f05c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4018070 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4010040 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc0b1f90 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4006dd0 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.972+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc153cd0 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.973+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc0b28c0 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.973+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05c4003030 con 0x7f05b80051c0 2023-10-09T11:47:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.974+0000 7f05c27fc700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.974+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f05c4083c10 con 0x7f05b80051c0 2023-10-09T11:47:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.974+0000 7f05c9d9b700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.974+0000 7f05c9d9b700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 0x7f05ac0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f05b40015a0 tx=0x7f05b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:40.978+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c4051180 con 0x7f05b80051c0 2023-10-09T11:47:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.170+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f05cc0b2720 con 0x7f05ac066f30 2023-10-09T11:47:41.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.170+0000 7f05c27fc700 1 -- 172.21.15.6:0/3400305634 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05b4007280 con 0x7f05ac066f30 2023-10-09T11:47:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 msgr2=0x7f05ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 0x7f05ac0693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f05b40015a0 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 msgr2=0x7f05cc153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f05c4002230 tx=0x7f05c4009040 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 shutdown_connections 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05cc0b2a70 0x7f05cc0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80051c0 0x7f05cc153790 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 --2- 172.21.15.6:0/3400305634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05cc152760 0x7f05cc152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 >> 172.21.15.6:0/3400305634 conn(0x7f05cc067640 msgr2=0x7f05cc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 shutdown_connections 2023-10-09T11:47:41.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.172+0000 7f05d0c29700 1 -- 172.21.15.6:0/3400305634 wait complete. 2023-10-09T11:47:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T11:47:41.185 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T11:47:41.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.307+0000 7ff356981700 1 Processor -- start 2023-10-09T11:47:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.307+0000 7ff356981700 1 -- start start 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff356981700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff356981700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 0x7ff35015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff356981700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3500d07c0 con 0x7ff35006d120 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff356981700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500cfbb0 con 0x7ff3501578d0 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff356981700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500cfe90 con 0x7ff350157ca0 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff34ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff354f1e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff35006d120 0x7ff35006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35736/0 (socket says 172.21.15.6:35736) 2023-10-09T11:47:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.308+0000 7ff354f1e700 1 -- 172.21.15.6:0/3623857705 learned_addr learned my addr 172.21.15.6:0/3623857705 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34f7fe700 1 --2- 172.21.15.6:0/3623857705 >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 0x7ff35015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34ffff700 1 -- 172.21.15.6:0/3623857705 >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 msgr2=0x7ff35015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34ffff700 1 --2- 172.21.15.6:0/3623857705 >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 0x7ff35015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34ffff700 1 -- 172.21.15.6:0/3623857705 >> v1:172.21.15.6:6789/0 conn(0x7ff35006d120 legacy=0x7ff35006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34effd700 1 -- 172.21.15.6:0/3623857705 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640933213 0 0) 0x7ff3500d07c0 con 0x7ff35006d120 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34ffff700 1 -- 172.21.15.6:0/3623857705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500d0170 con 0x7ff3501578d0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34f7fe700 1 --2- 172.21.15.6:0/3623857705 >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 0x7ff35015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34ffff700 1 --2- 172.21.15.6:0/3623857705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff350068510 tx=0x7ff3400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58ee2a7196f65e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34effd700 1 -- 172.21.15.6:0/3623857705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000b6b0 con 0x7ff3501578d0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34effd700 1 -- 172.21.15.6:0/3623857705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000b810 con 0x7ff3501578d0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.309+0000 7ff34effd700 1 -- 172.21.15.6:0/3623857705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000bbb0 con 0x7ff3501578d0 2023-10-09T11:47:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 -- 172.21.15.6:0/3623857705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 msgr2=0x7ff3500cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 --2- 172.21.15.6:0/3623857705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff350068510 tx=0x7ff3400091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 -- 172.21.15.6:0/3623857705 shutdown_connections 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 --2- 172.21.15.6:0/3623857705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff3500cf4f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 --2- 172.21.15.6:0/3623857705 >> v2:172.21.15.118:3300/0 conn(0x7ff350157ca0 0x7ff35015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 -- 172.21.15.6:0/3623857705 >> 172.21.15.6:0/3623857705 conn(0x7ff35006bb90 msgr2=0x7ff35006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 -- 172.21.15.6:0/3623857705 shutdown_connections 2023-10-09T11:47:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.310+0000 7ff356981700 1 -- 172.21.15.6:0/3623857705 wait complete. 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.311+0000 7ff356981700 1 Processor -- start 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.311+0000 7ff356981700 1 -- start start 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff3500c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff350153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff350157ca0 0x7ff3500c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c6450 con 0x7ff3501578d0 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350153e80 con 0x7ff35006d120 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c81e0 con 0x7ff350157ca0 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff350153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff350153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39888/0 (socket says 172.21.15.6:39888) 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 -- 172.21.15.6:0/3191679151 learned_addr learned my addr 172.21.15.6:0/3191679151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34ffff700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff3500c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff354f1e700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff350157ca0 0x7ff3500c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 -- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff350157ca0 msgr2=0x7ff3500c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff350157ca0 0x7ff3500c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 -- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 msgr2=0x7ff3500c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35006d120 0x7ff3500c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009420 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff34f7fe700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff350153940 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c800 tx=0x7ff344008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011600 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344011760 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011ae0 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.312+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500c5b20 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.313+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500c60e0 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.313+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3500c6e20 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff344010350 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff344084190 con 0x7ff3501578d0 2023-10-09T11:47:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff34ffff700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7ff33c06cd80 0x7ff33c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff33c06f860 con 0x7ff33c06cd80 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff344086770 con 0x7ff3501578d0 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.314+0000 7ff354f1e700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7ff33c06cd80 0x7ff33c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.315+0000 7ff34ffff700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff3400093f0 tx=0x7ff340017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.315+0000 7ff354f1e700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7ff33c06cd80 0x7ff33c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.315+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== osd.2 v2:172.21.15.6:6800/86375 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff33c06f860 con 0x7ff33c06cd80 2023-10-09T11:47:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.328+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 --> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff3500ceb10 con 0x7ff33c06cd80 2023-10-09T11:47:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.328+0000 7ff337fff700 1 -- 172.21.15.6:0/3191679151 <== osd.2 v2:172.21.15.6:6800/86375 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7ff3500ceb10 con 0x7ff33c06cd80 2023-10-09T11:47:41.330 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:41.330 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:41.330 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7ff33c06cd80 msgr2=0x7ff33c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6800/86375,v1:172.21.15.6:6801/86375] conn(0x7ff33c06cd80 0x7ff33c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 msgr2=0x7ff33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff33c066f30 0x7ff33c0693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff3400093f0 tx=0x7ff340017000 comp rx=0 tx=0).stop 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 msgr2=0x7ff350153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 --2- 172.21.15.6:0/3191679151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3501578d0 0x7ff350153940 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c800 tx=0x7ff344008040 comp rx=0 tx=0).stop 2023-10-09T11:47:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff354f1e700 1 -- 172.21.15.6:0/3191679151 reap_dead start 2023-10-09T11:47:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 shutdown_connections 2023-10-09T11:47:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 >> 172.21.15.6:0/3191679151 conn(0x7ff35006bb90 msgr2=0x7ff35006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 shutdown_connections 2023-10-09T11:47:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.329+0000 7ff356981700 1 -- 172.21.15.6:0/3191679151 wait complete. 2023-10-09T11:47:41.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T11:47:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.460+0000 7f551996b700 1 Processor -- start 2023-10-09T11:47:41.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.460+0000 7f551996b700 1 -- start start 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f551415a2a0 0x7f55140b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f55140cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f551406d650 0x7f551406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551406ea90 con 0x7f551406d650 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140b0ca0 con 0x7f551415a2a0 2023-10-09T11:47:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f551996b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140cf4c0 con 0x7f55140ceb30 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f55137fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f551406d650 0x7f551406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f55137fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f551406d650 0x7f551406da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39904/0 (socket says 172.21.15.6:39904) 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.461+0000 7f55137fe700 1 -- 172.21.15.6:0/881827150 learned_addr learned my addr 172.21.15.6:0/881827150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55127fc700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f55140cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f5512ffd700 1 --2- 172.21.15.6:0/881827150 >> v2:172.21.15.118:3300/0 conn(0x7f551415a2a0 0x7f55140b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 -- 172.21.15.6:0/881827150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 msgr2=0x7f55140cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f55140cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 -- 172.21.15.6:0/881827150 >> v2:172.21.15.118:3300/0 conn(0x7f551415a2a0 msgr2=0x7f55140b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 --2- 172.21.15.6:0/881827150 >> v2:172.21.15.118:3300/0 conn(0x7f551415a2a0 0x7f55140b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 -- 172.21.15.6:0/881827150 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140b00d0 con 0x7f551406d650 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f55137fe700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f551406da70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f55140637a0 tx=0x7f5504009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc541a1099a95c59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f5511ffb700 1 -- 172.21.15.6:0/881827150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400e070 con 0x7f551406d650 2023-10-09T11:47:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f5511ffb700 1 -- 172.21.15.6:0/881827150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400b970 con 0x7f551406d650 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.462+0000 7f5511ffb700 1 -- 172.21.15.6:0/881827150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040092e0 con 0x7f551406d650 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 -- 172.21.15.6:0/881827150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 msgr2=0x7f551406da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f551406da70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f55140637a0 tx=0x7f5504009840 comp rx=0 tx=0).stop 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 -- 172.21.15.6:0/881827150 shutdown_connections 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f551406da70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 --2- 172.21.15.6:0/881827150 >> v2:172.21.15.118:3300/0 conn(0x7f551415a2a0 0x7f55140b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 --2- 172.21.15.6:0/881827150 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f55140cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 -- 172.21.15.6:0/881827150 >> 172.21.15.6:0/881827150 conn(0x7f5514067640 msgr2=0x7f5514067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 -- 172.21.15.6:0/881827150 shutdown_connections 2023-10-09T11:47:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.463+0000 7f551996b700 1 -- 172.21.15.6:0/881827150 wait complete. 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.464+0000 7f551996b700 1 Processor -- start 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.464+0000 7f551996b700 1 -- start start 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f5514155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 0x7f551415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514155f70 con 0x7f551406d650 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551415ea20 con 0x7f551415a2a0 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140b4540 con 0x7f55140ceb30 2023-10-09T11:47:41.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 -- 172.21.15.6:0/1264949471 learned_addr learned my addr 172.21.15.6:0/1264949471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f55137fe700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 0x7f551415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f55127fc700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f5514155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 -- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 msgr2=0x7f5514155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f5514155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 -- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 msgr2=0x7f551415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 0x7f551415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 -- 172.21.15.6:0/1264949471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009ae0 con 0x7f551406d650 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f55137fe700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 0x7f551415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f55127fc700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f5514155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f5512ffd700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f550c00ec80 tx=0x7f550c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c00c9d0 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00cb30 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55140b4820 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c013470 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.465+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55140c80d0 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.466+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55140c9b70 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.467+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f550c0137e0 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.467+0000 7f550affd700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 0x7f54f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.467+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f550c0844e0 con 0x7f551406d650 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.467+0000 7f55127fc700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 0x7f54f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.468+0000 7f55127fc700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 0x7f54f40693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5514158480 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.472+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f550c051a50 con 0x7f551406d650 2023-10-09T11:47:41.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.664+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f551404bb80 con 0x7f54f4066f30 2023-10-09T11:47:41.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.665+0000 7f550affd700 1 -- 172.21.15.6:0/1264949471 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f551404bb80 con 0x7f54f4066f30 2023-10-09T11:47:41.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 msgr2=0x7f54f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 0x7f54f40693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5514158480 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2023-10-09T11:47:41.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 msgr2=0x7f55140b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f550c00ec80 tx=0x7f550c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 shutdown_connections 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f54f4066f30 0x7f54f40693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f551415a2a0 0x7f551415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f551406d650 0x7f55140b3360 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 --2- 172.21.15.6:0/1264949471 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55140ceb30 0x7f5514155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 >> 172.21.15.6:0/1264949471 conn(0x7f5514067640 msgr2=0x7f55141577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 shutdown_connections 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.667+0000 7f551996b700 1 -- 172.21.15.6:0/1264949471 wait complete. 2023-10-09T11:47:41.669 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T11:47:41.680 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T11:47:41.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.801+0000 7f32b7fe1700 1 Processor -- start 2023-10-09T11:47:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.801+0000 7f32b7fe1700 1 -- start start 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b7fe1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32b01578d0 0x7f32b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b7fe1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32b0157ca0 0x7f32b015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b7fe1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00d07c0 con 0x7f32b006d120 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b7fe1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cfbb0 con 0x7f32b0157ca0 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b7fe1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cfe90 con 0x7f32b01578d0 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b557c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32b0157ca0 0x7f32b015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b657e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32b006d120 0x7f32b006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35742/0 (socket says 172.21.15.6:35742) 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b557c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32b0157ca0 0x7f32b015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39926/0 (socket says 172.21.15.6:39926) 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b657e700 1 -- 172.21.15.6:0/2176670369 learned_addr learned my addr 172.21.15.6:0/2176670369 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.802+0000 7f32b5d7d700 1 --2- 172.21.15.6:0/2176670369 >> v2:172.21.15.118:3300/0 conn(0x7f32b01578d0 0x7f32b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b557c700 1 -- 172.21.15.6:0/2176670369 >> v2:172.21.15.118:3300/0 conn(0x7f32b01578d0 msgr2=0x7f32b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b557c700 1 --2- 172.21.15.6:0/2176670369 >> v2:172.21.15.118:3300/0 conn(0x7f32b01578d0 0x7f32b00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b557c700 1 -- 172.21.15.6:0/2176670369 >> v1:172.21.15.6:6789/0 conn(0x7f32b006d120 legacy=0x7f32b006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b4d7b700 1 -- 172.21.15.6:0/2176670369 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959269347 0 0) 0x7f32b00d07c0 con 0x7f32b006d120 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b557c700 1 -- 172.21.15.6:0/2176670369 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00d0170 con 0x7f32b0157ca0 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b557c700 1 --2- 172.21.15.6:0/2176670369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b0157ca0 0x7f32b015af00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f32b00646b0 tx=0x7f32a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8f61f83e96466c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b4d7b700 1 -- 172.21.15.6:0/2176670369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4011630 con 0x7f32b0157ca0 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b4d7b700 1 -- 172.21.15.6:0/2176670369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4011790 con 0x7f32b0157ca0 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.803+0000 7f32b4d7b700 1 -- 172.21.15.6:0/2176670369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4011b30 con 0x7f32b0157ca0 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2176670369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b0157ca0 msgr2=0x7f32b015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2176670369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b0157ca0 0x7f32b015af00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f32b00646b0 tx=0x7f32a40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2176670369 shutdown_connections 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2176670369 >> v2:172.21.15.118:3300/0 conn(0x7f32b01578d0 0x7f32b00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2176670369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b0157ca0 0x7f32b015af00 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2176670369 >> 172.21.15.6:0/2176670369 conn(0x7f32b006bb90 msgr2=0x7f32b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2176670369 shutdown_connections 2023-10-09T11:47:41.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.804+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2176670369 wait complete. 2023-10-09T11:47:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.805+0000 7f32b7fe1700 1 Processor -- start 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.805+0000 7f32b7fe1700 1 -- start start 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.805+0000 7f32b7fe1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 0x7f32b016b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32b01578d0 0x7f32b00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32b0157ca0 0x7f32b00c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c6bf0 con 0x7f32b006d120 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c6350 con 0x7f32b01578d0 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00c6630 con 0x7f32b0157ca0 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 0x7f32b016b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 0x7f32b016b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39932/0 (socket says 172.21.15.6:39932) 2023-10-09T11:47:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 -- 172.21.15.6:0/2700564684 learned_addr learned my addr 172.21.15.6:0/2700564684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b557c700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32b01578d0 0x7f32b00c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b657e700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32b0157ca0 0x7f32b00c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 -- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32b0157ca0 msgr2=0x7f32b00c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32b0157ca0 0x7f32b00c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 -- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32b01578d0 msgr2=0x7f32b00c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32b01578d0 0x7f32b00c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009420 con 0x7f32b006d120 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b557c700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32b01578d0 0x7f32b00c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b657e700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32b0157ca0 0x7f32b00c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b5d7d700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 0x7f32b016b650 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f32a800ec80 tx=0x7f32a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800c9d0 con 0x7f32b006d120 2023-10-09T11:47:41.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800cb30 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8013470 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.806+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b00c6910 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.807+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b00c6060 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.807+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32b00b4b70 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32a8013820 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f329c066f30 0x7f329c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f32a8084620 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32b557c700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f329c066f30 0x7f329c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f329c06cd80 0x7f329c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f329c06f860 con 0x7f329c06cd80 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.808+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a8086c60 con 0x7f32b006d120 2023-10-09T11:47:41.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.809+0000 7f32b657e700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f329c06cd80 0x7f329c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.809+0000 7f32b557c700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f329c066f30 0x7f329c0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f32b01580c0 tx=0x7f32a4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.809+0000 7f32b657e700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f329c06cd80 0x7f329c06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.809+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== osd.3 v2:172.21.15.6:6816/86387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f329c06f860 con 0x7f329c06cd80 2023-10-09T11:47:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.822+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 --> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f32b00b2f10 con 0x7f329c06cd80 2023-10-09T11:47:41.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.822+0000 7f32adffb700 1 -- 172.21.15.6:0/2700564684 <== osd.3 v2:172.21.15.6:6816/86387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f32b00b2f10 con 0x7f329c06cd80 2023-10-09T11:47:41.824 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:41.824 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:41.824 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f329c06cd80 msgr2=0x7f329c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6816/86387,v1:172.21.15.6:6817/86387] conn(0x7f329c06cd80 0x7f329c06f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f329c066f30 msgr2=0x7f329c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f329c066f30 0x7f329c0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f32b01580c0 tx=0x7f32a4017000 comp rx=0 tx=0).stop 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 msgr2=0x7f32b016b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 --2- 172.21.15.6:0/2700564684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b006d120 0x7f32b016b650 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f32a800ec80 tx=0x7f32a80091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b657e700 1 -- 172.21.15.6:0/2700564684 reap_dead start 2023-10-09T11:47:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 shutdown_connections 2023-10-09T11:47:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 >> 172.21.15.6:0/2700564684 conn(0x7f32b006bb90 msgr2=0x7f32b0156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 shutdown_connections 2023-10-09T11:47:41.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.823+0000 7f32b7fe1700 1 -- 172.21.15.6:0/2700564684 wait complete. 2023-10-09T11:47:41.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T11:47:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.953+0000 7f9d18503700 1 Processor -- start 2023-10-09T11:47:41.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.953+0000 7f9d18503700 1 -- start start 2023-10-09T11:47:41.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d18503700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 0x7f9d100b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d18503700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100b2890 con 0x7f9d100cf240 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d18503700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100b4070 con 0x7f9d101583b0 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d18503700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100b4350 con 0x7f9d10157fe0 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d16aa0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d100cf240 0x7f9d10158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35744/0 (socket says 172.21.15.6:35744) 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.954+0000 7f9d16aa0700 1 -- 172.21.15.6:0/3417039538 learned_addr learned my addr 172.21.15.6:0/3417039538 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1629f700 1 --2- 172.21.15.6:0/3417039538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 0x7f9d100b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831706889 0 0) 0x7f9d100b2890 con 0x7f9d100cf240 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf8003570 con 0x7f9d100cf240 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078145958 0 0) 0x7f9d100b4070 con 0x7f9d101583b0 2023-10-09T11:47:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d100b2890 con 0x7f9d101583b0 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1629f700 1 -- 172.21.15.6:0/3417039538 >> v1:172.21.15.118:6789/0 conn(0x7f9d101583b0 legacy=0x7f9d100ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1629f700 1 -- 172.21.15.6:0/3417039538 >> v1:172.21.15.6:6789/0 conn(0x7f9d100cf240 legacy=0x7f9d10158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1629f700 1 -- 172.21.15.6:0/3417039538 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100b4630 con 0x7f9d10157fe0 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1629f700 1 --2- 172.21.15.6:0/3417039538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 0x7f9d100b34c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009910 tx=0x7f9d080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fda0d9f4a02fe1e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.955+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011630 con 0x7f9d10157fe0 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08011790 con 0x7f9d10157fe0 2023-10-09T11:47:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d1529d700 1 -- 172.21.15.6:0/3417039538 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011b30 con 0x7f9d10157fe0 2023-10-09T11:47:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 -- 172.21.15.6:0/3417039538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 msgr2=0x7f9d100b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 --2- 172.21.15.6:0/3417039538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 0x7f9d100b34c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009910 tx=0x7f9d080091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 -- 172.21.15.6:0/3417039538 shutdown_connections 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 --2- 172.21.15.6:0/3417039538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d10157fe0 0x7f9d100b34c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 -- 172.21.15.6:0/3417039538 >> 172.21.15.6:0/3417039538 conn(0x7f9d10067640 msgr2=0x7f9d10067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 -- 172.21.15.6:0/3417039538 shutdown_connections 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.956+0000 7f9d18503700 1 -- 172.21.15.6:0/3417039538 wait complete. 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.957+0000 7f9d18503700 1 Processor -- start 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.957+0000 7f9d18503700 1 -- start start 2023-10-09T11:47:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100cf240 0x7f9d100c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d101583b0 0x7f9d10155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100c4510 con 0x7f9d10157fe0 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100c5240 con 0x7f9d100cf240 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d18503700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1016cb30 con 0x7f9d101583b0 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39944/0 (socket says 172.21.15.6:39944) 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 -- 172.21.15.6:0/126796826 learned_addr learned my addr 172.21.15.6:0/126796826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d1629f700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100cf240 0x7f9d100c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d16aa0700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d101583b0 0x7f9d10155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 -- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d101583b0 msgr2=0x7f9d10155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d101583b0 0x7f9d10155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 -- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100cf240 msgr2=0x7f9d100c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100cf240 0x7f9d100c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.958+0000 7f9d15a9e700 1 -- 172.21.15.6:0/126796826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009420 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d15a9e700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c7c0 tx=0x7f9d04007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04002ea0 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04010510 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d100c4910 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d040108b0 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.959+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100c4ed0 con 0x7f9d10157fe0 2023-10-09T11:47:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.960+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d100c5090 con 0x7f9d10157fe0 2023-10-09T11:47:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.960+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d04010c60 con 0x7f9d10157fe0 2023-10-09T11:47:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.960+0000 7f9d0e7fc700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.961+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9d04083880 con 0x7f9d10157fe0 2023-10-09T11:47:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.961+0000 7f9d1629f700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.961+0000 7f9d1629f700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 0x7f9cfc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009fd0 tx=0x7f9d08017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:41.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:41.965+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d04050df0 con 0x7f9d10157fe0 2023-10-09T11:47:42.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.156+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d100c53b0 con 0x7f9cfc066f30 2023-10-09T11:47:42.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.156+0000 7f9d0e7fc700 1 -- 172.21.15.6:0/126796826 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9d100c53b0 con 0x7f9cfc066f30 2023-10-09T11:47:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 msgr2=0x7f9cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 0x7f9cfc0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009fd0 tx=0x7f9d08017000 comp rx=0 tx=0).stop 2023-10-09T11:47:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 msgr2=0x7f9d1016c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c7c0 tx=0x7f9d04007dc0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 shutdown_connections 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f9cfc066f30 0x7f9cfc0693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d101583b0 0x7f9d10155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d100cf240 0x7f9d100c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 --2- 172.21.15.6:0/126796826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d10157fe0 0x7f9d1016c5f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 >> 172.21.15.6:0/126796826 conn(0x7f9d10067640 msgr2=0x7f9d1015b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 shutdown_connections 2023-10-09T11:47:42.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.158+0000 7f9d18503700 1 -- 172.21.15.6:0/126796826 wait complete. 2023-10-09T11:47:42.162 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T11:47:42.171 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T11:47:42.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:42.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.293+0000 7f4f2b59e700 1 Processor -- start 2023-10-09T11:47:42.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.293+0000 7f4f2b59e700 1 -- start start 2023-10-09T11:47:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f2c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c06d9b0 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2b59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0cf2d0 con 0x7f4f2c06d530 2023-10-09T11:47:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c15a690 con 0x7f4f2c0d0f50 2023-10-09T11:47:42.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f2c0d0b80 0x7f4f2c0cfd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35752/0 (socket says 172.21.15.6:35752) 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2a59c700 1 -- 172.21.15.6:0/2313525072 learned_addr learned my addr 172.21.15.6:0/2313525072 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f29d9b700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f2c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237421022 0 0) 0x7f4f2c06d9b0 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.294+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f18003570 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 306318309 0 0) 0x7f4f18003570 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 msgr2=0x7f4f2c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f2c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 >> v1:172.21.15.118:6789/0 conn(0x7f4f2c06d530 legacy=0x7f4f2c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0d0480 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f4f240017f0 con 0x7f4f2c0d0b80 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 >> v1:172.21.15.6:6789/0 conn(0x7f4f2c0d0b80 legacy=0x7f4f2c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18003a90 0x7f4f18003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f18004d50 0x7f4f180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c15a690 con 0x7f4f18003a90 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1800bba0 con 0x7f4f18004d50 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1800bd60 con 0x7f4f2c0d0f50 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18003a90 0x7f4f18003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f29d9b700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2ad9d700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f18004d50 0x7f4f180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 -- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 msgr2=0x7f4f18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f2c0d0f50 0x7f4f18004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 -- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f18004d50 msgr2=0x7f4f180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f18004d50 0x7f4f180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 -- 172.21.15.6:0/2313525072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18003570 con 0x7f4f18003a90 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2ad9d700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f18004d50 0x7f4f180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18003a90 0x7f4f18003ea0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a900 tx=0x7f4f2c0cf460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87042fb7aba30794 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240070d0 con 0x7f4f18003a90 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f24007230 con 0x7f4f18003a90 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.295+0000 7f4f2959a700 1 -- 172.21.15.6:0/2313525072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240075f0 con 0x7f4f18003a90 2023-10-09T11:47:42.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 -- 172.21.15.6:0/2313525072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18003a90 msgr2=0x7f4f18003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 --2- 172.21.15.6:0/2313525072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18003a90 0x7f4f18003ea0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a900 tx=0x7f4f2c0cf460 comp rx=0 tx=0).stop 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/2313525072 reap_dead start 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 -- 172.21.15.6:0/2313525072 shutdown_connections 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 -- 172.21.15.6:0/2313525072 >> 172.21.15.6:0/2313525072 conn(0x7f4f2c063230 msgr2=0x7f4f2c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 -- 172.21.15.6:0/2313525072 shutdown_connections 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.296+0000 7f4f2b59e700 1 -- 172.21.15.6:0/2313525072 wait complete. 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.297+0000 7f4f2b59e700 1 Processor -- start 2023-10-09T11:47:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.297+0000 7f4f2b59e700 1 -- start start 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f18003a90 0x7f4f2c16c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c16cc60 0x7f4f2c16a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 0x7f4f2c16ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c5cc0 con 0x7f4f2c16a970 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1687a0 con 0x7f4f2c16cc60 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2b59e700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c16b320 con 0x7f4f18003a90 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 0x7f4f2c16ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2a59c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f18003a90 0x7f4f2c16c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 0x7f4f2c16ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39968/0 (socket says 172.21.15.6:39968) 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/1210878480 learned_addr learned my addr 172.21.15.6:0/1210878480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f29d9b700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c16cc60 0x7f4f2c16a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f18003a90 msgr2=0x7f4f2c16c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f18003a90 0x7f4f2c16c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c16cc60 msgr2=0x7f4f2c16a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c16cc60 0x7f4f2c16a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.298+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c16d490 con 0x7f4f2c16a970 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f2ad9d700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 0x7f4f2c16ade0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007a80 tx=0x7f4f1c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c014480 con 0x7f4f2c16a970 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c0145e0 con 0x7f4f2c16a970 2023-10-09T11:47:42.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c16d770 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c014960 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c168430 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.299+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f2c0676e0 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.300+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f1c0133e0 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.300+0000 7f4f227fc700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f0c066f30 0x7f4f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4f1c0838f0 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f0c066f30 0x7f4f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f227fc700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f4f0c06cd80 0x7f4f0c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f0c06f860 con 0x7f4f0c06cd80 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f1c088220 con 0x7f4f2c16a970 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f2a59c700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f0c066f30 0x7f4f0c0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a3f0 tx=0x7f4f24016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f29d9b700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f4f0c06cd80 0x7f4f0c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.301+0000 7f4f29d9b700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f4f0c06cd80 0x7f4f0c06f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.302+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== osd.4 v2:172.21.15.118:6800/86573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f4f0c06f860 con 0x7f4f0c06cd80 2023-10-09T11:47:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.315+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 --> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f2c06dc00 con 0x7f4f0c06cd80 2023-10-09T11:47:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.315+0000 7f4f227fc700 1 -- 172.21.15.6:0/1210878480 <== osd.4 v2:172.21.15.118:6800/86573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f4f2c06dc00 con 0x7f4f0c06cd80 2023-10-09T11:47:42.317 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:42.317 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f4f0c06cd80 msgr2=0x7f4f0c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.118:6800/86573,v1:172.21.15.118:6801/86573] conn(0x7f4f0c06cd80 0x7f4f0c06f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f0c066f30 msgr2=0x7f4f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f4f0c066f30 0x7f4f0c0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a3f0 tx=0x7f4f24016000 comp rx=0 tx=0).stop 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 msgr2=0x7f4f2c16ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 --2- 172.21.15.6:0/1210878480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f2c16a970 0x7f4f2c16ade0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007a80 tx=0x7f4f1c009040 comp rx=0 tx=0).stop 2023-10-09T11:47:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2ad9d700 1 -- 172.21.15.6:0/1210878480 reap_dead start 2023-10-09T11:47:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 shutdown_connections 2023-10-09T11:47:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 >> 172.21.15.6:0/1210878480 conn(0x7f4f2c063230 msgr2=0x7f4f2c06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 shutdown_connections 2023-10-09T11:47:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.316+0000 7f4f2b59e700 1 -- 172.21.15.6:0/1210878480 wait complete. 2023-10-09T11:47:42.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T11:47:42.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.448+0000 7f26b14b2700 1 Processor -- start 2023-10-09T11:47:42.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.448+0000 7f26b14b2700 1 -- start start 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26b14b2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26ac06c190 0x7f26ac0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26b14b2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac069d10 con 0x7f26ac0b3170 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26b14b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac0b35b0 con 0x7f26ac157a60 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26b14b2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac15c130 con 0x7f26ac06c190 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26ab7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f26ac0b3170 0x7f26ac06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35754/0 (socket says 172.21.15.6:35754) 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26ab7fe700 1 -- 172.21.15.6:0/3862736421 learned_addr learned my addr 172.21.15.6:0/3862736421 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:42.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26a3fff700 1 --2- 172.21.15.6:0/3862736421 >> v2:172.21.15.118:3300/0 conn(0x7f26ac06c190 0x7f26ac0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218530678 0 0) 0x7f26ac069d10 con 0x7f26ac0b3170 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2698003570 con 0x7f26ac0b3170 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26a3fff700 1 -- 172.21.15.6:0/3862736421 >> v1:172.21.15.118:6789/0 conn(0x7f26ac157a60 legacy=0x7f26ac15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110877465 0 0) 0x7f26ac0b35b0 con 0x7f26ac157a60 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26a3fff700 1 -- 172.21.15.6:0/3862736421 >> v1:172.21.15.6:6789/0 conn(0x7f26ac0b3170 legacy=0x7f26ac06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.449+0000 7f26a3fff700 1 -- 172.21.15.6:0/3862736421 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac15c410 con 0x7f26ac06c190 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26a3fff700 1 --2- 172.21.15.6:0/3862736421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac06c190 0x7f26ac0b2c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f26940098e0 tx=0x7f26940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d26eb6f97bb2067 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400b640 con 0x7f26ac06c190 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400b7a0 con 0x7f26ac06c190 2023-10-09T11:47:42.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26aa7fc700 1 -- 172.21.15.6:0/3862736421 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400bb40 con 0x7f26ac06c190 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 -- 172.21.15.6:0/3862736421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac06c190 msgr2=0x7f26ac0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3862736421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac06c190 0x7f26ac0b2c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f26940098e0 tx=0x7f26940091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 -- 172.21.15.6:0/3862736421 shutdown_connections 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3862736421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac06c190 0x7f26ac0b2c30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 -- 172.21.15.6:0/3862736421 >> 172.21.15.6:0/3862736421 conn(0x7f26ac06cca0 msgr2=0x7f26ac06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 -- 172.21.15.6:0/3862736421 shutdown_connections 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.450+0000 7f26b14b2700 1 -- 172.21.15.6:0/3862736421 wait complete. 2023-10-09T11:47:42.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.451+0000 7f26b14b2700 1 Processor -- start 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.451+0000 7f26b14b2700 1 -- start start 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26ac0b3170 0x7f26ac159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac157a60 0x7f26ac0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac15af60 con 0x7f26ac06c190 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac15a090 con 0x7f26ac157a60 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26b14b2700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac15a350 con 0x7f26ac0b3170 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39982/0 (socket says 172.21.15.6:39982) 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26aaffd700 1 -- 172.21.15.6:0/3602143003 learned_addr learned my addr 172.21.15.6:0/3602143003 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26ab7fe700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac157a60 0x7f26ac0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.452+0000 7f26a3fff700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26ac0b3170 0x7f26ac159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 -- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26ac0b3170 msgr2=0x7f26ac159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26ac0b3170 0x7f26ac159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 -- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac157a60 msgr2=0x7f26ac0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac157a60 0x7f26ac0afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 -- 172.21.15.6:0/3602143003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694009420 con 0x7f26ac06c190 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26aaffd700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c530 tx=0x7f269c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011590 con 0x7f26ac06c190 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c0116f0 con 0x7f26ac06c190 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac15a630 con 0x7f26ac06c190 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011ab0 con 0x7f26ac06c190 2023-10-09T11:47:42.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.453+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac15abf0 con 0x7f26ac06c190 2023-10-09T11:47:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.454+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac068900 con 0x7f26ac06c190 2023-10-09T11:47:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.454+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f269c01b3b0 con 0x7f26ac06c190 2023-10-09T11:47:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.455+0000 7f26a2ffd700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.455+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f269c0837f0 con 0x7f26ac06c190 2023-10-09T11:47:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.455+0000 7f26a3fff700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.455+0000 7f26a3fff700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 0x7f268c0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f26940093f0 tx=0x7f2694017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.459+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f269c050d60 con 0x7f26ac06c190 2023-10-09T11:47:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.651+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f26ac15b0a0 con 0x7f268c066f30 2023-10-09T11:47:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.651+0000 7f26a2ffd700 1 -- 172.21.15.6:0/3602143003 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2694000c50 con 0x7f268c066f30 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 msgr2=0x7f268c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 0x7f268c0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f26940093f0 tx=0x7f2694017000 comp rx=0 tx=0).stop 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 msgr2=0x7f26ac168c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c530 tx=0x7f269c00c8f0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 shutdown_connections 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f268c066f30 0x7f268c0693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26ac157a60 0x7f26ac0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26ac06c190 0x7f26ac168c00 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 --2- 172.21.15.6:0/3602143003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26ac0b3170 0x7f26ac159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 >> 172.21.15.6:0/3602143003 conn(0x7f26ac06cca0 msgr2=0x7f26ac153660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 shutdown_connections 2023-10-09T11:47:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.653+0000 7f26b14b2700 1 -- 172.21.15.6:0/3602143003 wait complete. 2023-10-09T11:47:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T11:47:42.666 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T11:47:42.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.787+0000 7fd53b3e6700 1 Processor -- start 2023-10-09T11:47:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 -- start start 2023-10-09T11:47:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd53415a2a0 0x7fd5340b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd5340ceb30 0x7fd5340cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340b0ca0 con 0x7fd53406d650 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53406e160 con 0x7fd53415a2a0 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.788+0000 7fd53b3e6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53406ea90 con 0x7fd5340ceb30 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd53415a2a0 0x7fd5340b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539983700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd53406d650 0x7fd53406da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35756/0 (socket says 172.21.15.6:35756) 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539983700 1 -- 172.21.15.6:0/927717146 learned_addr learned my addr 172.21.15.6:0/927717146 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd538981700 1 --2- 172.21.15.6:0/927717146 >> v2:172.21.15.118:3300/0 conn(0x7fd5340ceb30 0x7fd5340cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 -- 172.21.15.6:0/927717146 >> v2:172.21.15.118:3300/0 conn(0x7fd5340ceb30 msgr2=0x7fd5340cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 --2- 172.21.15.6:0/927717146 >> v2:172.21.15.118:3300/0 conn(0x7fd5340ceb30 0x7fd5340cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 -- 172.21.15.6:0/927717146 >> v1:172.21.15.6:6789/0 conn(0x7fd53406d650 legacy=0x7fd53406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 -- 172.21.15.6:0/927717146 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340b00d0 con 0x7fd53415a2a0 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd539182700 1 --2- 172.21.15.6:0/927717146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd53415a2a0 0x7fd5340b1130 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fd53406ab90 tx=0x7fd52c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eaaf32017d94a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd533fff700 1 -- 172.21.15.6:0/927717146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00e070 con 0x7fd53415a2a0 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd533fff700 1 -- 172.21.15.6:0/927717146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00bc30 con 0x7fd53415a2a0 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.789+0000 7fd533fff700 1 -- 172.21.15.6:0/927717146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c012430 con 0x7fd53415a2a0 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 -- 172.21.15.6:0/927717146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd53415a2a0 msgr2=0x7fd5340b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/927717146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd53415a2a0 0x7fd5340b1130 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fd53406ab90 tx=0x7fd52c009780 comp rx=0 tx=0).stop 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 -- 172.21.15.6:0/927717146 shutdown_connections 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/927717146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd53415a2a0 0x7fd5340b1130 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/927717146 >> v2:172.21.15.118:3300/0 conn(0x7fd5340ceb30 0x7fd5340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 -- 172.21.15.6:0/927717146 >> 172.21.15.6:0/927717146 conn(0x7fd534067640 msgr2=0x7fd534067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 -- 172.21.15.6:0/927717146 shutdown_connections 2023-10-09T11:47:42.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.790+0000 7fd53b3e6700 1 -- 172.21.15.6:0/927717146 wait complete. 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.791+0000 7fd53b3e6700 1 Processor -- start 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.791+0000 7fd53b3e6700 1 -- start start 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd53406d650 0x7fd53414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 0x7fd534150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd53415a2a0 0x7fd534150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340b3100 con 0x7fd5340ceb30 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53415e1d0 con 0x7fd53415a2a0 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd53b3e6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53415d8a0 con 0x7fd53406d650 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 0x7fd534150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 0x7fd534150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40008/0 (socket says 172.21.15.6:40008) 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 -- 172.21.15.6:0/3817621702 learned_addr learned my addr 172.21.15.6:0/3817621702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd539182700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd53406d650 0x7fd53414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd539983700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd53415a2a0 0x7fd534150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 -- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd53406d650 msgr2=0x7fd53414fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd53406d650 0x7fd53414fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 -- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd53415a2a0 msgr2=0x7fd534150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd53415a2a0 0x7fd534150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.792+0000 7fd538981700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009a20 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd538981700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 0x7fd534150a40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd52800d890 tx=0x7fd528008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5280125f0 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528012750 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53415db80 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528012af0 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.793+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534150340 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.794+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd534069e40 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.794+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd52801e460 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.794+0000 7fd5317fa700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd520066f30 0x7fd5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd528084760 con 0x7fd5340ceb30 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd539182700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd520066f30 0x7fd5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd5317fa700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7fd52006cd80 0x7fd52006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd52006f860 con 0x7fd52006cd80 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd528086da0 con 0x7fd5340ceb30 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd539983700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7fd52006cd80 0x7fd52006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd539182700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd520066f30 0x7fd5200693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd53406ab90 tx=0x7fd52c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.795+0000 7fd539983700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7fd52006cd80 0x7fd52006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.796+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== osd.5 v2:172.21.15.118:6803/86574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fd52006f860 con 0x7fd52006cd80 2023-10-09T11:47:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 --> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd53404bb80 con 0x7fd52006cd80 2023-10-09T11:47:42.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd5317fa700 1 -- 172.21.15.6:0/3817621702 <== osd.5 v2:172.21.15.118:6803/86574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fd53404bb80 con 0x7fd52006cd80 2023-10-09T11:47:42.810 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:42.811 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:42.811 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:42.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7fd52006cd80 msgr2=0x7fd52006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.118:6803/86574,v1:172.21.15.118:6805/86574] conn(0x7fd52006cd80 0x7fd52006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd520066f30 msgr2=0x7fd5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fd520066f30 0x7fd5200693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd53406ab90 tx=0x7fd52c019000 comp rx=0 tx=0).stop 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 msgr2=0x7fd534150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.809+0000 7fd53b3e6700 1 --2- 172.21.15.6:0/3817621702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5340ceb30 0x7fd534150a40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd52800d890 tx=0x7fd528008040 comp rx=0 tx=0).stop 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.810+0000 7fd539983700 1 -- 172.21.15.6:0/3817621702 reap_dead start 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.810+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 shutdown_connections 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.810+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 >> 172.21.15.6:0/3817621702 conn(0x7fd534067640 msgr2=0x7fd534158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.810+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 shutdown_connections 2023-10-09T11:47:42.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.810+0000 7fd53b3e6700 1 -- 172.21.15.6:0/3817621702 wait complete. 2023-10-09T11:47:42.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T11:47:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.940+0000 7f1a34109700 1 Processor -- start 2023-10-09T11:47:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 -- start start 2023-10-09T11:47:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 0x7f1a2c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 0x7f1a2c06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c06ea90 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cf4f0 con 0x7f1a2c15a2a0 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.941+0000 7f1a34109700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0b0ca0 con 0x7f1a2c06d650 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40022/0 (socket says 172.21.15.6:40022) 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 -- 172.21.15.6:0/3424308867 learned_addr learned my addr 172.21.15.6:0/3424308867 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a326a6700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 0x7f1a2c06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a31ea5700 1 --2- 172.21.15.6:0/3424308867 >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 0x7f1a2c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 -- 172.21.15.6:0/3424308867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 msgr2=0x7f1a2c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 0x7f1a2c06da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 -- 172.21.15.6:0/3424308867 >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 msgr2=0x7f1a2c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 --2- 172.21.15.6:0/3424308867 >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 0x7f1a2c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 -- 172.21.15.6:0/3424308867 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0b00d0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a31ea5700 1 --2- 172.21.15.6:0/3424308867 >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 0x7f1a2c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a326a6700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 0x7f1a2c06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a316a4700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0637a0 tx=0x7f1a20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177863b0e3d0bde4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a30ea3700 1 -- 172.21.15.6:0/3424308867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000b860 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a30ea3700 1 -- 172.21.15.6:0/3424308867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000b9c0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.942+0000 7f1a30ea3700 1 -- 172.21.15.6:0/3424308867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000bd60 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 -- 172.21.15.6:0/3424308867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 msgr2=0x7f1a2c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0637a0 tx=0x7f1a20009250 comp rx=0 tx=0).stop 2023-10-09T11:47:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 -- 172.21.15.6:0/3424308867 shutdown_connections 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c06d650 0x7f1a2c06da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 --2- 172.21.15.6:0/3424308867 >> v2:172.21.15.118:3300/0 conn(0x7f1a2c15a2a0 0x7f1a2c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 --2- 172.21.15.6:0/3424308867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cefb0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 -- 172.21.15.6:0/3424308867 >> 172.21.15.6:0/3424308867 conn(0x7f1a2c067640 msgr2=0x7f1a2c067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 -- 172.21.15.6:0/3424308867 shutdown_connections 2023-10-09T11:47:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.943+0000 7f1a34109700 1 -- 172.21.15.6:0/3424308867 wait complete. 2023-10-09T11:47:42.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.944+0000 7f1a34109700 1 Processor -- start 2023-10-09T11:47:42.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.944+0000 7f1a34109700 1 -- start start 2023-10-09T11:47:42.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2c06d650 0x7f1a2c149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c15a2a0 0x7f1a2c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cc7f0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cbbe0 con 0x7f1a2c06d650 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a34109700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cbec0 con 0x7f1a2c15a2a0 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40024/0 (socket says 172.21.15.6:40024) 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 -- 172.21.15.6:0/2991810606 learned_addr learned my addr 172.21.15.6:0/2991810606 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a326a6700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c15a2a0 0x7f1a2c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a31ea5700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2c06d650 0x7f1a2c149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 -- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c15a2a0 msgr2=0x7f1a2c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c15a2a0 0x7f1a2c15acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 -- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2c06d650 msgr2=0x7f1a2c149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2c06d650 0x7f1a2c149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 -- 172.21.15.6:0/2991810606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200094f0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.945+0000 7f1a316a4700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009290 tx=0x7f1a20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.946+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011e40 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.946+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2001f070 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.946+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200266d0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.946+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0cc1a0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.946+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c0ca3f0 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.947+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0cc640 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.947+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a20026a40 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.947+0000 7f1a29ffb700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.948+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1a20021070 con 0x7f1a2c0ceb30 2023-10-09T11:47:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.948+0000 7f1a31ea5700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.948+0000 7f1a31ea5700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 0x7f1a180693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1a24006fd0 tx=0x7f1a24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:42.952+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a200535a0 con 0x7f1a2c0ceb30 2023-10-09T11:47:43.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.144+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a2c15c820 con 0x7f1a18066f30 2023-10-09T11:47:43.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.144+0000 7f1a29ffb700 1 -- 172.21.15.6:0/2991810606 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a2c15c820 con 0x7f1a18066f30 2023-10-09T11:47:43.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 msgr2=0x7f1a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 0x7f1a180693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1a24006fd0 tx=0x7f1a24008040 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 msgr2=0x7f1a2c0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009290 tx=0x7f1a20017000 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 shutdown_connections 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2c15a2a0 0x7f1a2c15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2c06d650 0x7f1a2c149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 --2- 172.21.15.6:0/2991810606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a2c0ceb30 0x7f1a2c0cb0e0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 >> 172.21.15.6:0/2991810606 conn(0x7f1a2c067640 msgr2=0x7f1a2c0cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 shutdown_connections 2023-10-09T11:47:43.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.146+0000 7f1a34109700 1 -- 172.21.15.6:0/2991810606 wait complete. 2023-10-09T11:47:43.149 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T11:47:43.159 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T11:47:43.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:43.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.281+0000 7fc45adcf700 1 Processor -- start 2023-10-09T11:47:43.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.281+0000 7fc45adcf700 1 -- start start 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc45adcf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc45adcf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc454157ca0 0x7fc45415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc45adcf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4540d07c0 con 0x7fc45406d120 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc45adcf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4540cfbb0 con 0x7fc454157ca0 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc45adcf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540cfe90 con 0x7fc4541578d0 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc454157ca0 0x7fc45415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc454157ca0 0x7fc45415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59998/0 (socket says 172.21.15.6:59998) 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 -- 172.21.15.6:0/1744962258 learned_addr learned my addr 172.21.15.6:0/1744962258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc458b6b700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 -- 172.21.15.6:0/1744962258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 msgr2=0x7fc4540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 -- 172.21.15.6:0/1744962258 >> v1:172.21.15.118:6789/0 conn(0x7fc45406d120 legacy=0x7fc45415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 -- 172.21.15.6:0/1744962258 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4540d0170 con 0x7fc454157ca0 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.282+0000 7fc453fff700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc45415af00 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fc444009f20 tx=0x7fc444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd70c331167de262 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc4537fe700 1 -- 172.21.15.6:0/1744962258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400e070 con 0x7fc454157ca0 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc4537fe700 1 -- 172.21.15.6:0/1744962258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400b9d0 con 0x7fc454157ca0 2023-10-09T11:47:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc4537fe700 1 -- 172.21.15.6:0/1744962258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440092e0 con 0x7fc454157ca0 2023-10-09T11:47:43.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 -- 172.21.15.6:0/1744962258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 msgr2=0x7fc45415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc45415af00 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fc444009f20 tx=0x7fc444009840 comp rx=0 tx=0).stop 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 -- 172.21.15.6:0/1744962258 shutdown_connections 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 --2- 172.21.15.6:0/1744962258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc45415af00 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 -- 172.21.15.6:0/1744962258 >> 172.21.15.6:0/1744962258 conn(0x7fc45406bb90 msgr2=0x7fc45406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 -- 172.21.15.6:0/1744962258 shutdown_connections 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.283+0000 7fc45adcf700 1 -- 172.21.15.6:0/1744962258 wait complete. 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.284+0000 7fc45adcf700 1 Processor -- start 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.284+0000 7fc45adcf700 1 -- start start 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc45406d120 0x7fc4540b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc4540ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540aad80 con 0x7fc454157ca0 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540b22b0 con 0x7fc45406d120 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45adcf700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540b2590 con 0x7fc4541578d0 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45936c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc4540ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45936c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc4540ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60000/0 (socket says 172.21.15.6:60000) 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc45936c700 1 -- 172.21.15.6:0/3999911974 learned_addr learned my addr 172.21.15.6:0/3999911974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc458b6b700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc45406d120 0x7fc4540b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.285+0000 7fc453fff700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 -- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 msgr2=0x7fc4540b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4541578d0 0x7fc4540b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 -- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc45406d120 msgr2=0x7fc4540b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc45406d120 0x7fc4540b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009ae0 con 0x7fc454157ca0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45936c700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc4540ae070 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c560 tx=0x7fc43c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011590 con 0x7fc454157ca0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c0116f0 con 0x7fc454157ca0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540aaa10 con 0x7fc454157ca0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011ab0 con 0x7fc454157ca0 2023-10-09T11:47:43.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.286+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454155200 con 0x7fc454157ca0 2023-10-09T11:47:43.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.287+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4540aa890 con 0x7fc454157ca0 2023-10-09T11:47:43.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.287+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc43c01b3b0 con 0x7fc454157ca0 2023-10-09T11:47:43.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc450ff9700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc434066f30 0x7fc4340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc43c083da0 con 0x7fc454157ca0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc458b6b700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc434066f30 0x7fc4340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc450ff9700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7fc43406cd80 0x7fc43406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc43406f860 con 0x7fc43406cd80 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc43c084170 con 0x7fc454157ca0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc453fff700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7fc43406cd80 0x7fc43406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.288+0000 7fc458b6b700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc434066f30 0x7fc4340693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009db0 tx=0x7fc44c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.289+0000 7fc453fff700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7fc43406cd80 0x7fc43406f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.289+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== osd.6 v2:172.21.15.118:6813/86575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fc43406f860 con 0x7fc43406cd80 2023-10-09T11:47:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.302+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 --> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc4541553f0 con 0x7fc43406cd80 2023-10-09T11:47:43.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.302+0000 7fc450ff9700 1 -- 172.21.15.6:0/3999911974 <== osd.6 v2:172.21.15.118:6813/86575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fc4541553f0 con 0x7fc43406cd80 2023-10-09T11:47:43.304 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:43.304 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:43.304 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7fc43406cd80 msgr2=0x7fc43406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.118:6813/86575,v1:172.21.15.118:6815/86575] conn(0x7fc43406cd80 0x7fc43406f190 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc434066f30 msgr2=0x7fc4340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7fc434066f30 0x7fc4340693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009db0 tx=0x7fc44c0091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 msgr2=0x7fc4540ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 --2- 172.21.15.6:0/3999911974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc454157ca0 0x7fc4540ae070 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00c560 tx=0x7fc43c007ef0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45936c700 1 -- 172.21.15.6:0/3999911974 reap_dead start 2023-10-09T11:47:43.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 shutdown_connections 2023-10-09T11:47:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 >> 172.21.15.6:0/3999911974 conn(0x7fc45406bb90 msgr2=0x7fc45406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 shutdown_connections 2023-10-09T11:47:43.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.303+0000 7fc45adcf700 1 -- 172.21.15.6:0/3999911974 wait complete. 2023-10-09T11:47:43.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T11:47:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.434+0000 7f200604b700 1 Processor -- start 2023-10-09T11:47:43.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.434+0000 7f200604b700 1 -- start start 2023-10-09T11:47:43.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f200604b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20001578d0 0x7f20000cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f200604b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f200006d120 0x7f200006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f200604b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20000d07c0 con 0x7f2000157ca0 2023-10-09T11:47:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f200604b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200006da50 con 0x7f200006d120 2023-10-09T11:47:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f200604b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000cfbb0 con 0x7f20001578d0 2023-10-09T11:47:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ff7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2000157ca0 0x7f200015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36376/0 (socket says 172.21.15.6:36376) 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ff7fff700 1 -- 172.21.15.6:0/3958642747 learned_addr learned my addr 172.21.15.6:0/3958642747 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffffff700 1 --2- 172.21.15.6:0/3958642747 >> v2:172.21.15.6:3300/0 conn(0x7f200006d120 0x7f200006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1fff7fe700 1 --2- 172.21.15.6:0/3958642747 >> v2:172.21.15.118:3300/0 conn(0x7f20001578d0 0x7f20000cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffeffd700 1 -- 172.21.15.6:0/3958642747 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853517726 0 0) 0x7f20000d07c0 con 0x7f2000157ca0 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffeffd700 1 -- 172.21.15.6:0/3958642747 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fec003570 con 0x7f2000157ca0 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffffff700 1 -- 172.21.15.6:0/3958642747 >> v2:172.21.15.118:3300/0 conn(0x7f20001578d0 msgr2=0x7f20000cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffffff700 1 --2- 172.21.15.6:0/3958642747 >> v2:172.21.15.118:3300/0 conn(0x7f20001578d0 0x7f20000cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.435+0000 7f1ffffff700 1 -- 172.21.15.6:0/3958642747 >> v1:172.21.15.6:6789/0 conn(0x7f2000157ca0 legacy=0x7f200015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f1ffffff700 1 -- 172.21.15.6:0/3958642747 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000cfe90 con 0x7f200006d120 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f1ffffff700 1 --2- 172.21.15.6:0/3958642747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f200006d120 0x7f200006d510 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f20000646b0 tx=0x7f1ff8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e282f2107bbc24c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f1ffeffd700 1 -- 172.21.15.6:0/3958642747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800e070 con 0x7f200006d120 2023-10-09T11:47:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f1ffeffd700 1 -- 172.21.15.6:0/3958642747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800bab0 con 0x7f200006d120 2023-10-09T11:47:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f1ffeffd700 1 -- 172.21.15.6:0/3958642747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800be70 con 0x7f200006d120 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 -- 172.21.15.6:0/3958642747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f200006d120 msgr2=0x7f200006d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 --2- 172.21.15.6:0/3958642747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f200006d120 0x7f200006d510 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f20000646b0 tx=0x7f1ff8009780 comp rx=0 tx=0).stop 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 -- 172.21.15.6:0/3958642747 shutdown_connections 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 --2- 172.21.15.6:0/3958642747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f200006d120 0x7f200006d510 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 --2- 172.21.15.6:0/3958642747 >> v2:172.21.15.118:3300/0 conn(0x7f20001578d0 0x7f20000cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 -- 172.21.15.6:0/3958642747 >> 172.21.15.6:0/3958642747 conn(0x7f200006bb90 msgr2=0x7f200006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.436+0000 7f200604b700 1 -- 172.21.15.6:0/3958642747 shutdown_connections 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.437+0000 7f200604b700 1 -- 172.21.15.6:0/3958642747 wait complete. 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 Processor -- start 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 -- start start 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200006d120 0x7f20000ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20001578d0 0x7f20000b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000b3fb0 con 0x7f2000157ca0 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000b63f0 con 0x7f200006d120 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f200604b700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000acaa0 con 0x7f20001578d0 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f1ffffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f1ffffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60014/0 (socket says 172.21.15.6:60014) 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.438+0000 7f1ffffff700 1 -- 172.21.15.6:0/27335652 learned_addr learned my addr 172.21.15.6:0/27335652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1fff7fe700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200006d120 0x7f20000ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ff7fff700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20001578d0 0x7f20000b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 -- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20001578d0 msgr2=0x7f20000b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20001578d0 0x7f20000b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 -- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200006d120 msgr2=0x7f20000ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200006d120 0x7f20000ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 -- 172.21.15.6:0/27335652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff8009a20 con 0x7f2000157ca0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ffffff700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f200006fe20 tx=0x7f1ff8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8012dd0 con 0x7f2000157ca0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8027470 con 0x7f2000157ca0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20000acd80 con 0x7f2000157ca0 2023-10-09T11:47:43.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8027830 con 0x7f2000157ca0 2023-10-09T11:47:43.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.439+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000b3c40 con 0x7f2000157ca0 2023-10-09T11:47:43.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.440+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000b4160 con 0x7f2000157ca0 2023-10-09T11:47:43.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.441+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ff8024070 con 0x7f2000157ca0 2023-10-09T11:47:43.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.441+0000 7f1ff77fe700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.441+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ff8086ca0 con 0x7f2000157ca0 2023-10-09T11:47:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.441+0000 7f1fff7fe700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.442+0000 7f1fff7fe700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009db0 tx=0x7f1ff00091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.446+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20000b4160 con 0x7f2000157ca0 2023-10-09T11:47:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.639+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f20000b40f0 con 0x7f1fe0066f30 2023-10-09T11:47:43.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.639+0000 7f1ff77fe700 1 -- 172.21.15.6:0/27335652 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f20000b40f0 con 0x7f1fe0066f30 2023-10-09T11:47:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 msgr2=0x7f1fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009db0 tx=0x7f1ff00091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 msgr2=0x7f20001549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f200006fe20 tx=0x7f1ff8019000 comp rx=0 tx=0).stop 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 shutdown_connections 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2000157ca0 0x7f20001549e0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200006d120 0x7f20000ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 --2- 172.21.15.6:0/27335652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20001578d0 0x7f20000b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 >> 172.21.15.6:0/27335652 conn(0x7f200006bb90 msgr2=0x7f2000156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 shutdown_connections 2023-10-09T11:47:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.641+0000 7f200604b700 1 -- 172.21.15.6:0/27335652 wait complete. 2023-10-09T11:47:43.644 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T11:47:43.654 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T11:47:43.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T11:47:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.775+0000 7f5a010ad700 1 Processor -- start 2023-10-09T11:47:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.775+0000 7f5a010ad700 1 -- start start 2023-10-09T11:47:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f5a010ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f5a010ad700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f59fc06e4e0 0x7f59fc0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f5a010ad700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0aaf40 con 0x7f59fc15a080 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f5a010ad700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc06c570 con 0x7f59fc06e4e0 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f5a010ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0aa930 con 0x7f59fc159cb0 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f59fb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f59fc06e4e0 0x7f59fc0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f59fbfff700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.6:39472/0 (socket says 172.21.15.6:39472) 2023-10-09T11:47:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.776+0000 7f59fbfff700 1 -- 172.21.15.6:0/79172354 learned_addr learned my addr 172.21.15.6:0/79172354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59fbfff700 1 -- 172.21.15.6:0/79172354 >> v2:172.21.15.118:3300/0 conn(0x7f59fc06e4e0 msgr2=0x7f59fc0ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59fbfff700 1 --2- 172.21.15.6:0/79172354 >> v2:172.21.15.118:3300/0 conn(0x7f59fc06e4e0 0x7f59fc0ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59fbfff700 1 -- 172.21.15.6:0/79172354 >> v1:172.21.15.118:6789/0 conn(0x7f59fc15a080 legacy=0x7f59fc0ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59fbfff700 1 -- 172.21.15.6:0/79172354 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc06e970 con 0x7f59fc159cb0 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59fbfff700 1 --2- 172.21.15.6:0/79172354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=428c676b1582f0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59faffd700 1 -- 172.21.15.6:0/79172354 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec009ea0 con 0x7f59fc159cb0 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59faffd700 1 -- 172.21.15.6:0/79172354 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00b860 con 0x7f59fc159cb0 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f59faffd700 1 -- 172.21.15.6:0/79172354 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00bc00 con 0x7f59fc159cb0 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.777+0000 7f5a010ad700 1 -- 172.21.15.6:0/79172354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 msgr2=0x7f59fc0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 --2- 172.21.15.6:0/79172354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec009250 comp rx=0 tx=0).stop 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 -- 172.21.15.6:0/79172354 shutdown_connections 2023-10-09T11:47:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 --2- 172.21.15.6:0/79172354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc159cb0 0x7f59fc0ce970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 --2- 172.21.15.6:0/79172354 >> v2:172.21.15.118:3300/0 conn(0x7f59fc06e4e0 0x7f59fc0ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 -- 172.21.15.6:0/79172354 >> 172.21.15.6:0/79172354 conn(0x7f59fc068110 msgr2=0x7f59fc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 -- 172.21.15.6:0/79172354 shutdown_connections 2023-10-09T11:47:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.778+0000 7f5a010ad700 1 -- 172.21.15.6:0/79172354 wait complete. 2023-10-09T11:47:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.779+0000 7f5a010ad700 1 Processor -- start 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.779+0000 7f5a010ad700 1 -- start start 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc06e4e0 0x7f59fc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 0x7f59fc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59fc15a080 0x7f59fc0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0c4d10 con 0x7f59fc159cb0 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0c4140 con 0x7f59fc15a080 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0c43e0 con 0x7f59fc06e4e0 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 0x7f59fc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 0x7f59fc0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60024/0 (socket says 172.21.15.6:60024) 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 -- 172.21.15.6:0/2690069732 learned_addr learned my addr 172.21.15.6:0/2690069732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fbfff700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc06e4e0 0x7f59fc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a008ac700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59fc15a080 0x7f59fc0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 -- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc06e4e0 msgr2=0x7f59fc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59fc06e4e0 0x7f59fc1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 -- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59fc15a080 msgr2=0x7f59fc0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59fc15a080 0x7f59fc0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0094f0 con 0x7f59fc159cb0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59fb7fe700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 0x7f59fc0c65f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f59e400ec80 tx=0x7f59e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4009690 con 0x7f59fc159cb0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400c850 con 0x7f59fc159cb0 2023-10-09T11:47:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc0c46c0 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400cc10 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.780+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc0b3b60 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.781+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59fc069c00 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59e4013470 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59e4084410 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59fbfff700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f59dc06cd80 0x7f59dc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59dc06f860 con 0x7f59dc06cd80 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.782+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=184) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59e4086a50 con 0x7f59fc159cb0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.783+0000 7f59fbfff700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.783+0000 7f5a008ac700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f59dc06cd80 0x7f59dc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.783+0000 7f5a008ac700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f59dc06cd80 0x7f59dc06f190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.784+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== osd.7 v2:172.21.15.118:6823/86576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f59dc06f860 con 0x7f59dc06cd80 2023-10-09T11:47:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.796+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 --> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59fc0c51a0 con 0x7f59dc06cd80 2023-10-09T11:47:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f59f3fff700 1 -- 172.21.15.6:0/2690069732 <== osd.7 v2:172.21.15.118:6823/86576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f59fc0c51a0 con 0x7f59dc06cd80 2023-10-09T11:47:43.798 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-09T11:47:43.799 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-09T11:47:43.799 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f59dc06cd80 msgr2=0x7f59dc06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.118:6823/86576,v1:172.21.15.118:6825/86576] conn(0x7f59dc06cd80 0x7f59dc06f190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59dc066f30 msgr2=0x7f59dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec017000 comp rx=0 tx=0).stop 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 msgr2=0x7f59fc0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a010ad700 1 --2- 172.21.15.6:0/2690069732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59fc159cb0 0x7f59fc0c65f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f59e400ec80 tx=0x7f59e40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.797+0000 7f5a008ac700 1 -- 172.21.15.6:0/2690069732 reap_dead start 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.798+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 shutdown_connections 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.798+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 >> 172.21.15.6:0/2690069732 conn(0x7f59fc068110 msgr2=0x7f59fc1563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.798+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 shutdown_connections 2023-10-09T11:47:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.798+0000 7f5a010ad700 1 -- 172.21.15.6:0/2690069732 wait complete. 2023-10-09T11:47:43.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T11:47:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.929+0000 7f12e7054700 1 Processor -- start 2023-10-09T11:47:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.929+0000 7f12e7054700 1 -- start start 2023-10-09T11:47:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e7054700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12e0157ca0 0x7f12e00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e7054700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00d07c0 con 0x7f12e01578d0 2023-10-09T11:47:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e7054700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00cfbb0 con 0x7f12e006d120 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e7054700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00cfe90 con 0x7f12e0157ca0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e4df0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f12e01578d0 0x7f12e015af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36380/0 (socket says 172.21.15.6:36380) 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12dffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12e0157ca0 0x7f12e00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.930+0000 7f12e4df0700 1 -- 172.21.15.6:0/2237920623 learned_addr learned my addr 172.21.15.6:0/2237920623 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12dffff700 1 -- 172.21.15.6:0/2237920623 >> v1:172.21.15.118:6789/0 conn(0x7f12e006d120 legacy=0x7f12e006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12dffff700 1 -- 172.21.15.6:0/2237920623 >> v1:172.21.15.6:6789/0 conn(0x7f12e01578d0 legacy=0x7f12e015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12df7fe700 1 -- 172.21.15.6:0/2237920623 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761360784 0 0) 0x7f12e00cfbb0 con 0x7f12e006d120 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12dffff700 1 -- 172.21.15.6:0/2237920623 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00d0170 con 0x7f12e0157ca0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12dffff700 1 --2- 172.21.15.6:0/2237920623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e0157ca0 0x7f12e00cf4f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098e0 tx=0x7f12d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8f467c467ed5bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12df7fe700 1 -- 172.21.15.6:0/2237920623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4009e80 con 0x7f12e0157ca0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12df7fe700 1 -- 172.21.15.6:0/2237920623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400b760 con 0x7f12e0157ca0 2023-10-09T11:47:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.931+0000 7f12df7fe700 1 -- 172.21.15.6:0/2237920623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400bae0 con 0x7f12e0157ca0 2023-10-09T11:47:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 -- 172.21.15.6:0/2237920623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e0157ca0 msgr2=0x7f12e00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 --2- 172.21.15.6:0/2237920623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e0157ca0 0x7f12e00cf4f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098e0 tx=0x7f12d40091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 -- 172.21.15.6:0/2237920623 shutdown_connections 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 --2- 172.21.15.6:0/2237920623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e0157ca0 0x7f12e00cf4f0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 -- 172.21.15.6:0/2237920623 >> 172.21.15.6:0/2237920623 conn(0x7f12e006bb90 msgr2=0x7f12e006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 -- 172.21.15.6:0/2237920623 shutdown_connections 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.932+0000 7f12e7054700 1 -- 172.21.15.6:0/2237920623 wait complete. 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.933+0000 7f12e7054700 1 Processor -- start 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.933+0000 7f12e7054700 1 -- start start 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12e01578d0 0x7f12e00ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12e0157ca0 0x7f12e00aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b3c40 con 0x7f12e006d120 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00acf60 con 0x7f12e01578d0 2023-10-09T11:47:43.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e7054700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b3ee0 con 0x7f12e0157ca0 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60032/0 (socket says 172.21.15.6:60032) 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 -- 172.21.15.6:0/287891645 learned_addr learned my addr 172.21.15.6:0/287891645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12dffff700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12e01578d0 0x7f12e00ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e55f1700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12e0157ca0 0x7f12e00aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 -- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12e0157ca0 msgr2=0x7f12e00aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12e0157ca0 0x7f12e00aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 -- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12e01578d0 msgr2=0x7f12e00ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12e01578d0 0x7f12e00ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 -- 172.21.15.6:0/287891645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009420 con 0x7f12e006d120 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12e4df0700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f12d800ce40 tx=0x7f12d8001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.934+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d800aa80 con 0x7f12e006d120 2023-10-09T11:47:43.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.935+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d800abe0 con 0x7f12e006d120 2023-10-09T11:47:43.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.935+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00b41c0 con 0x7f12e006d120 2023-10-09T11:47:43.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.935+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80070f0 con 0x7f12e006d120 2023-10-09T11:47:43.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.935+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e00ad240 con 0x7f12e006d120 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.936+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e0067ac0 con 0x7f12e006d120 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.936+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12d8007520 con 0x7f12e006d120 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.936+0000 7f12dcff9700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.936+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f12d80846d0 con 0x7f12e006d120 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.936+0000 7f12dffff700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:43.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.937+0000 7f12dffff700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 0x7f12cc0693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f12e01580c0 tx=0x7f12d4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:43.941+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12d8051cc0 con 0x7f12e006d120 2023-10-09T11:47:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.136+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f12e00d0450 con 0x7f12cc066f30 2023-10-09T11:47:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.136+0000 7f12dcff9700 1 -- 172.21.15.6:0/287891645 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12e00d0450 con 0x7f12cc066f30 2023-10-09T11:47:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 msgr2=0x7f12cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 0x7f12cc0693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f12e01580c0 tx=0x7f12d4016000 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 msgr2=0x7f12e00b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f12d800ce40 tx=0x7f12d8001be0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 shutdown_connections 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12e0157ca0 0x7f12e00aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12e006d120 0x7f12e00b6700 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 --2- 172.21.15.6:0/287891645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12e01578d0 0x7f12e00ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 >> 172.21.15.6:0/287891645 conn(0x7f12e006bb90 msgr2=0x7f12e01567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 shutdown_connections 2023-10-09T11:47:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.138+0000 7f12e7054700 1 -- 172.21.15.6:0/287891645 wait complete. 2023-10-09T11:47:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T11:47:44.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:47:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.269+0000 7f6271894700 1 Processor -- start 2023-10-09T11:47:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.269+0000 7f6271894700 1 -- start start 2023-10-09T11:47:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6271894700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f626c157ca0 0x7f626c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6271894700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c0d07c0 con 0x7f626c1578d0 2023-10-09T11:47:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6271894700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c0cfbb0 con 0x7f626c06d120 2023-10-09T11:47:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6271894700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c0cfe90 con 0x7f626c157ca0 2023-10-09T11:47:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f626affd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f626c1578d0 0x7f626c15af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36390/0 (socket says 172.21.15.6:36390) 2023-10-09T11:47:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f626affd700 1 -- 172.21.15.6:0/2018220517 learned_addr learned my addr 172.21.15.6:0/2018220517 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:47:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f626a7fc700 1 --2- 172.21.15.6:0/2018220517 >> v2:172.21.15.118:3300/0 conn(0x7f626c157ca0 0x7f626c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266790962 0 0) 0x7f626c0d07c0 con 0x7f626c1578d0 2023-10-09T11:47:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003570 con 0x7f626c1578d0 2023-10-09T11:47:44.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2796093328 0 0) 0x7f6258003570 con 0x7f626c1578d0 2023-10-09T11:47:44.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 >> v2:172.21.15.118:3300/0 conn(0x7f626c157ca0 msgr2=0x7f626c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:44.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 --2- 172.21.15.6:0/2018220517 >> v2:172.21.15.118:3300/0 conn(0x7f626c157ca0 0x7f626c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 >> v1:172.21.15.118:6789/0 conn(0x7f626c06d120 legacy=0x7f626c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0d0170 con 0x7f626c1578d0 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.270+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1815486633 0 0) 0x7f62640017f0 con 0x7f626c1578d0 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 >> v1:172.21.15.6:6789/0 conn(0x7f626c1578d0 legacy=0x7f626c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 0x7f6258003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0cfe90 con 0x7f6258003a60 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c0d0 con 0x7f6258004810 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c290 con 0x7f62580051c0 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 0x7f6258003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626a7fc700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626b7fe700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 -- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 msgr2=0x7f625800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62580051c0 0x7f625800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 -- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 msgr2=0x7f6258004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626b7fe700 1 -- 172.21.15.6:0/2018220517 reap_dead start 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 -- 172.21.15.6:0/2018220517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258003570 con 0x7f6258003a60 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626a7fc700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6258004810 0x7f6258004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f626affd700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 0x7f6258003e70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f626400a930 tx=0x7f62640021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcdf1a4a030bfed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640070d0 con 0x7f6258003a60 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6264007230 con 0x7f6258003a60 2023-10-09T11:47:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.271+0000 7f6269ffb700 1 -- 172.21.15.6:0/2018220517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640075d0 con 0x7f6258003a60 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 -- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 msgr2=0x7f6258003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 0x7f6258003e70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f626400a930 tx=0x7f62640021d0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 -- 172.21.15.6:0/2018220517 shutdown_connections 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 --2- 172.21.15.6:0/2018220517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6258003a60 0x7f6258003e70 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 -- 172.21.15.6:0/2018220517 >> 172.21.15.6:0/2018220517 conn(0x7f626c06bb90 msgr2=0x7f626c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 -- 172.21.15.6:0/2018220517 shutdown_connections 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.272+0000 7f6271894700 1 -- 172.21.15.6:0/2018220517 wait complete. 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.273+0000 7f6271894700 1 Processor -- start 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.273+0000 7f6271894700 1 -- start start 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f626c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f626c0c7890 0x7f626c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c16dd20 con 0x7f626c153680 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c16e000 con 0x7f626c0c7890 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f6271894700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c16e2e0 con 0x7f6258003a60 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60062/0 (socket says 172.21.15.6:60062) 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 -- 172.21.15.6:0/3167065087 learned_addr learned my addr 172.21.15.6:0/3167065087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626b7fe700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f626c0c7890 0x7f626c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626affd700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f626c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 -- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 msgr2=0x7f626c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f626c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 -- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f626c0c7890 msgr2=0x7f626c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f626c0c7890 0x7f626c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626a7fc700 1 -- 172.21.15.6:0/3167065087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c16e5c0 con 0x7f626c153680 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.274+0000 7f626affd700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f626c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f626a7fc700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6254011d20 tx=0x7f62540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400fac0 con 0x7f626c153680 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625400fc20 con 0x7f626c153680 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254014440 con 0x7f626c153680 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c16e8a0 con 0x7f626c153680 2023-10-09T11:47:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.275+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c0c8240 con 0x7f626c153680 2023-10-09T11:47:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.276+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c067ac0 con 0x7f626c153680 2023-10-09T11:47:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.276+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6254014a00 con 0x7f626c153680 2023-10-09T11:47:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.277+0000 7f6262ffd700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:47:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.277+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6254018030 con 0x7f626c153680 2023-10-09T11:47:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.277+0000 7f626affd700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:47:44.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.277+0000 7f626affd700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 0x7f624c0693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f626400a3f0 tx=0x7f6264016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:47:44.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.281+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62540523d0 con 0x7f626c153680 2023-10-09T11:47:44.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.471+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f626c0d0450 con 0x7f624c066f30 2023-10-09T11:47:44.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.473+0000 7f6262ffd700 1 -- 172.21.15.6:0/3167065087 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50165 (secure 0 0 0) 0x7f626c0d0450 con 0x7f624c066f30 2023-10-09T11:47:44.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 msgr2=0x7f624c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 0x7f624c0693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f626400a3f0 tx=0x7f6264016000 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 msgr2=0x7f626c153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6254011d20 tx=0x7f62540091a0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 shutdown_connections 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f624c066f30 0x7f624c0693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f626c0c7890 0x7f626c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6258003a60 0x7f626c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 --2- 172.21.15.6:0/3167065087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f626c153680 0x7f626c153af0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 >> 172.21.15.6:0/3167065087 conn(0x7f626c06bb90 msgr2=0x7f626c154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:47:44.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 shutdown_connections 2023-10-09T11:47:44.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:47:44.475+0000 7f6271894700 1 -- 172.21.15.6:0/3167065087 wait complete. 2023-10-09T11:47:44.478 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:47:44.488 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2023-10-09T11:47:44.303211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553294,"statfs":{"total":1600000000,"available":1590573395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.600962"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":302,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-09T11:47:32.703130+0000","last_change":"2023-10-09T11:35:53.610119+0000","last_active":"2023-10-09T11:47:32.703130+0000","last_peered":"2023-10-09T11:47:32.703130+0000","last_clean":"2023-10-09T11:47:32.703130+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:47:32.703130+0000","last_undegraded":"2023-10-09T11:47:32.703130+0000","last_fullsized":"2023-10-09T11:47:32.703130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T11:35:52.515966+0000","last_clean_scrub_stamp":"2023-10-09T11:35:52.515966+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:28.829181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198378772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.27500000000000002},"max":{"1min":0.70999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.59799999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.878},"last":0.51100000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.46700000000000003}]},{"osd":3,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":1.048},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.81100000000000005,"15min":1.079},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.45500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26400000000000001},"max":{"1min":0.53000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41499999999999998}]},{"osd":5,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64700000000000002,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.629},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59399999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":3.7589999999999999},"last":0.501},{"interface":"front","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.73499999999999999,"15min":0.78400000000000003},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.61799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":5.3540000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.6060000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.617},"last":0.57199999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.46},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":5.3949999999999996},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":1.2170000000000001,"5min":1.617,"15min":1.617},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42799999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.82999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.93300000000000005,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46000000000000002,"5min":0.624,"15min":1.9370000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.38,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":2.004},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.58299999999999996,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.622,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.29999999999999999}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59199999999999997,"5min":0.627,"15min":1.909},"last":0.376},{"interface":"front","average":{"1min":0.437,"5min":0.432,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":2.0369999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":2.1509999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.869},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.94499999999999995,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.873,"15min":2.1960000000000002},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.952},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":0.90100000000000002,"15min":1.782},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.819},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193730,"statfs":{"total":200000000,"available":198379783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39400000000000002,"15min":0.45100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.83999999999999997,"15min":2.194},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.508},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.82599999999999996,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.38600000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.629,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":2.5049999999999999,"15min":3.976},"last":0.437},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":1.03,"15min":2.1549999999999998},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.505},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.5429999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":1.593},"last":0.496},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44,"15min":0.432},"max":{"1min":0.81599999999999995,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.40600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36699999999999999,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.60599999999999998},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":11.055},"last":0.38}]},{"osd":3,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.41399999999999998},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.747,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.502}]},{"osd":5,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.77600000000000002,"5min":0.95099999999999996,"15min":1.097},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":2.2789999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36499999999999999},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.19},"max":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.371}]},{"osd":1,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.20399999999999999},"max":{"1min":0.502,"5min":0.621,"15min":1.034},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":1.335},"last":0.35199999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.26200000000000001,"15min":0.20499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":1.1200000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.82799999999999996,"15min":1.405},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":1.3600000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":0.95799999999999996,"15min":1.387},"last":0.53500000000000003}]},{"osd":6,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.38600000000000001},"max":{"1min":0.873,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":1.3819999999999999},"last":0.441}]},{"osd":7,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.371},"max":{"1min":0.85499999999999998,"5min":0.995,"15min":1.4570000000000001},"last":0.502},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.48499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.27300000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.373},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.68700000000000006},"min":{"1min":0.44700000000000001,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.73699999999999999,"5min":0.90000000000000002,"15min":7.4459999999999997},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":4.1609999999999996},"last":0.498},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":5.274},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.67700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79700000000000004,"15min":7.5679999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.69899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.82899999999999996},"last":0.60499999999999998}]},{"osd":6,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48299999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.86099999999999999},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.2729999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.85199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.96399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88500000000000001},"last":0.44600000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.626},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66000000000000003}]}]}],"pool_statfs":[]}} 2023-10-09T11:47:44.519 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T11:35:52.515966+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=11, tm_min=35, tm_sec=52, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=11, tm_min=47, tm_sec=39, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T11:47:44.519 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T11:48:04.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T11:48:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.650+0000 7f0b0bed6700 1 Processor -- start 2023-10-09T11:48:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0bed6700 1 -- start start 2023-10-09T11:48:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0bed6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b041578d0 0x7f0b040cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0bed6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040d07c0 con 0x7f0b0406d120 2023-10-09T11:48:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0bed6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040cfbb0 con 0x7f0b04157ca0 2023-10-09T11:48:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0bed6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b040cfe90 con 0x7f0b041578d0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b09c72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b041578d0 0x7f0b040cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.651+0000 7f0b0a473700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b0406d120 0x7f0b0406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43962/0 (socket says 172.21.15.6:43962) 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b0a473700 1 -- 172.21.15.6:0/3621788289 learned_addr learned my addr 172.21.15.6:0/3621788289 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b09c72700 1 -- 172.21.15.6:0/3621788289 >> v1:172.21.15.118:6789/0 conn(0x7f0b04157ca0 legacy=0x7f0b0415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b09c72700 1 -- 172.21.15.6:0/3621788289 >> v1:172.21.15.6:6789/0 conn(0x7f0b0406d120 legacy=0x7f0b0406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b09c72700 1 -- 172.21.15.6:0/3621788289 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040d0170 con 0x7f0b041578d0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b08c70700 1 -- 172.21.15.6:0/3621788289 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575020885 0 0) 0x7f0b040d07c0 con 0x7f0b0406d120 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b09c72700 1 --2- 172.21.15.6:0/3621788289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b040cf4f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0af40098e0 tx=0x7f0af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2c73db64243518 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b08c70700 1 -- 172.21.15.6:0/3621788289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4009e80 con 0x7f0b041578d0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b08c70700 1 -- 172.21.15.6:0/3621788289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400b860 con 0x7f0b041578d0 2023-10-09T11:48:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.652+0000 7f0b08c70700 1 -- 172.21.15.6:0/3621788289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400bbe0 con 0x7f0b041578d0 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3621788289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 msgr2=0x7f0b040cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3621788289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b040cf4f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0af40098e0 tx=0x7f0af40091a0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3621788289 shutdown_connections 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3621788289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b040cf4f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3621788289 >> 172.21.15.6:0/3621788289 conn(0x7f0b0406bb90 msgr2=0x7f0b0406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3621788289 shutdown_connections 2023-10-09T11:48:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.653+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3621788289 wait complete. 2023-10-09T11:48:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.654+0000 7f0b0bed6700 1 Processor -- start 2023-10-09T11:48:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.654+0000 7f0b0bed6700 1 -- start start 2023-10-09T11:48:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b0406d120 0x7f0b040cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04157ca0 0x7f0b04152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040b5360 con 0x7f0b041578d0 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0416ea20 con 0x7f0b04157ca0 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0bed6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040cdc40 con 0x7f0b0406d120 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37524/0 (socket says 172.21.15.6:37524) 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 -- 172.21.15.6:0/3205992284 learned_addr learned my addr 172.21.15.6:0/3205992284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b0a473700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04157ca0 0x7f0b04152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09c72700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b0406d120 0x7f0b040cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 -- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b0406d120 msgr2=0x7f0b040cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b0406d120 0x7f0b040cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 -- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04157ca0 msgr2=0x7f0b04152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04157ca0 0x7f0b04152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 -- 172.21.15.6:0/3205992284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4009420 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.655+0000 7f0b09471700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c590 tx=0x7f0af8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.656+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011590 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.656+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8011710 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.656+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011ad0 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.656+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b040b4d10 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.656+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b04152fa0 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.657+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b040b4b70 con 0x7f0b041578d0 2023-10-09T11:48:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.657+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0af801a360 con 0x7f0b041578d0 2023-10-09T11:48:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.657+0000 7f0b01ffb700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.658+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0af8083230 con 0x7f0b041578d0 2023-10-09T11:48:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.658+0000 7f0b09c72700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.658+0000 7f0b09c72700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 0x7f0af00693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0af40098e0 tx=0x7f0af4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.662+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b040b4b70 con 0x7f0b041578d0 2023-10-09T11:48:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.850+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 --> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b040b4b70 con 0x7f0af0066f30 2023-10-09T11:48:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.852+0000 7f0b01ffb700 1 -- 172.21.15.6:0/3205992284 <== mgr.4110 v2:172.21.15.6:6832/86144 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50186 (secure 0 0 0) 0x7f0b040b4b70 con 0x7f0af0066f30 2023-10-09T11:48:04.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:48:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 msgr2=0x7f0af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 0x7f0af00693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0af40098e0 tx=0x7f0af4017000 comp rx=0 tx=0).stop 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 msgr2=0x7f0b0416e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c590 tx=0x7f0af8007f50 comp rx=0 tx=0).stop 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 shutdown_connections 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b04157ca0 0x7f0b04152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b0406d120 0x7f0b040cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 --2- 172.21.15.6:0/3205992284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b041578d0 0x7f0b0416e4e0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 >> 172.21.15.6:0/3205992284 conn(0x7f0b0406bb90 msgr2=0x7f0b0415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 shutdown_connections 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.854+0000 7f0b0bed6700 1 -- 172.21.15.6:0/3205992284 wait complete. 2023-10-09T11:48:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-09T11:48:04.869 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-09T11:48:04.307551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553294,"statfs":{"total":1600000000,"available":1590573395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002596"},"pg_stats":[{"pgid":"1.0","version":"184'119","reported_seq":315,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T11:47:44.724657+0000","last_change":"2023-10-09T11:47:44.724630+0000","last_active":"2023-10-09T11:47:44.724657+0000","last_peered":"2023-10-09T11:47:44.724657+0000","last_clean":"2023-10-09T11:47:44.724657+0000","last_became_active":"2023-10-09T11:35:53.609199+0000","last_became_peered":"2023-10-09T11:35:53.609199+0000","last_unstale":"2023-10-09T11:47:44.724657+0000","last_undegraded":"2023-10-09T11:47:44.724657+0000","last_fullsized":"2023-10-09T11:47:44.724657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'119","last_scrub_stamp":"2023-10-09T11:47:44.724568+0000","last_deep_scrub":"184'119","last_deep_scrub_stamp":"2023-10-09T11:47:44.724568+0000","last_clean_scrub_stamp":"2023-10-09T11:47:44.724568+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:07:44.304494+0000","scrub_duration":0.0024023199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1583,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193729,"statfs":{"total":200000000,"available":198378772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.27500000000000002},"max":{"1min":0.70999999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.30399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.77100000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.26800000000000002},"max":{"1min":0.746,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.878},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.29699999999999999},"max":{"1min":0.74199999999999999,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61399999999999999,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.77500000000000002,"15min":0.90200000000000002},"last":0.63600000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.34300000000000003},"max":{"1min":0.77500000000000002,"5min":0.80900000000000005,"15min":1.048},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.81100000000000005,"15min":1.079},"last":0.56299999999999994}]},{"osd":4,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44,"15min":0.436},"min":{"1min":0.33400000000000002,"5min":0.30499999999999999,"15min":0.28000000000000003},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.78000000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.46700000000000003,"15min":0.45500000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26400000000000001},"max":{"1min":0.53000000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.50800000000000001}]},{"osd":5,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.33700000000000002,"15min":0.29499999999999998},"max":{"1min":0.67000000000000004,"5min":0.78600000000000003,"15min":0.83499999999999996},"last":0.439},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.37,"5min":0.32900000000000001,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.44900000000000001}]},{"osd":6,"last update":"Mon Oct 9 11:47:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64700000000000002,"5min":0.92200000000000004,"15min":0.92700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.53100000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.59399999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":3.7589999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67200000000000004,"5min":0.73499999999999999,"15min":0.78400000000000003},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57199999999999995,"15min":0.61799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":4.8230000000000004,"15min":5.298},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.30499999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":5.3540000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.40300000000000002,"5min":0.28499999999999998,"15min":0.26000000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.6060000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36699999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.617},"last":0.621}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":5.46},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":5.3949999999999996},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":1.2170000000000001,"5min":1.617,"15min":1.617},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.82999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":4.0339999999999998,"15min":4.0339999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.314},"max":{"1min":0.93300000000000005,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.88400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.374},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46000000000000002,"5min":0.624,"15min":1.9370000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.38,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.19700000000000001},"max":{"1min":0.56100000000000005,"5min":0.65900000000000003,"15min":2.004},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.38700000000000001},"min":{"1min":0.29099999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.58299999999999996,"5min":0.73699999999999999,"15min":2.2589999999999999},"last":0.315},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.433,"15min":0.41699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":0.622,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59199999999999997,"5min":0.627,"15min":1.909},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.432,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":2.0369999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":2.1509999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.94699999999999995,"15min":1.869},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.36699999999999999},"max":{"1min":0.94499999999999995,"5min":0.96699999999999997,"15min":1.9790000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.873,"15min":2.1960000000000002},"last":0.65200000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.379},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.952},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.504,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":2.2280000000000002},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48999999999999999,"5min":0.432,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":0.90100000000000002,"15min":1.782},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.819},"last":0.56699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193730,"statfs":{"total":200000000,"available":198379783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36899999999999999,"15min":0.40500000000000003},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.191},"max":{"1min":0.51300000000000001,"5min":0.55700000000000005,"15min":6.8959999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.37,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.22},"max":{"1min":0.61599999999999999,"5min":0.65000000000000002,"15min":1.3779999999999999},"last":0.499}]},{"osd":2,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.68700000000000006,"15min":2.2370000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.71799999999999997,"15min":1.4470000000000001},"last":0.38300000000000001}]},{"osd":3,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.39400000000000002,"15min":0.45100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":4.0369999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.83999999999999997,"15min":2.194},"last":0.442}]},{"osd":4,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":1.508},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.375,"15min":0.33600000000000002},"max":{"1min":0.82599999999999996,"5min":0.93300000000000005,"15min":3.9340000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.629,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"max":{"1min":0.69799999999999995,"5min":2.5049999999999999,"15min":3.976},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.51200000000000001,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.78800000000000003,"5min":1.03,"15min":2.1549999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68100000000000005,"15min":0.66800000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.97599999999999998,"15min":2.0859999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78700000000000003,"5min":0.91600000000000004,"15min":1.5429999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:47:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.92900000000000005,"15min":1.593},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.44,"15min":0.432},"max":{"1min":0.81599999999999995,"5min":2.5529999999999999,"15min":4.0060000000000002},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.36699999999999999,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.23499999999999999,"15min":0.20999999999999999},"max":{"1min":0.5,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.28299999999999997,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.66400000000000003,"15min":0.67100000000000004},"last":0.40899999999999997}]},{"osd":1,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38200000000000001,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.25},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.60599999999999998},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.24299999999999999},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":11.055},"last":0.59399999999999997}]},{"osd":3,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45300000000000001,"15min":0.41199999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27000000000000002},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71799999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.41399999999999998},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":0.72799999999999998,"15min":0.82199999999999995},"last":0.438}]},{"osd":4,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.747,"5min":0.95799999999999996,"15min":1.0489999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.36599999999999999,"15min":0.34000000000000002},"max":{"1min":0.83899999999999997,"5min":0.95099999999999996,"15min":1.0189999999999999},"last":0.39400000000000002}]},{"osd":5,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.77600000000000002,"5min":0.95099999999999996,"15min":1.097},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0189999999999999,"15min":1.0660000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 9 11:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.49099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":2.2789999999999999},"last":0.63},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46999999999999997,"15min":0.39600000000000002},"max":{"1min":0.88,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36799999999999999,"15min":0.36499999999999999},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.19},"max":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":1.3069999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.40600000000000003,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.214},"max":{"1min":0.50800000000000001,"5min":0.66100000000000003,"15min":1.0960000000000001},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.375,"15min":0.372},"min":{"1min":0.219,"5min":0.219,"15min":0.20399999999999999},"max":{"1min":0.502,"5min":0.621,"15min":1.034},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":0.59699999999999998,"5min":0.65400000000000003,"15min":1.335},"last":0.378}]},{"osd":2,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.26200000000000001,"15min":0.20499999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":1.1200000000000001},"last":0.441},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.82799999999999996,"15min":1.405},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35699999999999998},"max":{"1min":0.75,"5min":0.91800000000000004,"15min":1.4890000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.98399999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":1.3600000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38400000000000001},"max":{"1min":0.78400000000000003,"5min":0.95799999999999996,"15min":1.387},"last":0.52400000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.38600000000000001},"max":{"1min":0.873,"5min":0.93899999999999995,"15min":0.96399999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":0.92500000000000004,"5min":0.93100000000000005,"15min":1.3819999999999999},"last":0.54700000000000004}]},{"osd":7,"last update":"Mon Oct 9 11:47:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.371},"max":{"1min":0.85499999999999998,"5min":0.995,"15min":1.4570000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.40899999999999997},"max":{"1min":0.93899999999999995,"5min":0.98499999999999999,"15min":1.0109999999999999},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.27300000000000002},"max":{"1min":0.752,"5min":0.80200000000000005,"15min":7.4210000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.68700000000000006},"min":{"1min":0.44700000000000001,"5min":0.433,"15min":0.38400000000000001},"max":{"1min":0.73699999999999999,"5min":0.90000000000000002,"15min":7.4459999999999997},"last":0.63800000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54400000000000004,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.32600000000000001},"max":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":4.1609999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.78200000000000003,"5min":0.79800000000000004,"15min":5.274},"last":0.69599999999999995}]},{"osd":3,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.67700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.79700000000000004,"15min":7.5679999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.69899999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":7.5460000000000003},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.46500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.26800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26800000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.82899999999999996},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48299999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.86099999999999999},"last":1.069}]},{"osd":7,"last update":"Mon Oct 9 11:47:13 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28499999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.2729999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.314,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32500000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.437},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":1.1839999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.85199999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.96399999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.376,"15min":0.35899999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.63500000000000001}]},{"osd":4,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.26700000000000002},"max":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.23899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.88500000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.377,"5min":0.314,"15min":0.30499999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 11:47:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.312},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.32900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66700000000000004}]}]}],"pool_statfs":[]}} 2023-10-09T11:48:04.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T11:48:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.989+0000 7ff02d7c6700 1 Processor -- start 2023-10-09T11:48:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.989+0000 7ff02d7c6700 1 -- start start 2023-10-09T11:48:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02d7c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0280d0b80 0x7ff0280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02d7c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280cf2d0 con 0x7ff02806d700 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02d7c6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02806dc00 con 0x7ff0280d02b0 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02d7c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02815a690 con 0x7ff0280d0b80 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff027fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0280d0b80 0x7ff0280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02cfc5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff02806d700 0x7ff02815b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43964/0 (socket says 172.21.15.6:43964) 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff02cfc5700 1 -- 172.21.15.6:0/1532250529 learned_addr learned my addr 172.21.15.6:0/1532250529 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff027fff700 1 -- 172.21.15.6:0/1532250529 >> v1:172.21.15.118:6789/0 conn(0x7ff0280d02b0 legacy=0x7ff02806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff027fff700 1 -- 172.21.15.6:0/1532250529 >> v1:172.21.15.6:6789/0 conn(0x7ff02806d700 legacy=0x7ff02815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff027fff700 1 -- 172.21.15.6:0/1532250529 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280cf570 con 0x7ff0280d0b80 2023-10-09T11:48:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.990+0000 7ff026ffd700 1 -- 172.21.15.6:0/1532250529 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033365791 0 0) 0x7ff0280cf2d0 con 0x7ff02806d700 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff027fff700 1 --2- 172.21.15.6:0/1532250529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0280cfd70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff018009910 tx=0x7ff0180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b324ddf9a9a18e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff026ffd700 1 -- 172.21.15.6:0/1532250529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800b820 con 0x7ff0280d0b80 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff026ffd700 1 -- 172.21.15.6:0/1532250529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800b980 con 0x7ff0280d0b80 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff026ffd700 1 -- 172.21.15.6:0/1532250529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800bd20 con 0x7ff0280d0b80 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 -- 172.21.15.6:0/1532250529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 msgr2=0x7ff0280cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/1532250529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0280cfd70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff018009910 tx=0x7ff0180091a0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 -- 172.21.15.6:0/1532250529 shutdown_connections 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/1532250529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0280cfd70 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 -- 172.21.15.6:0/1532250529 >> 172.21.15.6:0/1532250529 conn(0x7ff028063230 msgr2=0x7ff028063600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 -- 172.21.15.6:0/1532250529 shutdown_connections 2023-10-09T11:48:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.991+0000 7ff02d7c6700 1 -- 172.21.15.6:0/1532250529 wait complete. 2023-10-09T11:48:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.992+0000 7ff02d7c6700 1 Processor -- start 2023-10-09T11:48:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 -- start start 2023-10-09T11:48:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02806d700 0x7ff028153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0280d02b0 0x7ff0281516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028151c00 con 0x7ff0280d0b80 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0281512c0 con 0x7ff02806d700 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02d7c6700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff028154920 con 0x7ff0280d02b0 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02cfc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.993+0000 7ff02cfc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37554/0 (socket says 172.21.15.6:37554) 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 -- 172.21.15.6:0/771629208 learned_addr learned my addr 172.21.15.6:0/771629208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff027fff700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02806d700 0x7ff028153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff0277fe700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0280d02b0 0x7ff0281516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 -- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0280d02b0 msgr2=0x7ff0281516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0280d02b0 0x7ff0281516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 -- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02806d700 msgr2=0x7ff028153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02806d700 0x7ff028153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 -- 172.21.15.6:0/771629208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018009420 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02cfc5700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff02000cc90 tx=0x7ff020001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000a8b0 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000aa10 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02814f5e0 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000add0 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.994+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff028154360 con 0x7ff0280d0b80 2023-10-09T11:48:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.995+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02814f770 con 0x7ff0280d0b80 2023-10-09T11:48:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.996+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff020007300 con 0x7ff0280d0b80 2023-10-09T11:48:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.996+0000 7ff00ffff700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.996+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff020084570 con 0x7ff0280d0b80 2023-10-09T11:48:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.996+0000 7ff027fff700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:04.997+0000 7ff027fff700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 0x7ff0140693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff0180093f0 tx=0x7ff018017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.000+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff020051b60 con 0x7ff0280d0b80 2023-10-09T11:48:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.196+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff0280676e0 con 0x7ff0280d0b80 2023-10-09T11:48:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.200+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff020051b60 con 0x7ff0280d0b80 2023-10-09T11:48:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.201+0000 7ff00ffff700 1 -- 172.21.15.6:0/771629208 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff020055180 con 0x7ff0280d0b80 2023-10-09T11:48:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 msgr2=0x7ff0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 0x7ff0140693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff0180093f0 tx=0x7ff018017000 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 msgr2=0x7ff0281557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff02000cc90 tx=0x7ff020001a80 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 shutdown_connections 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280d0b80 0x7ff0281557f0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02806d700 0x7ff028153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 --2- 172.21.15.6:0/771629208 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff0280d02b0 0x7ff0281516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 >> 172.21.15.6:0/771629208 conn(0x7ff028063230 msgr2=0x7ff028157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 shutdown_connections 2023-10-09T11:48:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.203+0000 7ff02d7c6700 1 -- 172.21.15.6:0/771629208 wait complete. 2023-10-09T11:48:05.217 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T11:48:05.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T11:48:05.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.334+0000 7f5b1e78c700 1 Processor -- start 2023-10-09T11:48:05.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 -- start start 2023-10-09T11:48:05.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b181578d0 0x7f5b180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 0x7f5b1815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180d07c0 con 0x7f5b1806d120 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180cfbb0 con 0x7f5b181578d0 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1e78c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180cfe90 con 0x7f5b18157ca0 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.335+0000 7f5b1cd29700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b1806d120 0x7f5b1815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43976/0 (socket says 172.21.15.6:43976) 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b1cd29700 1 -- 172.21.15.6:0/2640032078 learned_addr learned my addr 172.21.15.6:0/2640032078 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 --2- 172.21.15.6:0/2640032078 >> v2:172.21.15.118:3300/0 conn(0x7f5b181578d0 0x7f5b180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b177fe700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 0x7f5b1815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991573192 0 0) 0x7f5b180d07c0 con 0x7f5b1806d120 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b00003570 con 0x7f5b1806d120 2023-10-09T11:48:05.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 -- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 msgr2=0x7f5b1815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 0x7f5b1815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835904753 0 0) 0x7f5b00003570 con 0x7f5b1806d120 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 -- 172.21.15.6:0/2640032078 >> v1:172.21.15.6:6789/0 conn(0x7f5b1806d120 legacy=0x7f5b1815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 -- 172.21.15.6:0/2640032078 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180d0170 con 0x7f5b181578d0 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b177fe700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 0x7f5b1815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b17fff700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180cf4f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5b080098e0 tx=0x7f5b080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc478aee08c8c11d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100017f0 con 0x7f5b181578d0 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5b08011420 con 0x7f5b181578d0 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.336+0000 7f5b16ffd700 1 -- 172.21.15.6:0/2640032078 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080117a0 con 0x7f5b181578d0 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 -- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 msgr2=0x7f5b180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180cf4f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5b080098e0 tx=0x7f5b080091a0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 -- 172.21.15.6:0/2640032078 shutdown_connections 2023-10-09T11:48:05.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180cf4f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/2640032078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b18157ca0 0x7f5b1815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 -- 172.21.15.6:0/2640032078 >> 172.21.15.6:0/2640032078 conn(0x7f5b1806bb90 msgr2=0x7f5b1806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:05.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 -- 172.21.15.6:0/2640032078 shutdown_connections 2023-10-09T11:48:05.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.337+0000 7f5b1e78c700 1 -- 172.21.15.6:0/2640032078 wait complete. 2023-10-09T11:48:05.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.338+0000 7f5b1e78c700 1 Processor -- start 2023-10-09T11:48:05.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.338+0000 7f5b1e78c700 1 -- start start 2023-10-09T11:48:05.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b1806d120 0x7f5b180c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180c7560 con 0x7f5b18157ca0 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180c8bb0 con 0x7f5b181578d0 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1e78c700 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18154230 con 0x7f5b1806d120 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37560/0 (socket says 172.21.15.6:37560) 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 -- 172.21.15.6:0/3512418091 learned_addr learned my addr 172.21.15.6:0/3512418091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b17fff700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b1806d120 0x7f5b180c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b177fe700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 -- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b1806d120 msgr2=0x7f5b180c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b1806d120 0x7f5b180c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 -- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 msgr2=0x7f5b180c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.339+0000 7f5b1cd29700 1 -- 172.21.15.6:0/3512418091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c009420 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5b1cd29700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cbc0 tx=0x7f5b100015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10004dc0 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5b10007150 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b08009420 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10007530 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.340+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b180c8280 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.341+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180c8d60 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.341+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b100078e0 con 0x7f5b18157ca0 2023-10-09T11:48:05.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.342+0000 7f5afffff700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T11:48:05.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.342+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5b10083b20 con 0x7f5b18157ca0 2023-10-09T11:48:05.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.342+0000 7f5b17fff700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T11:48:05.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.342+0000 7f5b17fff700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 0x7f5b040693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5b08003080 tx=0x7f5b080091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T11:48:05.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.346+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b180c8d60 con 0x7f5b18157ca0 2023-10-09T11:48:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.584+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b180c8d60 con 0x7f5b18157ca0 2023-10-09T11:48:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.584+0000 7f5afffff700 1 -- 172.21.15.6:0/3512418091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f5b180c8d60 con 0x7f5b18157ca0 2023-10-09T11:48:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-09T11:48:05.586 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2648805876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2648805876},{"type":"v1","addr":"172.21.15.118:6835","nonce":2648805876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7606,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2883851393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2883851393},{"type":"v1","addr":"172.21.15.118:6834","nonce":2883851393}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/1330426334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1330426334},{"type":"v1","addr":"172.21.15.6:6836","nonce":1330426334}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/888329221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":888329221},{"type":"v1","addr":"172.21.15.6:6837","nonce":888329221}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[]} 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 msgr2=0x7f5b040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 0x7f5b040693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5b08003080 tx=0x7f5b080091a0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 msgr2=0x7f5b1816b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cbc0 tx=0x7f5b100015b0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 shutdown_connections 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:6832/86144,v1:172.21.15.6:6833/86144] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b18157ca0 0x7f5b1816b080 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b1806d120 0x7f5b180c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 --2- 172.21.15.6:0/3512418091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b181578d0 0x7f5b180c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T11:48:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 >> 172.21.15.6:0/3512418091 conn(0x7f5b1806bb90 msgr2=0x7f5b18156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T11:48:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 shutdown_connections 2023-10-09T11:48:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-09T11:48:05.586+0000 7f5b1e78c700 1 -- 172.21.15.6:0/3512418091 wait complete. 2023-10-09T11:48:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 94 2023-10-09T11:48:05.599 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T11:48:05.600 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T11:48:05.600 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T11:48:05.600 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.608 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T11:48:05.608 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T11:48:05.608 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:05.650 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:05.656 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T11:48:05.656 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T11:48:05.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.705 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T11:48:05.706 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T11:48:05.706 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.728 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T11:48:05.728 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T11:48:05.728 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T11:48:05.728 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.748 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T11:48:05.748 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T11:48:05.748 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.810 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T11:48:05.811 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T11:48:05.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.876 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T11:48:05.876 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T11:48:05.876 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.936 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T11:48:05.936 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T11:48:05.936 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:05.958 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T11:48:05.958 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T11:48:05.958 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.019 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T11:48:06.020 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T11:48:06.020 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.086 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T11:48:06.086 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T11:48:06.086 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.149 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T11:48:06.149 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T11:48:06.149 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T11:48:06.149 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.173 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T11:48:06.174 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T11:48:06.174 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.216 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T11:48:06.216 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T11:48:06.216 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T11:48:06.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.227 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T11:48:06.227 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T11:48:06.227 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.268 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T11:48:06.268 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T11:48:06.268 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T11:48:06.320 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T11:48:06.320 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T11:48:06.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T11:48:06.352 INFO:teuthology.orchestra.run.smithi006.stdout:1696851350.512159 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 219533.586260 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-09T11:48:06.352 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-09T11:48:06.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T11:48:06.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T11:48:06.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-09T11:48:06.569 INFO:teuthology.orchestra.run.smithi006.stdout:1696851350.512159 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 219533.586260 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-09T11:48:06.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:48:06.570 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T11:48:06.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:48:06.897 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T11:48:06.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:48:06.987 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T11:48:07.089 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:48:07.089 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T11:48:07.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:48:07.155 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T11:48:07.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:48:07.391 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T11:48:07.471 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:48:07.471 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T11:48:07.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:48:07.574 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T11:48:07.634 INFO:tasks.ceph:Archiving mon data... 2023-10-09T11:48:07.635 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/data/mon.a.tgz 2023-10-09T11:48:07.635 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-10-09T11:48:07.651 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.vSTRFhkjkZ 2023-10-09T11:48:07.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vSTRFhkjkZ 2023-10-09T11:48:07.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.vSTRFhkjkZ 2023-10-09T11:48:07.887 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.vSTRFhkjkZ is 370KB 2023-10-09T11:48:07.985 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.vSTRFhkjkZ 2023-10-09T11:48:08.000 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/data/mon.b.tgz 2023-10-09T11:48:08.000 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-10-09T11:48:08.016 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.QT0jL0gAvh 2023-10-09T11:48:08.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QT0jL0gAvh 2023-10-09T11:48:08.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.QT0jL0gAvh 2023-10-09T11:48:08.265 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.QT0jL0gAvh is 374KB 2023-10-09T11:48:08.360 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.QT0jL0gAvh 2023-10-09T11:48:08.374 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/data/mon.c.tgz 2023-10-09T11:48:08.374 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-10-09T11:48:08.427 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.d1GvR7WzZT 2023-10-09T11:48:08.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.d1GvR7WzZT 2023-10-09T11:48:08.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.d1GvR7WzZT 2023-10-09T11:48:08.640 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.d1GvR7WzZT is 374KB 2023-10-09T11:48:08.738 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.d1GvR7WzZT 2023-10-09T11:48:08.752 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T11:48:08.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T11:48:08.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T11:48:08.816 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T11:48:08.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T11:48:08.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T11:48:08.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T11:48:08.881 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T11:48:08.887 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T11:48:08.888 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi006/crash 2023-10-09T11:48:08.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T11:48:08.918 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi118/crash 2023-10-09T11:48:08.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T11:48:08.950 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T11:48:08.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:08.963 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:09.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:09.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T11:48:09.086 INFO:tasks.ceph:Compressing logs... 2023-10-09T11:48:09.086 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T11:48:09.105 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T11:48:09.128 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119139.log 2023-10-09T11:48:09.128 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113938.log 2023-10-09T11:48:09.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109320.log 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88900.log 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90235.log 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90606.log 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88900.log.gz 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr:gzip /var/log/ceph/ceph-client.1.90235.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.86220.log 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90235.log.gz 2023-10-09T11:48:09.172 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.90606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87768.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90606.log.gz 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91544.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86220.log.gz 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.87768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86346.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87768.log.gz 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.91544.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91544.log.gz 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86346.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86346.log.gz 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88148.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86434.log 2023-10-09T11:48:09.173 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88896.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88148.log.gz 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89768.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86434.log.gz 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88896.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88896.log.gz 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.89768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89768.log.gz 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88144.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89329.log 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88144.log.gz 2023-10-09T11:48:09.174 INFO:teuthology.orchestra.run.smithi118.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.89329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89329.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90231.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89764.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.90231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90231.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.89764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86391.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89764.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90610.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86391.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86391.log.gz 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.90610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91973.log 2023-10-09T11:48:09.175 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90610.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91073.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.91973.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91973.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 /var/log/ceph/ceph-client.1.91073.log: --verbose -- /var/log/ceph/ceph-client.admin.86476.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91073.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86476.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86476.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86180.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.86180.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86180.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91969.log 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.91969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91969.log.gz 2023-10-09T11:48:09.176 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88515.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88515.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88519.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.88519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88519.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87397.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.87397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87397.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91540.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.91540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91540.log.gz 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89325.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T11:48:09.177 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.89325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89325.log.gz 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87405.log 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.87405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87405.log.gz 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86304.log 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86304.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86304.log.gz 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86261.log 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.86261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86261.log.gz 2023-10-09T11:48:09.178 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91077.log 2023-10-09T11:48:09.180 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.91077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91077.log.gz 2023-10-09T11:48:09.180 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87764.log 2023-10-09T11:48:09.180 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.87764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87764.log.gz 2023-10-09T11:48:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110993.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119139.log.gz 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113938.log.gz 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.109320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109324.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109320.log.gz 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104900.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110993.log.gz 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.109324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106077.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109324.log.gz 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112769.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107446.log 2023-10-09T11:48:09.289 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104900.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113124.log 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106077.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112769.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117814.log 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113124.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107446.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93812.log 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113124.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116330.log 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117814.log.gz 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.93812.log: --verbose -- /var/log/ceph/ceph-client.admin.94790.log 2023-10-09T11:48:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.116330.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97237.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93812.log.gz 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108112.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97237.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.94790.log.gz--verbose 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.89319.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.116330.log.gz 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104100.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97237.log.gz 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89319.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108112.log.gz 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99395.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89319.log.gz 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87377.log 2023-10-09T11:48:09.291 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104100.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109818.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87377.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.99395.log.gz-5 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.94538.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87377.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102415.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109818.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95651.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96039.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94538.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95651.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102415.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102079.log 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96039.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95651.log.gz 2023-10-09T11:48:09.292 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115211.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96039.log.gz 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86105.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102079.log.gz 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107404.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115602.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115211.log.gz 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107404.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.86105.log.gz-5 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.93278.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107404.log.gz 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88822.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108809.log 2023-10-09T11:48:09.293 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115602.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92077.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93278.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100384.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88822.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108809.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93404.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92077.log: /var/log/ceph/ceph-client.admin.100384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91867.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92077.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100384.log.gz 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88480.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101911.log 2023-10-09T11:48:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.88480.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102865.log 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93404.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91867.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101911.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88480.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118509.log 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102865.log: gzip 87.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.101911.log.gz--verbose 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph.tmp-client.admin.84655.log 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102865.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108893.log 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.84655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93933.log 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118509.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84655.log.gz 2023-10-09T11:48:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101244.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108893.log: /var/log/ceph/ceph-client.admin.93933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109759.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108893.log.gz 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101244.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93933.log.gz 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87715.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101244.log.gz 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98839.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109759.log.gz 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107927.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98839.log: gzip 87.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.87715.log.gz-- 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117219.log 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.9%/var/log/ceph/ceph-client.admin.107927.log: -5 -- replaced with /var/log/ceph/ceph-client.admin.98839.log.gz 2023-10-09T11:48:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.110140.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118001.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107927.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93236.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117219.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110140.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94580.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118001.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115814.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101587.log 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93236.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115814.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94580.log.gz 2023-10-09T11:48:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87589.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115814.log.gz 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.0.101587.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.91026.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101587.log.gz 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87589.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87589.log.gz 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102205.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87096.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.91026.log.gz 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119266.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102205.log.gzgzip 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose /var/log/ceph/ceph-client.admin.87096.log: -- /var/log/ceph/ceph-client.admin.92264.log 2023-10-09T11:48:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88482.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119266.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87096.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119266.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98965.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88482.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92264.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91909.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88482.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113602.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89697.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98965.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113602.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91909.log.gz 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112146.log 2023-10-09T11:48:09.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89697.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.113602.log.gz-5 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.96583.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89697.log.gz 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95436.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96583.log: gzip -5 87.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.112146.log.gz 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91068.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118102.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96583.log.gz 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95436.log.gz 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111721.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91068.log.gz 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108502.log 2023-10-09T11:48:09.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111721.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118102.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96427.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96642.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96427.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.111721.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108502.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98063.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96427.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115858.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98063.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96642.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97405.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116634.log 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98063.log.gz 2023-10-09T11:48:09.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97405.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115858.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87975.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97405.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100051.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112998.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116634.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87975.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96894.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100051.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98663.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96382.log 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112998.log.gz 2023-10-09T11:48:09.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98663.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96894.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100818.log 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98663.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.96382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98143.log 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96382.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92464.log 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90732.log 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100818.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98143.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104324.log 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117730.log 88.6% 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92464.log.gz 2023-10-09T11:48:09.303 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6%/var/log/ceph/ceph-client.admin.104324.log: -- replaced with /var/log/ceph/ceph-client.admin.90732.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93152.log 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104324.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96936.log 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107842.log 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117730.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96936.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93152.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90942.log 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96936.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104042.log 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90942.log: gzip -5 --verbose 88.7%-- /var/log/ceph/ceph-client.admin.111595.log -- replaced with /var/log/ceph/ceph-client.admin.107842.log.gz 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-09T11:48:09.304 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90942.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101953.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104042.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89193.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118467.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111595.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89193.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101953.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114959.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89193.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.118467.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103249.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115992.log 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118467.log.gz 2023-10-09T11:48:09.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103249.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114959.log.gz 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89044.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103249.log.gz 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118635.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115992.log: /var/log/ceph/ceph-client.admin.89044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106984.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115992.log.gz 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118635.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89044.log.gz 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107969.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118635.log.gz 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100154.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91380.log 2023-10-09T11:48:09.306 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106984.log.gz 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107969.log.gz 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90687.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100154.log.gz 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111980.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.90687.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91380.log.gzgzip 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.111035.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90687.log.gz 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.111980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88139.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111980.log.gz 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102823.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115169.log 2023-10-09T11:48:09.307 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111035.log.gz 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102823.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88139.log.gz 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102373.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102823.log.gz 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114130.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103333.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115169.log.gz 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102373.log.gz 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96189.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114130.log.gz/var/log/ceph/ceph-client.admin.103333.log: 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93750.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92506.log 2023-10-09T11:48:09.308 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103333.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96189.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119184.log 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6%/var/log/ceph/ceph-client.admin.92506.log: -- replaced with /var/log/ceph/ceph-client.admin.93750.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105517.log 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90279.log 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92506.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119184.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98313.log 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.90279.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.89277.log 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105517.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90279.log.gz 2023-10-09T11:48:09.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88141.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89277.log: gzip -5 --verbose -- 87.3%/var/log/ceph/ceph-client.admin.101995.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98313.log.gz 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88141.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89277.log.gz 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98227.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103501.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88141.log.gz 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98227.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101995.log.gz 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110308.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103501.log: gzip -5 89.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.98227.log.gz/var/log/ceph/ceph-client.admin.100606.log 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103501.log.gz 2023-10-09T11:48:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114749.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91825.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110308.log.gz/var/log/ceph/ceph-client.admin.100606.log: 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114791.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100606.log.gz 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114749.log.gz 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114323.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114791.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91825.log.gz 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114875.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114791.log.gz 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.114323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106329.log 2023-10-09T11:48:09.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114323.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92035.log 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113854.log 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114875.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106329.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119055.log 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92035.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100988.log 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92802.log 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113854.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119055.log.gz 2023-10-09T11:48:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89361.log 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100988.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87138.log 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104942.log 87.6% 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92802.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89361.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102743.log 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87138.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114707.log 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90774.log 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104942.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102743.log.gz 2023-10-09T11:48:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109407.log 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114707.log.gz 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99115.log 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109407.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90774.log.gz 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101286.log 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109407.log.gz 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96469.log 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99115.log.gz 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114327.log 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97844.log 87.9% 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101286.log.gz 2023-10-09T11:48:09.314 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96469.log.gz 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.114327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95235.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114327.log.gz 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116078.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102665.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97844.log.gz 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95235.log.gz 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104732.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116078.log.gz 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109685.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104732.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.102665.log.gz-5 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103889.log 2023-10-09T11:48:09.315 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104732.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101632.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109685.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99308.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95913.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103889.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101632.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.99308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101328.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99308.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87419.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106942.log 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95913.log.gz 2023-10-09T11:48:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90287.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101328.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119013.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87419.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106942.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.90287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102247.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90287.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107362.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119013.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97489.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.102247.log.gz 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88148.log 2023-10-09T11:48:09.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97489.log: gzip 89.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.107362.log.gz 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97489.log.gz 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95173.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.88148.log.gz--verbose 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.102457.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118257.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95173.log.gz 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116120.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102457.log.gz 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105643.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118257.log: /var/log/ceph/ceph-client.admin.116120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91337.log 2023-10-09T11:48:09.318 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118257.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105643.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116120.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91741.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91337.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105643.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94892.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91337.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118383.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91741.log: /var/log/ceph/ceph-client.admin.94892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92888.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91741.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118383.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94892.log.gz 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89151.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117959.log 2023-10-09T11:48:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92888.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118383.log.gz 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111161.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92888.log.gz 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117959.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89151.log.gz 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103983.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111161.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117959.log.gz 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118761.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111161.log.gz 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97363.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118761.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.103983.log.gz-5 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.115001.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108376.log 2023-10-09T11:48:09.320 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118761.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97363.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106717.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115001.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112914.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106717.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.108376.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.95478.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106717.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105475.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112914.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116246.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95478.log: /var/log/ceph/ceph-client.admin.105475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97633.log 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95478.log.gz 2023-10-09T11:48:09.321 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105475.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87266.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116246.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115644.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104282.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97633.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87266.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88819.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115644.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99353.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104648.log 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104282.log.gz 2023-10-09T11:48:09.322 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88819.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87631.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99353.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106119.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103543.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104648.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87631.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93663.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103543.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106119.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113082.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.93663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103123.log 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93663.log.gz 2023-10-09T11:48:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87461.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.103543.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103123.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113082.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105068.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103123.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113186.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105068.log: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.87461.log.gz--verbose 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.0.101591.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113186.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105068.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106203.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113186.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.101591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91568.log 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101591.log.gz 2023-10-09T11:48:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100690.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106203.log.gz 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119224.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91568.log.gz 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.100690.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.108011.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100196.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100690.log.gz 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108011.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119224.log.gz 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116288.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108011.log.gz 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117688.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94155.log 2023-10-09T11:48:09.325 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100196.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117688.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116288.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98747.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117688.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91169.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108767.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94155.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91169.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98747.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105026.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91169.log.gz 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111077.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117646.log 2023-10-09T11:48:09.326 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108767.log.gz 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111077.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105026.log.gz 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109643.log 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111077.log.gz 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100904.log 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109643.log: gzip -5 87.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.117646.log.gz/var/log/ceph/ceph-client.admin.91464.log 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100904.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109643.log.gzgzip 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.118299.log 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100904.log.gz 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110518.log 2023-10-09T11:48:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112685.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91464.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110518.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118299.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118719.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110518.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110350.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93667.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112685.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110350.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118719.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118060.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110350.log.gz 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.93667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112084.log 2023-10-09T11:48:09.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93667.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113558.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112084.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118060.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105376.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112084.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93066.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86888.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113558.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93066.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105376.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96123.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93066.log.gz 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87222.log 2023-10-09T11:48:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98705.log 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86888.log.gz 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103847.log 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87222.log.gz 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98705.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.96123.log.gz 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89571.log 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98705.log.gz/var/log/ceph/ceph-client.admin.103847.log: 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91422.log 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89571.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103847.log.gz 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103806.log 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89571.log.gz 2023-10-09T11:48:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119097.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.103806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91422.log.gz 0.0% 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.0.103806.log.gz 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104232.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98923.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119097.log.gz 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104232.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104232.log.gz 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114917.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97447.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98923.log.gz 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87010.log 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114917.log.gz 2023-10-09T11:48:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114469.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97447.log.gz 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117041.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109902.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114469.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87010.log.gz 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109365.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114469.log.gz 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117041.log.gz 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112727.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109902.log: /var/log/ceph/ceph-client.admin.109365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100446.log 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109902.log.gz 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112727.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109365.log.gz 89.0% 2023-10-09T11:48:09.332 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103165.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112727.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104142.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103165.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100446.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89655.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103165.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99049.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107698.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104142.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99049.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89655.log.gz 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88485.log 2023-10-09T11:48:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.99049.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107698.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117436.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111119.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88485.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110182.log: /var/log/ceph/ceph-client.admin.117436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103417.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117436.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98271.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103417.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111119.log.gz 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103375.log 2023-10-09T11:48:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98271.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103417.log.gz 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104366.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98271.log.gz 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93320.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87925.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103375.log.gz 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93320.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104366.log.gz 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113430.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93320.log.gz 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110560.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113430.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.87925.log.gz--verbose 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.91110.log 2023-10-09T11:48:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110560.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113430.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91253.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110560.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100322.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87505.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91110.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100322.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91253.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116589.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100322.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94412.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.116589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97153.log 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87505.log.gz 2023-10-09T11:48:09.336 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116589.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89529.log 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94412.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113770.log 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97153.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118971.log 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88821.log 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89529.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113770.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108334.log 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118971.log.gz 2023-10-09T11:48:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92592.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108334.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.88821.log.gz--verbose 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.106245.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108334.log.gz 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88708.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92592.log.gz 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108460.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89109.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106245.log.gz 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88708.log.gz 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105823.log 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108460.log.gz 2023-10-09T11:48:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99715.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95563.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89109.log.gz 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105823.log.gz 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105194.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99715.log.gz 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95563.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103037.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95563.log.gz 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105194.log.gz 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106371.log 2023-10-09T11:48:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95701.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106371.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103037.log.gz 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104564.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92634.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95701.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.106371.log.gz 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96852.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95701.log.gz 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104564.log.gz 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86374.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96742.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96852.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92634.log.gz 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106900.log 2023-10-09T11:48:09.340 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96852.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86374.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94748.log 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112601.log 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96742.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94748.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106900.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92422.log 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112601.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94748.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117261.log 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112601.log.gz 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110644.log 2023-10-09T11:48:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92422.log: /var/log/ceph/ceph-client.admin.117261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91699.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92422.log.gz 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110644.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117261.log.gz 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94832.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99925.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1%/var/log/ceph/ceph-client.admin.91699.log: -- replaced with /var/log/ceph/ceph-client.admin.110644.log.gz 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94832.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.91699.log.gz 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.113812.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94832.log.gz 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89235.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99925.log: /var/log/ceph/ceph-client.admin.113812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92222.log 2023-10-09T11:48:09.342 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99925.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113812.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104408.log 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89235.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86634.log 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114833.log 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104408.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92222.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108174.log 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104408.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86634.log.gz 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105731.log 2023-10-09T11:48:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114833.log: /var/log/ceph/ceph-client.admin.108174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109061.log 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114833.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105731.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108174.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93110.log 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105731.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93470.log 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113346.log 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93110.log: /var/log/ceph/ceph-client.admin.93470.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.109061.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99967.log 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93110.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93470.log.gz 2023-10-09T11:48:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88707.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95313.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99967.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113346.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100524.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99967.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88707.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106675.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95313.log: /var/log/ceph/ceph-client.admin.100524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115379.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95313.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106675.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100524.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91295.log 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106675.log.gz 2023-10-09T11:48:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93708.log 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113644.log 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91295.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115379.log.gz 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106287.log 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91295.log.gz 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93708.log.gz 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98579.log 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113644.log: /var/log/ceph/ceph-client.admin.106287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103207.log 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113644.log.gz 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98579.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106287.log.gz 2023-10-09T11:48:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94622.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98579.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88479.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106779.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94622.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103207.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113040.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94622.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88479.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109019.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106779.log: /var/log/ceph/ceph-client.admin.113040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97279.log 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106779.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109019.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113040.log.gz 2023-10-09T11:48:09.347 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105601.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109019.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94664.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91951.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105601.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97279.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98881.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105601.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94664.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91993.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91951.log: /var/log/ceph/ceph-client.admin.98881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118845.log 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91951.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91993.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98881.log.gz 2023-10-09T11:48:09.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114022.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91993.log.gz 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111299.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3%gzip -5 /var/log/ceph/ceph-client.admin.114022.log: --verbose -- replaced with /var/log/ceph/ceph-client.admin.118845.log.gz-- 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95871.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111299.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114022.log.gz 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102499.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100111.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95871.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111299.log.gz 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90816.log 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95871.log.gz 2023-10-09T11:48:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113388.log 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100111.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102499.log.gz 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102993.log 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100111.log.gz 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115337.log 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113388.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90816.log.gz 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102993.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113388.log.gz 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101674.log 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95743.log 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102993.log.gz 2023-10-09T11:48:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115337.log: /var/log/ceph/ceph-client.admin.101674.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115337.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104606.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88147.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95743.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101674.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104606.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.108935.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95743.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105781.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88147.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104606.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88483.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88147.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87180.log 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105781.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108935.log.gz 2023-10-09T11:48:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97760.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105781.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87180.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88483.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87180.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99631.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97760.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105236.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104858.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93992.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99631.log.gz 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95997.log 2023-10-09T11:48:09.352 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105236.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93992.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104858.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89025.log 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93992.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101394.log 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114064.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95997.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98185.log 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91506.log 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89025.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.114064.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101394.log.gz 2023-10-09T11:48:09.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98493.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98185.log.gz 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118551.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91506.log: /var/log/ceph/ceph-client.admin.98493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96081.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91506.log.gz 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98493.log.gz 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95785.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96081.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118551.log.gz 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96081.log.gz 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103802.log 2023-10-09T11:48:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88817.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95785.log: /var/log/ceph/ceph-client.0.103802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110098.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103802.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95785.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98401.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88817.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110476.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101869.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98401.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110098.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97968.log 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98401.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110476.log.gz 2023-10-09T11:48:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98621.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107656.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97968.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101869.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107105.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97968.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98621.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104522.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107105.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107656.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107740.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107105.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104522.log.gz 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97676.log 2023-10-09T11:48:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105687.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107740.log: /var/log/ceph/ceph-client.admin.97676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108675.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107740.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90858.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97676.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105909.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105687.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107488.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90858.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108675.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105909.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90858.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107488.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105909.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107488.log.gz 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89445.log 2023-10-09T11:48:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115908.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110392.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89445.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115908.log: /var/log/ceph/ceph-client.admin.110392.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115908.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110392.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113514.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88486.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101072.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113514.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88486.log: /var/log/ceph/ceph-client.admin.101072.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88486.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101072.log.gz 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105559.log 2023-10-09T11:48:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117562.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117303.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105559.log.gz 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92342.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92932.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117303.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117562.log.gz 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92342.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.117303.log.gz--verbose 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.100774.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2%/var/log/ceph/ceph-client.admin.92932.log: -- replaced with /var/log/ceph/ceph-client.admin.92342.log.gz 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105110.log 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92932.log.gz 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100774.log: /var/log/ceph/ceph-client.admin.105110.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100774.log.gz 2023-10-09T11:48:09.359 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105110.log.gz 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108633.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104774.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92676.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103081.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108633.log.gz 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111679.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104774.log.gz 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118677.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92676.log.gz 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111679.log: gzip 87.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.103081.log.gz-- 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88146.log 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118677.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111679.log.gz 2023-10-09T11:48:09.360 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118677.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88146.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102541.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115686.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102541.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116999.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102541.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115686.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113264.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102121.log 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116999.log: /var/log/ceph/ceph-client.admin.113264.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116999.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113264.log.gz 2023-10-09T11:48:09.361 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102121.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110602.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112517.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109585.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0%/var/log/ceph/ceph-client.admin.112517.log: -- replaced with /var/log/ceph/ceph-client.admin.110602.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99799.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112517.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116036.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109585.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108418.log 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99799.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116036.log: /var/log/ceph/ceph-client.admin.108418.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116036.log.gz 2023-10-09T11:48:09.362 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108418.log.gz 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116941.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100238.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93194.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116941.log.gz/var/log/ceph/ceph-client.admin.100238.log: 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93194.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100238.log.gz 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99757.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93194.log.gz 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110770.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111205.log 2023-10-09T11:48:09.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110770.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99757.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110770.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111205.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98535.log 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105152.log 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101156.log 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98535.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105152.log: /var/log/ceph/ceph-client.admin.101156.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105152.log.gz 2023-10-09T11:48:09.365 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101156.log.gz 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100009.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95607.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110056.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100009.log.gz 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95607.log: /var/log/ceph/ceph-client.admin.110056.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95607.log.gz 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110056.log.gz 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104816.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108851.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100732.log 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104816.log.gz 2023-10-09T11:48:09.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97531.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99007.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100732.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108851.log.gz 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111427.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100732.log.gz 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99007.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97531.log.gz 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99007.log.gz 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111427.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111427.log.gz 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115950.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118593.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97906.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95521.log 2023-10-09T11:48:09.367 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115950.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112025.log 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118593.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.95521.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.116738.log 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97906.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112025.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95521.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108070.log 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112811.log 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112025.log.gz/var/log/ceph/ceph-client.admin.116738.log: 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108070.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116738.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112811.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108070.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112811.log.gz 2023-10-09T11:48:09.368 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104984.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117520.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.104984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92550.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104984.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117520.log: /var/log/ceph/ceph-client.admin.92550.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117520.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92550.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99673.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106035.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92760.log 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99673.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106035.log: /var/log/ceph/ceph-client.admin.92760.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106035.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92760.log.gz 2023-10-09T11:48:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116593.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91211.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.116593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100280.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116593.log.gz 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111341.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.91211.log: /var/log/ceph/ceph-client.admin.100280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97802.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91211.log.gz 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100280.log.gz 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106437.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116676.log 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111341.log.gz 2023-10-09T11:48:09.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118341.log 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97802.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116676.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106437.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116676.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118341.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103609.log 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94034.log 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94454.log 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.94034.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.106161.log 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103609.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94454.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94034.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94454.log.gz 2023-10-09T11:48:09.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.106161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114665.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105865.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106161.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105951.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114665.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105865.log: /var/log/ceph/ceph-client.admin.105951.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105865.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105951.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88818.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112383.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116204.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88818.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112383.log: /var/log/ceph/ceph-client.admin.116204.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112383.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116204.log.gz 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102289.log 2023-10-09T11:48:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107572.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115043.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102289.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98797.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103459.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115043.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107572.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98797.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115043.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103459.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98797.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88145.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103459.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113472.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96700.log 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88145.log.gz 2023-10-09T11:48:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108977.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100648.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96700.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113472.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113980.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96700.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88484.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108977.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90328.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100648.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87673.log 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88484.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113980.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88484.log.gz 2023-10-09T11:48:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87673.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90328.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87673.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89403.log 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105993.log 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89613.log 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89403.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109860.log 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111511.log 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89613.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105993.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109860.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89613.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111511.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109860.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111511.log.gz 2023-10-09T11:48:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97020.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93362.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90900.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97020.log.gz 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89739.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95394.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93362.log.gz 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116162.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90900.log.gz 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95394.log: /var/log/ceph/ceph-client.admin.116162.log: 88.8% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89739.log.gz -- replaced with /var/log/ceph/ceph-client.admin.95394.log.gz 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116162.log.gz 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115770.log 2023-10-09T11:48:09.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103291.log 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111469.log 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.103291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109944.log 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115770.log.gz 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103291.log.gz 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101201.log 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98451.log 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109944.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111469.log.gz 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101201.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109944.log.gz 2023-10-09T11:48:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98451.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101201.log.gz 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98451.log.gz 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87799.log 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117916.log 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87799.log.gz 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.117916.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117916.log.gz 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88820.log 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114368.log 2023-10-09T11:48:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111249.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88820.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114368.log: /var/log/ceph/ceph-client.admin.111249.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114368.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90984.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111249.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102603.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.90984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117856.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90984.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117856.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102603.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117856.log.gz 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87310.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117478.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100862.log 2023-10-09T11:48:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117478.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87310.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100862.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117478.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100862.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94977.log 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110686.log 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87547.log 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110686.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94977.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115253.log 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0%/var/log/ceph/ceph-client.admin.87547.log: -- replaced with /var/log/ceph/ceph-client.admin.110686.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87547.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115253.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115253.log.gz 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117177.log 2023-10-09T11:48:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96386.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110833.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.96386.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117177.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96386.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110833.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110833.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97321.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106634.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117135.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.106634.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97321.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106634.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117135.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117135.log.gz 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108252.log 2023-10-09T11:48:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102951.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112643.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108252.log.gz/var/log/ceph/ceph-client.admin.102951.log: 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112643.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102951.log.gz 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112643.log.gz 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112467.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101030.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95111.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101030.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112467.log.gz 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95111.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101030.log.gz 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95111.log.gz 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102907.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107614.log 2023-10-09T11:48:09.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111383.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4%/var/log/ceph/ceph-client.admin.107614.log: -- replaced with /var/log/ceph/ceph-client.admin.102907.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111383.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107614.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87883.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111383.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115442.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92718.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87883.log: /var/log/ceph/ceph-client.admin.115442.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87883.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115442.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92718.log.gz 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95027.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110266.log 2023-10-09T11:48:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110224.log 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110266.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95027.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110224.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110266.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110224.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99841.log 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95955.log 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.99841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117772.log 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99841.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95955.log: /var/log/ceph/ceph-client.admin.117772.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95955.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117772.log.gz 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92179.log 2023-10-09T11:48:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118887.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118803.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92179.log.gz 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118887.log: /var/log/ceph/ceph-client.admin.118803.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118887.log.gz 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118803.log.gz 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118425.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102331.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118425.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118425.log.gz 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.102331.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102331.log.gz 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95069.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94706.log 2023-10-09T11:48:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.95069.log: /var/log/ceph/ceph-client.admin.94706.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95069.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94706.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89487.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89873.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.89487.log: /var/log/ceph/ceph-client.admin.89873.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89487.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89873.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94496.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108717.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94496.log: /var/log/ceph/ceph-client.admin.108717.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94496.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108717.log.gz 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86795.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115085.log 2023-10-09T11:48:09.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86795.log: /var/log/ceph/ceph-client.admin.115085.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86795.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115085.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88481.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115127.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88481.log: /var/log/ceph/ceph-client.admin.115127.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88481.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115127.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107782.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111553.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107782.log: /var/log/ceph/ceph-client.admin.111553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107782.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111553.log.gz 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87841.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116891.log 2023-10-09T11:48:09.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87841.log: /var/log/ceph/ceph-client.admin.116891.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87841.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116891.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115520.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97573.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115520.log: /var/log/ceph/ceph-client.admin.97573.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115520.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97573.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109127.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109543.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109127.log: /var/log/ceph/ceph-client.admin.109543.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109127.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109543.log.gz 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116832.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108591.log 2023-10-09T11:48:09.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116832.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113728.log 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108591.log: /var/log/ceph/ceph-client.admin.113728.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108591.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113728.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111637.log 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87054.log 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111637.log: /var/log/ceph/ceph-client.admin.87054.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111637.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87054.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93024.log 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102037.log 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.93024.log: /var/log/ceph/ceph-client.admin.102037.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93024.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102037.log.gz 2023-10-09T11:48:09.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112871.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111984.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112871.log: /var/log/ceph/ceph-client.0.111984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112871.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111984.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86968.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113896.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.86968.log: /var/log/ceph/ceph-client.admin.113896.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86968.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113896.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108547.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110911.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108547.log: /var/log/ceph/ceph-client.admin.110911.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108547.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110911.log.gz 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97195.log 2023-10-09T11:48:09.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112956.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97195.log: /var/log/ceph/ceph-client.admin.112956.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97195.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112956.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101114.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99312.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101114.log: /var/log/ceph/ceph-client.0.99312.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101114.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99312.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114427.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112559.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114427.log: /var/log/ceph/ceph-client.admin.112559.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114427.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112559.log.gz 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92119.log 2023-10-09T11:48:09.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118929.log 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92119.log: /var/log/ceph/ceph-client.admin.118929.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92119.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118929.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88150.log 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109449.log 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.88150.log: /var/log/ceph/ceph-client.admin.109449.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88150.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109449.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115295.log 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91783.log 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115295.log: /var/log/ceph/ceph-client.admin.91783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115295.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91783.log.gz 2023-10-09T11:48:09.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107885.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107885.log.gz 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96978.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102163.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.96978.log: /var/log/ceph/ceph-client.admin.102163.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96978.log.gz 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102163.log.gz 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90691.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100946.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.90691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90691.log.gz 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100946.log.gz 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110434.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88149.log 2023-10-09T11:48:09.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110434.log: /var/log/ceph/ceph-client.admin.88149.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110434.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88149.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110728.log 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110728.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110728.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106630.log 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92982.log 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.106630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106630.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.92982.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92982.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105298.log 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115728.log 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.105298.log: 88.2%/var/log/ceph/ceph-client.admin.115728.log: -- replaced with /var/log/ceph/ceph-client.admin.105298.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115728.log.gz 2023-10-09T11:48:09.416 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117604.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92844.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117604.log: /var/log/ceph/ceph-client.admin.92844.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117604.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92844.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87757.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104690.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.87757.log: /var/log/ceph/ceph-client.admin.104690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87757.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104690.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111787.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113686.log 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111787.log: /var/log/ceph/ceph-client.admin.113686.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111787.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113686.log.gz 2023-10-09T11:48:09.417 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112425.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116396.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112425.log: /var/log/ceph/ceph-client.admin.116396.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112425.log.gz 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116396.log.gz 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99883.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.99883.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99883.log.gz 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97718.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.97718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97718.log.gz 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98357.log 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.98357.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98357.log.gz 2023-10-09T11:48:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94935.log 2023-10-09T11:48:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.94935.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94935.log.gz 2023-10-09T11:48:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107530.log 2023-10-09T11:48:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107530.log.gz 2023-10-09T11:48:09.419 INFO:teuthology.orchestra.run.smithi006.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T11:48:09.428 INFO:teuthology.orchestra.run.smithi006.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T11:48:09.520 INFO:teuthology.orchestra.run.smithi118.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T11:48:09.537 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T11:48:09.572 INFO:teuthology.orchestra.run.smithi118.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T11:48:09.820 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T11:48:09.882 INFO:teuthology.orchestra.run.smithi118.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T11:48:09.952 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T11:48:09.986 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T11:48:10.008 INFO:teuthology.orchestra.run.smithi118.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T11:48:10.010 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-10-09T11:48:10.010 INFO:teuthology.orchestra.run.smithi118.stderr:real 0m0.871s 2023-10-09T11:48:10.010 INFO:teuthology.orchestra.run.smithi118.stderr:user 0m4.082s 2023-10-09T11:48:10.011 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m0.170s 2023-10-09T11:48:10.043 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T11:48:10.081 INFO:teuthology.orchestra.run.smithi006.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T11:48:10.230 INFO:teuthology.orchestra.run.smithi006.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T11:48:10.274 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T11:48:10.276 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-09T11:48:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m1.158s 2023-10-09T11:48:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m4.790s 2023-10-09T11:48:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.491s 2023-10-09T11:48:10.276 INFO:tasks.ceph:Archiving logs... 2023-10-09T11:48:10.276 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi006/log 2023-10-09T11:48:10.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T11:48:11.429 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi118/log 2023-10-09T11:48:11.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T11:48:11.949 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T11:48:11.958 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T11:48:11.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T11:48:11.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T11:48:12.043 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T11:48:12.052 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T11:48:12.052 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:48:12.054 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T11:48:12.068 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-09T11:48:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:210 Number of sources = 4 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 -23us[ -13us] +/- 68ms 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 +88us[ +98us] +/- 69ms 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -34us[ -24us] +/- 67ms 2023-10-09T11:48:12.071 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:210 Number of sources = 4 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 -25us[-7875ns] +/- 68ms 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 +97us[ +114us] +/- 69ms 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -14us[ -14us] +/- 67ms 2023-10-09T11:48:12.072 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T11:48:12.074 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T11:48:12.082 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T11:48:12.083 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T11:48:12.091 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T11:48:12.235 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T11:48:12.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:48:12.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:48:12.360 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T11:48:12.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:48:12.390 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T11:48:12.399 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T11:48:12.408 INFO:teuthology.task.internal:Duration was 1399.013872 seconds 2023-10-09T11:48:12.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T11:48:12.416 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T11:48:12.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T11:48:12.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T11:48:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:48:12.474 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T11:48:12.635 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T11:48:12.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-10-09T11:48:12.635 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T11:48:12.654 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-10-09T11:48:12.654 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T11:48:12.673 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T11:48:12.673 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T11:48:12.696 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T11:48:12.752 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T11:48:12.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T11:48:12.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T11:48:12.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T11:48:12.877 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T11:48:12.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T11:48:12.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T11:48:12.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T11:48:12.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:48:12.945 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:48:12.967 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-10-09T11:48:12.991 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-10-09T11:48:13.004 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:48:13.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:48:13.036 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T11:48:13.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T11:48:13.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T11:48:13.067 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T11:48:13.068 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi006 2023-10-09T11:48:13.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T11:48:13.115 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423/remote/smithi118 2023-10-09T11:48:13.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T11:48:13.150 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T11:48:13.150 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T11:48:13.153 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T11:48:13.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T11:48:13.209 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T11:48:13.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T11:48:13.218 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T11:48:13.219 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T11:48:13.221 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T11:48:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 11:48 /home/ubuntu/cephtest 2023-10-09T11:48:13.254 INFO:teuthology.orchestra.run.smithi118.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 11:48 /home/ubuntu/cephtest 2023-10-09T11:48:13.255 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T11:48:13.265 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T11:48:13.284 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T11:48:13.309 DEBUG:teuthology.nuke:shortname: smithi006 2023-10-09T11:48:13.309 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:48:13.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.244289', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbPPd4qgmh4rOUyLxbWXr31ScyeBsHgy2YCgau6CW/kJj2R1U/IbwHWREVU0lCO50r3uNbB0SfJdtnBbcB4IKk='} 2023-10-09T11:48:13.335 DEBUG:teuthology.nuke:shortname: smithi118 2023-10-09T11:48:13.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T11:48:13.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_11:13:22-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 11:14:37.246048', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDceSactrI1vpiOAbWL7HOQAHEujhYkixJ9U/iCrhQ6ukDarDM/3FBgtruKQ8aFRD37qGoaH1bAEP5KqM1vZCPY='} 2023-10-09T11:48:13.388 INFO:teuthology.orchestra.console.smithi006:Power off 2023-10-09T11:48:13.388 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:48:13.416 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-10-09T11:48:13.416 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:13.429 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-09T11:48:13.429 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T11:48:13.436 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-09T11:48:13.451 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-09T11:48:13.451 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:13.481 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-09T11:48:17.438 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:17.482 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:17.547 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-09T11:48:17.590 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-09T11:48:21.548 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:21.591 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:21.657 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-09T11:48:21.700 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-09T11:48:21.800 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-09T11:48:25.661 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T11:48:25.770 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-10-09T11:48:25.870 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-10-09T11:48:25.975 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1399.013872385025 failure_reason: '"1696851350.512159 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 219533.586260 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-10-09T11:48:25.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T11:48:26.057 INFO:teuthology.run:FAIL